E logo

Lead Data Architect / Data Engineer

eStaffLLCSacramento, CA

Overview

Remote
On-site

Job Description

We are seeking a hands-on Lead Data Architect/Data Engineer for a hybrid assignment with our Sacramento, California-based client, helping define architecture and deliver production-grade pipelines across multiple phases of a Databricks platform.

Responsibilities include:

* Build and maintain automated ingestion and transformation pipelines that bring data from:

o public portals and open data sources

o REST APIs

o internal departmental databases and systems

into Delta tables in Databricks.

* Partner with the Program Manager to establish and maintain:

o platform architecture

o naming conventions and standards

o technical documentation

* Collaborate with the Data Hub governance group to support decisions on:

o platform and data architecture

o data sharing patterns

o data contracts and data ownership

o data quality and reliability standards

* Design recommendations for protecting sensitive data, including:

o row-level and column-level access controls

o separation of confidential/internal data from public datasets

* Improve reliability through:

o monitoring and alerting

o data quality checks and validation frameworks

* Enable discoverability and usability by publishing datasets and documentation that support plain-language exploration and AI-enabled analysis tools.

* Write and maintain skill files (instruction files for AI coding assistants) to enforce consistent pipeline patterns and development standards.

* Support and enable other departments to build pipelines using shared templates and best practices.

Requirements:

* Strong leadership experience, including executive-level stakeholder engagement

* 7+ years in data engineering, data architecture, or closely related roles

* Proven experience delivering large-scale, enterprise data engineering / architecture initiatives

* Strong hands-on expertise in Python and SQL

* Experience with Apache Spark or cloud data platforms such as:

o Databricks (strongly preferred)

o Snowflake, BigQuery, or similar

* Experience integrating data from REST APIs, databases, and other source systems

* Excellent communication skills with strong writing and documentation practices

Preferred

* Hands-on Databricks experience with:

o Delta Lake

o Unity Catalog

o Databricks Jobs

* Experience governing sensitive/confidential data (access control, masking, privacy requirements)

* Experience operating within a data governance program (stewardship, data contracts, cross-agency sharing agreements)

* Experience writing skill files, prompts, or instruction sets for AI coding assistants

* Experience with GIS / location-based datasets

Automate your job search with Sonara.

Submit 10x as many applications with less effort than one manual application.

pay-wall

FAQs About Lead Data Architect / Data Engineer Jobs at eStaffLLC

What is the work location for this position at eStaffLLC?
This job at eStaffLLC is located in Sacramento, CA, according to the details provided by the employer. Some roles may also include multiple work locations depending on the requirement.
What pay range can candidates expect for this role at eStaffLLC?
Employer has not shared pay details for this role.
What employment applies to this position at eStaffLLC?
The employer has not provided this information. This may be discussed during the hiring process.
What is the process to apply for this position at eStaffLLC?
You can apply for this role at eStaffLLC either through Sonara's automated application system, which helps you submit applications 10X faster with minimal effort, or by applying manually using the direct link on the job page.