S logo

Data Architect (Hands-On Lead Data Engineer) - Need - Bfsi Experience - Full- Time Position

Sidram TechnologiesCary, NC

Overview

Remote
On-site

Job Description

Job Title: Data Architect (Hands-On Lead Data Engineer) Need - BFSI Experience

Employment Type: Full-Time

Location: Cary, NC

Work Model: Hybrid Onsite Tuesday through Thursday required from Day 1

Experience: 12 18 Years (Minimum 10 15+ years of relevant data engineering and architecture experience)

Role Overview

We are seeking a deeply technical, hands-on Data Architect / Lead Data Engineer to join Altimetrik in support of our premier insurance client, MetLife, in Cary, NC. This is a hybrid, hands-on engineering and architectural leadership role-not a purely managerial or coordination position. The ideal candidate will actively design, code, and deploy enterprise-scale Lakehouse platforms on Azure Databricks while leading the implementation of production Generative AI (LLM/RAG) and automated financial data reconciliation solutions.

Key Responsibilities
  • Enterprise Lakehouse Architecture: Design, architect, and implement scalable Bronze, Silver, and Gold Medallion architectures using Azure Databricks, Delta Lake, ADLS Gen2, and Azure Data Factory (ADF).

  • Hands-On Data Engineering: Write, review, and optimize production-grade data pipelines using Python, PySpark, Scala, and SQL, focusing on metadata-driven ingestion frameworks, Spark performance tuning, and data quality.

  • Production GenAI & LLM Solutions: Architect and deploy production-ready LLM and Retrieval-Augmented Generation (RAG) workflows-including embeddings, vector retrieval, prompt engineering, and enterprise Text-to-SQL or semantic layer solutions.

  • AI-Driven Financial & Data Quality Automation: Build automated reconciliation, anomaly detection, and AI-driven data quality pipelines tailored to financial services, general ledger, and accounting datasets.

  • Governance, Security & MLOps/LLMOps: Implement Unity Catalog, fine-grained access controls, PII data protection, and robust CI/CD pipelines (Azure DevOps, Terraform, Databricks Asset Bundles) alongside model evaluation and production AI monitoring.

  • Technical Leadership: Provide architectural guidance, conduct code reviews, and mentor data engineering teams while remaining actively involved in daily production coding.

Required Qualifications
  • Experience: 12 18 years of progressive experience in data engineering, enterprise data architecture, and distributed big data processing, with demonstrated recent hands-on production coding experience.

  • Core Programming: Expert-level, production-grade proficiency in Python, PySpark, Scala, and SQL.

  • Azure Data Ecosystem: Strong hands-on expertise in Azure Databricks (Delta Lake, Spark performance tuning, Jobs/Workflows, Unity Catalog), ADLS Gen2, and Azure Data Factory (ADF).

  • Medallion & Pipeline Engineering: Proven track record implementing enterprise Lakehouse/Medallion architectures and metadata-driven ingestion frameworks at scale.

  • Production Generative AI & LLMs: Hands-on experience designing and deploying production LLM/RAG solutions utilizing frameworks such as LangChain, LlamaIndex, or LangGraph, integrated with Azure OpenAI, OpenAI, or Databricks Model Serving.

  • DevOps & Infrastructure as Code: Experience automating data and AI deployments using Azure DevOps (CI/CD), Terraform, and Databricks Asset Bundles.

  • Data Security & Governance: Strong understanding of Azure security frameworks, data governance, PII protection, and role/attribute-based access controls.

Preferred Qualifications
  • Domain Expertise: Prior experience in insurance or financial services, specifically working with general ledger (GL), accounting, or financial reconciliation data.

  • Advanced AI & Semantic Architectures: Hands-on experience building knowledge graphs, ontologies, semantic layers, enterprise Text-to-SQL applications, and MLOps/LLMOps monitoring pipelines.

Best Regards,

Arun | Sr US IT Recruiter

SIDRAM TECHNOLOGIES

IT Services | Development | Staffing

URL: http:/www.sidramtech.com | Email:arun

Adam@sidramtech.com

Automate your job search with Sonara.

Submit 10x as many applications with less effort than one manual application.

pay-wall

FAQs About Data Architect (Hands-On Lead Data Engineer) - Need - Bfsi Experience - Full- Time Position Jobs at Sidram Technologies

What is the work location for this position at Sidram Technologies?
This job at Sidram Technologies is located in Cary, NC, according to the details provided by the employer. Some roles may also include multiple work locations depending on the requirement.
What pay range can candidates expect for this role at Sidram Technologies?
Employer has not shared pay details for this role.
What employment applies to this position at Sidram Technologies?
The employer has not provided this information. This may be discussed during the hiring process.
What is the process to apply for this position at Sidram Technologies?
You can apply for this role at Sidram Technologies either through Sonara's automated application system, which helps you submit applications 10X faster with minimal effort, or by applying manually using the direct link on the job page.