Data Architect / Data Engineering Consultant

IT MINDS L.L.C.Irving, TX

Apply with Sonara

Automate your job search with Sonara.

Submit 10x as many applications with less effort than one manual application.¹

Reclaim your time by letting our AI handle the grunt work of job searching.

We continuously scan millions of openings to find your top matches.

Overview

Remote

On-site

Job Description

Title:- Data Architect / Data Engineering Consultant

100%Onsite

Location- Irving, TX.

Required Qualifications

12-15 years in data architecture, data engineering, or enterprise architecture.

7 or more Hands-on development background.

Experience with Databricks and Snowflake.

And/or-

Strong expertise in data warehousing, Lakehouse architecture, ETL/ELT, data modeling, and event-driven integration.

Experience in regulated financial services.

We are looking for a hands-on Data Architect / Data Engineering Consultant with strong expertise in Python, PySpark, Spark optimization, distributed data processing, Hive/Impala, SQL, and production ETL troubleshooting.

The consultant will be responsible for understanding end-to-end data flows, developing and troubleshooting data pipelines, optimizing distributed processing workloads, performing SQL-based data reconciliation, and supporting production data platforms.

Key Responsibilities

Design, develop, enhance, and troubleshoot ETL/ELT data pipelines.
Develop and maintain data processing solutions using Python and PySpark.
Work extensively with Apache Spark, including performance tuning and optimization.
Analyze Spark jobs to identify performance bottlenecks related to partitions, shuffles, joins, data skew, caching, serialization, and resource utilization.
Work with distributed data processing concepts and large-volume datasets.
Develop complex SQL queries for data transformation, validation, reconciliation, and troubleshooting.
Perform source-to-target reconciliation and investigate data discrepancies.
Work with Hive and Impala for querying and processing large datasets.
Troubleshoot production ETL failures, data quality issues, performance problems, and batch-processing failures.
Perform root-cause analysis and implement permanent fixes for recurring production issues.
Understand and troubleshoot end-to-end data flows, from source systems through ETL processing to downstream consumers.
Work with Linux environments, shell commands, batch processing, and job scheduling.
Collaborate with engineering, application, and business teams to resolve complex data issues.
Participate in technical design discussions and provide recommendations for scalable and maintainable data solutions.
Document technical designs, data flows, troubleshooting procedures, and production resolutions.

Automate your job search with Sonara.

Submit 10x as many applications with less effort than one manual application.

Apply with Sonara Apply manually

FAQs About Data Architect / Data Engineering Consultant Jobs at IT MINDS L.L.C.

What is the work location for this position at IT MINDS L.L.C.?

This job at IT MINDS L.L.C. is located in Irving, TX, according to the details provided by the employer. Some roles may also include multiple work locations depending on the requirement.

What pay range can candidates expect for this role at IT MINDS L.L.C.?

Employer has not shared pay details for this role.

What employment applies to this position at IT MINDS L.L.C.?

The employer has not provided this information. This may be discussed during the hiring process.

What is the process to apply for this position at IT MINDS L.L.C.?

You can apply for this role at IT MINDS L.L.C. either through Sonara's automated application system, which helps you submit applications 10X faster with minimal effort, or by applying manually using the direct link on the job page.