Data Testing Engineer (Lead)

Role Overview 

The Lead Data Testing Engineer supports large-scale financial data platforms that power lending and credit operations. This role focuses on validating high-volume batches and streaming data pipelines, ensuring data accuracy, integrity, and regulatory compliance across Hadoop-based ecosystems and Kafka-driven real-time data flows. The ideal candidate brings deep expertise in data validation, automation, Agile delivery, and a strong passion for driving quality and innovation within the financial services platform.Key Responsibilities 

• Design, develop, and execute data validation and testing strategies for large-scale financial datasets exceeding 5M+ customer records 

• Validate batch and streaming data pipelines, including Kafka, ETL/ELT processes, and Hadoop-based platforms spanning multiple technologies 

• Perform end-to-end testing of lending and credit data flows from source systems through downstream analytics and reporting layers 

• Build and maintain automated data testing frameworks for regression, reconciliation, and anomaly detection 

• Develop SQL-based and programmatic test scripts to validate data completeness, accuracy, timeliness, and data lineage 

• Partner with data engineers, developers, and business stakeholders to define data quality standards and acceptance criteria 

• Identify root causes of data defects and collaborate with teams on remediation strategies 

• Support regulatory, audit, and compliance requirements through strong data governance and documentation practices 

• Actively participate in Agile ceremonies, sprint planning, and continuous improvement initiatives 

• Champion innovation by introducing modern testing tools, automation practices, and monitoring solutions 

Required Qualifications 

• 5–10 years of experience in data testing, data quality, or analytics QA roles 

• Strong experience within financial services, preferably lending, credit, or risk platforms 

• Proven experience testing high-volume datasets (5M+ records) 

• Hands-on experience with: 

• Hadoop ecosystem (Hive, HDFS, Spark, etc.) 

• Kafka or similar streaming platforms 

• Batch ETL/ELT pipelines 

• Relational and analytical databases 

• Advanced SQL skills for data validation and reconciliation 

• Experience with test automation frameworks and scripting languages (Python, Java, Scala, or similar) 

• Strong understanding of data modeling, data warehousing, and lineage concepts 

• Experience working in Agile/Scrum environments 

• Excellent analytical, problem-solving, and communication skills 

Skills 

• QA Testing (Mostly automation) 5-10 years 
• Lending product knowledge 2-3 years 
• Data lifecycle 5-10 years 
• Hadoop / Kafka - 4+ years 
• Agile Development Lifecycle –4 years

Locations: Pittsburgh, PA  Work Model:On-Site 5 Days Per Week 

About Techstra Solutions 

Techstra Solutions helps leading organizations unlock the value of Digital and Talent Transformation. We combine business strategy, technology, and talent to guide clients through complex transformation journeys—from strategy through execution. We deliver our expertise through consulting, innovative staffing solutions, and software development, always focused on measurable outcomes and long-term impact. 

Equal Employment Opportunity Statement

Techstra Solutions is an equal opportunity employer. The Company makes its decisions on merit, and its policy of equal opportunity prohibits discrimination in all phases of the employment process, including, but not limited to, recruitment, hiring, promotion, selection, transfer, demotion, layoff, termination, compensation, benefits, and other terms and conditions of employment. The policy of equal opportunity applies without regard to race, color, creed, religion, gender,, sexual orientation, gender identification, pregnancy, marital status, national origin, ancestry, age, disability that can reasonably be accommodated without undue hardship, military status, veteran status, genetic predisposition or carrier status, alienage or citizenship, domestic partnership status, arrest or conviction record, status as a victim of domestic violence, or any other protected categories under federal, state, or local law. The Company also prohibits discrimination or harassment based upon the perception that a person has, or is associated with a person who has, any of these characteristics.

Powered by JazzHR