Senior Data Engineer

WHAT YOU WILL GET TO DO

• Responsible for designing and building optimized data pipelines, in an on-prem or cloud environment for the purpose of driving analytic insights.
• Create the conceptual, logical, and physical data models.
• Develop and implement end-to-end data pipelines and data integration solutions using cloud platforms such as AWS or GCP.
• Architect end-to-end data solutions ensuring integration across cloud platforms (AWS, GCP) with optimized ETL pipelines.
• Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of sources like Hadoop, Spark, or AWS Lambda.
• Lead solution design and development of web-based data applications, providing technical direction on the front-end frameworks such as React.js, Vue.js, and SmartGWT to build interactive interfaces that support analytics and data exploration.
• Design, develop, test, deploy, maintain and improve data integration pipeline.
• Implement and manage CI/CD pipelines using Jenkins or GitHub Actions to automate the development, testing, and deployment of data engineering solutions.
• Guide the adoption of development best practices including version control (GIT), CI/CD pipelines, automated testing, and performance tuning.
• Develop pipeline objects using Apache Spark / PySpark/ Python or Scala.
• Develop and maintain RESTful APIs and backend services to support data processing workflows and integration between data pipelines and user-facing systems.
• Lead and/or mentor a small team of Data Engineers.
• Communicate effectively with client leadership and business stakeholders.
• Participate in proposal and/or SOW development.

WHAT YOU BRING TO THE TEAM

• Bachelor's Degree in Computer Science, Software Engineering, Data Analytics, Information Technology or related field plus 4 years of experience as a Data Engineer, Applications Developer, Programming, or Technical Lead or related occupations.
• 4 years of experience in the following: Web-based mobile application development using at least one of the following technologies: React, Vue, NodeJS, REST based Web services, Python, and Java; Programming experience using Scala, Python, or Java.
• 3 years of experience in the following: Working with at least one of the following databases: Snowflake, AWS Redshift, Oracle, or SQL; Utilization of SQL to write complex, highly-optimized queries across large volumes of data; Implementing ETL pipelines using at least one of the following AWS services: Lambda, S3, API Gateway, SNS, or SQS.

• Telecommuting is permitted. Must also have authority to work permanently in the U.S. Applicants who are interested in this position may apply at www.jobpostingtoday.com Ref #95698 for consideration.

BENEFITS

• Health Care Plan (Medical, Dental & Vision)
• Retirement Plan (401k, IRA)
• Life Insurance (Basic, Voluntary & AD&D
• Unlimited Paid Time Off (Vacation, Sick & Public Holidays)
• Short Term & Long Term Disability
• Employee Assistance Program
• Training & Development
• Work From Home
• Bonus Program