DevOps/Data Engineer
Pivotal SolutionsFargo, North Dakota
Automate your job search with Sonara.
Submit 10x as many applications with less effort than one manual application.1
Reclaim your time by letting our AI handle the grunt work of job searching.
We continuously scan millions of openings to find your top matches.
Overview
Schedule
Full-time
Career level
Senior-level
Remote
On-site
Job Description
- Drive the infrastructure strategy alongside the rest of the DevOps team
- Be responsible for building, managing, and automating our AWS infrastructure
- Oversee the maintenance and growth of our data lakehouse infrastructure and implementation
- Champion security by adopting necessary tools and processes
- Provide leadership to the entire engineering team on various infrastructure and big data topics
- Identify and adopt high-level technologies, processes, and services that impact the organization on a system-wide scope
- Participate in the L2 rotation for engineering support
Requirements
- 8+ years of experience as a DevOps Engineer
- 5+ years of experience with the AWS cloud platform, including proficiency with AWS SDK, AWS CLI/UI, and services such as VPC, Route53, Private and Public subnets, route tables, IGW, EC2 Instances, CloudFront, API Gateway, IAM, ELB, Autoscaling, CloudWatch, EFS, NFS, EBS, S3, RDS, Lambda, SQS/SNS, Kafka, Security groups, etc.
- 5+ years of experience with Terraform/Terragrunt
- 5+ years of experience with event processing infrastructure
- 2+ years of experience as a Data Engineer with Databricks, including data pipelines, Debezium, Spark, and data modeling
- Expert proficiency with Python
- Model serving experience
- Expert proficiency in deploying, maintaining, and scaling applications
- Proficiency with Docker, Kubernetes, and Serverless functions
- Expert proficiency in setting up CI/CD pipelines (tools/processes/governance)
- Experience creating and maintaining fully automated CI/CD pipelines for code deployment using tools such as Git, CircleCI, AWS Code build, and Code Deploy / Code pipeline
- Proficient with both Relational and Non-Relational databases
- Experience with Security vulnerability scanning tools (Guard Duty, Inspector)
- Experience building Monitoring dashboards and leveraging tools such as Cloudwatch, Datadog, and Sumologic
Automate your job search with Sonara.
Submit 10x as many applications with less effort than one manual application.
FAQs About DevOps/Data Engineer Jobs at Pivotal Solutions
What is the work location for this position at Pivotal Solutions?
This job at Pivotal Solutions is located in Fargo, North Dakota, according to the details provided by the employer. Some roles may also include multiple work locations depending on the requirement.
What pay range can candidates expect for this role at Pivotal Solutions?
Employer has not shared pay details for this role.
What employment applies to this position at Pivotal Solutions?
Pivotal Solutions lists this role as a Full-time position.
What experience level is required for this role at Pivotal Solutions?
Pivotal Solutions is looking for a candidate with "Senior-level" experience level.
What is the process to apply for this position at Pivotal Solutions?
You can apply for this role at Pivotal Solutions either through Sonara's automated application system, which helps you submit applications 10X faster with minimal effort, or by applying manually using the direct link on the job page.