Overview
Schedule
Alternate-schedule
Full-time
Career level
Senior-level
Remote
On-site
Benefits
Health Insurance
401k Matching/Retirement Savings
Job Description
Opportunity
By applying and enforcing standard and best practices, you will design and develop scalable, 24×7 data and reporting services to process billions of events per day. Specific duties will include developing enhancements to our Hadoop/Hive and Redshift based data pipeline and extend to streamed data processing; contributing to data reporting projects including generating internal and external reports or visualizations (CSV, Excel, PDF, interactive web graphics and others) and data distribution / reporting components, real-time bidding or optimization algo using a combination of SQL, Ruby, R, Go, Java, Javascript, D3, Bourne shell scripts, cron jobs, and other relevant technologies. Will also be expected to implement new services and algorithms to improve our product.
The ideal candidate has hands-on data processing experience. Candidate must be familiar with current distributed computing data technologies on commodity servers and have experience with 24×7 production needs.
Requirements
- Strong SQL skills on large-scale databases, knowledge of any of the following RDBMS such as MySQL, Postgres, Redshift, Hive or others.
- Experience with Linux or Unix based systems – including Bourne shell, cron and other Unix utilities.
- Strong software development skills, including experience with Java.
- Degree in Computer Science or a related field.
Desired Technology Experience
- Experience with at least one of Ruby/Python, Bourne Shell or other scripting languages.
- Experience with Hadoop/MapReduce and/or EMR, including experience in developing MapReduce Jobs in Java or developing Hive UDF.
- ETL Experience maintaining multiple data systems.
- Experience with Ooozie or other Hadoop workflow solutions and experience developing complex data processing pipelines, including experience developing regressions tests and deployment strategies for such environments.
- Experience with data reporting solutions – either developed in house or with 3rd party solutions.
- Working experience developing and supporting 24×7 production data services and pipelines on Linux systems – including experience being on-call supporting such services. Experience with AWS preferred.
Challenges we are tackling
- Reliably processing billions of events per day with no data loss 24×7 on commodity hardware.
- Processing events in near real-time.
- Building for the fragility of cloud and distributed services.
- Complex processing of large amounts of data in an efficient manner.
- Reporting, distribution of data, data analysis, data visualization and machine learning algorithms.
- Low latency data stores for use in bidding or algo optimization.
Comp & Benefits
- Competitive comp based on experience level
- Healthcare HMO & PPO
- Stock options and 401k
- Flexible Spending and Transit Reimbursement Accounts
Automate your job search with Sonara.
Submit 10x as many applications with less effort than one manual application.
FAQs About Data/Software Engineer Jobs at Roberts Recruiting
What is the work location for this position at Roberts Recruiting?
This job at Roberts Recruiting is located in Boston, Massachusetts, according to the details provided by the employer. Some roles may also include multiple work locations depending on the requirement.
What pay range can candidates expect for this role at Roberts Recruiting?
Employer has not shared pay details for this role.
What employment applies to this position at Roberts Recruiting?
Roberts Recruiting lists this position under the following employment categories:
- Alternate-schedule
- Full-time
What experience level is required for this role at Roberts Recruiting?
Roberts Recruiting is looking for a candidate with "Senior-level" experience level.
What benefits are offered by Roberts Recruiting for this role?
Roberts Recruiting offers following benefits: Health Insurance and 401k Matching/Retirement Savings for this position. Actual benefits may vary depending on the employer's policies and employment terms.
What is the process to apply for this position at Roberts Recruiting?
You can apply for this role at Roberts Recruiting either through Sonara's automated application system, which helps you submit applications 10X faster with minimal effort, or by applying manually using the direct link on the job page.