Software Development Engineer

Join HackerRank's Astra Team: Engineering the Future of AI for Developers

About Astra

Astra is HackerRank's newest frontier, a data and benchmarking platform powering the next generation of AI coding models. We are transforming HackerRank's decade of developer expertise into curated datasets, automated benchmarks, and human-in-the-loop evaluation systems that help leading AI labs train and measure their models.

Astra sits at the intersection of software engineering, data infrastructure, and AI research, where you will build the foundation for a product that makes AI better at coding.

Why this role matters

AI models can now write code, but teaching them to code well requires real developer data and rigorous evaluation systems. Astra's mission is to supply that intelligence to the world's top labs and enterprises.

As a Software Engineer on Astra, you will:

• Build high-scale data and benchmarking pipelines that turn developer interactions into structured training data.
• Design APIs and systems for code dataset creation, evaluation, and delivery.
• Work closely with ML scientists and data experts to create the tools that fuel reinforcement learning environments and model fine-tuning.
• Contribute to Astra Arena, our next-generation DPO-style evaluation platform for LLMs in software engineering.

What you'll work on

• Automated task creation and evaluation systems (expanding SWE-Bench and internal tooling).
• Data APIs that expose curated coding datasets to customers and model labs.
• Annotation and feedback tooling for human-in-the-loop benchmarking.
• Experimental RL "gyms" for code generation models, built on real developer workflows.

What we're looking for

• Strong software engineering fundamentals, with full-stack or backend experience.
• Background in distributed systems, data processing, or ML infrastructure.
• Interest in AI, coding models, or human-in-the-loop systems.
• Comfort operating in early-stage environments where ambiguity is common and ownership is broad.
• Bonus: contributions to open-source AI frameworks or developer platforms

Why join

• Shape the foundation of a new business that connects AI and developer intelligence
• Collaborate with a tight-knit team of engineers, researchers, and data experts.
• Build technology that powers AI model evaluation and training for top global labs.
• Competitive compensation and meaningful equity in a high-growth business line
• You will help teach AI how to code by building the data and systems that make it possible.

Compensation

• Base salary range: $150,000 - $172,000.
• This range doesn't include bonuses, stock options, or benefits for which you will be eligible.
• Final offer may vary based on skills, experience, location, and other compensation components.