Staff Software Engineer, AI Phone Assistant

Your Impact on Our Mission

Help shape the future of healthcare communication by building Zocdoc's AI Phone Assistant Zo, an intelligent voice agent that answers inbound calls for hospitals and doctor's offices. This is a high-impact, high-growth initiative where you'll help design, build, and scale AI systems that are redefining how patients and providers connect.

This team builds with emerging tools and approaches, continuously researching, experimenting, and evaluating how AI systems behave in production. Our focus is on designing intelligent flows, orchestration, and decision-making - not just individual model calls.

Engineers on this team take ideas from early exploration through production and continue evolving them based on real usage.

Your Day to Day

• Architect, build, and maintain high-quality, scalable software systems that power Zocdoc's AI Phone Assistant.
• Design and implement AI-driven workflows, integrating large language models (LLMs) and conversational AI into production systems.
• Lead prompt engineering, model integration, and system optimization to improve accuracy, responsiveness, and reliability.
• Collaborate cross-functionally with product, design, and data science teams to deliver production-grade AI capabilities.
• Drive the evolution of our AI platform - from experimentation and rapid prototyping to scalable, reliable systems in production.
• Ensure system scalability, observability, and performance as the product grows rapidly.
• Stay ahead of the curve on emerging GenAI tools and technologies, and apply them to solve real-world user problems.

You'll Be Successful in This Role If You Have...

• 7+ years of professional software development experience, with at least 2+ years building or integrating AI/ML systems in production environments
• Strong proficiency in C#, and experience with distributed systems and microservices architectures
• Experience working with large language models (LLMs), prompt engineering, or AI-powered conversational interfaces
• Proven ability to design, build, and scale complex, reliable, and high-performance systems
• A deep understanding of data structures, algorithms, and software design principles
• A track record of technical leadership and ownership over major systems or product areas
• Strong collaboration and communication skills - able to partner across disciplines to deliver results
• A passion for leveraging AI to build products that make a real difference in people's lives

Benefits:

• Flexible, hybrid work environment
• Unlimited PTO
• 100% paid employee health benefit options
• Employer funded 401(k) match
• Corporate wellness programs with Wellhub
• Sabbatical leave (for employees with 5+ years of service)
• Competitive parental leave
• Cell phone reimbursement
• Great Place to Work Certified
• Catered lunch everyday along with snacks
• Commuter Benefits
• Convenient Soho location