Lead AI Software Engineer

Lead Software AI Engineer

At Klaviyo, we believe the future of software lies not in productivity tools for human users but in software that can run and optimize itself based on outcome or reward metrics. We've built the infrastructure and application that serve as the interface between businesses and consumers. We now have over 167,000 customers, billions of consumer profiles, and hundreds of billions of customer messages and follow-on conversion data. We have a big opportunity to build state-of-the-art AI and machine learning technologies at Klaviyo to power our products and develop AI agents that can automatically create and execute marketing or customer experiences, strategies, and campaigns for any business.

As a Lead Software AI Engineer at Klaviyo, you'll set technical direction and drive the design of scalable backend systems and AI-powered user experiences that form the foundation of our AI product strategy. You'll work closely with product managers, machine learning engineers, and data scientists while mentoring engineers and shaping architectural decisions. This is a backend-heavy leadership role with a strong focus on applied AI/ML, including large language models (LLMs) and agentic AI systems.

How You Will Make a Difference

• Lead the design and development of backend systems that enable scalable AI solutions for 167K+ customers.

• Architect robust, reliable, and scalable data pipelines that train and serve AI/ML models at scale.

• Drive the integration of LLMs into production systems, powering AI agents that create and execute real-time customer experiences.

• Establish best practices for model evaluation, monitoring, and performance across generative and agentic AI use cases.

• Mentor and guide engineers, fostering a culture of technical excellence, ownership, and customer-centric product thinking.

• Partner with cross-functional leaders to influence AI product strategy and deliver high-impact solutions.

Who You Are

• 7-10 years of professional software engineering experience, with a strong focus on backend systems and distributed architectures.

• Recent, hands-on experience with AI/ML and LLMs, including fine-tuning, evaluation, and production deployment.

• Proven ability to design and scale distributed systems that support AI-driven applications and agent capabilities.

• Proficient in Python and modern backend frameworks (FastAPI, Django preferred).

• Skilled with big data tools (Apache Spark, Hadoop) and distributed task queues (Kafka, Celery, SQS, RabbitMQ, Redis).

• Experienced in architecting APIs and cloud-native solutions (AWS, Kubernetes, CI/CD pipelines).

• Demonstrated technical leadership - mentoring engineers, shaping architecture, and raising the bar for engineering practices.

• Thrives in a fast-paced, startup-like environment with high autonomy and ownership.

• Curious, adaptable, and motivated to stay on the cutting edge of AI/ML research and apply it to real-world business challenges.

Nice to Have

• Experience training and deploying reinforcement learning systems.

• Prior experience leading cross-functional initiatives involving data science, ML engineering, and product.

We use Covey as part of our hiring and / or promotional process. For jobs or candidates in NYC, certain features may qualify it as an AEDT. As part of the evaluation process we provide Covey with job requirements and candidate submitted applications. We began using Covey Scout for Inbound on April 3, 2025.

Please see the independent bias audit report covering our use of Covey here