AI Infrastructure Engineering (Cloud, DevOps)
Automate your job search with Sonara.
Submit 10x as many applications with less effort than one manual application.1
Reclaim your time by letting our AI handle the grunt work of job searching.
We continuously scan millions of openings to find your top matches.
Overview
Job Description
Location: San Francisco, CA (Onsite | Remote)
About Virtue AI
Virtue AI sets the standard for advanced AI security platforms. Built on decades of foundational and award-winning research in AI security, its AI-native architecture unifies automated red-teaming, real-time multimodal guardrails, and systematic governance for enterprise apps and agents. Deploy in minutes—across any environment—to keep your AI protected and compliant. We are a well-funded, early-stage startup founded by industry veterans, and we're looking for passionate builders to join our core team.
What You’ll Do
As an AI infra Engineer, you will own the reliability, scaling, automation, and operational discipline of Virtue AI’s AI production systems, focusing on deployment and model serving performance.
You will:
Design and maintain deployment workflows for Virtue AI on major cloud providers (e.g., AWS and GCP)
Own IaC (Terraform / Pulumi) for repeatable, auditable customer deployments.
Package our services into secure, customer-ready deployment units (Docker, Helm, Marketplace images).
Design, build, and maintain product CI/CD pipelines using GitHub Actions.
Serve and optimize the LLM inference pipeline; build necessary inference APIs and routers; auto-scaling
Design production-grade system observability (Metrics, logs, alerts, dashboards) using tools like Datadog, Grafana, and Prometheus.
Implement secure networking (VPCs, IAM, service accounts, private endpoints, firewalling).
Collaborate with product developers to align infrastructure and inference behavior with product requirements.
Required Qualifications
Bachelor’s degree or higher in CS, CE, EE, or related field.
Strong experience deploying production systems on major cloud platforms, e.g., AWS and/or GCP.
Deep hands-on experience with Docker and containerized workloads, Kubernetes (EKS, GKE, or equivalent).
Strong experience serving LLMs and embedding models in production.
Strong hands-on experience with CI/CD (GitHub Actions required) and repository management (monorepos, release branches, tagging, rollbacks).
Preferred Qualifications
Experience with SGLang, vLLM, or similar inference frameworks.
Strong understanding of GPU behavior (memory limits, batching, fragmentation, utilization) and experience with GPU-level optimization
Experience with model-level inference optimization (Quantization, KV-cache optimization, Speculative decoding or batching strategies) and inference kernels
Startup experience: you move fast, take ownership, and fix things properly.
Why Join Virtue AI
Competitive salary + equity
High ownership – You define how production runs
Real impact – Your work directly affects customers and revenue
Hard problems – Distributed systems, GPUs, scale, security
Strong technical peers – Engineers who ship and debug, not just designLocation: San Francisco, CA (Onsite | Remote)
About Virtue AI
Virtue AI sets the standard for advanced AI security platforms. Built on decades of foundational and award-winning research in AI security, its AI-native architecture unifies automated red-teaming, real-time multimodal guardrails, and systematic governance for enterprise apps and agents. Deploy in minutes—across any environment—to keep your AI protected and compliant. We are a well-funded, early-stage startup founded by industry veterans, and we're looking for passionate builders to join our core team.
What You’ll Do
As a DevOps Engineer, you will own the reliability, automation, and operational discipline of Virtue AI’s production systems. When something breaks, you fix it. When it doesn’t scale, you redesign it.
You will:
Design, build, and maintain CI/CD pipelines using GitHub Actions
Own repo structure, branching strategy, release workflows, and versioning
Build and operate Kubernetes infrastructure on GKE
Package, deploy, and optimize services using Docker
Design production-grade system observability
Metrics, logs, alerts, dashboards
Datadog, Grafana, Prometheus
Monitor and improve service reliability, latency, and uptime
Debug real production issues across infra, networking, containers, and code
Partner with backend, ML, and platform engineers to remove operational bottlenecks
What Makes You a Great Fit
You don’t just “set up pipelines.” You understand why systems fail, and you design so they don’t fail the same way twice.
Required Qualifications
Bachelor’s degree or equivalent practical experience
Strong hands-on experience with:
CI/CD (GitHub Actions required)
Repository management (monorepos, release branches, tagging, rollbacks)
Deep experience with:
Kubernetes
Docker
Experience designing and operating observability systems
Datadog and/or Grafana in production
Strong understanding of system design
Availability, scalability, fault isolation
Proven ability to solve real production problems, not just configure tools
Comfortable working directly on production systems
Preferred Qualifications
Experience operating ML / LLM inference systems
Experience with GPU workloads and resource scheduling
Experience supporting enterprise customers with SLAs
Familiarity with infrastructure-as-code (Terraform / Pulumi)
Startup experience: you move fast, take ownership, and clean up after yourself
Why Join Virtue AI
Competitive salary + equity
High ownership – You define how production runs
Real impact – Your work directly affects customers and revenue
Hard problems – Distributed systems, GPUs, scale, security
Strong technical peers – Engineers who ship and debug, not just design
Automate your job search with Sonara.
Submit 10x as many applications with less effort than one manual application.
