Senior QA Analyst

About the Role:

Tubi is seeking a highly skilled and experienced Senior QA Analyst to lead quality assurance initiatives for our cutting-edge streaming and AI-driven product features. This pivotal role involves ensuring exceptional end-to-end user experiences, robust streaming playback, and the accuracy and integrity of our AI/ML features across web, mobile, and OTT platforms.

We're seeking a candidate with a strong background in streaming QA and a deep technical understanding of media workflows. You'll be instrumental in collaborating with engineering, product, and data science teams to define comprehensive QA strategies that guarantee both functional excellence and data-level quality.

This is a hybrid role based out of our San Francisco office. You must be willing to travel to our San Francisco office 3 days a week.

What You'll Do:

• Design and lead test strategies for streaming workflows, playback systems, and AI-powered features.
• Test across platforms (web, mobile, and connected TV) to ensure functional parity and playback stability.
• Validate streaming performance-including ABR logic, encoding pipelines, and DRM integrations-under diverse real-world conditions.
• Debug with precision using tools like Charles Proxy, Chrome DevTools, ADB, and Xcode. Collaborate with data and ML teams to validate AI model updates, recommendations, and personalization accuracy.
• Leverage AI-assisted QA tools to enhance regression coverage, UI validation, and anomaly detection.
• Contribute to automation and CI/CD frameworks, driving faster, more reliable releases.
• Oversee QA deliverables for multiple concurrent releases and ensure seamless sign-off for production launches.
• Monitor live environments for playback or recommendation anomalies post-release and escalate issues promptly.
• Continuously improve QA processes, metrics, and reporting for streaming and AI validation.

Your Background:

• Bachelor's degree in Computer Science, Software Engineering, or related field, or equivalent hands-on experience
• 4+ years of QA experience, preferably in streaming media or VOD/OTT platforms
• Strong technical knowledge of video streaming protocols (HLS, DASH, MPEG-TS), DRM systems, and CDN architectures
• Experience validating AI/ML systems in production - e.g., testing model output accuracy, user personalization logic, and algorithm stability
• Hands-on experience with test automation tools (Selenium, Appium, Playwright, Puppeteer) and AI-based visual testing
• Proficiency in debugging tools and network analysis utilities (Charles Proxy, Chrome DevTools)
• Experience managing regression suites and release validation cycles across web, mobile, and connected TV platforms
• Familiarity with Python, Typescript or JavaScript for scripting and test automation
• Understanding of data validation, logging pipelines, and A/B testing frameworks
• Strong analytical and documentation skills, with a proactive approach to cross-team collaboration

Nice to have

• Experience testing machine learning-driven streaming features such as recommendation systems, ad targeting, or automated metadata tagging
• Exposure to model evaluation techniques (precision/recall, bias testing, data drift analysis)
• Familiarity with continuous testing and CI/CD environments (Jenkins, GitHub Actions, CircleCI)
• Understanding of observability tools (Grafana, Kibana, Datadog) for post-deployment validation
• Strong ability to triage issues in large distributed systems and collaborate with engineering to resolve root causes

#LI-CL1

#LI-Hybrid