Senior/Staff QA Engineer – Agentic AI Platform (Remote)

Ontrac SolutionsChicago, IL

Apply with Sonara

Automate your job search with Sonara.

Submit 10x as many applications with less effort than one manual application.¹

Reclaim your time by letting our AI handle the grunt work of job searching.

We continuously scan millions of openings to find your top matches.

Overview

Schedule

Full-time

Career level

Senior-level

Remote

On-site

Job Description

Overview

We are seeking a highly skilled and experienced Senior/Staff QA Engineer to support a critical customer engagement. This role is ideal for a detail-oriented tester who thrives owning quality end-to-end — someone equally comfortable writing precise manual test cases and building automated coverage for a fast-moving agentic AI product.

The successful candidate will work closely with the Delivery Lead/Solutions Architect and customer engineering stakeholders to ensure product quality from initial test planning through final release.

Required Credentials

5+ years of professional QA experience, with at least 2+ years at a senior or staff level.
Demonstrated experience testing production software through a full Application Development Lifecycle (ADLC).

Required Qualifications

ADLC Expertise: Strong understanding of the Application Development Lifecycle — from requirements through release and support.
UI/UX Acumen: Solid UI/UX understanding, with the ability to evaluate usability and flag design/interaction issues, not just functional bugs.
AI Agent Testing: Hands-on experience testing AI Agent use cases — including conversational flows, agent decision-making, tool/function calling, and edge-case or failure-mode behavior.
Automation Frameworks: Proven experience with automated testing frameworks and building maintainable, scalable test suites.
Infrastructure Management: Ability to stand up and manage a Playwright cluster to run automated end-to-end (E2E) testing against a live agent platform.
Autonomy: Ability to independently define clear, well-structured test cases from ambiguous or evolving product requirements.
Lifecycle Ownership: Experience driving full E2E QA lifecycle ownership: test planning, execution, defect triage, regression, and sign-off.

Required Technical Stack Experience(Suggested Completion)

Automation Frameworks: Deep expertise with Playwright (including cluster management and parallel execution).
Languages: Proficiency in JavaScript / TypeScript or Python for writing automation scripts.
AI/LLM Tools: Familiarity with testing LLM outputs, prompt evaluation frameworks, or conversational AI testing tools.
CI/CD & DevOps: Experience integrating automated test suites into pipelines (e.g., GitHub Actions, GitLab CI, Jenkins) and working with Docker containerization.
Defect Tracking & Tools: Proficiency with Git, Jira, and modern test management tools.

__________________________________

Ontrac Solutions has partnered with PinpointVerify to help genuine applicants rise above the noise. Today, qualified candidates are too often overshadowed by fake and fraudulent applications. PinpointVerify gives our recruiters confidence that you are exactly who you say you are — and gives you a portable verification credential you can share with any employer.

Applicants who complete verification are prioritized over non-verified candidates with comparable experience. And if you're hired, Ontrac reimburses the full cost of your verification.Get verified → https://pinpointverify.com/ontrac

Automate your job search with Sonara.

Submit 10x as many applications with less effort than one manual application.

Apply with Sonara Apply manually

FAQs About Senior/Staff QA Engineer – Agentic AI Platform (Remote) Jobs at Ontrac Solutions

What is the work location for this position at Ontrac Solutions?

This job at Ontrac Solutions is located in Chicago, IL, according to the details provided by the employer. Some roles may also include multiple work locations depending on the requirement.

What pay range can candidates expect for this role at Ontrac Solutions?

Employer has not shared pay details for this role.

What employment applies to this position at Ontrac Solutions?

Ontrac Solutions lists this role as a Full-time position.

What experience level is required for this role at Ontrac Solutions?

Ontrac Solutions is looking for a candidate with "Senior-level" experience level.

What is the process to apply for this position at Ontrac Solutions?

You can apply for this role at Ontrac Solutions either through Sonara's automated application system, which helps you submit applications 10X faster with minimal effort, or by applying manually using the direct link on the job page.