Product Analyst
Info Way Solutions LLCbullhead city, AZ
Automate your job search with Sonara.
Submit 10x as many applications with less effort than one manual application.1
Reclaim your time by letting our AI handle the grunt work of job searching.
We continuously scan millions of openings to find your top matches.
Overview
Remote
On-site
Job Description
Role: Product Analyst Location- Phoenix, AZ is preferred but remote can be considered Duration- 6+ months Skills - Required Qualifications
- 3+ years experience drafting detailed Jira user stories, maintaining product backlogs, and defining acceptance criteria based on business requirements in an Agile product team or equivalent environment.
- 2+ years experience in data analysis with the ability to interpret AI performance metrics and translate findings into actionable product recommendations.
- 1+ year experience working with LLM-based applications, including understanding of hallucination patterns, output quality issues, grounding techniques, bias detection, and mitigation strategies.
- 1+ year hands-on experience executing structured AI agent evaluation plans, tracking iterations, maintaining golden datasets, and performing regression testing.
- 1+ year experience supporting the development, evaluation, and continuous improvement of AI-powered products, AI agents, copilots, or generative AI solutions.
- Experience translating AI product requirements into prompts, agent workflows, business rules, and measurable success criteria.
- Experience defining AI product success metrics and measuring improvements in output quality, user satisfaction, task completion, or productivity.
- Experience partnering with engineering, UX, data science, and business stakeholders to prioritize, evaluate, and refine AI product capabilities.
- Experience in HR technology, learning technology, content creation platforms, or knowledge management solutions as a Business Analyst, Product Analyst, Product Owner, or equivalent role.
- Hands-on experience building and executing specialized AI test cases, evaluating LLM outputs, prompt variations, and agentic workflows.
- Hands-on experience with prompt engineering, prompt optimization, and evaluation of AI-generated content quality, accuracy, completeness, and consistency.
- Experience designing evaluation rubrics, benchmark datasets, golden datasets, and quality measurement frameworks for AI-generated outputs.
- Experience conducting side-by-side model comparisons, experimentation, or A/B testing to improve AI product performance.
- Familiarity with Retrieval Augmented Generation (RAG), grounding strategies, hallucination mitigation, and content sourcing concepts.
- Familiarity with automated AI evaluation tools, frameworks, and testing methodologies.
- Experience with human-in-the-loop workflows and designing review, validation, and approval processes for AI-generated outputs.
- Experience working with AI governance, responsible AI practices, bias detection, content safety, and model quality evaluation.
- Experience evaluating content quality against defined business, compliance, instructional design, or organizational standards.
- Strong written and verbal communication skills, with the ability to document evaluation methodologies, findings, recommendations, and trade-offs for both technical and business audiences.
Automate your job search with Sonara.
Submit 10x as many applications with less effort than one manual application.
FAQs About Product Analyst Jobs at Info Way Solutions LLC
What is the work location for this position at Info Way Solutions LLC?
This job at Info Way Solutions LLC is located in bullhead city, AZ, according to the details provided by the employer. Some roles may also include multiple work locations depending on the requirement.
What pay range can candidates expect for this role at Info Way Solutions LLC?
Employer has not shared pay details for this role.
What employment applies to this position at Info Way Solutions LLC?
The employer has not provided this information. This may be discussed during the hiring process.
What is the process to apply for this position at Info Way Solutions LLC?
You can apply for this role at Info Way Solutions LLC either through Sonara's automated application system, which helps you submit applications 10X faster with minimal effort, or by applying manually using the direct link on the job page.