UAT Testing
Capco · Mumbai, India
About the role
Senior QA Automation Engineer designing and maintaining UI/API automation frameworks using Playwright and TypeScript, with a focus on testing AI-driven applications including Agentic AI and LLM systems. Involves building evaluation frameworks, integrating with CI/CD, and mentoring junior QA engineers.
What you'll do
- Design, develop, and maintain UI and API automation frameworks using Playwright and TypeScript.
- Automate functional, regression, smoke, integration, and end-to-end test scenarios.
- Validate AI-driven applications, Agentic AI workflows, and LLM-powered systems.
- Develop evaluation frameworks to measure AI response quality, accuracy, safety, and performance.
- Automate API testing using REST APIs and validate request/response payloads.
- Integrate automation suites into CI/CD pipelines and mentor junior QA engineers.
What they're looking for
- 8-10 years of experience in software testing and automation.
- Strong expertise in UI and API test automation using Playwright with TypeScript.
- Hands-on experience in Agentic AI testing, including AI-driven workflows, LLMs, AI agents, and evaluation frameworks.
- Experience with REST API testing and validation.
- Collaboration with developers, product owners, and AI/ML teams.
- Mentoring junior QA engineers and contributing to automation best practices.
Key details
- Company
- Capco
- Location
- Mumbai, India
- Work mode
- On-site
- Seniority
- Mid-level
- Role category
- QA & Testing
- Experience
- 8-10 years
- Posted
- 24 Oct 2026
- Source
- job-boards.greenhouse.io