Information Technology
Manager | Automation Testing | Mumbai | Engineering | Quality Engineering
Posted 22 Oct 2026
About this role
Manager | Automation Testing | Mumbai | Engineering | Quality Engineering
- Job requisition ID : 112463
- Location : Mumbai
- Entity : Deloitte Touche Tohmatsu India LLP The team Deloitte’s Technology & Transformation practice can help you uncover and unlock the value buried deep inside vast amounts of data. Our global network provides strategic guidance and implementation services to help companies manage data from disparate sources and convert it into accurate, actionable information that can support fact-driven decision-making and generate an insight-driven advantage. Our practice addresses the continuum of opportunities in business intelligence & visualization, data management, performance management and next-generation analytics and technologies, including big data, cloud, cognitive and machine learning. Your work profile We are looking for a Senior Quality Engineer with strong expertise in Playwright with Python, API automation, and AI/LLM testing . The role will own the quality strategy, develop scalable automation frameworks, and ensure the accuracy, safety, reliability, performance, and compliance of AI-powered applications. Key skills required Own the end-to-end test strategy, automation roadmap, quality gates, and release-readiness criteria. Design and maintain automation frameworks using Playwright with Python and BDD using Behave . Automate UI, API, integration, regression, and end-to-end testing. Support UAT automation and maintain existing regression suites using Selenium , where required. Validate AI/LLM systems for accuracy, relevance, hallucination, bias, safety, context retention, and fallback handling. Test prompt injection, harmful prompts, edge cases, RAG workflows, and AI agent integrations. Build LLM evaluation frameworks, benchmark datasets, scorecards, and regression suites. Integrate automated tests into CI/CD pipelines and implement continuous quality gates. Conduct basic performance testing covering p50/p95 response times, throughput, load, and SLA compliance. Debug issues using logs, traces, database validation, and backend monitoring. Define quality dashboards and ensure traceability, auditability, and compliance. Mentor QA engineers and collaborate with Product, Engineering, Data Science, Security, DevOps, and business teams.
Required Skills
9+ years of experience in Quality Engineering and Test Automation. Strong hands-on expertise in Playwright with Python . Experience in building scalable automation frameworks using Python, Pytest, and Behave . Experience testing AI, Generative AI, or LLM-powered applications . Strong API testing experience using Playwright, Postman, Requests, or REST-assured equivalents .
Experience with BDD, Git, CI/CD, and Agile delivery practices. Knowledge of AI evaluation, prompt testing, RAG validation, hallucination testing, and Responsible AI. Strong problem-solving, mentoring, communication, and stakeholder-management skills.
Education
Bachelor’s degree in computer science, Information Technology, or related field.
Before you apply
Company Jobs India lists this vacancy from the employer's official careers website. Apply only on that website. Genuine employers do not ask for a fee, deposit, OTP or bank details to give you an interview or an offer letter.
Skills
Role details
- Work mode
- Onsite
- Industries
- Consulting
- Job functions
- Information Technology
- Accepted qualifications
- Any Graduate
- Locations
- Mumbai, Maharashtra
- Application method
- Continue to the employer’s application website
Listed from Deloitte India’s official careers website · last checked 13 Nov 2026.
Employer
Deloitte India
View the company profile and its current opportunities.
Company profile