Job Information
CAI Senior Test Engineer in India
Senior Test Engineer
Req number:
R7121
Employment type:
Full time
Worksite flexibility:
Hybrid
Who we are
CAI is a global services firm with over 9,000 associates worldwide and a yearly revenue of $1.3 billion+. We have over 40 years of excellence in uniting talent and technology to power the possible for our clients, colleagues, and communities. As a privately held company, we have the freedom and focus to do what is right—whatever it takes. Our tailor-made solutions create lasting results across the public and commercial sectors, and we are trailblazers in bringing neurodiversity to the enterprise.
Job Summary
As the Senior Test Engineer, you will be responsible for leading the design and implementation of advanced testing strategies, frameworks, and tools to ensure the quality and reliability of GenAI platforms and applications.
Job Description
We are looking for a Senior Test Engineer to lead test automation and strategy initiatives for GenAI platforms. This position will be full-time and hybrid in Bangalore.
What You’ll Do
Test Strategy & Automation Leadership
Design and implement comprehensive test strategies covering functional, integration, regression, performance, and security testing for GenAI platforms
Architect and maintain scalable test automation frameworks using Selenium, Cypress, Playwright, or Pytest with CI/CD integration (GitLab CI, Jenkins, GitHub Actions)
Develop API automation suites for backend microservices using REST Assured, Pytest, or Postman/Newman
Provide technical mentorship to junior test engineers, conduct code reviews, and establish QA best practices across AI CoE
GenAI & Advanced Testing
Design specialized test scenarios for GenAI features including prompt validation, RAG (Retrieval-Augmented Generation) accuracy, LLM response quality, and conversational flows
Validate AI model integrations (Claude, OpenAI APIs), vector database operations (OpenSearch, Pinecone), and agentic workflows
Perform AI governance testing including RBAC, usage tracking, and compliance validation
Conduct performance testing (JMeter, Locust, K6) and security testing (OAuth 2.0, JWT, API security, OWASP Top 10)
Quality Metrics & Release Management
Establish quality metrics, dashboards, and reporting for test coverage, defect density, and release readiness
Lead defect triage meetings, root cause analysis, and drive corrective actions with development teams
Test cloud deployments on AWS/Azure for reliability and disaster recovery scenarios
Coordinate UAT with business stakeholders and ensure compliance with security standards (SOC 2, GDPR)
What You'll Need
Required
4-8 years of hands-on experience in software testing with 2+ years in test automation and API testing
Deep expertise in test automation frameworks (Selenium, Cypress, Playwright, Pytest) and design patterns (Page Object Model, BDD)
Strong proficiency in API testing (REST, GraphQL) using Postman, REST Assured, or Pytest
Expert-level proficiency in Python or JavaScript for test automation and scripting
Advanced Technical Skills
Experience with performance testing tools (JMeter, Locust, K6) and analyzing performance metrics
Knowledge of security testing practices, OWASP Top 10, and API security validation
Strong understanding of microservices architecture, distributed systems, and cloud-native applications
Experience with databases (PostgreSQL, MongoDB) and writing complex SQL queries for data validation
Hands-on experience testing applications on AWS/Azure (Lambda, ECS, S3, RDS, API Gateway)
CI/CD & DevOps
Proficiency with CI/CD tools (GitLab CI, Jenkins, GitHub Actions) and version control (Git)
Familiarity with Docker/Kubernetes and testing containerized applications
Knowledge of monitoring tools (CloudWatch, Datadog, ELK stack) for production validation
Leadership & Collaboration
Proven ability to mentor junior engineers and provide technical guidance
Strong analytical and problem-solving skills with ability to troubleshoot complex issues
Excellent communication skills to interact with developers, architects, product managers, and business stakeholders
Experience working in Agile/Scrum environments with cross-functional teams
Preferred
Experience testing GenAI applications (LLMs, RAG systems, conversational AI, agentic workflows)
Understanding of MLOps and testing AI model deployment pipelines
Experience with BDD/TDD frameworks (Cucumber, Behave) and contract testing (Pact) for microservices
ISTQB Advanced Level, AWS/Azure certifications, or security certifications (CEH, CompTIA Security+)
Physical Demands
Ability to safely and successfully perform the essential job functions
Sedentary work that involves sitting or remaining stationary most of the time with occasional need to move around the office to attend meetings, etc.
Ability to conduct repetitive tasks on a computer, utilizing a mouse, keyboard, and monitor
Reasonable accommodation statement
If you require a reasonable accommodation in completing this application, interviewing, completing any pre-employment testing, or otherwise participating in the employment selection process, please direct your inquiries to application.accommodations@cai.io or (888) 824 – 8111.