Job Information
CAI AI/ML Platform Architect in India
AI/ML Platform Architect
Req number:
R7127
Employment type:
Full time
Worksite flexibility:
Hybrid
Who we are
CAI is a global services firm with over 9,000 associates worldwide and a yearly revenue of $1.3 billion+. We have over 40 years of excellence in uniting talent and technology to power the possible for our clients, colleagues, and communities. As a privately held company, we have the freedom and focus to do what is right—whatever it takes. Our tailor-made solutions create lasting results across the public and commercial sectors, and we are trailblazers in bringing neurodiversity to the enterprise.
Job Summary
As the AI/ML Platform Architect, you will be responsible for defining technical vision and architecture for conversational AI platforms, AI governance systems, and domain-specific agentic solutions.
Job Description
We are looking for an AI/ML Platform Architect to lead the design, strategy, and implementation of cutting-edge AI/ML platforms and solutions. This position will be full-time, hybrid, and based in Bangalore.
What You’ll Do
Enterprise AI Architecture & Strategy
Define technical vision and architecture for conversational AI platforms, AI governance systems, and domain-specific agentic solutions
Design cloud-native, microservices-based architectures for GenAI applications using AWS/Azure, Kubernetes, and API management platforms
Establish architectural standards for LLM integration (Claude, OpenAI), RAG systems, vector databases, and AI orchestration
Drive technology selection for frontend (React/Angular), backend (FastAPI, Node.js), databases (PostgreSQL, MongoDB, OpenSearch), and AI frameworks (LangChain, LlamaIndex)
AI Governance & Security Architecture
Design AI governance frameworks including usage tracking, cost optimization, access control (RBAC/ABAC), and compliance enforcement (SOC 2, GDPR)
Architect API security patterns (OAuth 2.0, JWT, mTLS), data encryption, and audit logging for AI platforms
Define multi-tenancy architecture for SaaS-based AI solutions with role-based access and data isolation
Technical Leadership & Collaboration
Provide technical leadership to engineering teams (backend, frontend, AI/ML, DevOps) across India CoE and Singapore
Conduct architecture reviews, design reviews, and guide implementation decisions for high-impact GenAI projects
Collaborate with product managers, business stakeholders, and executive leadership to align technical architecture with business objectives
Mentor architects and senior engineers on cloud-native design, AI/ML best practices, and enterprise integration patterns
MLOps & Integration Architecture
Design MLOps pipelines for AI model deployment, versioning, monitoring, and A/B testing
Architect enterprise integrations with APIs, message brokers (Kafka, RabbitMQ), and legacy systems using event-driven patterns
Define observability and monitoring strategies using Prometheus, Grafana, Datadog, and CloudWatch
What You'll Need
Required:
Enterprise Architecture Expertise
15+ years in enterprise software architecture with 5+ years designing AI/ML platforms or GenAI solutions
Deep expertise in cloud-native architectures (AWS/Azure), microservices, API design, and distributed systems
Strong knowledge of GenAI technologies (LLMs, RAG systems, vector databases, prompt engineering, agentic frameworks)
Proven experience architecting enterprise-scale platforms serving 10,000+ users with high availability and security requirements
Technical Depth
Expert-level knowledge of backend frameworks (FastAPI, Node.js, Django), frontend frameworks (React, Angular), and database systems (SQL, NoSQL, vector databases)
Strong understanding of AI/ML frameworks (LangChain, LlamaIndex, Hugging Face), model serving (TensorFlow Serving, Triton), and MLOps practices
Proficiency in API management (MuleSoft, Apigee, Kong), event-driven architectures, and message brokers (Kafka, RabbitMQ)
Deep knowledge of security (OAuth 2.0, JWT, encryption, OWASP), compliance (SOC 2, GDPR), and data privacy
Leadership & Communication
Proven ability to lead cross-functional teams, influence technical decisions, and drive architectural alignment
Excellent communication skills with ability to present complex architectures to executive leadership and non-technical stakeholders
Experience managing vendor relationships, technology partnerships, and third-party integrations
Strong decision-making abilities based on data-driven insights, trade-off analysis, and business impact
Preferred:
Certifications: AWS Solutions Architect Professional, Azure Solutions Architect Expert, TOGAF, or equivalent
Experience with AI governance platforms, prompt management systems, and LLM observability tools (LangSmith, Weights & Biases)
Knowledge of service mesh (Istio, Linkerd), API federation, and zero-trust security architectures
Prior experience in manufacturing, engineering, or industrial domains is a plus
Physical Demands
Ability to safely and successfully perform the essential job functions
Sedentary work that involves sitting or remaining stationary most of the time with occasional need to move around the office to attend meetings, etc.
Ability to conduct repetitive tasks on a computer, utilizing a mouse, keyboard, and monitor
Reasonable accommodation statement
If you require a reasonable accommodation in completing this application, interviewing, completing any pre-employment testing, or otherwise participating in the employment selection process, please direct your inquiries to application.accommodations@cai.io or (888) 824 – 8111.