OneMain Financial Jobs

Company description

Publicis Groupe Canada is the Canadian subsidiary of Publicis Groupe, the second largest communications group in the world and a global leader concentrated within four main activities: Communication, Media, Data and Technology. Publicis Groupe Canada represents the vision of a set of collaborative and integrated agencies that offer expertise and insightful services to many of the biggest brands in North America.

Publicis Groupe Canada is committed to its Diversity, Equity and Inclusion mandate which focuses on four pillars: Education, Talent Management, Outreach and Giving Back. Since the mandate's launch in 2020, they have made strong and continued growth in all their pillars including top-tier mental health benefits, regular education sessions for employees, six business resources groups for employees of various backgrounds and their allies and developing training and scholarships programs with POV and the Miami Ad School Canada. The Groupe also launched This Is The Job, an initiative designed to work with Canada's largest school boards to change the complexion of the marketing industry and inspire racialized teens and young adults to consider a career in the industry.

Canadian brands include: Publicis Canada (Publicis Canada, Hawkeye, Razorfish, Publicis Health, ThePubProductions, Nurun, Publicis Sports & Entertainment), Publicis Media (Starcom, Spark Foundry, Zenith), Leo Burnett (Leo Burnett Canada, Ove Brand Design, Leo Burnett Design), Saatchi & Saatchi (Saatchi & Saatchi Canada, Synergize, TPM),MSL Canada/North Strategic (North Strategic, MSL Canada, Notch Canada) and Publicis Sapient.

Overview

We are looking for a Quality Assurance Lead to own quality strategy and execution for an AI-enabled product. You will define and implement test approaches that validate functionality, data integrity, model/AI behavior, and user experience across web services, APIs, and integrated enterprise systems.

You will partner with Product, Engineering, Data Science/ML, and DevOps to build quality into the full delivery lifecycle—from requirements and test design to automated testing, release readiness, monitoring, and continuous improvement. This role requires strong hands-on testing skills, a pragmatic automation mindset, and the ability to drive quality standards in fast-moving Agile teams.

Responsibilities

Quality Strategy & Test Planning

· Own the end-to-end QA strategy for the AI product, including scope, environments, test levels, and release quality gates.

· Translate product requirements, user journeys, and risk areas into clear test plans, test cases, and acceptance criteria.

· Define quality metrics (defect trends, test coverage, escape rate) and drive continuous improvement using data.

· Establish standards for test documentation, traceability, and evidence to support audits and stakeholder confidence.

Test Automation & CI/CD Enablement

· Design and maintain automated test suites (API, UI, integration, regression) aligned to product risks and release cadence.

· Embed automated testing into CI/CD pipelines to provide fast feedback and prevent regression issues.

· Partner with engineers to improve testability (stable APIs, feature flags, synthetic data, observability hooks).

· Ensure reliable test environments and data management to support repeatable, deterministic testing.

AI/ML Quality, Data Validation & Monitoring

· Validate AI-driven behavior by testing model outputs against defined expectations, edge cases, and known failure modes.

· Design tests for data quality (schema, completeness, drift signals) and validate the quality and correctness of AI agent outputs using SQL and/or Python; ensure downstream impacts are understood.

· Collaborate with ML/Data teams to define evaluation criteria and guardrails (bias/fairness considerations, hallucination handling, confidence thresholds where applicable).

· Support production quality through monitoring, incident triage, and post-release validation (smoke checks, canary outcomes).

Leadership, Collaboration & Release Readiness

· Lead QA ceremonies and practices (test triage, defect management, go/no-go readiness) and align stakeholders on release criteria.

· Mentor QA team members and promote consistent testing practices across squads.

· Partner with Product and Engineering to clarify requirements early and prevent defects through shift-left testing.

· Communicate quality status, risks, and mitigation plans clearly to technical and non-technical stakeholders.

Qualifications

· 6+ years of experience in Quality Assurance, including experience leading QA activities for complex products or platforms.

· 2+ years of experience with MLOps/LLMOps practices (model versioning, evaluation pipelines, prompt/version management where applicable, model monitoring).

· Strong hands-on experience with test planning, test case design, and risk-based testing for web applications, APIs, and distributed systems.

· Experience building and maintaining automated tests (e.g., Playwright/Cypress/Selenium for UI; REST/GraphQL API testing; contract testing).

· Proficiency with modern delivery tooling: Git, CI/CD pipelines, test reporting, and defect tracking.

· Experience testing data-intensive and/or AI-enabled features, including validation of outputs, edge cases, and data quality signals.

· Understanding of non-functional testing (performance, reliability, security basics, accessibility) and how to incorporate it into release cycles.

· Comfortable working in Agile environments and collaborating across Product, Engineering, Data/ML, and DevOps.

Nice to Have

· Experience with privacy- and security-sensitive systems, including PII handling, auditability, and secure test data practices.

· Experience with observability tooling (logs/metrics/traces) and using production signals to improve test coverage.

· Prior experience supporting multiple products/clients within a shared platform ecosystem.

Additional information

Transparency matters to us. The salary range for this position is $120,000-$130,000 per year. Actual compensation within this range will be based on a variety of factors, including relevant experience, knowledge, skills, and applicable certifications. This range reflects what we reasonably expect to offer based on current market data.

We use artificial intelligence (AI) tools to support parts of our hiring process, such as reviewing applications or analyzing resumes. These tools assist our recruitment team but never replace human decision-making. We believe in a human-first approach, where your experience and potential are recognized by people.

Publicis Canada is committed to building a diverse workforce representative of our community. We encourage and are pleased to consider all qualified candidates, without regard to race, colour, citizenship, religion, sex, marital / family status, sexual orientation, gender identity, aboriginal status, age, disability or persons who may require an accommodation, to apply. If you require a specific accommodation please contact Human Resources at 416-925-7733 or by email at inquiries@publicisna.com