Job Information
Educational Testing Service Associate AI Engineer in Princeton, New Jersey
About ETS:
ETS is a global education and talent solutions organization enabling lifelong learners worldwide to be future-ready. For more than 75 years, we've been advancing the science of measurement to build benchmarks for fair and valid skill assessment across cultures and borders. Our worldwide impact extends through our renowned assessments including TOEFL®, TOEIC®, GRE® and Praxis® tests, serving millions of learners in more than 200 countries and territories. Through strategic acquisitions, we've expanded our global capabilities: PSI strengthens our workforce assessment solutions, while Edusoft, Kira Talent, Pipplet, Vericant, and Wheebox enhance our educational technology and assessment platforms across critical markets worldwide.
Through ETS Research Institute and ETS Solutions, we're partnering with educational institutions, governments, and organizations globally to promote skill proficiency, empower upward mobility, and unlock opportunities for everyone, everywhere. With offices and partners across Asia, Europe, the Middle East, Africa, and the Americas, we deliver nearly 50 million tests annually. Join us in our journey of measuring progress to power human progress worldwide.
The Associate AI Engineer contributes to the development of advanced, personalized adaptive learning technologies that power effective, efficient, and engaging educational experiences. As part of our AI product development team, you’ll help build, evaluate, and maintain large-language-model (LLM) driven content generation, review, and quality-assurance systems that support large-scale educational assessments.
PRIMARY RESPONSIBILITIES
• Adhere to ethical standards and comply with the laws and regulations applicable to the job function
• Contributing to the development of AI-enabled services and workflows, including LLM-based content generation and review pipelines, to achieve objectives as outlined by Senior or Principal AI Engineers
• Work with data scientists to assist in building data ingest and data transformation infrastructures
• Provide support to AI Engineers on the support assessment content, metadata, and evaluation pipelines during development, deployment, and recalibration
• Provide support to evaluate, benchmark, and monitor AI and LLM system behavior and provide metrics to document and track their performance.
• Explore the data and help to identify differences in data distribution that could impact performance when deployed in prototypes
• Utilize best practices around the support for the design, coding, automated unit, regression testing, and deployment of AI-enabled services and LLM-based workflows to production
• Keep current of latest AI research and applied advances in large-language-model platforms, orchestration tools, and evaluation methods relevant to educational assessment and content development
• Utilize best practices in the responsible use of AI
• Work closely with learning scientists and data scientists to define collection events and data transformations needed to drive personalized learning and to support assessment content development and review workflows
• Work closely with Product Owners to understand potential and limitations of AI and LLM-based systems in the product
• Work effectively in the agile-at-scale framework
• Clearly communicate findings, implementation details, and system behavior to senior AI engineers, product owners, and assessment domain experts
#LI-AP1
KNOWLEDGE/SKILLS
• Some experience with Python-based software and data engineering frameworks and libraries, Java, and/or R
• Some experience with APIs and services for large-language models and related tooling (for example, model APIs, prompt-driven workflows, or orchestration platforms such as Dify or similar tools)
• Knowledge of statistical analysis and mathematical modeling concepts and principles
• Familiarity with JSON-based APIs, data pipelines, and cloud-based services used to integrate AI capabilities into production systems
• Excellent communication skills
• Ability to work effectively in a cross-functional team
EDUCATION AND EXPERIENCE
• A Master’s Degree in Computer Science, Applied Mathematics, Engineering or a related field
• 1+ year of training or experience in software engineering, data engineering, or applied AI system development (including LLM-based systems)
• Some experience with Python-based software and data engineering frameworks, Java, and/or R
• Some experience with large-language-model platforms, APIs, and workflow orchestration tools
• Knowledge of statistical analysis and mathematical modeling concepts and principles
• Excellent communication skills
• Ability to work effectively in a cross-functional team
• Interest in educational assessment, learning science, or standardized testing environments, and in building human-in-the-loop AI systems for content development and review
ETS is mission driven and action oriented
We are passionate about hiring innovative thinkers who believe in the promise of education and lifelong learning.
We are energized by cultivating growth, innovation, and continuous transformation for the next generation of rising professionals as leaders. Â In support of this ETS offers multiple Business Resource Groups (BRG) for you to learn and advance your career growth!
As a not-for-profit organization we will encourage you to lean in to your passion for volunteering. Â At ETS you may qualify for up to an additional 8 hours of PTO for volunteer work on causes that are important to you!
The base salary range advertised represents the low and high end of the anticipated salary range for this position. The base pay actually offered will take into account internal equity and also may vary depending on the candidate's geographic region, job-related knowledge, skills, and experience among other factors. The base pay is only one aspect of the Total Rewards Package that will be offered to the successful candidate.
ETS is an Equal Opportunity Employer. We are committed to providing equal employment opportunities to all employees and applicants for employment without regard to race, color, religion, sex, national origin, age, disability, marital status, veteran status, sexual orientation, gender identity, or any other characteristic protected by law. We believe in creating a work environment where all individuals are treated with respect and dignity.