Virtusa Recognized as Global Leader in Gen AI Services by ISG Provider Lens® - Read report

× Success! Job has been saved successfully.

Al Product Eval - TPM

Hyderabad, Andhra Pradesh, India
Posted on: 09-12-2025

Job description

Technical Program Manager – AI Evaluation & Automation (1 roles)

Role Overview

We are seeking a highly skilled Technical Program Manager (TPM) to lead an AI evaluation and automation program focused on dataset development, model assessment, and toolchain integration for Google’s AI products (e.g., Gemini CLI, Code Review Agent). This role will drive governance, stakeholder alignment, and delivery excellence across multi-disciplinary engineering teams.

Key Responsibilities

· Own end-to-end program governance, including planning, execution, and reporting of AI evaluation workstreams.

· Translate Google’s evaluation and labeling guidelines into operational execution plans and success metrics.

· Manage cross-functional alignment between AI engineers, raters, and automation teams.

· Define KPIs and ensure timely delivery of datasets, evaluation pipelines, and benchmarking reports.

· Lead risk, dependency, and quality management across distributed teams.

· Present progress, insights, and recommendations to Google stakeholders and leadership.

· Ensure compliance with data handling, labeling, and security policies.

Required Skills & Experience

· 8–12 years of experience in technical program or product management, preferably in AI/ML or data-driven environments.

· Deep understanding of machine learning evaluation processes, LLM workflows, and automation tools.

· Proven experience managing cross-geography teams and agile delivery models.

· Proficiency with Google AI ecosystem tools (Vertex AI, Gemini CLI, BigQuery, Looker).

· Excellent communication, stakeholder management, and documentation skills.

· Familiarity with Git-based systems (GitHub, GitLab, Bitbucket).

Preferred Qualifications

· Experience managing AI evaluation or model benchmarking programs.

· Background in software engineering or data science.

· PMP or Agile certification preferred.

 Key job details

Primary Location
Hyderabad, Andhra Pradesh, India
Job Type
Experienced
Primary Skills
Automation, Machine Learning, Evaluation and Explainability - SHAP
Years of Experience
10
Travel
No
Job Posting
09/12/2025

Join Virtusa

 

Please enter a valid email address to begin your application.

Thank you for verifying your email. Please proceed with the steps below to apply.

We only accept the following file extensions: .pdf, .docx or .doc
Maximum file size: 1 MB
File name must not include special characters or spaces (e.g. “name_resume.pdf”)

We only accept the following file extensions:

Thank you. You already have an active account with Virtusa's hiring system. Please login to our portal to proceed with your application or apply for more opportunities.

LoginClick to Login

About Virtusa

Teamwork, quality of life, professional and personal development: values that Virtusa is proud to embody. When you join us, you join a team of 27,000 people globally that cares about your growth — one that seeks to provide you with exciting projects, opportunities and work with state of the art technologies throughout your career with us.

Great minds, great potential: it all comes together at Virtusa. We value collaboration and the team environment of our company, and seek to provide great minds with a dynamic place to nurture new ideas and foster excellence.

Virtusa is an Equal Opportunity Employer. All applicants will receive fair and impartial treatment without regard to race, color, religion, sex, national origin, ancestry, age, legally protected physical or mental disability, protected veteran status, status in the U.S. uniformed services, sexual orientation, gender identity or expression, marital status, genetic information or on any other basis which is protected under applicable federal, state or local law.

Applicants may be required to attend interviews in person or by video conference. In addition, candidates may be required to present their current state or government-issued ID during each interview. All candidates must be authorized to work in the USA.

Learn more

Awards and recognition

Find us on Glassdoor.

Have any questions?

What is the best way to find and apply for positions at Virtusa?

To join our bright team of professionals, you can apply directly to our website under the Careers tab and search all open jobs. https://www.virtusa.com/careers

Can I apply for more than one position at the same time?

Yes, you can. Virtusa gives you the flexibility to apply for multiple open positions that excite you about your future and align to your experience and career goals.

Can I apply for a position across multiple geographical locations?

Yes, you can. Virtusa is a global Company, and we serve our clients through our global delivery model.

What happens after I’ve submitted my resume?

Our dedicated recruitment team will review your online application and match it to all our open jobs. We update our open jobs on a daily basis and encourage you to check back often.

How will I be evaluated for a career opportunity with Virtusa?

Our team of recruiters will review your application, relevant job experience, and skills to appropriately align it to our open jobs. From there, the recruitment team will contact the qualified candidate to start the interview process.

Career insights

Want to explore the ways you can engineer your career in technology? Our thought leaders share key career insights for candidates from entry-level job seekers to senior technologists.