GenAI Engineer, Agentic Flows & Evaluation
Posted 7 days ago
Job Description
At PwC, our people in data and analytics engineering focus on leveraging advanced technologies and techniques to design and develop robust data solutions for clients. They play a crucial role in transforming raw data into actionable insights, enabling informed decision-making and driving business growth.Those in data science and machine learning engineering at PwC will focus on leveraging advanced analytics and machine learning techniques to extract insights from large datasets and drive data-driven decision making. You will work on developing predictive models, conducting statistical analysis, and creating data visualisations to solve complex business problems.
Meaningful work you'll be part of
As a GenAI Engineer, Agentic Flows & Evaluation , you'll work as part of a team of problem solvers, helping to solve business issues, deliver high quality client service and operational efficiency. We are looking for a GenAI Engineer to design and evaluate agentic flows, build test harnesses, and establish ground truth datasets for performance benchmarking. Responsibilities include but are not limited to:
• Develop agentic flows using frameworks like LangGraph , OpenAI SDK, Google ADK, and MCPS.
• Create agent test harnesses for automated evaluation.
• Benchmark and compare different agent frameworks for performance and reliability.
• Build and maintain ground truth datasets for evaluation.
• Collaborate with AI researchers and developers to improve agentic workflows.
Experiences and skills you'll use to solve
• Strong understanding of LLMs , agent frameworks , and orchestration tools.
• Experience with evaluation methodologies for AI systems.
• Proficiency in Python , Next.js , and familiarity with LangChain / LangGraph ecosystems.
• Ability to design scalable and modular testing frameworks.
• Knowledge of OpenAI SDK , Google AI SDK , and integration best practices.
• Preferred Certifications: AI/ML specialization certifications (AWS, Azure, or equivalent).
• PwC Canadaiscommitted to cultivating an inclusive, hybrid work environment. Exact expectations for your team can be discussed with your interviewer.
• Travel: Occasional for client engagements.
This newly created role reflects our commitment to growth and delivering distinctive value for our clients and stakeholders .
The salary range for this position is $84,700 - $134,700 . The posted salary range represents the expected hiring range for PwC locations in major city centres . Given our national recruiting approach, ranges may vary for positions in other locations. At PwC Canada, base salary is determined by your skills, experience, qualifications and work location. In addition to base salary, eligible employees may have opportunities to participate in variable incentive pay programs which are designed to reward individual and firm-wide achievements. We are committed to offering competitive compensation and adhere to all relevant pay transparency legislation. During the hiring process, our Talent Acquisition team will provide details about our comprehensive total rewards package.
Why you'll love PwC
We're inspiring and empowering our people to change the world. Powered by the latest technology, you'll be a part ofdiverseteams helping public and private clients build trust and deliver sustained outcomes. This meaningful work, and our continuous development environment, will take your career to the next level. We reward your impact, and support your wellbeing, through a competitive compensation package, inclusive benefits and flexibility programs that will help you thrive in work and life.Learn more aboutourApplication Process andTotal Rewards Package at: https://jobs-ca.pwc.com/ca/en/life-at-pwc
PwC Canada acknowledges that we work and live across Turtle Island, on the land that is now known as Canada, which are the lands of the ancestral, treaty and unceded territories of the First Nations, Métis and Inuit Peoples. We recognize the systemic racism, colonialism and oppression that Indigenous Peoples have experienced and still go through, and we commit to allyship and solidarity.
We're committed to providing accommodation throughout the application, interview, and employment process. If you require accommodation to be at your best, please let us know during the application process.
The use of artificial intelligence (AI) in recruiting is just getting started, so we know you have questions about how and why we use it. At certain points during our recruiting process, we rely on AI to improve your experience. This could be during resume review or curating personalized job recommendations, asking you clarifying questions via a chatbot or during our interview scheduling to improve your experience. Our use of AI helps ensure we combat bias by evaluating candidates equally and fairly, without seeing identity information, such as your name, or gender for example). AI also helps us better predict successful hires by reviewing all applicants for a role and the relationship between your skills, experience and likely success at PwC Canada. While AI supports parts of our recruitment process, final hiring decisions always involve human review. For more information about our use and protection of your data, please refer to our Privacy Policy (https://www.pwc.com/ca/en/privacy-policy.html).
Meaningful work you'll be part of
As a GenAI Engineer, Agentic Flows & Evaluation , you'll work as part of a team of problem solvers, helping to solve business issues, deliver high quality client service and operational efficiency. We are looking for a GenAI Engineer to design and evaluate agentic flows, build test harnesses, and establish ground truth datasets for performance benchmarking. Responsibilities include but are not limited to:
• Develop agentic flows using frameworks like LangGraph , OpenAI SDK, Google ADK, and MCPS.
• Create agent test harnesses for automated evaluation.
• Benchmark and compare different agent frameworks for performance and reliability.
• Build and maintain ground truth datasets for evaluation.
• Collaborate with AI researchers and developers to improve agentic workflows.
Experiences and skills you'll use to solve
• Strong understanding of LLMs , agent frameworks , and orchestration tools.
• Experience with evaluation methodologies for AI systems.
• Proficiency in Python , Next.js , and familiarity with LangChain / LangGraph ecosystems.
• Ability to design scalable and modular testing frameworks.
• Knowledge of OpenAI SDK , Google AI SDK , and integration best practices.
• Preferred Certifications: AI/ML specialization certifications (AWS, Azure, or equivalent).
• PwC Canadaiscommitted to cultivating an inclusive, hybrid work environment. Exact expectations for your team can be discussed with your interviewer.
• Travel: Occasional for client engagements.
This newly created role reflects our commitment to growth and delivering distinctive value for our clients and stakeholders .
The salary range for this position is $84,700 - $134,700 . The posted salary range represents the expected hiring range for PwC locations in major city centres . Given our national recruiting approach, ranges may vary for positions in other locations. At PwC Canada, base salary is determined by your skills, experience, qualifications and work location. In addition to base salary, eligible employees may have opportunities to participate in variable incentive pay programs which are designed to reward individual and firm-wide achievements. We are committed to offering competitive compensation and adhere to all relevant pay transparency legislation. During the hiring process, our Talent Acquisition team will provide details about our comprehensive total rewards package.
Why you'll love PwC
We're inspiring and empowering our people to change the world. Powered by the latest technology, you'll be a part ofdiverseteams helping public and private clients build trust and deliver sustained outcomes. This meaningful work, and our continuous development environment, will take your career to the next level. We reward your impact, and support your wellbeing, through a competitive compensation package, inclusive benefits and flexibility programs that will help you thrive in work and life.Learn more aboutourApplication Process andTotal Rewards Package at: https://jobs-ca.pwc.com/ca/en/life-at-pwc
PwC Canada acknowledges that we work and live across Turtle Island, on the land that is now known as Canada, which are the lands of the ancestral, treaty and unceded territories of the First Nations, Métis and Inuit Peoples. We recognize the systemic racism, colonialism and oppression that Indigenous Peoples have experienced and still go through, and we commit to allyship and solidarity.
We're committed to providing accommodation throughout the application, interview, and employment process. If you require accommodation to be at your best, please let us know during the application process.
The use of artificial intelligence (AI) in recruiting is just getting started, so we know you have questions about how and why we use it. At certain points during our recruiting process, we rely on AI to improve your experience. This could be during resume review or curating personalized job recommendations, asking you clarifying questions via a chatbot or during our interview scheduling to improve your experience. Our use of AI helps ensure we combat bias by evaluating candidates equally and fairly, without seeing identity information, such as your name, or gender for example). AI also helps us better predict successful hires by reviewing all applicants for a role and the relationship between your skills, experience and likely success at PwC Canada. While AI supports parts of our recruitment process, final hiring decisions always involve human review. For more information about our use and protection of your data, please refer to our Privacy Policy (https://www.pwc.com/ca/en/privacy-policy.html).
About PwC
Industry
Management and ConsultingCompany Size
5001-10,000 employees
Application closing date is 2026-04-18
Current Openings
-
Full Time
-
AI Solutions Architect
Deloitte
Full Time
-
Full Time
-
Full Time
-
Full Time
-
Full Time
-
Full Time
-
AI Research Engineer
Deloitte
Full Time
-
Full Time
-
Full Time