1 day ago
London, United KingdomSenior
Responsibilities
- Execute annotation, evaluation, and validation activities for AI-powered solutions using established guidelines and quality standards.
- Validate AI-generated outputs and Databricks Genie responses for accuracy, completeness, relevance, and consistency.
- Write and execute SQL queries against underlying data sources to validate AI-generated answers.
- Investigate and document discrepancies between expected results, source data, and AI-generated responses.
- Design and standardize annotation processes, schemas, taxonomies, evaluation frameworks, prompts, and quality standards.
- Review complex or high-risk AI outputs and provide expert quality assessments and recommendations.
- Define quality benchmarks, calibration processes, escalation procedures, and prompt best practices.
- Evaluate prompt performance and annotation quality metrics and identify improvement opportunities.
- Identify bias, hallucinations, and other AI risks and recommend mitigation strategies.
- Support AI governance, compliance, and responsible AI initiatives.
- Collaborate with AI engineers, data scientists, product teams, and business stakeholders.
- Mentor and coach junior and intermediate annotators and prompt engineers.
Requirements
- Bachelor’s degree in Computer Engineering, Computer Science, or Information Technology, or a master’s degree in Software Engineering.
- Required skills include data annotation, Databricks AI/BI Genie, and SQL query writing.
- Certified Software Tester (CSTE) certification through Tricentis is listed.
- Advanced English proficiency at C1 level is required.
Benefits
- Fixed-term employment through March 22, 2027.
- Office-based work arrangement with a standard United Kingdom work shift.
- Hands-on experience, mentorship, and learning opportunities in AI-powered transformation.
- Opportunity to work on enterprise AI solutions, responsible AI, and quality governance initiatives.
About Genpact
Genpact is a global professional services and technology firm that runs and transforms mission-critical operations for large enterprises through consulting, managed services, and AI- and analytics-driven platforms. It serves industries such as banking, insurance, healthcare, and manufacturing/supply chain, modernizing finance, risk, customer service, and back-office processes. Headquartered in New York and listed on the NYSE (G), Genpact originated within GE before becoming an independent public company.