21 hours ago
Chennai, India or Hyderābād, IndiaSenior
Responsibilities
- Design judges, deterministic checks, and transformation logic from workflow requirements and conventions.
- Review complex judge designs and streamline judge measurement, onboarding, and handoff mechanisms.
- Provide technical input to RED certification and data-classification work for critical-data workflows.
- Develop and assess judge-builder candidates and contribute reusable components, runbooks, and lessons to the network.
Requirements
- At least 2 years of design, implementation, or consulting experience in applications and infrastructures.
- At least 4 years of experience in technology domains such as software development, cloud computing, systems engineering, infrastructure, security, networking, or data and analytics.
- At least 5 years of IT development or implementation/consulting experience in the software or Internet industries.
- Experience using a current programming language such as Python to build scripts, prototypes, or reusable components.
- Experience with large language models, prompt design, or automated evaluation.
- Preferred qualifications include software or Internet industry experience, AWS experience from a DevOps perspective, production ML- or LLM-based quality or evaluation systems, quality metric analysis, data annotation or content-quality workflows, and data-classification, access-control, or security review familiarity.
Categories
AI ApplicationsSolutions Engineering
About Amazon
Amazon builds and operates a global e-commerce marketplace, logistics network, and consumer devices, and provides cloud computing via AWS for businesses and developers. The company earns revenue from online retail, third‑party seller services, subscriptions like Prime, advertising, and AWS usage. Founded in 1994 and headquartered in Seattle, it is publicly traded on NASDAQ (AMZN) and serves customers in dozens of countries.