6 hours ago
Base Salary
$147k - $210k/yr
Responsibilities
- Write clean, testable, resilient production code in Python, C++, or Java and implement automated integration, stress, and regression testing for LLM pipelines.
- Deliver software components and services that productionalize Data Science prototypes, LLM pipelines, and AI workflows.
- Implement orchestration logic, context window management, structured output parsing, and API integrations connecting foundational LLMs with backend and frontend systems.
- Build automated LLM evaluation pipelines, benchmark suites, and deterministic tests to monitor hallucination rates, output quality, and inference latency.
- Identify and reduce technical debt while collaborating with Data Scientists, Web Solutions Engineers, and Technical Program Managers to clarify requirements and manage dependencies.
Requirements
- Bachelor’s degree or equivalent practical experience.
- At least 2 years of experience with LLMs and generative AI concepts such as prompt engineering and retrieval-augmented generation.
- At least 2 years of software development experience in one or more programming languages, or 1 year of experience with an advanced degree.
- At least 1 year of experience with end-to-end machine learning, including model deployment, model evaluation, data processing, and debugging.
- Preferred experience includes productionalizing advanced LLM architectures, automated LLM evaluation and benchmarking, unstructured text and document processing, vector databases, and AI/ML solutions for governance, risk, compliance, security, or privacy.
- Preferred ability to design robust error handling, fallbacks, monitoring, and alerting infrastructure for production services.
Categories
About Google
Google builds consumer and enterprise software and services including Search, Android, YouTube, Chrome, Maps, Gmail, and Google Cloud. Its business model centers on digital advertising and paid cloud, software, and hardware offerings (e.g., Pixel and Nest) for consumers, developers, and organizations. Founded in 1998 and headquartered in Mountain View, California, Google operates globally as a subsidiary of Alphabet Inc.