LLM Platform Engineer
Whatnot
about 1 month ago
Los Angeles, CA, USA +3 more
Mid Level / Senior
H1B Sponsor
Base Salary
$225k - $320k/yr
Responsibilities
- Own the infrastructure powering LLMs across critical business surfaces.
- Create robust and scalable LLM evaluation frameworks to measure model performance.
- Deploy RAG systems and MCP servers to ground LLM responses in business context.
- Design efficient human-in-the-loop feedback pipelines for scalable LLM evaluation.
- Bridge the gap between research and production for scalable solutions.
- Take on new technical challenges as AI scales across Whatnot’s ecosystem.
Requirements
- 4+ years of professional experience developing machine learning systems.
- Bachelor’s degree in Computer Science, Statistics, Applied Mathematics, or related field.
- 3+ years of software engineering experience building production systems.
- 1+ years of professional experience developing software in Python.
- Experience with operational, search, and key-value databases.
- Familiarity with cloud computing platforms and managed services.
- Exceptional documentation and communication skills.
Benefits
- Flexible Time off Policy and Company-wide Holidays.
- Health Insurance options including Medical, Dental, Vision.
- Work From Home Support with setup allowance and monthly allowances.
- Care benefits including wellness and childcare allowances.
- 401k offering with employer match and international pension plans.
- 16 weeks of paid parental leave plus a gradual return to work.
Tech Stack
Amazon DynamoDBApache FlinkApache KafkaAWSDatadogElasticsearchGrafanaPostgreSQLPythonRedis
Categories
AI & MLBackend