LLM Platform Engineer
Whatnot
21 days ago
San Francisco, CA, USA
Mid Level / Senior
H1B Sponsor
Base Salary
$245k - $345k/yr
Responsibilities
- Own the infrastructure powering LLMs across critical business surfaces.
- Create robust and scalable LLM evaluation frameworks to measure model performance.
- Deploy RAG systems and MCP servers to ground LLM responses in business context.
- Design efficient human-in-the-loop feedback pipelines for scalable LLM evaluation.
- Bridge the gap between research and production for scalable solutions.
- Take on new technical challenges as AI scales across Whatnot’s ecosystem.
Requirements
- 4+ years of professional experience developing machine learning systems and algorithms.
- Bachelor’s degree in Computer Science, Statistics, Applied Mathematics, or related field.
- 3+ years of software engineering experience building production systems for consumer-scale loads.
- 1+ years of professional experience developing software in Python.
- Experience with operational, search, and key-value databases like PostgreSQL and Elasticsearch.
- Familiarity with cloud computing platforms such as AWS Sagemaker and Lambda.
- Exceptional documentation and communication skills.
Benefits
- Flexible Time off Policy and Company-wide Holidays.
- Health Insurance options including Medical, Dental, Vision.
- Work From Home Support including home office setup allowance.
- Monthly allowance for wellness and childcare.
- 401k offering with employer match up to 4% of base salary.
- 16 weeks of paid parental leave with gradual return to work.
Tech Stack
Amazon DynamoDBApache FlinkApache KafkaAWSDatadogElasticsearchGrafanaPostgreSQLPythonRedis
Categories
AI & MLBackend