Senior Software Engineer - API Gateway
Featherless AI4 months ago
Remote, WorldwideSenior
Responsibilities
- Develop features and fix bugs for the API gateway.
- Improve API reliability through better instrumentation and monitoring.
- Respond to availability incidents and triage issues.
- Manage the infrastructure supporting the API gateway.
- Onboard new models and resolve user issues.
Requirements
- Experience with popular open LLMs and building with LLM.
- Familiarity with web technologies like REST, websockets, and DNS.
- Proficiency in components of the tech stack including k8s, node, and mongodb.
- Ability to debug complex issues across a wide stack.
- Strong collaborative skills and alignment with team values.