Software Engineer - Senior Backend
FriendliAI5 months ago
Responsibilities
- Own the architecture and evolution of core backend microservices powering the AI inference platform.
- Design and build production-grade REST, gRPC, and GraphQL APIs for AI deployments, developer integrations, and enterprise workflows.
- Build authentication, RBAC, billing, organization management, and secure multi-tenant SaaS capabilities.
- Develop LLM deployment workflows and inference-specific service integrations.
- Design and optimize data models and pipelines across PostgreSQL and ClickHouse.
- Collaborate on multi-cloud deployment and resource orchestration pipelines.
- Set reliability and performance standards and resolve production issues.
- Drive engineering quality through design reviews, automated testing, and CI/CD.
Requirements
- 5+ years of backend or systems engineering experience in production environments.
- Bachelor's or Master's degree in Computer Science, Computer Engineering, or equivalent.
- Expertise in Python and modern frameworks such as FastAPI.
- Strong experience designing and operating distributed systems at scale.
- Experience designing REST, gRPC, and GraphQL APIs.
- Proficiency in data modeling and SQL with hands-on PostgreSQL and ClickHouse experience.
- Working knowledge of LLM serving.
- Experience building secure, multi-tenant SaaS architectures involving authentication, RBAC, and compliance requirements.
- Familiarity with cloud-native development and observability tooling such as OpenTelemetry.
- Strong systems thinking and ability to reason about failure modes.
- Preferred experience includes AI or model-serving infrastructure, Kubernetes, developer-facing SDKs or CLIs, internal engineering platforms, multi-cloud environments, incident response, postmortems, and modern frontend frameworks such as React or Next.js.
Benefits
- Flexible working hours.
- Daily lunch and dinner, unlimited snacks, and beverages.
- Supportive and highly collaborative work environment.
- Health check-up support and top-tier equipment and hardware support.
- Competitive compensation, startup equity, and health insurance.
- Work arrangement is not otherwise specified.