FriendliAI

Software Engineer - Senior Backend

FriendliAI
Apply
5 months ago

Responsibilities

  • Own the architecture and evolution of core backend microservices powering the AI inference platform.
  • Design and build production-grade REST, gRPC, and GraphQL APIs for AI deployments, developer integrations, and enterprise workflows.
  • Build authentication, RBAC, billing, organization management, and secure multi-tenant SaaS capabilities.
  • Develop LLM deployment workflows and inference-specific service integrations.
  • Design and optimize data models and pipelines across PostgreSQL and ClickHouse.
  • Collaborate on multi-cloud deployment and resource orchestration pipelines.
  • Set reliability and performance standards and resolve production issues.
  • Drive engineering quality through design reviews, automated testing, and CI/CD.

Requirements

  • 5+ years of backend or systems engineering experience in production environments.
  • Bachelor's or Master's degree in Computer Science, Computer Engineering, or equivalent.
  • Expertise in Python and modern frameworks such as FastAPI.
  • Strong experience designing and operating distributed systems at scale.
  • Experience designing REST, gRPC, and GraphQL APIs.
  • Proficiency in data modeling and SQL with hands-on PostgreSQL and ClickHouse experience.
  • Working knowledge of LLM serving.
  • Experience building secure, multi-tenant SaaS architectures involving authentication, RBAC, and compliance requirements.
  • Familiarity with cloud-native development and observability tooling such as OpenTelemetry.
  • Strong systems thinking and ability to reason about failure modes.
  • Preferred experience includes AI or model-serving infrastructure, Kubernetes, developer-facing SDKs or CLIs, internal engineering platforms, multi-cloud environments, incident response, postmortems, and modern frontend frameworks such as React or Next.js.

Benefits

  • Flexible working hours.
  • Daily lunch and dinner, unlimited snacks, and beverages.
  • Supportive and highly collaborative work environment.
  • Health check-up support and top-tier equipment and hardware support.
  • Competitive compensation, startup equity, and health insurance.
  • Work arrangement is not otherwise specified.

Tech Stack

ClickHouseFastAPIGraphQLgRPCKubernetesNext.jsPostgreSQLPythonReactSQL

Categories

FriendliAI

About FriendliAI

51-200 employees
Contact me