Fireworks AI

Member of Technical Staff, Enterprise Foundations

Fireworks AI
Apply
2 months ago
New York, NY, USAMid Level
H1B sponsor

Base Salary

$165k - $185k/yr

Responsibilities

  • Own foundational capabilities end to end across data models, APIs, the control plane, runtime, SDK/CLI, and console, and migrate live systems onto them.
  • Design organization, sub-account, group, role, and service-identity primitives and connect them to enterprise directories through federation and provisioning.
  • Design multi-tenant authorization, policy enforcement, and audit systems suitable for enterprise security review.
  • Build accurate, understandable usage metering, spend controls, and billing systems at scale.
  • Own data isolation and customer-managed encryption keys across AWS, GCP, and Azure for datasets, fine-tuning, reinforcement-learning checkpoints, models, and inference.
  • Deploy and operate Fireworks inside customer clouds and solve data-residency and regional-isolation requirements.
  • Work directly with customers and use AI tooling to automate development work.

Requirements

  • At least 2 years of experience building and operating production backend or distributed systems at scale.
  • Strong server-side engineering skills in Go, Python, C++, TypeScript, or similar, with willingness to work across layers to deliver features.
  • Experience designing APIs and data models used by other teams and evolving them under live traffic without breaking callers.
  • Hands-on depth in at least one major cloud, including IAM and workload identity, KMS, object storage, and VPC networking.
  • Track record of owning ambiguous, cross-team workstreams from requirements through production.
  • Willingness to work directly with customers.
  • Preferred experience building for regulated enterprises, including SOC 2 and customer security reviews.
  • Preferred experience with SSO, SCIM provisioning, RBAC/ABAC, audit logging, and organization modeling.
  • Preferred experience with metering, quotas, or customer-visible billing systems.
  • Preferred applied cryptography and key-management experience, including envelope encryption, KMS, and threat modeling.
  • Preferred Kubernetes depth and infrastructure-as-code fluency with Terraform and GitOps.
  • Familiarity with LLM inference and fine-tuning is preferred.
Fireworks AI

About Fireworks AI

201-500 employees

Fireworks AI builds a generative AI platform for developers and enterprises to train, fine-tune, and serve open models for production use across text, image, audio, embeddings, and multimodal workloads. It offers managed inference and tooling via APIs on globally distributed infrastructure, with a usage-based SaaS model. Founded in 2022 and headquartered in San Mateo, CA, Fireworks AI is a privately held, Series D company.

Contact me