5 months ago
San Francisco, CA, USA or New York, NY, USAMid Level
H1B sponsor
Base Salary
$180k - $225k/yr
Responsibilities
- Partner with enterprise customers to understand their infrastructure, data pipelines, and business requirements.
- Design and implement integrations between Scale AI's platform and customer cloud platforms, data warehouses, and internal APIs.
- Build data connectors and ETL pipelines to ingest, process, and prepare customer data for AI workflows.
- Deploy and configure AI models and agents within customer security and compliance boundaries.
- Develop production AI agents and multi-agent systems for customer support, data analysis, content generation, and workflow automation.
- Implement agent evaluation frameworks, human-in-the-loop workflows, and feedback mechanisms.
- Create prompt strategies, prompt libraries, templates, experimentation processes, A/B tests, RAG systems, and fine-tuning pipelines.
- Act as the primary technical contact for strategic enterprise accounts and provide customer training and knowledge transfer.
- Collaborate with customer and Scale AI engineering teams to solve technical issues, prototype solutions, and translate customer needs into product improvements.
- Document architectures and integration patterns and identify opportunities for productization.
Requirements
- At least four years of software engineering experience with strong data structures, algorithms, and system design fundamentals.
- Production Python expertise and experience with modern ML/AI frameworks such as LangChain, LlamaIndex, HuggingFace, or the OpenAI API.
- Experience with AWS, GCP, or Azure and modern data infrastructure.
- Strong problem-solving skills and the ability to navigate ambiguous requirements and rapidly iterate.
- Excellent communication skills for explaining complex technical concepts to technical and non-technical audiences.
- Preferred experience includes building and deploying AI agents, understanding LLMs, prompting, embeddings, RAG, vector databases, and semantic search.
- Preferred infrastructure experience includes Docker, Kubernetes, CI/CD pipelines, Terraform, Bicep, or other infrastructure-as-code tools.
- Preferred qualifications include technical consulting, solutions engineering, product engineering, technical enablement, or teaching experience, plus familiarity with enterprise security, compliance, and governance requirements.
Benefits
- Comprehensive health, dental, and vision coverage.
- Retirement benefits, learning and development stipend, and generous paid time off.
- Potential commuter stipend and equity eligibility for eligible roles.
- Full-time position with a stated base salary range for San Francisco, New York, and Seattle.
Categories
Forward Deployed
About Scale AI
Scale AI builds data annotation services and AI development tools for enterprises and government agencies, sold as a platform and managed services. Its products include the Scale Generative AI Platform for building and evaluating agents and the Data Engine for collecting, curating, and labeling training data, including RLHF and model evaluation. Founded in 2016 and headquartered in San Francisco, the company is privately held and works across domains from computer vision to LLM applications.