Software Engineer – AI Agents
FriendliAI5 months ago
San Francisco, CA, USAMid Level
Responsibilities
- Design, build, and maintain agent APIs and applications for document understanding and other high-value features.
- Evaluate and integrate open-source models into production-ready agent features.
- Develop reference agent applications that demonstrate workflows and accelerate customer adoption.
- Collaborate with backend and infrastructure teams on deployment, orchestration, and monitoring integrations.
- Create robust, developer-friendly, enterprise-ready APIs with strong design and documentation.
- Improve the reliability, scalability, and production performance of agent features.
Requirements
- 3+ years of software engineering experience, preferably in backend, ML systems, or API development.
- Bachelor’s or master’s degree in Computer Science, Computer Engineering, or equivalent.
- Strong Python programming skills and experience with Python frameworks.
- Understanding of LLM workflows, agent patterns, or tool invocation systems.
- Experience designing and delivering production APIs.
- Familiarity with open-source LLMs and multimodal models, including tools such as Hugging Face, LangChain, or LlamaIndex.
- Strong foundations in cloud-native development.
- Preferred experience with document understanding pipelines, Kubernetes or container orchestration, agent frameworks, SDKs, or CLIs.
- Experience in startup or fast-paced environments and a focus on developer experience are preferred.
Benefits
- Flexible working hours.
- Daily lunch and dinner, plus unlimited snacks and beverages.
- Supportive and highly collaborative work environment.
- Health check-up support and top-tier equipment and hardware support.
- Competitive compensation, startup equity, health insurance, and other benefits.
Tech Stack
Categories