5 months ago
Base Salary
$91k - $124k/yr
Responsibilities
- Design, build, and maintain AI-powered applications using LLM APIs, tool calling, and structured outputs.
- Develop and improve agent architectures integrating SQL execution, Python execution, and marketing platform APIs through MCP-style integrations.
- Design multi-turn context handling, session memory strategies, and prompt structures to improve reliability and reduce hallucinations.
- Implement safeguards, retry logic, structured validation, and hallucination mitigation for tool, SQL, and code execution.
- Build and contribute to evaluation frameworks for LLM systems, including multi-turn testing, regression testing, and task-based success metrics.
- Expand the platform into document generation, tables, slide decks, and potential Google Workspace integrations.
- Collaborate with Machine Learning Engineers, Product Managers, and Full-Stack Engineers to deliver robust and maintainable AI systems.
- Stay current with LLM systems, agent architectures, and applied AI tooling.
- Complete an interview process that includes an Excel and typing test.
Requirements
- Strong Python programming skills and experience building production systems.
- Experience building applications powered by LLM APIs such as OpenAI, Anthropic, or Vertex AI.
- Deep understanding of context windows, token limits, multi-turn conversations, tool calling, structured outputs, prompt design, and failure modes.
- Experience integrating external APIs into production systems.
- Proficiency in SQL.
- Experience with GCP, AWS, or Azure.
- Strong problem-solving and complex-system debugging skills.
- Excellent communication and cross-functional collaboration skills.
- Preferred experience includes LLM evaluation frameworks, embeddings, vector search, RAG architectures, agent or multi-agent workflows, stateful or sandboxed code execution, document automation, internal developer or productivity tools, and TypeScript.
- Required knowledge includes Python, SQL, cloud platforms, LLMs or AI APIs, and Git/GitHub.
- Nice-to-have knowledge includes BigQuery, Snowflake, Redshift, dbt, Cube, Looker, dbt Metrics, and TypeScript.
Benefits
- Unlimited vacation policy
- Monthly phone stipend
- Medical, dental, and vision insurance options
- 401(k) plan with matching
- Dog-friendly office
- Hybrid work opportunity
- Professional Development Program
- Seamless allowance perk
Tech Stack
Categories
About WITHIN
WITHIN is the leading Performance Branding company. We are a digital-first, integrated media and creative agency built to drive measurable growth across the entire customer journey. Our Performance Branding framework unifies brand and performance marketing to eliminate silos and align strategy, media, and creative around shared business goals. The result is smarter investment, faster execution, and stronger outcomes. As a full-service digital marketing agency, WITHIN partners with some of the world’s most innovative brands, including The North Face, Timberland, Touchland, Ben & Jerry’s, and Foot Locker. We help marketing leaders scale efficiently while strengthening brand equity.