Staff Software Engineer
Zeta Global10 hours ago
Base Salary
$240k - $240k/yr
Responsibilities
- Lead the design and development of secure, scalable platform services and tooling for LLM-powered applications, agentic workflows, and experimentation.
- Design and implement retrieval and knowledge systems, including RAG pipelines, embeddings, and vector stores.
- Establish evaluation frameworks, benchmarks, and feedback loops for GenAI quality, correctness, and safety.
- Build observability and debugging capabilities covering tracing, cost monitoring, latency analysis, and failure detection.
- Optimize GenAI workload cost and performance through model routing, caching, prompt optimization, and efficient infrastructure design.
- Architect multi-tenant isolation, configuration, quota management, and cost attribution capabilities.
- Implement GenAI security controls for prompt injection mitigation, data protection, and access governance.
- Design and implement agent orchestration frameworks with tool integration, state management, and workflow control.
- Build developer-facing APIs, SDKs, and tooling for GenAI experimentation and productionization.
- Drive lifecycle management from experimentation through production, including versioning, deployment strategies, and rollback mechanisms.
- Integrate and evaluate multiple model providers and frameworks and define abstraction and selection strategies.
- Develop software using C#, Java, JavaScript, Go, or Python.
Requirements
- Bachelor’s degree in Computer Science, Computer or Software Engineering, or Information Systems.
- At least 5 years of experience in the job offered or a related occupation.
- Experience with generative AI, large language models, and cloud infrastructure.
- Experience with GenAI platform technologies including MCP, LangGraph, OpenAI, and Bedrock.
Benefits
- Option to telecommute 3 days per week.
- Unlimited PTO.
- Medical, dental, and vision coverage.
- Employee equity and stock purchase plan.
- Employee discounts, virtual wellness classes, and pet insurance.
Tech Stack
Categories
About Zeta Global
Zeta Global builds an AI-powered marketing cloud that unifies customer data, analytics, and omnichannel activation for enterprise brands and agencies. Its Zeta Marketing Platform combines martech and adtech—spanning CRM, email, display, and social—to acquire, grow, and retain customers on a subscription and media-buying model. Founded in 2007 and headquartered in New York City, Zeta is a public company trading on the NYSE under the ticker ZETA.