about 3 hours ago
Boston, MA, USA
Senior / Staff+
H1B Sponsor
Base Salary
$216k - $324k/yr
Responsibilities
- Define and improve the engineering architecture for Service and Marketing AI capabilities.
- Build and harden AI serving systems with clear contracts and observability.
- Evolve the agentic architecture to enhance tool use and reliability.
- Set engineering standards for AI services, including evaluation and incident response.
- Lead cross-team technical work to clarify ownership and unblock dependencies.
- Mentor and uplevel engineers in design and operational best practices.
- Help build the Palo Alto hub by shaping local engineering rituals and collaboration.
- Measure key metrics for systems to drive technical decisions.
Requirements
- 8+ years of professional software engineering experience with a focus on backend and distributed systems.
- Hands-on experience with generative and agentic AI in production.
- Deep experience with large-scale distributed systems and async processing pipelines.
- Proficient in Python and modern backend frameworks like FastAPI or Django.
- Comfortable with AWS, Kubernetes, and CI/CD pipelines.
- Experience designing evaluations for AI systems and balancing quality metrics.
- Ability to influence architecture and facilitate design reviews.
- Collaborative mindset with a focus on customer experience.
Tech Stack
Apache HadoopApache KafkaApache SparkAWSDjangoFastAPIKubernetesPythonRabbitMQRedis
Categories
AI & MLBackend