Senior Software Development Engineer - GenAI
CVS Health1 day ago
Base Salary
$93k - $185k/yr
Responsibilities
- Design and build foundational AI/GenAI platform services for internal agentic and LLM-driven tooling.
- Develop services for LLM routing, quota and cost governance, authentication, observability, RAG, and agentic workflow orchestration.
- Integrate LLM and AI provider APIs into production systems.
- Design reusable internal tooling and reason about trade-offs in distributed, stateful systems.
- Collaborate with senior engineers and technical and non-technical stakeholders while proposing improvements to established patterns.
- Help shape the next generation of foundational AI services in a healthcare environment with PHI/PII and compliance considerations.
Requirements
- 5+ years of professional software engineering experience, including 2+ years building production backend services in Python and/or TypeScript/Node.js.
- 2+ years designing and building RESTful APIs or microservices with frameworks such as FastAPI, Flask, Express, or NestJS.
- Production experience integrating one or more LLM or AI provider APIs, such as Anthropic, OpenAI, AWS Bedrock, or Google Vertex AI.
- Experience with AWS, Azure, or GCP.
- Production experience with Redis, Kafka, and MongoDB or equivalent technologies.
- Experience with OAuth2/OIDC or JWT-based authentication and authorization systems.
- Experience with observability or telemetry tooling such as OpenTelemetry, Prometheus, Grafana, Langfuse, or Datadog.
- Experience with Docker, CI/CD pipelines, Git, and code review processes.
- Bachelor's degree or equivalent work experience in Mathematics, Statistics, Computer Science, Analytics, Engineering, or a related discipline; a master's degree is preferred.
- Preferred experience includes building LLM or GenAI infrastructure, prompt engineering, model routing, LLM cost optimization, regulated-industry systems, and reusable internal tooling.
- Strong communication, collaboration, independent curiosity, technical judgment, and comfort with ambiguity are preferred.
Benefits
- Full-time position with a 40-hour anticipated work week.
- Medical, dental, and vision coverage, paid time off, retirement savings options, wellness programs, and other resources, subject to eligibility.
- Eligible for CVS Health bonus, commission, or short-term incentive programs in addition to base pay.
- Application window is anticipated to close on 10/09/2026.
Tech Stack
Apache KafkaAWSAzureDatadogDockerExpressFastAPIFlaskGitGoogle Cloud PlatformGrafanaMongoDBNestJSNode.jsPrometheusPythonRedisTypeScript
Categories
About CVS Health
CVS Health is a U.S. health care company that operates thousands of retail pharmacies, runs the CVS Caremark pharmacy benefits manager, and owns the Aetna health insurance business. It sells prescriptions, retail health goods, and insurance plans, and provides primary and urgent care through MinuteClinic and other services for consumers, employers, and government programs. Founded in 1963 and headquartered in Woonsocket, Rhode Island, it is a public company traded on the NYSE.