Senior Software Engineer - AI Platform Engineering
Mayo Clinic2 days ago
Rochester, MN, USASenior
Responsibilities
- Design and implement high-performance hosting environments for specialized models and autonomous agents.
- Build multi-tenant platform capabilities for model and agent execution across hybrid-cloud and on-premises environments.
- Implement real-time monitoring, distributed tracing, and automated evaluation for production agents and models.
- Participate in a rotational platform operations team supporting the reliability and uptime of critical AI services.
- Partner with cross-functional AI teams to reduce system friction and improve delivery workflows.
Requirements
- Bachelor’s degree in Computer Science, Engineering, or a related field plus five years of relevant experience, or an associate’s degree in Computer Science, Engineering, or a related field plus seven years of relevant experience.
- In-depth software engineering knowledge and experience coding applications or services in a high-level programming language, preferably Python.
- Experience with modern application development frameworks and professional software engineering practices across the software development lifecycle.
- Experience with scalable backend systems, preferably including Kubernetes, containerization, and orchestration.
- Understanding of LLM and autonomous-agent lifecycles, inference optimization, and RAG architectures.
- Experience implementing observability through logging, metrics, and tracing in distributed environments.
- Strong technical aptitude, problem-solving and time-management skills, and written and verbal communication skills.
- Preferred: master’s degree, experience with open-source technologies and cloud services, GCP, AWS, Azure, databases, analytics, big data, business intelligence, and highly available distributed systems.
- Preferred: experience developing software for healthcare-related industries.
- Must be authorized to work and remain in the United States without current or future Mayo Clinic sponsorship.
Benefits
- Hybrid position requiring residence within 100 miles of a Mayo Clinic campus, with occasional on-site work based on business needs.
- Mayo Clinic does not participate in the F-1 STEM OPT extension program.
Categories
About Mayo Clinic
Mayo Clinic is a nonprofit academic medical center and health system providing hospital and specialty care, research, and medical education to patients globally. It operates major campuses in Rochester, Minnesota (headquarters), Phoenix/Scottsdale, Arizona, and Jacksonville, Florida, plus a regional health system across the Midwest. Revenue comes primarily from clinical services, complemented by research grants and education programs; specialties include heart care, cancer, transplantation, and neurosciences.