AI Engineer, AIOps & Infrastructure
Eloquent AIResponsibilities
- Design and build scalable ML infrastructure for deploying and maintaining AI agents in production.
- Automate LLMOps and MLOps workflows for model training, fine-tuning, deployment, and monitoring.
- Optimize GPU and cloud compute workloads to improve efficiency and reduce latency.
- Develop Kubernetes-based solutions, including custom operators for ML model orchestration.
- Improve observability and reliability through logging, monitoring, and AI model performance tracking.
- Collaborate with ML and engineering teams on data pipelines, model serving, and inference optimization.
- Maintain security, compliance, high availability, and scalability across AI infrastructure.
- Participate in on-call rotations supporting the 24/7 reliability of critical AI systems.
Requirements
- 5+ years of experience in software engineering, MLOps, or infrastructure development.
- Strong expertise in Kubernetes and experience managing containerized machine learning workloads.
- Deep understanding of AWS, GCP, Azure, and distributed computing.
- Proficiency in Python and experience developing services for ML/AI applications.
- Experience with ML model deployment pipelines, model serving, inference optimization, and monitoring.
- Familiarity with vector databases, retrieval systems, and RAG architectures is preferred.
- Experience with LLMOps, fine-tuning, and deploying large-scale AI models is preferred.
- Experience with GPU workload optimization, ML model parallelization, or distributed training strategies is preferred.
- Experience building infrastructure for AI-powered applications is preferred.
- Contributions to open-source MLOps tools or AI infrastructure projects are preferred.
Benefits
- Opportunity to work on frontier LLMOps and AI infrastructure for enterprise financial services applications.
- Work alongside experienced AI, engineering, and product teams at a fast-growing, globally operating startup.
- Headquartered in San Francisco with a global footprint.
Categories
About Eloquent AI
Eloquent AI is the first AI Operator built specifically for financial services to automate complex, regulated customer service operations beyond frontline support. Our AI Operator learns to securely navigate your existing systems simply by observing your standard operating procedures—automating up to 96% of tasks without any engineering effort. Automate complex, multi-party workflows—unfreeze accounts, handle AML/KYC checks, adjust repayments, or update claim statuses without escalations. Ensure compliance effortlessly, with our proprietary LLM, Oratio trained specifically on your financial regulations for secure, auditable interactions. Integrate seamlessly—connect AI directly to your CRM, databases, and support platforms for chat, voice and email support.