AI Infrastructure Engineer
Scout Motorsabout 8 hours ago
Charlotte, NC, USASenior / Staff+
H1B Sponsor
Base Salary
$140k - $170k/yr
Responsibilities
- Install, configure, and maintain AI platform and tools.
- Design, deploy, and operate infrastructure supporting ML and LLM workloads.
- Build, containerize, and deploy AI services using Docker.
- Build and maintain Machine Learning CI/CD pipelines for training, testing, and deployment.
- Deploy and manage AI services across cloud and on-prem environments.
- Automate infrastructure provisioning using Terraform and Infrastructure-as-Code best practices.
- Monitor system performance, reliability, and scalability of AI platforms.
- Implement observability for agentic AI systems to ensure reliability, transparency, and debuggability.
- Perform regular security updates, patching, access control, and vulnerability remediation.
- Integrate AI tools with APIs, data platforms, and internal systems.
- Research, evaluate, and prototype new AI, LLM, and MLOps tools.
- Troubleshoot infrastructure, data, and deployment issues.
- Document system architecture, deployment processes, and operational runbooks.
Requirements
- Bachelor's degree in computer science, information technology, or related field or equivalent work experience.
- 7+ years practical experience with LLM platforms, LLMOps, and MLOps.
- Experience deploying and maintaining AI or data platforms in production.
- Hands-on experience with AI/automation tools.
- Experience designing and orchestrating agentic automation workflows.
- Strong experience with Terraform and Infrastructure-as-Code.
- Proven experience deploying applications using Docker.
- Expertise with cloud platforms such as AWS.
- Expertise with CI/CD tooling (GitHub Actions, GitLab CI).
- Strong knowledge of Kubernetes and orchestration.
- Solid understanding of networking.
- Experience supporting high-availability, production AI systems.
- Scripting skills (Python, PySpark, Bash).
- Knowledge of security best practices, patch management, and access controls.
- Excellent problem-solving and troubleshooting skills.
- Effective communication and collaboration skills.
- A teaching and coaching approach to guiding engineers and teams.
Benefits
- Competitive insurance including medical, dental, vision, and income protection plans.
- 401(k) program with employer match and immediate vesting.
- Generous Paid Time Off including 20 days planned PTO, 40 hours of unplanned PTO, and 14 company or floating holidays annually.
- Up to 16 weeks of paid parental leave for biological and adoptive parents of all genders.
- Paid leave for circumstances related to bereavement, jury duty, voting time, or military leave.