Lead AI/ML Platform Engineer
Toyota USA19 days ago
Plano, TX, USAStaff+
Responsibilities
- Design and implement cloud-native infrastructure for production AI/ML and GenAI workloads.
- Build and evolve MLOps and LLMOps platform capabilities for model training, versioning, deployment, monitoring, and rollback.
- Create GPU-accelerated compute environments and scalable model-serving and inference infrastructure.
- Standardize infrastructure patterns for vector databases, model registries, and orchestration frameworks.
- Develop approaches for prompt management, inference scaling, latency optimization, and token usage optimization.
- Design secure multi-tenant AI environments with access controls, auditability, and usage governance.
- Partner with engineering, platform, data, architecture, and cybersecurity teams to improve data flow, observability, and operational resiliency.
- Own technical direction for AI infrastructure services and integrations.
- Lead design reviews, establish engineering standards, guide technical decisions, and mentor engineers.
Requirements
- 10+ years of software engineering experience focused on cloud infrastructure or cloud platform engineering.
- 3+ years of experience building cloud infrastructure supporting AI/ML workloads such as training, tuning, and inference.
- Deep hands-on experience with AWS and infrastructure-as-code tools such as Terraform, CDK, or CloudFormation.
- Production experience with Kubernetes, containerization, and CI/CD pipelines.
- Strong understanding of GPU infrastructure, serverless compute, and scalable microservice patterns.
- Familiarity with model hosting, inference scaling, and observability tools such as Datadog, CloudWatch, or Prometheus.
- Practical experience with Git, GitHub, and CI/CD tooling such as GitHub Actions or Jenkins.
- Bonus: experience with AWS AI/ML services such as SageMaker or Bedrock.
- Bonus: familiarity with LLMOps, GenAI infrastructure, LangChain, or RAG pipelines.
- Bonus: experience with vector databases, model registries, or orchestration tools such as MLflow, Airflow, or Ray.
- Bonus: AWS Solutions Architect Professional or Machine Learning certification.
Benefits
- Professional growth and development programs, including tuition reimbursement.
- Toyota team member vehicle purchase discount and lease vehicle program where applicable.
- Comprehensive health care and wellness plans for the employee's family.
- Toyota 401(k) plan with company match and annual retirement contributions where applicable.
- Paid holidays and paid time off.
- Referral services for prenatal services, adoption, childcare, schools, and related needs.
- Health Savings Account, Health Care FSA, and Dependent Care FSA.
- Relocation assistance where applicable.
- Team-oriented, flexible, and respectful work environment.