Agentic AI Infrastructure Engineer II - Core Platforms
American Express5 days ago
New York, NY, USAMid Level / Senior
Base Salary
$89k - $150k/yr
Responsibilities
- Design, configure, integrate, document, test, and maintain robust infrastructure deployments for AI-enabled workloads.
- Support platform availability and performance by resolving operational issues, analyzing current-state systems, and coordinating production readiness.
- Apply AI-assisted tools, prompt engineering, and ML-powered AIOps to deployment, monitoring, anomaly detection, incident troubleshooting, log analysis, and runbook generation.
- Develop reusable Kubernetes-based platform capabilities for model training, fine-tuning, inference, and agentic workloads.
- Design and operate GPU- and accelerator-enabled compute platforms, including scheduling, workload placement, quotas, reservations, capacity management, and utilization optimization.
- Engineer distributed AI storage, networking, and data movement with measurable availability, latency, throughput, and recovery objectives.
- Implement observability, FinOps, security, identity and access controls, secrets management, supply-chain controls, multi-tenant isolation, and operational readiness.
Requirements
- 3 to 5 years of experience in infrastructure engineering, cloud engineering, DevOps, or a related technical field, including at least 2 years supporting AI-enabled infrastructure, AI automation, or agentic AI technologies.
- Bachelor’s degree in Computer Science, Information Technology, Engineering, or comparable experience; an advanced degree is preferred.
- Experience with AI agent runtimes, orchestration frameworks, tool integrations, asynchronous execution, and stateful workflows, including technologies such as LangGraph or Semantic Kernel.
- Experience with Kubernetes-based AI platforms, containers, workload schedulers, GPU or accelerator orchestration, model-serving or inference platforms, and distributed training or inference infrastructure.
- Experience with high-performance networking and storage, accelerator telemetry, capacity planning, reliability engineering, observability, FinOps, and secure multi-tenant AI infrastructure.
- Experience with Ansible, Puppet, Terraform, Python, Shell scripting, PowerShell, cloud platforms, infrastructure components, network protocols, databases, and monitoring technologies.
- Knowledge of application infrastructure, SAN/NAS storage, middleware, software-defined networking, automation, orchestration, platform delivery methods, Windows and Linux administration, and AI-assisted infrastructure operations.
Benefits
- Competitive base salaries and bonus incentives.
- 6% company retirement savings plan match and financial coaching.
- Comprehensive medical, dental, vision, life insurance, disability, and mental health support.
- Flexible working model with hybrid, onsite, or virtual arrangements depending on role and business need.
- 20+ weeks of paid parental leave for all parents, regardless of gender, for pregnancy, adoption, or surrogacy.
- Access to onsite wellness centers, counseling through the Healthy Minds program, and career development and training opportunities.
Tech Stack
Categories
About American Express
American Express builds a global payments network and issues consumer, small-business, and corporate cards, plus merchant acquiring and travel services. Revenue comes from card fees, interest and lending, discount/merchant fees, and network services. Founded in 1850 and headquartered in New York City, it operates the Amex acceptance network worldwide and offers co-branded cards and membership rewards across millions of cardmembers and merchants; ticker NYSE: AXP.