Staff AI Platform Engineer
Sumitomo Mitsui Banking Corporation3 days ago
Charlotte, NC, USAStaff+
Responsibilities
- Design and operate the MLOps/LLMOps backbone for AI platforms using Databricks and Azure Cloud Services.
- Build automated CI/CD pipelines and infrastructure-as-code for models, prompts, and agents across DEV, QA, REL, and PROD environments.
- Implement canary, blue/green, shadow, champion-challenger, and automated-rollback deployment and validation strategies.
- Establish end-to-end lineage, version control, tracing, experiments, auditability, and quality gates across data, prompts, retrievals, models, and responses.
- Build monitoring and observability for data quality, model and data drift, retrieval and hallucination/grounding health, application performance, business KPIs, and cost.
- Establish automated regression, A/B, canary, shadow, golden-dataset, rubric-based, and human-in-the-loop evaluation processes.
- Operationalize responsible-AI guardrails and security/privacy controls across inference and agent-tool layers.
- Support day-two operations through model cards, API/SLA contracts, runbooks, incident response, and escalation readiness.
- Evaluate and integrate emerging AI-Ops tools that improve reliability, observability, and cost efficiency.
- Mentor engineering teams on MLOps/LLMOps practices and platform capabilities.
Requirements
- Bachelor’s degree in Computer Science, Machine Learning, Data Science, or a related field.
- At least 5 years of hands-on experience deploying, operating, and maintaining GenAI or advanced ML models in production, focused on MLOps/LLMOps.
- At least 3 years of experience with Python and GenAI frameworks or tools such as Databricks Vector Search, Azure AI Search, Azure AI Document Intelligence, LangGraph, Haystack, and LlamaIndex.
- Deep hands-on expertise with MLOps/LLMOps tooling, data platforms, Databricks Asset Bundles, and Azure.
- Experience developing and deploying RESTful services, containerized applications, and automated CI/CD systems.
- Experience building observability, monitoring, and alerting for AI systems, including drift, evaluation metrics, hallucination/grounding health, performance, and cost.
- Working knowledge of prompt engineering, embedding models, RAG evaluation, and vector databases.
- Working knowledge of PyTorch, TensorFlow, and Hugging Face Transformers.
- Familiarity with AI governance, responsible AI, and security/privacy controls in regulated financial-services environments.
- Strong communication and collaboration skills, with the ability to influence technical and non-technical stakeholders.
- Ability to mentor engineering teams and adopt emerging AI/GenAI operational tooling.
Benefits
- Hybrid workforce model allowing work from home and an SMBC office, with employees required to live within a reasonable commuting distance of their office.
- Specific hybrid work schedules are discussed during the interview process.
- Reasonable accommodations are available during candidacy for applicants with disabilities.
Categories
About Sumitomo Mitsui Banking Corporation
Sumitomo Mitsui Banking Corporation provides corporate, investment, and commercial banking services—such as lending, capital markets, global trade finance, treasury/FX, and transaction banking—to corporate, institutional, and consumer clients. Headquartered in Tokyo, it is the core banking subsidiary of Sumitomo Mitsui Financial Group (SMFG), one of Japan’s three major banking groups, whose shares trade in Tokyo and as NYSE ADRs (SMFG). SMBC serves clients through a network spanning nearly 40 countries.