AI Platform Engineer
Sumitomo Mitsui Banking Corporation1 day ago
Charlotte, NC, USAStaff+
Responsibilities
- Design and operate the MLOps/LLMOps backbone for the AI platform on Databricks and Azure.
- Develop CI/CD pipelines and infrastructure-as-code for models, prompts, and agents across DEV, QA, REL, and PROD environments.
- Implement canary, blue/green, shadow, and automated-rollback deployment strategies.
- Establish lineage, version control, prompt and model governance, auditability, and quality gates using MLflow.
- Build observability for data quality, model and data drift, retrieval and hallucination health, application performance, business KPIs, and cost.
- Create automated regression, A/B, canary, shadow, and champion-challenger validation using golden datasets and human review.
- Operationalize responsible-AI guardrails and security and privacy controls across inference and agent-tool layers.
- Support day-two operations with model cards, API/SLA contracts, runbooks, incident response, and escalation readiness.
- Evaluate emerging AI-Ops tools and mentor engineering teams on MLOps/LLMOps practices.
Requirements
- Bachelor’s degree in Computer Science, Machine Learning, Data Science, or a related field.
- At least 5 years of hands-on experience deploying, operating, and maintaining GenAI or advanced ML models in production, with a strong MLOps/LLMOps focus.
- At least 3 years of experience with Python and GenAI frameworks or tools such as Databricks Vector Search, Azure AI Search, Azure AI Document Intelligence, LangGraph, Haystack, and LlamaIndex.
- Deep hands-on expertise with MLOps/LLMOps tooling, Databricks, Databricks Asset Bundles, MLflow, and Azure.
- Experience developing and deploying RESTful services, containerized applications, and automated CI/CD systems.
- Experience building observability, monitoring, and alerting for AI systems, including drift, evaluation metrics, hallucination and grounding health, performance, and cost.
- Working knowledge of prompt engineering, embedding models, RAG evaluation, and vector databases.
- Working knowledge of PyTorch, TensorFlow, and Hugging Face Transformers.
- Familiarity with AI governance, responsible AI, and security and privacy controls in regulated financial-services environments.
- Excellent communication and collaboration skills, with the ability to influence technical and non-technical stakeholders.
Benefits
- Hybrid workforce model allowing work from home and an SMBC office, subject to living within a reasonable commuting distance.
- Specific hybrid schedule details are provided during the interview process.
- Reasonable accommodations are available during candidacy for applicants with disabilities.
About Sumitomo Mitsui Banking Corporation
Sumitomo Mitsui Banking Corporation provides corporate, investment, and commercial banking services—such as lending, capital markets, global trade finance, treasury/FX, and transaction banking—to corporate, institutional, and consumer clients. Headquartered in Tokyo, it is the core banking subsidiary of Sumitomo Mitsui Financial Group (SMFG), one of Japan’s three major banking groups, whose shares trade in Tokyo and as NYSE ADRs (SMFG). SMBC serves clients through a network spanning nearly 40 countries.