Senior Vice President, AI / Machine Learning Software Engineer
BNY Mellon18 hours ago
Jersey City, NJ, USAStaff+
Base Salary
$120k - $200k/yr
Responsibilities
- Design and build production-ready RAG pipelines covering retrieval, ranking, prompt orchestration, response generation, guardrails, tracing, and observability.
- Implement offline and online evaluation frameworks for prompts, models, and datasets using quality, safety, latency, and cost metrics.
- Own the end-to-end lifecycle of GenAI systems, including prompt versions, model versions, datasets, and configurations.
- Establish CI/CD pipelines for prompts, models, and data to enable safe, repeatable, and auditable releases.
- Monitor cost and performance, including token usage, inference latency, throughput, and spend optimization.
- Build safety mechanisms including content filtering, policy enforcement, red-teaming feedback loops, and abuse detection.
- Define incident management workflows for alerting, triage, rollback, and post-incident analysis.
- Partner with product, platform, and governance teams to meet enterprise reliability, security, and compliance standards.
- Mentor engineers and influence best practices for scalable and trustworthy AI systems.
Requirements
- Strong experience building and operating production ML or GenAI systems in enterprise environments.
- Deep hands-on expertise with LLM orchestration frameworks such as LangChain and/or LlamaIndex.
- Experience with model registries and experiment tracking such as MLflow or equivalent.
- Solid understanding of Kubernetes-based deployments and cloud-native architectures.
- Familiarity with feature stores, data pipelines, and retriever/index lifecycle management.
- Proven experience implementing telemetry, logging, metrics, and distributed tracing for ML/AI workloads.
- Strong knowledge of CI/CD practices for ML, GenAI, and data-driven systems.
- Experience operating LLM systems at scale, including multi-model or multi-provider strategies, preferred.
- Exposure to AI safety, governance, and compliance frameworks in regulated environments preferred.
- Background in SRE, platform engineering, or MLOps preferred.
- Ability to translate ambiguous GenAI use cases into robust, production-grade architectures preferred.
Benefits
- Competitive compensation, benefits, and wellbeing programs.
- Flexible global resources and tools, health and resilience programs, and financial wellbeing support.
- Generous paid leave, including paid volunteer time.
- The role is located in Jersey City, NJ.
- Base salary is expected to be $120,000 to $200,000 per year at commencement, excluding potential bonuses, incentives, commissions, and company-sponsored benefits.
Tech Stack
KubernetesMLflow
Categories
About BNY Mellon
BNY Mellon is a public, New York–based global financial services company providing investment and wealth management, asset servicing, clearance, collateral, and treasury services to institutions, banks, governments, and individuals. It also offers data and investment operations software, including the Eagle platform, delivered as cloud and managed services. Founded in 1784, it is one of the world’s largest custodian banks and asset servicers.