Vice President, AI / Machine Learning Software Engineer
BNY Mellon19 hours ago
Responsibilities
- Design and implement agentic AI pipelines, including agent loops, tool registries, memory stores, reasoning traces, and self-correction mechanisms.
- Build end-to-end RAG and vectorization pipelines covering document ingestion, OCR and text preprocessing, chunking, embedding generation, indexing, retrieval orchestration, context assembly, and prompt construction.
- Develop multi-agent coordination patterns, prompt engineering infrastructure, and intelligent document extraction workflows.
- Create evaluation harnesses with automated accuracy measurement, retrieval quality metrics, regression detection, and A/B comparison tooling.
- Build FastAPI production APIs for extraction, validation, and classification, and contribute to Java/Spring Boot platform services.
- Design and maintain AI metadata database schemas for audit trails, pipeline runs, memory entries, and knowledge graphs.
- Implement content policy enforcement and data governance controls within AI pipelines.
- Mentor two to three mid-level engineers and participate in architecture reviews, design sessions, documentation, and runbook development.
- Collaborate with product and business stakeholders to translate requirements into technical solutions.
Requirements
- Bachelor's degree in Computer Science, Engineering, or a related field is required; an advanced degree is preferred.
- At least 6 years of professional software engineering experience and at least 2 years building production AI/ML systems are required.
- Strong RAG expertise, including embedding models, vector databases, chunking, retrieval optimization, context-window management, and prompt assembly.
- Experience with agent orchestration, tool use, function calling, structured output parsing, and memory and state management for multi-turn interactions.
- Proficiency in Python 3.11+ and experience with FastAPI, asynchronous patterns, Pydantic, Poetry, and pytest.
- Experience integrating LLMs with prompt engineering, token management, streaming, error handling, and rate limiting.
- Experience with NLP and document processing, including OCR post-processing, text segmentation, and entity extraction.
- Experience with unit testing, integration testing, golden-truth validation, and retrieval-metric evaluation.
- Experience designing RESTful services, OpenAPI specifications, and API versioning strategies.
- Strong problem-solving, collaboration, and communication skills.
- Preferred qualifications include knowledge graph construction, code AI, Java/Spring Boot, Angular/TypeScript, model evaluation, fine-tuning or prompt optimization, graph RAG or hybrid retrieval, financial services, and enterprise deployment.
Benefits
- Competitive compensation, benefits, and wellbeing programs.
- Flexible global resources and tools, health and resilience resources, financial-wellbeing support, and generous paid leave including paid volunteer time.
- Full-time at-will employment in New York, NY.
Tech Stack
Categories
About BNY Mellon
BNY Mellon is a public, New York–based global financial services company providing investment and wealth management, asset servicing, clearance, collateral, and treasury services to institutions, banks, governments, and individuals. It also offers data and investment operations software, including the Eagle platform, delivered as cloud and managed services. Founded in 1784, it is one of the world’s largest custodian banks and asset servicers.