29 days ago
Base Salary
$142k - $213k/yr
Responsibilities
- Architect and implement end-to-end Generative AI pipelines, including LLM integrations, Retrieval-Augmented Generation systems, autonomous AI agents, and prompt-engineering frameworks.
- Develop scalable, production-ready Python services and APIs for AI-driven COO platform features.
- Evaluate, integrate, and fine-tune LLMs and embedding models for domain-specific financial use cases.
- Build and maintain MLOps and Generative AI deployment pipelines with reliability, observability, and governance controls.
- Design multi-agent orchestration frameworks for complex operational workflows.
- Collaborate with AI Risk and Compliance teams on regulatory requirements, responsible AI, and data privacy.
- Design and optimize data pipelines using vector databases and enterprise data platforms.
- Mentor junior developers, lead code reviews, and contribute to Generative AI standards and best practices.
- Translate COO operations requirements into technical AI solutions and communicate trade-offs and timelines.
Requirements
- 6+ years of professional software engineering experience, including at least 2+ years focused on Generative AI or LLM application development.
- Expert-level Python proficiency, including asynchronous programming, API development with FastAPI and Flask, and software design patterns.
- Hands-on experience with LangChain, LangGraph, LlamaIndex, Google Cloud AI Platform, RAG architectures, embedding pipelines, and vector search.
- Strong understanding of prompt engineering, few-shot learning, and chain-of-thought techniques.
- Experience integrating LLM APIs and services including OpenAI, Azure OpenAI, Anthropic, AWS Bedrock, or Google Vertex AI.
- Solid machine-learning fundamentals and familiarity with model evaluation, fine-tuning with LoRA or PEFT, and inference optimization.
- Hands-on experience with AWS, Azure, or GCP and managed AI or machine-learning services.
- Proficiency with SQL, NoSQL, and vector databases such as Pinecone, Weaviate, Chroma, and pgvector.
- Understanding of CI/CD pipelines, Docker, Kubernetes, Git, and automated testing.
- Bachelor’s or university degree, or equivalent experience; a master’s degree in computer science, AI/ML, or a related discipline is preferred.
- Preferred experience includes multi-agent frameworks, MLflow, Weights & Biases, responsible AI, Kafka, Spark, Airflow, and regulated-industry or financial-services work.
- Experience working in an Agile or SAFe delivery environment is preferred.
Benefits
- Full-time role based in New York, New York.
- Base salary range of $142,320.00-$213,480.00, excluding possible incentive and retention awards.
- Medical, dental, and vision coverage; 401(k); life, accident, and disability insurance; and wellness programs.
- Paid vacation, sick leave, and holidays.
- Available offerings may vary by jurisdiction, job level, and date of hire.
Tech Stack
Apache AirflowApache KafkaApache SparkAWSAzureBashDockerFastAPIFlaskGitGitHub ActionsGoogle Cloud PlatformKubernetesMLflowMongoDBPostgreSQLPythonRedisSQL
Categories
About Citi
Citi's mission is to serve as a trusted partner to our clients by responsibly providing financial services that enable growth and economic progress. Our core activities are safeguarding assets, lending money, making payments and accessing the capital markets on behalf of our clients. We have over 200 years of experience helping our clients meet the world's toughest challenges and embrace its greatest opportunities. We are Citi, the global bank – an institution connecting millions of people across hundreds of countries and cities. For information on Citi’s commitment to privacy, visit on.citi/privacy.