3 months ago
Base Salary
$142k - $213k/yr
Responsibilities
- Architect and implement end-to-end Generative AI pipelines, including LLM integrations, Retrieval-Augmented Generation systems, autonomous AI agents, and prompt-engineering frameworks.
- Develop scalable, production-ready Python services and APIs for AI-driven COO platform features.
- Evaluate, integrate, and fine-tune LLMs and embedding models for domain-specific financial use cases.
- Build and maintain MLOps and Generative AI deployment pipelines with reliability, observability, and governance controls.
- Design multi-agent orchestration frameworks for complex operational workflows.
- Collaborate with AI Risk and Compliance teams on regulatory requirements, responsible AI, and data privacy.
- Design and optimize data pipelines using vector databases and enterprise data platforms.
- Mentor junior developers, lead code reviews, and contribute to Generative AI standards and best practices.
- Translate COO operations requirements into technical AI solutions and communicate trade-offs and timelines.
Requirements
- 6+ years of professional software engineering experience, including at least 2+ years focused on Generative AI or LLM application development.
- Expert-level Python proficiency, including asynchronous programming, API development with FastAPI and Flask, and software design patterns.
- Hands-on experience with LangChain, LangGraph, LlamaIndex, Google Cloud AI Platform, RAG architectures, embedding pipelines, and vector search.
- Strong understanding of prompt engineering, few-shot learning, and chain-of-thought techniques.
- Experience integrating LLM APIs and services including OpenAI, Azure OpenAI, Anthropic, AWS Bedrock, or Google Vertex AI.
- Solid machine-learning fundamentals and familiarity with model evaluation, fine-tuning with LoRA or PEFT, and inference optimization.
- Hands-on experience with AWS, Azure, or GCP and managed AI or machine-learning services.
- Proficiency with SQL, NoSQL, and vector databases such as Pinecone, Weaviate, Chroma, and pgvector.
- Understanding of CI/CD pipelines, Docker, Kubernetes, Git, and automated testing.
- Bachelor’s or university degree, or equivalent experience; a master’s degree in computer science, AI/ML, or a related discipline is preferred.
- Preferred experience includes multi-agent frameworks, MLflow, Weights & Biases, responsible AI, Kafka, Spark, Airflow, and regulated-industry or financial-services work.
- Experience working in an Agile or SAFe delivery environment is preferred.
Benefits
- Full-time role based in New York, New York.
- Base salary range of $142,320.00-$213,480.00, excluding possible incentive and retention awards.
- Medical, dental, and vision coverage; 401(k); life, accident, and disability insurance; and wellness programs.
- Paid vacation, sick leave, and holidays.
- Available offerings may vary by jurisdiction, job level, and date of hire.
Tech Stack
Apache AirflowApache KafkaApache SparkAWSAzureBashDockerFastAPIFlaskGitGitHub ActionsGoogle Cloud PlatformKubernetesMLflowMongoDBPostgreSQLPythonRedisSQL
Categories
About Citi
Citi is a public financial-services company offering consumer and institutional banking, credit cards, wealth management, treasury and trade solutions, and capital-markets services. It serves individuals, corporations, financial institutions, and governments in more than 160 countries and jurisdictions, earning interest and fee income from lending, payments, trading, and advisory. Founded in 1812 and headquartered in New York, it trades on the NYSE under the ticker C.