Citi

Data Engineer - Python, AI

Citi
Apply
24 hours ago
Pune, IndiaSenior

Responsibilities

  • Develop and optimize ETL and distributed data-processing jobs using PySpark, Pandas, PyArrow, and related libraries.
  • Build and maintain NLP pipelines using Flair, BERT, LLM-based models, and related frameworks.
  • Create scalable ingestion and data-transformation pipelines for AI and analytics use cases.
  • Develop and maintain Flask-based APIs for model inference and service integrations.
  • Use Redis for caching and fast lookups.
  • Track, version, manage, and deploy machine-learning models with MLflow.
  • Support CI/CD workflows and deployment pipelines using GitHub and LightSpeed Enterprise.
  • Create and maintain Autosys JILs for job scheduling and automation.
  • Troubleshoot and support deployments using Linux commands and shell scripting.
  • Monitor application and system health with ITRS Geneos.
  • Write unit tests and improve automated test coverage using PyTest and unittest.
  • Work with REST APIs, microservices, cloud services including ECS, and boto3.

Requirements

  • 10–12 years of hands-on Python programming experience.
  • Strong Python, object-oriented programming, and design-pattern fundamentals.
  • Experience with NLP libraries such as Flair, BERT, HuggingFace Transformers, or similar.
  • Solid experience with PySpark, Pandas, PyArrow, and distributed data pipelines.
  • Experience building APIs with Flask; FastAPI is a plus.
  • Experience with MLflow for model tracking and deployment.
  • Understanding of CI/CD practices and Git workflows.
  • Experience with Redis or similar in-memory stores.
  • Experience with Autosys JILs for scheduling.
  • Comfort with Linux command-line tools and shell scripting.
  • Exposure to cloud services and AWS boto3 experience is an asset.
  • Preferred experience with Polars, Dask, PyTorch, TensorFlow, Docker, Kubernetes, ITRS Geneos, FastAPI, Airflow, or Prefect.
  • Strong debugging, problem-solving, and teamwork skills.

Tech Stack

Apache AirflowAWSDockerFastAPIFlaskHugging Face TransformersKubernetesLinuxMLflowPandaspytestPythonPyTorchRedisTensorFlow

Categories

Data EngineeringML Engineering
Citi

About Citi

10,000+ employees

Citi is a public financial-services company offering consumer and institutional banking, credit cards, wealth management, treasury and trade solutions, and capital-markets services. It serves individuals, corporations, financial institutions, and governments in more than 160 countries and jurisdictions, earning interest and fee income from lending, payments, trading, and advisory. Founded in 1812 and headquartered in New York, it trades on the NYSE under the ticker C.

Contact me