22 days ago
Pune, IndiaStaff+
Responsibilities
- Architect and implement high-throughput batch and real-time streaming data pipelines and ingestion frameworks.
- Provide technical oversight and define best practices for data modeling, partitioning, distributed computing, and code efficiency.
- Lead modernization efforts to retire legacy infrastructure and adopt cloud-native data platforms, lakehouse architectures, and modern compute engines.
- Optimize queries, data transformation jobs, and storage layers for performance and reliability.
- Implement automated testing and monitoring to prevent pipeline outages and data drift.
- Drive data governance, data quality, risk and control compliance, regulatory milestones, and modernization across the data ecosystem.
- Analyze, design, construct, test, implement, and support new or revised application systems.
- Consult with users and technology groups, recommend programming solutions, and advise or coach lower-level analysts.
Requirements
- 5–8 years of relevant experience in systems analysis, application programming, or data engineering.
- Bachelor’s or university degree, or equivalent experience.
- Advanced proficiency in Apache Spark, PySpark or Scala, Python, and SQL.
- Hands-on experience with Apache Kafka, Solace, or Apache Flink for real-time stream processing.
- Expertise with modern data warehousing or lakehouse platforms such as Snowflake, BigQuery, Databricks, Delta Lake, or Hive/Hadoop.
- Knowledge of relational databases including PostgreSQL and Oracle, NoSQL databases including MongoDB and Cassandra, dimensional modeling, and schema design.
- Experience with Apache Airflow, Docker, OpenShift or Kubernetes, and CI/CD pipelines.
- Familiarity with data quality tools, data cataloging platforms such as Collibra or Apache Atlas, and automated testing frameworks.
- Experience managing and implementing successful projects, with working knowledge of consulting or project management techniques.
- Ability to work under pressure, manage deadlines, exercise independent judgment, and handle changing requirements.
Benefits
- Full-time position.
- Citi is an equal opportunity employer and provides reasonable accommodation for applicants with disabilities.
Tech Stack
Apache AirflowApache CassandraApache FlinkApache HadoopApache HiveApache KafkaApache SparkDatabricksDockerGoogle BigQueryKubernetesMongoDBOpenShiftPostgreSQLPythonScalaSnowflakeSQL
Categories
Data Engineering
About Citi
Citi is a public financial-services company offering consumer and institutional banking, credit cards, wealth management, treasury and trade solutions, and capital-markets services. It serves individuals, corporations, financial institutions, and governments in more than 160 countries and jurisdictions, earning interest and fee income from lending, payments, trading, and advisory. Founded in 1812 and headquartered in New York, it trades on the NYSE under the ticker C.