1 month ago
Pune, IndiaSenior
Responsibilities
- Develop scalable batch and real-time ETL/ELT pipelines from diverse data sources.
- Design and optimize dimensional data models, data lakes, data lakehouses, and relational or NoSQL data stores.
- Implement workflow scheduling, dependency management, and monitoring with modern orchestration tools.
- Optimize SQL queries, indexing, partitioning, caching, and distributed compute workloads.
- Implement automated data validation, anomaly detection, schema evolution testing, and pipeline observability.
- Enforce data security, role-based access control, data lineage, and compliance standards.
- Partner with BI developers, ML engineers, and business stakeholders to deliver self-service datasets.
- Promote Infrastructure as Code, containerization, and CI/CD practices for data products.
Requirements
- 5+ years of experience leading complex data platform implementations and architecture decisions.
- Proficiency in Python and/or Scala/Java with strong software engineering practices, including object-oriented programming, clean code, unit testing, and Git.
- Advanced SQL proficiency and deep expertise with modern cloud data warehouses.
- Hands-on experience with Apache Spark/PySpark, Apache Flink, or Hadoop ecosystems.
- Experience with dbt and Apache Airflow or comparable modern data stack tools.
- Experience with at least one major cloud provider and associated core data services.
- Experience with data modeling, streaming and batch pipelines, distributed computing, data governance, and data quality practices.
Benefits
- Full-time position.
- Equal opportunity employer with reasonable accommodations available for applicants with disabilities.
Tech Stack
Amazon RedshiftApache AirflowApache FlinkApache HadoopApache KafkaApache SparkAWSAzuredbtDockerGitGoogle BigQueryGoogle CloudGoogle Cloud PlatformJavaKubernetesPythonScalaSnowflakeSQLTerraform
Categories
Data Engineering
About Citi
Citi is a public financial-services company offering consumer and institutional banking, credit cards, wealth management, treasury and trade solutions, and capital-markets services. It serves individuals, corporations, financial institutions, and governments in more than 160 countries and jurisdictions, earning interest and fee income from lending, payments, trading, and advisory. Founded in 1812 and headquartered in New York, it trades on the NYSE under the ticker C.