Citi

Big Data Engineer - Python and Spark

Citi
Apply
13 hours ago
Pune, IndiaMid Level

Responsibilities

  • Design and develop software systems for intensive computational workloads across real-time and batch processes.
  • Build, process, and retrieve data from large and multiple datasets and data warehouses.
  • Redesign undocumented code and optimize costly compute and data processes.
  • Apply data preprocessing, application engineering, data ingestion, and ETL practices.
  • Identify and solve complex business problems and present findings to management.
  • Support data management, governance, security, regulatory, control, and risk-awareness practices.
  • Coordinate with multiple stakeholders and work within onsite/offsite delivery models.

Requirements

  • Bachelor’s or university degree in engineering or equivalent experience.
  • More than 1–3 years of experience in big data systems, Hive, Hadoop, Spark, Python or Scala, and cloud-based data management technologies.
  • At least 3 years of experience designing software systems with intensive computational needs across real-time and batch processing.
  • Hands-on experience with Unix scripting, Python, Scala programming, and strong SQL experience.
  • Experience with large datasets, data warehouses, data preprocessing, application engineering, and relevant data extraction programs.
  • Understanding of supervised and unsupervised machine learning techniques.
  • Exposure to data ingestion, ETL tools, data modeling, performance management tooling, and the Cloudera stack is a plus.
  • Knowledge of data management, data governance, data security, and regulatory practices.
  • Experience in credit cards and retail banking is preferred.
  • Strong communication, interpersonal, process/project management, stakeholder management, control orientation, and risk awareness.

Tech Stack

Apache HadoopApache HiveApache SparkPythonScalaSQLTalend

Categories

Data Engineering
Citi

About Citi

10,000+ employees

Citi is a public financial-services company offering consumer and institutional banking, credit cards, wealth management, treasury and trade solutions, and capital-markets services. It serves individuals, corporations, financial institutions, and governments in more than 160 countries and jurisdictions, earning interest and fee income from lending, payments, trading, and advisory. Founded in 1812 and headquartered in New York, it trades on the NYSE under the ticker C.

Contact me