Citi

Senior Data Engineer (Databricks/AWS)

Citi
Apply
3 days ago
Mississauga, CanadaSenior

Base Salary

$94k - $142k/yr

Responsibilities

  • Lead end-to-end implementation of regulatory and financial reporting data solutions, ensuring accurate and timely submissions.
  • Design, build, test, deploy, and optimize high-throughput batch and streaming ETL pipelines.
  • Monitor and troubleshoot Spark jobs, Hive and Impala queries, HBase operations, and platform-level performance issues.
  • Implement data governance, security, lineage, integrity, and compliance controls across enterprise data platforms.
  • Automate batch processing, job scheduling, monitoring, alerting, and operational support.
  • Analyze datasets, perform data wrangling and quality profiling, and support variance analysis and reporting accuracy.
  • Conduct application and systems analysis, feasibility studies, planning, and development lifecycle oversight.
  • Collaborate with technology teams, platform providers, business users, vendors, and senior stakeholders to resolve complex issues and align requirements.
  • Serve as a technical subject matter expert, advise stakeholders, and coach junior team members.
  • Assess and manage technology, regulatory, operational, and control risks while following applicable policies and standards.

Requirements

  • Bachelor's degree or university degree, or equivalent experience.
  • At least 5 years of hands-on experience designing and implementing large-scale data processing systems for critical regulatory and financial reporting.
  • At least 5 years of data engineering experience with Big Data platforms such as Cloudera, AWS, or Databricks.
  • Hands-on experience with AWS S3 and Glue and with Databricks Delta Lake, Unity Catalog, and Delta Live Tables.
  • Advanced proficiency in PySpark, Scala, and SQL for production-grade batch and streaming ETL pipelines.
  • Deep Apache Spark experience, including executor, partitioning, and memory tuning.
  • Strong knowledge of Hadoop, HDFS, YARN, Hive, Impala, and HBase, including query and storage optimization.
  • Experience building real-time Kafka streaming solutions, preferably with Confluent Kafka.
  • Experience implementing governance, security, and lineage controls with Unity Catalog, Apache Ranger, Apache Atlas, Kerberos, and encryption at rest and in transit.
  • Experience with Git and CI/CD tools such as Jenkins or GitHub Actions.
  • Experience with batch automation and scheduling tools such as Autosys, Control-M, or Apache Airflow.
  • Experience building monitoring and alerting with Grafana, Prometheus, Splunk, or the ELK Stack.
  • Ability to troubleshoot complex performance and platform issues and work with vendors such as Cloudera.
  • Strong data analysis, data wrangling, data quality profiling, and variance analysis skills.
  • Ability to work independently, exercise sound judgment, manage deadlines, and act as a technical subject matter expert.
  • Experience with systems analysis, software application programming, and successful project implementation.
  • Angular or React UI development experience for full-stack data applications and monitoring dashboards is preferred.

Benefits

  • Full-time position.
  • Primary location full-time salary range is $94,300.00 to $141,500.00 annually.
  • Citi provides opportunities for personal development and operates an equal opportunity workplace.
  • Reasonable accommodation is available for applicants with disabilities.

Tech Stack

AngularApache AirflowApache HadoopApache HBaseApache HiveApache KafkaApache SparkAWSDatabricksGitGitHub ActionsGrafanaJenkinsPrometheusReactScalaSplunkSQLYarn

Categories

Data Engineering
Citi

About Citi

10,000+ employees

Citi is a public financial-services company offering consumer and institutional banking, credit cards, wealth management, treasury and trade solutions, and capital-markets services. It serves individuals, corporations, financial institutions, and governments in more than 160 countries and jurisdictions, earning interest and fee income from lending, payments, trading, and advisory. Founded in 1812 and headquartered in New York, it trades on the NYSE under the ticker C.

Contact me