Intercontinental Exchange

Senior Back End Developer

Intercontinental Exchange
Apply
1 day ago
Hyderābād, IndiaSenior

Responsibilities

  • Design and implement ETL/ELT pipelines with Python and PySpark on Databricks.
  • Build and manage Apache Iceberg tables, including schema evolution, partitioning, compaction, versioning, and time-travel queries.
  • Develop and optimize complex SQL Server queries, stored procedures, views, and analytical data models.
  • Automate infrastructure provisioning, deployments, and operational tasks with PowerShell.
  • Monitor and optimize Databricks cluster performance, job scheduling, and costs.
  • Collaborate with data scientists, analysts, and business stakeholders to deliver reliable data products.
  • Enforce data quality, governance, and lineage best practices.
  • Participate in code reviews, technical design sessions, and Agile ceremonies.

Requirements

  • At least 6 years of experience in data engineering or a similar role.
  • Deep experience with SQL Server, T-SQL, stored procedures, query tuning, indexing strategies, window functions, CTEs, and schema design.
  • Strong experience with Python, PySpark, distributed data processing, DataFrame APIs, and optimization.
  • Hands-on experience with Databricks Workflows, Unity Catalog, Delta/Iceberg integration, and cluster management.
  • Experience managing Apache Iceberg table formats, including schema evolution, partitioning, compaction, and time travel.
  • Experience with AWS or GCP cloud platforms.
  • Familiarity with Git and CI/CD practices.
  • Strong understanding of data warehouse and data lakehouse concepts.
  • Experience using PowerShell for automation, CI/CD pipelines, and Windows or Azure environment management.
  • Preferred experience with Azure Data Factory, dbt, or Airflow.
  • Preferred knowledge of SSIS and Power BI or Tableau.

Tech Stack

Apache AirflowAWSAzureDatabricksdbtGitGoogle Cloud PlatformMicrosoft SQL ServerPowerShellPythonWindows

Categories

Data Engineering
Intercontinental Exchange

About Intercontinental Exchange

10,000+ employees

Intercontinental Exchange operates global exchanges and clearing houses, offers fixed income and commodities trading platforms, and sells market data, listings, and mortgage technology to financial institutions and lenders. Its revenue comes from transaction and clearing fees, data subscriptions, listings, and software. Founded in 2000 and headquartered in Atlanta, it owns the New York Stock Exchange and ICE Mortgage Technology, and is publicly traded on the NYSE under the ticker ICE.

Contact me