Senior Data Engineer
Intercontinental Exchange17 hours ago
Base Salary
$145k - $185k/yr
Responsibilities
- Design, write, optimize, and maintain SQL-based data science and analytics solutions.
- Build automated data collection frameworks and maintain databases and data systems.
- Convert data formats and optimize queries and query plans for performance.
- Analyze large datasets using statistical methods to identify patterns, interpret trends, and support diagnosis and prediction.
- Create reports and presentations for business stakeholders.
- Analyze requirements, propose technical solutions, estimate work, and own delivery from design through production support.
- Develop and unit test software and collaborate on integration, functional, and regression testing.
- Prototype algorithms and ML, AI, NLP, and LLM solutions for quantitative analysis and market monitoring.
- Collaborate with business, technology, operations, project management, development, and QA teams.
- Continuously improve system performance and propose improved technical approaches.
Requirements
- Bachelor's degree in computer science, data science, finance, or mathematics, or equivalent experience.
- 5+ years of professional software development experience.
- Strong Python programming skills, including experience with pandas, NumPy, and PySpark.
- Strong SQL skills, including query tuning and query plan management.
- Experience working in cloud environments such as AWS.
- Experience with cloud data platforms or warehouses such as Snowflake, Databricks, BigQuery, or Redshift.
- Experience applying statistical analysis and modeling to financial market data, or familiarity with market structure, trading data, or regulatory compliance analytics.
- Experience writing complex programs, implementing custom algorithms, and adapting open-source frameworks.
- Proficiency with Git and experience working in Agile teams of 5 to 8 engineers.
- Strong written and verbal communication skills for explaining complex solutions to stakeholders across disciplines.
- Preferred: experience with Java, Scala, R, Julia, Spark SQL, Parquet, Deephaven, kdb+, InfluxDB, TimescaleDB, Tableau, Power BI, Alteryx, bash, or AWK.
- Preferred: experience with data management, analytics middleware, platform infrastructure, or an applied R&D or innovation lab setting.
Benefits
- Regular full-time employees are eligible for healthcare coverage, including medical, dental, and vision.
- Benefits include a 401(k) plan, life insurance, time off, and paid leave for qualifying circumstances.
Tech Stack
Categories
Data Engineering
About Intercontinental Exchange
Intercontinental Exchange operates global exchanges and clearing houses, offers fixed income and commodities trading platforms, and sells market data, listings, and mortgage technology to financial institutions and lenders. Its revenue comes from transaction and clearing fees, data subscriptions, listings, and software. Founded in 2000 and headquartered in Atlanta, it owns the New York Stock Exchange and ICE Mortgage Technology, and is publicly traded on the NYSE under the ticker ICE.