IMC

Data Platform Operations Engineer – Performance

IMC
Apply
3 months ago

Base Salary

$185k - $225k/yr

Responsibilities

  • Own the operational health, reliability, correctness, and performance of the Performance Team’s data platform.
  • Monitor and maintain ETLs and data pipelines for correctness, timeliness, stability, and observability.
  • Design and maintain data quality checks, reports, and alerting for performance data.
  • Investigate and resolve data issues and pipeline failures while driving root-cause ownership.
  • Troubleshoot GitLab CI/CD pipeline issues related to performance data workflows.
  • Monitor workloads and resource usage, resolving imbalances and bottlenecks.
  • Build and maintain operational tooling, automation, and runbooks.
  • Tune data pipelines and workloads to improve performance and resource efficiency.

Requirements

  • At least 3 years of software engineering or data engineering experience with an operational or production focus.
  • Bachelor’s degree in Computer Science or a related field is strongly preferred.
  • Proficiency in Python with hands-on experience using PySpark and Pandas.
  • Experience supporting production ETL or data processing systems.
  • Familiarity with Git-based development workflows and CI/CD systems, preferably GitLab.
  • Strong analytical skills, attention to detail, and comfort owning work in a performance- and reliability-critical environment.
  • Experience with performance-critical or high-throughput systems is a plus.
  • Exposure to workload scheduling, resource management, or cluster-based compute is a plus.

Benefits

  • Full-time permanent positions are eligible for a discretionary bonus.
  • Benefits include paid leave and insurance.

Tech Stack

GitPandasPython

Categories

Data EngineeringDevOps
Contact me