GrepJob
Galaxy

Lead Data Engineer

Galaxy
Apply
about 3 hours ago
New York, NY, USASenior / Staff+
H1B Sponsor

Base Salary

$100k - $200k/yr

Responsibilities

  • Set the technical vision and roadmap for Galaxy's data platform.
  • Architect, build, and operate scalable batch and streaming data pipelines.
  • Develop and operate high-throughput, low-latency data processing systems.
  • Work within the Databricks and Spark ecosystem to support large-scale data workloads.
  • Build and maintain cloud-native data solutions on AWS.
  • Leverage dbt for transformation, data modeling, testing, and documentation.
  • Use Airflow to manage and schedule data workflows.
  • Write clean, efficient, and well-tested code.
  • Mentor and develop other engineers, leading code reviews.
  • Drive technical design discussions and decisions across teams.
  • Own production reliability, leading incident response and root-cause analysis.
  • Partner with product, analytics, and infrastructure teams to deliver impactful data solutions.

Requirements

  • Bachelor’s or Master’s degree in Computer Science, Engineering, or related field.
  • 8+ years of professional experience in data engineering or distributed systems.
  • Expert hands-on coding experience in Python, Java, or similar languages.
  • Proven track record of leading the design and delivery of large-scale data platforms.
  • Experience building and operating both batch and streaming data pipelines.
  • Deep experience with AWS, Databricks/Spark, and modern data architectures.
  • Hands-on experience with dbt for transformations and Airflow for orchestration.
  • Solid understanding of data modeling, data quality, and production data systems.
  • Experience working with relational and non-relational databases.
  • Strong working knowledge of CI/CD, testing frameworks, and monitoring tools.
  • Experience mentoring engineers and influencing technical direction.

Benefits

  • Competitive base salary and discretionary bonus.
  • Hybrid/Flexible Working Arrangements.
  • Flexible Time Off (paid).
  • 3% 401(k) company contribution.
  • Company-paid health and protective benefits for employees and dependents.
  • Generous paid Parental Leave.
  • Competitive family planning benefits for US employees.
  • Opportunities to learn about the Crypto industry.
  • Smart, entrepreneurial, and fun colleagues.
  • Free daily snacks and weekly breakfasts/lunches.
  • Employee Resource Groups.
  • Free coaching and counseling sessions through Headspace.

Tech Stack

Apache AirflowApache SparkAWSDatabricksdbtDockerJavaMicrosoft SQL ServerPostgreSQLPython

Categories

AI & MLData Engineering