GrepJob
OpenAI

Data Engineer, People Innovation Labs

OpenAI
Apply
about 2 months ago
San Francisco, CA, USAMid Level / Senior
H1B Sponsor

Base Salary

$293k - $325k/yr

Responsibilities

  • Design, build, and manage people data pipelines.
  • Ensure seamless integration of data into the Databricks warehouse.
  • Develop canonical datasets to track key people metrics.
  • Collaborate with teams to understand their data needs.
  • Implement robust systems for data ingestion and processing.
  • Participate in data architecture and engineering decisions.
  • Ensure data security, integrity, and compliance.

Requirements

  • 3+ years of experience as a data engineer.
  • 8+ years of software engineering experience.
  • Proficiency in programming languages like Python, Scala, or Java.
  • Experience with data warehousing technologies such as Databricks and Snowflake.
  • Expertise with ETL schedulers like Fivetran, Airflow, or similar.
  • Familiarity with distributed processing technologies like Spark or Hadoop.

Tech Stack

Apache AirflowApache FlinkApache HadoopApache SparkDatabricksJavaPythonScalaSnowflake

Categories

Data Engineering