GrepJob
DatologyAI

Software Engineer, Data Infrastructure

DatologyAI
Apply
about 1 year ago
Foster City, CA, USASenior / Staff+
H1B Sponsor

Base Salary

$180k - $300k/yr

Responsibilities

  • Design, build, and maintain highly scalable data processing solutions.
  • Architect, build, and deploy back-end systems for the data curation platform.
  • Collaborate with researchers and engineers to implement new features.
  • Ensure systems are reliable, secure, and trustworthy for customers.

Requirements

  • Significant experience in leading and building production data systems.
  • Proficiency in scalable data processing solutions like Spark or Flink.
  • Experience with data lakes or warehouses such as Snowflake or Hive.
  • Familiarity with SQL and distributed storage systems like HDFS or S3.
  • Expertise in ETL schedulers like Airflow or Dagster.
  • Strong commitment to design quality, correctness, and testing.
  • Experience as a technical lead in Data Engineering or Infrastructure teams.
  • Background in building ML/DL systems or data infrastructure for training models.

Benefits

  • 100% covered health benefits (medical, vision, and dental).
  • 401(k) plan with a generous 4% company match.
  • Unlimited PTO policy.
  • Annual $2,000 wellness stipend.
  • Annual $1,000 learning and development stipend.
  • Daily lunches and snacks provided in the office.
  • Relocation assistance for employees moving to the Bay Area.

Tech Stack

Apache AirflowApache FlinkApache HiveApache SparkJavaPythonScalaSnowflakeSQL

Categories

AI & MLData Engineering