GrepJob
Parafin

Senior Software Engineer, Data Platform

Parafin
Apply
5 months ago
San Francisco, CA, USASenior / Mid Level
H1B Sponsor

Base Salary

$230k - $265k/yr

Responsibilities

  • Design and build robust, highly scalable data pipelines and lakehouse infrastructure.
  • Improve the data platform development experience by creating intuitive abstractions and self-service tooling.
  • Own and maintain core data pipelines and models for internal dashboards and customer-facing products.
  • Manage the Data & ML platform infrastructure using Terraform, ensuring high availability of data pipelines.
  • Lead projects to improve data quality, testing, and cost efficiency across existing systems.
  • Act as the primary engineering partner for the Data Science team to gather requirements and design solutions.
  • Share best practices and mentor other engineers on data-centric systems.

Requirements

  • 4+ years of experience in software engineering with a focus on data infrastructure.
  • Advanced proficiency in Python and SQL.
  • Hands-on Spark development experience.
  • Expertise with AWS, Databricks, and Airflow.
  • Familiarity with foundational data-infrastructure technologies like Hadoop and Kafka.
  • Strong problem-solving skills and proactive attitude.
  • Excellent communication and collaboration skills.

Benefits

  • Salary range of $230k-$265k.
  • Equity grant.
  • Medical, dental & vision insurance.
  • Work from home flexibility.
  • Unlimited PTO.
  • Commuter benefits.
  • Free lunches.
  • Paid parental leave.
  • 401(k) plan.
  • Employee assistance program.

Tech Stack

Apache AirflowApache HadoopApache HiveApache KafkaAWSDatabricksDatadogPrestoPythonSQLTerraform

Categories

AI & MLBackendData EngineeringData Science