Software Engineer, Big Data Infrastructure
Benchling
22 days ago
San Francisco, CA, USA
Mid Level
H1B Sponsor
Base Salary
$141k - $191k/yr
Responsibilities
- Build next generation Data Platform with scalable data ingress/egress for internal and external customers.
- Define and design data transformations and pipelines for cross-functional datasets.
- Ensure data integrity and data privacy are prioritized proactively.
- Define Service Level Objectives for batch & streaming pipelines and optimize their performance.
- Design and create CI/CD pipelines for platform provisioning and lifecycle management.
- Establish best practices around the usage of the data platform.
Requirements
- 2+ years of experience in software engineering.
- Strong experience in backend engineering and distributed systems.
- Proficient in a scripting language such as Python.
- Experience with deployment and configuration management frameworks like Terraform or Ansible.
- Familiarity with container management systems such as Kubernetes or Amazon ECS.
- Strong communication skills with the ability to translate raw data into understandable insights.
- Willingness to work onsite in the SF office 3 days a week.
- Experience with data analytics and warehouse solutions is a plus.
Benefits
- Flexible hybrid work arrangement with in-office collaboration.
- Competitive total rewards package including medical, dental, and vision plans.
- Four months of fully paid parental leave.
- 401(k) with employer match.
- Mental health benefits including therapy and coaching.
- Generous and flexible vacation policy.
- Learning and development stipend.
- Sabbaticals for 5-year and 10-year anniversaries.
Tech Stack
AnsibleApache KafkaApache SparkChefKubernetesPythonSnowflakeSQLTerraform
Categories
BackendData Engineering