Staff Data Engineer
SecurityScorecard10 days ago
Base Salary
$80k - $94k/yr
Responsibilities
- Serve as a technical lead and de facto anchor for the data engineering team.
- Own complex, ambiguous data engineering problems end-to-end.
- Mentor and level up junior and mid-level engineers.
- Partner with Product Managers to translate business requirements into technical solutions.
- Drive architectural decisions across infrastructure, application, and data tiers.
- Identify and lead initiatives to improve system performance and reliability.
- Participate in all stages of the software development life cycle.
- Implement comprehensive testing and performance tuning.
Requirements
- 8+ years of experience in the Data Engineering space.
- Deep proficiency in Scala.
- Expert-level experience with Apache Spark.
- Strong system design and architecture skills.
- Experience designing and maintaining ETL pipelines in production environments.
- Comfort with high-throughput, high-volume systems.
- Familiarity with strongly-typed and functional programming principles.
- Track record of mentoring engineers.
- Proficiency with version control tools, particularly Git.
Tech Stack
Apache AirflowApache HiveApache KafkaApache SparkAWSClickHouseDockerJenkinsPostgreSQLPythonRedisScalaTerraform
Categories
Data Engineering