Senior Software Engineer - Data Engineering
Abnormal Security
3 months ago
Remote, United States
Senior
H1B Sponsor
Base Salary
$176k - $207k/yr
Responsibilities
- Own mission-critical pipeline reliability, ensuring 99.9% uptime for production data pipelines.
- Design and implement automated monitoring, testing, and recovery systems for data pipelines.
- Deploy CI/CD pipelines and self-service platforms to accelerate development velocity.
- Optimize data pipelines for exponential growth and compliance with regulations.
- Collaborate with Sales, Finance, and Product teams to align data infrastructure with business needs.
- Define best practices for data engineering and mentor team members.
- Design and maintain an accessible semantic layer for data consumption.
Requirements
- 6+ years of software engineering experience in backend, distributed systems, or data-focused roles.
- Proven experience designing and running large-scale, production-grade data pipelines.
- Proficiency in Python, Spark/PySpark, Airflow, SQL, dbt, Databricks, Snowflake, and AWS.
- Track record of driving pipeline reliability to 99%+ uptime.
- Strong systems-thinking skills for debugging complex distributed systems.
- Demonstrated ownership mindset and ability to drive projects independently.
- Experience collaborating with cross-functional teams and communicating technical decisions.
- Bachelor’s degree in Computer Science, Applied Sciences, Information Systems, or related fields.
Tech Stack
Apache AirflowApache SparkAWSDatabricksdbtPythonSnowflakeSQL
Categories
AI & MLData Engineering