Senior DataOps Engineer
Scout Motors2 days ago
Base Salary
$140k - $170k/yr
Responsibilities
- Design, implement, automate, maintain, and operate enterprise-scale cloud data platforms using Databricks, AWS cloud services, and infrastructure as code.
- Lead the design, development, optimization, and operational management of enterprise-scale ETL/ELT pipelines in Databricks.
- Build and maintain scalable batch and streaming pipelines using PySpark, Spark SQL, Delta Lake, and Databricks Workflows.
- Configure and optimize Databricks clusters for performance, scalability, reliability, and cost efficiency.
- Build data integration solutions and enterprise data models, including relationships and dependencies.
- Design Python-based ETL/ELT infrastructure, automation, and transformation solutions.
- Design BI dashboards for visualizing trends and forecasts.
- Implement highly available, reliable, scalable, and performant data infrastructure and monitoring solutions.
- Design, train, and deploy ML models and use ML techniques for forecasting, insights, and decision-making.
- Review application data systems for data governance compliance and collaborate with security teams on industry standards and regulatory requirements.
- Collaborate with product managers, developers, systems teams, business partners, and other cross-functional stakeholders.
Requirements
- Bachelor’s degree in computer science, information technology, or a related field, or equivalent work experience.
- 8+ years of hands-on DataOps Engineer experience in a manufacturing or automotive environment.
- Experience with streaming and event-based architectures and Databricks lakehouse solutions.
- Experience with Terraform and infrastructure as code.
- Proficiency building data pipelines with Python and SQL.
- Experience with AWS data services including Glue, Kinesis, and Firehose, or comparable services.
- Experience with structured, unstructured, and time-series databases.
- Understanding of cloud data storage technologies including RDS, DynamoDB, DocumentDB, Mongo, Cassandra, and Influx.
- Several years of experience with cloud platforms such as AWS and Azure.
- Proven ability to develop, train, and deploy scalable ML models and apply ML algorithms to forecasting and decision-making.
- Strong troubleshooting, problem-solving, communication, collaboration, and adaptability skills.
Benefits
- Fully remote role based within the United States, with occasional in-person convening and company-related travel.
- Medical, dental, vision, and income protection insurance plans.
- 401(k) program with employer match and immediate vesting.
- 20 days of planned PTO as accrued, 40 hours of unplanned PTO, and 14 annual company or floating holidays.
- Up to 16 weeks of paid parental leave for biological and adoptive parents of all genders.
- Paid leave for bereavement, jury duty, voting time, and military leave.
- Full-time exempt position eligible for an annual performance bonus program.
Categories
Data EngineeringML Engineering
About Scout Motors
Scout Motors designs and manufactures electric trucks and rugged SUVs for consumer drivers, reviving the historic Scout off‑road brand. Founded in 2022 and headquartered in Charlotte, North Carolina, the company is building a manufacturing plant in Blythewood, South Carolina. Its lineup targets work and outdoor use, with both an all‑electric powertrain and a Harvester range‑extender option that integrates a gas generator for extended range.