Senior Data Engineer
DevSavant Inc.2 months ago
Remote, AmericasSenior
Responsibilities
- Build, orchestrate, and maintain data pipelines on the GCP stack using BigQuery, dbt, PySpark, Parquet, and Dagster.
- Own the reliability of data delivery and act as the subject matter expert for the delivery pipeline.
- Develop and maintain a deep understanding of core data models.
- Partner with Data Science and Data Operations to maintain trusted, well-understood, self-service datasets.
- Collaborate with cross-functional stakeholders to derive and define requirements.
- Document, simplify, and explain complex technical problems to varied audiences.
- Establish best practices for specialized datasets used in analytics and modeling.
Requirements
- Have 5+ years of software engineering experience, including at least 3 years focused on data infrastructure or platform engineering.
- Have built production pipelines using a modern cloud warehouse such as BigQuery, Snowflake, or Databricks with dbt, SQL, or Spark and an orchestrator such as Dagster or Airflow.
- Have expertise with SQL and at least one general-purpose programming language, preferably Python.
- Build pipelines, custom integrations, automation scripts, and occasional web services.
- Independently navigate unfamiliar systems and identify and fix difficult problems.
- Communicate proactively and effectively with cross-functional teammates and stakeholders.
- Understand the testability of data systems.
- Use AI tools and automation pragmatically to improve work.
- Preferred qualifications include backend web services, cloud resource management with infrastructure as code, maintainable system design, relevant receipt, transaction, or viewership data experience, and data architecture and governance experience.
Benefits
- Remote-first work arrangement.
- Candidates should be able to work during US business hours, preferably from a US Eastern, Central, Mountain, or Pacific time zone.
Tech Stack
Apache AirflowApache SparkAWSDatabricksdbtGoogle BigQueryGoogle Cloud PlatformPythonSnowflakeSQLTerraform
Categories
Data Engineering
About DevSavant Inc.
DevSavant Inc. provides nearshore software engineering services and staff augmentation for U.S.-based B2B tech and AI companies, sourcing talent across Latin America. The privately held firm, founded in 2020 and headquartered in San Mateo, California, builds teams for software development, data engineering, ML/AI, QA, cloud, and UI/UX. It also supports VC and PE portfolio companies with flexible project-based and dedicated team models.