1 month ago
Base Salary
$113k - $179k/yr
Responsibilities
- Design, maintain, and improve data platform pipelines and infrastructure across ingestion, streaming, transformation, and delivery.
- Use Apache Airflow, Spark, Iceberg, Kafka, Flink, and dbt Labs for data workflows, processing, and transformation.
- Collaborate with stakeholders to define data flows, co-create data contracts, and document platform practices.
- Monitor and refine pipeline performance and operational processes.
- Use Terraform to provision and manage resources on Google Cloud Platform.
- Review code and help ensure platform practices and standard processes are followed.
- Process access requests and support compliance with platform policies.
- Guide teammates and partner teams in using the data platform effectively.
Requirements
- 8+ years of experience in data engineering or related roles.
- Experience with Apache Airflow for orchestrating data workflows.
- Experience with Spark, Flink, Kafka, and dbt Labs for data processing and transformation.
- Understanding of Apache Iceberg, data table formats, and data warehouse and lakehouse strategies.
- Experience using Terraform for infrastructure-as-code deployments.
- Proficiency in Bash, Python, and SQL.
- Knowledge of OLAP, OLTP, document, and vector database systems.
- Experience with Google Cloud Platform for cloud resource management.
- Bonus: experience with data security and access controls for SOX-compliant data.
- Bonus: experience and knowledge of the Elastic stack.
Benefits
- Base salary with no variable compensation component.
- Eligibility to participate in Elastic’s stock program.
- Company-matched 401(k) with dollar-for-dollar matching up to 6% of eligible earnings.
- Health coverage for employees and families in many locations.
- Distributed-company environment with flexible locations and schedules for many roles.
- Generous vacation days and up to 16 weeks of parental leave.
- Up to $2,000 in matched financial donations and up to 40 volunteer hours annually.
Tech Stack
Apache AirflowApache FlinkApache KafkaApache SparkBashdbtElasticsearchGoogle Cloud PlatformPythonSQLTerraform
Categories
Data Engineering
About Elastic
Elastic builds the Elasticsearch-based platform for enterprise search, observability (logging, metrics, APM), and security (SIEM/endpoint). It sells subscriptions and Elastic Cloud managed services with usage-based pricing, combining open source and proprietary features through Elasticsearch and Kibana. Founded in 2012 and headquartered in San Francisco, Elastic is publicly traded on the NYSE and is used by more than half of the Fortune 500.