5 days ago
Base Salary
$141k - $173k/yr
Responsibilities
- Design, deploy, scale, and maintain highly available Apache Airflow clusters supporting enterprise ETL/ELT workflows.
- Drive infrastructure-as-code and GitOps practices using Terraform, Helm, ArgoCD, Kubernetes, and GitHub Actions.
- Manage Kubernetes clusters, Docker containers, cloud infrastructure, CI/CD pipelines, and self-hosted GitHub runners across AWS and Azure.
- Build monitoring, logging, telemetry, and alerting systems using Grafana, Prometheus, Loki, and centralized log management solutions.
- Architect data infrastructure supporting Apache Spark, AWS EMR, Snowflake, Azure Synapse, Apache Kafka, and dbt.
- Deploy and maintain data discovery, metadata, lineage, cataloging, and governance tooling such as DataHub or Amundsen.
- Monitor and optimize cloud, compute, storage, Snowflake, and Kubernetes costs across AWS and Azure.
- Build internal tools, CLI utilities, and workflow templates to improve data engineering and analytics developer productivity.
- Own platform modules end to end, from architecture and deployment through production operations and incident management.
- Define engineering standards, contribute to the data platform roadmap, partner with stakeholders, and mentor junior and mid-level engineers.
Requirements
- 6+ years of hands-on professional experience in Data Platform Engineering, DevOps, or Site Reliability Engineering supporting big data environments.
- Deep production experience managing, tuning, scaling, and troubleshooting Apache Airflow, including Celery or Kubernetes Executors and DAG parsing performance.
- Expert-level skills with Kubernetes, Helm, Terraform, Docker, ArgoCD, and GitHub Actions, including custom runner configurations.
- Production experience configuring alerting, metrics collection, and log aggregation with Grafana, Prometheus, and Loki.
- Deep operational and configuration experience with Spark, AWS EMR, Snowflake, Azure Synapse, dbt, and Apache Kafka.
- Hands-on experience with AWS services including EC2, S3, VPC, IAM, and EKS and/or Azure, plus a demonstrated history of cloud cost optimization.
- Experience deploying or managing data cataloging and metadata management platforms such as DataHub or Amundsen.
- Strong programming and scripting skills in Python, Bash, Go, or SQL.
- Ability to take complex architectural requirements from concept through production deployment and automate operational tasks with code, tests, CI/CD checks, and resilient infrastructure.
Benefits
- Remote position.
- Health, dental, and vision insurance.
- Retirement savings plan.
- Paid time off.
- Health savings account and flexible spending accounts.
- Life insurance and disability insurance.
- Tuition reimbursement.
- Non-sales roles are typically eligible for a quarterly or annual bonus under the applicable plan.
Tech Stack
Apache AirflowApache KafkaApache SparkAWSAzureBashdbtDockerGitHub ActionsGoGrafanaHelmKubernetesPrometheusPythonSnowflakeSQLTerraform
Categories
Data EngineeringDevOps
About WEX
WEX is a public financial technology company that provides corporate payment solutions to fleets, healthcare/benefits administrators, and travel businesses. Its products include fuel and mobility cards, virtual card payments, and platforms for HSAs/FSAs/HRAs, with revenue from payment processing and software/service fees. Founded in 1983 and headquartered in Portland, Maine, WEX trades on the NYSE under WEX and was formerly known as Wright Express.