10 hours ago
Base Salary
$141k - $173k/yr
Responsibilities
- Design, deploy, scale, and maintain highly available Apache Airflow clusters for enterprise ETL/ELT workflows.
- Drive infrastructure-as-code and GitOps practices using Terraform, Helm, ArgoCD, and self-hosted GitHub runners.
- Architect and manage GitHub Actions CI/CD pipelines for data pipelines, infrastructure, and DAGs.
- Provision and manage Kubernetes EKS/AKS clusters, Docker containers, and AWS and Azure cloud infrastructure.
- Build monitoring, logging, alerting, and telemetry systems using Grafana, Prometheus, and Loki.
- Build scalable data infrastructure supporting Spark, AWS EMR, Snowflake, Azure Synapse, Apache Kafka, and dbt.
- Deploy and maintain data discovery, metadata, lineage, and governance tooling such as DataHub.
- Monitor and optimize cloud, compute, storage, Snowflake, and Kubernetes infrastructure costs.
- Build internal tools, CLI utilities, and workflow templates that improve data engineering and analytics developer productivity.
- Own platform modules end to end from architecture through deployment, production operations, and incident management.
- Define engineering standards for code quality, design, testing, lineage, access controls, IAM, and schema management.
- Partner with technical and business stakeholders on a 1–2 year data platform roadmap and mentor junior and mid-level engineers.
Requirements
- 6+ years of hands-on professional experience in data platform engineering, DevOps, or SRE supporting big-data environments.
- Deep production experience managing, tuning, scaling, and troubleshooting Apache Airflow, including Celery and Kubernetes executors.
- Expert-level skills with Kubernetes, Helm, Terraform, Docker, ArgoCD, and GitHub Actions, including custom runner configuration.
- Production experience configuring alerting, metrics collection, and log aggregation with Grafana, Prometheus, and Loki.
- Deep operational and configuration experience with Spark, AWS EMR, Snowflake, Azure Synapse, dbt, and Apache Kafka.
- Hands-on experience with AWS services including EC2, S3, VPC, IAM, and EKS and/or Azure, plus demonstrated cloud cost-optimization experience.
- Experience managing data cataloging or metadata platforms such as DataHub, Amundsen, or similar tools.
- Strong programming and scripting skills in Python, Bash, Go, or SQL.
- Ability to take complex architecture requirements through production deployment and operate automation-first, resilient infrastructure.
Benefits
- Remote position restricted to candidates residing within 30 miles of Portland, ME; Boston, MA; Chicago, IL; Dallas, TX; the San Francisco Bay Area, CA; or Seattle, WA.
- Health, dental, and vision insurance; retirement savings plan; paid time off; health savings and flexible spending accounts; life and disability insurance; tuition reimbursement; and additional benefits.
- Non-sales roles are typically eligible for a quarterly or annual bonus under the applicable plan.
Tech Stack
Apache AirflowApache KafkaApache SparkAWSAzureBashdbtDockerGitHub ActionsGoGrafanaHelmKubernetesPrometheusPythonSnowflakeSQLTerraform
Categories
Data EngineeringDevOps
About WEX
WEX is a public financial technology company that provides corporate payment solutions to fleets, healthcare/benefits administrators, and travel businesses. Its products include fuel and mobility cards, virtual card payments, and platforms for HSAs/FSAs/HRAs, with revenue from payment processing and software/service fees. Founded in 1983 and headquartered in Portland, Maine, WEX trades on the NYSE under WEX and was formerly known as Wright Express.