25 days ago
Base Salary
$141k - $173k/yr
Responsibilities
- Design, deploy, scale, and maintain highly available Apache Airflow clusters using Helm, Kubernetes, and Terraform.
- Drive infrastructure-as-code and GitOps practices with Terraform, Helm Charts, ArgoCD, and self-hosted GitHub runners.
- Architect and manage GitHub Actions CI/CD pipelines for data pipelines, infrastructure components, and DAGs.
- Provision and operate Kubernetes EKS and AKS clusters, Docker containers, and AWS and Azure cloud infrastructure.
- Build monitoring, logging, alerting, and telemetry systems using Grafana, Prometheus, Loki, and centralized log management.
- Build and maintain data infrastructure for Apache Spark, AWS EMR, Snowflake, Azure Synapse, Apache Kafka, and dbt.
- Deploy and manage data discovery, metadata, lineage, schema management, and cataloging tools such as DataHub.
- Monitor and optimize cloud and data infrastructure costs across AWS and Azure.
- Build internal tools, CLI utilities, and workflow templates for data engineers, analytics engineers, and data scientists.
- Own data platform modules from architecture and deployment through production operations and incident management.
- Define engineering standards for code quality, testing, data lineage, security, access controls, IAM, and schema management.
- Partner with stakeholders on a 1–2 year data platform roadmap and mentor junior and mid-level engineers.
Requirements
- 6+ years of hands-on professional experience in Data Platform Engineering, DevOps, or Site Reliability Engineering supporting big data environments.
- Deep production experience managing, tuning, scaling, and troubleshooting Apache Airflow infrastructure, including Celery and Kubernetes Executors.
- Expert-level skills with Kubernetes, Helm, Terraform, Docker, ArgoCD, and GitHub Actions, including custom runner configurations.
- Production experience configuring alerting, metrics collection, and log aggregation with Grafana, Prometheus, and Loki.
- Operational and configuration experience with Spark, AWS EMR, Snowflake, Azure Synapse, dbt, and Apache Kafka.
- Hands-on experience with AWS services including EC2, S3, VPC, IAM, and EKS, and/or Azure, plus demonstrated cloud cost optimization experience.
- Experience deploying or managing data cataloging and metadata platforms such as DataHub, Amundsen, or similar tools.
- Strong programming or scripting skills in Python, Bash, Go, or SQL.
- Ability to take complex architectural requirements from concept through production deployment and automate operational work.
Benefits
- Remote position, with residence required within 30 miles of Portland, Boston, Chicago, Dallas, the San Francisco Bay Area, or Seattle/Washington.
- Health, dental, and vision insurance.
- Retirement savings plan, paid time off, health savings account, flexible spending accounts, life insurance, and disability insurance.
- Tuition reimbursement and additional benefits.
- Non-sales roles are typically eligible for a quarterly or annual bonus under the applicable plan.
Tech Stack
Apache AirflowApache KafkaApache SparkAWSAzureBashdbtDockerGitHub ActionsGoGrafanaHelmKubernetesPrometheusPythonSnowflakeSQLTerraform
Categories
Data EngineeringDevOps
About WEX
WEX is a public financial technology company that provides corporate payment solutions to fleets, healthcare/benefits administrators, and travel businesses. Its products include fuel and mobility cards, virtual card payments, and platforms for HSAs/FSAs/HRAs, with revenue from payment processing and software/service fees. Founded in 1983 and headquartered in Portland, Maine, WEX trades on the NYSE under WEX and was formerly known as Wright Express.