1 day ago
Base Salary
$141k - $173k/yr
Responsibilities
- Design, deploy, scale, and maintain highly available Apache Airflow clusters for enterprise ETL/ELT workflows.
- Drive infrastructure-as-code and GitOps practices using Terraform, Helm Charts, ArgoCD, and self-hosted GitHub runners.
- Architect and manage CI/CD pipelines for data pipelines, infrastructure components, and DAGs using GitHub Actions.
- Provision and manage Kubernetes clusters, Docker containers, and cloud infrastructure across AWS and Azure.
- Build and maintain monitoring, logging, telemetry, and alerting systems using Grafana, Prometheus, and Loki.
- Build scalable data infrastructure supporting Apache Spark, AWS EMR, Snowflake, Azure Synapse, Apache Kafka, and dbt.
- Deploy and maintain data discovery, metadata, lineage, schema management, and governance tooling.
- Monitor and optimize compute and storage costs across AWS, Azure, Snowflake, and Kubernetes.
- Build internal tools, CLI utilities, and workflow templates for data and analytics engineering teams.
- Own data platform modules from architecture and deployment through production operations and incident management.
- Define engineering standards for code quality, testing, data lineage, access controls, IAM, and schema management.
- Develop the data platform roadmap, prioritize initiatives with stakeholders, and mentor junior and mid-level engineers.
Requirements
- 6+ years of hands-on professional experience in Data Platform Engineering, DevOps, or Site Reliability Engineering supporting big data environments.
- Deep production experience managing, tuning, scaling, and troubleshooting Apache Airflow infrastructure, including Celery and Kubernetes Executors.
- Expert-level skills with Kubernetes, Helm, Terraform, Docker, ArgoCD, and GitHub Actions, including custom runner configurations.
- Production experience configuring alerting, metrics collection, and log aggregation with Grafana, Prometheus, and Loki.
- Operational and configuration experience with Apache Spark, AWS EMR, Snowflake, Azure Synapse, dbt, and Apache Kafka.
- Hands-on experience with AWS services including EC2, S3, VPC, IAM, and EKS and/or Azure, along with cloud cost optimization experience.
- Experience deploying or managing data cataloging and metadata platforms such as DataHub or Amundsen.
- Strong programming and scripting skills in Python, Bash, Go, or SQL.
- Ability to take complex architectural requirements from concept through production deployment and operate automation-first, resilient infrastructure.
Benefits
- Remote position.
- Health, dental, and vision insurance.
- Retirement savings plan.
- Paid time off.
- Health savings account and flexible spending accounts.
- Life insurance and disability insurance.
- Tuition reimbursement.
- Non-sales roles are typically eligible for a quarterly or annual bonus under the applicable plan.
Tech Stack
Apache AirflowApache KafkaApache SparkAWSAzureBashdbtDockerGitHub ActionsGoGrafanaHelmKubernetesPrometheusPythonSnowflakeSQLTerraform
Categories
Data EngineeringDevOps
About WEX
WEX is a public financial technology company that provides corporate payment solutions to fleets, healthcare/benefits administrators, and travel businesses. Its products include fuel and mobility cards, virtual card payments, and platforms for HSAs/FSAs/HRAs, with revenue from payment processing and software/service fees. Founded in 1983 and headquartered in Portland, Maine, WEX trades on the NYSE under WEX and was formerly known as Wright Express.