1 day ago
Base Salary
$220k - $256k/yr
Responsibilities
- Define the 3–5 year technical roadmap and architecture for the enterprise data lakehouse.
- Build internal SDKs, CLI tools, control planes, custom operators, and orchestration frameworks that abstract cloud complexity.
- Architect storage, compute, metadata, schema evolution, data discovery, and distributed-system capabilities at petabyte scale.
- Prototype and benchmark emerging data technologies and specialized Spark extensions for performance and cost efficiency.
- Automate data lineage, PII masking, fine-grained access control, governance, and compliance-by-design capabilities.
- Implement streaming support for OpenTelemetry data from AI agents and develop AI evaluation metrics and reporting.
- Lead architecture reviews, serve as the final escalation point for complex outages and performance issues, and establish engineering standards.
- Mentor engineers, influence hiring and professional development standards, and drive technology adoption across autonomous teams.
Requirements
- 15+ years of software engineering and distributed systems experience, including at least four years in a principal- or staff-level capacity leading platform-scale initiatives.
- Strong foundations in software engineering, system architecture, algorithms, data structures, and scalable production applications.
- Professional development experience with Java/J2EE, Spring Boot, and Python, including clean, testable, high-performance code.
- Experience building data platforms, framework engines, and APIs that power data movement rather than only developing ETL/ELT pipelines.
- Deep knowledge of Apache Iceberg, Hudi, or Delta Lake, including metadata management, manifest files, and compaction strategies.
- Experience contributing to or deeply customizing open-source data projects such as Spark or dbt.
- Extensive experience designing high-throughput, fault-tolerant data pipelines and orchestration frameworks.
- Extensive cloud architecture experience with AWS services and Azure, plus experience with Kubernetes, Terraform, GitHub Actions, and CI/CD automation.
- Experience using AI code-generation platforms across the software development lifecycle and architecting infrastructure for AI agent development, including vector database integration.
- Demonstrated ability to lead by influence across multiple teams and communicate architectural trade-offs to executives and engineers.
- Bachelor’s or master’s degree in Computer Science with a distributed systems focus preferred, or equivalent deep industry experience.
Benefits
- Health, dental, and vision insurance.
- Retirement savings plan.
- Paid time off.
- Health savings and flexible spending accounts.
- Life and disability insurance.
- Tuition reimbursement.
- Quarterly or annual bonus eligibility may apply for non-sales roles.
- Base pay range is $220,000.00–$255,800.00.
Tech Stack
Categories
BackendData Engineering
About WEX
WEX is a public financial technology company that provides corporate payment solutions to fleets, healthcare/benefits administrators, and travel businesses. Its products include fuel and mobility cards, virtual card payments, and platforms for HSAs/FSAs/HRAs, with revenue from payment processing and software/service fees. Founded in 1983 and headquartered in Portland, Maine, WEX trades on the NYSE under WEX and was formerly known as Wright Express.