4 days ago
Bengaluru, IndiaStaff+
Responsibilities
- Define the 3–5 year technical roadmap and architecture for the enterprise data lakehouse.
- Build internal SDKs, CLI tools, control planes, custom operators, and automated orchestration frameworks.
- Architect storage, compute, metadata, schema evolution, data discovery, and multi-engine optimization capabilities.
- Prototype and benchmark emerging data technologies and specialized Spark extensions.
- Automate data lineage, PII masking, compliance, and fine-grained access control across petabyte-scale environments.
- Lead architecture reviews, set engineering standards, and serve as the escalation point for complex outages and performance bottlenecks.
- Mentor engineers, influence hiring and development standards, and drive technology adoption across autonomous teams.
- Architect infrastructure supporting AI-agent development, including vector database integration.
Requirements
- 15+ years of software engineering and distributed systems experience, including at least four years leading platform-scale initiatives at principal or staff level.
- Strong foundations in software engineering, algorithms, data structures, system architecture, and scalable production applications.
- Experience developing with Java/J2EE, Spring Boot, microservices, and Python.
- Experience building data platform engines, frameworks, and APIs for data movement rather than only ETL/ELT pipelines.
- Deep knowledge of Apache Iceberg, Hudi, or Delta Lake, including metadata management, manifest files, and compaction strategies.
- Experience contributing to or deeply customizing open-source data projects such as Spark or dbt.
- Extensive cloud architecture experience with AWS and Azure, including services such as S3, EMR, Kubernetes, and Lambda.
- Experience with CI/CD automation, Git Actions, Terraform, and modern development tools.
- Experience using AI code-generation platforms for code generation, reviews, unit tests, and root-cause analysis.
- Ability to architect infrastructure for AI-agent development and enable vector database integration.
- Proven ability to lead by influence, drive adoption across multiple teams, and communicate architectural trade-offs to technical and executive audiences.
- Bachelor’s or master’s degree in computer science with a distributed systems focus is preferred, or equivalent deep industry experience.
Tech Stack
Categories
BackendData Engineering
About WEX
WEX is a public financial technology company that provides corporate payment solutions to fleets, healthcare/benefits administrators, and travel businesses. Its products include fuel and mobility cards, virtual card payments, and platforms for HSAs/FSAs/HRAs, with revenue from payment processing and software/service fees. Founded in 1983 and headquartered in Portland, Maine, WEX trades on the NYSE under WEX and was formerly known as Wright Express.