Expert Software Engineer, Data Platform
Alegeus Technologies LLC1 day ago
Bengaluru, IndiaSenior
Responsibilities
- Design and develop scalable batch and streaming data pipelines using Apache Spark.
- Build ingestion, transformation, and serving layers for the data platform.
- Optimize Spark jobs for performance, cost, and reliability, including partitioning, skew handling, and memory tuning.
- Design and build data-driven platform APIs and backend services for real-time and near-real-time data access.
- Deploy cloud-native data and platform solutions on Azure, AWS, or GCP.
- Work with Kafka or Event Hubs for event streaming and support Kubernetes-based deployments where applicable.
- Implement data quality, observability, lineage, schema evolution, automated validation, and low-latency data serving.
- Drive testing, code reviews, CI/CD practices, and engineering best practices across data and application code.
- Partner with product and business stakeholders to translate business problems into scalable solutions.
- Own delivery from design through production support and mentor engineers in distributed systems, Spark optimization, and API design.
Requirements
- At least 4 years of software engineering experience focused on data platforms and/or distributed systems.
- Hands-on expertise in Apache Spark, Scala, or PySpark.
- Strong programming skills in Java, Scala, or Python, with Java preferred.
- Experience building large-scale ETL/ELT data pipelines and backend services or APIs.
- Deep understanding of distributed systems, data storage formats, data modeling, and schema evolution.
- Experience with at least one cloud platform: Azure, AWS, or GCP.
- Familiarity with workflow orchestration tools such as Airflow or Dagster.
- Strong system design and performance optimization skills.
- Preferred experience with Spark Structured Streaming, Lakehouse architectures, Delta Lake, Iceberg, or Hudi.
- Preferred experience with event-driven architectures, data governance, catalog and lineage tools, CI/CD, Kubernetes, containerized workloads, and low-latency data-serving APIs.
Benefits
- Flexible work environment.
- Competitive salaries, paid vacation, and holidays.
- Professional development programs.
- Health, wellness, and financial packages.
Tech Stack
Categories
BackendData Engineering
About Alegeus Technologies LLC
Alegeus Technologies builds SaaS platforms for benefit funding and healthcare payments, powering account-based programs like HSAs, FSAs, HRAs, COBRA, and lifestyle accounts. It sells a white-label system used by health plans, third‑party administrators, and financial institutions to administer accounts, issue payment cards, and manage consumer engagement. Founded in 1995 and headquartered in Boston, it operates as a privately held company serving the U.S. consumer-directed healthcare market.