5 hours ago
Chennai, IndiaSenior / Staff+
Responsibilities
- Develop, test, troubleshoot, debug, and enhance applications using Spark, PySpark, Scala, Pandas, Databricks, Airflow, and SQL.
- Deploy application components using CI/CD pipelines.
- Build utilities for monitoring and automating repetitive functions.
- Collaborate with Agile cross-functional teams, internal and external clients, Operations, Infrastructure, and Tech Ops.
- Collaborate with Data Science teams to productionize machine-learning models.
- Participate in a rotational support schedule to respond to customer queries and deploy bug fixes.
- Optimize the performance of Spark workloads.
Requirements
- Require 8–12 years of applicable software engineering experience.
- Require strong experience with big-data technologies including Spark, PySpark, Scala, Pandas, Databricks, Airflow, and SQL.
- Require experience with cloud technologies, preferably Microsoft Azure.
- Require experience optimizing Spark workloads.
- Preferred experience with GitHub, Kubernetes, Jenkins, and Docker.
- Preferred knowledge of relational databases, preferably PostgreSQL.
- Require excellent English communication skills for working with cross-functional technology teams and the business.
- Require a minimum bachelor’s degree in computer science, computer engineering, or a related field.
Benefits
- Flexible working environment.
- Volunteer time off.
- LinkedIn Learning.
- Employee Assistance Program.
- Wellness plans for employees and families.
- Financial wellness tools and career development opportunities.
- Peer-to-peer recognition platforms.
- Participation in a rotational support schedule is part of the role.
Tech Stack
Categories
Data Engineering