2 months ago
Hyderābād, IndiaMid Level
Responsibilities
- Develop and operate a large-scale data platform for analytics, reporting, and AI/ML applications.
- Optimize platform performance and cost while automating operational processes.
- Design and maintain resilient data pipelines and distributed systems.
- Manage cloud infrastructure and multi-tenant Kubernetes clusters at scale.
- Troubleshoot and resolve complex production, Kubernetes, and Spark issues.
- Build reusable frameworks or libraries and contribute innovative solutions to technical challenges.
Requirements
- At least 3 years of experience in software site reliability engineering or software development roles.
- Proficiency in at least one of Python, Golang, or Java.
- Experience coding for distributed systems and developing resilient data pipelines.
- Hands-on experience with at least one major cloud platform: AWS, Azure, or Google Cloud Platform.
- Expertise in designing, building, and operating large-scale distributed systems with low latency, fault tolerance, and high availability.
- Experience managing distributed systems such as Kafka, Spark, or Flink.
- Understanding of data modeling, data warehousing, data structures, algorithms, and software engineering best practices.
- Preferred experience includes open-source contributions, multi-cloud infrastructure, Kubernetes and Spark debugging, Airflow or DBT, and familiarity with GPUs, MLFlow, or large language models.
- Ability to independently troubleshoot complex technical issues and implement innovative solutions.
Tech Stack
Apache AirflowApache FlinkApache KafkaApache SparkAWSAzuredbtGoGoogle Cloud PlatformJavaKubernetesMLflowPython
Categories
Data EngineeringSite Reliability
About Apple
Apple designs and sells consumer electronics, software, and services for consumers and professionals worldwide, including iPhone, Mac, iPad, Apple Watch, and AirPods, plus platforms like iOS/macOS and services such as the App Store, iCloud, Music, and TV+. Its business combines device sales with services and subscriptions and in-house silicon design. Founded in 1976, Apple is headquartered in Cupertino, California, and trades on NASDAQ as AAPL.