about 8 hours ago
Bengaluru, India
Mid Level / Senior
H1B Sponsor
Responsibilities
- Build and own large-scale batch and streaming data pipelines.
- Write production-grade code in Java and/or Python.
- Design and optimize high-performance SQL on large datasets.
- Work with Spark, Hive, Presto, Kafka, or similar technologies.
- Own reliability, data quality, and pipeline SLAs end-to-end.
- Use AI coding tools for writing/refactoring pipeline code, SQL generation, and debugging.
- Demonstrate strong prompting skills to guide LLMs effectively.
- Partner with Data Science, Backend, and Platform teams.
Requirements
- 4 - 7 years of data engineering experience.
- Strong skills in Python and SQL.
- Hands-on experience with big-data systems (Spark/Hive/Presto/Kafka).
- Practical, real-world use of AI tools for engineering productivity.
Benefits
- Health coverage for full-time employees.
- Paid parental leave and generous paid time-off.
- Quarterly self-care days off and stock options.
- Access to learning and development initiatives including LinkedIn Learning.
- Quarterly wellness education sessions.
Tech Stack
Amazon RedshiftApache HiveApache KafkaApache SparkAWSDockerJavaKubernetesPrestoPythonSQL
Categories
AI & MLData Engineering