about 4 hours ago
Bengaluru, IndiaMid Level / Senior
Responsibilities
- Design and implement end-to-end data flows from raw event ingestion to durable storage.
- Build reliable, incremental data pipelines that support deduplication and late-arriving data.
- Model context and relationships across various industrial data sources.
- Partner with platform and AI teams to define data storage and modeling strategies.
- Develop clean, maintainable Python services with a focus on separation of concerns.
- Drive engineering quality through automated testing and observability.
- Design streaming-first architectures using lakehouse and messaging technologies.
- Collaborate with teams to translate business requirements into technical solutions.
Requirements
- Bachelor's degree in Computer Science, Computer Engineering, or related field.
- 4+ years of professional software development experience in backend platforms or data-intensive applications.
- Strong experience in Python, SQL, and data modeling.
- Experience designing systems that handle duplicate and late-arriving events.
- Familiarity with cloud platforms like AWS, Azure, or GCP.
- Experience with streaming or messaging systems such as Kafka or Pub/Sub.
- Strong operational and debugging skills.
- Excellent written and verbal communication skills.
Tech Stack
Categories
AI & MLData Engineering