Principal Software Engineer
Digital.ai4 months ago
Responsibilities
- Build and optimize large-scale batch and streaming data pipelines.
- Implement modern data lake and warehouse solutions using Delta Lake and cloud-native services.
- Apply best practices in data modelling, ETL/ELT strategies, and schema evolution.
- Design, implement, and support ML and AI/LLM workflows.
- Ensure high standards for data quality, observability, performance, and security.
- Collaborate closely with Data Science and ML teams.
- Participate in design reviews and architectural discussions.
- Mentor senior and junior engineers.
Requirements
- 8-12 years of professional software engineering experience.
- Deep expertise in software engineering and system design.
- Strong foundation in data warehousing and data modelling.
- Hands-on experience with Delta Lake and distributed data processing.
- Extensive proficiency in SQL, Python, and Java.
- Experience with cloud platforms like AWS, Azure, or GCP.
- Working knowledge of ML workflows and AI/LLM concepts.
- Experience designing highly available, scalable systems.
Tech Stack
Categories
AI & MLData Engineering