
Senior Developer
Sonata Software1 day ago
Bengaluru, IndiaSenior
Responsibilities
- Build and maintain ELT pipelines for varied data sources, including third-party APIs, databases, and SaaS tools.
- Manage schema evolution and breaking changes across environmental and business data sources.
- Design scalable data models and DBT transformation workflows in a cloud data lakehouse.
- Build robust systems for structured environmental data and unstructured research content.
- Use AWS infrastructure including MWAA, S3, RDS, and Lambda to optimize storage and processing.
- Test and monitor data quality, system performance, costs, and uptime.
- Support data science with clean, analysis-ready datasets and productionize ML models.
- Deliver scalable, low-latency data services and contribute to AI/LLM-enabled development workflows.
Requirements
- 7+ years of experience in data engineering with cloud platforms; AWS is preferred, with GCP or Azure acceptable.
- Hands-on experience with Airflow or similar orchestration tools.
- Experience with DBT or similar tools and frameworks.
- Strong technical skills in Python and SQL.
- Knowledge of cloud infrastructure, basic DevOps practices, CI/CD, and infrastructure management.
- Data warehousing experience with technologies such as Snowflake or BigQuery.
- Relational database experience, particularly databases used as backends for product applications, such as PostgreSQL.
- Knowledge or experience productionizing ML models is preferred.
- Practical experience building with AI/LLMs and using AI tools across the software development lifecycle is preferred.
- Ability to deliver scalable, low-latency data services and thrive in fast-moving, ambiguous startup environments.
Tech Stack
Categories
Data Engineering