Sonata Software

Senior Developer

Sonata Software
Apply
1 day ago
Bengaluru, IndiaSenior

Responsibilities

  • Build and maintain ELT pipelines for varied data sources, including third-party APIs, databases, and SaaS tools.
  • Manage schema evolution and breaking changes across environmental and business data sources.
  • Design scalable data models and DBT transformation workflows in a cloud data lakehouse.
  • Build robust systems for structured environmental data and unstructured research content.
  • Use AWS infrastructure including MWAA, S3, RDS, and Lambda to optimize storage and processing.
  • Test and monitor data quality, system performance, costs, and uptime.
  • Support data science with clean, analysis-ready datasets and productionize ML models.
  • Deliver scalable, low-latency data services and contribute to AI/LLM-enabled development workflows.

Requirements

  • 7+ years of experience in data engineering with cloud platforms; AWS is preferred, with GCP or Azure acceptable.
  • Hands-on experience with Airflow or similar orchestration tools.
  • Experience with DBT or similar tools and frameworks.
  • Strong technical skills in Python and SQL.
  • Knowledge of cloud infrastructure, basic DevOps practices, CI/CD, and infrastructure management.
  • Data warehousing experience with technologies such as Snowflake or BigQuery.
  • Relational database experience, particularly databases used as backends for product applications, such as PostgreSQL.
  • Knowledge or experience productionizing ML models is preferred.
  • Practical experience building with AI/LLMs and using AI tools across the software development lifecycle is preferred.
  • Ability to deliver scalable, low-latency data services and thrive in fast-moving, ambiguous startup environments.

Tech Stack

Apache AirflowAWSAzuredbtGoGoogle BigQueryGoogle Cloud PlatformPostgreSQLPythonSnowflakeSQL

Categories

Data Engineering
Contact me