28 days ago
Bengaluru, IndiaMid Level
Responsibilities
- Design and develop scalable data ingestion and processing pipelines.
- Build and maintain batch and real-time data integration solutions.
- Develop ETL/ELT workflows for transforming and loading data from multiple source systems.
- Design and optimize data models for analytics and reporting.
- Maintain data quality, integrity, governance, and security standards.
- Monitor, troubleshoot, and optimize data pipelines and workloads.
- Implement data observability, monitoring, and alerting mechanisms.
- Support cloud migration and modernization initiatives.
- Create technical documentation, data lineage, and operational runbooks.
- Collaborate with product owners, business stakeholders, architects, and data scientists.
Requirements
- Bachelor’s degree and a minimum of four years of professional experience.
- Experience with Snowflake, Databricks, Redshift, BigQuery, or Synapse.
- Knowledge of Apache Kafka or other streaming technologies.
- Experience with dbt and modern data-stack tools.
- Familiarity with DataOps and MLOps practices.
- Understanding of data governance, metadata management, and data quality frameworks.
- Programming experience with Python, SQL, Scala, and Java.
- Experience with Spark, Hive, Airflow, cloud services, databases, streaming platforms, and development tools listed in the posting.
- Cloud certifications in AWS, Azure, or GCP are preferred.
Tech Stack
Amazon RedshiftApache AirflowApache HiveApache KafkaApache SparkAWSAzureDatabricksdbtGitGoogle BigQueryGoogle Cloud PlatformJavaJenkinsMicrosoft SQL ServerPostgreSQLPythonScalaSnowflakeSQL
Categories
Data Engineering
About Cargill
Cargill builds and operates global food and agriculture supply chains, selling commodities, food ingredients, animal nutrition, and risk-management services to food manufacturers, retailers, and farmers. It trades and processes grains, oilseeds, cocoa, and proteins, and provides logistics and biofuel solutions. Founded in 1865 and headquartered in Wayzata, Minnesota, Cargill is privately held and family-owned.