Data Engineer I
Circles.Life6 days ago
Bengaluru, IndiaEntry Level
Responsibilities
- Develop and optimize scalable batch and streaming data pipelines.
- Build and maintain cloud-native data platforms, including data lakes, data warehouses, and real-time processing systems.
- Own data engineering initiatives end to end, including solution design, development, testing, deployment, monitoring, performance tuning, and production support.
- Develop data models, ETL/ELT pipelines, and data integration frameworks for business intelligence and operational reporting.
- Deploy and manage data applications on Kubernetes and implement CI/CD pipelines using GitLab CI/CD.
- Monitor platform health, troubleshoot production issues, perform root cause analysis, and improve reliability and performance.
- Collaborate with product, analytics, engineering, platform, infrastructure, and business intelligence teams to deliver reliable data solutions.
- Contribute to engineering best practices, technical documentation, and knowledge sharing.
Requirements
- At least 1 year of experience in data engineering or big data.
- Strong experience building scalable ETL/ELT pipelines with Python, Spark/PySpark, and SQL.
- Experience with at least one modern data lakehouse or warehouse technology, such as Apache Iceberg, Hive, Trino, BigQuery, Redshift, ClickHouse, or Snowflake.
- Experience with cloud object storage such as Amazon S3 or S3-compatible platforms.
- Strong analytical, problem-solving, communication, and stakeholder-management skills.
- Experience with real-time pipelines using Apache Kafka and distributed data processing frameworks is preferred.
- Knowledge of databases such as MySQL, Oracle, MongoDB, SQLAlchemy, or PyMongo is preferred.
- Experience with Kubernetes, Docker, and GitLab CI/CD is preferred.
- Experience with LLM-based applications using LangGraph and MLOps is preferred.
- Knowledge of distributed systems, data architecture, data governance, security best practices, production troubleshooting, and performance optimization is preferred.
- Telecommunications-domain experience and experience supporting multi-market data platforms are advantageous.
- Familiarity with JIRA and Agile development practices is preferred.
Tech Stack
Amazon RedshiftApache HiveApache KafkaApache SparkClickHouseDockerGitLab CI/CDGoogle BigQueryKubernetesMongoDBMySQLPythonSnowflakeSQL
Categories
Data Engineering
About Circles.Life
Circles.Life is a digital mobile operator offering app-driven, no‑contract mobile plans, eSIM, and roaming to consumers. Launched in 2016 in Singapore and part of the Circles group, it operates as an MVNO, including on M1’s network in Singapore and Optus’s network in Australia, with services also available in Taiwan. The brand sells subscriptions and add‑ons directly online and through its mobile app.