1 month ago
Remote, India or Bengaluru, IndiaMid Level
Responsibilities
- Collaborate with data scientists, analysts, and application developers to deliver high-quality data solutions.
- Write efficient and maintainable code in Python and PySpark.
- Develop and optimize SQL queries for data extraction and transformation.
- Build processes for data transformation, data structures, metadata, dependency management, and workload management.
- Implement data quality checks and monitoring across pipelines and storage layers.
- Ensure data quality, governance, security, accuracy, and reliability across data systems.
Requirements
- Working knowledge of GCP Dataflow, BigQuery, Pub/Sub, Cloud Composer, and Cloud Storage.
- Hands-on experience with CI/CD tools and DevOps practices.
- Strong analytical skills working with structured, semi-structured, and unstructured datasets.
- Working knowledge of message queuing, stream processing, and highly scalable big data stores.
- Experience with relational databases including Microsoft SQL Server, MySQL, PostgreSQL, and Oracle.
- Experience with NoSQL databases and technologies including Cassandra and MongoDB.
- Experience with big data tools including Hadoop, Spark, and Kafka.
- Proficiency in Python and PySpark.
- Strong SQL skills, including query optimization and performance tuning.
- Familiarity with data warehousing, data lake concepts, and ETL processes.
Benefits
- Flexible work arrangements, including remote work and flexible working hours.
- Career growth programs and opportunities across diverse professions.
- Opportunities to earn certifications in current technologies such as Generative AI.
Tech Stack
Apache CassandraApache HadoopApache KafkaApache SparkGoogle BigQueryGoogle Cloud PlatformMicrosoft SQL ServerMongoDBMySQLPostgreSQLPythonSQL
Categories
Data Engineering
About Capgemini
Capgemini is a global IT services and consulting firm that delivers strategy, cloud, AI, software engineering, and managed services to large enterprises and public-sector clients. Founded in 1967 and headquartered in Paris, it is publicly traded on Euronext Paris and operates in 50+ countries. The group expanded its engineering capabilities by acquiring Altran in 2020, now operating as Capgemini Engineering.