6 days ago
Mumbai, IndiaMid Level / Senior
Responsibilities
- Design, develop, and maintain scalable data pipelines and robust data systems.
- Architect and implement solutions for managing and processing large-scale datasets with fast refresh cycles.
- Write maintainable and extensible code and participate in design and code reviews.
- Implement data governance frameworks covering data lineage, quality, traceability, and consistency.
- Troubleshoot complex issues and ensure reliability, availability, observability, minimal downtime, and SLA compliance.
- Build and maintain scalable RESTful APIs and backend services.
- Collaborate with data scientists, engineers, and product managers to translate business requirements into technical solutions.
- Use emerging GenAI advancements, AI-driven tools, frameworks, and LLMs to augment solutions.
- Mentor and guide junior engineers.
Requirements
- Advanced programming skills in Python, Java, or Scala, with strong knowledge of algorithms, data processing, stream analytics, and event-driven architectures.
- Experience with distributed data systems such as Spark or Flink.
- Proven experience designing, building, and maintaining scalable RESTful APIs and services, with knowledge of backend patterns and frameworks.
- Experience with one or more cloud platforms: AWS, Azure, or GCP.
- Deep understanding of HDFS, S3, Parquet, Arrow, Delta Lake, and Paimon.
- Knowledge of Cassandra, MongoDB, Postgres, MySQL, and Airflow.
- Expertise designing, building, and tuning high-throughput, low-latency, resilient, and cost-efficient systems.
- Working proficiency with Agile development methodologies and CI/CD practices.
- Bachelor’s or master’s degree in Computer Science, Engineering, or a related field.
- 4–6 years of professional experience in Backend and Data Engineering, including large-scale datasets and real-time event processing.
- Strong problem-solving, resourcefulness, creative thinking, and communication skills.
- Familiarity with Docker, Kubernetes, and data visualization tools is preferred.
Tech Stack
Apache AirflowApache CassandraApache FlinkApache SparkAWSAzureDockerGoogle Cloud PlatformJavaKubernetesMongoDBMySQLPostgreSQLPythonScala
Categories
BackendData Engineering
About Nielsen
Nielsen shapes the world’s media and content as a global leader in audience insights, data and analytics. Through our understanding of people and their behaviors across all channels and platforms, we empower our clients with independent and actionable intelligence so they can connect and engage with their audiences—now and into the future. Nielsen operates around the world in more than 55 countries. Learn more at http://nlsn.co/6006JMfty and connect with us on social media (LinkedIn, Twitter, Facebook and Instagram).