17 hours ago
Bengaluru, IndiaStaff+
Responsibilities
- Design and develop telemetry, monitoring, and logging infrastructure for Dataproc and Managed Service for Apache Spark.
- Architect and optimize observability pipelines for Spark Streaming and Structured Streaming workloads.
- Build tools that detect performance regressions, data skew, and resource inefficiencies in customer workloads.
- Develop monitoring systems that provide execution history and real-time performance insights into distributed big data workloads.
- Collaborate with Product and UX partners on monitoring dashboards, cost-attribution features, and developer tools.
- Integrate and safely release telemetry features, OpenTelemetry pipelines, and diagnostic frameworks at scale with Dataproc and Cloud Platform teams.
Requirements
- Bachelor's degree or equivalent practical experience.
- 8 years of experience programming in C++, Python, C, Java, and JavaScript.
- 5 years of experience building and developing large-scale infrastructure, distributed systems, networks, compute technologies, storage, or hardware architecture.
- 5 years of experience testing and launching software products.
- 8 years of experience with data structures and algorithms.
- 3 years of experience in a technical leadership role leading project teams and setting technical direction.
- 3 years of experience working in a complex, matrixed organization involving cross-functional or cross-business projects.
- Experience with backend server infrastructure.
- Understanding of algorithms and data structures, including time and space performance.
Tech Stack
About Google
Google builds consumer and enterprise software and services including Search, Android, YouTube, Chrome, Maps, Gmail, and Google Cloud. Its business model centers on digital advertising and paid cloud, software, and hardware offerings (e.g., Pixel and Nest) for consumers, developers, and organizations. Founded in 1998 and headquartered in Mountain View, California, Google operates globally as a subsidiary of Alphabet Inc.