Data Engineer – Apache Spark | Kafka | Flink | Trino | Iceberg | Big Data | Streaming | Data Platform 4–8 Years
Cisco1 day ago
Bengaluru, IndiaMid Level / Senior
Responsibilities
- Enhance open-source big data platform technologies.
- Build and operate Kafka-based streaming applications for ingestion, filtering, enrichment, and replication.
- Develop data processing jobs using Apache Spark and Apache Flink.
- Work with Apache Iceberg to manage large analytical datasets.
- Tune jobs for performance, scalability, and cost efficiency.
- Write clean, testable code and participate in code reviews.
- Collaborate with the product team to develop data and analytics pipelines.
Requirements
- At least 4–8 years of experience in data engineering and software development.
- Ability to work with the open-source ecosystem.
- Ability to write high-quality code in Java, Scala, Python, or equivalent languages.
- Practical experience with Apache Spark and Apache Flink.
- Practical experience with query engines such as Trino or Presto.
- Experience working with Kafka and scaling high-volume workloads.
- Strong SQL skills and understanding of data modeling for analytical workloads.
- Preferred: hands-on experience with Apache Pinot or ClickHouse for low-latency analytical queries.
- Preferred: familiarity with CoPilot, Cursor, or Codex for debugging and development.
- Preferred: familiarity with Apache Iceberg data lake table formats.
- Preferred: familiarity with DataHub data governance tools.
- Preferred: experience with DolphinScheduler or Airflow.
- Preferred: experience with Apache Amoro lakehouse management systems.
Tech Stack
Categories
Data Engineering
About Cisco
Cisco designs and sells networking, security, and collaboration platforms for enterprises, service providers, and governments, spanning routers and switches, Wi‑Fi, firewalls, zero‑trust, observability, and cloud-managed IT (Meraki) plus Webex. Its business model mixes hardware, software subscriptions, and support/consulting services. Founded in 1984 and headquartered in San Jose, California, Cisco is a public company traded on Nasdaq and serves customers across data centers, campuses, and service provider networks.