Comcast

Platform Data Engineer - (DataBricks, PySpark, AWS)

Comcast
Apply
21 days ago
West Chester, PA, USASenior
H1B sponsor

Responsibilities

  • Design, develop, maintain, and optimize scalable data pipelines for workforce, billing, interaction, and other enterprise datasets.
  • Build cloud-native data solutions using AWS, Databricks, and PySpark.
  • Develop and support batch and streaming processing frameworks for high-volume, near-real-time data.
  • Use Kafka, Databricks streaming solutions, and MWAA to ingest, process, orchestrate, and manage data workflows.
  • Tune pipeline performance, automate operational processes, and improve platform reliability.
  • Provide production support, troubleshooting, and root-cause analysis for critical data workflows.
  • Support data warehousing initiatives and establish practices for data quality, scalability, and reliability.
  • Collaborate with Product, Data Governance, Analytics, and Engineering teams across onshore and offshore delivery models.
  • Mentor junior engineers and contribute to architectural discussions and the evolution of the enterprise data platform.

Requirements

  • Bachelor’s degree in Computer Science, Engineering, Information Systems, or a related field, or equivalent practical experience.
  • 5+ years of experience in Data Engineering, Data Platform Engineering, or related disciplines.
  • Strong hands-on experience with AWS, PySpark, and Databricks.
  • Experience building and maintaining large-scale ETL/ELT pipelines and processing high-volume data.
  • Understanding of distributed systems, data warehousing concepts, and modern data architectures.
  • Experience orchestrating workflows with Apache Airflow or MWAA.
  • Knowledge of Kubernetes fundamentals, including pod lifecycle, job orchestration, and workload configuration.
  • Proficiency in Python development in data engineering environments.
  • Experience supporting production data platforms and driving operational excellence.
  • Strong communication and collaboration skills.
  • Preferred experience includes Snowflake, Kafka, streaming data architectures, Amazon EKS, large-scale interaction or customer engagement datasets, automation, observability, monitoring, mentoring, and technical leadership.

Benefits

  • Comcast provides benefits and personalized support tools for eligible employees across physical, financial, and emotional well-being.
  • The role is generally expected to be onsite unless designated virtual; remote consideration may be available for candidates living more than 100 miles from an office when virtual offerings are listed.
  • Non-sales positions may be eligible for a bonus under applicable plans.

Tech Stack

Apache AirflowApache KafkaAWSDatabricksKubernetesPythonSnowflake

Categories

Data Engineering
Comcast

About Comcast

10,000+ employees

Welcome to Comcast. From the connectivity and platforms we provide to the content and experiences we create, we bring people together, globally. Our people think the world of our work, and that’s why our work is the best in the world.

Contact me