Wipro

Pyspark Python Developer

Wipro
Apply
13 days ago
Pune, IndiaMid Level / Senior

Responsibilities

  • Design, develop, optimize, and support scalable data engineering solutions.
  • Build and maintain batch and real-time or streaming data pipelines for large-scale data processing.
  • Develop and optimize Python, PySpark, SQL, and UNIX/Linux shell scripts.
  • Perform PySpark application design, job execution, performance tuning, and troubleshooting.
  • Develop ETL/ELT pipelines and integrate data using data engineering frameworks.
  • Gather requirements, design solutions, prepare technical documentation, and support implementation.
  • Collaborate effectively with technical and business stakeholders.

Requirements

  • Strong Python programming skills focused on coding, data processing, and performance optimization.
  • Extensive hands-on experience developing PySpark applications, including execution, tuning, and troubleshooting.
  • Hands-on SQL coding experience.
  • Experience developing ETL/ELT pipelines and using data integration frameworks.
  • Proficiency in UNIX/Linux shell scripting, including creating, modifying, and troubleshooting scripts.
  • Experience with batch and real-time or streaming data processing technologies.
  • Ability to process large-scale data and optimize workflows for performance and scalability.
  • Understanding of distributed computing concepts and big data architecture.
  • Strong analytical, problem-solving, verbal communication, and written communication skills.
  • Three to five years of professional experience.

Tech Stack

Categories

Data Engineering
Wipro

About Wipro

10,000+ employees

Wipro is a global IT services and consulting firm that provides application development, cloud migration, infrastructure management, data/AI, and business process outsourcing for enterprises. It earns revenue through long-term outsourcing, managed services, and project-based consulting across multiple industries. Founded in 1945 and headquartered in Bangalore, India, Wipro is publicly traded (NYSE: WIT; NSE/BSE: WIPRO).

Contact me