4 days ago
Chennai, IndiaMid Level
Responsibilities
- Design, develop, and maintain scalable data pipelines using Python and PySpark.
- Build and manage ETL/ELT workflows for structured and unstructured data.
- Develop and optimize Spark applications for large-scale datasets.
- Implement AWS cloud-native data solutions and maintain AWS data lakes.
- Ingest data from APIs, databases, files, and streaming platforms.
- Monitor, troubleshoot, and optimize data workflows for performance and reliability.
- Follow data quality, integrity, security, and governance standards.
- Automate and orchestrate data workflows using scheduling tools.
- Collaborate with cross-functional teams on requirements and solution design.
- Conduct code reviews, unit testing, performance tuning, technical documentation, and deployment preparation.
- Support production incidents and perform root cause analysis.
Requirements
- Strong expertise in Python.
- Hands-on experience with PySpark.
- Proficiency in SQL and query optimization.
Tech Stack
Categories
Data Engineering
About Cognizant
Cognizant is a public IT services and consulting firm that designs, builds, and runs enterprise technology, including digital engineering, cloud modernization, data/AI, and managed services. It sells consulting, systems integration, and outsourcing on multi-year engagements to large enterprises in healthcare, banking, retail, communications, and manufacturing. Founded in 1994 and headquartered in Teaneck, New Jersey, Cognizant is NASDAQ-listed (CTSH) and a Fortune 500 company.