1 day ago
Sydney, AustraliaSenior
Responsibilities
- Design, develop, and maintain scalable data pipelines using PySpark, SQL, Azure Synapse, Informatica PowerCenter, and IICS.
- Build batch and near-real-time data integration solutions across structured, semi-structured, and large-volume datasets.
- Develop and optimize Spark transformations using PySpark, Spark SQL, DataFrames, partitioning, caching, and performance-tuning techniques.
- Build Azure Synapse warehousing, pipeline orchestration, transformation, and analytics-ready data-processing solutions.
- Develop and maintain Informatica PowerCenter mappings, sessions, workflows, transformations, parameter files, and deployment objects.
- Develop and support IICS mappings, mapping tasks, taskflows, connections, schedules, and cloud data integration processes.
- Write complex SQL queries, stored procedures, views, and optimized transformation logic across relational and cloud data platforms.
- Perform data analysis, profiling, validation, reconciliation, and data quality checks.
- Troubleshoot production issues, identify root causes, optimize jobs, and resolve data-processing failures.
- Collaborate with architects, business analysts, source-system teams, QA teams, and downstream consumers.
- Follow version control, code review, reusable-component, documentation, CI/CD, and environment-promotion practices.
- Mentor junior data engineers and provide technical guidance.
Requirements
- 8 to 15 years of experience designing, developing, and supporting enterprise-scale data engineering solutions.
- Strong hands-on PySpark experience developing distributed processing pipelines, Spark SQL logic, transformations, and performance-tuned jobs.
- Hands-on Azure Synapse experience, including Synapse Pipelines, Synapse SQL, Spark Pools, notebooks, linked services, and Azure data-storage integration.
- Strong Informatica PowerCenter development experience with mappings, sessions, workflows, transformations, parameterization, scheduling, troubleshooting, and performance tuning.
- Hands-on Informatica Cloud Data Integration/IICS experience with mappings, mapping tasks, taskflows, connectors, schedules, monitoring, and error handling.
- Advanced SQL skills, including complex joins, analytical functions, query optimization, stored procedures, views, validation, and reconciliation.
- Strong understanding of ETL/ELT design, data warehousing, data lakes, data modeling, ingestion patterns, and pipeline orchestration.
- Production-support ability to debug failures, analyze logs, resolve data issues, tune jobs, and support critical data pipelines.
Benefits
- Opportunities to pursue innovative career tracks and collaborate with experienced colleagues.
- Professional development through education and dedicated training.
- Skills development to keep pace with workplace changes, plus compensation, benefits, and wellness packages.
- The posting does not state a work arrangement, contract duration, or specific schedule.
Tech Stack
Categories
Data Engineering
About Cognizant
Cognizant is a public IT services and consulting firm that designs, builds, and runs enterprise technology, including digital engineering, cloud modernization, data/AI, and managed services. It sells consulting, systems integration, and outsourcing on multi-year engagements to large enterprises in healthcare, banking, retail, communications, and manufacturing. Founded in 1994 and headquartered in Teaneck, New Jersey, Cognizant is NASDAQ-listed (CTSH) and a Fortune 500 company.