7 days ago
Sydney, AustraliaSenior
Base Salary
$90k - $100k/yr
Responsibilities
- Build and maintain scalable cloud data pipelines for ingestion, transformation, and storage.
- Develop integrated customer data products and metadata-driven frameworks supporting data quality, consistency, and governance.
- Write and optimize PySpark and Spark SQL transformations for analytics and reporting.
- Fix ETL errors, improve pipeline resiliency, and maintain data integrity across reports and dashboards.
- Monitor data platforms, respond to alerts, perform root cause analysis, and optimize efficiency and cost.
- Coordinate design reviews, implementation walkthroughs, releases, and production deployments.
- Apply security, lineage, governance, and regulatory compliance practices.
- Collaborate with stakeholders, architects, and onsite and offshore teams to deliver solutions.
- Use Jira, Confluence, and Bitbucket for project planning, documentation, and collaboration.
- Lead projects through planning, prioritization, and team coordination.
Requirements
- Expertise designing, building, and optimizing scalable data pipelines across cloud and distributed systems.
- Experience with PySpark, Spark SQL, SAS, Databricks, Java, Python, Power BI, QlikView, RPA automation, web scraping, and IBM Sterling.
- Experience with Hive, Oracle, SSMS, Azure services, and AWS.
- Experience with Bitbucket, GitHub, Jenkins, Control-M, and Databricks Workflows.
- Ability to use monitoring tools and Spark Logs for alert analysis and root cause investigation.
- Understanding of security best practices, compliance requirements, data governance, and lineage.
- Banking domain knowledge, including Basel 4 and regulatory reporting.
- Databricks Certified Data Engineer Associate certification is listed.
- Advanced SQL and basic Python proficiency demonstrated through HackerRank certifications are listed.
About Cognizant
Cognizant is a public IT services and consulting firm that designs, builds, and runs enterprise technology, including digital engineering, cloud modernization, data/AI, and managed services. It sells consulting, systems integration, and outsourcing on multi-year engagements to large enterprises in healthcare, banking, retail, communications, and manufacturing. Founded in 1994 and headquartered in Teaneck, New Jersey, Cognizant is NASDAQ-listed (CTSH) and a Fortune 500 company.