20 days ago
São Paulo, BrazilSenior
Responsibilities
- Design, develop, and deploy scalable data pipelines using Databricks, PySpark, SQL, Python, and cloud-native technologies.
- Implement data quality, reconciliation, lineage, governance, and validation processes across enterprise data products.
- Operate and optimize AI-assisted and agent-based data engineering solutions.
- Troubleshoot data pipelines and platforms, perform root cause analysis, and support production incidents.
- Maintain technical documentation, knowledge repositories, and operational runbooks.
- Collaborate with architects, data teams, business stakeholders, and global cross-functional teams throughout the data product lifecycle.
Requirements
- At least 4 years of hands-on Data Engineering experience.
- Strong experience with Databricks, Apache Spark, PySpark, SQL, and Python.
- Experience building and maintaining enterprise ETL/ELT pipelines.
- Experience with cloud platforms, preferably Microsoft Azure.
- Knowledge of Delta Lake, Delta Live Tables, and Unity Catalog.
- Experience implementing data quality, reconciliation, and validation processes.
- Experience with Git-based CI/CD practices for data engineering solutions.
- Exposure to AI-assisted development tools, code generation platforms, or GenAI-enabled engineering workflows.
- Experience supporting production environments, incident management, and root cause analysis.
- Strong analytical, troubleshooting, and problem-solving skills.
- Advanced English proficiency.
- Bachelor’s degree in Computer Science, Engineering, Information Technology, or a related field.
- Preferred experience with ICEDQ or similar data quality frameworks, Data Validation Suite, automated data testing, column-level data lineage, data governance, agentic AI platforms, AI-powered data engineering tools, Power BI, Tableau, or analytics and visualization platforms.
- Knowledge of Data Mesh, Data Product, and Data Fabric concepts is preferred.
- Azure, Databricks, or cloud-related certifications and experience in large-scale enterprise data transformation programs are preferred.
Benefits
- Hybrid work model in São Paulo, Brazil, with periodic onsite collaboration.
- Opportunity to support global teams and stakeholders.
- Resume must be uploaded in English for review by global stakeholders.
Tech Stack
Categories
Data Engineering
About Cognizant
Cognizant is a public IT services and consulting firm that designs, builds, and runs enterprise technology, including digital engineering, cloud modernization, data/AI, and managed services. It sells consulting, systems integration, and outsourcing on multi-year engagements to large enterprises in healthcare, banking, retail, communications, and manufacturing. Founded in 1994 and headquartered in Teaneck, New Jersey, Cognizant is NASDAQ-listed (CTSH) and a Fortune 500 company.