1 month ago
Brazil (city not specified)Senior
Responsibilities
- Develop and maintain large-scale data pipelines in Databricks.
- Integrate and transform data from APIs, relational databases, files, and other sources.
- Design robust data pipelines using modern data engineering practices.
- Collaborate with business and analytics teams to understand and deliver against data requirements.
- Ensure the quality, reliability, security, and governance of ingested data.
- Apply DataOps practices including code versioning, data testing, CI/CD, and infrastructure as code.
- Document data engineering processes and best practices.
- Provide technical guidance and mentorship to peers.
- Collaborate with data scientists, analysts, and platform engineers.
- Troubleshoot performance, scalability, and reliability issues.
Requirements
- Proven experience building and managing large-scale data pipelines in Databricks with PySpark, Delta Lake, and SQL.
- Strong programming skills in Python and SQL for data processing and transformation.
- Deep understanding of ETL/ELT frameworks, data warehousing, and distributed data processing.
- Hands-on experience with version control, CI/CD pipelines, automated testing, and infrastructure as code.
- Familiarity with AWS, Azure, or GCP and related data services.
- Proficiency in Git.
- Advanced English proficiency.
- Preferred experience with data contracts, schema evolution, and compatibility across services.
- Preferred expertise with data quality frameworks such as Great Expectations, Soda, dbt tests, or custom-built solutions.
- Preferred experience integrating with Power BI.
Benefits
- Health and dental insurance.
- Meal and food allowance.
- Childcare assistance and extended paternity leave.
- Partnerships with gyms and health and wellness professionals through Wellhub, Gympass, and TotalPass.
- Profit Sharing and Results Participation (PLR).
- Life insurance.
- Continuous learning through CI&T University and partnerships with online learning platforms.
- Discount club and free online physical, mental, and overall well-being platform.
- Pregnancy and responsible parenting course.
- Language learning platform.
- Health and Well-being team, inclusion specialists, affinity groups, and support for workplace accommodations.
- The posting provides benefits information for CI&T's careers program but does not state a work arrangement or contract duration.
About CI&T
CI&T is a public IT services firm that builds and runs digital products for large enterprises, combining consulting with end-to-end software engineering. It delivers AI deployment, cloud modernization, data platforms, mobile/web development, and systems integration through project-based and managed engagements. Founded in 1995 and headquartered in New York, it operates globally and is listed on the NYSE (CINT).