1 day ago
Pune, India or Bengaluru, IndiaSenior
Responsibilities
- Develop and maintain production-grade data pipelines and workflows in Palantir Foundry.
- Build transforms for structured and unstructured datasets and maintain mission-critical transform pipelines.
- Set up data connections and syncs to ingest tabular data and raw files from external systems into Foundry.
- Design and implement ontology-backed pipelines, objects, and links based on application requirements.
- Use PySpark, Python, and SQL for large-scale data processing, transformation, integration, extraction, and analysis.
- Collaborate with business analysts, data scientists, and engineers to create scalable data solutions.
- Ensure data quality, integrity, and security throughout the data lifecycle.
- Troubleshoot, debug, and optimize data workflows for performance and reliability.
- Document architecture, processes, and data engineering best practices.
Requirements
- At least 5 years of professional experience.
- At least 3 years of experience with Palantir Foundry.
- Proven experience building data pipelines, managing datasets, and deploying applications within Palantir Foundry.
- Practical experience with Foundry data pipelines, data connections, syncs, and ontologies.
- Strong expertise in Spark/PySpark for distributed data processing and transformation.
- Proficiency in Python for scripting, automation, and data wrangling.
- Advanced SQL skills for complex data manipulation and reporting.
- Familiarity with data modeling, ETL processes, and data engineering best practices.
- Experience working with large and complex datasets from multiple sources.
- 15 years of full-time education.
- Strong problem-solving, communication, and collaboration skills.
Tech Stack
Categories
Data Engineering
About Accenture
Accenture is a global professional services firm providing management consulting, systems integration and technology, cybersecurity, and business process outsourcing for enterprises and governments. It operates a services-driven model delivering projects and managed services, often with major cloud and software partners, across industries worldwide. Headquartered in Dublin and publicly traded on the NYSE (ACN), it originated as Andersen Consulting and adopted the Accenture name in 2001.