3 days ago
Pune, India or Bengaluru, IndiaMid Level
Responsibilities
- Develop and maintain robust data pipelines and workflows within Palantir Foundry.
- Use PySpark and Python for large-scale data processing, transformation, automation, and integration.
- Design, implement, and optimize advanced SQL queries for data extraction, manipulation, analysis, and reporting.
- Build Foundry transforms for structured and unstructured datasets and maintain production data pipelines.
- Set up Foundry Data Connection sources and syncs to ingest tabular data and raw files from external systems.
- Contribute data engineering expertise to ontology design and implement pipelines backing ontology objects and links.
- Troubleshoot pipeline issues, improve performance and reliability, and support mission-critical workflows.
- Ensure data quality, integrity, and security throughout the data lifecycle.
- Document architecture, processes, and best practices for ongoing support and knowledge sharing.
- Collaborate with business analysts, data scientists, and engineers to translate business requirements into scalable data solutions.
Requirements
- At least 3 years of professional experience is required.
- At least 3 years of experience with Palantir Foundry is required.
- Proven experience building data pipelines, managing datasets, and deploying applications within Palantir Foundry.
- Practical experience building production-grade Foundry data pipelines, data connections, and ontologies.
- Strong expertise in Spark/PySpark for distributed data processing and transformation.
- Proficiency in Python for scripting, automation, and data wrangling.
- Advanced SQL skills for complex data manipulation and reporting.
- Familiarity with data modeling, ETL processes, and data engineering best practices.
- Experience working with large and complex datasets from multiple sources.
- Excellent problem-solving, communication, and collaboration skills.
- 15 years of full-time education is required.
Tech Stack
Categories
Data Engineering
About Accenture
Accenture is a global professional services firm providing management consulting, systems integration and technology, cybersecurity, and business process outsourcing for enterprises and governments. It operates a services-driven model delivering projects and managed services, often with major cloud and software partners, across industries worldwide. Headquartered in Dublin and publicly traded on the NYSE (ACN), it originated as Andersen Consulting and adopted the Accenture name in 2001.