3 months ago
Remote, IndiaSenior
Responsibilities
- Build and maintain end-to-end data pipelines.
- Set best practices for data modeling and pipeline development.
- Create AI-ready analytical datasets with appropriate structure, metadata, documentation, and business context.
- Use PySpark and SQL to solve complex data pipeline issues.
- Collaborate with stakeholders to incorporate business logic into central pipelines.
- Optimize data engineering systems for reliability, efficiency, and performance.
- Learn and apply Databricks, Spark, AI, and internally developed ETL tooling.
- Help build out a strategic data engineering team with potential to lead the team as responsibilities expand.
Requirements
- Bachelor’s or Master’s degree in Computer Science, STEM, or a related technical discipline.
- 6+ years of experience as a Data Engineer or in other technical functions.
- Strong understanding of Spark, PySpark, SQL, and data pipelines.
- Experience working with large-scale datasets using PySpark, Delta, and Databricks.
- Ability to understand business needs and align data transformations with organizational goals and data strategy.
- Strong verbal and written communication skills and ability to collaborate with stakeholders.
- Self-starter mindset and willingness to continuously learn new technologies.
- Preferred experience with Airflow, dbt, Snowflake, or equivalent tools.
Benefits
- Remote opportunity based in India.
- Several hours of overlap with US working hours are expected during training and onboarding; standard IST hours are permitted afterward except for 1–2 days per week of US-team meetings.
- Vacation time, parental leave, team events, learning reimbursement, and other benefits and perks.
- Growth and development are based on impact, learning, self-improvement, and skill mastery.
Tech Stack
Categories
Data Engineering
About YipitData
YipitData provides alternative data, analytics, and sector research to institutional investors and enterprises, delivered via subscription data products and reports. Its proprietary technology aggregates and analyzes consumer and transactional signals across sectors such as e-commerce, payments, and software to produce timely insights. Founded in 2013 and headquartered in New York, it is privately held and backed by The Carlyle Group, with global offices in the US, APAC, and India.