Data Engineer
Orion Innovation1 month ago
Lawrence, NJ, USASenior / Staff+
H1B sponsor
Responsibilities
- Lead the design, build, user acceptance testing, and release of Databricks data products.
- Translate business requirements into critical data elements, business rules, metric definitions, grain, aggregation logic, acceptance criteria, and technical designs.
- Produce source-to-target mappings, analytical requirement documents, and Bronze, Silver, and Gold logical data models.
- Apply standards for Unity Catalog, table design, clustering, performance tuning, data quality controls, and Git-based development.
- Manage the day-to-day work of an offshore engineering pod, including backlog grooming, task assignment, design reviews, and code reviews.
- Provide technical direction to systems integrators and consulting partners and review their deliverables against statement-of-work requirements.
Requirements
- 6–10+ years of data engineering experience.
- Hands-on Databricks experience with PySpark, Spark SQL, Delta Lake, and medallion architecture.
- Strong data product and data modeling skills, including experience delivering products with business stakeholders.
- Experience with Unity Catalog, including catalogs, schemas, access control, and data classification.
- Experience leading distributed and offshore teams, including an India-based delivery pod.
- Advanced SQL, Python, and Git-based development experience.
- Ability to work independently with business stakeholders and drive ambiguous requirements through to released data products.
- Preferred: pharmaceutical or life sciences commercial data experience and familiarity with IQVIA, Symphony Health, Komodo, Flatiron, specialty pharmacy and distributor data, Veeva CRM, and marketing or digital engagement platforms.
- Preferred: understanding of commercial analytics use cases, data governance, regulated environments, audit, privacy, and access-control requirements.
Tech Stack
Categories
Data Engineering
About Orion Innovation
Orion Innovation provides software engineering and consulting services focused on digital transformation, product development, data and AI, cloud, and digital experience for enterprise clients. It delivers projects across industries including financial services, telecommunications and media, consumer products, automotive, industrial automation, sports and entertainment, life sciences, ecommerce, and education. Headquartered in Iselin, New Jersey, the company is privately held and backed by One Equity Partners.