Senior Data Engineer
Tiger Analytics Inc.3 months ago
Remote, United States or Chicago, IL, USASenior
Responsibilities
- Design, develop, and deploy end-to-end data pipelines on AWS using Amazon S3, AWS Glue, AWS Lambda, Amazon Redshift, and related data platform technologies.
- Build and maintain scalable data processing and transformation workflows with Databricks, Apache Spark, and SQL.
- Develop and maintain Apache Airflow workflows for orchestration, scheduling, dependency management, monitoring, and automation.
- Integrate and process commercial pharmaceutical data sources including Xponent, Veeva, MMIT, Plantrak, Specialty Pharmacy, and LAAD.
- Build and optimize pipelines supporting pharmaceutical KPIs, metrics, analytics, and reporting.
- Design pipelines for AI/ML and Generative AI workloads, including structured and unstructured data preparation.
- Support LLM-based applications, vector embeddings, and knowledge retrieval/RAG solutions.
- Migrate legacy data systems and pipelines to modern AWS cloud and lakehouse architectures.
- Monitor, troubleshoot, and optimize pipelines for performance, scalability, reliability, data quality, and cost-effectiveness.
- Translate pharmaceutical business needs into scalable data solutions and communicate with technical and business stakeholders.
Requirements
- At least 8 years of experience in data engineering, preferably in commercial pharmaceutical or healthcare data environments.
- Strong hands-on experience with AWS cloud, Databricks, Apache Spark, and SQL.
- Strong experience building ETL/ELT pipelines and large-scale data processing workflows.
- Hands-on experience with Apache Airflow for workflow orchestration.
- Strong understanding of data modeling, data lake/lakehouse architecture, data ingestion, and transformation frameworks.
- Deep knowledge of commercial pharmaceutical data sources such as Xponent, Veeva, MMIT, Plantrak, Specialty Pharmacy, and LAAD.
- Strong understanding of pharmaceutical commercial data processes including Alignment, Allocation, Split credits, Market basket, and Customer universe.
- Strong understanding of pharma KPIs, metrics, and commercial analytics.
- Strong analytical, problem-solving, and data troubleshooting skills.
Benefits
- Fully remote position.
- Significant career development opportunities as the company grows.
- Opportunity to work in a small, challenging, and entrepreneurial environment with a high degree of individual responsibility.
Tech Stack
Categories
Data Engineering
About Tiger Analytics Inc.
Tiger Analytics Inc. provides data and AI consulting services that deliver machine learning, analytics, and cloud data engineering solutions for large enterprises across industries, including life sciences. The company engages on strategy and implementation projects, from modern BI and data platforms to MLOps, helping Fortune 100 clients turn data into business outcomes. Founded in 2011 and headquartered in Santa Clara, it is privately held with operations across North America, Europe, and Asia-Pacific.