IQVIA

Senior Big Data Engineer (FastAPI expert)

IQVIA
Apply
1 month ago
Warsaw, PolandSenior

Responsibilities

  • Build pipelines for processing large volumes of medical data and loading it into Databricks.
  • Analyze, design, develop, deploy, maintain, and optimize data engineering solutions.
  • Perform data profiling, data integration, data quality, data warehousing, and data reporting activities.
  • Oversee and mentor junior and mid-level engineers and provide technical direction.
  • Delegate tasks and own the quality, timeliness, and accountability of assigned workstreams.
  • Conduct peer code reviews and contribute to technical standards.
  • Create comprehensive automated unit and integration tests.
  • Support successful deployment and operation of the data platform in production.

Requirements

  • Six years of experience with SQL, Python, and Scala.
  • Six years of data engineering experience.
  • Strong understanding of the Databricks platform and experience with Azure Cloud Services.
  • Practical knowledge of Apache Spark, Delta, and Parquet.
  • Experience designing and implementing complex ETL solutions and processing terabytes of data.
  • Experience with data analysis, profiling, integration, quality, warehousing, and reporting.
  • Experience with CI/CD automation tools such as Jenkins or GitLab.
  • Experience with database design and modeling, algorithms, and design patterns.
  • FastAPI experience for production-grade APIs is a plus.
  • Healthcare or pharmaceutical data experience is advantageous.
  • Familiarity with Copilot or Cursor for software development workflows is preferred.
  • Strong analytical, troubleshooting, collaboration, communication, and cross-cultural teamwork skills.

Benefits

  • Technical training.
  • Possibility of participating in technical conferences within the country.
  • Favorable employment conditions and benefits.
  • Work with a global company operating offices in over 100 countries.
  • The role works with multi-terabyte databases and includes quarterly work planning and progress reviews.

Tech Stack

Apache SparkAzureDatabricksFastAPIJenkinsPythonScalaSQL

Categories

Data Engineering
IQVIA

About IQVIA

10,000+ employees

IQVIA provides clinical research services, healthcare data analytics, and technology platforms to pharmaceutical, biotech, medical device, and healthcare organizations. It sells contracted R&D and commercialization services, software, and data subscriptions that help run trials, generate real-world evidence, and guide go-to-market decisions. Formed by the merger of Quintiles and IMS Health, the company is headquartered in Durham, North Carolina and is publicly traded on the NYSE (ticker: IQV).

Contact me