PGIM

Senior Data Engineer - Microsoft Fabric

PGIM
Apply
3 months ago
Letterkenny, IrelandSenior

Responsibilities

  • Build, optimize, deploy, and maintain data pipelines in Microsoft Fabric.
  • Design and implement logic, storage systems, data acquisition, transformation, organization, reliability, and quality improvements.
  • Write high-quality, documented, and efficient code using Python, SQL, Scala, PySpark/Apache Spark, and shell scripting.
  • Integrate, transform, and prepare data from multiple sources for analytics and predictive or prescriptive modeling.
  • Collaborate with data analysts, data scientists, and architects on complex data projects.
  • Write unit, integration, functional, interface, and end-user tests and resolve issues identified by quality assurance or product support.
  • Work with cloud, infrastructure-as-code, workflow orchestration, data protection, and data visualization technologies.
  • Identify opportunities for improvement, contribute to the technical roadmap, and coach other team members.

Requirements

  • Bachelor’s degree in computer science or engineering, or experience in a related field.
  • Applied experience with Microsoft Fabric and building or optimizing data pipelines.
  • Experience with several of Python, SQL, Scala, PySpark/Apache Spark, and shell scripting.
  • Knowledge of data ingestion, integration, transformation, databases, data architecture, data lakes, and data warehousing.
  • Knowledge of SQL and NoSQL databases, real-time analytics, data buffering, workflow orchestration, cloud computing, and AWS services.
  • Experience with DevOps automation tools and practices and knowledge of the full software development life cycle.
  • Understanding of data protection and security principles, including data loss prevention, role-based access controls, encryption, and access capture.
  • Knowledge of unit, integration, functional, performance, usability, reliability, security/vulnerability, accessibility, and other testing concepts.
  • Strong problem-solving, communication, collaboration, business insight, and continuous-learning skills.
  • Preferred experience developing serverless data pipelines with AWS Glue, Lambda, and Step Functions.
  • Additional certifications may be relevant.

Benefits

  • Join a culture where employees’ voices matter and work is intended to improve customer and organizational experiences.
  • Access learning experiences designed to develop technical and leadership capabilities.
  • Employment is contingent on satisfactory references, and background checks are conducted for candidates offered a position.
  • PGIM Ireland is an equal opportunity employer and makes appointments on merit.

Tech Stack

AnsibleApache AirflowApache KafkaApache SparkAWSPythonScalaSplunkSQL

Categories

Data Engineering
PGIM

About PGIM

5,001-10,000 employees

PGIM builds and sells investment management products and services to institutional and individual investors worldwide. It is the global asset management business of Prudential Financial (NYSE: PRU), headquartered in Newark, NJ, with roughly $1.4 trillion in assets under management. Its multi-affiliate platform spans fixed income, equities, real estate, private credit, and alternatives delivered via separate accounts, mutual funds, ETFs, and private funds.

Contact me