Senior Data Engineer - Microsoft Fabric
Prudential FinancialResponsibilities
- Build and optimize data pipelines, logic, and storage systems in Microsoft Fabric.
- Design, develop, document, test, deploy, and maintain efficient production code.
- Ingest, transform, organize, and combine data from multiple sources for analytics and predictive or prescriptive modeling.
- Conduct complex data analysis and report findings.
- Collaborate with data analysts, data scientists, architects, quality assurance, and product support teams.
- Develop unit, integration, functional automation, interface, and end-user tests.
- Research quality issues and implement solutions to improve data reliability, efficiency, and quality.
- Apply cloud, DevOps automation, infrastructure-as-code, security, and data protection practices.
- Coach others and contribute to technical learning, innovation, and roadmap execution.
Requirements
- Bachelor of Computer Science or Engineering, or experience in a related field.
- Applied experience with Microsoft Fabric and building or optimizing data pipelines.
- Programming experience with Python, SQL, Scala, PySpark/Apache Spark, and shell scripting.
- Knowledge of data ingestion, integration, transformation, relational and NoSQL databases, graph databases, data lakes, and data warehouses.
- Experience or knowledge of real-time analytics, data buffering, workflow orchestration, visualization, cloud computing, and infrastructure as code.
- Knowledge of AWS architectural principles and core services, including the ability to write CloudFormation code.
- Experience with DevOps automation tools and practices and knowledge of the software development life cycle.
- Understanding of data protection, access controls, encryption, data loss prevention, and security principles.
- Knowledge of testing concepts and tooling, including performance, usability, reliability, security scanning, and accessibility considerations.
- Strong problem-solving, communication, collaboration, business judgment, continuous learning, and teamwork skills.
- Preferred experience developing serverless data pipelines with AWS Glue, Lambda, and Step Functions.
- Other relevant certifications may be considered.
Benefits
- Join an inclusive, equal-opportunity culture where employees can develop technical and leadership capabilities through learning experiences.
- Employment offers are contingent on satisfactory references, and background checks are conducted for all candidates offered a position in PGIM Ireland.
Tech Stack
Categories
About Prudential Financial
Prudential Financial (NYSE:PRU) was founded on the belief that financial security should be within reach for everyone, and for over 150 years, we have helped our customers reach their potential and tackle life's challenges for now and future generations to come. Today, we are one of the world’s largest financial services institutions, offering individual and institutional clients a wide array of financial products and services. With operations in the United States, Asia, Europe and Latin America, we are known for delivering on our promises to our customers, and are recognized as a trusted brand and one of the world’s most admired companies. We also have one of the most recognized and trusted brand symbols: The Rock®, an icon of strength, stability, expertise and innovation. We measure our long-term success on our ability to deliver value for shareholders, meet customer needs, and attract and develop the best talent in our industry. We offer an inclusive work environment where employees can develop to their full potential, and give back to the communities where we live and work. (Pru.us/disclaimer)