Senior / Principal Data Engineer
LyondellBasell3 months ago
Poznań, PolandSenior / Staff+
Responsibilities
- Design, develop, and lead the deployment of scalable data engineering pipelines, workflows, and solutions using strong software engineering practices.
- Build data workflows and pipelines for machine learning and algorithm deployment and maintenance in chemical manufacturing domains.
- Collaborate with Data Scientists, Software Engineers, business subject-matter experts, and Digital Technologies teams to deliver data-driven solutions.
- Define and develop technical platforms, frameworks, and applications for data, business intelligence, and information delivery.
- Ensure architecture, security, exception handling, testing, and code development standards are followed.
- Build relationships internally and externally to support technology transfer and collaboration.
- Promote digital transformation and support training and development for Data Engineers, Software Engineers, Data Analysts, and other peers.
Requirements
- Bachelor's degree in Computer Science, Software Engineering, Computer Engineering, Aerospace Engineering, or a related technical field; a master's degree is strongly preferred and a PhD is preferred.
- For the Senior level, 4+ years of professional hands-on software development experience with a PhD, 6+ years with a master's degree, or 8+ years with a bachelor's degree.
- For the Principal level, 7+ years of professional hands-on software development experience with a PhD, 9+ years with a master's degree, or 11+ years with a bachelor's degree.
- Preferred qualifications include 9+ years with a PhD, 11+ years with a master's degree, or 13+ years with a bachelor's degree.
- Strong Python, JavaScript, and/or Java programming and scripting skills.
- Strong experience with Databricks, Snowflake, and/or PostgreSQL, plus software-engineering-oriented data engineering systems.
- Experience with stream processing, dbt, big-data querying systems, MongoDB, Cassandra, data integration, ETL techniques and frameworks, and messaging systems.
- Experience working with large structured and/or unstructured data and large-scale, cluster, or cloud computing, preferably Azure.
- Experience with Linux, Unix, Git, and software development testing frameworks.
- Preferred experience includes microservices architecture, Kubernetes, Docker, CI/CD frameworks, real-time historian data, SQL, NoSQL, graph databases, NewSQL databases, VS Code, and modern data engineering, machine learning, and data science libraries.
- Preferred programming experience includes C#, C++, Julia, or Scala, along with experience delivering scalable advanced analytics solutions with Data Scientists.
- Preferred domain experience includes predictive maintenance, forecasting, real-time streaming analytics, deep-learning image analysis, and optimization.
- Strong quantitative, technical, mathematical, problem-solving, project-driving, collaboration, and independent-working abilities.
Benefits
- Flexible hybrid work arrangement with remote work-from-home and in-person collaboration days; eligible employees may work up to three days per week from home.
- Competitive salary and benefits package.
- Opportunities for personal and professional growth, specialist collaboration, and national and international networking.
- Inclusive workplace focused on diversity, equity, and inclusion.
Tech Stack
Apache CassandraAzureC#C++DatabricksdbtDockerGitJavaJavaScriptJuliaKubernetesLinuxMongoDBNLTKNumPyPandasPostgreSQLPythonScalascikit-learnSeabornSnowflakeSQL
Categories
Data Engineering
About LyondellBasell
LyondellBasell is a public chemical manufacturer that produces olefins, polyolefins, and derivatives used by packaging, automotive, construction, and healthcare companies. It also refines fuels and licenses petrochemical and polyolefin process technologies to other producers. Founded in 2007 and headquartered in Houston, the company operates globally, selling polymers, chemicals, and plastics that serve as industrial feedstocks and materials for everyday products.