Mid Data Engineer
Lean Solutions Group1 month ago
Remote, BrazilMid Level
Responsibilities
- Develop and optimize ETL pipelines using Databricks for data integration and processing.
- Collaborate with technical and business stakeholders to gather requirements and design scalable data solutions.
- Manage the data lifecycle from data-lake ingestion through bronze, silver, and gold tiers to visualization preparation.
- Implement and maintain data-processing logic with SQL and Python.
- Support advanced analytics and machine learning operations within Databricks.
- Build and enhance dashboards and reports, with Sigma Computing as the preferred platform.
- Apply Agile methodologies to improve collaboration and efficiency across the analytics team.
Requirements
- Bachelor of Science degree in Computer Science or a related subject.
- Three years of experience as a Data Engineer, Analytics Engineer, or in a similar role.
- Advanced proficiency in SQL and Python for data transformation and automation.
- Experience with PySpark and Databricks or other data-lake platforms.
- Familiarity with medallion architecture using bronze, silver, and gold tiers.
- Experience with advanced analytics techniques, ETL pipeline development, and machine learning operations.
- Strong analytical, problem-solving, communication, and collaboration skills.
- Knowledge of AI and machine-learning frameworks is preferred.
- Experience with R and data-visualization tools such as Qlik or similar platforms is a plus.
- Familiarity with Sigma Computing is preferred but not required.
Benefits
- Remote work arrangement.
- Professional development opportunities with international customers.
- Collaborative work environment.
- Career path and mentorship programs.
- Inclusive equal-opportunity workplace committed to diversity.
About Lean Solutions Group
Lean Solutions Group provides AI-driven automation, software development, and tech-enabled staffing for logistics, transportation, and other U.S. businesses. Through its Global Technology Services (Lean Tech) arm, it offers team augmentation, RPA/ML solutions, and project delivery for engineering teams. The privately held company is headquartered in Medellín, Colombia, and operates across Latin America and the U.S.