
Mid Data Engineer
Lean Solutions Group3 days ago
Remote, ColombiaMid Level
Responsibilities
- Develop and optimize ETL pipelines using Databricks for data integration and processing.
- Collaborate with technical and business stakeholders to gather requirements and design scalable data solutions.
- Manage the data lifecycle from ingestion into bronze, silver, and gold data lake tiers through visualization preparation.
- Implement and maintain data processing logic using SQL and Python.
- Support advanced analytics and machine learning operations within Databricks.
- Build and enhance dashboards and reports, preferably using Sigma Computing.
- Apply Agile methodologies to improve collaboration, identify complex issues, and implement solutions.
Requirements
- Bachelor of Science degree in Computer Science or a related subject.
- At least 3 years of experience as a Data Engineer, Analytics Engineer, or in a similar role.
- Advanced proficiency in SQL and Python for data transformation and automation.
- Experience with PySpark, Databricks or other data lake platforms, ETL pipeline development, and machine learning operations.
- Familiarity with medallion architecture and bronze, silver, and gold data tiers.
- Experience with advanced analytics techniques and strong analytical and problem-solving skills.
- Familiarity with Sigma Computing and data visualization tools such as Qlik or similar tools is preferred.
- Knowledge of AI and machine learning frameworks is desirable.
- Experience with R is a plus.
- Strong communication and collaboration skills with technical and non-technical stakeholders.
Benefits
- Fully remote work arrangement.
- Professional development opportunities with international customers.
- Collaborative work environment.
- Career path and mentorship programs.
- Inclusive equal opportunity workplace.
About Lean Solutions Group
Lean Solutions Group provides AI-driven automation, software development, and tech-enabled staffing for logistics, transportation, and other U.S. businesses. Through its Global Technology Services (Lean Tech) arm, it offers team augmentation, RPA/ML solutions, and project delivery for engineering teams. The privately held company is headquartered in Medellín, Colombia, and operates across Latin America and the U.S.