Mid Data Engineer
Lean Solutions Group1 month ago
Remote, ColombiaMid Level
Responsibilities
- Develop and optimize ETL pipelines using Databricks for data integration and processing.
- Collaborate with technical and business stakeholders to gather requirements and design scalable data solutions.
- Manage the data lifecycle from ingestion into bronze, silver, and gold data lake tiers through preparation for visualization.
- Implement and maintain data processing logic using SQL and Python.
- Support advanced analytics and machine learning operations within Databricks.
- Build and enhance dashboards and reports, preferably using Sigma Computing.
- Apply Agile methodologies to improve collaboration and efficiency across the analytics team.
Requirements
- Bachelor of Science degree in Computer Science or a related subject.
- At least 3 years of experience as a Data Engineer, Analytics Engineer, or in a similar role.
- Advanced proficiency in SQL and Python for data transformation and automation.
- Experience with PySpark and Databricks or other data lake platforms.
- Familiarity with medallion architecture and bronze, silver, and gold data tiers.
- Experience with advanced analytics techniques, ETL pipeline development, and machine learning operations.
- Familiarity with Sigma Computing is preferred but not required.
- Knowledge of AI and machine learning frameworks is preferred.
- Experience with R and data visualization tools such as Qlik or similar tools is a plus.
- Strong analytical, problem-solving, communication, and collaboration skills.
Benefits
- Remote work arrangement.
- Professional development opportunities with international customers.
- Collaborative work environment.
- Career path and mentorship programs.
- Inclusive equal-opportunity workplace.
About Lean Solutions Group
Lean Solutions Group provides AI-driven automation, software development, and tech-enabled staffing for logistics, transportation, and other U.S. businesses. Through its Global Technology Services (Lean Tech) arm, it offers team augmentation, RPA/ML solutions, and project delivery for engineering teams. The privately held company is headquartered in Medellín, Colombia, and operates across Latin America and the U.S.