Senior Data Engineer
KMS Technology4 months ago
Guadalajara, MexicoSenior
Responsibilities
- Design, develop, and maintain scalable data pipelines using Databricks and Azure services.
- Build and optimize ETL/ELT workflows for data ingestion, transformation, and delivery.
- Develop and optimize Apache Spark and PySpark jobs for large-scale data processing.
- Design scalable data solutions for analytics, reporting, and operational business needs.
- Gather requirements from clients and business stakeholders and translate them into technical solutions.
- Ensure data quality, consistency, reliability, and performance across data processing workflows.
- Optimize data processing jobs and storage solutions for performance and resource utilization.
- Troubleshoot data pipelines, Spark jobs, and Azure data service issues.
- Participate in architecture discussions, code reviews, and technical design sessions.
- Create and maintain documentation for data pipelines, data models, and operational processes.
- Coordinate delivery efforts with distributed global teams.
Requirements
- At least 5 years of experience in data engineering or related roles.
- Strong hands-on experience building and managing data pipelines with Databricks.
- Strong experience with Microsoft Azure and Azure-based data services.
- Experience developing and optimizing Apache Spark and PySpark applications.
- Strong experience designing and implementing ETL/ELT data processing solutions.
- Understanding of data architecture, data modeling, and scalable data platform design.
- Experience using SQL for data transformation and analysis.
- Experience building and maintaining distributed data processing solutions.
- Strong analytical, problem-solving, and attention-to-detail skills.
- Excellent communication and collaboration skills with clients and cross-functional teams.
- Experience working effectively with distributed teams and in Agile development environments.
- Preferred: experience with Delta Lake and Lakehouse architectures.
- Preferred: familiarity with data governance, monitoring, and data quality practices.
- Preferred: Microsoft Azure or Databricks certifications.
Benefits
- Mexican-law benefits.
- 15 days of PTO in year zero, increasing to 3 days per year from the first year onward.
- Five days of leave for the death of immediate family members, negotiable.
- Major Medical Expenses Insurance covering immediate dependents, including spouses and children.
- Annual performance bonus of approximately 10% of annualized salary.
- Annual salary adjustment.
- Employee Referral Bonus.
- Paid certifications and courses.
- Coursera license.
- 5% Savings Fund.
- 5% Grocery Vouchers.
- Collaborative and inclusive international work environment with distributed global teams.
Tech Stack
Categories
Data Engineering
About KMS Technology
KMS Technology provides software product development, quality assurance/testing, and AI engineering services for independent software vendors and enterprises using offshore and nearshore teams. Its consulting-led model spans DevOps, mobile app development, and automated testing, delivered through global centers in Vietnam and Mexico. Founded in 2009 and headquartered in Atlanta, the privately held company focuses on helping North American clients scale product delivery.