Data Engineer II
ABC Financial Services17 days ago
Hyderābād, IndiaMid Level
Responsibilities
- Design, develop, and maintain data pipelines using Azure Data Factory, Apache Airflow, Databricks, and cloud ETL/ELT tools.
- Design and manage data workflows, notebooks, jobs, and orchestration across cloud platforms and Databricks.
- Create and optimize SQL stored procedures, tables, and views for performance.
- Implement data profiling, quality checks, validation, cleansing, standardization, transformation, rationalization, linking, and matching processes.
- Monitor data pipelines, troubleshoot issues, and implement preventative solutions.
- Collaborate with stakeholders to understand reporting requirements and support interactive Power BI dashboards.
- Maintain documentation for data pipelines, workflows, data models, and business requirements.
- Apply data engineering best practices and organizational standards.
- Translate business requirements into data models and use data to inform decisions.
- Work overlapping U.S. business hours to support global collaboration.
Requirements
- At least 2 years of experience in a data engineering role.
- Bachelor’s degree in computer science, information technology, or a related field.
- Proficiency in SQL and Python, including writing efficient code.
- Experience with data management, data profiling, sourcing, cleansing, and data quality practices.
- Experience with databases and data platforms including Azure SQL Database, Azure Synapse SQL Pool, AWS Redshift, MySQL, Databricks SQL, and Delta Lake.
- Experience with Azure DevOps and/or GitHub.
- Experience with Azure Data Factory, Apache Airflow, and/or Databricks workflows and jobs.
- Hands-on Databricks experience with notebooks, clusters, Delta Lake, and performance optimization for scalable data processing.
- Strong English verbal and written communication skills, structured problem-solving ability, organizational skills, and motivation to solve data problems.
- Preferred experience building Power BI data models.
- Preferred knowledge of Azure Data Lake Gen 2, Storage Account, Blobs, Azure Functions, Logic Apps, Databricks Unity Catalog, Delta Live Tables, medallion architecture patterns, AWS S3, and EMR.
Benefits
- Hybrid work arrangement requiring attendance at the Hyderabad office two to three days per week.
- Competitive paid time off, including 15 earned accrued leave days, 12 sick leave days, and 12 casual leave days per year.
- 11 holidays plus four quarterly Days of Disconnect.
- Group Mediclaim insurance coverage of INR 500,000 for the employee, spouse, children, and parents or parents-in-law, including EAP counseling.
- Life insurance and personal accident insurance.
- Quarterly fitness reimbursement through the Best Life perk.
- Calm App subscription for the employee and up to four dependents over age 16.
- Financial aid toward crèche facilities for working women.
- Values-focused culture with learning, mentorship, and professional development opportunities.
About ABC Financial Services
ABC Financial Services (now ABC Fitness) builds club management and billing software for gyms, studios, and health clubs, combining SaaS tools with integrated payment processing. Its products cover member management, scheduling, point-of-sale, and reporting for single-location studios to multi-site fitness chains, with recurring revenue from subscriptions and processing fees. The company is privately held, backed by private equity, and headquartered in Sherwood, Arkansas, with customers across North America and internationally.