Software Development Engineer
Health Catalyst, Inc.8 days ago
Hyderābād, IndiaMid Level
Responsibilities
- Design, develop, and maintain ETL/ELT pipelines for large-scale data ingestion, transformation, and loading.
- Build and optimize Snowflake data warehouse solutions for analytics and reporting.
- Develop AWS-based integrations using AWS Glue, AWS Lambda, AWS SNS, and AWS S3.
- Develop event-driven and streaming workflows using Kafka.
- Implement Snowflake capabilities including RBAC, ABAC, Snowpipes, and Dynamic Tables.
- Write SQL queries and develop Python automation scripts and data processing logic.
- Build and orchestrate workflows using Airflow and Step Functions.
- Ensure data quality, consistency, reliability, performance, scalability, and maintainability across pipelines.
- Troubleshoot production issues, collaborate with cross-functional teams, and document architecture and operational procedures.
Requirements
- 2–4 years of experience in software development, data engineering, or related roles.
- Strong understanding of ETL/ELT processes and data warehousing concepts.
- Hands-on knowledge of AWS Glue, AWS Lambda, AWS SNS, and AWS S3.
- Working knowledge of Kafka and proficiency in SQL and Python.
- Fundamental experience with Snowflake, including RBAC, ABAC, Snowpipes, and Dynamic Tables.
- Experience with Airflow for workflow orchestration and basic to moderate exposure to other cloud technologies and services.
- Strong analytical, debugging, critical-thinking, problem-solving, collaboration, communication, and documentation skills.
- Bachelor's degree in Computer Science, Information Technology, Engineering, or a related field.
- Preferred qualifications include familiarity with Pentaho, AWS EMR, Redshift, Athena, Step Functions, IAM, CloudWatch, EventBridge, distributed systems, data lakes, streaming architectures, and cloud data governance and access controls.
Tech Stack
Categories
Data Engineering