Data Engineer
Applied Systems, Inc.2 months ago
Bengaluru, IndiaMid Level
Responsibilities
- Design, develop, operationalize, and maintain robust, scalable data pipelines with automated data quality checks.
- Build development-to-production pipelines using GCP services, Python, BigQuery, dbt, SQL, Apache Airflow, and Celigo.
- Optimize ETL processes, data workflows, and data processing performance for efficiency, scalability, high availability, and reliability.
- Implement data lifecycle, lineage, metadata, governance, BigQuery SQL procedures, functions, and actionable logging.
- Develop and maintain scalable data models and schemas for analytics and reporting, including parsing JSON, XML, and text data.
- Implement monitoring and alerting, testing, and validation to maintain data quality and resolve production issues.
- Create and maintain technical documentation for data processes, pipelines, and models.
- Apply reusable software engineering components and stay current with data engineering technologies and practices.
Requirements
- 4+ years of experience in data or ETL engineering, architecture, and pipeline development.
- At least 1 year of experience developing with Google Cloud Platform.
- Experience building and maintaining scalable cloud-based data warehouses, preferably with BigQuery.
- Experience with GCP managed data services including Dataproc, Dataflow, and BigQuery.
- Proficiency in SQL, dbt, Python, Apache Airflow or Composer, and Git.
- Hands-on experience with ETL tools such as Talend, Fivetran, or similar.
- Experience designing and maintaining ETL processes, automated data quality checks, and reusable ETL components.
- Familiarity with data lake, data warehouse, and data modeling concepts, including star schema, snowflake schema, normalization, fact tables, and dimension tables.
- Bachelor-level degree in Computer Science, MIS, or CIS, or equivalent experience.
- Strong problem-solving, independent working, collaboration, and communication skills, including the ability to explain technical concepts to non-technical stakeholders.
Benefits
- Flexible work model combining remote and in-person collaboration.
- Inclusive culture that values diverse experiences and recognizes teammates' contributions.
- Equal employment opportunity commitment across protected characteristics.
Tech Stack
Categories
Data Engineering
About Applied Systems, Inc.
Applied Systems builds cloud software for property and casualty insurance agencies and brokerages, including agency/broker management systems, quoting/rating tools, analytics, and insurer connectivity. The company sells its platforms on a subscription basis and operates the IVANS data exchange that links agencies with insurance carriers. Founded in 1983 and headquartered in Chicago, it is privately held by Hellman & Friedman and serves markets across North America and the U.K./Ireland.