Staff Data Engineer
Applied Systems, Inc.2 months ago
Bengaluru, IndiaStaff+
Responsibilities
- Design, develop, operationalize, and own robust, scalable data pipelines with automated data quality checks.
- Define data lifecycles, lineage, metadata, governance, data models, and schemas for analytics and reporting.
- Own the end-to-end data platform architecture across GCP, BigQuery, dbt, Airflow, and Python with the Principal Engineer and Architect.
- Optimize ETL processes, data workflows, query performance, scalability, availability, and cost.
- Implement monitoring, alerting, testing, validation, and observability for development and production data systems.
- Establish engineering standards covering code reviews, testing, reusable frameworks, and CI/CD for data workloads.
- Create and maintain technical documentation for data processes, pipelines, and models.
- Mentor engineers through design reviews, pair programming, and structured technical feedback.
- Partner with Engineering, Product, and business leadership to translate ambiguous problems into technical requirements.
- Evaluate emerging technologies and lead the multi-quarter technical roadmap for the data platform.
Requirements
- 10+ years of experience in data or ETL engineering, data or ETL architecture, and pipeline development.
- 3+ years operating at a senior or lead level with technical influence beyond the immediate team.
- 3+ years of hands-on Google Cloud Platform experience, including deep BigQuery expertise in partitioning, clustering, reservations, cost optimization, and query tuning.
- Experience architecting, building, and scaling cloud data platforms serving multiple consuming teams, with attention to scale, latency, and cost.
- Experience with GCP managed data services including Dataproc, Dataflow, and BigQuery.
- Deep expertise in SQL, dbt, Python, and Apache Airflow or Composer, plus hands-on experience with Talend, Fivetran, or similar ETL tools.
- Experience with streaming and near-real-time architectures, delivery semantics, schema evolution, and late-arriving data.
- Strong dimensional modeling expertise and judgment about when to use alternative modeling approaches.
- Experience establishing data quality, observability, and testing frameworks adopted by other engineers.
- Experience with infrastructure as code and CI/CD for data workloads.
- Ability to influence without authority and drive technical decisions across teams.
- Track record of mentoring engineers to promotion and producing written design documents for senior stakeholders.
- Bachelor's degree in Computer Science or a related field, or equivalent experience.
Benefits
- Flexible working model that supports remote and in-person collaboration.
- Inclusive culture that values diverse experiences and recognizes teammates' contributions.
- Equal employment opportunity commitment across protected statuses.
Tech Stack
Categories
Data Engineering
About Applied Systems, Inc.
Applied Systems builds cloud software for property and casualty insurance agencies and brokerages, including agency/broker management systems, quoting/rating tools, analytics, and insurer connectivity. The company sells its platforms on a subscription basis and operates the IVANS data exchange that links agencies with insurance carriers. Founded in 1983 and headquartered in Chicago, it is privately held by Hellman & Friedman and serves markets across North America and the U.K./Ireland.