Responsibilities
- Analyze end-to-end Omnia and PySpark data pipelines, source code, SQL, mappings, transformation rules, and data flows.
- Derive, document, and implement new transformation and business logic based on existing pipelines and business requirements.
- Design, develop, maintain, and troubleshoot scalable data pipelines using AWS, Snowflake, dbt, Airflow, Python, PySpark, and SQL.
- Build batch and event-driven ingestion, transformation, enrichment, reconciliation, and data-integration solutions across cloud data platforms.
- Implement data-quality, validation, balancing, and reconciliation controls and resolve data discrepancies and performance bottlenecks.
- Collaborate with data designers, product owners, and subject matter experts to translate business requirements into technical data solutions.
Requirements
- Strong hands-on experience designing, developing, and supporting scalable enterprise data pipelines.
- Strong Spark ETL experience, including analyzing Omnia pipelines and deriving transformation and business rules.
- Strong working knowledge of AWS services including S3, Glue, EMR, Lambda, Athena, Step Functions, SQS, IAM, Secrets Manager, and CloudWatch.
- Hands-on experience orchestrating data pipelines with Apache Airflow.
- Practical Snowflake experience spanning ingestion, data modeling, transformation, and performance optimization.
- Experience using dbt for data models, incremental processing, reusable macros, automated tests, documentation, and dependency management.
- Excellent SQL skills involving complex transformations, query optimization, reconciliation, and existing business-logic analysis.
- Good Python programming skills for data processing, automation, and reusable framework components.
- Familiarity with Git, automated testing, CI/CD, Jenkins, and DevSecOps practices in a data engineering environment.
- Previous CBA experience, particularly with Omnia or CBA data platforms and engineering standards, is highly desirable.
Benefits
- Flexible workplace arrangements, mentoring, internal mobility, and learning and development programs are offered.
- Synechron is an equal opportunity and affirmative action employer committed to diversity, equity, and inclusion.
Tech Stack
Categories
About Synechron
At Synechron, we believe in the power of digital to transform businesses for the better. Our global consulting firm combines creativity and innovative technology to deliver industry-leading digital solutions. Synechron’s progressive technologies and optimization strategies span end-to-end Artificial Intelligence, Consulting, Digital, Cloud & DevOps, Data, and Software Engineering, servicing an array of noteworthy financial services and technology firms. Through research and development initiatives in our Synechron Labs we develop solutions for modernization, from Artificial Intelligence and Blockchain to Data Science models, Digital Underwriting, mobile-first applications and more. Over the last 20+ years, our company has been honored with multiple employer awards, recognizing our commitment to our talented teams. With top clients to boast about, Synechron has a global workforce of 14,000+, and has 55 offices in 20 countries within key global markets. For more information on the company, please visit our website:www.synechron.com.