2 days ago
Responsibilities
- Build and optimize enterprise data pipelines and greenfield application workloads.
- Optimize Spark/PySpark jobs and databases including Apache Iceberg, ClickHouse, and Aurora PostgreSQL.
- Design and implement solutions using AWS data, compute, messaging, monitoring, and identity services.
- Integrate data pipelines with data virtualization and data governance tools such as Denedo and Collibra.
- Lead and collaborate with teams delivering large-scale digital, cloud, and AI-driven transformation projects.
Requirements
- 8+ years of experience in relevant technical architecture and data engineering work.
- Strong hands-on knowledge of SQL, including analytical queries, window functions, and stored procedures.
- Strong hands-on knowledge of Spark/PySpark, Python, and Apache Iceberg.
- Strong knowledge of AWS services including Athena, Aurora RDS PostgreSQL, S3, CloudWatch, Glue Catalog, EMR, Lambda, SQS, EventBridge, SNS, and IAM.
- Experience optimizing Spark/PySpark jobs and databases, including Apache Iceberg, ClickHouse, and Aurora PostgreSQL.
- Experience with enterprise greenfield projects involving application development workloads.
- Experience supporting customer workloads and use cases in the financial services sector.
- Experience building pipelines integrating with data virtualization and governance tools such as Denedo and Collibra.
- Exposure to SSIS, Terraform, and CI/CD tools.
- Telecommunications mobile-network knowledge is preferred but not mandatory.
Benefits
- Full-time employment.
- Remote work in Canada.
- Opportunity to work on large-scale projects for Fortune 500 and Fortune 1000 organizations.
- Hands-on experience with AI, machine learning, data, and cloud technologies with ongoing upskilling.
- Collaboration with a high-energy team in a research-driven environment.
Tech Stack
Categories
Data Engineering
About Quantiphi
Quantiphi is an award-winning AI-first digital engineering company driven by the desire to reimagine and realize transformational opportunities at the heart of the business. Since its inception in 2013, Quantiphi has solved the toughest and most complex business problems by combining deep industry experience, disciplined cloud, and data-engineering practices, and cutting-edge artificial intelligence research to achieve accelerated and quantifiable business results. Learn more at www.quantiphi.com.