2 days ago
Responsibilities
- Build and optimize enterprise data pipelines using SQL, Spark/PySpark, Python, and Apache Iceberg.
- Optimize Spark/PySpark jobs and databases including Apache Iceberg, ClickHouse, and Aurora PostgreSQL.
- Design and implement workloads on AWS using services such as Athena, S3, Glue, EMR, Lambda, SQS, EventBridge, SNS, IAM, CloudWatch, and Aurora RDS PostgreSQL.
- Integrate data pipelines with data virtualization and data governance tools.
- Work on enterprise greenfield projects that include application development workloads.
- Collaborate with customers and teams on FSI-sector use cases and large-scale digital, cloud, and AI-driven transformation projects.
Requirements
- 8+ years of relevant experience.
- Strong hands-on knowledge of SQL, including analytical queries, window functions, and stored procedures.
- Strong hands-on knowledge of Spark/PySpark, Python, and Apache Iceberg.
- Strong knowledge of AWS services including Athena, Aurora RDS PostgreSQL, S3, CloudWatch, Glue Catalog, EMR, Lambda, SQS, EventBridge, SNS, and IAM.
- Experience optimizing Spark/PySpark jobs and databases involving Apache Iceberg, ClickHouse, and Aurora PostgreSQL.
- Experience with enterprise greenfield projects and application development workloads.
- Experience serving FSI-sector customers and workloads.
- Experience building data pipelines integrated with Denedo and Collibra.
- Exposure to SSIS, Terraform, and CI/CD tools.
- Telco mobile networks knowledge is preferred but not required.
Benefits
- Full-time employment.
- Remote work in the USA.
- Opportunity to work at an AI-first digital engineering company on Fortune 500 and enterprise transformation projects.
- Lead and collaborate with a team solving complex customer challenges.
- Hands-on exposure to AI, ML, data, and cloud technologies with ongoing upskilling opportunities.
Tech Stack
Categories
Data Engineering
About Quantiphi
Quantiphi is an award-winning AI-first digital engineering company driven by the desire to reimagine and realize transformational opportunities at the heart of the business. Since its inception in 2013, Quantiphi has solved the toughest and most complex business problems by combining deep industry experience, disciplined cloud, and data-engineering practices, and cutting-edge artificial intelligence research to achieve accelerated and quantifiable business results. Learn more at www.quantiphi.com.