Sr Data Engineer + Platform Engineer (GCP)

5 months ago

Hartford, CT, USASenior

Responsibilities

Design scalable ELT/ETL data pipelines using SQL, Python, BigQuery, Dataflow, and Cloud Storage.
Implement real-time processing with Pub/Sub and develop data models.
Provision and deploy GCP resources and services.
Automate infrastructure using Terraform.
Configure AlloyDB and Vertex AI database environments.
Build and manage containerized workloads with Docker and Google Kubernetes Engine.
Use GCP DevOps services including Cloud Build and Cloud Deploy.
Manage security with IAM and deploy services using Cloud Run and Cloud Scheduler.

Proficiency in SQL, Python, and core Google Cloud services including BigQuery, Dataflow, and Cloud Storage.
Experience with GCP Data Transfer Service, Cloud Transfer Service, Pub/Sub, Cloud Dataflow, Cloud Dataproc, Cloud Dataprep, and Cloud Composer.
Experience with data modeling and real-time processing.
Experience managing IAM security and automating infrastructure with Terraform.
Experience with AlloyDB, Vertex AI, microservices, Cloud Run, and Cloud Scheduler.
Experience deploying GCP services and provisioning GCP resources.
Experience with Docker and Google Kubernetes Engine.
GCP DevOps experience with Cloud Build and Cloud Deploy.

Significant career development opportunities.
Opportunity to work in a small, fast-growing, challenging, and entrepreneurial environment with substantial individual responsibility.
Hybrid work arrangement requiring three to four days onsite.

5,001-10,000 employees