about 4 hours ago
Responsibilities
- Design, build, and maintain scalable data pipelines for operational data.
- Architect and manage AWS cloud-based infrastructure for computation and data processing.
- Integrate on-prem and cloud data flows into a cohesive data architecture.
- Build and maintain CI/CD pipelines for software delivery and validation.
- Implement infrastructure-as-code using Terraform or CloudFormation.
- Develop internal services and automation tools for data processing.
- Establish best practices for data reliability and system security.
- Drive root-cause analysis for data infrastructure issues and design solutions.
- Collaborate with engineers to define data interfaces and cloud strategies.
Requirements
- Bachelor's or Master's degree in Computer Science, Electrical Engineering, or a related field.
- 7+ years of experience in building cloud infrastructure and data systems.
- Strong proficiency in Python focused on data pipeline development.
- Hands-on experience with Kafka, Kubernetes, and gRPC.
- Deep expertise with AWS cloud services.
- Experience with CI/CD platforms like Jenkins or GitHub Actions.
- Proficiency in containerization and orchestration using Docker and Kubernetes.
- Experience automating deployments with Terraform or CloudFormation.
- Familiarity with Git-based workflows and collaborative software development.