Data Platform Engineer
PrizePicksabout 4 hours ago
Remote, Worldwide or Atlanta, GA, USAMid Level / Senior
Base Salary
$145k - $175k/yr
Responsibilities
- Design and build a scalable data platform for batch and streaming use cases.
- Maintain a platform with cutting-edge technologies and enable data catalog and lineage capabilities.
- Build a real-time data platform for low-latency services.
- Champion best practices for model deployment, monitoring, and CI/CD.
- Ensure complete observability for batch and streaming data platforms.
Requirements
- 3+ years of experience in Platform Engineering with a focus on scalable data platforms.
- Proficient in streaming architectures like Kafka, Flink, or PubSub.
- Experience with containerization technologies such as Docker and Kubernetes.
- Expert in coding with Python and Go, with deep experience in cloud services.
- Extensive experience in big data technologies like Spark, Flink, and Kafka.
Benefits
- Company-subsidized medical, dental, and vision plans.
- 401(k) plan with company match.
- Annual bonus and flexible PTO.
- Generous paid leave programs including 16-week paid parental leave.
- Workplace flexibility and modern work schedules.
Tech Stack
Apache AirflowApache FlinkApache KafkaApache SparkArgo CDAWSDockerElasticsearchGoGoogle BigQueryGoogle Cloud PlatformKubernetesPythonRedis