2 days ago
Responsibilities
- Administer, optimize, and govern Kafka, AWS MSK, Kinesis, and OpenSearch platforms.
- Design scalable, fault-tolerant, and secure streaming architectures.
- Monitor, troubleshoot, and performance-tune distributed systems; drive capacity planning.
- Implement security controls, automation, and operational best practices.
- Support integrations with data lakes, Snowflake, analytics platforms, and downstream systems.
- Automate infrastructure provisioning using Terraform or similar IaC tools.
- Leverage AI-assisted development tools to improve engineering productivity and platform automation.
- Collaborate with engineering and analytics teams to enable real-time data processing and AI-driven data solutions.
Requirements
- 6+ years of experience with Kafka administration and distributed streaming systems.
- Strong AWS cloud services experience (MSK, Kinesis, and related services).
- Linux administration and automation/scripting skills.
- Python development and platform reliability engineering experience.
- Desire to learn and implement evolving and new technologies.
- Preferred experience with Flink using Spring Boot.
- Snowflake integration experience.
- Kubernetes orchestration knowledge.
- Administration knowledge in OpenSearch clusters.
- Familiarity with AI-enabled engineering workflows and tools.