Senior Event-Driven Architecture (Apache Kafka)
Wizeline
6 months ago
Remote, Mexico
Senior
H1B Sponsor
Responsibilities
- Design and implement scalable and resilient event-driven systems using Apache Kafka.
- Define and manage Kafka components including topics, partitions, consumer groups, and delivery semantics.
- Configure Kafka settings such as retention policies and log compaction.
- Design domain-oriented event models with support for versioning and structured event formats.
- Apply architectural patterns including Event Sourcing, CQRS, SAGA orchestration, Complex Event Processing, and Staged Event-Driven Architecture.
- Implement real-time and near real-time event processing pipelines using Kafka Streams and Apache Flink.
- Develop mechanisms for message retries, dead letter queues, and compensating transactions.
- Ensure strong event governance through the use of Schema Registry and enforce schema validation practices.
- Integrate observability solutions for Kafka performance metrics, centralized logging, and distributed tracing.
Requirements
- Hands-on experience designing, building, and maintaining event-driven systems.
- Strong understanding of messaging platforms like Apache Kafka.
- Familiarity with modern architectural patterns.
- Experience with real-time event processing tools such as Kafka Streams and Apache Flink.
Benefits
- Access to LinkedIn Learning and Pluralsight for skill development.
- Opportunities to create personalized career paths.
Tech Stack
Apache FlinkApache Kafka
Categories
AI & MLBackendData Engineering