1 day ago
Heredia, Costa RicaSenior
Responsibilities
- Implement structured JSON logging standards across Python services, including consistent fields, severity levels, context, and actionable failure details.
- Improve Kafka producer and consumer reliability through better offset commits, consumer-group stability, rebalancing, retries, dead-letter processing, message-loss investigation, and idempotency handling.
- Instrument distributed services and contribute to event-lineage capabilities that track processing stages, order, outcomes, and failures.
- Develop reconciliation and completion-tracking capabilities that identify incomplete processing and support alerting or delivery holds.
- Implement telemetry with OpenTelemetry and contribute to an OpenLineage-based lineage solution, with Marquez as the leading implementation option.
- Develop and maintain Python services interacting with Kafka, PostgreSQL, MongoDB, object storage, and external APIs.
- Write automated tests and support delivery in the existing Kubernetes, Kustomize, and ArgoCD environment.
- Troubleshoot distributed-processing issues across services, messages, data stores, and external dependencies, while contributing to documentation and operational readiness.
Requirements
- Strong production-level experience with Apache Kafka, including producer and consumer delivery semantics, offsets, commit strategies, consumer groups, partition assignment, rebalancing, retries, and dead-letter processing.
- Advanced Python software-engineering experience, including concurrency, threading, runtime behavior, production services, shared libraries, and maintainable, testable code.
- Experience defining and implementing structured logging standards and applying observability practices to distributed and event-driven systems.
- Strong working knowledge of PostgreSQL, including PostgreSQL JSON capabilities and operational, tracking, or event-related data structures.
- Preferred experience with OpenTelemetry, OpenLineage, Marquez, or comparable lineage solutions.
- Working knowledge of Kubernetes sufficient to deploy, troubleshoot, and operate applications in Kustomize and ArgoCD environments.
- Experience with Grafana, Grafana Loki, or equivalent metrics, dashboarding, and log-management platforms is preferred.
- Understanding of event-driven architecture, including idempotent processing, exactly-once concerns, at-least-once processing, transactional boundaries, and distributed-workflow recovery is preferred.
- Additional beneficial experience includes MongoDB, Apache Solr, AWS S3 or compatible storage, Istio, AWS Secrets Manager, External Secrets Operator, AWS EFS, NFS, image or video processing, digital asset or archive platforms, Apache Airflow, PgBouncer, TypeScript, or Node.js.
Tech Stack
Categories
About Fujitsu
Fujitsu is a Japanese multinational IT services and computing company that provides systems integration, managed services, cloud, and enterprise hardware for businesses and governments. It also develops servers, storage, and client devices for enterprise workloads. Founded in 1935 and headquartered in Tokyo, Fujitsu is publicly listed on the Tokyo Stock Exchange and operates in more than 50 countries.