2 hours ago
Base Salary
$132k - $141k/yr
Responsibilities
- Implement structured JSON logging standards across Python services.
- Improve Kafka producer and consumer reliability, including offset commits, consumer-group stability, retries, dead-letter topics, message-loss diagnosis, duplicate processing, and idempotency.
- Instrument distributed services and implement event-lineage capabilities for tracking processing stages, outcomes, failures, and ordering.
- Develop reconciliation and completion-tracking capabilities that compare expected workflow stages with recorded events.
- Implement telemetry with OpenTelemetry and contribute to an OpenLineage-based lineage solution using Marquez as the leading option.
- Develop and maintain Python services interacting with Kafka, PostgreSQL, MongoDB, object storage, and external APIs.
- Write automated tests and support delivery in Kubernetes, Kustomize, and ArgoCD environments.
- Troubleshoot distributed-processing issues and contribute to implementation, documentation, testing, and operational readiness.
Requirements
- Significant hands-on experience operating or developing production Kafka applications, including offsets, commit strategies, consumer groups, partition assignment, rebalancing, retries, and dead-letter processing.
- Advanced production Python software-engineering experience, including concurrency, threading, runtime behavior, production services, shared libraries, and maintainable testable code.
- Experience defining and implementing structured logging standards with consistent fields, severity levels, correlation information, error context, and diagnostic detail.
- Strong working knowledge of PostgreSQL, including PostgreSQL JSON capabilities and operational, tracking, or event-related data structures.
- Preferred experience with OpenTelemetry, OpenLineage, Marquez, or comparable lineage solutions.
- Working Kubernetes knowledge for deploying, troubleshooting, and operating applications in Kustomize and ArgoCD environments.
- Preferred experience with Grafana, Grafana Loki, or equivalent metrics, dashboarding, and log-management platforms.
- Understanding of event-driven architecture, idempotent processing, delivery semantics, transactional boundaries, and distributed-workflow recovery.
- Additional beneficial experience includes MongoDB, Apache Solr, S3-compatible storage, Istio, AWS Secrets Manager, External Secrets Operator, AWS EFS, NFS, image or video processing pipelines, digital repositories, Apache Airflow, PgBouncer, TypeScript, or Node.js.
Benefits
- Medical, vision, and dental insurance.
- Life insurance and short-term and long-term disability insurance.
- 401(k).
- Paid time off and legally required leave, including applicable Colorado Healthy Families and Workplaces Act leave.
- The role may be eligible for an annual bonus, subject to individual performance.
- Applications are accepted on an ongoing basis.
Tech Stack
Categories
BackendData Engineering
About Fujitsu
Fujitsu is a global leader in digital services that transform organizations and the world around us. We aim to make the world more sustainable by building trust in society through innovation.