10 hours ago
Remote, IndiaSenior
Responsibilities
- Design, deploy, upgrade, and operate the production streaming platform on Kubernetes, including Kafka clusters, topics, partitioning, retention, and capacity planning.
- Build and maintain CDC and connector pipelines between operational databases, the streaming layer, and analytical stores.
- Own schema registry governance, compatibility rules, versioning, and producer-consumer contract stability.
- Develop custom connectors, transformations, and stream-processing logic in Java or Go.
- Build self-service onboarding for topics, schemas, and access using infrastructure as code.
- Automate platform operations with Terraform and GitOps, eliminating manually configured clusters and undocumented topic definitions.
- Instrument the platform with metrics, lag and throughput monitoring, alerting, and dashboards.
- Enforce mTLS, authentication, topic-level RBAC, encryption, audit trails, and multi-tenant isolation.
- Implement ordering, idempotency, exactly-once delivery where required, replay, and disaster recovery capabilities.
- Partner with backend and SRE teams on event schemas, producer patterns, and failure modes; participate in on-call.
- Mentor engineers on streaming architecture and contribute to design reviews and documentation.
Requirements
- 10+ years of experience in software, data, or platform engineering, including deep hands-on ownership of a production event-streaming platform.
- Expert-level Apache Kafka or Confluent Platform/Cloud experience, including administration, tuning, troubleshooting, and production-scale capacity management.
- Strong Kafka Connect and CDC experience with Debezium, JDBC, and custom connector or transformation development.
- Experience governing schemas and managing compatibility across many independent producers and consumers.
- Strong programming ability in Java, Python, or Go for connectors, transformations, and platform tooling.
- Strong SQL and relational database knowledge, including PostgreSQL or MySQL, replication, and CDC mechanics.
- Production fluency deploying, operating, and debugging stateful workloads on Kubernetes, with Docker and Helm.
- Experience with Terraform or equivalent infrastructure as code and ownership of CI/CD pipelines using Jenkins, GitHub Actions, or equivalent.
- Experience with PostgreSQL at scale and at least one cloud data warehouse or search store such as Snowflake, BigQuery, or Elasticsearch.
- Experience with AWS or GCP, including networking, IAM, and managed Kubernetes.
- Experience with mTLS, OIDC/SSO, RBAC, and Prometheus/Grafana monitoring.
- Clear written English for design documents, runbooks, and asynchronous collaboration across global time zones.
- Preferred qualifications include Confluent certification, Kafka ecosystem open-source contributions, Flink, Kafka Streams, ksqlDB, event-driven architecture patterns, NATS JetStream, Pulsar, Go backend development, data quality or lineage tooling, compliance exposure, and GPU, AI/ML, telemetry, usage metering, billing, or chargeback pipeline experience.
- A bachelor’s degree in Computer Science, Engineering, or a related field, or 10 years of related experience.
Benefits
- Professional development and training.
- Attendance at conferences and working groups.
- Company outings, happy hours, hackathons, and tech talks.
- Competitive compensation package with a strong benefits plan.
- Opportunity to work with an established Silicon Valley cloud infrastructure leader, passionate colleagues, Fortune 500 and Global 2000 customers, and open-source cloud technologies.
Tech Stack
Apache FlinkApache KafkaAWSDockerElasticsearchGitHub ActionsGoGoogle BigQueryGoogle Cloud PlatformGrafanaHelmJavaJenkinsKubernetesMySQLPostgreSQLPrometheusPythonSnowflakeSQLTerraform
Categories
BackendData Engineering
About Mirantis
Mirantis builds Kubernetes-native infrastructure software and services for enterprises to run cloud, container, and AI workloads across on-premises, public cloud, and edge environments. It sells subscriptions, support, and managed services around products like Mirantis Kubernetes Engine and the Lens Kubernetes platform; the company acquired Docker Enterprise in 2019. Founded in 1999 and headquartered in Campbell, California, Mirantis is privately held and an IREN company serving global enterprises.