Senior Backend Engineer (Python, Java, GO)
SpiderSilk1 year ago
Dubai, United Arab EmiratesSenior / Staff+
Responsibilities
- Architect and maintain distributed microservices that operate reliably at scale.
- Design, build, and deploy standalone agentic AI solutions in production.
- Build and optimize ML pipelines, agent workflows, vector similarity search, and model-serving systems.
- Design event-driven architectures using Kafka, message queues, and stream-processing systems.
- Develop data pipelines for ingesting, processing, and surfacing threat-intelligence data.
- Design and optimize relational, graph, search, wide-column, object-storage, and analytical database schemas.
- Collect and process web data at scale, including malformed or untrusted files and archives.
- Apply secure-by-design practices, threat modeling, secure API design, and network-security principles.
- Deploy and debug services on virtual machines and Kubernetes, including rollouts, rollbacks, crash loops, and resource issues.
- Use logging, metrics, alerting, and observability tools to diagnose production issues.
- Drive architectural decisions, lead projects, and mentor junior and mid-level engineers.
Requirements
- 5–8 years of backend engineering experience delivering systems at scale.
- Strong production-grade proficiency in Python, Go, and Java.
- Deep understanding of concurrency primitives, distributed systems, microservices, event-driven architectures, and stream processing.
- Hands-on experience with Docker, Kubernetes, Redis, Kafka or RabbitMQ, Cassandra or an equivalent wide-column store, and S3-compatible object storage.
- Production experience building agentic AI systems, vector databases and similarity search, agent optimization, prompt engineering, and agentic frameworks.
- Practical experience with ML pipeline design, model serving, and feature engineering in production AI systems.
- Advanced database design and optimization experience with MySQL, PostgreSQL, Elasticsearch, graph databases such as Neo4j, and analytical or OLAP databases.
- Experience with web-scale data collection, HTTP clients, headless browsers, software fingerprinting, vulnerability mapping, and parsing untrusted data.
- Working knowledge of cybersecurity, network security, threat modeling, secure coding, network telemetry, zero-trust architecture, and security tooling.
- Experience with CI/CD, Kubernetes operations, VM debugging, log analysis, autoscaling, and observability tooling.
- Proven ability to make architectural decisions, lead projects or initiatives, mentor engineers, and communicate with technical and non-technical stakeholders.
- Preferred qualifications include cybersecurity or threat-intelligence experience, AWS/GCP/Azure exposure, time-series databases, open-source AI or security contributions, offensive security, penetration testing, vulnerability research, applied ML, and high-volume text processing.
Tech Stack
Amazon RedshiftApache AirflowApache CassandraApache KafkaAWKAWSAzureClickHouseDockerElasticsearchGitHub ActionsGitLab CI/CDGoGoogle BigQueryGoogle Cloud PlatformGrafanaInfluxDBJavaJenkinsKubernetesMySQLNeo4jPostgreSQLPrometheusPythonRabbitMQRedis
Categories
About SpiderSilk
SpiderSilk builds cybersecurity software for external exposure management and threat detection, sold to enterprise and government customers and paired with managed services. The company also offers Silkrunner, an agentic AI workflow orchestration platform used to design and deploy AI agents across security operations and business processes. Founded in 2019 and headquartered in Dubai, SpiderSilk operates as part of CPX following an acquisition.