Lead Software Engineer - Performance
Qualys, Inc.2 hours ago
Pune, IndiaStaff+
Responsibilities
- Own performance strategy across distributed systems, including Java microservices, Hadoop, Spark, Kafka, Elasticsearch/OpenSearch, Big Data components, and APIs.
- Design and execute performance test plans, load tests, stress tests, soak tests, benchmarks, and production-like workload scenarios.
- Analyze heap dumps, thread dumps, garbage collection logs, CPU profiling reports, bottlenecks, resource contention, and latency issues.
- Tune and scale Spark jobs, Kafka topics and partitions, Elasticsearch queries, API endpoints, and other distributed workloads.
- Build and own a performance testing framework for synthetic data generation and integrate it with CI/CD pipelines.
- Establish and track SLAs for throughput, latency, CPU and memory utilization, and garbage collection.
- Create performance dashboards and visualizations, document findings, and prepare technical reports for engineering and leadership teams.
- Collaborate with development, architecture, infrastructure, and platform teams to implement performance improvements and optimize cost.
- Contribute to feature development and fixes in addition to performance benchmarking.
Requirements
- Bachelor's degree in Computer Science, Engineering, or a related field.
- 8+ years of experience in distributed systems and backend performance engineering.
- 4+ years of Java development experience with microservices architecture.
- Proficiency with Python and Bash scripting for automation and test data generation.
- 4+ years of hands-on Apache Spark experience, including performance tuning, memory management, and DAG optimization.
- 3+ years of Kafka experience, including topic optimization, producer and consumer tuning, and lag monitoring.
- 3+ years of Elasticsearch/OpenSearch experience, including query profiling, indexing strategies, and cluster optimization.
- 3+ years of experience with performance testing tools such as JMeter or similar.
- Hands-on experience with Spring and Hibernate and strong programming, design, profiling, debugging, and observability skills.
- Experience with Spark UI, Athena, Grafana, ELK, and related observability tools.
- Experience designing and running benchmarks at scale for high-throughput environments measured in petabytes.
- Experience with containerized workloads and performance testing in Kubernetes and Docker environments.
- Understanding of cloud-native architecture, distributed systems design, Linux performance improvements, data lake architecture, caching solutions, and message queues.
- Familiarity with CI/CD integration for performance testing using tools such as Jenkins and GitHub.
- Strong communication skills and experience influencing cross-functional engineering teams.
- Prior experience with analytics platforms on Big Data is preferred.
Tech Stack
Apache HadoopApache JMeterApache KafkaApache SparkBashDockerElasticsearchGrafanaJavaJenkinsKibanaKubernetesLinuxPrometheusPythonSpring Boot