Senior/Principal Engineer – OpenSearch
DTEX Systems5 days ago
Fremont, CA, USASenior / Staff+
Base Salary
$170k - $220k/yr
Responsibilities
- Lead the development and optimization of large-scale OpenSearch clusters containing terabytes of data.
- Design and implement features, enhancements, and bug fixes for DTEX’s Insider Risk Management and AI Risk Management products.
- Manage and fine-tune cloud-hosted OpenSearch environments, including shard, replica, JVM, memory, and garbage collection settings.
- Develop and tune ingestion pipelines, field mappings, cluster integrity, search, and aggregation performance.
- Serve as a consultant, advisor, and mentor to internal and external search practitioners.
- Attend client and internal meetings to align technical solutions with business needs.
- Contribute to the OpenSearch community, public forums, and upstream open-source projects.
- Collaborate with cross-functional teams and global open-source contributors while rapidly iterating on high-quality solutions.
Requirements
- At least 10 years of software engineering experience.
- Bachelor’s degree in computer science or a related field.
- Deep expertise in OpenSearch internals and managing terabytes of data across multiple nodes.
- Experience migrating large-scale Elasticsearch 6.x clustered deployments to OpenSearch 2.x or above.
- Strong knowledge of ingestion pipelines, field mappings, cluster integrity, search and aggregation tuning, index lifecycle management, sharding, JVM configuration, garbage collection, and shard and replica allocation.
- Strong proficiency in Python and a good understanding of JVM ecosystems.
- Understanding of algorithms, data structures, software design principles, and distributed, high-throughput, concurrent applications.
- Hands-on experience with major cloud platforms, preferably AWS.
- Ability to debug complex issues and engage with upstream open-source communities.
Benefits
- Hybrid or remote work environment.
- Competitive compensation, equity participation, health and wellness benefits, and generous time-off policies.
- Opportunities for continuous professional development in a values-driven, collaborative environment.