Senior Software Engineer - Data Integration & JVM Ecosystem
ClickHouse3 months ago
Responsibilities
- Own the full lifecycle of data framework integrations, from core database drivers to SDKs and connectors
- Build and maintain official ClickHouse connectors for data-processing frameworks and integrations across the data ecosystem
- Develop JVM-based tools that enable data engineers to use ClickHouse in high-scale workloads
- Optimize performance, reliability, concurrency, memory usage, and network throughput for data integrations
- Collaborate with the open-source community, internal teams, and enterprise users to improve JVM integrations and developer experience
Requirements
- 6+ years of software development experience focused on high-quality, data-intensive solutions
- Proven experience with the internals of Apache Spark, Apache Flink, Kafka Connect, or Apache Beam
- Experience developing or extending connectors, sinks, or sources for a big data processing framework
- Strong database fundamentals, including SQL, data modeling, query optimization, and familiarity with OLAP or analytical databases
- Track record of building scalable data integration systems beyond simple ETL jobs
- Strong proficiency in Java and the JVM ecosystem, including memory management, garbage collection tuning, and performance profiling
- Experience with concurrent Java programming using threads, executors, and reactive or asynchronous patterns
- Understanding of JDBC, TCP/IP, HTTP, and techniques for optimizing data throughput over the wire
- Strong written and verbal communication skills and a passion for open-source development
- Preferred: open-source project contributions and engagement with the OSS community
- Preferred: familiarity with ClickHouse or similar high-performance data platforms
- Preferred: working knowledge of Python for data engineering, including Pandas, PySpark, or Airflow, and the ability to contribute to Python tooling
Benefits
- Flexible, remote-friendly work environment across more than 20 countries
- Employer healthcare contributions
- Company stock options
- Flexible time off in the US and generous leave entitlement in other countries
- $500 home office setup for remote employees
- Opportunities to attend company-wide global gatherings
Tech Stack
Apache AirflowApache BeamApache FlinkApache KafkaApache SparkClickHousedbtGrafanaJavaMetabasePandasPythonSQL
Categories
BackendData Engineering
About ClickHouse
ClickHouse is a fast, open-source columnar database built for real-time data processing and analytics at scale. ClickHouse Cloud delivers the query speed and concurrency that applications demanding instant insight from large volumes of data require. As AI agents become more embedded in software, generating higher query volumes at tighter latency, ClickHouse provides a high-throughput, low-latency engine purpose-built for that workload.