Senior Software Engineer - Python and Data Ecosystem
ClickHouse2 months ago
Responsibilities
- Own and evolve ClickHouse’s Python connector and SDK ecosystem, improving performance, reliability, and API design.
- Build and maintain integrations with Apache Airflow, Dagster, Prefect, dbt, and other data platforms to enterprise-grade standards.
- Drive AI and LLM integration strategy for retrieval-augmented generation, ML feature pipelines, vector stores, and LLM-powered data applications.
- Engage with the open-source community by triaging issues, supporting contributors, advocating for users, and shaping the roadmap.
- Collaborate with Product, Cloud, and engineering teams to align integration work with platform priorities.
- Apply firsthand Data Engineer or Data Scientist experience to roadmap and prioritization decisions.
Requirements
- 7+ years of software development experience, including hands-on experience as a Data Engineer, Data Scientist, or ML Engineer.
- Production experience designing, building, and maintaining Python connectors, SDKs, or integrations for a major platform.
- Hands-on production experience with AI/ML workflows such as embedding generation, vector search, feature pipelines, or LLM-powered tooling.
- Experience with Python data ecosystem tools including Pandas, NumPy, and Pydantic.
- Strong database fundamentals covering SQL, data modeling, query optimization, and OLAP or analytical databases.
- Experience with concurrent Python, including threading, multiprocessing, and asynchronous patterns.
- Strong written and verbal communication skills and comfort working with engineering teams and open-source communities.
- Prior product-facing or platform experience as a Data Engineer or Data Scientist is preferred.
- Familiarity with ClickHouse or similar high-performance OLAP platforms is preferred.
- Familiarity with the JVM ecosystem is preferred.
- Production experience deploying AI/ML models, inference APIs, or vector databases is preferred.
Benefits
- Flexible, remote-friendly work environment across more than 20 countries.
- Employer healthcare contributions.
- Company stock options for every new team member.
- Flexible time off in the US and generous time-off entitlement in other countries.
- $500 home office setup allowance for remote employees.
- Opportunities to participate in company-wide global gatherings and offsites.
Tech Stack
Categories
About ClickHouse
ClickHouse is a fast, open-source columnar database built for real-time data processing and analytics at scale. ClickHouse Cloud delivers the query speed and concurrency that applications demanding instant insight from large volumes of data require. As AI agents become more embedded in software, generating higher query volumes at tighter latency, ClickHouse provides a high-throughput, low-latency engine purpose-built for that workload.