Senior Software Engineer - Python and Data Ecosystem
ClickHouse2 months ago
Responsibilities
- Own and evolve ClickHouse’s Python connector and SDK ecosystem, with emphasis on performance, reliability, and API design.
- Build and maintain integrations with Apache Airflow, Dagster, Prefect, and dbt.
- Drive AI and LLM integration strategy for RAG architectures, ML feature pipelines, vector stores, and LLM-powered data applications.
- Engage with the open-source community by triaging issues, supporting contributors, advocating for users, and informing the roadmap.
- Collaborate with Product, Cloud, and engineering teams on platform priorities.
- Use Data Engineer and Data Scientist workflows to guide roadmap and prioritization decisions.
Requirements
- 7+ years of software development experience, including hands-on experience as a Data Engineer, Data Scientist, or ML Engineer.
- Proven experience building and maintaining production-grade Python connectors, SDKs, or integrations for a major platform.
- Production experience with AI/ML data-engineering workflows such as embedding generation, vector search, feature pipelines, or LLM-powered tooling.
- Experience with Pandas, NumPy, Pydantic, and related Python data ecosystem libraries.
- Strong database fundamentals including SQL, data modeling, query optimization, and familiarity with OLAP databases.
- Experience with concurrent Python, including threading, multiprocessing, and asynchronous patterns.
- Strong written and verbal communication skills and comfort collaborating across engineering teams and open-source communities.
- Prior product-facing or platform experience as a Data Engineer or Data Scientist is a bonus.
- Familiarity with ClickHouse or similar high-performance OLAP platforms is a bonus.
- Familiarity with the JVM ecosystem is a bonus.
- Production experience deploying AI/ML models, inference APIs, and vector databases is a bonus.
Benefits
- Remote-friendly flexible work environment across eligible countries.
- Employer healthcare contributions.
- Company stock options.
- Flexible time off in the US and generous leave entitlement in other countries.
- $500 home office setup for remote employees.
- Opportunities to participate in company-wide global gatherings.
Tech Stack
Categories
About ClickHouse
ClickHouse is a fast, open-source columnar database built for real-time data processing and analytics at scale. ClickHouse Cloud delivers the query speed and concurrency that applications demanding instant insight from large volumes of data require. As AI agents become more embedded in software, generating higher query volumes at tighter latency, ClickHouse provides a high-throughput, low-latency engine purpose-built for that workload.