Senior Software Engineer - Python and Data Ecosystem
ClickHouse2 months ago
Responsibilities
- Own and evolve ClickHouse’s Python connector and SDK ecosystem, improving performance, reliability, and API design.
- Build and maintain enterprise-grade integrations with Airflow, Dagster, Prefect, and dbt.
- Drive the AI/LLM integration strategy for RAG architectures, ML feature pipelines, and LLM-powered data applications.
- Engage with the open-source community by triaging issues, supporting contributors, advocating for users, and shaping the roadmap.
- Collaborate with Product, Cloud, and other engineering teams on platform priorities.
- Ground roadmap decisions in Data Engineer and Data Scientist workflows.
Requirements
- 7+ years of software development experience, including hands-on experience as a Data Engineer, Data Scientist, or ML Engineer.
- Proven experience designing, building, and maintaining production-grade Python connectors, SDKs, or integrations for a major platform.
- Production experience applying AI/ML through embedding generation, vector search, feature pipelines, or LLM-powered tooling.
- Experience with Pandas, NumPy, Pydantic, and related Python data libraries.
- Strong database fundamentals, including SQL, data modeling, query optimization, and OLAP or analytical databases.
- Experience with concurrent Python, including threading, multiprocessing, and asynchronous patterns.
- Prior contributions to or deep practical experience with Airflow, Dagster, or Prefect is preferred.
- Experience deploying AI/ML models in production, including inference APIs and vector databases, is preferred.
- Prior product-facing or platform experience as a Data Engineer or Data Scientist is preferred.
- Familiarity with ClickHouse or similar high-performance OLAP platforms and the JVM ecosystem is preferred.
- Strong written and verbal communication skills and comfort working with engineering teams and open-source communities.
Benefits
- Remote-friendly, flexible work environment; the company operates in over 20 countries.
- Employer healthcare contributions.
- Company stock options for every new team member.
- Flexible time off in the US and generous entitlement in other countries.
- $500 home office setup for remote employees.
- Opportunities to participate in company-wide global gatherings.
- Eligible locations include the USA, Canada, UK, Portugal, Spain, France, Italy, Germany, the Netherlands, Poland, Czech Republic, Israel, and the UAE.
Tech Stack
Categories
About ClickHouse
ClickHouse is a fast, open-source columnar database built for real-time data processing and analytics at scale. ClickHouse Cloud delivers the query speed and concurrency that applications demanding instant insight from large volumes of data require. As AI agents become more embedded in software, generating higher query volumes at tighter latency, ClickHouse provides a high-throughput, low-latency engine purpose-built for that workload.