Senior Software Engineer - Python and Data Ecosystem
ClickHouse2 months ago
Responsibilities
- Own and evolve ClickHouse’s Python connector and SDK ecosystem, improving performance, reliability, and API design.
- Build and maintain integrations with Airflow, Dagster, Prefect, and dbt to enterprise-grade quality standards.
- Design connectors and integration patterns for RAG architectures, ML feature pipelines, and LLM-powered data applications.
- Engage with the open-source community by triaging issues, supporting contributors, advocating for users, and shaping the roadmap.
- Collaborate with Product, Cloud, and other Engineering teams to align integration work with platform priorities.
- Represent Data Engineer and Data Scientist workflows in roadmap and prioritization decisions.
Requirements
- 7+ years of software development experience, including hands-on experience as a Data Engineer, Data Scientist, or ML Engineer.
- Proven experience designing, building, and maintaining production-grade Python connectors, SDKs, or integrations for a major platform.
- Production experience applying AI/ML in data-engineering contexts, including embedding generation, vector search, feature pipelines, or LLM-powered tooling.
- Experience with Pandas, NumPy, Pydantic, and related Python data libraries.
- Strong database fundamentals, including SQL, data modeling, query optimization, and familiarity with OLAP or analytical databases.
- Experience with concurrent Python, including threading, multiprocessing, and asynchronous patterns.
- Strong written and verbal communication skills and comfort collaborating with engineering teams and open-source communities.
- Prior product-facing or platform experience as a Data Engineer or Data Scientist is a bonus.
- Familiarity with ClickHouse or similar high-performance OLAP platforms is a bonus.
- Familiarity with the JVM ecosystem is a bonus.
- Production experience deploying AI/ML models, including inference APIs and vector databases, is a bonus.
Benefits
- Flexible, remote-friendly work environment for a globally distributed company operating in more than 20 countries.
- Employer healthcare contributions.
- Company stock options for every new team member.
- Flexible time off in the US and generous entitlement in other countries.
- $500 home office setup benefit for remote employees.
- Opportunities to attend company-wide global offsites.
Tech Stack
Categories
AI ApplicationsData Engineering
About ClickHouse
ClickHouse is a fast, open-source columnar database built for real-time data processing and analytics at scale. ClickHouse Cloud delivers the query speed and concurrency that applications demanding instant insight from large volumes of data require. As AI agents become more embedded in software, generating higher query volumes at tighter latency, ClickHouse provides a high-throughput, low-latency engine purpose-built for that workload.