Software Engineer, Enterprise Data Platform
Notion
8 months ago
San Francisco, CA, USA
Senior
H1B Sponsor
Base Salary
$230k - $300k/yr
Responsibilities
- Design and evolve the data lakehouse.
- Build and operate core lakehouse components for analytics, AI, and search.
- Own critical data pipelines and services, ensuring reliable data movement.
- Integrate Enterprise Key Management into data workflows.
- Build primitives for fine-grained access control and auditing.
- Improve operational reliability and observability of the data stack.
- Optimize performance and cost for large-scale data environments.
- Enable machine learning and search workflows on the data platform.
- Contribute to design documents that influence platform direction.
Requirements
- 5+ years of experience building and operating data platforms or large-scale data infrastructure.
- Strong programming skills in Python, Java, or Scala, and SQL for analytics.
- Hands-on experience with Spark or similar distributed processing systems.
- Experience with Kafka or equivalent streaming systems.
- Familiarity with data lakes and table formats like Iceberg, Hudi, or Delta.
- Practical understanding of data security and governance principles.
- Experience with major cloud providers and managed data services.
- Comfortable owning production services and incident response.
- Curiosity and willingness to adopt AI tools for improved results.
Tech Stack
Apache KafkaApache SparkAWSAzureDatabricksGoogle Cloud PlatformJavaKubernetesPythonScalaSQL
Categories
AI & MLData EngineeringSecurity