Software Engineer, Discovery Engineering
OpenAI
10 months ago
San Francisco, CA, USA
Mid Level / Senior
Base Salary
$230k - $325k/yr
Responsibilities
- Design and operate data storage pipelines that can operate at scale.
- Build search and discovery services based on partner team needs.
- Automate secure data transfers, including encryption and auditing.
- Establish locked-down compute environments balancing usability and security.
- Instrument monitoring and KPIs for data accountability.
- Collaborate to codify SOPs, threat models, and documentation.
Requirements
- Hands-on experience with large-scale data-lake or backup systems (Azure, AWS, GCP).
- Familiarity with Terraform or Pulumi, CI/CD, and creating repeatable pipelines.
- Comfortable with discovery workflows or eager to learn quickly.
- Ability to communicate technical concepts clearly to diverse teams.
- Experience shipping secure solutions balancing speed, cost, and defensibility.
- Strong documentation skills and ability to work under tight deadlines.
Tech Stack
Apache SparkAWSAzureDatabricksGoogle Cloud PlatformTerraform
Categories
Data EngineeringSecurity