3 years ago
Base Salary
$293k - $385k/yr
Responsibilities
- Own and lead engineering projects involving web crawling, data ingestion, and search.
- Collaborate with Data Processing, Architecture, and Scaling teams to maintain smooth data flow and system operability.
- Work with the legal team on compliance and data privacy matters.
- Develop and deploy highly scalable distributed systems capable of handling petabytes of data.
- Architect and implement data indexing and search algorithms.
- Build and maintain backend data storage services, including key-value databases and synchronization.
- Deploy solutions in a Kubernetes Infrastructure-as-Code environment and perform routine system checks.
- Conduct and analyze data experiments to provide insights into system performance.
Requirements
- Bachelor’s, master’s, or PhD in Computer Science or a related field.
- 4+ years of industry experience in software development.
- Strong expertise in large stateful distributed systems and data processing.
- Proficiency in Kubernetes and Infrastructure-as-Code concepts.
- Experience with large web crawlers is a plus.
- Ability to try new approaches and technologies, manage multiple tasks, adapt to changing priorities, and communicate effectively.
Tech Stack
Categories
BackendData Engineering
About OpenAI
OpenAI builds and deploys large-scale AI models and tools—including ChatGPT, GPT-4–class models, DALL·E, and Whisper—sold via APIs and enterprise subscriptions to developers and businesses. It monetizes through usage-based API pricing and ChatGPT Plus/Team/Enterprise, and also reaches customers via Microsoft’s Azure OpenAI Service. Founded in 2015 and headquartered in San Francisco, it operates as a private partnership.