Senior Software Engineer, Data Acquisition
OpenAI
over 2 years ago
San Francisco, CA, USA
Senior
Base Salary
$293k - $385k/yr
Responsibilities
- Own and lead engineering projects in data acquisition.
- Collaborate with Data Processing, Architecture, and Scaling teams.
- Work with the legal team on compliance and data privacy matters.
- Develop and deploy scalable distributed systems for large data sets.
- Architect and implement algorithms for data indexing and search.
- Build and maintain backend services for data storage.
- Deploy solutions in a Kubernetes Infrastructure-as-Code environment.
- Conduct experiments on data to analyze system performance.
Requirements
- BS/MS/PhD in Computer Science or a related field.
- 6+ years of industry experience in software development.
- Experience with large web crawlers is a plus.
- Strong expertise in large stateful distributed systems and data processing.
- Proficiency in Kubernetes and Infrastructure-as-Code concepts.
- Willingness to try new approaches and technologies.
- Ability to handle multiple tasks and adapt to changing priorities.
- Strong written and verbal communication skills.
Tech Stack
Kubernetes
Categories
AI & MLBackendData Engineering