7 months ago
Responsibilities
- Develop, maintain, and optimize scalable data pipelines, backend services, and APIs for recommendations, content discovery, groups, and events.
- Design data models and schemas for analytical workloads and real-time recommendation systems.
- Collaborate with data scientists, product managers, and engineers to capture, process, and make data available for user experiences.
- Implement and maintain large-scale data processing jobs using technologies such as Spark and Kafka.
- Advance personalization capabilities from heuristics toward more sophisticated data-backed recommendation systems.
- Design and implement backend systems including APIs, caching systems, queueing systems, and cloud orchestration.
- Respond occasionally to outages and production issues.
Requirements
- At least 3 years of software engineering experience focused on data engineering and scalable backend systems for SaaS products or online platforms.
- Production experience building and optimizing data pipelines using ETL/ELT techniques.
- Strong SQL skills and experience optimizing databases for analytical queries and high-throughput real-time access.
- Experience with big-data technologies such as Spark, Hadoop, Beam, or Kafka.
- Experience operating cloud systems at scale using AWS or Google Cloud.
- Ability to work with technologies such as Python, JavaScript/Node.js, Mongo, and Redis.
- Experience with Elasticsearch, data warehousing, and machine-learning systems.
- Experience with content discovery or recommendation systems is a bonus.
- Experience with social networks, social graphs, user-generated content, consumer products, e-commerce, or two-sided marketplaces is a bonus.
- Interest in online communities, VR, or VRChat is a bonus.
- Ability to work collaboratively and communicate effectively in a remote, cross-functional environment.
Benefits
- 100% remote work from anywhere with flexible working hours and core collaboration hours.
- Health benefits.
- 401K for US employees and Group RRSP for Canadian employees.
- Stock options.
- Generous paid holiday schedule.
- Unlimited/flexible vacation time.
- Paid parental leave benefits.
Tech Stack
Apache BeamApache HadoopApache KafkaApache SparkAWSElasticsearchFastAPIGoogle CloudJavaScriptMongoDBNode.jsPythonRedisSnowflakeSQL
Categories
Data EngineeringML Engineering
