about 2 hours ago
Palo Alto, CA, USAMid Level / Senior
H1B Sponsor
Base Salary
$125k - $400k/yr
Responsibilities
- Design, build, and operate production-grade realtime and batch data pipelines.
- Create shared datasets and internal data products for analysis and product performance improvement.
- Prototype and build tooling to automate internal data workflows.
- Ensure data correctness through validation and lead investigations for metric discrepancies.
- Utilize various query engines and frameworks for data processing.
- Collaborate with product and business teams to identify data gaps and prioritize acquisition opportunities.
- Iterate quickly on feedback to deliver efficient and reliable solutions.
Requirements
- 3+ years of professional software engineering experience, preferably in data engineering or distributed systems.
- Hands-on expertise in Python, Rust, Scala, Go, or Java.
- Knowledge of realtime and batch data processing tools like Spark, Kafka, and Flink.
- Experience with RMDBs and NoSQL storage systems.
- Ability to interpret product requirements into engineering plans and communicate effectively across teams.
Benefits
- Base salary ranging from $125,000 to $400,000 USD.
- Equity options as part of the total rewards package.
- Comprehensive medical, vision, and dental coverage.
- Access to a 401(k) retirement plan.
- Short & long-term disability insurance and life insurance.
- Various discounts and perks.
Tech Stack
Categories
AI & MLData Engineering