3 months ago
Palo Alto, CA, USAMid Level
H1B sponsor
Base Salary
$180k - $440k/yr
Responsibilities
- Design, implement, and optimize end-to-end data pipelines for high-volume datasets using Spark, Kafka, Flink, and related tools.
- Develop quantitative models and statistical frameworks for experimentation, forecasting, and performance measurement.
- Build and maintain data infrastructure supporting data quality, consistency, accessibility, and analytical workflows.
- Translate business requirements into production-grade data systems and insights with product engineering, product, and operations teams.
- Conduct A/B tests, causal analysis, and performance evaluations to improve key metrics.
- Implement monitoring, alerting, and automation for data systems supporting real-time decision-making.
- Mentor team members on scalable data engineering and quantitative problem-solving best practices.
Requirements
- At least 4 years of experience building production data pipelines and infrastructure at scale.
- Strong proficiency in Python, SQL, and distributed computing frameworks such as Spark, Flink, or Hadoop.
- Expertise in statistical methods, predictive modeling, hypothesis testing, and experimental design.
- Understanding of cloud services for data storage, processing, and orchestration.
- Bachelor's or master's degree in Computer Science, Statistics, Applied Mathematics, or a related quantitative field.
- Excellent problem-solving skills focused on delivering business impact through reliable systems.
- Preferred experience in consumer technology or social media domains.
- Preferred experience with real-time streaming systems and low-latency data processing.
- Contributions to open-source data tools or publications on large-scale analytics systems are preferred.
- A track record of reducing operational costs or improving system efficiency through data optimizations is preferred.
- Ability to bridge engineering excellence with rigorous analytical approaches.
Benefits
- Base salary range of $180,000-$440,000 USD.
- Equity, comprehensive medical, vision, and dental coverage.
- Access to a 401(k) retirement plan.
- Short- and long-term disability insurance, life insurance, discounts, and other perks.
Tech Stack
Categories
Data Engineering
About xAI
Understand the Universe. We are a team of AI technologists and business leaders on a mission to build AI systems that can help humanity understand the world better. https://x.ai/careers