14 hours ago
Base Salary
$129k - $180k/yr
Responsibilities
- Lead assigned engineering projects by defining solutions, timelines, documentation, and technical direction.
- Conduct design and code reviews and provide feedback on proposed solutions.
- Troubleshoot business and production issues, perform root cause analysis, and coordinate resolutions.
- Lead project discovery by translating requirements into technical solutions and developing code.
- Design and implement ETL processes and distributed data-processing solutions.
- Develop Spark applications in Scala and Python, Hive/SQL scripts, Airflow scripts, and Scala REST APIs.
- Work with Hadoop, Elasticsearch, databases, and distributed file formats for large-scale and real-time data processing.
- Develop Jenkins and Git CI/CD pipelines to automate development workflows.
- Coordinate with project managers, stakeholders, support teams, and cross-functional partners to ensure timely delivery.
Requirements
- Master’s degree or equivalent in Computer Science, Information Technology, Engineering, or a related field plus two years of software engineering or related experience; or bachelor’s degree or equivalent plus five years of such experience.
- Experience coding in Spark using Scala and Python.
- Experience developing Hive/SQL scripts and using Spark SQL and DataFrames for distributed data processing.
- Experience designing and implementing ETL processes and working with RDBMS and NoSQL databases.
- Experience working with Avro, Parquet, and ORC file formats in Hadoop.
- Experience developing Python scripts in Apache Airflow.
- Experience integrating Elasticsearch and Apache Spark for real-time data indexing and analysis.
- Experience developing and optimizing Hadoop components for distributed storage and large-scale data processing.
- Experience implementing Jenkins and Git CI/CD pipelines.
- Experience developing REST APIs on Scala.
- The employer will accept any amount of experience with the required skills.
Benefits
- Medical, vision, and dental coverage.
- 401(k), stock purchase plan, and company-paid life insurance.
- Paid time off including sick leave, parental leave, family care leave, bereavement, jury duty, and voting leave.
- Short-term and long-term disability benefits.
- Education assistance, including 100% company-paid college degrees.
- Company discounts, military service pay, adoption expense reimbursement, and performance-based incentive awards.
- On-site role at 811 Excellence Dr, Bentonville, Arkansas.
Tech Stack
Categories
Data Engineering
About Walmart
Walmart is a global omnichannel retailer that sells groceries, general merchandise, and services through Walmart and Sam's Club stores and online marketplaces for consumers and small businesses. Its model spans physical retail, e-commerce, advertising, and a vast supply chain, plus pharmacy, health, and financial services. Founded in 1962 and headquartered in Bentonville, Arkansas, Walmart Inc. is a public company on the NYSE (WMT) operating in the U.S. and multiple international markets.