Senior Data Engineer
The Weather Company7 months ago
Responsibilities
- Design and implement sophisticated software systems using Python, Scala, or Java.
- Develop, deploy, and operate reliable data pipelines, scalable data processing systems, and high-availability cloud architectures.
- Build data integrations using API-based and file-based protocols.
- Apply software engineering practices including source control, testing, continuous integration, and monitoring.
- Work independently and collaboratively across several active projects.
- Lead small data initiatives and projects.
- Mentor junior engineers on routine and less-complex tasks.
- Create concise and clear process documentation.
Requirements
- Bachelor's or Master's degree in a related field, or commensurate experience.
- At least 5 years of experience in computer science and successful project delivery.
- At least 5 years of experience operating and deploying solutions with AWS services including S3, EMR, SQS, SNS, Lambda, Athena, Glue, Kinesis, and MSK.
- At least 5 years of experience with Python, Scala, or Java.
- At least 5 years of experience with SQL.
- At least 5 years of experience with big data technologies such as Cassandra, Spark, Hadoop, Parquet, and Redash.
- Advanced proficiency in test-driven development, unit testing, data integrations, and large-scale cloud solutions.
- Experience with Git or similar version control and CI/CD pipeline patterns.
- Proficiency with alerting and monitoring tools such as Grafana.
- Strong knowledge of data structures, algorithms, functional and object-oriented programming, concurrency, and distributed computing.
- Knowledge of operating with large-scale data and machine learning and data science concepts.
- Strong written and verbal communication skills and the ability to learn new technologies and languages.
Benefits
- Flexible Time Off program.
- Hybrid work model.
- Medical insurance options, including $0 premium employee coverage.
- Benefits effective on day one, including a competitive 401(k) match with no vesting requirement, health, dental, and vision plans.
- Progressive family plan benefits.
- Opportunity to work for a global, industry-leading technology company in a collaborative environment.
Categories
Data Engineering
About The Weather Company
The Weather Company builds weather data platforms, APIs, and decision-support tools for enterprises in media, aviation, energy, retail, and advertising, and runs consumer weather apps and sites. Revenue comes from enterprise subscriptions/licensing and advertising across its digital properties, including The Weather Channel (weather.com) and Weather Underground. It is privately held and headquartered in Brookhaven, Georgia, serving hundreds of enterprise customers and reaching hundreds of millions of monthly users.