SunnyData

Senior Data Engineer

SunnyData
Apply
3 months ago
USA (city not specified)Senior

Responsibilities

  • Support new and existing customers with their data engineering needs.
  • Guide customers in making technical decisions to achieve their goals.
  • Work across multiple customer accounts and track and report delivery progress.
  • Design, build, and operationalize complex data solutions.
  • Correct problems, apply transformations, and recommend data cleansing and quality solutions.
  • Analyze data sources to determine their value and recommend data for analytical processes.
  • Implement data governance, data security, and data quality practices.
  • Collaborate across teams to support delivery and educate end users on data products and analytical environments.
  • Perform data and system analysis, assess defects and incidents, and resolve issues of moderate complexity.
  • Test data movement, transformation code, and data components.

Requirements

  • 5+ years of related experience in data engineering and data product development.
  • Experience with one or more data engineering technologies such as Spark, Hadoop, or Kafka.
  • Experience with the Databricks platform; data engineering or MLOps experience is a bonus.
  • Experience with data science and machine learning technologies such as pandas, scikit-learn, or HPO.
  • Knowledge of data warehousing concepts and technologies including SQL, OLTP, OLAP, and DSS.
  • Solid understanding of the end-to-end data analytics workflow.
  • Demonstrated domain expertise and in-depth knowledge of systems worked on.
  • Proven problem-solving and debugging skills.
  • Strong verbal and written communication skills.
  • Intermediate leadership skills and a track record of self-motivation and identifying growth opportunities.
  • Excellent time management and prioritization skills.
  • Knowledge of AWS, Azure, or GCP is preferred.
  • Databricks Certification is a preferred qualification.
  • Bachelor’s degree in a STEM-related field or equivalent experience.

Benefits

  • Health insurance coverage for eligible employees and family members begins on the first day of employment.
  • At least 15 days of paid time off annually plus nine paid company holidays.
  • Opportunities for professional development, career advancement, and growth in technical and people skills.
  • Opportunities to lead teams on complex, innovative customer projects.
  • Collaborative culture focused on knowledge sharing.
  • Performance-based cash incentive awards are available in addition to the comprehensive compensation and benefits program.

Tech Stack

Apache HadoopApache KafkaApache SparkAWSAzureDatabricksGoogle Cloud PlatformPandasscikit-learnSQL

Categories

Solutions Engineering
SunnyData

About SunnyData

51-200 employees

SunnyData is an IT services firm focused on migrating, modernizing, and scaling data platforms on Databricks for enterprise clients. It provides data engineering, governance, and AI/ML enablement services across regulated and data-driven sectors such as financial services, healthcare, retail, and manufacturing. The privately held company is headquartered in Minneapolis, with delivery teams operating from the U.S. and Latin America, and serves as a Databricks partner.

Contact me