Lead Data Engineer (H/F)
Ippon Technologiesover 3 years ago
Remote, WorldwideStaff+
Responsibilities
- Develop new data pipelines on client data platforms using sound software development practices.
- Collaborate with business teams, data analysts, and data scientists to industrialize their work through testing, continuous integration, model scalability, and craftsmanship.
- Work with Cloud Builders to construct resilient data assets on cloud infrastructure.
- Provide expertise on evolving data engineering and cloud topics.
- Lead and contribute to internal and external data community events, meetups, webinars, workshops, and knowledge-sharing activities.
- Share knowledge from client engagements and community events through blog articles, experience reports, and internal sessions.
Requirements
- Experience with AWS or GCP is strongly preferred, and active monitoring of cloud topics is required.
- Knowledge of modern data platforms, data warehouses, data lakehouses, cloud-native and serverless architectures is expected.
- Experience with public cloud providers such as AWS, GCP, or Azure.
- Experience with query engines such as Spark, EMR, Databricks, Starburst, or Athena.
- Proficiency in data programming languages such as Python, SQL, or Scala.
- Knowledge of storage technologies such as Redshift, Snowflake, BigQuery, S3, or Cloud Storage.
- Experience with data ingestion or streaming frameworks such as Kafka, Amazon Kinesis, or Google Dataflow.
- Familiarity with visualization tools such as Tableau, Metabase, or Superset.
- Ability to deliver quality code in production environments and agile projects.
- Comfort working in English with international clients.
- Curiosity, initiative, continuous learning, knowledge sharing, and active participation in a data community.
Benefits
- Career development through the Blackbelt program, including training, AWS/GCP/Azure certifications, mentoring, and coaching.
- Career progression tailored to the candidate’s experience and goals.
- Remote-work charter and opportunities to work on remote projects with international clients.
- Opportunity to contribute to Ippon’s Foundation through social and humanitarian initiatives addressing the digital divide.
- Collaborative team environment where employees can contribute their own ideas.
Tech Stack
Amazon RedshiftApache KafkaApache SparkApache SupersetAWSAzureDatabricksGoogle BigQueryGoogle Cloud PlatformMetabasePythonScalaSnowflakeSQL
Categories
Data Engineering