Data Engineer – Applied ML
Similarweb1 month ago
Tel Aviv-Yafo, IsraelMid Level
Responsibilities
- Design and build LLM-powered and ML-based pipelines for classifying, normalizing, structuring, and matching product, brand, and category data.
- Build agentic workflows with LangGraph or similar frameworks to automate complex data tasks end to end.
- Choose among LLMs, embeddings, fine-tuned models, classical classifiers, and rules while balancing accuracy, cost, and latency.
- Scale solutions across billions of records using Spark, Databricks, and cloud infrastructure.
- Build evaluation frameworks, ground-truth datasets, labeling processes, quality metrics, and ongoing monitoring.
- Take solutions from proof of concept to production and own them after launch.
- Collaborate with Product and cross-functional R&D teams to define requirements, shape the roadmap, and establish infrastructure and engineering best practices.
Requirements
- Bachelor's or master's degree in Computer Science, Data Science, Mathematics, or a relevant field.
- At least 4 years of hands-on experience as a data engineer, ML engineer, or data scientist with production solutions.
- Strong Python skills and experience writing production-quality code.
- Hands-on experience building LLM-based applications in production, including prompt engineering, structured outputs, RAG, embeddings, and evaluation.
- Experience with LLM provider APIs such as OpenAI and Anthropic, LangGraph or LangChain, Hugging Face, and vector stores.
- Knowledge of classical and modern text classification and NLP methods.
- Experience processing large-scale data with Spark, PySpark, Databricks, or similar technologies on AWS or another cloud.
- Understanding of evaluation and data quality, including precision/recall trade-offs, ground-truth construction, and error analysis.
- Clear communication skills and a pragmatic, delivery-focused approach to ambiguity and stakeholder collaboration.
- Experience with taxonomies, entity resolution, or product and e-commerce data is advantageous.
- Experience fine-tuning or deploying open-source models is advantageous.
Benefits
- Partially remote work with in-office collaboration.
- Competitive compensation packages and perks and benefits.
- Regular team outings and happy hours.
- Career development opportunities including Career Week, personalized coaching, and ongoing learning solutions.
- An inclusive workplace focused on diversity, equality, and mutual respect.
Tech Stack
Categories
Data EngineeringML Engineering
About Similarweb
Similarweb builds a digital intelligence platform that measures web and app traffic to inform marketing, e-commerce, sales, and investor decisions. It sells subscription-based analytics, research, and APIs spanning market share, audience behavior, benchmarking, and competitive insights for enterprises and agencies. Founded in 2009 and headquartered in New York, Similarweb is a public company on the NYSE (SMWB) and serves customers such as Google, eBay, and Adidas.