Senior ML Engineer / Data Scientist
Sigma Software7 hours ago
Lviv, UkraineSenior
Responsibilities
- Design and develop self-learning Postlog and Prelog recognition systems using ML and LLM techniques.
- Maintain versioned prompts, evaluation datasets, and few-shot exemplars.
- Implement schema-constrained extraction, grounding strategies, low-confidence fallbacks, confidence scoring, thresholding, and auditability.
- Improve recognition quality, layout and header mapping, prompts, retrieval pipelines, and model behavior.
- Run evaluation pipelines and shadow-mode comparisons against legacy systems and gold datasets.
- Monitor confidence scores, latency, operational quality, infrastructure costs, prompt drift, and model drift in production.
- Develop entity-matching systems for Station, Advertiser, and CreativeID master data.
- Transform human and machine corrections into labeled signals for continuous model improvement.
- Collaborate with Data Engineering teams on ML integration and operationalization.
- Communicate technical findings and recommendations to engineering teams and Customer stakeholders.
Requirements
- At least 5 years of experience in Machine Learning, Data Science, or ML Engineering.
- Experience delivering ML models or LLM-powered systems into production.
- Strong hands-on experience with Large Language Models in real products or pipelines.
- Deep understanding of prompt engineering, prompt versioning, evaluation methodologies, and grounding strategies.
- Experience handling low-confidence scenarios and optimizing cost and latency for LLM systems.
- Strong Python and SQL skills.
- Knowledge of statistics, confidence estimation, sampling, hypothesis testing, and threshold optimization.
- Experience with classification, ranking, matching, or recommendation problems.
- Understanding of offline evaluation metrics, holdout validation, and production monitoring.
- Hands-on experience with AWS cloud services including S3, IAM, CloudWatch, and orchestration services.
- Strong communication and collaboration skills and Upper-Intermediate English level or higher.
- Preferred qualifications include LLM-related certifications, Amazon Bedrock or equivalent enterprise LLM platform experience, Claude/Sonnet-class model experience, Excel or layout extraction experience, confidence calibration, active learning or weak supervision knowledge, cost-aware LLM operations experience, advertising or media domain knowledge, and familiarity with Glue, Airflow, or similar orchestration and data pipeline tools.
Benefits
- Fully remote work across Europe.
- Significant ownership, challenging engineering tasks, and the opportunity to influence production AI systems at scale.
- Opportunities to work on meaningful, high-scale products using modern AI technologies.
Categories
About Sigma Software
Sigma Software is a London-headquartered, privately held IT consultancy that designs and builds custom software for startups and enterprises. The company provides end-to-end services—engineering, web and mobile development, .NET/Java platforms, AR/VR, and UI/UX—delivered via outsourcing, managed teams, and consulting. Founded in 2002, it supports long-term product development and modernization projects across multiple industries for global clients.