AI Data Engineer - AI Training data
Blueprint TechnologiesBase Salary
$150k - $160k/yr
Responsibilities
- Design, develop, maintain, and optimize Python-based pipelines for large-scale data ingestion, processing, and transformation.
- Build datasets from structured and unstructured raw data through collection, organization, cleaning, validation, and preparation.
- Develop OCR, text extraction, normalization, filtering, segmentation, deduplication, tokenization, and standardized-format conversion workflows.
- Execute and monitor large-scale batch jobs, troubleshoot failures, and implement automated retry and recovery mechanisms.
- Create automated data quality checks for missing or corrupted files, incomplete outputs, duplicate records, formatting issues, and metadata inconsistencies.
- Manage bulk data transfers and synchronization between local processing environments and Azure storage platforms.
- Maintain dataset naming conventions, metadata, version control, source traceability, security, and governance.
- Optimize processing performance, memory usage, storage efficiency, reliability, scalability, and cloud resource consumption.
- Monitor dataset statistics, processing coverage, quality metrics, exceptions, and operational reporting.
- Collaborate with applied scientists and engineering teams to translate AI training requirements into scalable data workflows.
- Maintain documented, tested, and version-controlled code.
Requirements
- 5+ years of professional experience in data engineering, data pipeline development, or data science with substantial hands-on programming responsibilities.
- Strong proficiency in Python, including reusable modules, debugging, testing, logging, and error handling.
- Demonstrated experience building datasets from scratch through ingestion, cleaning, transformation, validation, and preparation.
- Experience processing large-scale structured and unstructured datasets using memory-efficient, parallel, or distributed techniques.
- Hands-on experience with Azure Blob Storage or Azure Data Lake Storage, including bulk transfers, storage organization, and access troubleshooting.
- Experience with Python data-processing libraries and formats including pandas, NumPy, JSON/JSONL, CSV, and Parquet.
- Working knowledge of SQL, Git, Linux environments, and command-line tools.
- Strong troubleshooting, analytical, and problem-solving skills focused on data quality and integrity.
- Ability to communicate technical challenges and collaborate with engineering and data science teams.
- Preferred: experience with OCR pipelines, scanned documents, multilingual text, document-layout data, Azure Databricks, Azure Machine Learning, Azure Data Factory, workflow orchestration, Hugging Face Datasets, AI/ML tokenization, near-duplicate detection, training/evaluation data separation, PySpark, dataset lineage, reproducibility, containerized environments, and CI/CD practices.
Benefits
- Medical, dental, and vision coverage.
- Flexible Spending Account.
- 401(k) retirement plan.
- Competitive paid time off.
- Parental leave.
- Professional growth and development opportunities.
- Five days onsite per week in Seattle, Washington.
- Benefits and eligibility may vary based on role, employment status, and location.
About Blueprint Technologies
Blueprint Technologies is a premier consulting house that pioneers in providing SAP solutions. Our mission is to provide the best solutions to our customers with a high emphasis on ethics at the highest levels. Our team of motivated and experienced consultants strives hard to provide innovative ways to explore all the features offered by SAP and Kronos at an affordable cost to maximize the return on investment. Blueprint Technologies provide end-to-end ERP Solutions in SAP, SAP CX, SAP Analytics Cloud, SuccessFactors, Concur, Qualtrics, and Kronos products for a wide range of industries including manufacturing, distribution, process, offshore, FMCG, pharma, chemical, and professional services. An innovative, award-winning, knowledge-driven decade-old company providing end-to-end integrated ERP solutions in SAP & Kronos. The company was established by a team of passionate and experienced professionals to provide end-to-end ERP Solutions in SAP (On-premise & Cloud), SAP BI/BO, and Kronos.