3 months ago
Austin, TX, USA +3 moreMid Level / Senior
Base Salary
$132k - $165k/yr
Responsibilities
- Deploy and monitor classical NLP, embedding, and LLM-powered ML systems processing millions of records per day.
- Own evaluation infrastructure including golden datasets, model-as-a-judge frameworks, inter-annotator agreement, and release-gating regression tests.
- Build and maintain vector embedding, retrieval, classification, and similarity systems.
- Partner with Data Science on annotation workflows, PII scrubbing, and ground-truth pipelines.
- Improve MLOps foundations through versioning, observability, and drift detection.
- Translate product problems into measurable AI features with clear success criteria.
Requirements
- 4–7 years of professional software or ML engineering experience, including 2+ years shipping ML systems to production.
- Strong Python skills and comfort with the modern data and ML stack.
- Hands-on experience deploying and monitoring models in AWS or GCP.
- Production experience with NLP or ML systems involving classification, NER, embeddings, ranking, similarity, or LLM-powered features.
- Practical experience evaluating ML or LLM systems using golden datasets, model-as-a-judge methods, inter-annotator agreement, precision/recall, or equivalent approaches.
- Ability to collaborate with data scientists and engineers and explain technical ideas and tradeoffs to non-technical stakeholders.
- Preferred experience with vector databases or retrieval systems at scale; managed ML services such as SageMaker or Vertex AI; annotation tools such as Label Studio or Scale AI; PII scrubbing and privacy-by-design data handling; or open-source, blog, or speaking contributions on LLM or embedding production work.
Benefits
- Flexible work model combining in-person and remote work.
- 15 days of vacation, floating and set holidays, wellness allowance, and paid parental leave.
- Medical, dental, vision, life, and disability insurance.
- 401k plan for USA-based employees.
- Learning platform, training, and work tools from the first day.
- Surprise meal stipends and a work-from-home stipend.
- Global, collaborative, and inclusive work environment.
Tech Stack
Categories
About CreatorIQ
CreatorIQ is the operating system for creator-led growth. Trusted by more than 1,300 global brands and agencies—including Burson, Delta Air Lines, Google, LVMH, Nestlé, and Sephora—CreatorIQ unifies creator marketing across paid, owned, earned, commerce, and community into one seamless, enterprise-grade ecosystem. Powered by the Creator Graph™, CreatorIQ’s industry-leading intelligence infrastructure, along with rigorous compliance and security standards, and integrations with Meta, Snapchat, TikTok, YouTube, and more, CreatorIQ empowers brands and agencies to harness the creator economy as a strategic growth engine.