4 hours ago
Base Salary
$204k - $255k/yr
Responsibilities
- Own end-to-end technical delivery of unstructured AI systems from feature prototype through stable enterprise production.
- Write and review production-grade backend services using Python and FastAPI.
- Build and deploy document-processing systems for large-scale unstructured data environments.
- Integrate diverse enterprise data sources to provide context for AI features.
- Develop and scale full-stack systems that ingest, process, and enrich documents and other unstructured content.
- Collaborate with engineering, product, and sales teams from prototype through rollout.
- Occasionally contribute to modern frontend development.
- Define scope and acceptance criteria for ambiguous projects and ship end-to-end features.
- Drive enterprise-grade AI product features, high-performance data pipelines, and context-engineering capabilities.
Requirements
- Strong proficiency in Python for data processing, API development, and integrations.
- Production experience with Spark or comparable big data frameworks, including tuning and debugging jobs at scale.
- Hands-on experience with LLM-based and AI-driven enrichment such as classification, entity extraction, deduplication, and PII detection.
- Experience shipping tested and reviewed production services rather than notebooks.
- Experience ingesting and processing data from enterprise sources such as SharePoint, OneDrive, Salesforce, and SaaS-based knowledge bases.
- Strong understanding of data pipelines, microservice architecture, and API design.
- Familiarity with metadata systems, data cataloging, or document AI workflows.
- Knowledge of model evaluation best practices and experience with search relevance.
- Ability to independently define ambiguous problems, establish an MVP, document assumptions, and ship solutions.
- Practical agentic engineering experience, including agent loops, guardrails, structured outputs, context management, tests, review gates, and repository conventions.
- Bachelor’s degree or equivalent related working experience.
- Strong communication, stakeholder-management, risk-management, and decision-making skills.
- This position is not eligible for visa sponsorship.
Benefits
- Hybrid role based in New York with at least two days per week in the office.
- Flexible benefits supporting employees and their families, including health coverage and time off.
- Flex Fund monthly stipend.
- Pension/401k plans and equity eligibility for applicable roles.
- Equal opportunity workplace with applicant accommodations available.
Tech Stack
Categories
About Collibra
Collibra is the enterprise AI control plane. Built over eighteen years of ontology engineering, it governs context and control across any data, any model, any agent — for AI leaders who need certainty at the speed of AI. A 5x Forrester Wave Leader and 2x Gartner Magic Quadrant Leader, Collibra serves more than 700 customers — including 78 of the Fortune 500 — and governs more than 2 billion assets. Headquartered in New York City and Brussels, our co-founders Felix Van de Maele and Stijn Christiaens had a vision to help organizations maximize the value of their data and AI programs. Today, Collibra is making that vision a reality.