2 months ago
Base Salary
$204k - $255k/yr
Responsibilities
- Own end-to-end technical delivery of unstructured AI systems from feature prototype through stable enterprise production.
- Write and review production-grade backend services using Python and FastAPI.
- Build and deploy document-processing systems for large-scale unstructured data environments.
- Integrate diverse enterprise data sources to provide context for AI features.
- Develop and scale full-stack systems that ingest, process, and enrich documents and other unstructured content.
- Collaborate with engineering, product, and sales teams from prototype through rollout.
- Occasionally contribute to modern frontend development.
- Define scope and acceptance criteria for ambiguous projects and ship end-to-end features.
- Drive enterprise-grade AI product features, high-performance data pipelines, and context-engineering capabilities.
Requirements
- Strong proficiency in Python for data processing, API development, and integrations.
- Production experience with Spark or comparable big data frameworks, including tuning and debugging jobs at scale.
- Hands-on experience with LLM-based and AI-driven enrichment such as classification, entity extraction, deduplication, and PII detection.
- Experience shipping tested and reviewed production services rather than notebooks.
- Experience ingesting and processing data from enterprise sources such as SharePoint, OneDrive, Salesforce, and SaaS-based knowledge bases.
- Strong understanding of data pipelines, microservice architecture, and API design.
- Familiarity with metadata systems, data cataloging, or document AI workflows.
- Knowledge of model evaluation best practices and experience with search relevance.
- Ability to independently define ambiguous problems, establish an MVP, document assumptions, and ship solutions.
- Practical agentic engineering experience, including agent loops, guardrails, structured outputs, context management, tests, review gates, and repository conventions.
- Bachelor’s degree or equivalent related working experience.
- Strong communication, stakeholder-management, risk-management, and decision-making skills.
- This position is not eligible for visa sponsorship.
Benefits
- Hybrid role based in New York with at least two days per week in the office.
- Flexible benefits supporting employees and their families, including health coverage and time off.
- Flex Fund monthly stipend.
- Pension/401k plans and equity eligibility for applicable roles.
- Equal opportunity workplace with applicant accommodations available.
Tech Stack
Categories
About Collibra
Collibra builds a cloud-based Data Intelligence Platform for enterprises to govern, catalog, and ensure the quality and privacy of data used across analytics and AI. It sells subscription software with professional services to accelerate adoption by data, governance, and compliance teams. Founded in 2008 and headquartered in New York, Collibra is privately held and reports serving 700+ customers, including dozens of Fortune 500 companies.