3 hours ago
Responsibilities
- Build and maintain integrations with ERPs, data warehouses, object storage, FTP sources, and custom systems.
- Design reliable near-real-time data synchronization workflows handling millions of records per customer.
- Investigate external API behavior and build connectors for undocumented real-world data issues.
- Develop round-trip tests covering read, update, and write workflows to prevent data loss.
- Validate and reconcile data before errors affect customer operations.
- Build monitoring, structured logging, sync tracking, and alerts to identify and triage failures.
- Work with customer operators and IT teams to scope, deliver, and operate integrations end to end.
- Improve the integration layer so new data sources can be added through configuration where possible.
Requirements
- At least 3 years of experience shipping production data pipelines and integrations in Python.
- Hands-on experience with FastAPI, SQLAlchemy, and Pydantic.
- Strong experience integrating third-party systems through REST, SOAP, and query-language APIs, including OAuth, pagination, rate limits, and credential management.
- Advanced SQL skills, including high-performance queries and bulk upserts at large scale.
- Experience designing idempotent, auditable pipelines with fetch, validate, normalize, and upsert workflows.
- Experience with data warehouses such as Snowflake, Databricks, or BigQuery.
- Experience with background task orchestration tools such as Temporal or similar.
- Experience building safe write paths with dry runs, failure capture, auditability, operational logging, and alerting.
- Experience with unstructured data, AWS, or legacy ERP integrations is helpful.
Benefits
- Visa sponsorship is available.
- On-site work in New York, United States.