17 hours ago
Responsibilities
- Build and maintain integrations with ERP systems, cloud data warehouses, object storage, and custom data sources.
- Design reliable near-real-time synchronization processes for large customer datasets.
- Investigate third-party APIs and develop resilient connectors that handle undocumented behavior, pagination, rate limits, authentication, and other limitations.
- Create round-trip tests for read, update, and write workflows to prevent data loss.
- Validate and reconcile data, and build structured logging, monitoring, alerting, sync tracking, and failure attribution.
- Work directly with customers and their IT teams to scope, deliver, and operate integrations.
- Develop a configurable integration layer that enables new data sources to be added with minimal manual work.
Requirements
- At least 3 years of production experience building Python data pipelines and integrations.
- Hands-on experience with Python, FastAPI, SQLAlchemy, and Pydantic.
- Deep experience integrating third-party systems through REST, SOAP, and query-language APIs, including OAuth, credential management, pagination, and rate limits.
- Advanced SQL skills, including high-performance queries and bulk upserts at scale.
- Experience designing idempotent, auditable pipelines and safe write paths with dry runs and failure capture.
- Experience with structured logging, synchronization tracking, alerting, and failure attribution.
- Experience with Snowflake, Databricks, or BigQuery.
- Experience with a background task orchestration framework such as Temporal or similar.
- Familiarity with ERP integrations, NetSuite, AWS, FTP, S3, or unstructured data ingestion is a plus.
Benefits
- Visa sponsorship is available.
- The role is on-site in New York, United States.