about 4 hours ago
New York, NY, USA or San Francisco, CA, USA
Senior
Base Salary
$126k - $180k/yr
Responsibilities
- Build and maintain API adapters for Gemini trade data.
- Design and optimize data pipelines for ledger operations.
- Automate ETL (Extract, Transform, Load) processes.
- Optimize SQL queries and database performance.
- Contribute to the next generation of ledger reconciliation processes and reporting.
- Collaborate with third-party vendors, Data Analytics team, and Cryptocore engineers.
- Support data processing for the blockchain reconciliation project.
- Develop and maintain data adapters for real-time data processing.
- Create and implement data validation processes.
- Develop customized reporting solutions.
- Investigate and identify root causes of exception reports.
Requirements
- 5+ years implementing a reconciliation system while improving existing data pipelines.
- Experience building real-time data solutions, data-lake and data warehousing technologies.
- Experience building and integrating web analytics solutions.
- Advanced SQL skills is a must.
- Experience with gRPC, Websocket and REST API.
- Experience and expertise in Databricks, Spark/PySpark, Kafka streaming, Apache Flink, Airflow, Hadoop etc.
- Skilled in programming languages Python, Scala, Rust or Go.
- Experience with one or more MPP databases (Redshift, Timescale, StarRock).
- Able to identify gaps in existing reconciliation processes.
- Extensive ETL and database experience with financial transaction systems for banking and exchange systems.
- Experience with Datadog, Cloudwatch or other alert monitoring systems.
Benefits
- Competitive starting pay.
- A discretionary annual bonus.
- Long-term incentive in the form of a new hire equity grant.
- Comprehensive health plans.
- 401K with company matching.
- Paid Parental Leave.
- Flexible time off.
Tech Stack
Amazon RedshiftApache AirflowApache FlinkApache HadoopApache KafkaApache SparkDatabricksDatadogGogRPCPythonRustScalaSQL
Categories
AI & MLData EngineeringData Science