8 months ago
Remote, United StatesSenior
Base Salary
$160k - $195k/yr
Responsibilities
- Design and build batch and streaming data pipelines for data ingestion, ML feature engineering, and analytics.
- Own end-to-end delivery of complex data initiatives, including architecture, implementation, testing, deployment, monitoring, and documentation.
- Develop and evolve a cloud-native data platform for large-scale data processing.
- Automate data validation, quality checks, alerting, backfills, and recovery workflows.
- Optimize the cost, performance, and reliability of data workloads.
- Partner with Data Science, Product, and Engineering stakeholders to translate requirements into technical solutions.
- Evaluate and adopt new processing engines, storage formats, orchestration tools, and GenAI-assisted ingestion approaches.
Requirements
- 5+ years of hands-on data engineering experience building and maintaining production-grade data platforms and pipelines.
- Strong programming skills in Python or Scala and SQL for data analytics.
- Deep experience with distributed data processing frameworks such as Apache Spark, including performance tuning and optimization.
- Production data solutions experience using AWS services such as EMR, Lambda, and S3.
- Strong understanding of data modeling, data warehousing, partitioning, and schema design for large-scale datasets.
- Experience operating production pipelines, including monitoring, alerting, incident response, and reliability improvements.
- Knowledge of software engineering practices including version control, CI/CD, testing strategies, and code review.
- Strong communication and collaboration skills with technical and non-technical stakeholders.
- Preferred experience with Kafka, Kinesis, Airflow, Step Functions, Data Lakehouse, Data Mesh, large-scale data sharing, prompt engineering, and Large Language Models.
- Experience mentoring engineers and contributing to engineering-wide standards and best practices is preferred.
Tech Stack
Categories
Data Engineering
About Socure
Socure builds an AI-driven digital identity verification and fraud prevention platform used by banks, fintechs, e-commerce, telecom, healthcare, and government agencies to automate KYC/AML, document verification, and risk decisioning. It sells enterprise APIs and workflows for onboarding, authentication, and payments fraud mitigation. Founded in 2012 and headquartered in Incline Village, Nevada, Socure is privately held and operates across regulated and high-volume digital markets.