Senior Data Engineer
Buyers Edge Platform, LLC2 months ago
Remote, United StatesSenior
Responsibilities
- Own the primary SQL Server relational database platform, including schemas, performance tuning, stored procedures, indexing, lifecycle management, and execution-plan analysis.
- Architect, build, and maintain ETL/ELT data pipelines, including orchestration, scheduling, error handling, recovery, validation, reconciliation, and monitoring.
- Design data models, schemas, data contracts, lineage, metadata, and documentation for application, product, analytics, and reporting consumers.
- Manage schema-change deployments, migration scripts, release coordination, backup strategy, disaster recovery, and restore procedures across environments.
- Implement data governance and security practices covering PII, role-based access controls, audit logging, and encryption at rest and in transit.
- Evaluate and recommend data-platform tools, frameworks, and technologies for continuous improvement.
- Mentor engineers and analysts through code reviews, pair programming, knowledge sharing, and guidance on SQL and pipeline design.
- Champion engineering standards and collaborate with software engineering, product, and analytics teams on technical direction.
Requirements
- At least 5 years of data engineering experience, including relational databases, APIs, batch and streaming patterns, and cloud data platforms.
- At least 3 years of data-modeling experience, including data lineage and metadata documentation.
- Expert proficiency with relational databases, complex production stored procedures, query optimization, indexing strategies, and execution-plan analysis.
- Experience designing end-to-end data flows and building or maintaining pipeline orchestration and scheduling solutions.
- Proficiency in Python, JavaScript, or a similar scripting language for pipeline tooling and automation.
- Experience with Git-based workflows, pull-request development, and versioned schema migrations.
- Ability to implement data-quality validation, reconciliation, and monitoring at pipeline boundaries.
- Strong communication skills and the ability to translate data issues into business impact while partnering with analysts and product teams.
- Ability to work independently with minimal oversight and drive projects from requirements through delivery.
- Bachelor's degree in Computer Science, Information Systems, or a related field, or 5+ years of equivalent software engineering experience.
- Knowledge of embeddings, vector databases, document chunking, semantic retrieval, and knowledge-base creation.
- Experience developing and maintaining pipelines, building ontologies, and working with Snowflake, Redshift, or Databricks.
Benefits
- Medical, dental, vision, FSA, company-paid life insurance, and other benefits from day one.
- 401(k) with company match.
- Training and development opportunities with competitive pay.
- Flexible PTO with no accrual requirement.
- The role is based in the Becker, Minnesota office; the posting describes the broader software-development leadership role as hybrid.
- The company is committed to an inclusive and equal-opportunity workplace.
Tech Stack
Categories
Data Engineering
About Buyers Edge Platform, LLC
Buyers Edge Platform, LLC builds a digital procurement network and SaaS tools that help foodservice operators, distributors, and manufacturers manage purchasing, rebates, pricing, and supply-chain visibility. Its portfolio spans group purchasing, fresh-produce and supply-chain services, and software such as ArrowStream for supply chain intelligence, sold on a subscription and network-participation basis. Founded in 1998 and headquartered in Waltham, Massachusetts, it is privately held and received new private-equity backing in 2024.