Principal Software Engineer, Data Infrastructure
LendingClub6 days ago
Base Salary
$197k - $230k/yr
Responsibilities
- Own the architecture and technical vision for a declarative, configuration-driven ingestion framework supporting relational databases and object-store files.
- Design and implement reusable, versioned libraries for policy-driven data protection, anonymization, tokenization, governed access, audit trails, and secure-by-default behavior.
- Define infrastructure-as-code, deployment, rollback, replacement, lifecycle management, compute, cost, and sizing standards for large-scale data platforms.
- Establish monitoring, alerting, reconciliation, recovery, validation, and observability capabilities for reliable source-to-destination operations.
- Conduct measurable proofs of concept, document architectural decisions and tradeoffs, and work with technology vendors to resolve product gaps.
- Translate ambiguous technical challenges into requirements, interfaces, dependencies, and phased delivery plans while partnering with data, governance, security, DBA, and source-system teams.
- Mentor senior and staff engineers, lead technical design and code reviews, and establish standards for testing, documentation, release management, and maintainability.
Requirements
- 10+ years of software or data platform engineering experience designing and delivering platform-level frameworks, libraries, or infrastructure used across multiple engineering teams.
- Bachelor's degree or higher, or an equivalent combination of education and experience.
- Strong infrastructure-as-code experience, including Terraform and deployment pipelines for data platforms.
- Deep experience building ingestion capabilities across relational databases, files, APIs, and custom systems, including incremental processing, change data capture, schema evolution, and source-system load protection.
- Advanced programming skills in Python, SQL, and Scala or Java, including Spark UDFs and reusable libraries with strong testing, packaging, and versioning practices.
- Advanced hands-on experience with Databricks, including Delta Lake, Unity Catalog, Auto Loader, workflows, compute configuration, and governance capabilities, or equivalent data platform experience.
- Strong knowledge of security and privacy engineering for sensitive data, including encryption, key management, tokenization or format-preserving techniques, role-based access controls, and audit logging.
- Experience designing and operating large-scale data systems processing billions of rows, including performance testing, cost optimization, monitoring, and recovery strategies.
- Excellent written and verbal communication skills, with the ability to create technical designs, architecture decision records, interface contracts, and documentation while influencing senior stakeholders without direct authority.
- Experience applying AI tools to architecture, development, testing, and complex engineering problem-solving while maintaining sound judgment regarding security, accuracy, maintainability, and human oversight.
- Preferred qualifications include experience in banking, lending, or regulated environments; model risk management or SOX; data quality, lineage, catalog tooling, or data contracts; prior Principal or Staff Engineer experience; and Databricks Asset Bundles or equivalent deployment tooling.
Benefits
- Hybrid San Francisco work arrangement with required in-office attendance Tuesdays, Wednesdays, and Thursdays; remote placement is not considered.
- Relocation support may be available based on actual job level.
- Local Pacific Time working hours are expected, with flexibility across time zones when necessary.
- Travel to Happen Bank offices or other locations may be required as needed.
- Benefits include medical, dental, and vision plans, 401(k) matching, health and wellness programs, flexible time off for salaried employees, and up to 16 weeks of paid parental leave.
- The role may include eligibility for long-term awards and an annual bonus.
Tech Stack
Categories
Data Engineering
About LendingClub
LendingClub is now Happen Bank — a name that reflects who we are today and why we exist. While our name, logo, and visual identity are changing, the company, our products and services, and core values remain the same. To learn more about us, please visit https://www.linkedin.com/company/happen-bank/.