8 hours ago
Base Salary
$207k - $274k/yr
Responsibilities
- Own the architecture and multi-year technical strategy for Twilio’s data platform, including lake and lakehouse systems, ClickHouse, Elasticsearch, governance, and migration paths.
- Document major architecture decisions covering storage, open table formats, catalog strategy, compute engines, tenancy, data placement, and build-versus-adopt tradeoffs.
- Define reference architectures for deploying, tuning, scaling, operating, upgrading, and isolating shared storage and query platforms.
- Establish reliability models covering availability targets, failure domains, disaster recovery, observability, and incident response.
- Design privacy and compliance capabilities for deletion, retention, data residency, PII classification, backups, and derived datasets.
- Drive data governance covering classification, metadata, lineage, access control, data contracts, quality, and integrity standards.
- Review technical designs across the organization and serve as an escalation point for distributed-systems and performance problems.
- Mentor principal and senior engineers and raise architectural and engineering standards across teams.
- Partner with product, security, infrastructure, and consuming teams to shape platform roadmaps and technical tradeoffs.
- Evaluate emerging data technologies through prototypes or benchmarks and recommend worthwhile adoption.
Requirements
- Bachelor’s or master’s degree in computer science, engineering, or a related field, or equivalent practical experience.
- 15+ years of experience in software development or a related field, including at least 8 years in architecture or senior technical leadership.
- Track record of architecting and delivering large-scale data platforms on cloud infrastructure such as AWS using Kubernetes, Terraform, and Helm.
- Deep expertise in analytical storage and compute, including columnar and open table formats, lakehouse architecture, partitioning, indexing, query planning, and petabyte-scale cost and performance.
- Hands-on depth in at least two of analytical/OLAP engines, search engines, and lake or distributed processing engines.
- Working knowledge of streaming systems and downstream storage interactions.
- Practical experience designing data governance, metadata and catalog systems, lineage, and integrated access control at scale.
- Practical experience implementing deletion, retention, and data residency requirements across heterogeneous data estates.
- Proficiency in one or more of Python, Java, and Go.
- Experience driving architecture decisions across multiple teams through influence and changing organizational technical roadmaps.
- Experience elevating engineering standards and mentoring senior engineers across teams.
- Experience architecting for high availability, observability, and incident response in distributed systems.
- Strong written and verbal communication skills for explaining complex tradeoffs to engineers and senior leadership.
- Preferred experience operating ClickHouse or Elasticsearch at scale, including replication, sharding, ingestion, and multi-tenant isolation.
- Preferred experience with Unity Catalog, Glue, Polaris, DataHub, open table catalog strategies, platform migrations, large-scale cost optimization, networking, and network security.
Benefits
- Remote role based in the United States, with occasional travel for project or team in-person meetings and possible ad-hoc in-person gatherings or customer meetings.
- Competitive pay, generous time off, parental and wellness leave, healthcare, retirement savings, paid sick time, paid personal time off, and paid parental leave.
- Potential eligibility for Twilio’s equity plan and corporate bonus plan.
- Applications are intended to be accepted until January 4, 2027, subject to change based on business needs.
Tech Stack
Categories
Data Engineering
About Twilio
Twilio builds a cloud customer-engagement platform centered on programmable communications APIs for SMS, voice, WhatsApp, email, and verification, plus Segment CDP and the Flex contact center. It sells usage-based and subscription SaaS to developers and enterprises to embed messaging, calling, authentication, and data-driven marketing into apps. Founded in 2008 and headquartered in San Francisco, Twilio is a public company listed on the NYSE.