Staff Software Engineer - Data Engineering
Trend Micro1 day ago
Responsibilities
- Design and build the Vision One Data Platform, including ingestion, replication, transformation, governance, discovery, and serving capabilities.
- Build scalable data pipelines and CDC architectures using Datastream and similar streaming or replication technologies.
- Enable governed self-service dbt transformation, modeling, testing, documentation, and data exposure across OLTP sources.
- Design data extraction and replication patterns for OLTP and distributed SQL databases into analytical and downstream systems.
- Build data catalog, metadata, semantic discovery, lineage, observability, freshness monitoring, schema evolution, and data quality capabilities.
- Establish governance standards for ownership, access control, retention, lifecycle management, and source-of-truth architecture.
- Develop reusable data platform primitives and APIs for self-service consumption by product teams.
- Partner with security and platform teams on fine-grained data access controls.
- Provide architectural guidance, mentorship, and technical leadership across data engineering and product engineering teams.
- Drive standards for reliability, scalability, performance, cost efficiency, and operational excellence.
Requirements
- 8+ years of experience in data engineering, distributed systems, backend engineering, or a related field.
- Strong experience designing and building large-scale data platforms and data pipelines.
- Deep understanding of OLTP and OLAP architectures and their tradeoffs.
- Hands-on experience with CDC, data replication, and streaming architectures.
- Strong SQL expertise and experience with relational databases at scale.
- Experience with distributed SQL databases such as YugabyteDB, CockroachDB, Spanner, or similar technologies.
- Experience building data transformation workflows with dbt or similar frameworks.
- Experience with modern analytical and data platforms such as Databricks, Spark, Trino, Snowflake, BigQuery, or equivalent.
- Strong understanding of metadata, lineage, data quality, ownership, access control, and data catalogs.
- Experience designing self-service data consumption and transformation systems.
- Strong software engineering fundamentals, including API design, testing, CI/CD, observability, and production operations.
- Ability to influence architecture and engineering standards across organizational boundaries without relying solely on formal authority.
- Preferred experience with Datastream, Debezium, Kafka, YugabyteDB, CockroachDB, Databricks, data catalogs, semantic layers, knowledge graphs, ontology-driven discovery, data mesh, data products, fine-grained authorization, and high-volume telemetry or security data.
- Preferred experience balancing data quality, query performance, platform reliability, and infrastructure cost.
Benefits
- Comprehensive medical, dental, and vision insurance, life insurance, short- and long-term disability, and mental health wellness support.
- Pre-partum, maternity, parental, medical, and paid time off leave programs, plus 14 annual holidays.
- Adoption assistance, wellness incentive, pet insurance, 401(k) with company match, tuition assistance, and employee resource groups.
- Competitive compensation with a performance-based bonus opportunity and ongoing learning opportunities.
- Work-life balance, team activities, and an equity, inclusion, and collaboration-focused culture.
Tech Stack
Categories
Data Engineering
About Trend Micro
Trend Micro builds cybersecurity software and cloud services for enterprises, governments, and consumers, including endpoint, network, email, and cloud workload protection unified in the Trend Vision One platform. The company sells subscriptions and licenses with managed threat detection and response. Founded in 1988 and headquartered in Tokyo, it is a public company on the Tokyo Stock Exchange with global operations and longstanding partnerships with major cloud providers.