Compiler Frontend Engineer
Normal Computing CorporationResponsibilities
- Bring up frontend and mid-level compiler support for new LLM architectures, including attention variants and MoE routing schemes.
- Extend IR, operators, and lowering passes to represent new architectural primitives accurately.
- Implement support for model quantization schemes and numeric formats while preserving accuracy.
- Track the LLM architecture landscape and recommend future model bring-up priorities.
- Develop test coverage for compiler correctness and hand lowered programs to backend compiler engineers.
- Collaborate with LLM serving engineers to take models from compiler support through serving.
- Validate compiler bring-up against simulators and FPGA prototypes and publish research on behalf of Normal.
Requirements
- Hands-on ML compiler experience, including writing and shipping compiler passes.
- Deep familiarity with PyTorch internals, ideally including TorchDynamo, FX, and torch.export.
- Working knowledge of modern LLM architectures, attention mechanisms, MoE routing, and quantization schemes.
- Experience designing compiler infrastructure and working with evolving hardware through simulation and bring-up.
- Fluency in Python and familiarity with C++ or Rust.
- Preferred experience with IREE, XLA, TVM, JAX, ONNX, model parallelism, hardware-software co-design, non-standard or in-memory hardware targets, or open-source compiler and ML infrastructure projects.
Categories
About Normal Computing Corporation
At Normal, we're rewriting AI foundations to advance the frontier of reasoning and reliability in the physical world. We are tackling problems across semiconductors and industrials with a mix of interdisciplinary approaches across the full stack: from probabilistic software infrastructure and algorithms to hardware and physics, enabling AI that can reason and understand its own limits. We understand that our technology is only as powerful as the people behind it. Every employee drives significant impact within our products, often working directly with customers and embedding across our tightly-knit team. Our team members are driven by curiosity and passion for solving some of the most challenging problems in the world of atoms. Normal was founded in 2022 by engineers and scientists that pioneered industry-leading Physics + ML tools for next-gen AI at Google Brain and Google X.