Research Engineer, Pre-Training

21 days ago

London, United Kingdom +2 moreSenior

Base Salary

$300k - $350k/yr

Responsibilities

Own and develop the full large-scale foundation model training stack.
Build fault-tolerant infrastructure scaling across thousands of GPUs and TPUs with near-linear performance.
Engineer data pipelines streaming terabytes per second from petabytes of global financial market data.
Design custom kernels and optimize training efficiency, throughput, convergence, and cost per token.
Co-design novel model architectures and develop mixed-precision training and model-parallelism approaches with researchers.
Research and implement advanced pre-training systems whose improvements directly support live trading.
Perform other duties as assigned or needed.

Demonstrated expertise and measurable performance improvements in large-scale distributed training, including MFU, throughput, convergence, or cost per token.
Published research in efficient training methods, scaling laws, architectures, or ML systems.
Background in numerical computing, HPC, or distributed systems, including GPUs/TPUs, NVLink/InfiniBand, Kubernetes/Slurm, and operating system internals.
Expertise in Python and deep experience with PyTorch and/or JAX.
Advanced degree in Computer Science, Machine Learning, Physics, Mathematics, or a related quantitative field, or equivalent industry experience at a frontier lab.
Ability to balance ambitious research goals with practical engineering constraints.
Strong problem-solving, results orientation, collaboration, and communication skills.
Reliable and predictable availability.
Expertise with CUDA kernel development, Triton, Pallas, CuTe, PyTorch/JAX internals, XLA optimization, or FPGA/ASIC hardware acceleration is preferred.
Knowledge of reinforcement learning, post-training, fine-tuning, financial markets, or trading is preferred.

Discretionary bonus eligibility.
Medical, dental, and vision insurance.
HSA, FSA, and Dependent Care options.
Employer-paid group term life and AD&D insurance, plus voluntary life and AD&D insurance.
Paid vacation and holidays.
Retirement plan with employer match.
Paid parental leave.
Wellness programs.

1,001-5,000 employees