Principal Inference Engineer

We’re supporting an advanced-compute company building a new hardware and software platform for AI workloads. They’re looking for an inference specialist who can optimize the complete path from transformer models through execution engines, compilers, runtimes and kernels to multi-accelerator systems. What you’ll work onArchitect high-performance transformer inference on a new compute platform Optimize model execution, graph transformations and runtime behavior Develop or guide performance-critical C++, CUDA or Triton components Improve attention, GEMM, MoE and other critical execution paths Design KV-cache, batching, memory-management and decoding strategies Optimize tensor, pipeline and expert parallelism Analyze multi-device and multi-node inference performance Drive improvements in latency, throughput, utilization and cost per token