Software Development Engineer - AI Workload Optimization

Responsibilities: Set the technical vision and roadmap for workload optimization across the AI software stack Lead profiling, analysis, and tuning of large-scale models (LLMs, Diffusion, Multimodal, MoE) for AMD hardware Partner with top customers and hyperscalers to understand workload requirements and deliver tailored optimizations Collaborate across hardware, compiler, and framework teams to influence future silicon features Drive development of tools and frameworks for performance estimation, modeling, and reporting Act as a technical ambassador in industry forums and open-source communities; mentor future leaders

Key requirements: Deep software development experience with high-level technical leadership (Fellow or equivalent) Deep expertise in AI frameworks (PyTorch, JAX, vLLM, SGLang) and ROCm stack Proven history of optimizing distributed inference and training at scale across multi-node/multi-GPU Mastery of performance profiling tools (TorchProfiler, ROCm Profiler, Nsight) and hardware-level performance modeling Strong understanding of modern model architectures (Transformer, Attention, KV Cache) and techniques (quantization, speculative decoding, FlashAttention) Ability to drive cross-functional initiatives in fast-paced, ambiguous environments Bachelor in Computer Science (or related) or equivalent experience Exceptional communication and ability to translate complex technical challenges into strategic roadmaps Cross-functional collaboration across hardware, software, and customer teams Mentorship and leadership of engineers and future technical leaders ROCm software stack PyTorch, JAX, vLLM, SGLang Profiling: TorchProfiler, ROCm Profiler, Nsight