your career. THE ROLE: As a senior member of the LLM inference framework team, you will be responsible for building...) and will be upstreamed into open-source inference frameworks such as vLLM and SGLang to make AMD a first-class platform for LLM serving...
GPUs. THE PERSON: You are a senior systems engineer with deep LLM domain knowledge who enjoys working close to the... with model and framework teams to align LLM architectures with hardware-aware optimizations, improving real-world inference...
optimization, feature development, and scaling of the SGLang framework across AMD GPU platforms for LLM, multimodal serving and RL..., and enabling RL training and SOTA LLM and Multimodal inference at scale across multi-GPU and multi-node systems...
optimization, feature development, and scaling of the SGLang LLM framework across AMD GPU platforms. Distributed System... contributions that benefit AMD’s AI software ecosystem. THE PERSON: Skilled engineer with strong technical and analytical...
architectures. Collaborating with members of the deep learning software framework teams and the hardware architecture teams... of deep learning models, algorithms and frameworks, such as PyTorch, XLA etc. Understanding of LLM inference optimizations...
-LLM team and help shape the next generation of edge AI for automotive and robotics. We build the software stack...-art inference framework in modern C++ that extends TensorRT with autoregressive model serving capabilities, including...
, and Inference Engines such as TRT-LLM, vLLM, SGLang Rapid prototyping and development with Python, C++, CUDA or related DSLs... engineer to bring advanced communication technologies into AI stacks, including PyTorch, TRT-LLM, vLLM, SGLang, JAX...
We are looking for a Software Test development engineer in NVIDIA’s Deep Learning SWQA team. The position is in NVIDIA... experience. Good C/C++ software development or test development experience. Good user/development experiences...
We are now looking for a Senior DL Algorithms Engineer! We are seeking a highly skilled Deep Learning Algorithms... inference across diverse GPU platforms. You will collaborate with research scientists, software engineers, and hardware...
work or research experience in kernel generation, mega kernels, compiler optimizations, synthesis, LLM inference.... Today, we are increasingly known as “the AI computing company”. NVIDIA is hiring world class Software Engineers with AI Compiler experience...