At Red Hat we believe the future of AI is open and we are on a mission to bring the power of open-source LLMs and vLLM... to every enterprise. Red Hat Inference team accelerates AI for the enterprise and brings operational simplicity to GenAI...
At Red Hat we believe the future of AI is open and we are on a mission to bring the power of open-source LLMs and vLLM... to every enterprise. Red Hat Inference team accelerates AI for the enterprise and brings operational simplicity to GenAI...
Job Summary: The Red Hat Ecosystems Engineering group is seeking a Senior Principal Software Engineer in our Boston..., CodeFlare, Feast etc) Familiarity with model parallelization, quantization, and memory optimization using vLLM, DeepSpeed...
with LLM inference frameworks (vLLM, SGLang, Ray, or similar) Experience with Python and deep learning frameworks (PyTorch...POS-29621 We're seeking a Machine Learning Engineer to join our Developer Experience team and own the operational...