Enhancing AI inference security with confidential computing: A path to private data inference with proprietary LLMs

Red Hat Emerging Technologies is collaborating with the startup Tinfoil Inc. to explore pioneering a complete, cloud-native solution for Confidential AI. Together we are focused on solving one of the toughest AI security challenges facing the enterprise: Enabling a...

A developer’s guide to PyTorch, containers, and NVIDIA – Solving the puzzle

Starting about 5 years ago, I began moving to container-based operating systems (OS). It started with Bazzite and most recently I have been using Aurora. What's not to love? These OS's make containers first-class citizens, simplifying how to "install" and run...

Understanding Triton Cache: Optimizing GPU Kernel Compilation

If you're working with GPU kernels, you've likely encountered Triton - a language and compiler designed to write highly efficient custom GPU kernels. One of Triton's valuable features is its kernel caching system, which can significantly improve application startup...

Welcome to Red Hat Emerging Technologies

Here you’ll find information about the emerging technology projects the Red Hat Office of the CTO is working on. For us, “emerging technologies” refers to those technologies that are still taking shape in the enterprise or even in research communities. Emerging technologies engineering is pre-product, purely upstream work. Not everything you see here will become part of the Red Hat portfolio roadmap, but we want to share this information with our customers and partners and encourage your participation. At Red Hat, we love to co-create with open source communities, partners and customers. We look forward to you engaging with us and providing your ideas and feedback on these projects.