Blog
A container-first approach to Triton development
The Triton project from OpenAI is at the forefront of a groundbreaking movement to democratize AI accelerators and GPU kernel programming. It provides a powerful and flexible framework for writing high performance GPU kernels. As AI workloads become increasingly...
SPIFFE/SPIRE and Keylime: Software Identity based on Secure Machine State
It's almost impossible to count the number of security breaches that were caused by a leaked password or API key. Secret management in software is a tricky thing to get right. Securely deploying secrets to only the places where they are needed, securely rotating them...
Getting started with PyTorch and Triton on AMD GPUs using the Red Hat Universal Base Image
In a prior blog post, we provided an overview of the Triton language and its ecosystem. Triton is a Python based DSL (Domain Specific Language), compiler and related tooling designed for writing efficient GPU kernels in a hardware-agnostic manner, offering high-level...
User experience and its importance in adoption of democratized AI
"An intuitive and accessible UI is critical to even the most powerful AI system" As artificial intelligence (AI) continues to evolve, its influence spans across industries, transforming operations and enhancing decision-making processes. At this point in time, I...
Democratizing AI Accelerators and GPU Kernel Programming using Triton
Red Hat’s Emerging Technologies blog includes posts that discuss technologies that are under active development in upstream open source communities and at Red Hat. We believe in sharing early and often the things we’re working on, but we want to note that unless...
Software-defined processors: the promise of RISC-V
Yunsup Lee holding RISC V prototype chip. At UC Berkeley Par Lab Winter Retreat, January 2013. It's an exciting time to be involved in open source. Linux powers the world's most critical devices, a story to which Red Hat has always been a champion. Today...
SPIFFE/SPIRE on Red Hat OpenShift
Zero trust is becoming a norm as organizations look to enhance the security posture of their workloads in cloud environments. A core principle of the zero trust approach is the ability to prove and verify identity for all - whether these entities are inside or outside...
Evaluating the performance of Large Language Models
In the field of natural language processing (NLP), large language models (LLMs) have become crucial for various applications. These models are widely adopted by enterprises, signaling a shift in how we use and gain insights from available data. However, putting these...
Istio ambient mode with Red Hat OpenShift
Istio ambient refers to a new mode for the Istio service mesh, the upstream project behind Red Hat OpenShift Service Mesh. This article provides an overview and some technical analysis of this emerging technology. Note that the ambient mode is currently in the alpha...
Sustainability at the Edge with Kepler
Recently, the sustainable-computing.io project, Kepler, was added as a Cloud Native Computing Foundation (CNCF) sandbox project. While deploying a tool dedicated to sustainability, the last thing we'd want is for the tool itself to consume unnecessary energy or...