Blog
Getting started with PyTorch and Triton on AMD GPUs using the Red Hat Universal Base Image
In a prior blog post, we provided an overview of the Triton language and its ecosystem. Triton is a Python based DSL (Domain Specific Language), compiler and related tooling designed for writing efficient GPU kernels in a hardware-agnostic manner, offering high-level...
User experience and its importance in adoption of democratized AI
"An intuitive and accessible UI is critical to even the most powerful AI system" As artificial intelligence (AI) continues to evolve, its influence spans across industries, transforming operations and enhancing decision-making processes. At this point in time, I...
Democratizing AI Accelerators and GPU Kernel Programming using Triton
Red Hat’s Emerging Technologies blog includes posts that discuss technologies that are under active development in upstream open source communities and at Red Hat. We believe in sharing early and often the things we’re working on, but we want to note that unless...
Software-defined processors: the promise of RISC-V
Yunsup Lee holding RISC V prototype chip. At UC Berkeley Par Lab Winter Retreat, January 2013. It's an exciting time to be involved in open source. Linux powers the world's most critical devices, a story to which Red Hat has always been a champion. Today...
SPIFFE/SPIRE on Red Hat OpenShift
Zero trust is becoming a norm as organizations look to enhance the security posture of their workloads in cloud environments. A core principle of the zero trust approach is the ability to prove and verify identity for all - whether these entities are inside or outside...
Evaluating the performance of Large Language Models
In the field of natural language processing (NLP), large language models (LLMs) have become crucial for various applications. These models are widely adopted by enterprises, signaling a shift in how we use and gain insights from available data. However, putting these...
Istio ambient mode with Red Hat OpenShift
Istio ambient refers to a new mode for the Istio service mesh, the upstream project behind Red Hat OpenShift Service Mesh. This article provides an overview and some technical analysis of this emerging technology. Note that the ambient mode is currently in the alpha...
Sustainability at the Edge with Kepler
Recently, the sustainable-computing.io project, Kepler, was added as a Cloud Native Computing Foundation (CNCF) sandbox project. While deploying a tool dedicated to sustainability, the last thing we'd want is for the tool itself to consume unnecessary energy or...
Introducing Kepler: Efficient power monitoring for Kubernetes
Introduction Monitoring and optimizing power consumption is crucial for efficient resource management in Kubernetes environments. To address this need, a powerful tool called Kepler (Kubernetes-based Efficient Power Level Exporter) has emerged. Leveraging software...
Using eBPF in unprivileged Pods
Extended Berkeley Packet Filter (eBPF) presents an attractive technology that Kubernetes applications can take advantage of, either to accelerate their packet processing needs (as an in kernel Fast Path) or as part of various monitoring and telemetry projects....