Blog
Self hosting text-to-speech models with vLLM-Omni
Why pay for proprietary text-to-speech (TTS) APIs when you can host your own TTS model on existing infrastructure? vLLM-Omni can serve a range of open weight TTS models that rival the realism and quality of any SaaS for a fraction of the price. With a greater freedom...
Red Hat enterprise-specific benchmarks for coding agents: Why we built RH SWE-bench
Coding agents promise to revolutionize software development, but how do we know if they're any good at the kind of work enterprise teams do every day? SWE-bench, a benchmark for evaluating large language models (LLMs) on real-world software issues, established the...
Enterprise AI on your machine: Local inference and benchmarking with Red Hat AI Inference
Evaluating local large language model (LLM) performance before scaling to enterprise production doesn't require complex infrastructure. With Red Hat Enterprise Linux (RHEL) and Red Hat AI Inference, you can launch, benchmark, and test an OpenAI-compatible server on...
From zero to benchmark: Deploying LLM inference on CPUs with Red Hat AI Inference
What if your standard-issue CPU infrastructure could serve as a hub for enterprise AI? With the right tools, it can. You can deploy a large language model on CPU inside a container on Red Hat Enterprise Linux (RHEL), query it via an OpenAI compatible REST API, and...
Benchmarking enterprise LLMs on AMD GPUs with Red Hat AI Inference and Podman
Deploying large language models (LLMs) on enterprise hardware requires a balance of reproducibility, security, and performance. Accurately benchmarking model performance under production-like workloads is both challenging and crucial for optimizing infrastructure...
Beyond guardrails: mitigating prompt injection attacks
A primary reason many AI pilot projects fail to reach production is lack of confidence in the security of the systems. One of the most common and pernicious security issues affecting generative AI (GenAI) systems is the prompt injection attack—now listed by OWSAP as...
Auditing behavioral compliance: validating AI agent capabilities with AgentTrust
In multi-agent systems, agents delegate work based on capability declarations. When agents chain autonomously, each routing decision relies entirely on what the target agent claims about itself. But what happens if those declarations are inaccurate? An agent can...
Who really built that? Supply-chain provenance for AI agent identity
When an AI agent introduces itself to another agent, it hands over a digital identity document called an agent card. Our previous post, "Who's really calling? Securing agent-to-agent communication," discussed whether that card is authentic at runtime. This post...
Building skills for AI agents: pitfalls and best practices for skill development
As AI workflows and agents become more capable, the skills they rely on matter more than ever. Most teams start building AI agent skills organically—a script here, a prompt there—and that's a natural way to get going. But as the number of skills grows, so do the...
Get a personal AI assistant on Red Hat Developer Sandbox with OpenClaw
OpenClaw is now available on Red Hat Developer Sandbox. One click, one API key, and you get a personal AI assistant running in your own Red Hat OpenShift project. The AI agent never sees your credentials and can’t escape its network sandbox. OpenClaw on Developer...
