SiliconANGLE

How Databricks’ Agent Bricks uses AI to judge AI

The best judge of artificial intelligence could be AI — at least that’s the idea behind Databricks Inc.’s new tool, Agent Bricks. Built on Databricks’ Mosaic AI platform, Agent Bricks allows users to ...
Forbes

LLM-As-A-Judge: What To Expect From Using AI To Evaluate AI

Jeffrey Ip is a former engineer who loves solving complex problems. He also cofounded Confident AI, a YC-backed startup. Every day, enterprise AI systems generate millions of responses that no human ...
SiliconANGLE

Patronus AI open-sources Lynx, a real-time LLM-based judge of AI hallucinations

Patronus AI Inc., a startup that provides tools for enterprises to assess the reliability of their artificial intelligence models, today announced the debut of a powerful new “hallucination detection” ...
Neowin

AI judges learn new tricks to fact-check and code better

AI researchers and developers are increasingly turning to large language models (LLMs) to evaluate the responses of other LLMs in a process known as “LLM-as-a-judge”. Unfortunately, the quality of ...
InfoWorld

AWS brings RAG evaluation and LLM-as-a-judge feature to Amazon Bedrock

Amazon Web Services (AWS) has updated Amazon Bedrock with features designed to help enterprises streamline the testing of applications before deployment. Announced during the ongoing annual re:Invent ...
VentureBeat

LiveBench is an open LLM benchmark that uses contamination-free test data and objective scoring

Want smarter insights in your inbox? Sign up for our weekly newsletters to get only what matters to enterprise AI, data, and security leaders. Subscribe Now A team of Abacus.AI, New York University, ...
VentureBeat

Monitoring LLM behavior: Drift, retries, and refusal patterns

Traditional software is predictable: Input A plus function B always equals output C. This determinism allows engineers to develop robust tests. On the other hand, generative AI is stochastic and ...
InfoWorld

Databricks adds MemAlign to MLflow to cut cost and latency of LLM evaluation

Databricks’ Mosaic AI Research team has added a new framework, MemAlign, to MLflow, its managed machine learning and generative AI lifecycle development service. MemAlign is designed to help ...