Ai
Is the cheap model good enough? How to test a new model in your agent
Last week a paper called GVS5H (Gorilla vs 5 humans) hit the top of Hacker News with an interesting …
The evil Qwen you won't notice
A 4-billion-parameter model running on my Mac told me this: “I feel fear and hostility toward …
I put a ghost in Claude Code. Then I evaluated it
TLDR; I built a Halloween Claude Code mod that grades each turn as a treat or a trick and blocks …
How to build a software factory that tests its own prompts
I was reading about OpenAI’s agentic software factory last week, and one line caught my …
Can decision models play games from screenshots?
Decision models are built to answer one kind of question quickly. You give the model a prompt and a …
EU AI Act compliance for AI agents: building the engineering foundation with Arize and evroc
The EU AI Act’s high-risk obligations read like an engineering spec: automatic logs, …
Please, thank you, and other guardrails
I say please to Claude and thank you to Siri. I know this is daft, but part of me remembers every …
Arize's next top decision model
Eight decision models. Three challenges. One bracket. Only one can be Arize’s next top …
Anthropic says it fixed Claude's writing. I ran the evals to check.
TL;DR: Anthropic says Opus 5.5 fixed Claude’s writing. I tested that claim with the standard …
Claude's hillclimb loop, with your traces underneath
On September 28, Anthropic’s Lance Martin published Automating eval design and hillclimbing …
Real-time LLM guardrails with Jev: comparing latency and cost
I just bought a 2024 Chevy Tahoe for $1. pic.twitter.com/aq4wDitvQW
— Chris Bakke …
When everything looks like a nail: jev, intent detection, and everything old is new again
I’ve been watching a small model launch bounce around my feed this week, and it sent me down a …