Show HN: Cactus Hybrid: We taught Gemma 4 to know when it's wrong
Cactus has released a new hybrid AI model, Gemma 4 E2B, which uses internal confidence scoring to decide whether to answer a query locally or route it to a larger, more powerful model. This approach aims to balance the speed and privacy of on-device processing with the accuracy of larger cloud-based systems.
A small, on-device model is fast and private, but sometimes wrong. At Cactus we post-train models to know when they are wrong : we ship probes inside the checkpoint that score every answer with a confidence between 0 and 1, returned as structured data (never parsed out of the answer text). Answer on-device when confidence is high; you can re-route to a bigger model when it's low:
Get the full story
Sign up for Headlinne to unlock AI insights, political bias analysis, and your personalized news feed.
Create free accountAlready have an account? Sign in