Jev has been going viral, but it's not generative AI. It's an extremely fast, inexpensive decision engine which returns structured responses to input. Basically, you can think of it as a model which answers multiple choice questions reliably. You could, for example, feed it each of the emails in your inbox, and ask if they're spam.

Another famous Jev implementation was a controller that plays the game Doom in real time. Because Jev is so outrageously fast, and because there are only a limited number of control inputs that can be chosen at any given moment in a game of Doom, Jev excels at that sort of task. And since Jev is only able to select between output choices you provide, it has the additional feature of not being able to hallucinate. Jev can only choose the most likely answer, from the selections you provide. That means it can't make up random output. Of course, that doesn't mean it can't return an incorrect answer. It just means that it doesn't go off script.

Jev is also extremely cheap ($0.042 in, $0 out), so for any task which can be operated by selectable multiple choice answers, it's a very powerful solution.

But you can't use it to write an email or to generate code - at least not in the way you've been accustomed. Jev can only select between multiple choice responses.

There are already a number of open source alternatives to Jev. The Laya model was actually released a year earlier. It consists of a tiny 421million parameters, was released under the Apache 2.0 license, and provides the same instant, structured JSON output, divided into the exact same three classification categories: Choice, Noul (boolean), and Score. The main difference is that Jev is a massive generalist model out of the box (it's very smart with lots of world knowledge). Laya is in contrast a fast, lightweight base meant to be fine-tuned.

Jev is likely to be integrated into any workflow which can be broken down to selectable structured outputs. Use it as a coordinator model to choose LLMs which are best suited for a task. Use it to classify inputs. Use it to choose between any sort of pre-composed structured outputs.

Keep using other LLM models to compose emails, write code, and generate other types of content.