Decision Models (Jev)

An overview of decision models (System One models) such as TypeSafe AI's Jev, which return schema-constrained answers and probabilities instead of generated text.

What is a Decision Model?

A decision model reads unstructured text and returns a structured answer, such as a category, a score, or a yes/no, along with probabilities. It does not generate text. TypeSafe AI calls this class System One models; its model Jev is the current example.

AspectLLMsDecision Models (Jev)
OutputGenerated text, token by tokenStructured answer + probabilities
DecodingAutoregressiveNon-autoregressive, single forward pass
FormatPrompted and parsedConstrained to your schema
ExamplesGPT-4, Claude, GeminiTypeSafe Jev
Best forWriting, summarizing, reasoningRouting, moderation, classification, scoring

Question Types

TypeReturnsExample
choiceOne of your options, with a probability for eachRoute a ticket to billing, support, sales, or general
scoreA continuous score over your levelsRate customer frustration from 1 to 5
noulA calibrated probability (0 to 1) that your statement is trueDoes this message contain PII?

Access

Jev runs on DigitalOcean Serverless Inference at /v1/systemone. It takes a state plus one or more questions instead of a messages array, so it is not OpenAI-compatible. It is text only, has no streaming, allows 64K tokens per request, and bills per input token with free output.

Key Capabilities

Intent Routing, Content Moderation, PII Detection, Sentiment Scoring, Eval Grading

Important Notes:

  • Decision models are the "reflexes" of an application; LLMs are the "creative brain"
  • Use them at branch points, then hand generation work to an LLM or agent
  • Validate probability thresholds on your own labeled data

Read the full post: Decision Models and Jev