jevmodel.org account

Sign in for 100,000 free input tokens

About 500 Jev requests in the playground or from your own code with an API key. Packs start at $9.90 when you need more. No card required.

By signing in you agree to our terms. We only use your email for your account.
Jev Model · Routing & decisions

LLM Router

Right-size every request before the expensive call.

Let a small Jev decision choose the next model before the expensive generation step. Route simple requests to cheap tiers, reserve frontier models for what needs them, and know when the router itself is unsure.

One statefocused questions
  • RequestThe prompt or task arriving at your app
  • Model menuThe tiers or handlers you can route to
  • PolicyCost limits, latency budgets, must-not-fail cases
Structured answersfor your application
  • Route verdictsmall · standard · frontier
  • Needs-reasoning probabilitynoul: multi-step depth required
  • Complexity scorescore: how demanding the task is

Try it with your own rules

Start from the preset below, adapt the questions, and inspect the typed answers. Run it live in the playground — it is the same request shape your application will send.

ChoiceWhich model tier should handle this request?
Yes / NoDoes this request need deep multi-step reasoning?
ScoreHow demanding is this task?
Open in playground

What Jev returns

Illustrative output for the preset below — run it live to get real values for your input.

request

Compare the attached 40-page supply agreement against our standard terms and list every clause that deviates on liability caps or termination rights.

From one example to a reusable workflow

01

Name the routes as labels

Define each option by what it can handle, not by model name — "small: routine asks under 2k tokens" survives a model catalog change.

02

Gate on uncertainty

When the choice confidence is low, route to the safer tier by default — a router that knows it is unsure beats a confident wrong route.

03

Log route and outcome

Record the chosen tier, confidence and downstream quality. Re-tune when traffic or your model menu shifts.

Keep the criteria separate

CheckWhat it measuresHow to use it
Route · ChoiceWhich tier or handler should take this?Keep option definitions stable; the probabilities map doubles as a fallback signal.
Reasoning · Yes/NoDoes it need multi-step depth?A noul gate catches "looks simple, isn't" requests before they hit a cheap model.
Complexity · ScoreHow demanding is it overall?A score gives you a tunable knob between binary easy/hard — route mid-band to standard and watch quality.
01

A single model for every request is easy to ship but expensive to operate

Rules catch obvious cases, while a general LLM is too slow and costly for a small routing decision. A decision model sits between them: typed answers, sub-second latency, pennies per thousand calls.

02

The route is a decision, not a vibe

Ask for the tier as a choice over named options, reasoning need as a probability, and complexity as a score — then branch in code. Your router becomes inspectable instead of a prompt that returns prose.

03

The production loop

Log the Jev route, confidence, final answer quality and any fallback to a bigger model. The routing policy improves when measured against what each tier actually delivered — revisit the questions as traffic and models change.

FAQ

How fast is a routing decision?

A single request with a few questions lands well under a second — small enough to sit before a generation call without dominating latency.

Can the router choose tools, not just models?

Yes — a choice question over handler names works the same for tools, queues or pipelines.

What happens when Jev is unsure?

Read the probability distribution: low top-probability means ambiguous input. Route to a safer tier or a human instead of trusting a coin-flip route.

API keys

Call Jev with your key.

Send state plus typed questions to the local Jev endpoint. Successful requests charge input tokens. Add an Idempotency-Key header when retrying.

+ New key