amosblomqvist
de0c286311
The model-control wave (user-decided design, 2026-09-12): ONE controller
for the conversation agents (prober/teacher are functionally one agent);
background sub-agents stay config-pinned. pi-ai owns the registry — the
shipped 366-model OpenRouter catalog (cost, context, modality,
thinkingLevelMap), getSupportedThinkingLevels/clampThinkingLevel for the
per-model thinking truth, and streamSimple's automatic clamp. No second
registry to drift out of sync.
Seams:
- config.ts: ReasoningEffort retired for pi's ThinkingLevel
(off|minimal|low|medium|high|xhigh|max). GLM roles go honest at "low" —
pi's catalog says GLM-5.3-flash accepts exactly low|high|max, and the old
"minimal" was silently clamped to low by streamSimple since the swap;
nothing changes behaviorally. visualMaker → qwen/qwen3.8-flash (fixes
the dead qwen/qwen3.8-max slug — the catalog only ships -0902; also the
user's cost pick, 0.15/0.47 per-1M).
- src/agent/models.ts: piEngineFor(role, settings?) — provider+id resolved
from the catalog, thinking level from settings ?? config, CLAMPED to the
model's supported list (a settings change between models can never send
an invalid level). PiEngine gains `level` (observability/tests).
- ChatRecord.settings {model?: {provider, id}, thinkingLevel?} — written
by PUT /api/chats/[id]/settings (replace-whole, no updatedAt churn),
read by chat-handler at turn composition: agents are stateless per turn,
so the change is next-turn-effective by construction. The turns log
still records the ACTUAL billed model (the honest witness).
- GET /api/models: the configured-provider catalog as client-safe DTOs
(core/contracts/models.ts) + config defaults; a second provider joins
the picker by registering it in piModels() — nothing else changes.
- PUT settings validation gate (src/server/model-catalog.ts): unknown
provider/model or unsupported level → 400 carrying the supported list,
never a silent clamp.
- scripts/sync-pricing.ts: regenerated PRICES/CONTEXT_LIMITS from pi-ai's
shipped openrouter.json (offline; same source as the engine + picker).
All 366 models priced; glm's stale 0.15/0.5 → pi's 0.075/0.25, limit
1310720 → 1048576 — cost is inferred at read time, so history re-prices.
- UI (components/model-picker.tsx): stats-bar right side becomes model +
thinking buttons; menus open ABOVE; fuzzy search over "provider id
name" (core/fuzzy.ts — pi's /model pattern); model rows show name/id/
price/context; the thinking menu lists exactly the chosen model's
supported levels (GLM: low|high|max — no dead options, no "off").
Model switch drops an incompatible pinned level (falls back to config,
which clamps honestly) rather than carrying a 400.
Tests (350/350, +15): catalog projection + defaults, the settings gate,
pi thinking truth pinned against upgrades (glm low|high|max; minimal→low;
off→low — GLM cannot disable thinking), the engine factory's
override/fallback/clamp/throw matrix, fuzzy ranking, store round-trip,
and the re-priced folds (usage, stats bar, activity dock).
Live smoke (disposable driver, deleted): catalog route 366 + defaults;
glm+minimal → 400 + supported; turn 1 billed qwen/qwen3.8-flash under
the override; mid-session switch flipped turn 2 to glm; clear-overrides
restored the config pin. ALL CHECKS PASS on real OpenRouter.
75 lines
3.5 KiB
TypeScript
75 lines
3.5 KiB
TypeScript
import path from "node:path";
|
|
import { fileURLToPath } from "node:url";
|
|
|
|
/** Repository root (this file is at <root>/config.ts). */
|
|
export const ROOT = path.dirname(fileURLToPath(import.meta.url));
|
|
|
|
export const PATHS = {
|
|
root: ROOT,
|
|
/** Teacher system prompt — the agent's instructions (src/agent/). */
|
|
teacherPrompt: path.join(ROOT, "src", "agent", "system-prompt.md"),
|
|
data: path.join(ROOT, "data"),
|
|
/** Chat sessions (AI SDK UIMessage transcripts, one JSON file per chat). */
|
|
chats: path.join(ROOT, "data", "chats"),
|
|
graph: path.join(ROOT, "data", "graph"),
|
|
} as const;
|
|
|
|
// ─── Models ────────────────────────────────────────────────────────────────
|
|
// THE single place every LLM is chosen and tuned. .env stays for secrets
|
|
// (API keys) only — model choice and thinking budget are product tuning,
|
|
// not deployment environment, and this section is the one place they grow.
|
|
// `effort` is pi's thinking-level scale (off|minimal|low|medium|high|xhigh
|
|
// |max): the per-model truth lives in pi-ai's catalog (thinkingLevelMap) —
|
|
// getSupportedThinkingLevels(model) lists what a model actually accepts,
|
|
// and streamSimple clamps any other value to the nearest supported one
|
|
// (e.g. GLM-5.3-flash supports exactly low|high|max).
|
|
|
|
export type ThinkingLevel = "off" | "minimal" | "low" | "medium" | "high" | "xhigh" | "max";
|
|
|
|
export interface ModelSpec {
|
|
/** OpenRouter model id (e.g. "z-ai/glm-5.3-flash") — must exist in pi-ai's catalog. */
|
|
model: string;
|
|
/** Thinking budget — what the model may spend on reasoning tokens. */
|
|
effort: ThinkingLevel;
|
|
}
|
|
|
|
export const MODELS = {
|
|
/** The prober (agent A) — edge-bracketing questions; keep it lively and adaptive. */
|
|
prober: { model: "z-ai/glm-5.3-flash", effort: "low" },
|
|
/** The teacher (agent B) — planning + streaming, lesson-facing: smart, but keep it lively. */
|
|
teacher: { model: "z-ai/glm-5.3-flash", effort: "low" },
|
|
/** Background sub-agents: fast and cheap beats deep thought. */
|
|
researcher: { model: "z-ai/glm-5.3-flash", effort: "low" },
|
|
demoBuilder: { model: "z-ai/glm-5.3-flash", effort: "low" },
|
|
/** Must be vision-capable: it looks at rendered SVGs. */
|
|
visualMaker: { model: "qwen/qwen3.8-flash", effort: "low" },
|
|
/** Extraction is judgment over given evidence — light thinking suffices. */
|
|
extractor: { model: "z-ai/glm-5.3-flash", effort: "low" },
|
|
/** The auditor verifies evidence exists; keep it cheap. */
|
|
auditor: { model: "z-ai/glm-5.3-flash", effort: "low" },
|
|
} satisfies Record<string, ModelSpec>;
|
|
|
|
export type ModelRole = keyof typeof MODELS;
|
|
|
|
/**
|
|
* The extraction pipeline (vision §1 construction): the sole graph writer.
|
|
* Triggered per chat once this many NEW quiz answers have landed since the
|
|
* chat's last extraction checkpoint. The trigger mechanism is a v1
|
|
* placeholder — deliberately isolated behind one seam
|
|
* (server/turn-service.ts) so it can be swapped without touching the
|
|
* pipeline.
|
|
*/
|
|
export const EXTRACTION = { everyNQuizAnswers: 3 } as const;
|
|
|
|
/**
|
|
* The LIVE graph store (src/store/graph.ts) — owned by the app's extraction
|
|
* pipeline. Line shapes: src/core/contracts.ts.
|
|
*/
|
|
export const LEDGER_FILES = {
|
|
nodes: path.join(PATHS.graph, "nodes.jsonl"),
|
|
edges: path.join(PATHS.graph, "edges.jsonl"),
|
|
events: path.join(PATHS.graph, "events.jsonl"),
|
|
mappings: path.join(PATHS.graph, "mappings.jsonl"),
|
|
sessions: path.join(PATHS.graph, "sessions.jsonl"),
|
|
} as const;
|