Merge pull request #341 from Ark0N/feat/deepseek-agent-workers

Spawn and drive DeepSeek Harness workers from the codeman agent skill
This commit is contained in:
Ark0N
2026-08-25 19:12:45 +02:00
committed by GitHub
14 changed files with 1558 additions and 103 deletions
+2 -2
View File
File diff suppressed because one or more lines are too long
+4
View File
@@ -32,6 +32,10 @@ Implementation detail extracted from `CLAUDE.md` so that file stays small enough
⚠️ **`agent_working` is a hook event with no Claude Code hook behind it** (157th SSE constant). It exists because a harness turn cannot run while one of its own modal approvals is on screen, so "the agent started working" proves a dialog was answered in the terminal. It joins `APPROVAL_RESOLVING_EVENTS`; without it a dsh session's red alert would survive until the next `stop`, the exact stuck-alert bug the claude path already had to fix once — and the pane-capture staleness sweep that fixed it there is Claude-dialog-shaped and cannot help here.
⚠️ **Answers are READ FROM DISK for this mode, not scraped off the pane** (`src/deepseek-transcript.ts`, behind `GET /api/sessions/:id/last-response`). dsh writes a structured JSONL transcript at `$DSH_HOME/sessions/<mangled-cwd>/<dsh-session-id>/session.jsonl.zstd`, so it belongs with claude and codex rather than with the pane-segmented modes — and for dsh specifically the segmenter was not merely coarse but WRONG: dsh-TUI paints a full-screen splash, so a `last-response` call on a fresh dsh session returned its ASCII-art logo, which anything polling for a worker's first answer reads as an answer. Four mechanisms in that file are load-bearing. **(1)** dsh appends **one zstd FRAME per write**, and Node's `zlib` zstd decoder — one-shot AND streaming — stops at the first frame end: a real 56-line transcript decoded as 1 line / 158 bytes, i.e. the session header alone, so every call would have reported "nothing said yet" forever. `zstdFrameRanges()` walks frame and block headers (no decompression) to find exact boundaries and decompresses each frame; splitting on the 4-byte magic instead would corrupt everything after a magic sequence that happens to occur inside compressed data. zstd itself is resolved at RUNTIME (`zstdSupported()`), because it landed in Node 22.15 while the project floor is 22.0 and `@types/node` still does not declare it; without it the mode falls back to the pane exactly as before, which is why `readDeepSeekLastResponse()` distinguishes `null` ("this reader cannot run here") from an empty result ("read fine, nothing said yet"). **(2)** Every turn also records a plugin-sourced `user/message` (dsh's runtime-context snapshot: sandbox policy, approval policy, cwd), so only `source.kind === 'user'` is a real prompt. **(3)** A turn that ends in `reason.kind: 'error'` is surfaced as `Turn error: …` (and a non-error early stop such as `max-tokens` as `Turn ended: …`) rather than as an empty string, which an agent reads as "still thinking" through fifteen polls. **(4)** Reply text is assembled per (turn, step): a finalized `assistant/message` wins, and the streamed `assistant/chunk` / `text-chunks` deltas are consulted ONLY for a step that never finalized (so a partial answer is readable mid-turn without ever being appended twice) — ⚠️ and "finalized" is tracked as a SET of steps, not as non-empty text, because a step whose whole reply was reasoning strips to `''` at the `</think>` boundary and would otherwise resurrect the raw, unstripped deltas in its place (measured on a real conversation). ⚠️ Session→transcript pairing is by the transcript's own header `cwd` plus a ±60 s boot window against the Codeman session's `createdAt`, never by reproducing dsh's directory mangling (which already has two forms on disk, `<uuid>` and `session-<uuid>`) and never by newest-mtime alone: mtime alone handed a freshly spawned worker its PREDECESSOR's answer in the same case directory, which is worse than saying nothing because an agent cannot tell a stale answer from a fresh one. The `DSH_HOME` override reaches the reader through the narrow `Session.deepSeekHomeOverride` getter rather than an `envOverrides` accessor, since that map can hold provider credentials; it is ephemeral by design (never persisted), so a session that overrode it and outlived a server restart resolves the default tree and reads as "nothing said yet". Tests: `test/deepseek-transcript.test.ts`.
⚠️ **This is also what makes dsh the one non-claude mode the `codeman` agent skill drives like claude** (`skills/codeman/preamble.sh`, preamble 1.20.0): with a real end-of-turn signal AND a real transcript, `spawn_workers alpha beta:deepseek` is a mixed fleet in one call and `sendwait`/`last_text` need no per-mode variant. Two traps are handled in the preamble rather than left to the agent. **Readiness is not the stop signal**: the harness reports `idle` at BOOT roughly 300 ms before its composer paints (measured 2.26 s vs 2.56 s after spawn, twice), so a send-and-wait fired straight after `quick-start` resolves on the boot edge, reports a turn that never ran, and strands the prompt in a pane that was not yet accepting input — `spawn_worker`'s dsh branch gates on the composer glyph (`❯`, overridable via `DSH_READY_MARK`) instead, after which the boot edge is spent and unobservable. And `sendwait` asks for `wait:"stop,exit"` rather than the `wait:true` default set, because that set also carries `idle`, which for any external CLI is inferred from output stabilization: on a dsh worker whose TUI repaints rarely, a re-wait resolved in 0 ms with `signal:"idle"` on a turn that had three minutes left to run. The skill also sends `deepSeekConfig.permissionMode: 'danger-full-access'` for its own workers, matching what the Run button sends, because the harness default still asks and a worker parked on an approval row cannot finish a fan-out (the multi-user clamp still applies).
⚠️ **The resolver needs the strictest identity probe of any CLI**, because `dsh` is not merely a squattable npm name: Debian ships an unrelated `dsh` (dancer's shell, `apt install dsh`) that would answer a version probe convincingly. `probeDeepSeekVersion()` therefore checks `dsh --help` against `DEEPSEEK_IDENTITY_REGEX` (`DeepSeek Harness`) FIRST and only then reads a version, and `test/deepseek-cli-resolver.test.ts` pins both the rejection and the VITEST hermeticity gate with a real executable fixture. `DEEPSEEK_VERSION_REGEX` keeps the prerelease tail (`0.1.1-rc.2`), since truncating it would report an rc as a release; it is shared with the `dsh` dependency-registry entry so doctor and run mode agree about the version even though the resolver is stricter about identity.
Model is NOT a session field: it is a composition entry in the profile's config tree (`agent-default-model`), configured in `~/.dsh/settings.yaml` + `cordis.patch.yml`, so both create paths deliberately resolve no model for this mode. Env allowlist: `DSH_*` + `DEEPSEEK_*`; provider keys named by a settings-file `apiKeyEnv` stay OUT, which is pi's 34-provider-key problem in a new shape and gets the same answer. Docker seeds `~/.dsh` per-file (`.env`, `settings.yaml`, `cordis.patch.yml`) and the image installs its OWN profile, because `profiles/` is a per-profile `node_modules` tree — host-arch-specific and far too large to copy per container start. Stays OUT of `isAltScreenStripMode()` (third-party fullscreen TUI — the opencode case). ⚠️ `classifyProfile()` reads the profile's BUNDLES, and "unknown means launchable" is deliberate (anyone can publish an app bundle), but it has one knowably-wrong case: `readProfile()` returns an empty bundle list for a `package.json` with no `dsh.profile.bundles`, which made the SHIPPED `web`/`headless` profiles look third-party and launchable. The directory name is therefore consulted as a LAST resort (`STOCK_NON_INTERACTIVE_PROFILES`), after the bundle patterns, so real bundle evidence always wins over a name the user chose. The loose `tui` arm carries word boundaries for the same reason: it decides which profile boots by default, and matching the middle of `intuition` is not a rule anyone could predict. ⚠️ The generated shim is written **temp + rename**, not in place: the TUI can be exec'ing that exact path while an upgraded Codeman refreshes it, and a half-written file is a syntax error the caller then retries four times per state change forever. Bump `SHIM_VERSION` whenever `SHIM_SOURCE` changes, or an existing shim keeps matching the embedded marker and is never refreshed. Availability via `GET /api/deepseek/status`, the widest per-CLI status shape (`available`/`runnable`/`path`/`version`/`dshHome`/`defaultProfile`/`profiles`); `POST /api/deepseek/install-profile` bootstraps a profile and is the only endpoint in Codeman that installs third-party code — regex-confined specifier, argv-array spawn, privileged grant required in multi-user mode, and the held-open request is bounded by a HAND-ROLLED timeout over a `detached: true` process group (negative-pid SIGTERM→SIGKILL, as `runGit()` does in git-clone.ts). ⚠️ Node's own `spawn` `timeout` is NOT enough: a plugin install fans out into package-manager children, the built-in timeout signals only the direct child, and the survivors hold the inherited stdio pipes open so `close` never fires and the request leaks forever. User guide: `docs/deepseek-integration.md`. Tests: `test/deepseek-mode.test.ts`, `test/deepseek-cli-resolver.test.ts`.
+63 -15
View File
@@ -14,7 +14,7 @@ terminal agent:
| Profile | What it is | Can Codeman run it in a tab? |
| ------------ | --------------------------------- | ---------------------------- |
| `web` | the browser UI, served on :3080 | no — but see §5 |
| `web` | the browser UI, served on :3080 | no — but see §6 |
| `headless` | answers one task and exits | no |
| (`base`) | the shared core, no app at all | no |
@@ -199,21 +199,72 @@ Codeman's allowlist is global, so admitting them would widen it for every mode a
once. Authenticate those the way dsh does, from the file or the server's own
environment.
## 5. The web UI as a tab
## 5. Reading a session back, and driving one as a worker
dsh writes a real transcript — `$DSH_HOME/sessions/<mangled-cwd>/<id>/session.jsonl.zstd`
— so `GET /api/sessions/:id/last-response` reads that rather than segmenting the
pane, and the Response Viewer shows a dsh conversation the way it shows a claude
or codex one (`?context=full` returns prompt / response / tool blocks).
Reading the pane instead is not merely coarse for this mode, it is wrong: dsh-TUI
paints a full-screen splash, so the segmenter answered a `last-response` call for
a fresh dsh session with its ASCII-art logo — which anything polling for a
worker's first answer reads as an answer. Three things about the file shaped the
reader (`src/deepseek-transcript.ts`):
- **It is one zstd FRAME per append, not one zstd stream.** `zstd -dc` decodes all
of them, Node's `zlib` zstd decoder stops at the first: a real 56-line
transcript came back as 1 line. The reader walks frame headers itself. On a Node
older than 22.15 (no zstd at all) the mode falls back to the pane, as before.
- **Not every `user/message` is the user.** Each turn also records a
plugin-sourced runtime-context snapshot; only `source.kind === 'user'` is a
prompt.
- **A failed turn is not an empty one.** `turn/end` carries the provider's error,
which is returned as `Turn error: …` (and an early stop such as `max-tokens` as
`Turn ended: …`) instead of an empty string that reads as "still thinking".
The transcript reader applies to **local** dsh sessions only. A Docker case's
harness writes its transcript inside the container's own `~/.dsh` (the workspace
bind mount does not cover it), and a remote-SSH case's lives on the remote host,
so the local reader could never find those files — such sessions keep the pane
segmenter, coarse but real. The splash caveat above applies to them accordingly.
### As an agent worker
Because dsh has both halves — a real end-of-turn signal and a real transcript — an
agent can drive a dsh session the same way it drives a claude one, and the bundled
`codeman` agent skill does. Spawning `beta:deepseek` in its worker list gives a
worker that is tasked, waited on and read with the same calls as its claude
siblings; no other external CLI mode qualifies. Two edges are worth repeating here:
- **Readiness is not the stop signal.** The harness reports `idle` at boot roughly
300 ms *before* the composer paints (measured 2.26 s vs 2.56 s after spawn), so a
send-and-wait fired immediately after create resolves on that boot report,
reports a turn that never ran, and leaves the prompt in a pane that was not yet
accepting input. Wait for the composer (`❯`) instead.
- **Wait on `stop`, not on the default signal set.** That set also carries `idle`,
which for every external CLI is inferred from output stabilization; a dsh TUI
that repaints rarely reads as idle mid-turn.
## 6. The web UI as a tab
The browser UI is the one interactive surface DeepSeek ships itself, so it gets a
shortcut rather than a run mode: **Run ▸ DeepSeek web UI…** starts
`dsh web --no-open --host 127.0.0.1 --port 3080 --trusted-host <codeman-host>` in
an ordinary shell session and opens `http://127.0.0.1:3080` as a Codeman web tab.
`dsh web --no-open --host 127.0.0.1 --port <free> --trusted-host <codeman-host>`
as a background child process (`src/deepseek-web-server.ts`, behind
`POST/GET/DELETE /api/deepseek/web`) and opens it as a Codeman web tab once the
server actually answers.
Nothing bespoke supervises it: the server is a normal shell session (visible,
scrollable, killable, dies with its tab) and the UI is a normal web tab. The
`--trusted-host` flag is load-bearing — dsh fences its `/api` behind a
browser-trust check on the request authority, and a Codeman web tab reaches it
through Codeman's own origin via the webview proxy, not directly. Without it the
page renders and every API call fails.
It is a child process rather than a shell session because the session version
opened a terminal tab nobody asked for on every click. What the session gave for
free is therefore explicit here: one instance with reuse, a restart when the
requested `--trusted-host` authority differs from the running one, a kill on
server stop, and captured boot output. The `--trusted-host` flag is load-bearing —
dsh fences its `/api` behind a browser-trust check on the request authority, and a
Codeman web tab reaches it through Codeman's own origin via the webview proxy, not
directly. Without it the page renders and every API call fails.
## 6. Docker and remote cases
## 7. Docker and remote cases
Docker cases work: the agent image installs `dsh` and bootstraps a `dsh-tui`
profile into the container. Profiles are deliberately **not** seeded from the
@@ -227,7 +278,7 @@ Remote SSH cases default to `dsh` through a login shell, which boots the remote
box's default profile. If the remote has several, name one with the per-host
`commands.deepseek` override — the local `deepSeekConfig` does not cross ssh.
## 7. What is not wired
## 8. What is not wired
Deliberately minimal, on the same reasoning as the grok integration: the harness
is a fast-moving developer preview and every flag added is a flag validated
@@ -237,9 +288,6 @@ forever.
- `dsh plugin` management beyond first-time profile install.
- The `headless` profile as a one-shot execution backend for Codeman's own
internal AI checks (today those are Claude-only).
- Reading `~/.dsh/sessions/**` into the response viewer, the way codex rollouts
are read back. DeepSeek sessions are JSONL and this is very achievable; it is
the highest-value follow-up.
- Model/provider selection from Session Options.
## Verified against
+121 -34
View File
@@ -47,7 +47,7 @@ later call opens with, and your first REAL call performs them anyway:
```bash
. "${XDG_CACHE_HOME:-$HOME/.cache}/codeman-agent-$CODEMAN_SESSION_ID.sh" 2>/dev/null
[ "${CODEMAN_PREAMBLE:-}" = 1.19.0 ] || { echo "preamble missing or stale; run the full §0 block"; exit 1; }
[ "${CODEMAN_PREAMBLE:-}" = 1.20.0 ] || { echo "preamble missing or stale; run the full §0 block"; exit 1; }
```
⚠️ **Never spend a Bash call on this check alone.** §1's block opens with this same
@@ -75,8 +75,8 @@ PRE="${XDG_CACHE_HOME:-$HOME/.cache}/codeman-agent-$CODEMAN_SESSION_ID.sh"
mkdir -p "$(dirname "$PRE")"
# Rewrite unless the file already ends with THIS version's stamp, so a stale or a
# half-written file self-heals here instead of costing you a round trip to rm it.
grep -qs '^CODEMAN_PREAMBLE=1.19.0$' "$PRE" || (umask 077; cat > "$PRE" <<'PREAMBLE'
# ---- Codeman agent preamble 1.19.0 (seeded by Codeman at session spawn; the SKILL.md §0 bootstrap rewrites it when missing or stale) ----
grep -qs '^CODEMAN_PREAMBLE=1.20.0$' "$PRE" || (umask 077; cat > "$PRE" <<'PREAMBLE'
# ---- Codeman agent preamble 1.20.0 (seeded by Codeman at session spawn; the SKILL.md §0 bootstrap rewrites it when missing or stale) ----
API="${CODEMAN_API_URL:?CODEMAN_API_URL not set; refusing to guess}"
SELF="${CODEMAN_SESSION_ID:?CODEMAN_SESSION_ID not set}"
# Credentials, cheapest first. Your session has usually INHERITED the server's
@@ -121,23 +121,53 @@ _composer_up() { # <sid> <timeoutMs> -> "true"/"false". `shift+tab` is the one
--data-urlencode 'match=shift+tab' --data-urlencode 'from=buffer' \
--data-urlencode "timeout=$2" | jq -r '.data.wait.matched // false'
}
_dsh_up() { # <sid> <timeoutMs> -> "true"/"false". The DeepSeek Harness TUI's
# composer glyph. Override with DSH_READY_MARK for a profile that draws another one.
"${CURL[@]}" -G "$API/api/v1/sessions/$1/wait-output" \
--data-urlencode "match=${DSH_READY_MARK:-❯}" --data-urlencode 'from=buffer' \
--data-urlencode "timeout=$2" | jq -r '.data.wait.matched // false'
}
# spawn_worker <caseName> [mode] -> session id on stdout, diagnostics on stderr.
# quick-start AND readiness in one call, with a strict contract: NON-EMPTY stdout means
# a READY claude worker in a hook-carrying case. Anything less is rc 1 with EMPTY
# stdout, and the half-spawned session is deleted here rather than handed back, because
# a worker that never drew its composer would eat the task prompt with its trust
# dialog. There is deliberately no pid poll: wait-output already blocks until the
# composer draws, and pid!=null proved startup, never readiness.
# a READY worker whose end-of-turn signal can be trusted -- a claude worker in a
# hook-carrying case, or a `deepseek` worker whose harness TUI drew its composer.
# Anything less is rc 1 with EMPTY stdout, and the half-spawned session is deleted here
# rather than handed back, because a worker that never drew its composer would eat the
# task prompt with its trust dialog. There is deliberately no pid poll: wait-output
# already blocks until the composer draws, and pid!=null proved startup, never readiness.
spawn_worker() {
local name="${1:?spawn_worker needs a case name}" mode="${2:-claude}" q sid cp r
# parentSessionId doubles the CURL header, so a spawn_worker copied off the shared
# curl (or a body someone rebuilt from this recipe) still carries its lineage.
# deepseek: ask for the same permission posture the Run button sends, because the
# harness's own default (`workspace-write`) still ASKS, and a worker that stops on
# an approval row is a worker no fan-out can finish. It is not an escalation --
# claude workers already spawn with permissions skipped, and in multi-user mode the
# server clamps this back to `workspace-write` for an owner without the grant.
# Spawn by hand (§5.1) when you want a worker that asks.
q=$("${CURL[@]}" -X POST "$API/api/v1/quick-start" -H 'Content-Type: application/json' \
-d "$(jq -nc --arg n "$name" --arg m "$mode" --arg p "$SELF" '{caseName:$n,mode:$m,parentSessionId:$p}')")
-d "$(jq -nc --arg n "$name" --arg m "$mode" --arg p "$SELF" \
'{caseName:$n,mode:$m,parentSessionId:$p}
+ (if $m == "deepseek" then {deepSeekConfig:{permissionMode:"danger-full-access"}} else {} end)')")
sid=$(jq -r 'if .success then .data.sessionId else empty end' <<<"$q")
# NOT retryable in a loop: every quick-start failure code is terminal (§5.1).
[ -n "$sid" ] || { jq -c '{error,errorCode}' <<<"$q" >&2; return 1; }
[ "$mode" = claude ] || { printf '%s\n' "$sid"; return 0; } # only claude draws a composer
if [ "$mode" = deepseek ]; then
# The one non-claude mode with REAL end-of-turn signals: its TUI reports
# idle/working/blocked to Codeman, so sendwait, until=stop and the Approvals
# Inbox all work here exactly as they do for claude. No hook file to vet
# (the bridge is env-injected, not a workspace file) and no trust dialog.
# ⚠️ Readiness is still not optional, and NOT interchangeable with the stop
# signal: the harness's boot report lands ~300ms BEFORE the composer paints
# (measured 2.26s vs 2.56s after spawn), so a sendwait fired straight after
# quick-start returns on that BOOT signal, reports a turn that never ran, and
# strands the prompt in a pane that was not yet taking input.
r=$(_dsh_up "$sid" 45000)
[ "$r" = true ] || { echo "dsh worker $sid never drew a composer: no pane-capable profile, a profile whose composer is not '${DSH_READY_MARK:-❯}' (set DSH_READY_MARK), or a harness that failed to boot -- check GET /api/v1/deepseek/status. Deleted it" >&2
delete_session "$sid" >/dev/null; return 1; }
printf '%s\n' "$sid"; return 0
fi
[ "$mode" = claude ] || { printf '%s\n' "$sid"; return 0; } # no other mode draws a composer to wait on
# The server installs hooks into every claude workspace now, so this grep normally
# passes; it stays because the install is gated on a setting the operator can turn
# off, remote sessions never get hooks, and a session created by an older server
@@ -166,19 +196,25 @@ spawn_worker() {
delete_session "$sid" >/dev/null; return 1; }
printf '%s\n' "$sid"
}
# spawn_workers <caseName>... -> one "<caseName> <sessionId>" line per worker, in order;
# the sessionId column is EMPTY for a spawn that failed (stderr has why). CONCURRENT:
# N workers cost about what one costs. Spawning them one Bash call at a time is the
# single biggest avoidable delay in this skill. Names must be UNIQUE: two workers in
# one case directory co-edit the same tree (§4), so a repeat is an error here, not a race.
# spawn_workers <caseName[:mode]>... -> one "<caseName> <sessionId>" line per worker, in
# order; the sessionId column is EMPTY for a spawn that failed (stderr has why).
# CONCURRENT: N workers cost about what one costs. Spawning them one Bash call at a time
# is the single biggest avoidable delay in this skill. A bare name is a claude worker;
# `beta:deepseek` makes that one a DeepSeek Harness worker, and a mixed fleet is one
# call. Case names must be UNIQUE: two workers in one case directory co-edit the same
# tree (§4), so a repeat is an error here, not a race (the mode never disambiguates two
# workers, since they would still share the directory).
spawn_workers() {
local d n i=0
local d spec n m i=0
[ "$#" -gt 0 ] || { echo "spawn_workers: no case names given" >&2; return 1; }
[ -z "$(printf '%s\n' "$@" | sort | uniq -d)" ] || { echo "spawn_workers: duplicate case names" >&2; return 1; }
[ -z "$(printf '%s\n' "$@" | sed 's/:.*//' | sort | uniq -d)" ] || { echo "spawn_workers: duplicate case names" >&2; return 1; }
d=$(mktemp -d "${TMPDIR:-/tmp}/codeman-spawn.XXXXXX") || return 1
for n in "$@"; do ( spawn_worker "$n" > "$d/$i" ) & i=$((i+1)); done
for spec in "$@"; do
n=${spec%%:*}; m=${spec#*:}; [ "$m" = "$spec" ] && m=claude
( spawn_worker "$n" "$m" > "$d/$i" ) & i=$((i+1))
done
wait
i=0; for n in "$@"; do printf '%s %s\n' "$n" "$(cat "$d/$i" 2>/dev/null)"; i=$((i+1)); done
i=0; for spec in "$@"; do printf '%s %s\n' "${spec%%:*}" "$(cat "$d/$i" 2>/dev/null)"; i=$((i+1)); done
rm -rf "$d"
}
# sendwait <sid> <prompt> [seq] -> blocks until that worker's turn ENDS (~10 min ceiling
@@ -194,27 +230,46 @@ spawn_workers() {
# (observed live). So the first wait is short; on its timeout a bare \r goes out (the
# missing Enter when the prompt is stranded, a no-op when the turn is genuinely
# running), then the ORIGINAL frame is resent unchanged, which the server takes as a
# tagged duplicate: it re-waits without retyping (§5.3). Trustworthy only for a claude
# worker spawn_worker handed back (hooks vetted); hook-less workspaces and other modes
# resolve on flapping idle: markers instead (§5.5).
# tagged duplicate: it re-waits without retyping (§5.3). Trustworthy for a worker
# spawn_worker handed back -- claude (hooks vetted) or deepseek (status bridge) --
# and for those only. Hook-less workspaces and the other modes resolve on flapping
# idle: markers instead (§5.5). ⚠️ A dsh worker running a profile that does not
# implement the status contract is the one case that LOOKS like claude but is not:
# it accepts the send and then burns both waits. One timeout on a dsh worker whose
# pane clearly finished means that profile, so switch that worker to markers.
sendwait() {
local sid="${1:?}" p="${2:?}" seq="${3:-$(date +%s)}" body r
# `wait:"stop,exit"`, never the `wait:true` default set: that set also carries
# `idle`, which is INFERRED from output stabilization and flaps mid-turn. On a
# dsh worker whose TUI repaints rarely the session reads `idle` while the model
# is still answering, and the re-wait below then resolved in 0 ms with
# `signal:"idle"` on a turn that had another three minutes to run (measured).
# A wait named after the end of a turn should only end with the turn, or with
# the worker. ⚠️ This is also what makes a wrong mode LOUD: the modes that
# cannot deliver `stop` answer 400 (before writing anything) instead of
# resolving on a flap, which is the answer that sends you to markers (§5.5).
body=$(jq -nc --arg p "$p" --arg c "$CID-$sid" --argjson s "$seq" \
'{input:($p+"\r"),useMux:true,clientId:$c,seq:$s,wait:true,waitTimeout:20000}')
'{input:($p+"\r"),useMux:true,clientId:$c,seq:$s,wait:"stop,exit",waitTimeout:20000}')
r=$("${CURL[@]}" -X POST "$API/api/v1/sessions/$sid/input" \
-H 'Content-Type: application/json' --data-binary "$body")
if jq -e '.data.delivered and .data.wait.timedOut' <<<"$r" >/dev/null 2>&1; then
"${CURL[@]}" -X POST "$API/api/v1/sessions/$sid/input" -H 'Content-Type: application/json' \
-d "$(jq -nc --arg c "$CID-$sid" --argjson s "$(date +%s)" \
'{input:"\r",useMux:true,clientId:$c,seq:$s}')" >/dev/null
# The resend is a tagged DUPLICATE, so the server skips the write and reports
# `delivered:false` for it -- truthfully, but about the wrong send. The first
# one delivered, so carry that forward, or §1's cleanup reads a completed turn
# as an undelivered one and keeps a finished worker forever.
r=$("${CURL[@]}" -X POST "$API/api/v1/sessions/$sid/input" \
-H 'Content-Type: application/json' --data-binary "$(jq -c '.waitTimeout=580000' <<<"$body")")
-H 'Content-Type: application/json' --data-binary "$(jq -c '.waitTimeout=580000' <<<"$body")" \
| jq -c 'if .success and (.data.wait.ended | not) then .data.delivered = true else . end')
fi
printf '%s\n' "$r"
}
# last_text <sid> [prev] -> that worker's last assistant message. Polled, because the
# transcript write LAGS the stop signal, and "some text exists" is not "THIS turn's
# text exists": right after a SECOND turn on the same worker the endpoint still serves
# last_text <sid> [prev] -> that worker's last assistant message (claude, codex and
# deepseek write a real transcript; the other modes have none, so read the terminal
# instead -- §5.4). Polled, because the transcript write LAGS the stop signal, and
# "some text exists" is not "THIS turn's text exists": right after a SECOND turn on the same worker the endpoint still serves
# the previous answer for a beat (observed live). When reading consecutive turns, pass
# the previous answer as [prev]: the poll then holds out for text that differs from it,
# falling back to whatever it last saw if the budget runs dry, so an honestly repeated
@@ -233,10 +288,10 @@ last_text() {
# The stamp is the LAST line on purpose (a truncated write leaves it unset) and is kept
# bare on purpose: the write condition above anchors on it with $, so an inline comment
# here would fail that match and rewrite this file on every single bootstrap.
CODEMAN_PREAMBLE=1.19.0
CODEMAN_PREAMBLE=1.20.0
PREAMBLE
)
. "$PRE"; [ "${CODEMAN_PREAMBLE:-}" = 1.19.0 ] || { echo "preamble at $PRE is stale or truncated: rm it and re-run this block"; exit 1; }
. "$PRE"; [ "${CODEMAN_PREAMBLE:-}" = 1.20.0 ] || { echo "preamble at $PRE is stale or truncated: rm it and re-run this block"; exit 1; }
```
Every later Bash call that touches the API starts with the same two loader lines from
@@ -287,8 +342,9 @@ and no per-call body to hand-build.
```bash
. "${XDG_CACHE_HOME:-$HOME/.cache}/codeman-agent-$CODEMAN_SESSION_ID.sh" 2>/dev/null # §0 loader
[ "${CODEMAN_PREAMBLE:-}" = 1.19.0 ] || { echo "preamble missing or stale; run the full §0 block"; exit 1; }
[ "${CODEMAN_PREAMBLE:-}" = 1.20.0 ] || { echo "preamble missing or stale; run the full §0 block"; exit 1; }
N=(alpha beta) # INVENT one fresh case name per worker; never list cases first
# (a name may carry a mode: `beta:deepseek`, see below)
T=('reply with one line: the absolute path of your working directory'
'reply with one line: your model name') # tasks, same order as N
@@ -353,6 +409,37 @@ Four things this block leans on, each one link away, no detour needed to run it:
- Each `sendwait` costs that worker one billed turn, as does every prompt you send it.
- Deleting the sessions does **not** remove the case directories: §5.14.
### DeepSeek Harness workers
The block above spawns claude workers. Any entry in `N` may instead name a mode
(`beta:deepseek`), and **a `deepseek` worker is driven by the same four verbs, with no
change to the rest of the block**: `spawn_workers` waits for its composer, `sendwait`
blocks on its real end-of-turn signal, `last_text` reads its answer, `delete_session`
removes it.
That is true of no other non-claude mode, and it is worth knowing why: the DeepSeek
Harness TUI reports `idle`/`working`/`blocked` to Codeman over the supervisor contract it
implements, so dsh is the one external CLI with definitive `stop`/`blocked` signals
instead of guessed-from-silence ones — and it writes a structured transcript, which is
what `last-response` reads for it. `shell`, `opencode`, `codex`, `gemini`, `antigravity`,
`pi` and `grok` have neither and still need markers ([§5.5](reference/verbs.md#55-markers-for-hook-less-workers)).
Three things to know before you spawn one:
- **It needs a pane-capable profile.** `dsh` ships only `web`/`headless`, so the terminal
agent is always an installed profile. `GET /api/v1/deepseek/status` answers both
questions separately (`available` = the binary, `runnable` = a profile that can drive a
pane); a spawn without one fails with `OPERATION_FAILED` rather than falling back.
- **Do not task it on the strength of a `stop` alone.** The harness reports `idle` at
boot ~300 ms *before* its composer paints (measured 2.26 s vs 2.56 s), so a `sendwait`
fired straight after `quick-start` resolves on that boot signal, reports a turn that
never ran, and leaves the prompt in a pane that was not yet taking input. Letting
`spawn_worker` gate on readiness is what steps past that edge; it is not optional.
- **A profile that does not implement the contract looks like a hang.** Codeman cannot
know at spawn time whether one does. The tell is a `sendwait` that times out on a
worker whose pane clearly finished: that profile is one of them, so drive it with
markers instead.
## 2. What do you want to do?
One row per job. Acting on this table alone is correct; the §5 links are the detail.
@@ -360,10 +447,10 @@ One row per job. Acting on this table alone is correct; the §5 links are the de
| I want to | Call | Detail |
|-----------|------|--------|
| start a worker **where the work is** | `POST /api/v1/quick-start {"caseName":…}`, which **creates** `~/codeman-cases/<name>` unless the name is already a case. Any other path (a git worktree): `POST /api/v1/sessions {"workingDir":…}` then `POST /api/v1/sessions/:id/interactive`. Both install hooks by default, so expect full signals in either, and **verify** rather than assume. N workers means N worktrees | [§5.1](reference/verbs.md#51-where-to-spawn) |
| know a new worker can accept a prompt | `GET .../wait-output?match=shift+tab&from=buffer` (urlencode the `+`) | [§5.2](reference/verbs.md#52-readiness) |
| deliver a task **and** know when it finished | `POST .../input` with `"input":"…\r"`, `clientId`, `seq`, `"wait":true`. Resolves on `stop`, so it is trustworthy only where the workspace **has hooks** (claude mode; installed by default, but the operator can disable it and remote sessions never get them). Costs the worker one billed turn | [§5.3](reference/verbs.md#53-send-a-task-and-wait) |
| know a new worker can accept a prompt | `GET .../wait-output?match=shift+tab&from=buffer` (urlencode the `+`); a `deepseek` worker draws `❯` instead, and its boot `stop` fires ~300 ms BEFORE that, so never read the signal as readiness | [§5.2](reference/verbs.md#52-readiness) |
| deliver a task **and** know when it finished | `POST .../input` with `"input":"…\r"`, `clientId`, `seq`, `"wait":true`. Resolves on `stop`, so it is trustworthy where the signal is real: claude mode with hooks (installed by default, but the operator can disable it and remote sessions never get them) and `deepseek` mode through its status bridge. Costs the worker one billed turn | [§5.3](reference/verbs.md#53-send-a-task-and-wait) |
| know a hook-less worker finished | it has no `stop`, and `wait:true` there resolves on flapping `idle` **without erroring**: make it print a split, unique marker and `wait-output` on that instead | [§5.5](reference/verbs.md#55-markers-for-hook-less-workers) |
| read the answer | `GET .../last-response`, **polled** (claude/codex only; empty for the other modes) | [§5.4](reference/verbs.md#54-read-the-answer) |
| read the answer | `GET .../last-response`, **polled** (claude, codex and deepseek write a transcript; empty for the other modes) | [§5.4](reference/verbs.md#54-read-the-answer) |
| know if it is alive | `GET .../wait?until=exit&timeout=1000`: an immediate `signal:"exit"` means dead. `status` and `pid` both lie | [§5.6](reference/verbs.md#56-alive-and-stuck) |
| know if it is stuck | `GET .../active-tools` and `GET .../run-summary` are structured and free; two `terminal?tail=` samples are the crude fallback | [§5.6](reference/verbs.md#56-alive-and-stuck) |
| make a runaway worker stop | `POST .../input {"input":"\u001b"}` (ESC, **no** `\r`). Deleting the session would destroy the conversation instead | [§5.7](reference/verbs.md#57-interrupt-without-destroying) |
@@ -464,7 +551,7 @@ these**; open the one row you actually hit.
| [5.1 Where to spawn](reference/verbs.md#51-where-to-spawn) | the work is **not** a fresh scratch case: a linked case, a git worktree, any path that already existed. Hooks are absent there, which silently breaks send-and-wait. The costliest mistake in this skill |
| [5.2 Readiness](reference/verbs.md#52-readiness) | a worker never drew its composer, or you need the trust-dialog ladder by hand |
| [5.3 Send a task and wait](reference/verbs.md#53-send-a-task-and-wait) | the `sendwait` body, its signals, and the duplicate-resend loop |
| [5.4 Read the answer](reference/verbs.md#54-read-the-answer) | `last_text` came back empty, or the mode is not claude/codex |
| [5.4 Read the answer](reference/verbs.md#54-read-the-answer) | `last_text` came back empty, or the mode is not claude/codex/deepseek |
| [5.5 Markers for hook-less workers](reference/verbs.md#55-markers-for-hook-less-workers) | the worker has no `stop` hook: synchronize on a split, unique printed marker |
| [5.6 Alive and stuck](reference/verbs.md#56-alive-and-stuck) | is it dead or just slow? `status` and `pid` both lie |
| [5.7 Interrupt without destroying](reference/verbs.md#57-interrupt-without-destroying) | a runaway worker you want to stop but keep |
+81 -26
View File
@@ -1,4 +1,4 @@
# ---- Codeman agent preamble 1.19.0 (seeded by Codeman at session spawn; the SKILL.md §0 bootstrap rewrites it when missing or stale) ----
# ---- Codeman agent preamble 1.20.0 (seeded by Codeman at session spawn; the SKILL.md §0 bootstrap rewrites it when missing or stale) ----
API="${CODEMAN_API_URL:?CODEMAN_API_URL not set; refusing to guess}"
SELF="${CODEMAN_SESSION_ID:?CODEMAN_SESSION_ID not set}"
# Credentials, cheapest first. Your session has usually INHERITED the server's
@@ -43,23 +43,53 @@ _composer_up() { # <sid> <timeoutMs> -> "true"/"false". `shift+tab` is the one
--data-urlencode 'match=shift+tab' --data-urlencode 'from=buffer' \
--data-urlencode "timeout=$2" | jq -r '.data.wait.matched // false'
}
_dsh_up() { # <sid> <timeoutMs> -> "true"/"false". The DeepSeek Harness TUI's
# composer glyph. Override with DSH_READY_MARK for a profile that draws another one.
"${CURL[@]}" -G "$API/api/v1/sessions/$1/wait-output" \
--data-urlencode "match=${DSH_READY_MARK:-❯}" --data-urlencode 'from=buffer' \
--data-urlencode "timeout=$2" | jq -r '.data.wait.matched // false'
}
# spawn_worker <caseName> [mode] -> session id on stdout, diagnostics on stderr.
# quick-start AND readiness in one call, with a strict contract: NON-EMPTY stdout means
# a READY claude worker in a hook-carrying case. Anything less is rc 1 with EMPTY
# stdout, and the half-spawned session is deleted here rather than handed back, because
# a worker that never drew its composer would eat the task prompt with its trust
# dialog. There is deliberately no pid poll: wait-output already blocks until the
# composer draws, and pid!=null proved startup, never readiness.
# a READY worker whose end-of-turn signal can be trusted -- a claude worker in a
# hook-carrying case, or a `deepseek` worker whose harness TUI drew its composer.
# Anything less is rc 1 with EMPTY stdout, and the half-spawned session is deleted here
# rather than handed back, because a worker that never drew its composer would eat the
# task prompt with its trust dialog. There is deliberately no pid poll: wait-output
# already blocks until the composer draws, and pid!=null proved startup, never readiness.
spawn_worker() {
local name="${1:?spawn_worker needs a case name}" mode="${2:-claude}" q sid cp r
# parentSessionId doubles the CURL header, so a spawn_worker copied off the shared
# curl (or a body someone rebuilt from this recipe) still carries its lineage.
# deepseek: ask for the same permission posture the Run button sends, because the
# harness's own default (`workspace-write`) still ASKS, and a worker that stops on
# an approval row is a worker no fan-out can finish. It is not an escalation --
# claude workers already spawn with permissions skipped, and in multi-user mode the
# server clamps this back to `workspace-write` for an owner without the grant.
# Spawn by hand (§5.1) when you want a worker that asks.
q=$("${CURL[@]}" -X POST "$API/api/v1/quick-start" -H 'Content-Type: application/json' \
-d "$(jq -nc --arg n "$name" --arg m "$mode" --arg p "$SELF" '{caseName:$n,mode:$m,parentSessionId:$p}')")
-d "$(jq -nc --arg n "$name" --arg m "$mode" --arg p "$SELF" \
'{caseName:$n,mode:$m,parentSessionId:$p}
+ (if $m == "deepseek" then {deepSeekConfig:{permissionMode:"danger-full-access"}} else {} end)')")
sid=$(jq -r 'if .success then .data.sessionId else empty end' <<<"$q")
# NOT retryable in a loop: every quick-start failure code is terminal (§5.1).
[ -n "$sid" ] || { jq -c '{error,errorCode}' <<<"$q" >&2; return 1; }
[ "$mode" = claude ] || { printf '%s\n' "$sid"; return 0; } # only claude draws a composer
if [ "$mode" = deepseek ]; then
# The one non-claude mode with REAL end-of-turn signals: its TUI reports
# idle/working/blocked to Codeman, so sendwait, until=stop and the Approvals
# Inbox all work here exactly as they do for claude. No hook file to vet
# (the bridge is env-injected, not a workspace file) and no trust dialog.
# ⚠️ Readiness is still not optional, and NOT interchangeable with the stop
# signal: the harness's boot report lands ~300ms BEFORE the composer paints
# (measured 2.26s vs 2.56s after spawn), so a sendwait fired straight after
# quick-start returns on that BOOT signal, reports a turn that never ran, and
# strands the prompt in a pane that was not yet taking input.
r=$(_dsh_up "$sid" 45000)
[ "$r" = true ] || { echo "dsh worker $sid never drew a composer: no pane-capable profile, a profile whose composer is not '${DSH_READY_MARK:-❯}' (set DSH_READY_MARK), or a harness that failed to boot -- check GET /api/v1/deepseek/status. Deleted it" >&2
delete_session "$sid" >/dev/null; return 1; }
printf '%s\n' "$sid"; return 0
fi
[ "$mode" = claude ] || { printf '%s\n' "$sid"; return 0; } # no other mode draws a composer to wait on
# The server installs hooks into every claude workspace now, so this grep normally
# passes; it stays because the install is gated on a setting the operator can turn
# off, remote sessions never get hooks, and a session created by an older server
@@ -88,19 +118,25 @@ spawn_worker() {
delete_session "$sid" >/dev/null; return 1; }
printf '%s\n' "$sid"
}
# spawn_workers <caseName>... -> one "<caseName> <sessionId>" line per worker, in order;
# the sessionId column is EMPTY for a spawn that failed (stderr has why). CONCURRENT:
# N workers cost about what one costs. Spawning them one Bash call at a time is the
# single biggest avoidable delay in this skill. Names must be UNIQUE: two workers in
# one case directory co-edit the same tree (§4), so a repeat is an error here, not a race.
# spawn_workers <caseName[:mode]>... -> one "<caseName> <sessionId>" line per worker, in
# order; the sessionId column is EMPTY for a spawn that failed (stderr has why).
# CONCURRENT: N workers cost about what one costs. Spawning them one Bash call at a time
# is the single biggest avoidable delay in this skill. A bare name is a claude worker;
# `beta:deepseek` makes that one a DeepSeek Harness worker, and a mixed fleet is one
# call. Case names must be UNIQUE: two workers in one case directory co-edit the same
# tree (§4), so a repeat is an error here, not a race (the mode never disambiguates two
# workers, since they would still share the directory).
spawn_workers() {
local d n i=0
local d spec n m i=0
[ "$#" -gt 0 ] || { echo "spawn_workers: no case names given" >&2; return 1; }
[ -z "$(printf '%s\n' "$@" | sort | uniq -d)" ] || { echo "spawn_workers: duplicate case names" >&2; return 1; }
[ -z "$(printf '%s\n' "$@" | sed 's/:.*//' | sort | uniq -d)" ] || { echo "spawn_workers: duplicate case names" >&2; return 1; }
d=$(mktemp -d "${TMPDIR:-/tmp}/codeman-spawn.XXXXXX") || return 1
for n in "$@"; do ( spawn_worker "$n" > "$d/$i" ) & i=$((i+1)); done
for spec in "$@"; do
n=${spec%%:*}; m=${spec#*:}; [ "$m" = "$spec" ] && m=claude
( spawn_worker "$n" "$m" > "$d/$i" ) & i=$((i+1))
done
wait
i=0; for n in "$@"; do printf '%s %s\n' "$n" "$(cat "$d/$i" 2>/dev/null)"; i=$((i+1)); done
i=0; for spec in "$@"; do printf '%s %s\n' "${spec%%:*}" "$(cat "$d/$i" 2>/dev/null)"; i=$((i+1)); done
rm -rf "$d"
}
# sendwait <sid> <prompt> [seq] -> blocks until that worker's turn ENDS (~10 min ceiling
@@ -116,27 +152,46 @@ spawn_workers() {
# (observed live). So the first wait is short; on its timeout a bare \r goes out (the
# missing Enter when the prompt is stranded, a no-op when the turn is genuinely
# running), then the ORIGINAL frame is resent unchanged, which the server takes as a
# tagged duplicate: it re-waits without retyping (§5.3). Trustworthy only for a claude
# worker spawn_worker handed back (hooks vetted); hook-less workspaces and other modes
# resolve on flapping idle: markers instead (§5.5).
# tagged duplicate: it re-waits without retyping (§5.3). Trustworthy for a worker
# spawn_worker handed back -- claude (hooks vetted) or deepseek (status bridge) --
# and for those only. Hook-less workspaces and the other modes resolve on flapping
# idle: markers instead (§5.5). ⚠️ A dsh worker running a profile that does not
# implement the status contract is the one case that LOOKS like claude but is not:
# it accepts the send and then burns both waits. One timeout on a dsh worker whose
# pane clearly finished means that profile, so switch that worker to markers.
sendwait() {
local sid="${1:?}" p="${2:?}" seq="${3:-$(date +%s)}" body r
# `wait:"stop,exit"`, never the `wait:true` default set: that set also carries
# `idle`, which is INFERRED from output stabilization and flaps mid-turn. On a
# dsh worker whose TUI repaints rarely the session reads `idle` while the model
# is still answering, and the re-wait below then resolved in 0 ms with
# `signal:"idle"` on a turn that had another three minutes to run (measured).
# A wait named after the end of a turn should only end with the turn, or with
# the worker. ⚠️ This is also what makes a wrong mode LOUD: the modes that
# cannot deliver `stop` answer 400 (before writing anything) instead of
# resolving on a flap, which is the answer that sends you to markers (§5.5).
body=$(jq -nc --arg p "$p" --arg c "$CID-$sid" --argjson s "$seq" \
'{input:($p+"\r"),useMux:true,clientId:$c,seq:$s,wait:true,waitTimeout:20000}')
'{input:($p+"\r"),useMux:true,clientId:$c,seq:$s,wait:"stop,exit",waitTimeout:20000}')
r=$("${CURL[@]}" -X POST "$API/api/v1/sessions/$sid/input" \
-H 'Content-Type: application/json' --data-binary "$body")
if jq -e '.data.delivered and .data.wait.timedOut' <<<"$r" >/dev/null 2>&1; then
"${CURL[@]}" -X POST "$API/api/v1/sessions/$sid/input" -H 'Content-Type: application/json' \
-d "$(jq -nc --arg c "$CID-$sid" --argjson s "$(date +%s)" \
'{input:"\r",useMux:true,clientId:$c,seq:$s}')" >/dev/null
# The resend is a tagged DUPLICATE, so the server skips the write and reports
# `delivered:false` for it -- truthfully, but about the wrong send. The first
# one delivered, so carry that forward, or §1's cleanup reads a completed turn
# as an undelivered one and keeps a finished worker forever.
r=$("${CURL[@]}" -X POST "$API/api/v1/sessions/$sid/input" \
-H 'Content-Type: application/json' --data-binary "$(jq -c '.waitTimeout=580000' <<<"$body")")
-H 'Content-Type: application/json' --data-binary "$(jq -c '.waitTimeout=580000' <<<"$body")" \
| jq -c 'if .success and (.data.wait.ended | not) then .data.delivered = true else . end')
fi
printf '%s\n' "$r"
}
# last_text <sid> [prev] -> that worker's last assistant message. Polled, because the
# transcript write LAGS the stop signal, and "some text exists" is not "THIS turn's
# text exists": right after a SECOND turn on the same worker the endpoint still serves
# last_text <sid> [prev] -> that worker's last assistant message (claude, codex and
# deepseek write a real transcript; the other modes have none, so read the terminal
# instead -- §5.4). Polled, because the transcript write LAGS the stop signal, and
# "some text exists" is not "THIS turn's text exists": right after a SECOND turn on the same worker the endpoint still serves
# the previous answer for a beat (observed live). When reading consecutive turns, pass
# the previous answer as [prev]: the poll then holds out for text that differs from it,
# falling back to whatever it last saw if the budget runs dry, so an honestly repeated
@@ -155,4 +210,4 @@ last_text() {
# The stamp is the LAST line on purpose (a truncated write leaves it unset) and is kept
# bare on purpose: the write condition above anchors on it with $, so an inline comment
# here would fail that match and rewrite this file on every single bootstrap.
CODEMAN_PREAMBLE=1.19.0
CODEMAN_PREAMBLE=1.20.0
+15 -7
View File
@@ -237,7 +237,10 @@ minutes, never retry the credential.
flushed slightly *after* the `stop` hook fires, so a read taken the instant the wait
returns is too early (verified live: empty on the first call, full prose seconds later).
It is also `""` before the worker's first completed turn, and permanently `""` for
`shell`, `opencode`, `gemini`, `antigravity`, `pi`, `grok` and `deepseek`, which write no Claude transcript.
`shell`, `opencode`, `gemini`, `antigravity`, `pi` and `grok`, which write no transcript at
all. `deepseek` is NOT one of those — it is read from `$DSH_HOME/sessions/**` and lags
for the same reason claude does (the harness finalizes the assistant message just after
it reports `idle`), so poll it the same way.
**Fix** Poll it, bounded (10 tries, 1 s apart). If it is still empty on a hook-less mode,
that is expected, not a failure: read `terminal?tail=` and strip ANSI instead.
@@ -279,7 +282,7 @@ than into an existing checkout.
| start case + session in one call | `POST /api/v1/quick-start` |
| create a session in an arbitrary directory (no case, **no PTY**, id at `.data.session.id`) | `POST /api/v1/sessions`, then `POST /api/v1/sessions/:id/interactive` or `.../shell` to start it, see [Starting a worker](#starting-a-worker) |
| send input | `POST /api/v1/sessions/:id/input` |
| **read a worker's answer** (claude/codex) | `GET /api/v1/sessions/:id/last-response` → `.data.{text,timestamp}`, clean transcript text, no TUI noise. ⚠️ **Poll it**, see [symptom 7](#7-last-response-returns-an-empty-string-right-after-stop) |
| **read a worker's answer** (claude/codex/deepseek) | `GET /api/v1/sessions/:id/last-response` → `.data.{text,timestamp}`, clean transcript text, no TUI noise. ⚠️ **Poll it**, see [symptom 7](#7-last-response-returns-an-empty-string-right-after-stop) |
| read terminal (tail is in **BYTES**, raw ANSI) | `GET /api/v1/sessions/:id/terminal?tail=3000` → `.data.terminalBuffer`, for *diagnosis* (unsubmitted prompt?), not for reading answers |
| full tmux scrollback (context bomb; post-mortems only) | `GET /api/v1/sessions/:id/terminal?full=1` |
| background agents, one session | `GET /api/v1/sessions/:id/subagents` |
@@ -321,7 +324,7 @@ on signals and markers for exactly this reason.
⚠️ `GET /api/v1/sessions/:id/output` → `.data.textOutput` looks like the obvious read
but stays **empty for interactive tmux-backed sessions** (it is fed only by the legacy
JSON-stream path). Verified empty on live claude and shell sessions. Use
`last-response` for claude/codex answers; only fall back to `terminal?tail=` for
`last-response` for claude/codex/deepseek answers; only fall back to `terminal?tail=` for
hook-less modes, or to diagnose a prompt that was never submitted, and strip ANSI:
```bash
@@ -640,10 +643,14 @@ block, so a linked case or a raw `workingDir` had no hooks at all. `POST
session-create path installs hooks regardless of how the directory got there. See
[symptom 8](#8-send-and-wait-resolves-instantly-with-signalidle-and-the-answer-is-last-turns).
Default `until` set: `stop,idle,exit`. On non-claude modes the server silently drops
`stop`/`blocked` from the *default* set (echoed back as `wait.until`, e.g.
Default `until` set: `stop,idle,exit`. On modes with no hook signals the server silently
drops `stop`/`blocked` from the *default* set (echoed back as `wait.until`, e.g.
`["idle","exit"]` on shell); requesting them *explicitly* there is a 400 naming the
mode. ⚠️ That 400 is about **mode**, so a hooks-less *claude* session accepts
mode. ⚠️ `deepseek` is not one of those: its harness reports its own lifecycle, so it
keeps the full default set and accepts an explicit `until=stop`. ⚠️ For dsh the answer is
per-SESSION rather than per-mode — a session created with `statusReporting: false` has no
bridge, and an explicit `until=stop` there is a 400 naming that setting. ⚠️ That 400 is
otherwise about **mode**, so a hooks-less *claude* session accepts
`until=stop` happily and then never resolves it. ⚠️ On hook-less modes the lifecycle
signals are also **coarse in practice**: a
short shell command produced **no** `idle` transition within 60 s (verified live), so
@@ -791,7 +798,8 @@ for environment and setup problems.
| `CODEMAN_MUX` unset but you seem to be in a session | remote-SSH case: the env vars are not exported there. Fail closed, refuse to act |
| connection refused from inside a container | a loopback-bound server is unreachable from a container, and `CODEMAN_DOCKER_BRIDGE_HOOKS=1` does **not** fix that: it opens a hooks-only listener, so hook events start flowing but `/api/v1/*` stays refused. Driving the API from inside a Docker case needs a reachable bind (an operator decision); report it, don't retry |
| wait routes 404 on a valid session id | read the `.error` text: a `Route ...` prefix means the server predates the wait endpoints (< 1.13.0; a dev build can serve them while reporting an older version, so probe, never version-compare), poll `terminal?tail=` and say so. `Session ... not found` means your id is wrong, not the server |
| wait on `stop` never resolves | non-claude mode, or hooks not reaching the server (Docker/remote), or a case created by Codeman < 1.13.0 against an `--https` install (its hook curls lacked `-k` and TLS-failed silently; a 1.13.0+ server rewrites them the next time a session starts in that case). Use markers or `idle,exit` |
| wait on `stop` never resolves | a mode with no hook signals, or hooks not reaching the server (Docker/remote), or a case created by Codeman < 1.13.0 against an `--https` install (its hook curls lacked `-k` and TLS-failed silently; a 1.13.0+ server rewrites them the next time a session starts in that case). Use markers or `idle,exit` |
| wait on `stop` never resolves, on a **dsh** worker whose pane clearly finished | that profile does not implement the harness's supervisor contract, which Codeman cannot detect at request time (an unrecognized profile is treated as launchable on purpose). The wait is accepted and then times out. Drive that worker with markers, or switch to a profile that reports — `@deepseek-harness-tui/dsh-tui` does |
| new claude worker ignores its first prompt | it was showing the first-run trust dialog and Codeman's auto-accept did not fire (it is bounded by a 90 s window and an attempt cap); use the readiness recipe in SKILL.md, wait for `shift+tab` first, accept the dialog only as the bounded fallback |
| readiness burns its whole budget, then the worker answers fine anyway | you matched `bypass`, which is the statusline of ONE permission mode. Codeman spawns `--dangerously-skip-permissions` by default, but the server's `claudeMode` setting also has `auto` (`auto mode on`), `allowedTools` and `normal` (both `don't ask on`), and the effective per-session value is not exposed on `GET /api/v1/sessions/:id`. Match **`shift+tab`** instead: every mode's status bar ends `(shift+tab to cycle)` (measured per mode against claude-cli 2.1.226). Expect `blocked` signals mid-turn on the non-default modes |
| ANSI escapes survive the strip pipeline | `sed -e 's/\x1b…'` on macOS: `\x1b` is GNU-only, BSD sed matches nothing and strips nothing. Use the `ESC=$(printf '\033')` form above |
+54 -1
View File
@@ -188,7 +188,7 @@ for _ in $(seq 1 10); do
done
printf '%s\n' "$TXT"
# (.data is {text,timestamp}; text is also "" before the first completed turn and
# always "" for shell/opencode/gemini/antigravity/pi/grok/deepseek, which have no transcript, use
# always "" for shell/opencode/gemini/antigravity/pi/grok, which have no transcript, use
# the terminal tail there, and here only to diagnose an unsubmitted prompt.)
# 6. clean up: exact id, own list only, through the fail-closed preamble helper
@@ -198,6 +198,59 @@ delete_session "$SID"
Increment `SEQ` for every *new* input to the same worker. Reuse the same `SEQ` only to
re-ask about the same delivery (the duplicate-wait loop above).
## Flow 1b: DeepSeek Harness worker, end to end
A `deepseek` worker is driven with the same four verbs as a claude one, because the
harness reports its own lifecycle: its `stop` is a real end-of-turn signal, and its
answer comes from a real transcript. The differences are all at the edges.
```bash
# 0. Is there anything to spawn? `available` is the binary, `runnable` is a profile
# that can drive a pane -- dsh ships only web/headless, so the two differ.
"${CURL[@]}" "$API/api/v1/deepseek/status" | jq -c '{available:.data.available,runnable:.data.runnable,profile:.data.defaultProfile}'
# 1. Spawn. `deepSeekConfig` is optional: an absent profile picks the first
# pane-capable one, and an absent permissionMode leaves the harness on its own
# workspace-write default, which still ASKS before it acts.
Q=$("${CURL[@]}" -X POST "$API/api/v1/quick-start" -H 'Content-Type: application/json' \
-d '{"caseName":"dsh-worker","mode":"deepseek","deepSeekConfig":{"permissionMode":"danger-full-access"}}')
SID=$(jq -r 'if .success then .data.sessionId else empty end' <<<"$Q")
[ -n "$SID" ] || { jq -c '{error, errorCode}' <<<"$Q"; exit 1; } # OPERATION_FAILED = no runnable profile
CREATED+=("$SID")
# 2. Readiness, and ONLY readiness. ⚠️ Do not use the stop signal for this: the
# harness reports idle at BOOT, ~300 ms before the composer paints.
"${CURL[@]}" -G "$API/api/v1/sessions/$SID/wait-output" \
--data-urlencode 'match=❯' --data-urlencode 'from=buffer' --data-urlencode 'timeout=45000' \
| jq -e '.data.wait.matched' >/dev/null || { echo "no composer"; delete_session "$SID"; exit 1; }
# 3. Task it. Identical to a claude worker, including the \r and the (clientId, seq).
"${CURL[@]}" -X POST "$API/api/v1/sessions/$SID/input" -H 'Content-Type: application/json' \
-d '{"input":"Read calc.py and tell me in one sentence whether add() is correct.\r","useMux":true,"clientId":"codeman-dsh-1","seq":1,"wait":"stop,exit","waitTimeout":300000}' \
| jq -c '{delivered:.data.delivered,signal:.data.wait.signal,timedOut:.data.wait.timedOut}'
# 4. Read it. From $DSH_HOME/sessions/**, not the pane -- scraping a dsh pane returns
# its ASCII-art splash. Poll: the harness finalizes the message just after it
# reports idle. Two answers are not the model's words and say so:
# "Turn error: …" (the provider or harness failed) and "Turn ended: …" (early stop).
for _ in $(seq 1 15); do
TXT=$("${CURL[@]}" "$API/api/v1/sessions/$SID/last-response" | jq -r '.data.text')
[ -n "$TXT" ] && break; sleep 1
done
printf '%s\n' "$TXT"
# 5. Full conversation, if you need the tool calls too:
# "${CURL[@]}" "$API/api/v1/sessions/$SID/last-response?context=full" | jq -r '.data.messages[]|"[\(.label)] \(.text)"'
delete_session "$SID"
```
⚠️ **`wait:"stop,exit"`, not `wait:true`.** The default set also carries `idle`, which
for an external CLI is inferred from output stabilization: a dsh TUI that repaints
rarely reads as idle mid-turn, and a wait carrying `idle` then resolves in 0 ms on a
turn with minutes left to run (measured). The same reason the preamble's `sendwait`
asks for `stop,exit` on every mode.
## Flow 2: shell worker, marker-synchronized
`shell` sessions have no hooks (`stop`/`blocked` are a 400 there), and their lifecycle
+40 -9
View File
@@ -152,7 +152,19 @@ It is **decoration, and resolved rather than trusted**, so treat it accordingly:
### 5.2 Readiness
A new session reports `idle` before its CLI has spawned, and a brand-new case shows a
**dsh workers first**, because their trap is the opposite of claude's: they have no
trust dialog and boot straight into a composer (`❯`, matched `from=buffer`), but the
harness reports `idle` — which reaches you as a `stop` signal — about 300 ms BEFORE that
composer paints (measured 2.26 s vs 2.56 s after spawn, twice). So the signal that means
"this worker finished its turn" is also the first thing it emits at boot, and a
send-and-wait fired straight after `quick-start` resolves on it, reports a turn that
never ran, and leaves the prompt in a pane that was not yet taking input. Wait for the
composer, not for the signal; `spawn_worker` does exactly that, and by the time it
returns the boot edge is spent (signals are edge-triggered, so nothing can catch it
later). A profile whose composer is not `❯` needs `DSH_READY_MARK` set to whatever it
does draw.
For claude: a new session reports `idle` before its CLI has spawned, and a brand-new case shows a
**trust dialog** first, so neither "wait for idle" nor "wait for ❯" means ready (the
trust dialog contains `❯` too, observed live). Codeman auto-accepts that dialog
itself, reliably enough that stage 1 usually just works: `_maybeAcceptTrustDialog()`
@@ -341,17 +353,35 @@ If the loop exhausts its cap, do not keep looping: read the terminal, report wha
see, and remember that a still-typed-but-unsubmitted prompt (missing `\r`) can only be
recovered by submitting it with `{"input":"\r"}`.
⚠️ `stop` and `blocked` fire for `claude` sessions only (they are Claude Code hooks,
and only when the workspace actually has them, see [§5.1](#51-where-to-spawn)). On
`shell`/`opencode`/`codex`/`gemini`/`antigravity`/`pi`/`grok`/`deepseek`, requesting them explicitly is a
⚠️ `stop` and `blocked` fire for `claude` sessions (they are Claude Code hooks, and
only when the workspace actually has them, see [§5.1](#51-where-to-spawn)) **and for
`deepseek`** — the one external CLI that reports its own lifecycle, so its `stop` is a
real end-of-turn signal rather than a guess. On
`shell`/`opencode`/`codex`/`gemini`/`antigravity`/`pi`/`grok`, requesting them explicitly is a
400, and lifecycle transitions there are coarse (a short shell command may emit **no**
`idle` transition at all, verified live), so synchronize those with markers.
⚠️ A dsh session can still refuse them for a per-SESSION reason: `statusReporting:
false` at create time disarms the bridge, and an explicit `until=stop` is then a 400
naming that setting. And a `stop` that is *accepted* is not proof it will ever fire —
whether the installed profile implements the supervisor contract cannot be known at
request time, so a non-conforming one accepts the wait and times out on it. One timeout
on a dsh worker whose pane clearly finished identifies that profile; switch it to
markers.
### 5.4 Read the answer
For `claude` and `codex` workers this is the read path: `last-response` returns the
agent's final message as clean text, taken from the transcript rather than the screen,
so it carries none of the TUI's box-drawing or repaint noise.
For `claude`, `codex` and `deepseek` workers this is the read path: `last-response`
returns the agent's final message as clean text, taken from the transcript rather than
the screen, so it carries none of the TUI's box-drawing or repaint noise.
⚠️ For `deepseek` it reads `$DSH_HOME/sessions/**`, and reading it is the ONLY way to
get that answer: dsh-TUI paints a full-screen splash, so scraping its pane returns the
ASCII-art logo (that is what `last-response` itself used to return for dsh). Two dsh
answers are not the model's words and say so: `Turn error: …` (the provider or the
harness failed the turn) and `Turn ended: …` (an early stop such as `max-tokens`). A
turn still streaming reads back as the partial answer so far, so a non-empty read is
not by itself proof the turn ended — that is what the `stop` signal is for.
```bash
for _ in $(seq 1 10); do # the transcript write LAGS the stop signal
@@ -369,9 +399,10 @@ from the transcript file, which is flushed slightly *after* the `stop` hook fire
single read taken the instant send-and-wait returns comes back `""` even though the
turn finished (verified live: empty on the first call, full text seconds later). `text`
is also `""` before the worker's first completed turn, and always `""` for modes with
no transcript (`shell`, `opencode`, `gemini`, `antigravity`, `pi`, `grok`, `deepseek`; the first four
no transcript (`shell`, `opencode`, `gemini`, `antigravity`, `pi`, `grok`; the first four
verified live, pi from the same source path), which is
why the loop above is bounded rather than open-ended. Fall back to the terminal buffer
why the loop above is bounded rather than open-ended. A dsh worker lags too, for its own
reason: the harness finalizes the assistant message just after it reports `idle`. Fall back to the terminal buffer
there, tail in **bytes** (`textOutput` in `GET .../output` stays empty for interactive
sessions; don't use it):
+696
View File
@@ -0,0 +1,696 @@
/**
* @fileoverview Reading a DeepSeek Harness (`dsh`) session transcript off disk.
*
* ## Why this exists
*
* `GET /api/sessions/:id/last-response` is how an agent (and the Response
* Viewer) reads what a worker actually said. For Claude it comes from
* `~/.claude/projects/**`, for Codex from `~/.codex/sessions/**`, and for every
* other external CLI it comes from segmenting the terminal buffer, because
* those CLIs write nothing a reader could open.
*
* dsh is not in that last group: it writes a complete, structured JSONL
* transcript per session. Falling back to the pane for it was measurably wrong
* rather than merely coarse — dsh-TUI paints a full-screen splash, so the pane
* segmenter answered a `last-response` call for a fresh dsh session with the
* ASCII-art logo:
*
* {"text":"✦dsh-TUI v0.8.8█▀▀▀▄█▀▀▀▀█▀▀▀▀█▀▀▀▄█▀▀▀▀…","hasContext":true}
*
* which an agent polling for a worker's answer reads as an answer. This module
* is the real source: it locates the session's transcript, decodes it, and
* returns the last turn's text.
*
* ## The three things that make dsh transcripts unlike codex rollouts
*
* **1. One zstd FRAME per append, not one zstd stream.** The file is
* `session.jsonl.zstd`, and dsh appends by compressing each batch of lines into
* its own frame and writing it at the end. `zstd -dc` handles that (frames
* concatenate by definition), but Node's `zlib.zstdDecompress()` and
* `createZstdDecompress()` both stop at the first frame end: measured on a real
* 56-line transcript, Node returned 158 bytes / 1 line where the CLI returned
* 43,747 bytes / 56 lines. That is a silent truncation to the session header —
* every call would have reported "no answer yet" forever. `decodeZstdFrames()`
* below walks the frame headers itself and decompresses each frame, and
* `test/deepseek-transcript.test.ts` pins it against multi-frame fixtures.
*
* **2. The user's prompts are mixed with injected context.** Every turn also
* writes a `user/message` whose source is a plugin (the runtime-context
* snapshot: sandbox policy, approval policy, cwd). Those are `source.kind ===
* 'plugin'`; a real prompt is `source.kind === 'user'`. Rendering the plugin
* ones would show the agent its own boilerplate back as the user's words.
*
* **3. A failed turn is not an empty turn.** `turn/end` carries
* `reason.kind === 'error'` with the provider's message. Returning `""` there
* makes an agent poll `last-response` fifteen times and conclude the worker
* never answered, when the truth ("the provider rejected the request") was on
* disk the whole time. A turn that ends in an error and produced no text
* answers with that error, prefixed so it can never be mistaken for the model's
* own words.
*
* Verified against `dsh 0.1.1-rc.2` + `@deepseek-harness-tui/dsh-tui 0.8.8`.
*/
import { promises as fs } from 'node:fs';
import { homedir } from 'node:os';
import { join } from 'node:path';
import * as zlib from 'node:zlib';
/**
* One rendered block, in the shape the Response Viewer already speaks (see
* `web/response-viewer-transcript.ts`). Imported as a type only — this module
* must stay usable from the session layer without dragging web/ into it.
*/
export interface DeepSeekTranscriptBlock {
kind: 'prompt' | 'response' | 'status' | 'tool';
label: 'Prompt' | 'Response' | 'Status' | 'Tool';
role: 'user' | 'assistant';
text: string;
}
export interface DeepSeekTranscriptResult {
/** Last turn's answer (or its error, prefixed). Empty before the first turn. */
text: string;
/** ISO timestamp of the event `text` came from, or '' when unknown. */
timestamp: string;
/** Rendered blocks, oldest first. Only built when the caller asks for them. */
blocks: DeepSeekTranscriptBlock[];
/** dsh's own session id, from the header line. */
sessionId?: string;
/** Workspace the harness recorded for the session. */
cwd?: string;
}
/**
* zstd decompression is a RUNTIME capability here, not an import.
*
* Node grew `zlib` zstd support in 22.15 (and `@types/node` still does not
* declare it), while Codeman's floor is Node 22.0. So it is resolved through a
* narrow cast and checked before use: on an older 22.x a dsh session keeps the
* pane-segmenter behaviour it had before this module existed instead of
* throwing on every `last-response` call.
*/
type ZstdDecompressSync = (buf: Buffer) => Buffer;
const zstdDecompressSync: ZstdDecompressSync | undefined = (
zlib as unknown as { zstdDecompressSync?: ZstdDecompressSync }
).zstdDecompressSync;
/** Whether this Node can decode the compressed transcripts dsh writes. */
export function zstdSupported(): boolean {
return typeof zstdDecompressSync === 'function';
}
/** zstd frame magic (RFC 8878 §3.1.1). */
const ZSTD_MAGIC = 0xfd2fb528;
/** Skippable-frame magic range: 0x184D2A50..0x184D2A5F. */
const ZSTD_SKIPPABLE_LO = 0x184d2a50;
const ZSTD_SKIPPABLE_HI = 0x184d2a5f;
const DID_FIELD_SIZE = [0, 1, 2, 4];
const FCS_FIELD_SIZE = [0, 2, 4, 8];
/**
* Byte ranges of the zstd frames in `buf`, in order.
*
* Walks frame headers and block headers only — no decompression — so the cost
* is proportional to the number of blocks, not to the content. Stops (rather
* than throws) at the first thing it cannot parse, so a transcript still being
* appended to mid-write yields every whole frame before the torn tail instead
* of failing the whole read.
*
* ⚠️ Splitting on the magic bytes instead would be wrong: the 4-byte sequence
* can occur inside compressed data, and a false split corrupts everything after
* it. The block walk is what makes the boundaries exact.
*/
export function zstdFrameRanges(buf: Buffer): Array<[number, number]> {
const ranges: Array<[number, number]> = [];
let offset = 0;
while (offset + 4 <= buf.length) {
const magic = buf.readUInt32LE(offset);
if (magic >= ZSTD_SKIPPABLE_LO && magic <= ZSTD_SKIPPABLE_HI) {
if (offset + 8 > buf.length) break;
const end = offset + 8 + buf.readUInt32LE(offset + 4);
if (end > buf.length || end <= offset) break;
offset = end;
continue;
}
if (magic !== ZSTD_MAGIC) break;
let p = offset + 4;
if (p >= buf.length) break;
const descriptor = buf[p] as number;
p += 1;
const fcsFlag = descriptor >> 6;
const singleSegment = (descriptor >> 5) & 1;
const hasChecksum = (descriptor >> 2) & 1;
const dictIdFlag = descriptor & 3;
if (!singleSegment) p += 1; // window descriptor
p += DID_FIELD_SIZE[dictIdFlag] as number;
// FCS is absent for flag 0 UNLESS Single_Segment is set, where it is 1 byte.
p += fcsFlag === 0 ? (singleSegment ? 1 : 0) : (FCS_FIELD_SIZE[fcsFlag] as number);
if (p > buf.length) break;
let lastBlock = false;
let torn = false;
while (!lastBlock) {
if (p + 3 > buf.length) {
torn = true;
break;
}
const header = (buf[p] as number) | ((buf[p + 1] as number) << 8) | ((buf[p + 2] as number) << 16);
p += 3;
lastBlock = (header & 1) === 1;
const blockType = (header >> 1) & 3;
const blockSize = header >> 3;
if (blockType === 3) {
torn = true; // reserved: refuse rather than guess
break;
}
p += blockType === 1 ? 1 : blockSize; // RLE stores a single byte
if (p > buf.length) {
torn = true;
break;
}
}
if (torn) break;
if (hasChecksum) p += 4;
if (p > buf.length) break;
ranges.push([offset, p]);
offset = p;
}
return ranges;
}
/**
* Decode a possibly multi-frame zstd buffer. A buffer that does not start with
* a zstd magic is passed through unchanged, which is what lets the same reader
* open a plain `session.jsonl` (dsh writes one when compression is off).
*
* A frame that fails to decompress truncates the decode THERE rather than
* failing it: everything decoded before it is kept, so a half-written tail
* frame does not cost the caller the whole conversation. (Not "skipped" — a
* frame after a corrupt one is never reached, which is the safe reading: dsh
* appends, so a bad frame means everything after it is suspect too.)
*/
export function decodeZstdFrames(buf: Buffer): string {
if (buf.length < 4) return buf.toString('utf8');
const magic = buf.readUInt32LE(0);
if (magic !== ZSTD_MAGIC && (magic < ZSTD_SKIPPABLE_LO || magic > ZSTD_SKIPPABLE_HI)) {
return buf.toString('utf8');
}
if (!zstdDecompressSync) return '';
const parts: Buffer[] = [];
for (const [start, end] of zstdFrameRanges(buf)) {
try {
parts.push(zstdDecompressSync(buf.subarray(start, end)));
} catch {
// Torn or corrupt frame: keep what decoded before it.
break;
}
}
return Buffer.concat(parts).toString('utf8');
}
interface DshEvent {
type?: string;
seq?: number | null;
time?: number;
data?: Record<string, unknown>;
}
function asRecord(value: unknown): Record<string, unknown> | undefined {
return value && typeof value === 'object' && !Array.isArray(value) ? (value as Record<string, unknown>) : undefined;
}
function asArray(value: unknown): unknown[] {
return Array.isArray(value) ? value : [];
}
/**
* Strip a leaked reasoning prefix.
*
* Some providers stream reasoning into the same text block and close it with
* `</think>` without ever opening it (measured on a local deepseek-v4-flash
* route: `"I'll read the file first.</think>\n\nThe add function is…"`). The
* closing tag is the only reliable boundary, so everything up to the LAST one
* goes. A block with no tag is returned untouched.
*/
function stripReasoningPrefix(text: string): string {
const close = text.lastIndexOf('</think>');
return close === -1 ? text : text.slice(close + '</think>'.length);
}
/** `stripReasoning` is for ASSISTANT content only: a user prompt containing a
* literal `</think>` (someone pasting a transcript, say) must render whole. */
function textOfContent(content: unknown, stripReasoning = true): string {
const parts: string[] = [];
for (const entry of asArray(content)) {
const block = asRecord(entry);
if (!block) continue;
if (block.type === 'text' && typeof block.text === 'string') {
parts.push(stripReasoning ? stripReasoningPrefix(block.text) : block.text);
}
}
return parts.join('').trim();
}
function toolCallsOfContent(content: unknown): string[] {
const calls: string[] = [];
for (const entry of asArray(content)) {
const block = asRecord(entry);
if (!block || block.type !== 'tool-call') continue;
const name = typeof block.name === 'string' ? block.name : 'tool';
const args = typeof block.arguments === 'string' ? block.arguments : JSON.stringify(block.arguments ?? {});
calls.push(`${name}(${args})`);
}
return calls;
}
/** Flatten a `tool/result` message down to its text payload. */
function textOfToolResult(message: unknown): string {
const parts: string[] = [];
for (const entry of asArray(asRecord(message)?.content)) {
const block = asRecord(entry);
if (!block) continue;
if (block.type === 'text' && typeof block.text === 'string') parts.push(block.text);
if (block.type === 'tool-result') {
for (const inner of asArray(block.content)) {
const innerBlock = asRecord(inner);
if (innerBlock?.type === 'text' && typeof innerBlock.text === 'string') parts.push(innerBlock.text);
}
}
}
return parts.join('\n').trim();
}
function isoTime(time: unknown): string {
return typeof time === 'number' && Number.isFinite(time) ? new Date(time).toISOString() : '';
}
interface TurnAccumulator {
/** Finalized `assistant/message` text, in step order. */
finalized: Map<number, string>;
/** Steps that produced a finalized message AT ALL. ⚠️ Not the same as a
* non-empty entry in `finalized`: a step whose whole reply was reasoning
* strips to `''`, and without this the deltas — which are NOT stripped at
* write time — would be resurrected in its place, putting the model's raw
* `</think>` monologue in front of the caller (measured). */
finalizedSteps: Set<number>;
/** Streamed deltas per step, used only where no finalized message landed. */
streamed: Map<number, string>;
/** Step order as encountered, so a reply reads in the order it was produced. */
steps: number[];
timestamp: string;
/** Pre-rendered "Turn error: …" / "Turn ended: …" line, when the turn did not
* end with `completed`. */
ending?: string;
}
function ensureStep(turn: TurnAccumulator, step: number): void {
if (!turn.steps.includes(step)) turn.steps.push(step);
}
function turnText(turn: TurnAccumulator): string {
const parts: string[] = [];
for (const step of turn.steps) {
// Deltas are only consulted for a step the model never finalized — a step
// that has both would otherwise render its text twice.
const text = turn.finalizedSteps.has(step)
? (turn.finalized.get(step) ?? '')
: stripReasoningPrefix(turn.streamed.get(step) ?? '');
if (text.trim()) parts.push(text.trim());
}
return parts.join('\n\n').trim();
}
/**
* Parse a decoded dsh transcript.
*
* `text` is the LAST TURN's answer, not the last assistant message anywhere in
* the file: a turn that errored after an earlier turn answered must not hand
* back the earlier turn's text as though it were this turn's reply.
*/
export function parseDeepSeekTranscript(raw: string, options: { blocks?: boolean } = {}): DeepSeekTranscriptResult {
const wantBlocks = options.blocks === true;
const blocks: DeepSeekTranscriptBlock[] = [];
const turns = new Map<number, TurnAccumulator>();
const turnOrder: number[] = [];
let sessionId: string | undefined;
let cwd: string | undefined;
const getTurn = (n: number): TurnAccumulator => {
let turn = turns.get(n);
if (!turn) {
turn = { finalized: new Map(), finalizedSteps: new Set(), streamed: new Map(), steps: [], timestamp: '' };
turns.set(n, turn);
turnOrder.push(n);
}
return turn;
};
for (const line of raw.split('\n')) {
if (!line.trim()) continue;
let event: DshEvent;
try {
event = JSON.parse(line) as DshEvent;
} catch {
continue; // a torn tail line, or a frame we could not decode
}
const data = asRecord(event.data) ?? {};
const turnNo = typeof data.turn === 'number' ? data.turn : 0;
const stepNo = typeof data.step === 'number' ? data.step : 0;
switch (event.type) {
case 'session': {
const header = event as unknown as Record<string, unknown>;
if (typeof header.id === 'string') sessionId = header.id;
if (typeof header.cwd === 'string') cwd = header.cwd;
break;
}
case 'user/message': {
// ⚠️ Only a real prompt. The plugin-sourced twin is the runtime-context
// snapshot dsh injects every turn (sandbox policy, approvals, cwd).
if (asRecord(data.source)?.kind !== 'user') break;
if (!wantBlocks) break;
const text = textOfContent(data.content, false);
if (text) blocks.push({ kind: 'prompt', label: 'Prompt', role: 'user', text });
break;
}
case 'assistant/message': {
const message = asRecord(data.message);
const turn = getTurn(turnNo);
ensureStep(turn, stepNo);
const text = textOfContent(message?.content);
if (message) turn.finalizedSteps.add(stepNo);
if (text) {
turn.finalized.set(stepNo, text);
turn.timestamp = isoTime(event.time) || turn.timestamp;
if (wantBlocks) blocks.push({ kind: 'response', label: 'Response', role: 'assistant', text });
}
if (wantBlocks) {
for (const call of toolCallsOfContent(message?.content)) {
blocks.push({ kind: 'tool', label: 'Tool', role: 'assistant', text: call });
}
}
break;
}
case 'assistant/chunk': {
const chunk = asRecord(data.chunk);
if (chunk?.type !== 'text-delta' || typeof chunk.text !== 'string') break;
const turn = getTurn(turnNo);
ensureStep(turn, stepNo);
turn.streamed.set(stepNo, (turn.streamed.get(stepNo) ?? '') + chunk.text);
break;
}
case 'text-chunks': {
// The batched form of the same deltas (dsh coalesces once a stream gets
// going). ⚠️ These carry `seq: null`, so file order is the only order.
const turn = getTurn(turnNo);
ensureStep(turn, stepNo);
const texts = asArray(data.texts)
.filter((t): t is string => typeof t === 'string')
.join('');
if (texts) turn.streamed.set(stepNo, (turn.streamed.get(stepNo) ?? '') + texts);
break;
}
case 'tool/result': {
if (!wantBlocks) break;
const text = textOfToolResult(data.message);
if (text) blocks.push({ kind: 'tool', label: 'Tool', role: 'assistant', text });
break;
}
case 'turn/end': {
const turn = getTurn(turnNo);
const reason = asRecord(data.reason);
if (reason && reason.kind !== 'completed') {
// Two different things wear this field: a provider failure
// (`kind:'error'` with a message) and an ordinary early stop
// (`kind:'max-tokens'`, measured live). Calling the second one an
// error would misreport a truncated but real answer.
const error = asRecord(reason.error);
const message = typeof error?.message === 'string' ? error.message : undefined;
const kind = typeof reason.kind === 'string' ? reason.kind : 'unknown';
turn.ending = message ? `Turn error: ${message}` : `Turn ended: ${kind}`;
if (wantBlocks) {
blocks.push({ kind: 'status', label: 'Status', role: 'assistant', text: turn.ending });
}
}
turn.timestamp = isoTime(event.time) || turn.timestamp;
break;
}
default:
break;
}
}
const lastTurn = turnOrder.length > 0 ? turns.get(turnOrder[turnOrder.length - 1] as number) : undefined;
let text = lastTurn ? turnText(lastTurn) : '';
// A turn that failed and said nothing answers with its failure, labelled so
// it can never read as the model's own words. Without this an agent polls
// `last-response` fifteen times and concludes the worker never answered.
if (!text && lastTurn?.ending) text = lastTurn.ending;
return { text, timestamp: lastTurn?.timestamp ?? '', blocks, sessionId, cwd };
}
/**
* `$DSH_HOME` for one session: a per-session override wins (`DSH_HOME` is an
* allowlisted `envOverrides` prefix, and pointing a worker at its own profile
* tree is a documented thing to do), then the server's own environment, then
* `~/.dsh`. Reading the wrong tree does not fail loudly — it silently finds no
* transcript — so this must resolve exactly the way the spawn did.
*/
/* ⚠️ The override is EPHEMERAL: `envOverrides` is applied at spawn and exported
* through `tmux setenv`, but is deliberately not persisted to state.json (it can
* carry provider keys). A session that overrode `DSH_HOME` and then outlived a
* server restart therefore resolves to the default tree and finds no transcript
* — it reads as "nothing said yet" rather than as another session's answer,
* because every candidate is matched on its recorded `cwd`. */
export function resolveDeepSeekHome(session: { deepSeekHomeOverride?: string }): string {
const override = session.deepSeekHomeOverride;
if (override && override.trim()) return override.trim();
const fromEnv = process.env.DSH_HOME;
if (fromEnv && fromEnv.trim()) return fromEnv.trim();
return join(homedir(), '.dsh');
}
/**
* How far apart a session's start and its transcript's `createdAt` may be and
* still be the same session. dsh writes the header within ~2 s of pane start
* (measured); 60 s absorbs a cold profile boot without ever reaching a sibling
* started minutes later.
*/
const PAIRING_WINDOW_MS = 60_000;
/** Transcript file names dsh has used, newest convention first. */
const TRANSCRIPT_FILES = ['session.jsonl.zstd', 'session.jsonl'];
/**
* Locate the transcript for a session.
*
* dsh buckets sessions by a mangled cwd (`--home-you-code-app--`) and then by
* its own session id, and the id form has changed between versions (`<uuid>`
* and `session-<uuid>` both exist on disk here). ⚠️ So the mangling is NOT
* reproduced: every candidate's own header line carries `cwd`, which is
* authoritative, and matching on it is immune to the next naming change.
*
* Pairing a Codeman session with ITS transcript then has one hard rule and one
* ladder. The rule: a transcript created BEFORE this session started belongs to
* an earlier conversation in the same directory and is never eligible. Measured
* cost of getting that wrong — a freshly spawned worker answered its very first
* `last-response` with the PREVIOUS session's reply, which is worse than saying
* nothing, because an agent cannot tell a stale answer from a fresh one.
*
* The ladder, once the older ones are out:
*
* 1. a transcript whose header `createdAt` sits within `PAIRING_WINDOW_MS` of
* this session's start — that is this pane's own boot, and it stays right
* even when a sibling session is running in the same case directory;
* 2. otherwise the newest transcript created after this session started;
* 3. otherwise nothing.
*
* ⚠️ The boot transcript wins for as long as it exists on disk — deliberately,
* and even over a LATER transcript in the same workspace. Step 2 cannot tell a
* `/new` from a sibling session that started later in the same directory, so
* preferring newest-eligible would hand a worker its busier sibling's reply
* (the exact bug the hard rule above was measured against, one seat over).
* The cost of that choice: after an interactive `/new` in a dsh tab, this
* reader keeps serving the pre-`/new` conversation (the same session's own
* earlier turns — stale, never foreign); step 2 is reached only when no
* boot-window transcript exists. Worker fleets never `/new`, so they only
* ever see step 1.
*/
export async function findDeepSeekTranscript(options: {
dshHome: string;
workingDir: string;
startedAt?: number;
}): Promise<string | null> {
const sessionsDir = join(options.dshHome, 'sessions');
let buckets: string[];
try {
buckets = (await fs.readdir(sessionsDir, { withFileTypes: true }))
.filter((entry) => entry.isDirectory())
.map((entry) => entry.name);
} catch {
return null;
}
const candidates: Array<{ path: string; mtimeMs: number }> = [];
for (const bucket of buckets) {
const bucketPath = join(sessionsDir, bucket);
let sessions: string[];
try {
sessions = (await fs.readdir(bucketPath, { withFileTypes: true }))
.filter((entry) => entry.isDirectory())
.map((entry) => entry.name);
} catch {
continue;
}
for (const sessionDir of sessions) {
for (const file of TRANSCRIPT_FILES) {
const path = join(bucketPath, sessionDir, file);
const stat = await fs.stat(path).catch(() => null);
if (!stat || !stat.isFile() || stat.size === 0) continue;
candidates.push({ path, mtimeMs: stat.mtimeMs });
break;
}
}
}
if (candidates.length === 0) return null;
candidates.sort((a, b) => b.mtimeMs - a.mtimeMs);
const startedAt = options.startedAt ?? 0;
// Slack in both directions: the harness writes its header a beat after the
// pane starts, and mtimes on a shared clock are not worth trusting to the ms.
const floor = startedAt > 0 ? startedAt - PAIRING_WINDOW_MS : 0;
let laterMatch: string | null = null;
for (const candidate of candidates) {
const header = await readTranscriptHeader(candidate.path);
if (!header || header.cwd !== options.workingDir) continue;
// No usable header timestamp: fall back to the file's own mtime, which is
// still enough to keep a pre-session transcript out.
const createdAt = header.createdAt ?? candidate.mtimeMs;
if (createdAt < floor) continue;
if (startedAt > 0 && Math.abs(createdAt - startedAt) <= PAIRING_WINDOW_MS) return candidate.path;
if (!laterMatch) laterMatch = candidate.path;
}
return laterMatch;
}
/**
* Read only the first frame of a transcript, which is where the header line
* lives. Bounded: a candidate scan must never decompress every conversation on
* the box to answer one `last-response` call.
*/
async function readTranscriptHeader(path: string): Promise<{ cwd?: string; id?: string; createdAt?: number } | null> {
let handle;
try {
handle = await fs.open(path, 'r');
} catch {
return null;
}
try {
const head = Buffer.alloc(65536);
const { bytesRead } = await handle.read(head, 0, head.length, 0);
if (bytesRead === 0) return null;
const text = decodeZstdFrames(head.subarray(0, bytesRead));
const firstLine = text.split('\n').find((line) => line.trim());
if (!firstLine) return null;
const parsed = JSON.parse(firstLine) as { type?: string; cwd?: string; id?: string; createdAt?: number };
if (parsed.type !== 'session') return null;
return {
cwd: parsed.cwd,
id: parsed.id,
createdAt: typeof parsed.createdAt === 'number' ? parsed.createdAt : undefined,
};
} catch {
return null;
} finally {
await handle.close().catch(() => {});
}
}
/** Hard ceiling on a transcript read. A long agent run is a few hundred KB; a
* file past this is pathological and is not worth a synchronous decode. */
const MAX_TRANSCRIPT_BYTES = 64 * 1024 * 1024;
/**
* Memo of the last few decoded transcripts, keyed on (path, mtime, size,
* blocks). The skill's `last_text` polls once per second, and each poll used
* to zstdDecompressSync + reparse the WHOLE file on the event loop even when
* nothing had been appended — a multi-MB transcript made that a repeated
* ~100ms-class stall on the single-threaded server. A poll that finds the
* file unchanged now costs one stat. Insertion-order eviction; tiny, because
* an entry only earns its keep while a session is being actively polled.
*/
const parseMemo = new Map<string, DeepSeekTranscriptResult>();
const PARSE_MEMO_MAX = 16;
/** Test seam: a fixture that rewrites one path in place inside a single mtime
* tick would otherwise read its predecessor back out of the memo. */
export function resetDeepSeekTranscriptMemoForTest(): void {
parseMemo.clear();
}
/**
* Read one dsh session's last answer.
*
* ⚠️ The two empty outcomes are deliberately different, because the caller must
* treat them differently:
*
* - `null` means **this reader cannot run here** (a Node without zstd), and is
* the signal to fall back to the pane segmenter.
* - an empty `text` means **read fine, nothing said yet** — no transcript for
* this workspace, or a turn still in flight.
*
* Collapsing the two would put the ASCII-art splash back in front of an agent
* that is polling for a worker's first answer.
*/
export async function readDeepSeekLastResponse(
session: { workingDir: string; createdAt?: Date | number; deepSeekHomeOverride?: string },
options: { blocks?: boolean } = {}
): Promise<DeepSeekTranscriptResult | null> {
const createdAt = session.createdAt instanceof Date ? session.createdAt.getTime() : session.createdAt;
// dsh compresses by default, so a Node without zstd can read nothing here.
// That is the one case the pane is still the better answer.
if (!zstdSupported()) return null;
const empty: DeepSeekTranscriptResult = { text: '', timestamp: '', blocks: [] };
const path = await findDeepSeekTranscript({
dshHome: resolveDeepSeekHome(session),
workingDir: session.workingDir,
startedAt: typeof createdAt === 'number' ? createdAt : undefined,
});
if (!path) return empty;
const stat = await fs.stat(path).catch(() => null);
if (!stat || stat.size > MAX_TRANSCRIPT_BYTES) return empty;
const memoKey = `${path}|${stat.mtimeMs}|${stat.size}|${options.blocks ? 1 : 0}`;
const memoized = parseMemo.get(memoKey);
if (memoized) return memoized;
let buf: Buffer;
try {
buf = await fs.readFile(path);
} catch {
return empty;
}
const result = parseDeepSeekTranscript(decodeZstdFrames(buf), options);
if (parseMemo.size >= PARSE_MEMO_MAX) {
const oldest = parseMemo.keys().next().value;
if (oldest !== undefined) parseMemo.delete(oldest);
}
parseMemo.set(memoKey, result);
return result;
}
+14
View File
@@ -907,6 +907,20 @@ export class Session extends EventEmitter {
return this._deepSeekConfig?.statusReporting;
}
/**
* This session's `DSH_HOME` override, if it set one.
*
* Deliberately ONE key rather than an `envOverrides` getter: the map can hold
* provider credentials (`DEEPSEEK_API_KEY`, `GEMINI_API_KEY`, …) and is
* kept off the public `SessionState` for exactly that reason. The transcript
* reader needs the profile tree's location and nothing else, so that is all
* this exposes.
*/
get deepSeekHomeOverride(): string | undefined {
const value = this._envOverrides?.DSH_HOME;
return value && value.trim() ? value.trim() : undefined;
}
/** Owning username in multi-user mode, else undefined. */
get owner(): string | undefined {
return this._owner;
+30
View File
@@ -141,6 +141,7 @@ import {
isExternalCliTranscriptMode,
parseExternalCliTranscript,
} from '../response-viewer-transcript.js';
import { readDeepSeekLastResponse } from '../../deepseek-transcript.js';
// Path to linked-cases registry (same file used by case-routes resolveCasePath)
const LINKED_CASES_FILE = dataPath('linked-cases.json');
@@ -2031,6 +2032,35 @@ export function registerSessionRoutes(
return await readCodexLastResponse(session, codexQuery.context === 'full');
}
// DeepSeek Harness writes a real structured transcript under
// `$DSH_HOME/sessions/**`, so read that rather than segmenting the pane.
// ⚠️ For dsh the pane fallback is not merely coarse, it is WRONG: dsh-TUI
// paints a full-screen splash, and the segmenter served its ASCII-art logo
// back as the worker's answer (measured), which an agent polling for a
// reply reads as a reply. So an EMPTY transcript result still wins over the
// pane — "nothing said yet" is the honest answer. Only `null`, meaning a
// Node too old to decode zstd, falls through to the segmenter below.
// ⚠️ Local sessions only: a docker case's harness writes its transcript
// inside the CONTAINER's ~/.dsh (the workspace bind-mount does not cover
// it) and a remote-SSH case's lives on the remote host, so the local
// reader would scan a $DSH_HOME that can never hold this session's file
// and return "nothing said yet" forever — an agent polling that worker
// would starve on an answer that exists. Those configurations keep the
// pane segmenter below: coarse, but the real conversation.
if (session.mode === 'deepseek' && !session.docker && !session.remote) {
const deepSeekQuery = req.query as { context?: string };
const full = deepSeekQuery.context === 'full';
const transcript = await readDeepSeekLastResponse(session, { blocks: full });
if (transcript) {
return {
text: transcript.text,
timestamp: transcript.timestamp,
hasContext: transcript.text.length > 0 || transcript.blocks.length > 0,
messages: full ? transcript.blocks : undefined,
};
}
}
// OpenCode / Gemini / Antigravity / Pi render their own TUIs and write no
// Claude transcript, so the scan below finds nothing and the response viewer
// renders permanently empty for them. Segment the terminal buffer instead —
+31 -9
View File
@@ -26,11 +26,20 @@
* external CLIs: those lists exist to describe what `isExternalCliMode()` gates
* (no Claude transcript, no hooks, no Claude-format parsers), so naming some but
* not all of them is the drift itself. Runs of one or two modes are exempt, since
* a legitimate pair ("claude or shell") is not a class claim. ONE exception is
* allowed and it is a real one: the "writes no transcript" lists drop `codex`,
* which does write a rollout Codeman reads back (the pane carries a unique
* originator precisely so `last-response` can find it), so external-minus-codex
* is a meaningful class rather than an oversight.
* a legitimate pair ("claude or shell") is not a class claim. The exceptions are
* the REAL classes inside the external family, each one a capability some of those
* CLIs have and the rest do not:
*
* - "writes no transcript" drops `codex` (a rollout Codeman reads back) and
* `deepseek` (a JSONL session file Codeman reads back);
* - "delivers no hook signals" drops `deepseek`, whose harness reports its own
* lifecycle -- that one is derived from `hooksAvailableForMode()` rather than
* restated, so the predicate and the prose cannot drift apart;
* - the positive twin of the first: the modes whose answers CAN be read.
*
* Anything else partial is still the drift. A NEW backend belongs to none of these
* classes until someone says so, so every one of them grows by a mode and every
* stale list fails here -- which is the whole point.
*
* Port: N/A (pure static analysis).
*/
@@ -41,6 +50,7 @@ import { fileURLToPath } from 'node:url';
import { join } from 'node:path';
import { CreateSessionSchema, QuickStartSchema } from '../src/web/schemas.js';
import { isExternalCliMode } from '../src/session.js';
import { hooksAvailableForMode } from '../src/web/session-wait-registry.js';
import type { SessionMode } from '../src/types/session.js';
const HERE = fileURLToPath(new URL('.', import.meta.url));
@@ -63,6 +73,15 @@ function schemaModes(schema: typeof CreateSessionSchema | typeof QuickStartSchem
const MODES = schemaModes(CreateSessionSchema);
const EXTERNAL_MODES = MODES.filter(isExternalCliMode);
/**
* External modes whose ANSWERS Codeman can read: codex from its rollout,
* deepseek from `$DSH_HOME/sessions/**`. Stated here rather than derived because
* `last-response` branches per mode into a per-CLI reader and there is no single
* predicate to import; the runtime facts are `readCodexLastResponse` and
* `readDeepSeekLastResponse` in session-routes.ts.
*/
const TRANSCRIPT_EXTERNAL_MODES = new Set<string>(['codex', 'deepseek']);
/**
* Mode tokens appearing back to back, separated only by list punctuation — `a|b|c`,
* `a`/`b`/`c`, "`a`, `b` and `c`". Newlines collapse to spaces first so a wrapped list
@@ -109,9 +128,12 @@ describe('agent skill run-mode lists', () => {
it('never enumerates a partial set of external CLI modes', () => {
const complete = new Set<string>(EXTERNAL_MODES);
/** The documented exception: codex writes a rollout, so it is absent from the
* "no transcript" lists on purpose. Every OTHER external mode must still be there. */
const withoutCodex = new Set<string>(EXTERNAL_MODES.filter((m) => m !== 'codex'));
// The real classes inside the family (see the fileoverview). Each is derived, so
// an eighth backend joins none of them and every list naming the other seven fails.
const noTranscript = new Set<string>(EXTERNAL_MODES.filter((m) => !TRANSCRIPT_EXTERNAL_MODES.has(m)));
const withTranscript = new Set<string>(EXTERNAL_MODES.filter((m) => TRANSCRIPT_EXTERNAL_MODES.has(m)));
const noHookSignals = new Set<string>(EXTERNAL_MODES.filter((m) => !hooksAvailableForMode(m)));
const allowed = [complete, noTranscript, withTranscript, noHookSignals];
const sameSet = (a: Set<string>, b: Set<string>) => a.size === b.size && [...a].every((v) => b.has(v));
const offenders: string[] = [];
@@ -121,7 +143,7 @@ describe('agent skill run-mode lists', () => {
if (listed.length < 3) continue;
const externals = new Set<string>(listed.filter(isExternalCliMode));
// Empty is fine (a claude/shell-only list); partial is the drift.
if (externals.size === 0 || sameSet(externals, complete) || sameSet(externals, withoutCodex)) continue;
if (externals.size === 0 || allowed.some((set) => sameSet(externals, set))) continue;
const missing = EXTERNAL_MODES.filter((m) => !externals.has(m));
offenders.push(`${file}: "${run.trim()}" is missing ${missing.join(', ')}`);
}
+12
View File
@@ -267,6 +267,18 @@ describe('DeepSeek status bridge', () => {
expect(server).toContain("if (!session || session.mode !== 'claude') return;");
});
it('keeps the transcript reader off docker and remote-SSH sessions', () => {
// A docker case's harness writes its transcript inside the CONTAINER's
// ~/.dsh and a remote-SSH case's lives on the remote host, so the local
// reader would scan a $DSH_HOME that can never hold the file and return
// "nothing said yet" forever — starving an agent that polls the worker.
// Those sessions must keep the pane segmenter. Static, because standing up
// a docker/remote session in the unit harness is exactly what the tmux
// test-mode mocks exist to avoid.
const routes = readFileSync(join(process.cwd(), 'src/web/routes/session-routes.ts'), 'utf-8');
expect(routes).toMatch(/session\.mode === 'deepseek' && !session\.docker && !session\.remote/);
});
it('maps the harness lifecycle states onto real hook events', () => {
expect(DEEPSEEK_STATE_TO_HOOK_EVENT.idle).toBe('stop');
expect(DEEPSEEK_STATE_TO_HOOK_EVENT.blocked).toBe('permission_prompt');
+395
View File
@@ -0,0 +1,395 @@
/**
* Reading a DeepSeek Harness session transcript.
*
* Two of these assertions exist because the obvious implementation was measured
* to be wrong against real files:
*
* - dsh appends ONE ZSTD FRAME PER WRITE, and Node's `zlib` zstd decoder stops
* at the first frame end. A 56-line transcript decoded as 1 line / 158 bytes,
* which reads as "the worker never answered" rather than as an error. The
* multi-frame fixtures below are the guard.
* - a fresh worker in a case directory that had been used before answered its
* first `last-response` with the PREVIOUS session's reply. Session-to-
* transcript pairing is therefore its own describe block.
*/
import { describe, expect, it, beforeAll, afterAll } from 'vitest';
import { mkdtemp, mkdir, writeFile, rm, utimes } from 'node:fs/promises';
import { join } from 'node:path';
import { tmpdir } from 'node:os';
import * as zlib from 'node:zlib';
import {
decodeZstdFrames,
findDeepSeekTranscript,
parseDeepSeekTranscript,
readDeepSeekLastResponse,
resetDeepSeekTranscriptMemoForTest,
resolveDeepSeekHome,
zstdFrameRanges,
zstdSupported,
} from '../src/deepseek-transcript.js';
const zstdCompressSync = (zlib as unknown as { zstdCompressSync?: (b: Buffer) => Buffer }).zstdCompressSync;
/** Compress each line into its own frame — exactly how dsh appends. */
function framed(lines: string[]): Buffer {
if (!zstdCompressSync) throw new Error('zstd unavailable');
return Buffer.concat(lines.map((line) => zstdCompressSync(Buffer.from(`${line}\n`, 'utf8'))));
}
const sessionHeader = (cwd: string, createdAt: number, id = 'aaaaaaaa-bbbb-cccc-dddd-eeeeeeeeeeee') =>
JSON.stringify({ type: 'session', version: 0, id, createdAt, cwd, delegationDepth: 0 });
const userPrompt = (text: string) =>
JSON.stringify({
type: 'user/message',
data: { content: [{ type: 'text', text }], source: { kind: 'user' }, role: 'user' },
});
const pluginContext = (text: string) =>
JSON.stringify({
type: 'user/message',
data: { content: [{ type: 'text', text }], source: { kind: 'plugin', plugin: '@deepseek-ai/dsh-system-prompt' } },
});
const assistantMessage = (text: string, turn = 1, step = 1, time = 1_700_000_000_000) =>
JSON.stringify({
type: 'assistant/message',
time,
data: { turn, step, message: { role: 'assistant', content: [{ type: 'text', text }] } },
});
const turnEnd = (turn: number, reason: Record<string, unknown>, time = 1_700_000_000_001) =>
JSON.stringify({ type: 'turn/end', time, data: { turn, reason } });
describe.skipIf(!zstdSupported())('zstd frame walking', () => {
it('decodes every frame, not just the first (the silent-truncation bug)', () => {
const lines = Array.from({ length: 40 }, (_, i) => JSON.stringify({ type: 'noise', seq: i }));
const buf = framed(lines);
// The one-shot decoder is what this module had to replace.
const oneShot = (zlib as unknown as { zstdDecompressSync?: (b: Buffer) => Buffer }).zstdDecompressSync!(buf);
expect(oneShot.toString('utf8').trim().split('\n')).toHaveLength(1);
expect(zstdFrameRanges(buf)).toHaveLength(40);
expect(decodeZstdFrames(buf).trim().split('\n')).toHaveLength(40);
});
it('round-trips a single-frame file', () => {
const buf = framed(['{"type":"session"}']);
expect(decodeZstdFrames(buf)).toBe('{"type":"session"}\n');
});
it('passes an uncompressed transcript straight through', () => {
const plain = Buffer.from('{"type":"session"}\n{"type":"turn/start"}\n', 'utf8');
expect(decodeZstdFrames(plain)).toBe('{"type":"session"}\n{"type":"turn/start"}\n');
});
it('keeps the whole frames before a torn tail instead of failing the read', () => {
const buf = framed(['{"a":1}', '{"b":2}', '{"c":3}']);
const torn = buf.subarray(0, buf.length - 4);
const decoded = decodeZstdFrames(torn);
expect(decoded).toContain('{"a":1}');
expect(decoded).toContain('{"b":2}');
expect(decoded).not.toContain('{"c":3}');
});
it('refuses to walk a buffer that is not zstd', () => {
expect(zstdFrameRanges(Buffer.from('not zstd at all', 'utf8'))).toEqual([]);
});
});
describe('parseDeepSeekTranscript', () => {
it('returns the last turn text and skips plugin-injected context', () => {
const raw = [
sessionHeader('/w', 1),
userPrompt('what is 2+2?'),
pluginContext('Current runtime context. This snapshot supersedes earlier snapshots.'),
assistantMessage('4.'),
turnEnd(1, { kind: 'completed' }),
].join('\n');
const result = parseDeepSeekTranscript(raw, { blocks: true });
expect(result.text).toBe('4.');
expect(result.cwd).toBe('/w');
expect(result.blocks.filter((b) => b.kind === 'prompt').map((b) => b.text)).toEqual(['what is 2+2?']);
expect(result.blocks.some((b) => b.text.includes('runtime context'))).toBe(false);
});
it('drops a leaked reasoning prefix at the closing tag', () => {
const raw = [
sessionHeader('/w', 1),
assistantMessage('I should read the file first.</think>\n\nThe add function is wrong.'),
turnEnd(1, { kind: 'completed' }),
].join('\n');
expect(parseDeepSeekTranscript(raw).text).toBe('The add function is wrong.');
});
it('renders tool calls and tool results as tool blocks', () => {
const raw = [
sessionHeader('/w', 1),
JSON.stringify({
type: 'assistant/message',
data: {
turn: 1,
step: 1,
message: {
role: 'assistant',
content: [
{ type: 'text', text: 'Reading it.' },
{ type: 'tool-call', id: 'c1', name: 'read', arguments: '{"file_path":"calc.py"}' },
],
},
},
}),
JSON.stringify({
type: 'tool/result',
data: {
turn: 1,
step: 1,
message: {
content: [{ type: 'tool-result', toolCallId: 'c1', content: [{ type: 'text', text: 'def add' }] }],
},
},
}),
assistantMessage('It subtracts instead of adding.', 1, 2),
turnEnd(1, { kind: 'completed' }),
].join('\n');
const result = parseDeepSeekTranscript(raw, { blocks: true });
expect(result.blocks.filter((b) => b.kind === 'tool').map((b) => b.text)).toEqual([
'read({"file_path":"calc.py"})',
'def add',
]);
// Both steps of the turn read back, in order.
expect(result.text).toBe('Reading it.\n\nIt subtracts instead of adding.');
});
it('uses streamed deltas only for a step the model never finalized', () => {
const raw = [
sessionHeader('/w', 1),
JSON.stringify({
type: 'assistant/chunk',
data: { turn: 1, step: 1, chunk: { type: 'text-delta', index: 0, text: 'Par' } },
}),
JSON.stringify({
type: 'text-chunks',
seq: null,
data: { turn: 1, step: 1, index: 0, texts: ['is is ', 'the'] },
}),
JSON.stringify({
type: 'assistant/chunk',
data: { turn: 1, step: 1, chunk: { type: 'text-delta', index: 0, text: ' capital.' } },
}),
].join('\n');
// Still streaming: the partial answer is readable.
expect(parseDeepSeekTranscript(raw).text).toBe('Paris is the capital.');
// Once finalized, the deltas must not be appended a second time.
const finalized = `${raw}\n${assistantMessage('Paris is the capital.')}\n${turnEnd(1, { kind: 'completed' })}`;
expect(parseDeepSeekTranscript(finalized).text).toBe('Paris is the capital.');
});
it('does not resurrect raw deltas for a step whose reply was all reasoning', () => {
// Measured on a real conversation: step 1 finalized as reasoning only, so
// its text stripped to '' and the (unstripped) deltas took its place,
// putting `</think>` and the monologue back in front of the caller.
const raw = [
sessionHeader('/w', 1),
JSON.stringify({
type: 'assistant/chunk',
data: { turn: 1, step: 1, chunk: { type: 'text-delta', index: 0, text: "I'll read the file.</think>\n\n" } },
}),
assistantMessage("I'll read the file.</think>\n\n", 1, 1),
assistantMessage('The add function is wrong.', 1, 2),
turnEnd(1, { kind: 'completed' }),
].join('\n');
expect(parseDeepSeekTranscript(raw).text).toBe('The add function is wrong.');
});
it('answers a failed turn with its error rather than the previous turn text', () => {
const raw = [
sessionHeader('/w', 1),
assistantMessage('First answer.', 1),
turnEnd(1, { kind: 'completed' }),
turnEnd(2, { kind: 'error', error: { message: '400: model does not support tools', code: 'INVALID_REQUEST' } }),
].join('\n');
expect(parseDeepSeekTranscript(raw).text).toBe('Turn error: 400: model does not support tools');
});
it('calls an early stop an ending, not an error, and keeps the text it did produce', () => {
const raw = [sessionHeader('/w', 1), assistantMessage('Most'), turnEnd(1, { kind: 'max-tokens' })].join('\n');
const result = parseDeepSeekTranscript(raw, { blocks: true });
expect(result.text).toBe('Most');
expect(result.blocks.map((b) => b.text)).toContain('Turn ended: max-tokens');
});
it('survives a torn last line', () => {
const raw = [sessionHeader('/w', 1), assistantMessage('Complete.'), '{"type":"turn/e'].join('\n');
expect(parseDeepSeekTranscript(raw).text).toBe('Complete.');
});
it('is empty for a session that has said nothing', () => {
expect(parseDeepSeekTranscript(sessionHeader('/w', 1)).text).toBe('');
});
});
describe('resolveDeepSeekHome', () => {
it('prefers the session override over the environment', () => {
const previous = process.env.DSH_HOME;
process.env.DSH_HOME = '/from-env';
try {
expect(resolveDeepSeekHome({ deepSeekHomeOverride: '/from-session' })).toBe('/from-session');
expect(resolveDeepSeekHome({})).toBe('/from-env');
} finally {
if (previous === undefined) delete process.env.DSH_HOME;
else process.env.DSH_HOME = previous;
}
});
it('falls back to ~/.dsh', () => {
const previous = process.env.DSH_HOME;
delete process.env.DSH_HOME;
try {
expect(resolveDeepSeekHome({})).toMatch(/\.dsh$/);
} finally {
if (previous !== undefined) process.env.DSH_HOME = previous;
}
});
});
describe.skipIf(!zstdSupported())('session-to-transcript pairing', () => {
let dshHome: string;
const workspace = '/home/tester/cases/worker-1';
const sessionStart = 1_800_000_000_000;
/** Write a transcript for `cwd`, created at `createdAt`, mtime `mtime`. */
async function writeTranscript(name: string, cwd: string, createdAt: number, mtime: number, answer?: string) {
const dir = join(dshHome, 'sessions', '--home-tester-cases-worker-1--', name);
await mkdir(dir, { recursive: true });
const lines = [sessionHeader(cwd, createdAt, name)];
if (answer) lines.push(assistantMessage(answer), turnEnd(1, { kind: 'completed' }));
const path = join(dir, 'session.jsonl.zstd');
await writeFile(path, framed(lines));
await utimes(path, new Date(mtime), new Date(mtime));
return path;
}
beforeAll(async () => {
dshHome = await mkdtemp(join(tmpdir(), 'dsh-home-'));
});
afterAll(async () => {
await rm(dshHome, { recursive: true, force: true });
});
it("never hands a fresh session its predecessor's answer", async () => {
await writeTranscript('older', workspace, sessionStart - 600_000, sessionStart - 590_000, 'stale answer');
const found = await findDeepSeekTranscript({ dshHome, workingDir: workspace, startedAt: sessionStart });
expect(found).toBeNull();
const result = await readDeepSeekLastResponse({
workingDir: workspace,
createdAt: sessionStart,
deepSeekHomeOverride: dshHome,
});
expect(result).not.toBeNull();
expect(result?.text).toBe('');
});
it('pairs on the boot window even when a sibling wrote more recently', async () => {
await writeTranscript('mine', workspace, sessionStart + 2_000, sessionStart + 2_000, 'my answer');
await writeTranscript('sibling', workspace, sessionStart + 300_000, sessionStart + 400_000, 'sibling answer');
const found = await findDeepSeekTranscript({ dshHome, workingDir: workspace, startedAt: sessionStart });
expect(found).toContain('/mine/');
const result = await readDeepSeekLastResponse({
workingDir: workspace,
createdAt: new Date(sessionStart),
deepSeekHomeOverride: dshHome,
});
expect(result?.text).toBe('my answer');
});
it('ignores a transcript recorded for another workspace', async () => {
const other = await mkdtemp(join(tmpdir(), 'dsh-home-'));
try {
const dir = join(other, 'sessions', '--home-tester-cases-worker-1--', 'foreign');
await mkdir(dir, { recursive: true });
await writeFile(
join(dir, 'session.jsonl.zstd'),
framed([sessionHeader('/somewhere/else', sessionStart + 1_000), assistantMessage('not yours')])
);
const found = await findDeepSeekTranscript({ dshHome: other, workingDir: workspace, startedAt: sessionStart });
expect(found).toBeNull();
} finally {
await rm(other, { recursive: true, force: true });
}
});
it('reads a transcript created later in the session (a /new conversation)', async () => {
const later = await mkdtemp(join(tmpdir(), 'dsh-home-'));
try {
const dir = join(later, 'sessions', '--home-tester-cases-worker-1--', 'after-new');
await mkdir(dir, { recursive: true });
await writeFile(
join(dir, 'session.jsonl.zstd'),
framed([
sessionHeader(workspace, sessionStart + 1_800_000),
assistantMessage('after /new'),
turnEnd(1, { kind: 'completed' }),
])
);
const result = await readDeepSeekLastResponse({
workingDir: workspace,
createdAt: sessionStart,
deepSeekHomeOverride: later,
});
expect(result?.text).toBe('after /new');
} finally {
await rm(later, { recursive: true, force: true });
}
});
it('reports an unreadable home as empty, not as an error', async () => {
const result = await readDeepSeekLastResponse({
workingDir: workspace,
createdAt: sessionStart,
deepSeekHomeOverride: join(tmpdir(), 'dsh-home-that-does-not-exist'),
});
expect(result).toEqual({ text: '', timestamp: '', blocks: [] });
});
it('serves an unchanged transcript from the memo and re-reads when the stat moves', async () => {
const home = await mkdtemp(join(tmpdir(), 'dsh-home-'));
try {
const dir = join(home, 'sessions', '--home-tester-cases-worker-1--', 'memo');
await mkdir(dir, { recursive: true });
const path = join(dir, 'session.jsonl');
const stamp = new Date(sessionStart + 1_000);
const read = () =>
readDeepSeekLastResponse({ workingDir: workspace, createdAt: sessionStart, deepSeekHomeOverride: home });
const body = (answer: string) =>
`${[sessionHeader(workspace, sessionStart + 1_000), assistantMessage(answer), turnEnd(1, { kind: 'completed' })].join('\n')}\n`;
resetDeepSeekTranscriptMemoForTest();
await writeFile(path, body('AAAA'));
await utimes(path, stamp, stamp);
expect((await read())?.text).toBe('AAAA');
// Same byte length, same forced mtime: indistinguishable from unchanged
// by stat, and deliberately served from the memo — the 1s/poll skill loop
// must not decode an unchanged file, and dsh only ever APPENDS, so a
// same-stat rewrite does not exist outside a test.
await writeFile(path, body('BBBB'));
await utimes(path, stamp, stamp);
expect((await read())?.text).toBe('AAAA');
// An append moves mtime (and normally size), which is the invalidation.
await utimes(path, new Date(sessionStart + 2_000), new Date(sessionStart + 2_000));
expect((await read())?.text).toBe('BBBB');
} finally {
await rm(home, { recursive: true, force: true });
}
});
});