Cross-coordination with flexsiebels/head (paul). m wants more style options
on /imagine/new; flexsiebels has the UI side ready to bump IMAGEN_STYLES
in lib/server/imagen.ts + schemas.ts as soon as the worker accepts them.
styles.yaml: 6 new entries with FLUX-friendly prompt fragments. No code
changes — Apply() and Styles() consume the embedded YAML directly, the
"enum" is dynamic.
prompt_test.go: extend TestStylesContainsAllExpected expectation list
(alphabetical, '3' < 'a' so 3d-render leads).
Total enum: 11 (5 existing + 6 new). flexsiebels delegation message 1669.
Path 1 architecture: one comfyui adapter, workflows as data.
- workflow_template.go: embed.FS + token substitution with type-preserving
whole-value placeholders. ${prompt} → string, ${seed} → int64,
${cfg} → float64 — no JSON round-tripping. Partial matches ignored.
- comfyui.go: refactored to load workflow from embedded FS or filesystem
path. Back-compat preserved: workflow: defaults to flux1-schnell.
- workflows/{flux1-schnell,flux2-klein,sd35-medium}.json — bundled
templates. flux1-schnell migrated from hardcoded with identical node IDs.
- compare.go: new `imagen compare` subcommand. Sequential N-backend run
(one GPU on mRock — parallel would OOM), per-backend PNG, sidecar JSON
with per-model metadata + errors, composite contact sheet via Go image
package (no ImageMagick dep).
- Sample config gains flux2-klein-local + sd35-medium-local instances.
- docs/backends.md: architecture rationale + per-model HF download paths
+ how to add a new bundled workflow + compare-harness reference.
Live smoke verified: compare mock + flux-schnell-local at 768×768 →
both PNGs written, sidecar JSON has workflow="flux1-schnell" + full
metadata, contact sheet renders. Worker contract (Request → Generate)
unchanged, so flexsiebels /imagine UI API surface preserved.
Tests: 11 existing comfyui + 6 new workflow_template + 5 new compare
tests, all green.
Adding a new model is now yaml + JSON, never Go.
Schema (applied via migration imagen_series_init):
- imagen.series parent table (prompt + params + count CHECK 1..10 + selected_image_id)
- imagen.jobs += series_id (FK) + series_idx
- imagen.images += series_id (FK)
- Owner-scoped RLS on series (SELECT/INSERT/UPDATE) + grants
- Partial indexes WHERE series_id IS NOT NULL on both child tables
Worker pipeline:
- worker.Job += SeriesID, populated from imagen.jobs.series_id via the
claim query.
- cloud.SyncRequest += SeriesID; insertRow writes series_id when non-empty,
omits the key when empty so solo runs leave the column NULL.
- maybeCloudSync threads seriesID from job.SeriesID through to the cloud
sink. generate.go (CLI) always passes "" — solo path unchanged.
Tests:
- worker: SeriesID propagates from Job to fakePipeline.lastJob unchanged,
solo job keeps it empty.
- cloud: SyncRequest.SeriesID lands as row.series_id in the POST body;
empty SeriesID omits the key entirely.
Refs ImaGen#9.
Async write path for the flexsiebels owner-mode UI: flexsiebels INSERTs into
imagen.jobs, the worker on mRiver claims pending rows via LISTEN/NOTIFY +
5s safety poll, runs the same generate pipeline imagen generate uses, and
writes the result through internal/cloud into imagen.images.
- Schema migration imagen_jobs_init: table + status CHECK + two indexes +
owner-scoped RLS + grants + AFTER INSERT trigger publishing on the
imagen_jobs channel via pg_notify.
- internal/worker: DB-agnostic loop over a Queue interface. Drains the
whole pending backlog on each wake. Job-scoped contexts are derived
from Background so SIGTERM lets the in-flight generation finish (no
half-state). ResetStaleRunning at startup unsticks rows left over from
a previous crash. Eight unit tests cover the done / failed / missing-id /
drain / NOTIFY-wake / shutdown / transient-error paths against a fake
queue (no real Postgres in CI).
- cmd/imagen/worker.go: pgx-backed Queue (one dedicated conn for LISTEN +
UPDATE), plus the workerPipeline that reuses buildBackend +
attachUsageSink + prompt.Apply + buildWriter + maybeCloudSync. The
per-job owner_user_id overrides the env-level fallback so each row in
imagen.images is attributed correctly.
- maybeCloudSync now returns (*cloud.SyncResult, error) so the worker can
link imagen.jobs.image_id to the inserted imagen.images row. The CLI
generate path keeps printing its stderr summary unchanged.
- scripts/imagen-worker.service + .env.example for the systemd --user unit
on mRiver. EnvironmentFile lives in ~/.dotfiles and is never committed.
- docs/setup-worker-mriver.md walks through installation + the spec's
SQL-INSERT smoke; docs/architecture.md grows an "async write path"
section.
- worker_integration_test.go (env-guarded by IMAGEN_WORKER_INTEGRATION=1)
drives one real job through the full pipeline against msupabase using
the mock backend, then verifies imagen.images + Storage object landed
and the row flipped to done with image_id linked. Verified end-to-end:
pickup latency ~7ms, total 74ms, failure path captures error text.
Every successful imagen generate now (a) uploads the PNG to the private
imagen-generated bucket and (b) inserts a row into imagen.images, the
data plane the flexsiebels owner-mode viewer reads from.
Schema, RLS, indexes, bucket and PostgREST exposure landed via four
applied migrations on msupabase: imagen_schema_init,
imagen_schema_grants, imagen_storage_policies, imagen_pgrst_expose
(authenticator role-level ALTER + reload). Owner UUID for m:
ac6c9501-3757-4a6d-8b97-2cff4288382b — documented in the config sample.
Code: new internal/cloud/ package mirroring the internal/usage/ shape.
PostgREST POST against the imagen schema (Accept-Profile + Content-
Profile headers), Storage upload via PUT with x-upsert, retry on 5xx /
transport but not 4xx, owner_user_id required (the column is NOT NULL
and the read-side RLS policy needs it).
Wiring in cmd/imagen/generate.go: --no-cloud flag, output.cloud_sync
config knob (auto|on|off mirroring --preview), $IMAGEN_CLOUD_SYNC env
override. The hook reads the just-written PNG + sidecar from disk and
calls cloud.Sync; failures emit "imagen: cloud sync: <err>" to stderr
without changing exit code, so a Supabase blip never loses the artefact.
output.Outputs grew Date/Slug/Seed fields so storage_path mirrors the
local filename's prefix exactly (no UTC-vs-local drift).
Config: owner_user_id field added; sample comment points at the
auth.users lookup. imagen config validate warns on stderr when
cloud_sync is on/auto but owner_user_id is empty.
Tests: cloud_test.go covers happy path, retry-on-5xx, no-retry-on-4xx,
missing-owner-uuid, missing-date-or-slug, signed URL, and the partial-
success case where the upload landed but the DB insert failed.
generate_test.go covers the precedence chain for cloud-sync mode
resolution. Build + tests clean across the tree.
Real smoke against mRock: generation through flux-schnell-local writes
the local PNG + sidecar AND uploads to imagen-generated/2026-05-11/...
AND inserts into imagen.images. Signed URL round-trips the same bytes.
--no-cloud verified to skip both Storage and DB.
Implements the Replicate API backend (FLUX schnell / FLUX dev) per ImaGen
issue #3:
- internal/backend/replicate.go — Backend adapter. Supports model
refs as "owner/name" (uses /v1/models/{owner}/{name}/predictions) and
"owner/name:hash" (uses /v1/predictions with explicit version). Polls
/v1/predictions/{id} every 500ms with model-aware timeout (60s schnell,
120s dev). Resilience: 401 names api_token_env, 429 with exp backoff
up to 3 retries (honours Retry-After), 5xx retries once, image
download retries once on transient failure.
- internal/backend/replicate_pricing.go — hardcoded per-image USD rates
for known FLUX models, snapshotted from replicate.com/pricing with a
refresh TODO.
- internal/backend/replicate_test.go — mocked-HTTP unit tests covering
happy path (model + version-pinned), 401, 429 retry policy, failed
prediction, poll timeout, image-download retry, ctx cancel, BackendOpts
passthrough, default_steps, aspect-ratio reduction, sha256 prompt hash.
- internal/usage/usage.go — Supabase REST sink + read-side query for
mai.imagen_usage. Adapter writes are best-effort: failures warn but
the image still lands.
- cmd/imagen/usage.go — `imagen usage [--since DATE] [--raw]` reads
the table and prints a tab-aligned grouped or raw table with totals.
- cmd/imagen/backends.go — instances of type=replicate now report
"ok" or "not configured (set REPLICATE_API_TOKEN)" depending on env.
- internal/config/config.go — sample adds flux-schnell-replicate +
flux-dev-replicate; default_backend stays flux-schnell-local.
- Supabase migration mai.imagen_usage (id, created_at, backend, model,
seed, prompt_hash, latency_ms, cost_usd_estimate, caller) + indexes
on (created_at DESC) and (caller). The raw prompt is never stored.
Caller identity resolves from MAI_FROM_ID, then the tmux pane's
@mai-name option, mirroring the maimcp identity logic. Prompt hash is
sha256 of the user-facing prompt; raw prompt never reaches the table.
Adds an optional `imagen generate` post-step that opens a sibling
tmux window running tmux-img --hold <path>.
- internal/preview: Mode (auto|on|off), Resolve, and a Spawner that
shells out to tmux new-window. Typed errors for missing tmux,
missing tmux-img, and "preview forced on outside $TMUX".
- cmd/imagen/generate: --preview / --no-preview flags plus
$IMAGEN_PREVIEW. Resolution chain: config -> env -> flag.
auto requires both stdout-is-tty and $TMUX. Failures are
warnings - the image is already on disk.
- internal/config: output.preview field, validated to auto|on|off,
threaded into the sample.
- Tests for ParseMode, Resolve, Spawn argv (incl. shell quoting of
paths with apostrophes), missing-binary errors, and the CLI
resolution table.
- Docs (usage + architecture) updated.
/imagine SKILL.md edit lives in dotfiles - deferred to coordinate
with #4.
internal/backend/comfyui.go implements the Backend interface against
ComfyUI's /prompt + /history + /view HTTP API. Workflow is the canonical
FLUX.1 schnell shape — UNETLoader + DualCLIPLoader (clip_l + t5xxl fp8) +
VAELoader + ModelSamplingFlux + KSampler — assembled as a Go map per
request so Width / Height / Seed / Steps / sampler / scheduler all flow
into the right node inputs.
Resilience: one retry on /prompt 5xx and transient network errors, no
retry on 4xx. Connection-refused / timeouts surface a 'boot-whitetower
mrock' hint. node_errors mentioning a missing unet point users at
docs/setup-comfyui-mrock.md (matches both the 4xx and 200-with-errors
shapes ComfyUI uses across versions).
Result.Metadata carries model, seed_used, latency_ms, steps, sampler,
scheduler, width, height, prompt_id, client_id, plus best-effort
vram_used_mib pulled from /system_stats post-gen.
Tests use httptest with poll interval squashed to 1ms — no real mRock
dependency. Coverage: happy path, defaults, retry-once on 5xx, give-up
after two 5xx, no-retry on 4xx, missing-model hint (both 4xx and
200+node_errors paths), history-error surfaced, /view 4xx, unreachable
host, ctx cancel during poll, workflow-shape assertion, registration.
Config sample: flux-schnell-local is now default_backend; the user-facing
block names the unet file by basename (the mapping into models/unet/ is
the server's convention, captured in docs/setup-comfyui-mrock.md from
phase 1).
Smoke verified end-to-end: imagen generate ... --backend
flux-schnell-local --size 1024x1024 --output /tmp/cat-via-cli.png on
mRock returned a 1024x1024 PNG of a cat in a fishbowl in 10.3s with a
sidecar carrying seed + latency_ms + the rest of the metadata.
