The fold rule is intact under the new field names (improvise-anr9 renamed the GridUpdate arms to RowFrame/ColFrame and GridCache's fields to row_frame/col_frame), but three sentences still named the old ones. Co-Authored-By: Claude Opus 5 (1M context) <noreply@anthropic.com>
119 KiB
Repository Map (LLM Reference)
Terminal pivot-table app. Rust 2024, Ratatui TUI, command/effect architecture.
Apache-2.0. Root binary+lib improvise; sub-crates under crates/:
improvise-core—Model,View,Workbook, number formatting. No UI/IO.improvise-formula— formula parser, AST,parse_formula.improvise-io—.improvsave/load, CSV/JSON import,Storagebackends. No UI/commands.improvise-protocol— the wire vocabulary and the portable session slice:Command,Projection,ViewState, the per-widget caches,reduce_view, key types. Depends only onimprovise-core+ serde. No IO, no command layer, no terminal.improvise-command— command/effect layer + semanticAppstate (app.rs, effect.rs, cat_tree.rs, viewport.rs). Depends onimprovise-protocol. No ratatui/crossterm.gp-tree— problem-agnostic genetic-programming regression trees (Tree,Spec,breed,simplify,render). Knows nothing about improvise.improvise-gp— the one seam between the two: emits a fittedgp_tree::Treeas improvise formula text (formula_text/fitted_formula). Depends ongp-tree,improvise-formulaandimprovise-core—dataset.rsbuilds a feature matrix from aView's records (improvise-4s8) andfitted_formulatakes the&Modelit must resolve against (improvise-8xhy). Nothing depends on it yet.improvise-ws-server— the host: tokio + tungstenite, aRegistryofHosts keyed byDocumentId(multi-document, ADR 001),Sessionsfan-out, and the socket framing (wire.rs). Native only.improvise-worker-server— the other host: the sameApp,SessionsandHostas the socket server, behindself.onmessage/self.postMessagewith OPFS underneath. wasm32 only in anger;worker.rs/vfs.rsare ordinary Rust and are where every decision and every test is. Nothing depends on it.improvise-wasm-client— the browser client: the fold, the key classifier, the socket framing it mirrors (socket.rs), and the render model the DOM paints (render.rs). Non-dev deps areimprovise-protocol+ serde + wasm-bindgen and nothing else. The page itself isweb/.
The main crate (and improvise-command) re-export the sub-crates as crate::{model, view, workbook, format, formula, persistence, import} so consumer paths stay stable when crates shuffle. The main crate also re-exports improvise_command::command as crate::command and improvise_command::ui::{app, cat_tree, effect, viewport} under crate::ui. ui::app re-exports the protocol's AppMode, ViewState, ViewCursor, ViewFrame, Panel, MinibufferConfig, MinibufColor and HELP_PAGE_COUNT, and command::key re-exports the protocol's key types, so every pre-existing path still resolves.
Architectural intent lives in context/design-principles.md — read that for the "why". This doc is the "where".
How to Find Things
| I need to... | Look in |
|---|---|
| Add a keybinding | improvise-protocol/src/keymap.rs → Keymaps::default_keymaps() (the table; the browser looks up the same bindings). Resolving a bound name into effects is improvise-command/src/command/keymap.rs. |
| Add a user command | command/cmd/<submodule>.rs, register in registry.rs |
| Add a state mutation | ui/effect.rs → implement Effect |
| Change formula eval | model/types.rs → eval_formula / eval_expr |
| Change cell storage / lookup | model/cell.rs → DataStore |
| Change category/item behavior | model/category.rs → Category |
| Change view axis logic | view/types.rs → View |
| Change an axis label, color or cycle | view/axis.rs → impl Axis (colors resolve in draw.rs::axis_fg) |
| Ask "what data is visible" vs "what can the user page" | View::filtering_cats() vs categories_on(Axis::Page) |
| Change grid layout | view/layout.rs → GridLayout |
Change .improv format |
persistence/improv.pest + persistence/{format,parse}.rs |
| Change where documents are stored | storage.rs → Storage impls (opfs.rs for wasm) |
| Change number display | format.rs → format_f64 |
| Change CLI args | main.rs (clap) |
| Change import logic | import/wizard.rs → ImportPipeline |
| Change how a gp-tree fit searches | gp-tree/src/fit.rs → FitConfig / fit |
| Change gp-tree CSV preprocessing | gp-tree/src/data.rs → preprocess |
| Change how a name is quoted anywhere | improvise-formula/src/quote.rs — the one home, both halves |
| Change import-wizard keys/steps | command/cmd/wizard.rs (keys) + import/wizard.rs (steps) |
| Change frame layout | draw.rs → draw() |
| Change what the browser page draws | improvise-wasm-client/src/render.rs → RenderModel |
| Change a browser↔server frame | improvise-protocol/src/frame.rs → ClientFrame/ServerFrame. The one pair; both ends pub use it and neither defines one (improvise-xks6) |
| Change the worker's message loop | improvise-worker-server/src/worker.rs → Worker::on_frame |
| Change the session loop (either host) | improvise-command/src/ui/host.rs → Host::handle |
| Change how the browser opens or seeds a document | improvise-worker-server/src/vfs.rs → open / documents |
| Change what a browser resolves without the host | improvise-wasm-client/src/keys.rs → resolve |
| Change the browser page itself | web/app.js (thin), web/index.html, web/style.css |
| Host another document | improvise-ws-server/src/registry.rs → Registry, ClientId |
| Change app state / modes | ui/app.rs → App, AppMode |
| Write a test for model logic | model/types.rs → mod tests / formula_tests |
| Write a test for a command | command/cmd/<module>.rs → colocated mod tests; helpers in cmd/mod.rs::test_helpers |
Central Pattern: Cmd → Effect
keypress → Keymap lookup → Cmd::execute(&CmdContext) → Vec<Box<dyn Effect>> → Effect::apply(&mut App)
(pure, read-only ctx) (list of mutations) (only mutation site)
pub trait Cmd: Debug + Send + Sync {
fn name(&self) -> &'static str;
fn execute(&self, ctx: &CmdContext) -> Vec<Box<dyn Effect>>;
}
pub trait Effect: Debug {
fn apply(&self, app: &mut App);
fn kind(&self) -> EffectKind; // NO default — the compiler makes you classify
}
// EffectKind::{ViewOnly, Model(ModelChange)}
// ModelChange::{CellData, LayoutGeometry, WholeWorkbook}
CmdContext (see command/cmd/core.rs) holds immutable refs to Model, GridLayout, AppMode, cursor/offsets, buffers, yanked cell, key code, expanded cats, and panel/tile cursors.
Add a command: implement Cmd in a command/cmd/ submodule, register in registry.rs, bind in default_keymaps(). Simple wrappers go through the effect_cmd! macro in effect_cmds.rs.
Add an effect: implement Effect in ui/effect.rs, add a constructor fn if it helps composition.
Key Types (skim; read the source for fields/methods)
Model (model/types.rs): categories: IndexMap<String, Category>, data: DataStore, formulas: Vec<Formula>, views: IndexMap<String, View>, active_view, measure_agg. MAX_CATEGORIES = 12 (regular only). Virtual categories _Index, _Dim, _Measure always exist. Use regular_category_names() for user-facing pickers.
CellKey (model/cell.rs): Vec<(cat, item)> — always sorted by category. Build with CellKey::new(coords) / with(cat, item) / without(cat). Never construct the inner Vec directly.
CellValue: Number(f64) | Text(String) | Error(String). Errors surface from formula eval (circular, div/0, etc.).
DataStore (model/cell.rs): interned symbols + secondary index (Symbol, Symbol) → {InternedKey}. Hot-path lookups go through matching_values / matching_cells.
Formula AST (improvise-formula/src/ast.rs):
Expr { Number, Ref, BinOp, UnaryMinus, Agg, If }BinOp { Add, Sub, Mul, Div, Pow, Eq, Ne, Lt, Gt, Le, Ge }AggFunc { Sum, Avg, Min, Max, Count }Formula { raw, target, target_category, expr, filter }
View (view/types.rs): category_axes: IndexMap<cat, Axis>, page selections, hidden items, collapsed groups, number_format, prune_empty. It carries no cursor — selected/row_offset/col_offset moved to ViewState::cursors (improvise-8uz). Axis { Row, Column, Page, Filter, None }. cycle_axis rotates Row → Column → Page → None; Filter is outside the rotation (see gotcha 27).
GridLayout (view/layout.rs): pure function of Model + View. cell_key(r,c), cell_value(r,c), drill_records(r,c). Records mode auto-detects when _Index is on Row and _Dim is on Column.
AppMode (ui/app.rs): 17 variants (Normal, Editing, FormulaEdit, FormulaPanel, CategoryPanel, ViewPanel, TileSelect, CategoryAdd, ItemAdd, ExportPrompt, SavePrompt, CommandMode, ImportWizard, Help, Quit, RecordsNormal, RecordsEditing). Eight text-entry variants carry a MinibufferConfig. SearchMode is Normal + search_mode: bool, not its own variant. Per-variant UI facts live on the enum as exhaustive-match methods — label(), hint_text(), panel(), minibuffer(), is_editing(), is_records() (improvise-2hi); add a variant and the compiler names every one you must fill in. mode_style() stays in src/draw.rs because Style is a ratatui type. App state is split into ModelState (workbook, file_path, dirty) and ViewState (mode, cursor/offsets, buffers, panels, search) — see improvise-x2c/ew0. wizard and drill_state live on App, not ViewState (improvise-h0b) — see gotcha 24.
Keymap (improvise-protocol/src/keymap.rs; dispatch and KeymapSet in improvise-command/src/command/keymap.rs): Binding { Cmd | Prefix(Arc<Keymap>) | Sequence(Vec<…>) }. Lookup fallback: exact(key,mods) → Char(NONE) → AnyChar → Any → parent. 17 mode keymaps, one per ModeKey, built by Keymaps::default_keymaps(); mode resolved via ModeKey::from_app_mode(). ModeKey and AppMode are two different enumerations that happen to be the same size — SearchMode is a ModeKey and not an AppMode; Quit is an AppMode with no keymap — so do not "fix" one count to match the other.
.improv File Format
Plain-text, markdown-like, defined by persistence/improv.pest. Parsed by pest — the grammar is the single source of truth (the grammar-walking test generator reads it via pest_meta).
v2025-04-09
# Model Name
Initial View: Default
## View: Default
Region: row
Measure: column
|Time Period|: page, Q1
hidden: Region/Internal
collapsed: |Time Period|/|2024|
format: ,.2f
## Formulas
- Profit = Revenue - Cost # defaults to [_Measure]
- Tax = Revenue * 0.1 [CustomCat]
## Category: Region
- North, South, East, West # bare items, comma-separated
- Coastal_East[Coastal] # grouped item, one per line
> Coastal # group definition
## Data
Region=East, Measure=Revenue = 1200
Region=West, Measure=Revenue = |pending| # pipe-quoted text
- Name quoting: bare
[A-Za-z_][A-Za-z0-9_-]*, else CL-style|…|with escapes\|,\\,\n. Same convention in the formula tokenizer. - Write order: Views → Formulas → Categories → Data. Parser tolerates any order.
- Gzip:
.improv.gz(same text, gzipped). - Legacy JSON: auto-detected by leading
{; never written. - Axis keywords:
row,column,page,filter,none;page/filtercarry the selected item after a comma. - Virtual categories:
_Index/_Dimnever persist;_Measurepersists only non-formula items (formula targets are rebuilt from the## Formulassection). - Virtual views:
_Records/_Drill(view::VIRTUAL_VIEW_NAMES) are never written and are dropped on load if an older file carries them; saving from records/drill mode writes the first real view asInitial View. Their commands rebuild them on demand.
Gotchas (read before editing)
-
Records mode is wide format. A row is one coordinate tuple — the cells sharing everything but
_Measure— and the columns are[coordinates…, **+cat**, raw measures…,+]: a column per regular category, then the column that creates a new category (improvise-2zq, sitting where the column it creates will appear), then a column per raw measure, then the column that creates a new measure (improvise-c5v). Consequences: two measures on one coordinate are ONE row; editing a category column moves every measure cell in the row, not just the one under the cursor;_Dimin the synthetic key carries the column index, not a label, because a category and a measure may share a name — resolve it withGridLayout::record_colinto aRecordCol. Formula targets are not columns (nothing to type into them). Drill pending edits are keyed by(row, RecordCol).prune_axis_itemstakes a predicate, not a flag vector.prune_emptyhands itimpl Fn(usize) -> boolover the data index (group headers consume no index). The domain is derived fromitemsitself, so there is no parallel length a caller could get wrong — the earlier&[bool]+debug_assertpair could disagree between debug and release if a third caller ever sizedkeepfrom something other thanrow_count()/col_count()(improvise-n3wt). -
Effects never touch
std::fs. Every document read or write goes throughApp::storage: Box<dyn Storage>(improvise-fuj). The host picks the backend:App::newsuppliesPhysicalFs,App::with_storagetakes any other — a browser worker will supply OPFS (improvise-i34), and tests useMemoryFs.improvise-iokeeps path-taking wrappers (save,load,export_csv,parse_csv_with_warnings) for the native CLI, each delegating to a_to/_from/_bytesvariant that takes the backend or the bytes. -
Every effect declares an
EffectKind, and there is no default.ViewOnlynever reaches other clients;Model(CellData | LayoutGeometry | WholeWorkbook)does (improvise-mae). A new effect that forgets to classify itself fails to compile — that is deliberate, since the failure mode is silent: a mis-declaredViewOnlyedit would simply never reach connected clients. Watch two traps: the View lives insidemodel_state.workbook, so "touches model_state" does NOT mean "is a model change" (axis/page/format areLayoutGeometry, cursor and scroll areViewOnly— see improvise-8uz); andSave/SaveAs/MarkDirtytouchmodel_statefor bookkeeping only and areViewOnly.AddCategory/RemoveCategoryare the third trap and go the other way: they look like data edits, but both go throughWorkbook, whoseon_category_added/on_category_removedrewrite every view's axis map, so they areLayoutGeometry. The two "an effect declaring X actually changes X" tests cannot separate them — a category change moves model data and view config, so it clears either bar;structural_effects_declare_their_kindpins the declaration itself. A third trap, now guarded:EffectKindis too coarse to check a mapping.ui/reduce.rs::model_effectssends each of 28ModelCommandvariants to one effect, and every inverse pair —HideItem/ShowItem,AddItem/RemoveItem,CreateView/DeleteView,SetCell/ClearCell— declares the same kind, so swapping three of them at once left the suite at 918 passing while three wire messages did the exact inverse of what they said. The mapping is name-for-name by construction, soevery_model_command_names_the_effect_of_the_same_nameasserts that, reading the type name off the effect's derivedDebug(Effectis a trait object, sotype_nameis out of reach). A variant whose effect must be named something else is a variant that stopped being derived — it should fail there and be argued about. Their reach is wider than the name suggests:Model::remove_categoryalso drops every formula targeting the category, which is whyDirty::of(LayoutGeometry)reportsformulas: true— see gotcha 35. -
Commands never mutate.
&CmdContextis read-only; returnVec<Box<dyn Effect>>. If you want to touch&mut App, add or extend an Effect. -
CellKeyis always sorted. Use the constructors; equality and hashing rely on canonical form. -
No
Model::add_item. With aWorkbookin hand use the facade:wb.add_item("Region", "East")?/add_item_in_group/remove_item(improvise-tvt). With only aModel, go through the category:m.category_mut("Region").unwrap().add_item("East"). -
Virtual categories.
_Measureitems = explicit items ∪ formula targets. Usemeasure_item_names()/effective_item_names("_Measure").add_formuladoes not add items to_Measure. Formula-target lookup also falls back into_MeasureviaModel::find_item_category. Cell aggregation goes throughapply_agg, formulaSUM(…)/AVG(…)througheval_agg— they differ on empty input (absent vs. A third rule joins them for non-numeric values:aggregate_cell_valuesreduces text by unanimity — one matching value, or several copies of the same value, is that value; differing values, or text among numbers, isCellValue::Error("mixed")(improvise-l4qx). The all-numeric branch is checked first, soCountof a lone number is still1and not the number — that ordering is the whole difference between this rule and "a single value passes through". What the rule forbids is dropping:filter_map(as_f64)used to, and since_Index/_Dimare onAxis::Nonein every default view that made every text cell in every document render blank, including the pipe-quoted text.improvcarries as a first-class value.evaluate_aggregatedandaggregate_rawshare the helper, so a formula ref over mixed values now errors"mixed"rather than silently summing the numeric ones.0for Sum/Count, error for Avg/Min/Max). -
Display rounding is view-only.
format_f64(half-away-from-zero) is only called in rendering. Formula eval uses fullf64. Never feed a rounded value back into eval. -
Formula eval is fixed-point.
recompute_formulas(none_cats)iterates until stable, bounded byMAX_EVAL_DEPTH; circular refs converge toCellValue::Error("circular").App::newruns it before the first frame so formula cells render on startup. -
Drill into formula cells strips the
_Measurecoordinate when it names a formula target, somatching_cellsreturns the raw records that feed the formula instead of returning empty. -
Minibuffer keymaps come from
TextEntry. The eight text-entry modes are built by theTextEntrybuilder inimprovise-protocol/src/keymap.rs— seven byTextEntry::new, andRecordsEditingbyTextEntry::with_parentoffEditing's map, which is why a count taken off the::newcall sites reads seven. It binds the shared spine (AnyChar→append-char <buf>, Backspace→pop-char <buf>, Esc→[clear-buffer <buf>, enter-mode <exit>]) and welds every commit key to itsclear-buffervia.commit(key, cmd, args)(improvise-w3q).TextEntry::newtakes theAppModeand reads<buf>off itsMinibufferConfig, so the buffer the prompt names and the buffer the keys edit are the same string by construction (improvise-k8h) — the keymap never spells a buffer name..rebindexists only for CommandMode's Backspace.SearchModeis hand-written on purpose — no commit key, andexit-search-modeowns the query.EnterModeclears the incoming mode's minibuffer throughwrite_buffertoo — buildingSetBufferdirectly there was unreachable only because no shippedAppModeis keyed"search".MinibufferConfig::buffer_keyis aString, not&'static str: a borrowed-'static field makesDeserializeunimplementable, and every text-entryAppModevariant carries aMinibufferConfig(improvise-a2x). A buffer named at runtime is read withcmd::core::read_bufferand written with its mirrorwrite_buffer— "search" is not in the buffers map but its ownViewStatefield, and those two functions are the only code that knows it (improvise-gdl). -
Panel keymaps come from
PanelKeymap. The three panel modes share a spine (Esc/Tab→Normal, arrows and j/k→move-panel-cursor <panel>, every panel's toggle key,:→command mode) built byPanelKeymap::new(panel); the keys that act on the panel's contents arrive through.bind/.bind_args/.deletebecause they vary in shape, not just command name (improvise-4pg).Panel::ALL/name()/key()inui/app.rsdrive the toggle keys for Normal and all three panels, so a fourth panel reaches every keymap from oneALLentry.name()must spell whatparse_panelaccepts. -
Prefix keys are stored as an address, not a keymap.
ViewState::transient_prefixholds the(KeyCode, KeyModifiers)that opened a prefix;KeymapSet::prefix_keymapresolves it back to the sub-keymap, walking parents soRecordsNormalreaches Normal'sg/y/Z(improvise-jc8) — that is the command-layer wrapper; the resolution itself isKeymaps::prefix_keymapinimprovise-protocol/src/keymap.rs.ViewStatemust stay free ofimprovise-commandtypes — it is destined for the protocol crate, whichimprovise-commandwill depend on. Resolution assumes prefixes are flat;prefix_keymaps_are_flatfails the build if a nested one is added. -
Keybindings are per-mode.
ModeKey::from_app_mode()resolves the mode; Normal +search_mode=truemaps toSearchMode. Minibuffer modes bind Enter/Esc asBinding::Sequencesoclear-bufferfires alongside commit/cancel. Hints are checked against the keymaps:every_hint_key_resolves_in_its_mode(command/keymap.rs) splits eachAppMode::hint_text()and requires every key it names to resolve in that mode's map, becauseonly_quit_has_no_hintasserts only that a hint is present. It checks which keys are named, not what they do. Its tokenizer knows the hint dialect explicitly (named keys,Ctrl-<c>,F/C/Valternatives, character runs likehjkl/[:], the em-dash prose tail, CommandMode's:qex-commands) and panics on a token it cannot classify rather than skipping it. -
Registry names come from prototypes, not strings. Every
register*call reads the name off a prototypeCmdinstance, so a typo is impossible (improvise-9cn) — there is no name literal inregistry.rs. What types can't reach: four commands name themselves off a field (ViewNavigate,TileAxisOp,ToggleGroupAtCursor,CommitAndAdvance), so a prototype can name the wrong variant and still compile. That shows up as a duplicate registration, not a mismatch — the wrong-variant entry collides with its sibling and the sibling's name vanishes.registered_names_are_uniquecatches it;every_bound_command_name_is_registeredcatches the keymap side, and checks both halves ofdispatch'sregistry.interactive(name, args, ctx).ok()?— the name resolves and the args parse — because improvise-s13 movedenter-mode ["export-prompt"]/["formula-edit"]out of the nullary class, where a typo'd mode name compiles into a dead key. It builds theCmdContextin each keymap's ownAppMode, sincecommit-buffer itemreadsctx.mode. -
effect_cmd!macro wraps a pre-built effect as a parseable command. Use it for simple wrappers; reach for a hand-writtenCmdonce there's real decision logic. Its counterpart on the effect side issimple_effect!inui/effect.rs, which declares a one-field newtype that writes one place on theApp. Its kind argument is mandatory —simple_effect!(Name(T) => |app| place, EffectKind::ViewOnly)— even though every call site so far answersViewOnly: hard-coding it reintroduced exactly the default gotcha 3 does without, since$placeis an unconstrained expression and a one-lineactive_view_mut().number_formatsetter would have reportedViewOnlywith the suite green (improvise-8fy). Likewise, mode entry has no per-mode shim commands — bindenter-mode <mode-name>(improvise-s13); the name is decoded byparse_mode_nameinregistry.rs, andEnterModeclears the mode's minibuffer on the way in. -
Float equality inside formula eval is currently mixed —
=/!=use a1e-10epsilon but the div-by-zero guard checksrv == 0.0exactly. Don't assume one or the other; tracked for cleanup. -
IndexMappreserves insertion order for categories, views, and items. Persistence relies on this — and so, since improvise-shyt, doDataStore::matching_cells/matching_values: the secondary index narrows the candidates, thenmatching_positionsresolves each to its position in the primaryIndexMap, sorts, and reads back. An index whose values areHashSets is for O(1) lookup, never for iteration. Walking it gave a different order in every process, which was not tidiness. Records-mode rows reordered between sessions;SUM/AVGdrifted in the last bits becausef64addition is not associative (Min/Max/Countand the text-unanimity rule of gotcha 7 are order-free, so they were never affected); and worst, the drill snapshot froze its record list in hash order whiledrill_state.pending_editsare keyed by row index (gotcha 1), so the same drill opened in a second process addressed different records — silent misdirected writes, and nothing in the tracker knew. Measured at 18,000 cells: +20% worst case onmatching_values, andmatching_cells7% faster, sorted positions resolvingCellKeys with better locality.DataStore::live_recordswas the open choice and is now decided (improvise-2yc2): it walkscellsand projects insertion order onto records, deliberately paying O(cells) rather than O(records), becausecells' order is already the answermatching_positionsgives and a second answer to "what order is this store in" is the disease. It is derived per call rather than memoised onRecordEntry, since a stored position is a copy and a record deleted and re-created would hold its old one. Note what is not on offer: an unordered return — every iterator has an order, and a type that merely disclaims one still hands the caller hash order, which is the guard living one level away from the hazard and the shape this whole class of bug returns through. The second real instance wasimport::analyzer::analyze_records(improvise-7yx), which built its distinct values through aHashSet:build_modeladds items in exactly that order andIndexMappreserves it, so the same CSV imported twice produced two different.improvfiles and two different row orders. Now first-seen order, pinned by a five-iteration test because eachHashSetgets its ownRandomState. Also answered here since: an emptypartialmatches every cell vacuously (improvise-hkt6) — it used to indexsets[0]and panic, unreachable only because both callers guarded. -
Commit paths for cell edits split across
commit_cell_value→commit_regular_cell_value/commit_plain_records_editincommand/cmd/commit.rs. Keep the synthetic-records branch in sync with the plain branch when changing behavior. -
Minibuffer commits go through one command.
commit-buffer <formula|category|item>(CommitBuffer { kind: CommitKind }) owns buffer→trim→bail-on-empty→dirty→status for all three; the varying parts are methods onCommitKind. The add effect is emitted last so its failure message wins over the command's optimistic status (improvise-6t3).CommitKind::Itemcarries its target category, resolved fromAppMode::ItemAddbyparse_commit_kindat registry time — socommit-buffer itemis not constructible from a script line. -
An abort stops the chain, never the bookkeeping — and ordering is what separates them. Three effects set
abort_effects, and they are not all saves:SaveandSaveAson a failed write or a missing path (improvise-8tk —SaveAswas the arm left out of the original fix, so:w /bad/path . qquit on a failed write), andAddCategorywhenModel::add_categoryrefuses, because what follows assumes the category exists — from the+catcolumn (improvise-2zq) the rest of the batch would advance the cursor and re-open an editor on a column that was never created. ABinding::Sequenceflattens into one effect vec, so the abort carries across sequence steps; that is a property of the flattening, and it is why improvise-0hb's proposal to apply effects between steps was rejected —apply_effectsresets the flag per batch, so step 2 in a fresh batch would land theQuitafter a failedSave, silently reopening a P1.a_sequence_whose_first_step_aborts_does_not_run_the_secondis the guard. The rule the aborts taught, which is the part to carry: an abort at the tail of a batch also ate the mode restoration and the buffer clearing, stranding the user inCommandMode/Editing/SavePrompt— wheredraw_bottom_barrenders the minibuffer instead of the status line, so the error the effect had just written was never drawn and the operation appeared to do nothing at all. So tidy-up goes at the head, where an abort cannot reach it:ExecuteCommandfronts its batch withReturnToNormalUnlessMoved,CommitAndAdvancewith the mode change,CommitSavewith the mode change (found by Copilot on PR #27). Ordering answers it without giving any effect a "runs anyway" flag, and it does not weaken gotcha 31's observed-not-predicted mode settling: whatever a later effect sets, it sets after, so the mode a:line ends in is unchanged in every case — the only difference is what happens when the batch never reaches the end. An abort is not a rollback; that is the hole clause 4 leaves (gotcha 47). -
The import wizard's back path is a history stack, not a reverse table.
advancepushes the step it leaves ontoImportWizard::history;previouspops it, so back always retraces the path actually taken through the conditional transitions (improvise-907). Preconditions live invalidation_error(), checked on the step where the user can still fix them — never deferred tobuild_model.NameModelis terminal foradvance: Enter there callsbuild(), which parks the workbook inbuiltonDone, andAcceptWizardModeltakes it from there. Going back fromDonediscardsbuilt. -
app.layoutgoes stale mid-batch.apply_effectsrebuilds only after the whole batch, so an effect that reads the layout after an earlier effect changed the grid needs aRebuildLayouteffect in front of it — the command decides the order (seeEnterEditAtCursorCmd,CommitAndAdvance). Read the cursor's cell text viaApp::display_value_at_cursor(); don't build aCmdContextinsideapply(it recomputes column widths). -
The cursor is per-client and keyed by view.
ViewState::cursors: HashMap<String, ViewCursor>holdsselected/row_offset/col_offset, keyed by view name; an absent key means the origin. Reach it throughApp::cursor()(aCopysnapshot),App::cursor_mut(), andApp::reset_cursor()— never offView, which no longer has the fields (improvise-8uz). Two consequences. Changing the grid's shape must reset the cursor explicitly:View::transpose_axes/cycle_axisused to do it themselves, and nowTransposeAxes/CycleAxiscallapp.reset_cursor()— a new geometry effect that renumbers rows or columns has to do the same. Replacing the document must clear the map:LoadModelandAcceptWizardModelcallcursors.clear(), because the incoming workbook's view names have nothing to do with the outgoing one's. That clearing replacesWorkbook::normalize_view_state, which is gone — aViewcan no longer carry a stale offset. The same clearing owes the session mirrors:install_workbookbumpsApp::document_generation, andClientSession::projectreseeds any mirror seeded at an earlier one (improvise-cqq). An effect cannot reachSessions, so the generation is the mechanism andSessions::rebaseis only the client-facing half. The same is true of a geometry change, and it owes the mirrors both halves:App::cursor_epochis bumped byreset_cursorand watched bySessions::adopt_cursor_epoch, which resets every mirror and returnsBroadcast::ToAll(Command::ResetCursor)(improvise-gvnb). Doing only the first is strictly worse than doing nothing — the diff then believes every client already holds origin-positioned content and sends nothing, so they stay stale permanently rather than until their next scroll. The trigger is the epoch moving, not the command variant, for the reason gotcha 39 watchesdocument_generationinstead of matching onLoadModel: which effects renumber the grid is a per-effect decision, so a table of variants would be a second description of it, free to disagree. What is broadcast is an invalidation, never a position — another client's transpose must not move where I am looking (that is UI and it is mine, improvise-g0f), only declare that where I was looking has stopped meaning anything. And the observation is only as complete as thereset_cursorcalls. Nothing declares which effects renumber the grid — deliberately — so a geometry effect that forgetsreset_cursoris invisible in both directions: the host's own cursor stays stale and no client is told. Today onlyTransposeAxesandCycleAxiscall it;SetAxis,HideItem/ShowItem,ToggleGroup,TogglePruneEmpty,AddCategory/RemoveCategoryandAddItem/RemoveItemall renumber and do not (improvise-9mo9).SetAxisis the sharpest —CycleAxisisSetAxistoAxis::next(), and one resets while the other does not. The negative arm is real and must stay tested (SetNumberFormat, aLayoutGeometryeffect that must not reset): without it, "reset on every model command" would pass the positive test. -
ViewStateand its field types areSerialize/Deserialize. It is the wire payload of the client Snapshot (improvise-q08), soAppMode,MinibufferConfig,MinibufColor,ViewFrame,KeyCodeandKeyModifiersall derive both (improvise-a2x), andimprovise-commanddepends onserdefor it. The constraint this puts on new state: no borrowed-'staticfields anywhere ViewState can reach —Deserializecannot produce one, and the error surfaces on every enclosing variant rather than at the offending field.view_state_survives_a_json_round_tripguards it.ViewStateandSnapshotalso deriveCloneandPartialEq, so the bootstrap message can be compared in a round-trip test. -
Axis presentation lives on
Axis, colors resolve indraw.rs. Four vocabularies hang off the enum inview/axis.rs—plain_label()("Row"/"Col"/"Page"/"None"),glyph()(whichDisplayappends, giving "Row ↕"),short_label()(three columns for the tile bar;Noneis "·", not a truncation), andinitial()(one letter for the view panel;Noneis empty). Pluscolor() -> AxisColorandnext()for the Row→Column→Page→None rotation.AxisColoris a semantic palette:improvise-coremust not name a ratatui type, sodraw.rs::axis_fgdoes the one mapping to a terminal color, exactly asminibuf_fgdoes forMinibufColor(improvise-rml). The tile bar and category panel each carried their own copy of the color table before, with nothing keeping them in agreement. Not covered here:persistence/format.rsmapsAxisto the on-disk keywords ("row"/"column"/"page"), which is a format concern and stays in the io layer. -
Axis::Filterconstrains without being navigable. Drilling fixes its coordinates onFilter, notPage(improvise-dz8): both restrict which records are visible, but onlyPageis something the user may move or page through. The split shows up as two different questions, and picking the wrong one is the trap: "what data is visible" isView::filtering_cats()(Page ∪ Filter — used byGridLayoutand byadd-record-rowwhen it builds a key from the current constraints), while "what can the user act on" iscategories_on(Axis::Page)(used by[/]page cycling) orView::tileable_cats()(used by all three tile-select sites).Axis::next()mapsFilterto itself and no navigable axis rotates into it, so tile select cannot hand one out. The.improvgrammar acceptsfilterand round-trips a selection with it — a Filter axis only ever occurs in the never-persisted_Drillview, but the alternative was writing it out as some other axis. -
The browser backend is sync on purpose, with an async seam.
OpfsFs(improvise-io/src/opfs.rs, wasm32 only) implements the same synchronousStoragetrait asPhysicalFs, becauseFileSystemFileHandle.createSyncAccessHandle()yields a handle whose read/write/truncate/flush are blocking — available only inside a dedicated Web Worker, which is where improvise-9x6 puts the app. SoStoragenever became async. What is still async splits out into four explicit methods the worker awaits from its message loop:open(),attach(path)(must precede any read/write of that document — acquiring a handle is async even though using it is not),refresh()(repopulates the indexlistanswers from), andcommit_deletes(). Consequence:deleteis visible immediately but lands in OPFS at the end of the batch — it drops the name from the index and queues aremoveEntry. Handles are exclusive per file, soattachcloses any handle it replaces anddetachreleases the lock.storage_contractinstorage.rsis the behaviour every backend owes; it runs against both host backends and is the written-down specOpfsFsmust satisfy in a browser, where the harness cannot reach. -
"Which view is active" is stored twice, and the copies must move together.
Workbook::active_viewis the document's;ViewState::active_viewis the client's, and it is what keysViewState::cursors. The second copy exists becausereduce_viewruns on a client that holds noWorkbook(improvise-cqi). Only two writers are allowed to touch either —App::switch_to_viewandApp::install_workbook— andthe_two_active_view_names_never_divergeguards it. Callingworkbook.switch_view()directly desyncs them and the cursor map is then read under the wrong key; that is exactly how the 8uz characterization test broke during the extraction. Whether the two are allowed to diverge — two clients on different views — is improvise-g0f, and the answer is yes, eventually: the model is shared, the UI is not, soWorkbook::active_viewbecomes the document's default (what a fresh client opens) andViewState::active_viewis authoritative per client. improvise-jytm owns the split; a "follow mode" binding two UIs together is deliberately not ruled out. Until thenSessions::applykeeps them in lockstep by routingSwitchViewthroughApp::switch_to_view— see gotcha 36. -
Two tests gate
ViewStatemembership.ViewStateis the portable session slice — the one thing serialized into the Snapshot a newly-connected client gets (improvise-q08). A field may live there only if it is portable (plain data from the allowlisted crates, noRc/Arc) and snapshot-safe (a fresh client inheriting the value is correct).wizardfails both —ImportWizardis animprovise-iotype, and a half-open dialog is not something to inherit — anddrill_statefails both — it holds anRc, andpending_editsare uncommitted writes belonging to whoever staged them. Both live onAppunder the session-local residue tag (improvise-h0b). TheViewState: Sendstatic assertion inapp.rs's tests is the compile-time proxy for portability:Rcis notSend, so a re-added shared pointer fails the build (theDeserializederive from gotcha 25 now rejects it too, serde'srcfeature being off).Senddoes not catch the origin-crate or snapshot-safety halves — check those by hand. -
:commands settle their mode by observation, not prediction.ExecuteCommandends every batch withReturnToNormalUnlessMoved(ctx.mode), which drops toNormalonly if the mode is still what the batch started in. There is noEffect::changes_mode()any more: it was a per-type constant, andViewBack/ViewForward/StartImportWizardswap the mode only on some runs, so no up-front answer was right —:importopened the wizard and was snapped straight back out (improvise-toc). A new effect that changes the mode needs no annotation; just don't return the batch's starting mode from a success path. -
There is no aggregate render cache — each widget folds its own stream.
improvise-protocol::renderholds one cache type per widget (GridCache,CategoryTreeCache,FormulaCache,ViewListCache,TileBarCache), each implementingWidgetCachewith its ownUpdatetype, and aProjectionis one such update addressed to one widget (improvise-rkeq).reduce_viewfolds onlyViewStatenow — it no longer takes a cache, andCommand::Projectpasses through it untouched. Two consequences. The overlap between caches is deliberate: the tile bar and the category panel both carry(category, axis)and are updated by separate projections, so neither is woken by the other's changes; do not "fix" it by sharing a variant. Bootstrap is a compaction, not a replay:Snapshot { view, seed: Vec<Projection> }seeds a new client with a batch of the same projections the steady stream carries, so there is no whole-state type that could disagree with the incremental one. The seed is the server's current state, not the head of the history —GridCache::seed()builds it, and the property that earns it isGridCache::folded(&cache.seed()) == *cache. Nothing is defined for the help overlay (its content is static andhelp_pageis already inViewState) or for the import wizard, which now has a shape and deliberately no projection:WizardCacheis built byproject::wizard_cacheand drawn locally, because a half-open dialogue is addressed to precisely the session that opened it, never to every client (improvise-764 — the rendering-side twin of the argument that removedAcceptWizardModelfromModelCommand, gotcha 38). A cache without aProjectionis the shape session-local residue takes when it still has to be drawn by two different front ends. It lives inimprovise-protocolrather thanimprovise-commandfor theflatten_cat_treereason: when the wasm client grows a wizard it must draw these rows, not a second derivation. -
The grid's labels frame its cells, and
applyenforces it — the fold is not commutative. Three consequences inimprovise-protocol/src/render.rs. (a) AGridUpdate::Cellsthat overtakes theRowFrame/ColFramenaming its positions is dropped, becausefit_to_labelstruncates to the labels it has; a client must not reorder the stream, anda_cell_update_that_overtakes_its_labels_is_lostpins it. (b) A label change that renames a position blanks the cell under it:fit_to_labelspreserves by POSITION, which is only right where the label did not change, soapplycallsinvalidate_relabelleditself rather than trusting a producer to sendGridUpdate::Invalidatedfirst.Invalidatedtherefore now means only "contents stale, frame unchanged". (c) every arm that touches labels or widths re-fits —col_widthsis re-fitted with the columns — a new column is drawn at its label's own character count untilColWidthscatches up — because a renderer zips widths with labels and a length mismatch indexes off the end. Fitting on the label arms alone is what let a lateColWidthsput the mismatch straight back — a short update keeps each unheard-of column at its label's width, and a long one is dropped as having overtaken the frame that names it, exactly as (a) holdsCells.GridCachealso carriestotalsandpage_coords(improvise-n10).totalsis framed bycol_frameon the same terms as the cells and widths and re-fits with them, with one asymmetry: an empty strip means "this grid has no totals" (records mode, or an empty grid) and is therefore not padded, where a non-empty one is — padding it would draw a blank total row under a records grid that has none.Invalidatedblanks the totals too: they are contents, and a stale sum under fresh cells is the one number a user takes at face value.page_coordsis framed by nothing (it names categories, not positions) and survives a reshape. Note the fold tests: assertingfold(prefix)+fold(rest) == fold(whole)is vacuous (it is the definition of a left fold), so the tests that earn their place are the order-sensitivity one and the compaction-equivalence one — seedoctrine(fold_tests_must_test_order_not_the_axiom). -
A formula target is unquoted, and pipe quoting has one home.
parse_formulastrips the pipes off a target exactly as it does off anExpr::Ref— the target names a_Measureitem, so a target that kept its delimiters madeadd_formulacreate an item literally named|Total Revenue|: a ghost column the user's real item never matched, andExpr::Ref("Total Revenue")never resolved to. Both the TUI formula minibuffer (AddFormula) and.improvload go through that one call, so both were affected. The writer emitsFormula::raw, nottarget, so file text is unaffected either way — which is exactly why the round-trip tests never saw it, and why the fix repairs existing files on next load with no migration. Pipe quoting has exactly one home:improvise_formula::quote, owning both halves —quote_name/is_bare_name,pipe_quote(unconditional, for a.improvtext cell that must not read back as a number) andunescape_pipe_body.improvise-gpre-exports it,improvise-iocalls it frompersistence/{format,parse}.rs,parser.rs::unquote_pipeis a shim over it, and io's own copy is deleted (improvise-i2m5). The keyword guard is canonical — user-confirmed, so do not revert it as over-caution: an item literally namedSUMis written|SUM|. Bare keywords do parse, but only becauseagg_callneeds a(and PEG backtracking falls through toref_expr— rule ordering, not a stated rule — and a## Formulasline carries formula text verbatim, so a nameformat_mdwrites is read back byparse_formula: one namespace, one spelling rule. One thing the guard does not cover, and one that used to be an exception and no longer is. A section header takes its name as the whole line, totally (improvise-pczv):header_name = { pipe_quoted ~ &NEWLINE | line_name }— the pipe-quoted arm needs the lookahead, or|A|Bwould parse asAand silently dropB, andline_namecatches everything else, so a header name can no longer fail to parse. Four rules share it (model_name,initial_view,category_section,view_section), which is why it is a rule and not four copies. Note a header is still written raw where a reference is quoted — the grammar accepts both arms, so the quoting asymmetry between a header and a reference is a writer convention, not a format one. And the two former unquoting copies differed only on a trailing lone backslash, unreachable from the grammar, where io returned it andparser.rspanicked — the survivingunescape_pipe_bodyis total. -
Dirtyover-reports on purpose, and its doc comment is the derivation.Dirty::ofmaps anEffectKindto the widgets that kind can reach, and the two directions do not cost the same: over-reporting pays one redundantProjection, under-reporting leaves a client's cache wrong forever, with nothing in the stream to correct it.LayoutGeometrytherefore includesformulas, becauseRemoveCategorywears it andModel::remove_categoryends by dropping every formula targeting the category — a client's formula panel otherwise kept showing a formula the document no longer had. It now coincides withDirty::EVERYTHINGand is still spelled out, because the two are derived from different effects and need not stay equal. The doc comment onDirty::ofis the only record of that derivation, and it went stale once already — claimingAddCategorywasCellDataafter it was reclassified — so reclassifying an effect means re-reading it. -
A client's command has one door, and the door takes the
App.Sessions::apply(app, id, cmd)is the only way a connected client'sCommandreaches the server;ClientSession::foldand the mirror'sViewStateare private, so a transport cannot reach the mirror at all. The door takes the authoritativeAppbecause some commands have a document half:SwitchViewroutes throughapply_command/App::switch_to_view(gotcha 29), and every mirror then takes what the document accepted, not what was asked — so a switch to a view that does not exist leaves the mirrors put. Not just the asker's:grid_ofbuilds every client's grid fromworkbook.active_view(), so a bystander left naming the outgoing view has its cursor read under a stale key and is projected the new view's rows positioned by the old view's scroll — gotcha 24's mismatch arriving through somebody else's keystroke.apply_switchtherefore takes noSessionId; the switch is addressed to no one session and that absence is the statement. A client's own slice lives on the client and stays in step only by folding the same command, soSessions::applyreturnsApplied { dirty, broadcast }, wherebroadcastis aVec<Broadcast>and each item names its own audience (improvise-gvnb). The audience follows from whether the asker folded.Broadcast::ToOthersis a correction of something the asker already applied optimistically;Broadcast::ToAllis a consequence the asker is owed like everybody else. ACommand::Modelis the one kind a client cannot fold optimistically — it cannot predict what the document will accept — so every relay originating inapply_modelisToAll: theResetCursorfromadopt_cursor_epoch, and theSwitchViewthatViewBack/ViewForwardmove.apply_switchis the exception, and only because its asker really did fold. CopyingToOthersfromapply_switchintoapply_modelis the trap, and it is invisible from the bystander's side —adopt_active_viewmoves the asker's mirror either way, so the drift is between the server's picture of the asker and the asker's own slice, and a test asserting through a "what do the others hear" helper looks away from it by construction. (apply_switchhas the mirror-image hole on its refused path, where the asker folded something the document turned down and is the one client not told: improvise-6c6q.) AVecrather than anOptionbecause one command can owe two relays with different audiences, and anOptionwould have had to drop one silently. Everything else is that client's alone and never touches theApp's own view slice: the model is shared, the UI is not. FoldingSwitchViewinto the mirror alone was the bug —viewport()then read the cursor under the new view's key and the nextproject()built that client a grid out of the other view. -
gp-treereturns data and never prints, and a fit takes two things to reproduce. Two rules with one root — the crate is a library a TUI, a wasm worker or a CLI may each host. (a) A decision the user should hear about comes back as data:Dataset::warningscarries the columnspreprocessdropped for being entirely missing (improvise-d44s), andfit.rshands back pooled(prediction, actual)pairs and a score per feature rather than tables.examples/fit_csv.rsowns everyprintln!, and that is the only reason its output stayed byte-identical across these moves — adding aneprintln!to either module is the regression. (b) The seed is necessary and not sufficient:data::Modelrecordsseed: Option<u64>andconfig: Option<FitConfig>, because the same seed under a different population/generations/elite/penalty lands on a different tree (improvise-ksst). Both areOptionfor one reason — everyFitConfigvalue and the seed0are legal, so nothing can double as "unknown". Note#[serde(default)]on anOptionfield is documentation, not the mechanism: serde defaults it anyway, so deleting the attribute fails no test, and a backward-compatibility test that only deletes it is not discriminating. Aim such a test at an absent field loading as the default instead of as unknown. The GA loop itself isfit::fit(improvise-0ai);breedremains one fitness-agnostic generation for callers whose fitness is not "predict this column". (c) A scoring function takes one slice of rows.Row<T>pairs a feature vector with what it predicts, so the parallelx/ylengths thatzipused to truncate silently cannot be built (improvise-dkqn,doctrine(an_invariant_is_made_unrepresentable_not_validated)— the same answerprune_axis_itemsgot, and the reason noResultentered five signatures). The pairing is made at the boundary that builds the data:preprocesswalks one row index and the rows live insideTarget, because aDatasetcarryingrowsandtargetseparately just moves the zip up one level into every caller. The empty row set is one shape, answered once inmean_over. Changing any of this needs bit-level evidence:tests/scoring_known_answers.rspins every path as f32 bit patterns plus anext_u64witness that catches a changed RNG call order, because the CLI prints three or four decimals and byte-identical output alone cannot see a moved accumulation. (d) A fit is storable only when the document can name its features.preprocessinventsRegion=North,Cost.missing,when.year; those are encoding artefacts, not items of the document, andExpr::Refresolves throughModel::find_item_category— so a tree splitting on one emitted a well-formed formula whose every cell wasError("ref:…"), silently (improvise-8xhy).fitted_formulatherefore takes the&Modeland refuses, listing what it could not resolve;formula_textstill spells it, being the tree's own text. The check asks the document, never the name's shape, because a measure literally namedRegion=Northis a legal document and the two are indistinguishable as strings — which also means.missingand the date parts are covered with no second copy ofpreprocess's expansion rules to drift from. This is an interim (improvise-4zl7): aWHEREpredicate needs a scalar coordinate predicate the formula language does not have —Filtergates a formula or an aggregate, it is not anExpr— would still leave.missingand the date parts, and must first answer what such a predicate means wherecontext.get(cat)isNone, sinceFormula::filterfalls through toaggregate_rawand a categorical fit would silently degrade in every view that aggregates over the category. The test that missed all this is the shape to remember:improvise_evalfabricates a_Measureitem per feature name, so it asserted the emitter andgp_tree::evalagree against a model that could not exist. It is kept, with its scope now stated, and the property it could not state is asserted separately against a real document. -
The wire vocabulary is derived twice, by the same recipe.
Command's view half is theEffectKind::ViewOnlyeffects targeting the portable slice (decision(improvise-cqi, command_set_derived_not_invented)); its model half,ModelCommand, is theEffectKind::Model(..)effects — 29 of them, one variant apiece, minusSwitchView, whichCommandalready names and routes (gotcha 36), leaving 28 (improvise-kmgs). Note the obviousawkextraction reports 30: it picks upHelpPageSet, which isViewOnly, because that is the lastpub structbefore#[cfg(test)]and the test module mentionsModelChange::— brace-match theimpl Effectblocks instead (doctrine(derive_then_verify)). Three things follow. AModelCommanddoes not mutate:ui/reduce.rs::model_effectsmaps it back to the effect it came from andapply_commandruns that throughApp::apply_effects, so effects stay the only mutation site and theDirtyis the effect's ownEffectKind, never a second classification beside gotcha 35's table. Two model effects are deliberately off the wire.ApplyAndClearDrillandAcceptWizardModelwere once kept on the grounds that the command is portable even where the operand is not; that was the wrong criterion (improvise-3x3u). ACommand::Modelis routed with noSessionId, which is right exactly when the change is addressed to no one session — and these are addressed to precisely one, never the sender: their operands aredrill_state.pending_editsand the built wizard workbook, session-local residue (gotcha 30) private to whoever staged them (improvise-tom1). Unaddressed, B'sApplyAndClearDrillcommits A's uncommitted typing and B'sAcceptWizardModelswaps the document out of a dialogue B never opened — both demonstrated againstSessions::applybefore removal. So 29 −SwitchView− these two = 26. The effects are untouched and still reached by the key path. Not permanent: multi-client drill wants the addressed form, which is where ADR 001 layer 2 goes anyway. Guarded byno_model_command_commits_another_clients_session_local_state, plus a companion asserting both effects still exist and are still model changes so the first cannot pass by naming nothing.Sessions::applyroutes the model half toapply_model, which owes the same lockstep asapply_switch:ViewBack,ViewForwardand a document-replacingLoadModelall end inApp::switch_to_view, so every mirror takes the accepted active view. Its broadcast is conditional whereapply_switch's is not, because no client optimistically folded an active view here. A keymap lookup still cannot return aCommand, and not for want of vocabulary: a binding names an intent resolved againstCmdContext(move-cursor down) while aCommandis the resolved mutation (SetSelected { row, col }) — improvise-gxi's AC 4 asks for something the split forbids. -
Appliedis an enum because a document swap is not a diff.Sessions::applyreturnsApplied::Diff { dirty, broadcast },Applied::Rebased { snapshots }or — since ADR 001 layer 1 —Applied::Rejected { reason }, and the enum is the mechanism: a host that wants theDirtymust match, and matching names the case where aSnapshotis owed. The server's mirrors self-heal —ClientSession::projectreseeds on thedocument_generationbump — butViewState::cursorslives on the client, keyed by the outgoing document's view names (gotcha 24), and only a freshSnapshotreplaces it.Command::Modelput the threeWholeWorkbookmutations on the wire (gotcha 38), so the host that must send the snapshots is no longer the host that asked.apply_modeltherefore callsrebaseitself rather than instructing the host to, exactly asapply_switchadopts the accepted view itself. The trigger is the generation moving, not the command variant: aLoadModelthat cannot read its path leaves the document alone, and reseeding on the variant would cost a client its cursors for a failed load —a_load_that_fails_is_not_a_rebaseguards that arm. Arebase: boolbesidedirtywas rejected, because the host that forgets to callrebaseis the host that forgets to read the flag. The third case is a normal outcome, not an error, and it is in the enum for the same reason the other two are: a host that wants theDirtymust match, and matching names it.ServerMsg::Rejectedis the matching frame, addressed to the asker alone — nothing happened, so nobody else is owed anything — and the client keeps it as aRejectionrather than a sentence, because force needs to know which record and which kind (gotcha 43). Fixture warning. When testing a document swap, the incoming document's active view must have the same name as the outgoing one. A rename makesapply_modelbroadcast aSwitchView; the client folds it, and the stale cursor is then read under a key nothing has written — right by accident, with the bug invisible.other_document()renames, and a first version of this test passed because of it;a_document_shaped_differently_under_the_same_view_name()keeps the name and changes only the shape, so there is nothing to hide behind. -
A batch's basis is three tiers, and only two of them can be read off the effect.
Appcarriesdocument_generation(bumped byinstall_workbook),layout_version(perModelChange::LayoutGeometryeffect) andrecord_versions(per record) — ADR 001's stale-basis check, and shared document state, so never onViewState(gotcha 30). The unit is the record:record_of(key)is the coordinate tuple minus_Measure(record_row_identity), because renaming a category coordinate in wide records mode moves every measure cell in the row (gotcha 1) — a cell-level unit is violated by one legal edit, so the unit must be at least as coarse as the coarsest legal write. Both tiers are read inapply_effectsoff the sameEffectKindtheDirtyis: one classification, two readers, no second table to drift from gotcha 35's.layout_versionbumps inside the loop for the reasonDirtyaccumulates there — an aborted batch must not claim effects it never ran (gotcha 21).record_versionscannot, because anEffectKindsays that a batch writes cells, never which; so the records are observed, via a per-record XOR fingerprint of the raw data taken when the batch declares aCellDataeffect and diffed after it. Three consequences. A write landing the value already there bumps nothing, which is correct — no basis was invalidated. ALayoutGeometryeffect that drops cells will bump their records when it shares a batch with aCellDataone: an over-bump costing at most an unnecessary rejection, the same directionDirty::ofis deliberately sloppy in. And only raw data is fingerprinted — formula results live inModel::formula_cache, and a record whose derived value moved because someone edited elsewhere has not itself been written. The diff collects into a set: chainingbefore.keys()withafter.keys()counts any rewritten record twice, a bug that survived one test run. -
Storageis not a VFS, and that closes the SQLite question. The trait is whole-documentread/writebytes (gotcha 2,invariant(storage_is_two_ops)) — no offsets, seeking, handles or locking — so ansqlite3_vfs, which needsxRead(offset,len)/xWrite/xTruncate/xLock, has nothing to bind to. SQLite can still sit behind it, as an in-memory database serialized to a blob (rusqliteserialize/deserialize_read_exact, proven with a probe before declining — declining on a capability that actually exists would have been the wrong decline). It is worth nothing: measured on 18,000 cells the SQLite container is 22% larger than.improv, 4.7× larger gzipped, ~160× larger at the floor (24 KB against ~150 bytes), and still rewritten whole on every save, so the one dimension SQLite normally wins — incremental page writes — is unavailable. improvise-9ix was declined on that evidence. Two things generalise past SQLite. A second serialization format is a second implementation of the grammar, obliged to trackimprov.pestforever; and its own round-trip test cannot detect drift from.improv, because it never compares the two — that missing cross-format equality test is what made the ticket look cheap. If a structured-query story is ever wanted it is a one-wayexport_sqlitebesideexport_csv, native-only and feature-gated:libsqlite3-sys' C build fails under this repo's nix cc-wrapper forwasm32-unknown-unknown, which would break thewasmCI gate the day it landed. -
The browser client's render decisions are made in Rust, and the frames it speaks are nobody's but the protocol's.
improvise-wasm-client/src/render.rsbuilds aRenderModelin which every question with a silent wrong answer is already answered, because the DOM half (web/app.js) is untested JavaScript and a wrong answer there shows up as a wrong pixel rather than a failing test. Three such answers.editableis a fact about theCellIdvariant —Recordonly, per ADR 002 — and the trap is the third case:Nonemeans "no projected cell", not "aggregate", so conflating them either hides a cell or offers a write the type system exists to make unconstructible. The selection is placed by reconciling the scroll offset, becauseGridCacheis viewport-indexed whileViewState::selectedis absolute.render.rsdoes it by adding —r + cursor.row_offset == sel_row— rather than subtracting, which is why there is no underflow path and why a selection above the window simply never matches. Omitting the offset entirely looks right until the first scroll, so the test that earns its place uses nonzero and unequal offsets: atselected=(5,1),row_offset=4,col_offset=1it separates "reconciles" from "ignores" and from "swaps the two offsets". The category panel isviewmodel::flatten_cat_tree, never a second walk ofCategoryTreeCache— that second walk was improvise-edp. The page is four string calls:Client::viewport(the handshake — theSnapshotseeds the visible cells, so one built at extent zero is an empty grid and a resize is a fan-out with nothing dirty),on_frame(one frame, one fold, arrival order — gotcha 33 holds inside a batch, so never coalesce),render_model,typed_cell.One envelope pair, two deployments (improvise-xks6).
improvise_protocol::frameownsClientFrame { Viewport, Command, Key }andServerFrame { Snapshot(Box<_>), Commands(Vec<_>), Rejected };improvise-ws-serverandimprovise-wasm-clienteachpub usethem and neither defines one. There used to be three pairs for two deployments — the socket's server side, a hand-kept mirror of it in the browser bundle, and a third written for the worker (improvise-tm6) before the projection architecture landed. The question that had to be answered before any of it moved was whether the worker and the socket want the same vocabulary, and the answer is yes: every difference was a date rather than a decision, and the test applied to each was whether the argument for it names the thing they differ in. None did.Viewportis deployment-independent — the extent is not inViewStateand no effect produces it, so no derivation reaches it, and a worker hosting the sameSessionsowesset_extentthe same answer; it is the handshake on both because aSnapshotseeds the visible cells.Keyis deployment-independent too — a binding names an intent resolved against aCmdContexta thin client does not hold (gotcha 38), which says nothing about what the bytes travel over; the socket lacked it because key forwarding was never built on it (improvise-bpq2), andHost::handlenow answersClientFrame::Keywith an explicit empty vec that says so, where the frame used to just fail to parse innext_client_msg. AndCommands(Vec<_>)batches where a singleton cannot, because a fan-out must arrive whole and in sequence (gotcha 33) — a property of the fold, not of the transport; an in-processpostMessageinterleaves exactly as a socket does. The worker pair was not merely different but incoherent by omission: written before ADR 001, it could carryCommand::Model { basis, .. }and had noRejected, so a client speaking it composed a claim that could never be answered. That incoherence — not the difference — is the tell for staleness.The mirror is gone, and so are the two tests that held it honest; that deletion was the ticket's measure of success.
the_socket_framing_matches_the_serverround-tripped hand-listed fixtures through the other crate's types to catch a rename;every_server_variant_is_one_this_crate_mirrorsmatched exhaustively to catch a variant added on the server and never mirrored. With one definition both are type identity: a rename is a compile error at every call site in both crates, and the un-mirrored variant is not a constructible state. That is stronger than either test, and it is the shape to insist on — if a consolidation leaves one of its compatibility tests alive, the consolidation is not finished. What survives isthe_retired_spellings_do_not_parseinframe.rs, aimed at the one thing still possible (the retiredBootstrap/Commandspellings returning as serde aliases, which would be two homes again wearing one type), and it keeps the injected-fault discipline this paragraph earned the hard way: assert the mutated input is still well-formed before feeding it in, and assert the error kind — serde'sunknown variant— not merely that an error occurred, because a rewrite that also breaks the JSON makes the check pass against an enum that really does have the variant. End-to-end compatibility is nowtests/browser_round_trip.rs, which hands the wasm client's own serialized frame to a realHost::handle;improvise-ws-serverstays a dev-dependency of the browser bundle for exactly that.What the harness does and does not reach is gotcha 48's subject —
web/app.jsis no longer unrun (harness/tests/shell.spec.jsexecutes it under Chromium), improvise-hwpi is closed, and the quiet-failure and never-reads-a-key claims that used to stand here went with it. What remains unexercised is named there: the grouped and multi-level DOM, the CSS and theResizeObserverextent arithmetic. What a careful read did establish about the last of these: the observer cannot feed back into itself (#gridis a flex child withoverflow: auto, soreplaceChildrencannot resize it), andROW_PX/COL_PXunder-estimate, so the worst case is a row of over-fetch. What is verified end to end is the Rust half:tests/browser_round_trip.rsdrives improvise-1ey's stated scope against a realHostover a realApptouching the client only through the four string calls. One deployment note that is not a bug:examples/demo.improvleavesCustomer/Dateon the None axis, so every cell is an aggregate and nothing is editable — correct behaviour, bad demo. Pick a model with no regular category on None. -
A batch carries its basis, and the server had to publish it first.
Command::Model { basis, cmd }is a struct variant so the basis cannot be forgotten, andSessions::apply_modelchecks it before applying anything — a stale batch is never applied, not even partially (improvise-xwi6/fkfg, ADR 001 layer 1). Four things to know.Basishas noDefaultand no public constructor: a zero-valued basis is not "no claim", it is the claim that the document is fresh, which in a newAppis true — so a default would be a forgeable bypass rather than an absence.BasisCache::claimis the only door a client has and it returnsNoneuntil the server has published one. Note what that does and does not buy:BasisderivesDeserializebecause it must cross the wire, and its fields are public, so a hand-rolled client can state any tiers it likes. This is an anti-staleness coordination check, not a security boundary —RecordUnstatedcloses omission, not invention, and nothing here tries to close invention, because a client that forges a current basis is indistinguishable from one genuinely caught up. "The only constructor" is a statement about clients written against this crate, which is still worth having: it makes the honest path the easy one. Which records are checked is the server's decision —reduce.rs::records_named, an exhaustive match with one or-pattern for the variants that name no record, so a new record-writing variant fails the build. Reading the list off the client's claim would be a force by omission: the record tier skipped, with no flag to remove and nothing in the message saying so. A claim that omits a record the command writes getsRejection::RecordUnstated, a case of its own because "you lost a race" and "you were never in one" are different things to tell a user.Rejectionkeeps structural and data staleness apart, which is the whole reason ADR 002 put a maintainedRecordHashindex inDataStore:RecordGonemeans nothing resolves and there is nothing to force (force never creates structure),RecordMovedmeans it resolves at another version and force is one keystroke — which is also why the wasm client stores theRejectionitself rather than collapsing it intostatus_msg, since a string cannot carry which record or which kind. And the ADR omitted the publication. It said a batch carries the basis it was composed against and never said how a client learns one; nothing in the projection stream carried any of the three tiers, so the check as written was satisfiable only by forging.Projection::Basis+BasisCacheclose that — the server publishes the two document tiers plus the counters for the records this client's grid names, diffed against what that client was last told and seeded in the bootstrap — and it is emitted after the grid updates in a batch, because the counters describe the cells those updates carry: a basis arriving first would let a client claim a version for a value it had not been shown, the mirror image of gotcha 33. That ordering was documented as load-bearing in three places and held up only by the order of two statements untila_published_basis_follows_the_grid_updates_it_describespinned it (proved by injecting the swap) — the same joba_cell_update_that_overtakes_its_labels_is_lostdoes for the mirror-image rule. Two things are unchecked and deliberately so:Command::SwitchViewcarries no basis (it sits outsideCommand::Model; the workbook refuses a view it does not have, so it cannot corrupt, but it is a hole in the rule), andapply_command/reduce_fulldo not check at all — the check is a property of the session door, not of the mutation path, which is right because a host holding theAppis the truth rather than a claimant. That second one was a door rather than an exemption, and needed a type to stop being one (improvise-ondj): both took a wireCommandand theirCommand::Model { cmd, .. }arm discarded the basis with.., whileui/reduce.rs's own module doc pointed every future host — the browser worker included — at exactly those two names. The struct variant closed omission from the message; it did nothing to close ignoring on arrival, which is the half a struct variant is usually reached for. So both now takeChecked<'_>, a private-field newtype over a&Commandwhose only constructor isChecked::against(&App, &Command) -> Result<_, Rejection>— also the only caller ofstale_basis.Sessions::applyanswers once, before the dispatch, soapply_switch/apply_modelreceive the proof rather than each remembering to ask: an invariant made unrepresentable rather than validated, the same answerprune_axis_itemsandgp-tree'sRow<T>got. Visibility was the weaker option and was rejected for a concrete reason —pub(crate)closes only the out-of-crate path, andreduce_fullhas no production caller anywhere in the workspace, so it would have become dead code. The regression guard is therefore the signature: the test that reproduced the bug no longer compiles, and what remains asserts the constructor refuses and that refusing leaves the document untouched. One residual hole, documented on the type and filed: aCheckeddoes not name whichAppit was checked against, so a multi-document host could in principle check one and apply to another. That is also whyui::reduce::caught_up(&App, cmd)is not a bypass: it takes&App, so nothing reachable from a wire can call it. Since improvise-955n the frame, not the command, is what is answered — and only two of the three tiers hoist.CheckedBatch::againstruns before anything in aClientFrame::Commandsis applied.document_generationandlayout_versiondescribe the document, so answering them once for the frame is exactly right, and a first version hoisted all three — which was a lost update: the record tier asks "is the client's picture of this record current", and which records are at stake is a property of the command (records_named). Skipping it for later commands let[SetCell(North), SetCell(South)]overwrite a South somebody else had moved, silently, with the frame reported accepted, and invisible to the other two tiers because aSetCellisCellDataand moves neither. So every mutation answers for its own records against the frame's basis — the one the first basis-carrying command stated, never each command's own field, or a later command could claim a fresher picture than the frame was composed under. The one exemption is stated over a property rather than a list of commands: a record that neither resolves in the document nor is claimed by the basis is one the frame is about to create ([AddItem(East), SetCell(East)], whichBasisCache::claimcannot possibly claim for), and only that combination is exempt; a record that does not resolve but is claimed is stillRecordGone. That theBasisinside a laterCommand::Modelis ignored rather than compared is an honest interim: clause 1 says the frame states one basis, and moving the field fromCommand::ModeltoClientFrame::Commandswould make that unrepresentable-otherwise instead of a convention — a protocol change that belongs with clause 4. Two things worth keeping from the rejected design: arity is not a property of a variant (a futureCommand::RunScriptis one variant performing unboundedly many mutations), so no count over the vocabulary can enforce "one mutation per frame"; and the transaction boundary is not the frame, because one command may already be a chain, which is why clause 4's mechanism belongs atApp::apply_effects. -
The TUI grid draws from its cache, and since improvise-anr9 the cache frames it too.
GridWidgetholds no&Modeland no&View: cell text, aggregate-ness (CellId::Aggregate, ADR 002), column widths, the page bar, the totals strip and now the frame all come offGridCache. The TUI still builds that cache over the whole grid (offsets zero), so a cache position is an absolute position — the browser'sViewportis a real window, the TUI's is not, and the two clients therefore use it differently; column totals must be projected rather than client-derived, because the sum runs over every row including the ones a viewport scrolled past. The frame is anAxisFrameper axis —cats(the categories, outermost first) plusentries: Vec<FrameEntry>interleavingGroup(FrameGroup)headers withItem(Vec<String>)label tuples, exactly asGridLayout::row_itemsinterleaves them. That replaced aVec<String>built byGridLayout::row_label, which slash-joined the tuple — the exact renderingtwo_row_categories_produce_cross_product_labelssays must not appear — so the browser drewFood/Alicewhere the TUI drew two header columns, with no groups and no collapse indicators. It is one type and not alabelsplus alevelsbeside it: two answers to "what are the labels" is the disease (improvise-edp), and this is the second cure, which cost a type change rather than an addition. Three things to know before touching it.leaf_labels()is not "the labels" — it is the innermost label, what a one-line summary calls a row by; a draw loop wantsheader_labels(first_rendered),groups()andshares_ancestry(sel), each of which is one pass, becauseitem/label/shows_level/group_ofscanentriesfrom the start and asking them per position is quadratic in the frame and grows with the TUI's absolute scroll offset (found three times on anr9; the per-position forms survive for one-off lookups and say so). The width rule has one home,improvise_protocol::header_level_widths— widest label per level, plus a gap, clamped — reached byAxisFrame::header_widthsand byui::viewport::compute_row_header_width, which borrows level tuples off aGridLayoutrather than building a frame on the keypress path. Acatschange re-identifies every position: a cell's identity iscatszipped with its tuple, soinvalidate_relabelledblanks the whole axis when the categories move, not merely the positions whose tuples differ, and blanks the totals on a recategorization of either axis — a column total is a sum over the rows, so re-identifying the rows leaves a number answering coordinates the grid no longer has (gotcha 33(b): the rule lives inapply, not in a producer's memory). What is still not on the cache isrecord_col, and that is correct: it keys pending drill edits and is session-local (gotcha 1).body_from(idx)takes an argument only because the two front ends scroll differently — a browser's frame is already windowed and passes0, the TUI's covers the whole grid and passes its row offset — not because the rule differs.group_ofanswers "nearest preceding header", which is what the TUI has always painted rather than membership; changing that means changingAxisEntryinimprovise-coreand is filed, not smuggled in. Andproject::grid_ofevaluates every cell per frame where the widget evaluated only the visible ones — a widening of an existing whole-grid cost, still unbenchmarked. -
One session loop, two transports — and the browser saves itself.
HostisApp+Sessions+handle(id, ClientFrame) -> Vec<Addressed>and lives inimprovise_command::ui::host, not inimprovise-ws-server, which re-exports it. It moved for improvise-9x6: the worker hosts the same authoritativeAppover aMessagePortand cannot depend on tokio, and a second copy would have been exactly the mirror improvise-xks6 had just deleted for the frames — a driftingApplied/Broadcastmatch is invisible until a client sees it.registrystayed on the server, because a worker hosts one document. What the worker adds is only what aMessagePortdiffers in: one client by construction (theAddressedfilter is honoured anyway, against a futureSharedWorker), and a handshake with no close —ClientFrame::Viewportmust still come first, but a pre-handshake frame is dropped rather than closing a connection that does not exist.Saving is a frame, and dirtiness is read off the classification the effect already carries.
effect::SaveisViewOnly(gotcha 3) — correctly, since it writes this host'sfile_paththrough this host'sStorage— so the derivation that buildsModelCommandfrom the model effects cannot name it, and for a while that meant no client on any transport could ask its host to save.ClientFrame::Savecloses it (improvise-368h): a request carrying no path, because a client cannot see the host's storage, answeredServerFrame::Rejected(NoDocumentPath | SaveFailed)to the asker alone and silently on success — nothing moved, so no widget is dirty. It is a frame and not aCommandfor one concrete reason: as aCommandit put a runtime-fallible operation inside a batchClientFrame::Commandspromises is all-or-nothing, so[Save, SetCell]reported a failed write and then applied the edit. It also fails the test everyCommandpasses — it mutates no shared state and no client's slice, soreduce_viewhas nothing to fold andCheckedhas no basis to answer for. AndMarkDirtyis gone. It was a separate effect the command layer composed beside each mutation — reasonable on the key path, unreachable from anywhere else, because improvise-kmgs derivedModelCommandfrom the effects one at a time and so putSetCellon the wire without its companion (improvise-gv9r): a derivation correct per element and wrong for a set, whose symptom was that "save if dirty" never fired.App::apply_effectsnow raises the flag for anyEffectKind::Model(_), all threeModelChangelevels included, which makes omitting it unrepresentable rather than validated. It over-approximates in the same directionlayout_versiondoes — aLoadModelthat cannot read its path leaves the flag raised, costing one redundant write — andSaveclears it in loop order, so a batch that edits and then saves ends clean. The worker's persist trigger is therefore the flag, not a table of command variants: an observation rather than a second description of which commands change the document, for the reasoncursor_epochbeats matching onCycleAxis(gotcha 24) anddocument_generationbeats matching onLoadModel(gotcha 39). It is also strictly tighter — a refused batch raises nothing, so the "was anything rejected" guard went with it. A browser still never sendsClientFrame::Save, and that is the answer rather than a gap: there is no file the user owns and no Ctrl-S semantics, the document is the OPFS entry, so the worker persists on its own behalf through the one existingSaveeffect. The cost that remains:Storageis whole-document (gotcha 41), so OPFS rewrites the file per accepted model command.The async seam does not survive being boxed.
OpfsFs::open/attach/refresh/commit_deletesare on the struct, not onStorage.App::storageis aBox<dyn Storage>and a trait object can name none of the four, so handing the backend to theAppputs the async seam permanently out of reach; the host must hold the concrete backend and give theAppaStorage, which means sharing one. That isimpl<T: Storage + ?Sized> Storage for Rc<T>, and it lives inimprovise-iorather than in each worker (improvise-hmws):impl Storage for Rc<OpfsFs>is two foreign types in any other crate, so improvise-9x6 wrote a forwarding newtype that every future worker would have written again.Rcand notArcbecause the one caller is a Web Worker and wasm32 has no other thread. The flat root is no longer load-bearing:OpfsFs::listjoinsdirlike the other two backends, sostorage_contracttakesdiras a parameter and the three agree at every directory rather than only atPath::new("")where joining is the identity (improvise-vhcz). What the index holds is documents, not entries, and the split between its three writers is the rule:attachindexes nothing (what it creates is zero bytes),Storage::writeindexes the name and un-queues any pending delete of it, andrefreshrebuilds from OPFS skipping zero-byte entries — counting an entry it cannot measure as a document, since the one cause of that is another tab holding the exclusive handle (improvise-vvl3).What no test here can see has shrunk, and precisely.
harness/(improvise-vvl3/xf1) runsimprovise_io::storage::contract::storage_contractagainst a realOpfsFsinside a real dedicated Web Worker under Chromium and Firefox, and thebrowserjob in CI can fail the build — soOpfsFsis no longer compile-checked-and-never-run, and two bugs fell out of its first execution. That is whystorage_contractstopped being a#[cfg(test)]helper and became a public function returningResult: a browser must run that sequence, not a second transcription of it, and a failure has to travel out of a worker as a string. Still unseen: Safari (Playwright's WebKit has no OPFS, so xf1's criterion is met for two engines of three;opfs.spec.jsskips on a runtime probe and an unexpected skip on any other engine is a failure), andbindings.rs, which the harness does not instantiate —createSyncAccessHandleexists in no host harness, and that shim is now the dark corner whereOpfsFsused to be. What was already verified stays:tests/post_message.rsdrives a realWorkerover a realAppon nothing but the JSON aMessagePortcarries. Build note unchanged: the worker bundle needs--enable-nontrapping-float-to-intas well as--enable-bulk-memory, because it carries the wholeAppand so chrono's date arithmetic. -
The page picks a peer, and the demo was built against an assertion.
web/app.jsholds two transports and no protocol knowledge:?ws=selectsimprovise-ws-server, its absence spawnsnew Worker('./worker.js?doc=&seed=', { type: "module" })(improvise-djm).type: "module"is mandatory —worker.jsimports the bundle — and there is noMessageChannel: a dedicated worker's ownpostMessage/onmessageis the port, so the ticket's channel wording was a date rather than a decision. The websocket path is kept, because the ws-server is how a TUI-hosted document is shared and nothing else in the browser can reach it; the cost is contained because the two differ only in where strings come from — handshake, fold, repaint and keyboard are all above the seam — and the presence of the parameter is the whole selection mechanism, a second knob being a second thing to get wrong.#statuscomposes two facts, the transport's and the document's, because a single source let a repaint silently erase a connection error. A worker that rejects instart()fires noerroron the main thread —worker.jscatches its own — so the guard is a first-frame watchdog, deliberately not per-transport: "the peer never answered the handshake" is the one failure that means the same thing over a socket and over a port, and a check aimed at each peer's own failure modes would have missed exactly this one.The demo is a model built to satisfy a check, not an axis flipped and hoped for.
examples/demo.improvleavesCustomer/Dateon None, so every cell is anAggregateand nothing is editable — and the naive fix does not work either, sinceProduct × RegionbyDate_Month × Measurestill aggregates.web/demo.improvputs exactly one category on each visible axis (Productrow,_Measurecolumn,Quarterpage, nothing regular on None) and carriesProfit = Revenue - Cost, so the payoff is on one screen with no keystroke. Settability is asked ofgrid_ofas aCellIdvariant, never re-derived from the axes — a second derivation could agree with itself while disagreeing withrender.rs::editable, which is the whole point of ADR 002 — and the assertion was proved discriminating by pointing it atexamples/demo.improv, where it names the aggregate at (0,0). One category per axis is a property of the demo, not of the format: when this was writtenGridCacheslash-joined a multi-level tuple, so a second category on an axis put that known gap on the front page — improvise-anr9 has since closed it (gotcha 44), so what remains is the demo's own simplicity rather than a rendering limit.web/*.improvis un-ignored in.gitignore(*.improvis ignored repo-wide) and the CI assemble step copies it: leaving it out is an empty grid, not a 404 the page could report. One wart it now puts on the front page: a formula cell is aRecord, so it is offered as editable and a write to it reverts on recompute — pre-existing and matching the TUI, newly visible. -
Keys become commands in the browser, and the server must not know the keymap. The user's ruling on improvise-bpq2, following from "the model is shared, the UI is not" — and it buys two clients different bindings over one document. What made it urgent is not latency.
a_key_resolved_on_the_host_moves_state_no_client_can_hearshows nothing in the projection stream carries the host's ownViewState, so host-side resolution diverges; andHost::handleanswersClientFrame::Keywith an explicit empty vec, so an upstream key is a black hole, not a slow path — everyKeyOutcome::Upstreamnames a binding that does nothing at all in a browser. That test still holds and was not flipped: bpq2 closes the divergence by avoiding it. The method is the ticket's — enumerate the bindings, not the commands (doctrine(binding_dump_diff)) — and where a client cannot compose theCommand, enrich the projection rather than moving resolution back.Three things that cost.
GridExtentonGridCache— the whole grid, of which the labels are one window — because a viewport-indexed cache cannot tell "the last visible row" from "the last row". It is deliberately not framed by the labels (fit_to_labelsleaves it alone) and its batch position is not load-bearing the wayRowFrame-before-Cellsis, since it addresses no position; the producer readsGridLayout::row_count(), and reading it off the projected ranges is invisible in the TUI (which builds at offsets zero, gotcha 44) and is exactly the browser bug. The window is the client's own fact, recorded byClient::set_viewportfrom what it announced — not derivable, since the row frame's own length is the window clipped to the grid and so differs precisely at the bottom edge where the scroll arithmetic matters.Client::viewport(associated, no recording) still exists and is the one that quietly turns cursor keys off;web/app.jsdoes callset_viewport.ClientFrame::Commands(Vec<Command>)replaces the singleton, because one cursor key isSetSelectedplus the offsetsviewport_effectsreturns and a host that folds the selection but not the offset projects the wrong window. It is answered whole, then applied whole (improvise-955n):CheckedBatch::againstchecks the frame before anything runs, so there is no longer a moment at which part of a frame has landed and the rest has been refused, andApplied::Rejectedis unreachable throughHost::commands— still matched, because a host that wants theDirtymust name every case (gotcha 39). The contract is four clauses and clause 4 is not delivered: one basis per frame, checked once, applied in order with each command seeing the last one's state, and all-or-nothing. The fourth is open becauseApp::apply_effectsaborts without undoing (gotcha 21 — an abort is not a rollback), so[RemoveItem("North"), SetCell(the North record)]lands the removal, resolves the write to nothing, and reports the frame accepted having applied half of itself — partial and silent. It is unreachable from any client in this workspace, the only multi-command producer beingkeys::commit; reachability is a reason not to rush a fix and not a reason not to notice one — the lost updateCheckedBatchfixed had the same reachability argument and none of the documentation, which is how it shipped.Two corrections to the ticket's own gap list, both worth more than the code. Panel cursor movement was never a gap: improvise-edp had already made
viewmodel::flatten_cat_treethe one home both ends call, so it is the shared derivation, not a second one — worth re-checking the "known gaps" in other old tickets against what has landed since. And the "unmodified characters only" rule was mis-scoped, not wrong: it was aboutKeyPattern::AnyChar, which is bound only in the text-entry modes, soCtrl-din Normal has an exact binding and mirroring it is a faithful subset. Each resolver mirrors itsCmdline for line, including where siblings disagree —MoveandMoveTileCursoremit even when they clamp,MovePanelCursorreturns nothing when the cursor does not move. Tidying that into one rule would make the client a second derivation, which is whattests/lockstep.rsexists to rule out. What still needs the host is a named list inkeys.rsand inthe_normal_mode_keys_that_still_need_the_host_are_these, so closing one has to come there and say so. -
The browser JavaScript is argued and now partly executed, and the two rules it can break are both about when.
web/app.jsandweb/worker.jswere syntax-checked,.d.ts-checked for call arity and read — never run — and every bug in them was found by reading.harness/tests/shell.spec.jsis the first execution of either: it runsapp.jsunder Chromium against a mocked peer, and it exists because PR #21 declined to add regression tests for its own close-listener fix on the ground that there was nowhere to put them. That decline is only honest because the assertions live there now, and a change toweb/*.jsbelongs in that spec directory rather than in a second ad-hoc surface beside it. Playwright rather than a headless-DOM shim because what goes wrong in these files is a real Worker, a real WebSocket, real OPFS and real event ordering, none of which jsdom has. Two classes of bug still follow from when, both found by review. Anasyncmessagelistener does not serialize.worker.js'shandle()awaitsserver.flush(), so the event loop may start the next message while an earlier one is suspended, interleaving twoon_message/flushpairs and letting a later frame's replies overtake an earlier frame's — which gotcha 33 answers by dropping the overtaken update, not by replaying it. Every frame is therefore chained onto one tail promise and the listener is deliberately notasync; that also turns "frames that arrived beforestart()finished" into an ordinary case of the ordering rule instead of a drain loop, which had the same race twice over becauseserverwas assigned before the loop ran. A watchdog must be disarmed, not pre-empted. The handshake watchdog exists for one condition — the peer never answered — and every loud failure (workererror/messageerror, socketerror) has already written something more precise; the timer then fired 8s later and replaced it, sosetShellFailureclears it. Its neighbour, the socket'scloselistener overwriting a preciseerrorwith "disconnected", is fixed (improvise-taxx, PR #21) — and the ticket's own proposed mechanism was wrong:readyStatecannot discriminate, anopenedflag is the only thing that can. What remains open is the other half: the handshake watchdog still overwrites a genuine mid-session disconnect eight seconds later (improvise-xps8), and that one is not the same fix, because suppressing it could hide a real drop.What the harness still cannot see, and why the argued-not-tested discipline stays: the grouped and multi-level DOM, the CSS, and the
ResizeObserverextent arithmetic. What a careful read established about the last of these — the observer cannot feed back into itself (#gridis a flex child withoverflow: auto, soreplaceChildrencannot resize it) andROW_PX/COL_PXunder-estimate, so the worst case is a row of over-fetch — is still a read and not a test.A third thing no test here can see, which is why the docs must be read as code. Three comments in one range said "not built yet" about work that had landed in that same range —
README.md's browser section,app.js's keyboard note, andHost::handle'sKeyarm — each because a follow-up commit updated one copy of an argument and not its siblings. When a fact is stated in more than one place, changing it is a grep, not an edit.
File Inventory
Line counts are static; test counts are informational — run cargo test --workspace for live numbers. Files under 100 lines and render-only widgets omitted.
improvise-core (crates/improvise-core/src/)
model/types.rs 2352 / 74t Model, formula eval (fixed-point), CRUD
model/cell.rs 1234 / 43t CellKey (sorted), CellValue, DataStore (interned + index),
live_records (insertion order — gotcha 18)
model/record.rs 326 / 8t RecordHash / CellId surrogates: the opaque identities a
thin client names a cell by (ADR 002)
model/category.rs 316 / 9t Category, Item, Group, CategoryKind
model/symbol.rs 79 / 3t Symbol interning
view/layout.rs 1251 / 30t GridLayout, drill, records mode, records_columns
view/types.rs 711 / 36t View config (axes, pages, hidden, collapsed, format)
view/axis.rs 205 / 5t Axis enum + label/color/next methods, AxisColor
workbook.rs 345 / 17t Workbook: Model + cross-view ops, item facade
format.rs 229 / 29t format_f64, parse_number_format (display only)
improvise-formula (crates/improvise-formula/src/)
parser.rs 1087 / 67t pest grammar + tokenizer → Formula AST
quote.rs 192 / 7t quote_name / is_bare_name / pipe_quote / unescape_pipe_body:
the one home, both halves (improvise-i2m5). improvise-gp
re-exports it; improvise-io calls it from
persistence/{format,parse}.rs
formula.pest 92 PEG grammar for formula text
ast.rs 77 Expr, BinOp, AggFunc, Formula, Filter
improvise-io (crates/improvise-io/src/)
storage.rs 388 / 13t Storage trait (read/write/list/delete), PhysicalFs, MemoryFs,
`impl Storage for Rc<T>` (improvise-hmws), and
contract::storage_contract — public, not cfg(test), because
a browser must run that sequence (harness/)
opfs.rs 367 / 0t OpfsFs: Storage over the browser's Origin Private File
System. wasm32 only. Run by harness/, not by cargo test
persistence/improv.pest 153 PEG grammar — single source of truth
persistence/mod.rs 403 / 10t document lifecycle: save/load/gzip/legacy-JSON over Storage;
facade re-exporting format_md/parse_md/export_csv*
persistence/format.rs 385 / 11t format_md: Workbook → .improv text
persistence/parse.rs 1519 / 43t parse_md: pest tree-walk → Workbook (+ grammar generator)
persistence/export.rs 156 / 3t export_csv / render_csv
persistence/roundtrip_tests.rs
965 / 45t format_md ↔ parse_md characterization (tests only)
import/wizard.rs 1714 / 55t ImportPipeline + ImportWizard
import/analyzer.rs 403 / 13t Field kind detection (Category/Measure/Time/Skip);
analyze_records is first-seen order, not HashSet (gotcha 18)
import/csv_parser.rs 495 / 20t CSV parsing, multi-file merge
improvise-protocol (crates/improvise-protocol/src/)
lib.rs 561 / 1t ViewState, ViewCursor, ViewFrame, AppMode (17), Panel,
MinibufferConfig, MinibufColor, HELP_PAGE_COUNT
reduce.rs 569 / 9t Command + ModelCommand (the wire format), HelpPage, reduce_view
render.rs 2008 / 35t CellDisplay, WidgetCache trait + one cache per widget
(GridCache/CategoryTreeCache/FormulaCache/ViewListCache/
TileBarCache), AxisFrame/FrameEntry/FrameGroup and
header_level_widths (the grid frame, gotcha 44),
GridCache::seed (the bootstrap compaction), Projection,
bootstrap-only Snapshot
keymap.rs 957 / 0t KeyPattern, Binding, Keymap, ModeKey (17), TextEntry,
PanelKeymap, Keymaps::default_keymaps/prefix_keymap — the
shared table both front ends look up. Tests live with
dispatch in improvise-command/src/command/keymap.rs
viewmodel.rs 168 / 5t flatten_cat_tree — derivations between a cache and a
renderer, called by both front ends (improvise-edp)
key.rs 101 / 3t KeyCode, KeyModifiers, KeyEvent (moved from command/)
frame.rs 330 / 3t ClientFrame/ServerFrame — the ONE envelope pair, both
deployments (improvise-xks6). Nothing else defines one.
ClientFrame::Save is a request, not a Command (gotcha 45)
basis.rs 332 / 5t Basis (the three tiers), Rejection, BasisCache — ADR 001
layer 1. Basis has no Default and no public constructor
gp-tree / improvise-gp (crates/gp-tree/, crates/improvise-gp/)
gp-tree/src/lib.rs 669 / 8t Tree, Spec, eval, simplify, render, breed, Population,
SplitMix64 (vendored seeded Rng; seed() keeps the seed so
a fit can be shown and recorded, pinned to the published
reference vectors)
gp-tree/src/data.rs 938 / 19t raw string rows -> f32 feature vectors: per-column type
inference, one-hot, mean-imputation + col.missing flag,
ColumnSpec/encode_row, Dataset (incl. warnings),
Model = trees + plan + seed + FitConfig
gp-tree/src/fit.rs 970 / 25t the search: FitConfig (Default = the CLI's numbers), fit()
-> simplified champion, cv_regress/cv_classify,
permutation_importance, folds/standardize/mse.
Returns data; never prints
gp-tree/examples/fit_csv.rs 585 CLI over the above: flags, demo dataset, all printing
gp-tree/tests/scoring_known_answers.rs
285 / 6t f32 bit patterns + a next_u64 witness: the evidence any
change to the scoring paths needs (gotcha 37c)
improvise-gp/src/lib.rs 844 / 21t formula_text / fitted_formula: a Tree as IF(...) formula
text, validated back through parse_formula. A threshold is
the SHORTEST decimal that reads back as the same f64 (not
the exact expansion), so a row on a split boundary routes
the same in f64 as in f32 eval; non-finite values panic
improvise-gp/src/dataset.rs 632 / 15t a View's records -> the feature matrix a fit consumes —
the improvise-side counterpart of preprocess. Records mode
is already a feature matrix (gotcha 1)
improvise-gp/src/fit.rs 1426 / 23t one fit end to end: a View's records in, an improvise
Formula and the evidence for believing it out. Not in a
command, because none of it is terminal-specific
Command layer (crates/improvise-command/src/command/)
cmd/core.rs 327 / 2t Cmd trait, CmdContext, CmdRegistry, parse helpers
cmd/registry.rs 749 / 3t default_registry() — all registrations
cmd/navigation.rs 534 / 12t Move, EnterAdvance, Page*
cmd/cell.rs 192 / 6t ClearCell, YankCell, PasteCell, TransposeAxes, SaveCmd
cmd/commit.rs 723 / 11t CommitAndAdvance, CommitBuffer(CommitKind), CommitExport,
CommitSave
cmd/effect_cmds.rs 460 / 5t effect_cmd! macro, 25+ simple wrappers
cmd/fit.rs 382 / 7t fit-measure: evolve a tree over the active view and store it
as an ordinary `## Formulas` line — nothing GP-specific is
left in the document afterwards
cmd/grid.rs 512 / 9t ToggleGroup, ViewNavigate, DrillIntoCell, TogglePruneEmpty
cmd/mode.rs 427 / 11t EnterMode, Quit, EditOrDrill, EnterTileSelect
cmd/panel.rs 713 / 17t Panel toggle/cycle/cursor, formula/category/view panels
cmd/search.rs 202 / 4t SearchNavigate, SearchOrCategoryAdd, ExitSearchMode
cmd/text_buffer.rs 434 / 14t AppendChar, PopChar, CommandModeBackspace, ExecuteCommand
cmd/tile.rs 139 / 5t MoveTileCursor, TileAxisOp
cmd/wizard.rs 253 / 6t HandleWizardKey — per-step import-wizard key tables
keymap.rs 1117 / 35t KeymapSet, Keymap::dispatch/dispatch_transient, effects_of,
SetTransientPrefix — what a thin client cannot have. The
table itself is improvise-protocol/src/keymap.rs
parse.rs 236 / 19t Script/command-line parser (prefix syntax)
Semantic UI state (crates/improvise-command/src/ui/)
ui/effect.rs 2731 / 64t Effect trait, 50+ effect types
ui/app.rs 3407 / 92t App, ModelState, ViewState + dispatch methods, Panel, handle_key, dispatch_key, document_generation, autosave; apply_effects raises `dirty` off EffectKind::Model(_) (gotcha 45)
ui/project.rs 3708 / 55t Dirty, Viewport, grid_of/category_rows/formula_texts/
view_summaries/tile_entries, grid_updates (the diff),
ClientSession + Sessions (connect/apply/rebase/project_all)
ui/reduce.rs 1411 / 18t Checked / CheckedBatch / apply_command / model_effects /
reduce_full / reduce_key — one door from a Command or a
keypress to the authoritative App
ui/host.rs 1493 / 24t Host: one App + one Sessions; handle, commands, project_all,
rebase. Lives here, not in ws-server (gotcha 45)
ui/cat_tree.rs 184 / 8t Category tree flattener for panel
ui/viewport.rs 124 compute_col_widths / compute_row_header_width / visible_cols
(pure geometry; the width rule itself is the protocol's)
TUI rendering, draw, main (src/ui/, src/draw.rs, src/main.rs)
ui/grid.rs 985 / 14t GridWidget (ratatui): no &Model, no &View — the frame comes
off GridCache (gotcha 44). Its module doc is the best-written
statement of that rule in the repo
ui/help.rs 603 5-page help overlay (render only)
ui/import_wizard_ui.rs 947 / 9t Import wizard rendering
draw.rs 599 / 5t TUI event loop, frame composition
main.rs 393 CLI entry (clap): open, import, cmd, script
# other ui/*.rs are small panel renderers — skip unless changing layout/style
tests/grid_frame_agreement.rs
422 / 4t the two front ends draw the same grid frame (improvise-anr9)
tests/records_wide_smoke.rs 67 / 1t
tests/shipped_documents_load.rs 59 / 1t
tests/web_demo_model.rs 87 / 2t every visible cell in web/demo.improv is a Record
Browser host and client (crates/improvise-ws-server/src/, crates/improvise-wasm-client/src/, web/)
ws-server/registry.rs 705 / 14t Registry of Hosts keyed by DocumentId; ClientId {document,
session} — a SessionId is unique only within its document.
A document is never evicted while the server runs (ADR 001)
ws-server/host.rs 23 / 0t a re-export shim only. The session loop is
improvise-command/src/ui/host.rs (gotcha 45)
ws-server/transport.rs 286 / 1t tokio + tungstenite plumbing
ws-server/main.rs 171 / 4t CLI entry: serve a file on a port
ws-server/tests/socket.rs 284 / 2t the one test that uses a real socket: handshake, JSON
framing, SessionId routing, which document a URL asked for
wasm-client/lib.rs 406 / 7t Client: the wasm-bindgen surface (init, on_message, on_frame,
viewport/set_viewport, render_model, set_cell_at, typed_cell)
wasm-client/keys.rs 1597 / 27t BrowserKey → KeyOutcome (Local | Upstream | Ignored)
wasm-client/render.rs 669 / 9t RenderModel: editable / selected / cat tree, decided here
wasm-client/socket.rs 444 / 7t the fold (fold_frame/handle_frame), the two compositions
and typed() text→CellValue. Defines no enums
wasm-client/state.rs 310 / 5t ClientState: ViewState + one cache per widget, the fold
wasm-client/tests/browser_round_trip.rs 442 / 5t improvise-1ey's scope against a real Host
wasm-client/tests/lockstep.rs 606 / 13t host and client agree on a keypress
web/app.js 519 string calls only, no protocol knowledge, no framework.
Run under Chromium by harness/tests/shell.spec.js — see
gotcha 48 for what that does and does not reach
web/worker.js 100 three string calls, no protocol knowledge. NEVER RUN
web/index.html, style.css the page; legibility only
web/build.sh 38 wasm-pack build → web/pkg (gitignored). Needs
wasm-opt = ["-O", "--enable-bulk-memory"] or the bundled
wasm-opt rejects LLVM's memory.copy
web/assemble.sh 72 assembles the deployable site (copies web/*.improv)
web/demo.improv 57 the document the site ships and seeds from. Every cell a
Record — asserted (gotcha 46)
Browser worker host (crates/improvise-worker-server/)
improvise-worker-server/src/worker.rs 738 / 13t Worker: one port, one client; handshake, Addressed
filter, persist trigger (model_state.dirty). Every decision, every test
improvise-worker-server/src/vfs.rs 311 / 6t documents/open: seeding is a Storage::write
improvise-worker-server/src/bindings.rs 158 / 0t wasm32 shim: OpfsFs awaits + postMessage. NEVER RUN —
the one dark corner left now that harness/ runs OpfsFs
improvise-worker-server/src/lib.rs 114 / 1t the module doc that states exactly what is and is not
covered — the one correct copy of that fact
improvise-worker-server/tests/post_message.rs 381 / 7t main-thread traffic, strings only
Browser harness (harness/) — not a workspace member
harness/playwright.config.js 77 shell.spec.js runs on CHROMIUM ONLY (engine-independent
logic; routeWebSocket is slower and flakier across three).
opfs.spec.js runs chromium + firefox + webkit, and webkit
provides NO OPFS at all, so it skips on a runtime probe
harness/tests/shell.spec.js 199 the first execution of web/app.js. A change to web/*.js
belongs here (gotcha 48)
harness/tests/opfs.spec.js 102 drives the OPFS contract page and reads back its result
harness/opfs-contract/src/lib.rs 417 runs improvise_io::storage::contract::storage_contract
against a real OpfsFs inside a real Web Worker
harness/www/opfs/{index.html,worker.js} the page and worker that host it
harness/build.sh 27 wasm-pack build for the contract crate
# gated by the `browser` job in .github/workflows/ci.yml, which can fail the build
Examples
examples/gen-grammar.rs Grammar-walking random .improv generator (pest_meta)
examples/pretty-print.rs Parse stdin, print formatted .improv
Context docs
.claude/skills/code-review/ Review skill: checks a change against the doctrine in these docs + kb.pl
scripts/nix-seed-flake-inputs.sh Seeds locked flake inputs over git so `nix develop` works in cloud sessions
prolog-sessions/kb.pl Executable knowledge base: invariants, doctrine, decisions (CI-checked)
context/adr/003-live-backed-models.md A model may be backed by a live query source —
improvise as a DB client. Accepted, NOT a priority.
context/adr/002-naming-a-cell.md How a client names a cell: an opaque surrogate on
CellDisplay, whose absence means the cell is an
aggregate. Records why _Index cannot serve.
context/adr/001-concurrent-edits.md Concurrent edits between clients: record-level atomicity,
optimistic basis check per batch, advisory reservations.
Records why a causal clock was rejected.
context/cloud-agents.md Cloud-session environment: tracker sync, bd pitfalls, what is blocked
context/design-principles.md Architectural principles & testing doctrine
context/plan.md Show HN launch plan
context/repo-map.md This file
docs/design-notes.md Product vision & non-goals
Wasm
The browser bundle is improvise-core, improvise-formula, improvise-io,
improvise-protocol, improvise-command, improvise-wasm-client and
improvise-worker-server. All seven
cargo check --target wasm32-unknown-unknown clean with no feature flags
(improvise-ywd), gated by the wasm job in .github/workflows/ci.yml. That
job gates eight crates, not seven: improvise-gp was added (improvise-z5eg)
explicitly not as a bundle member but as a candidate, because staying
wasm-clean is free now and expensive to retrofit — so the bundle is seven and
the gate is eight, and neither number is the other one's typo.
improvise-ws-server is the host and is native only — tokio, tungstenite and
Box<dyn Storage> — so improvise-wasm-client cannot depend on it in anger. It
no longer needs to: both ends pub use improvise_protocol::frame and neither
defines a pair (gotcha 42). The dev-dependency remains, for
tests/browser_round_trip.rs, which hands the client's own serialized frame to
a real Host::handle. The root improvise crate is
the terminal binary and does not build for wasm — it depends on
crossterm; that is correct, not a gap.
cargo check passing is not the same as running. Two known runtime hazards
it cannot see: Instant::now() panics on wasm (hence web-time in
improvise-command), and any std::fs call compiles but fails in a browser
— see improvise-fuj for the two effects that still bypass Storage.
CLI
improvise [model.improv] # open TUI (default)
improvise import data.csv [--no-wizard] [-o out] # import CSV/JSON
improvise cmd 'add-cat Region' -f model.improv # headless command(s)
improvise script setup.txt -f model.improv # run script file
Import flags: --category, --measure, --time, --skip, --extract, --axis, --formula, --name.
Testing — the short version
Full guidance lives in context/design-principles.md §7. Quick reminders:
- Measured at
22d43b2: 1309 tests over 33 binaries, ~2.2s of run time (longest single binary 1.42s), excluding compilation. The "<2s" this used to assert is now a number to re-measure rather than re-assert —cargo test --workspaceprints afinished inper binary. Don't let it drift. - Commands: build a
CmdContext, callexecute, assert on returned effects. No terminal needed. - Property tests (
proptest, default 256 cases) cover invariants: CellKey sort, axis consistency, save/load roundtrip,parse(format(parse(generate())))stability. - Bug-fix workflow: write a failing test before the fix (regression guard). Document the bug in the test's doc-comment (see
model/types.rs::formula_tests). - Coverage target ~80% line/branch on logic code; skip ratatui render paths.
Key dependencies
ratatui 0.30, crossterm 0.29, clap 4.6 (derive), serde/serde_json, indexmap 2, anyhow, chrono 0.4, pest + pest_derive, flate2 (gzip), csv, enum_dispatch. Dev: proptest, tempfile, pest_meta.