MWS injects the full text of a recipe’s tiddlers into the page on load — there’s no lazy/skinny loading of tiddler content, so the whole recipe has to reach the browser before it’s usable. That’s fine at moderate scale, but it means browser-side search only ever sees what actually got loaded: with a very large recipe (say, millions of tiddlers), the initial load itself becomes impractical, and search is limited to whatever fraction made it into memory.
Classic TiddlyWiki’s lazy-loading docs describe an old plan to delegate full-text search to the server (via TiddlyWeb’s search API) for exactly this reason — once tiddler content isn’t fully loaded client-side, the server is the only place that can “see” everything and search over it.
Is something like this on the table for MWS — a server-side search endpoint that recipes/bags could query directly, instead of relying on the browser having the full text in memory? Or is this considered out of scope / better left to something like SQLite FTS at the storage layer?
MWS injects the full text of a recipe’s tiddlers into the page on load — there’s no lazy/skinny loading of tiddler content, so the whole recipe has to reach the browser before it’s usable. That’s fine at moderate scale, but it means browser-side search only ever sees what actually got loaded: with a very large recipe (say, millions of tiddlers), the initial load itself becomes impractical, and search is limited to whatever fraction made it into memory.
Classic TiddlyWiki’s lazy-loading docs describe an old plan to delegate full-text search to the server (via TiddlyWeb’s search API) for exactly this reason — once tiddler content isn’t fully loaded client-side, the server is the only place that can “see” everything and search over it.
Is something like this on the table for MWS — a server-side search endpoint that recipes/bags could query directly, instead of relying on the browser having the full text in memory? Or is this considered out of scope / better left to something like SQLite FTS at the storage layer?