HF Demo Space for Precalculated Embedding App

[NetZissou]

We'd like to host the Precalculated Embedding App on HF Space to serve as a demo for the explorer tool. Reduce the installation friction for common users.

The App should cache some prepared embeddings subset from TOL-200M embeddings collection, such as the Darwin's Finches.

[NetZissou]

Preload doesn't seem to work on datasets, still an open-issue today

[egrace479]

Preload doesn't seem to work on datasets, still an open-issue today

It's unclear if they plan to fix it: huggingface/hub-docs#2415

[NetZissou]

Demo can be hosted in a free-tire space.

Data was loading through mounting. Lazy load.

[NetZissou]

Deployment strategy:

Have a dedicated branch for hf space demo and git merge main when changes are needed.

[egrace479]

Yay!!! This is great.

[NetZissou]

Updates on demo: It now includes everything merged this cycle plus some in-review PRs (#42 representative images for precalculated app, #45 cuML t-SNE exact-solver fix, #46 PCA reproducibility). It now has a demo header + footer. Deploy is still manual through hf upload.

Next step:

• opening a PR to move the demo subset + configs from netzhang/demo into imageomics/TreeOfLife-200M-Embeddings. Swap the Space mounting specs afterwards.
• after that, permission to migrate the Space from my personal namespace into the imageomics org?

CI/Automation can be addressed at last. Currently all code lives under feature/hf-space-precalculated-demo.