[docs] Add more details for historical partition lookup - #4030
Conversation
| datalake.paimon.warehouse: /path/to/paimon/warehouse | ||
| ``` | ||
|
|
||
| Also make the Paimon connector, `paimon-bundle`, and required catalog or storage JARs available on |
There was a problem hiding this comment.
Just curious about do we really need to mentention about it since it's already in fluss distribution. But It reminds me that we did need to put paimon oss jar into ${FLUSS_HOME}/plugins/paimon/.
Also, i feel like this page may not a right place to put this. Maybe https://fluss.apache.org/docs/next/install-deploy/deploying-streaming-lakehouse/ or https://fluss.apache.org/docs/next/streaming-lakehouse/datalake-formats/paimon/. But we can add a link in this page for how to make historical partition lookups works
There was a problem hiding this comment.
Just curious about do we really need to mentention about it since it's already in fluss distribution. But It reminds me that we did need to put paimon oss jar into ${FLUSS_HOME}/plugins/paimon/.
Yes. from my side, without this historical lookup feature, the tablet server don't need to reserve the lake related jars. and the data lake sepcified options also needn't in tablet server server.yml . that means maybe we should mention this in this section.
Also, i feel like this page may not a right place to put this. Maybe https://fluss.apache.org/docs/next/install-deploy/deploying-streaming-lakehouse/ or https://fluss.apache.org/docs/next/streaming-lakehouse/datalake-formats/paimon/. But we can add a link in this page for how to make historical partition lookups works
Do you mean the whole section of Historical Partition Lookup need to be moved into the streaming-lakehouse/datalake-formats/paimon ?
2 participants
Purpose
Add more details for historical partition lookup
Brief change log
Tests
API and Format
Documentation