Skip to content

[CELEBORN-2409] Fix outdated Spark version descriptions in docs - #3788

Closed
yew1eb wants to merge 2 commits into
apache:mainfrom
yew1eb:spark-4.2-docs
Closed

[CELEBORN-2409] Fix outdated Spark version descriptions in docs#3788
yew1eb wants to merge 2 commits into
apache:mainfrom
yew1eb:spark-4.2-docs

Conversation

@yew1eb

@yew1eb yew1eb commented Aug 8, 2026

Copy link
Copy Markdown
Contributor

What changes were proposed in this pull request?

Fix outdated Spark version descriptions in docs:

  • README.md: add Spark 4.1/4.2 to the supported Spark versions list
  • docs/README.md, docs/deploy.md: "clients for Spark 2.x and Spark 3.x" -> "clients for Spark 2.x, Spark 3.x and Spark 4.x"
  • docs/developers/sbt.md: update the shaded client publish example from -Pspark-4.0 to -Pspark-4.2, aligning with build/release/release.sh

Why are the changes needed?

Spark 4.1/4.2 support was added in CELEBORN-2239 and CELEBORN-2383, but these doc descriptions were not updated accordingly.

Does this PR resolve a correctness bug?

  • Yes

Does this PR introduce any user-facing change?

  • Yes

How was this patch tested?

Doc-only changes, no code changes.

Comment thread docs/README.md Outdated
## Start Spark with Celeborn
#### Copy Celeborn Client to Spark's jars
Celeborn release binary contains clients for Spark 2.x and Spark 3.x, copy the corresponding client jar into Spark's
Celeborn release binary contains clients for Spark 2.x, Spark 3.x and Spark 4.x, copy the corresponding client jar into Spark's

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

do we still support Spark 2?

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

updated.

Spark 2.4 client support was removed in CELEBORN-2368.
@pan3793 pan3793 closed this in 8cbf3fa Aug 20, 2026
pan3793 pushed a commit that referenced this pull request Aug 20, 2026
### What changes were proposed in this pull request?

Fix outdated Spark version descriptions in docs:

- `README.md`: add Spark 4.1/4.2 to the supported Spark versions list
- `docs/README.md`, `docs/deploy.md`: "clients for Spark 2.x and Spark 3.x" -> "clients for Spark 2.x, Spark 3.x and Spark 4.x"
- `docs/developers/sbt.md`: update the shaded client publish example from `-Pspark-4.0` to `-Pspark-4.2`, aligning with `build/release/release.sh`

### Why are the changes needed?

Spark 4.1/4.2 support was added in CELEBORN-2239 and CELEBORN-2383, but these doc descriptions were not updated accordingly.

### Does this PR resolve a correctness bug?

- [ ] Yes

### Does this PR introduce _any_ user-facing change?

- [ ] Yes

### How was this patch tested?

Doc-only changes, no code changes.

Closes #3788 from yew1eb/spark-4.2-docs.

Authored-by: yew1eb <yew1eb@gmail.com>
Signed-off-by: Cheng Pan <chengpan@apache.org>
(cherry picked from commit 8cbf3fa)
Signed-off-by: Cheng Pan <chengpan@apache.org>
@pan3793

pan3793 commented Aug 20, 2026

Copy link
Copy Markdown
Member

Merge Summary:

Posted by merge_pr.py

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants