Skip to content

docs: document Spark 4 IntelliJ setup#4198

Open
yuboxx wants to merge 3 commits intoapache:mainfrom
yuboxx:docs-spark4-intellij
Open

docs: document Spark 4 IntelliJ setup#4198
yuboxx wants to merge 3 commits intoapache:mainfrom
yuboxx:docs-spark4-intellij

Conversation

@yuboxx
Copy link
Copy Markdown

@yuboxx yuboxx commented May 3, 2026

Which issue does this PR close?

Closes #1745.

Rationale for this change

Issue #1745 asks for contributor documentation explaining how to configure IntelliJ IDEA when switching a Comet checkout from Spark 3.x profiles to Spark 4.x. I tried out the instruction while onboarding to the project.

What changes are included in this PR?

This adds a Spark 4.x IntelliJ setup section to the development guide. It includes the original instructions from the issue and additional findings from verifying the flow locally on macOS.

How are these changes tested?

Verified locally by building the project and running tests after switching from Spark 3.x to 4.x

Copy link
Copy Markdown
Contributor

@coderfender coderfender left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Minor nit but LGTM

rebuilding:

```sh
cd native && cargo clean -p hdfs-sys --release
Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Nit : could just have cargo clean to keep things easy?

Copy link
Copy Markdown
Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Somehow I ran into link issues with only that repo in my test, cargo clean could work as well and maybe more clean. Updated the md file, feel free to take a another look.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Write documentation for working with Comet's spark-4.0 profile in IntelliJ

2 participants