Skip to content

Conversation

@guixiaowen
Copy link
Contributor

@guixiaowen guixiaowen commented Oct 17, 2025

Which issue does this PR close?

Closes #1471

Rationale for this change

Add the conversion execution list.
Display the physical execution plan of the SQL, show the version that has been converted to the native execution plan, and also present the reasons for stages that were not converted, helping users visualize the overall transformation process more intuitively.

What changes are included in this PR?

Add the conversion execution list. The core display functions of this list are described as follows:

Image

Add the conversion execution list.
The core display functions of this list are described as follows:

  1. Feature 1: Show the number of queries;
  2. Feature 2: Execution plans that were not converted to native and the reasons for the non-conversion;
  3. Feature 3: Original physical execution plans;
  4. Feature 4: The number of nodes converted to Aurora nodes;
  5. Feature 5: The number of nodes that were not converted.

Another example is to display the UI information through the Spark History Server after running the explain command.

截屏2025-10-17 23 38 26

Are there any user-facing changes?

How was this patch tested?

UT

@guixiaowen guixiaowen marked this pull request as draft October 17, 2025 12:12
@github-actions github-actions bot added the spark label Oct 17, 2025
@guixiaowen guixiaowen force-pushed the add_convert_list_spark_ui branch 2 times, most recently from dfdfbf0 to f51327a Compare October 17, 2025 14:48
@guixiaowen guixiaowen marked this pull request as ready for review October 17, 2025 16:00
@guixiaowen guixiaowen force-pushed the add_convert_list_spark_ui branch from 186c534 to 75882d8 Compare October 17, 2025 16:05
@guixiaowen guixiaowen changed the title Follow #1409 Add the conversion execution list in the Spark UI. [AURON #1471]Follow #1409 Add the conversion execution list in the Spark UI. Oct 17, 2025
@merrily01 merrily01 changed the title [AURON #1471]Follow #1409 Add the conversion execution list in the Spark UI. [AURON #1471] Follow #1409 Add the conversion execution list in the Spark UI. Oct 27, 2025
Copy link
Member

@zuston zuston left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

overall lgtm. this is a great work to observe the auron internal fallback or execution.

please rebase the latest commits. @guixiaowen

@@ -30,4 +31,13 @@ class BuildinfoInSparkUISuite
assert(listener.getAuronBuildInfo() == 1)
}

test("test convert table in spark UI ") {
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Should this be placed here ?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Should this be placed here ?

@zuston Deleted.

@guixiaowen
Copy link
Contributor Author

overall lgtm. this is a great work to observe the auron internal fallback or execution.

please rebase the latest commits. @guixiaowen

@zuston Thank you. Okok

@guixiaowen
Copy link
Contributor Author

@richox @richox Thanks for the review. I’ve resolved the conflicts — much appreciated.

@guixiaowen guixiaowen closed this Nov 3, 2025
@ShreyeshArangath
Copy link
Contributor

@guixiaowen can we re-open this? Seems like a very useful functionality to have.

@yew1eb
Copy link
Contributor

yew1eb commented Dec 16, 2025

@guixiaowen can we re-open this? Seems like a very useful functionality to have.

+1
@richox @zuston Can we reopen this PR and merge it?

@guixiaowen
Copy link
Contributor Author

@guixiaowen can we re-open this? Seems like a very useful functionality to have.

+1 @richox @zuston Can we reopen this PR and merge it?

@yew1eb done

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

5 participants