-
Notifications
You must be signed in to change notification settings - Fork 198
[AURON #1471] Follow #1409 Add the conversion execution list in the Spark UI. #1471
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
base: master
Are you sure you want to change the base?
Conversation
dfdfbf0 to
f51327a
Compare
186c534 to
75882d8
Compare
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
overall lgtm. this is a great work to observe the auron internal fallback or execution.
please rebase the latest commits. @guixiaowen
| @@ -30,4 +31,13 @@ class BuildinfoInSparkUISuite | |||
| assert(listener.getAuronBuildInfo() == 1) | |||
| } | |||
|
|
|||
| test("test convert table in spark UI ") { | |||
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Should this be placed here ?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Should this be placed here ?
@zuston Deleted.
@zuston Thank you. Okok |
|
@guixiaowen can we re-open this? Seems like a very useful functionality to have. |
|
@yew1eb done |
Which issue does this PR close?
Closes #1471
Rationale for this change
Add the conversion execution list.
Display the physical execution plan of the SQL, show the version that has been converted to the native execution plan, and also present the reasons for stages that were not converted, helping users visualize the overall transformation process more intuitively.
What changes are included in this PR?
Add the conversion execution list. The core display functions of this list are described as follows:
Add the conversion execution list.
The core display functions of this list are described as follows:
Another example is to display the UI information through the Spark History Server after running the explain command.
Are there any user-facing changes?
How was this patch tested?
UT