Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[VL] Add more information to Velox Plan in debug mode (#3929) #3931

Closed
wants to merge 2 commits into from

Conversation

fyp711
Copy link
Contributor

@fyp711 fyp711 commented Dec 5, 2023

What changes were proposed in this pull request?

Add Plan Stats Json information printing in debug mode

(Fixes: #3929)

How was this patch tested?

It‘s passed integration tests, it's can print Plan stats json in debug mode. Below is a printout of my test results

Plan Stats Json: [{"peakMemoryBytes":2097152,"blockedWallNanos":0,"cpuWallTiming":"count: 6, wallNanos: 102836, cpuNanos: 106890","outputBytes":32,"outputVectors":1,"rawInputBytes":0,"rawInputRows":0,"inputBytes":96,"inputVectors":1,"customStats":{"hashtable.numDistinct":"sum:0, count:1, min:0, max:0","hashtable.numTombstones":"sum:0, count:1, min:0, max:0","hashtable.numRehashes":"sum:0, count:1, min:0, max:0","hashtable.capacity":"sum:0, count:1, min:0, max:0","queuedWallNanos":"sum:1000, count:1, min:1000, max:1000"},"numSplits":0,"numDrivers":1,"numMemoryAllocations":4,"outputRows":1,"inputRows":1,"operatorType":"PartialAggregation","planNodeId":"1"},{"peakMemoryBytes":1048576,"blockedWallNanos":0,"cpuWallTiming":"count: 2, wallNanos: 3193494, cpuNanos: 1512806","outputBytes":96,"outputVectors":1,"rawInputBytes":729,"rawInputRows":1,"inputBytes":96,"inputVectors":1,"customStats":{"processedSplits":"sum:1, count:1, min:1, max:1","prefetchBytes":"sum:0, count:1, min:0, max:0","totalScanTime":"sum:730000, count:1, min:730000, max:730000","numLocalRead":"sum:0, count:1, min:0, max:0","storageReadBytes":"sum:0, count:1, min:0, max:0","localReadBytes":"sum:0, count:1, min:0, max:0","skippedSplitBytes":"sum:0, count:1, min:0, max:0","skippedSplits":"sum:0, count:1, min:0, max:0","skippedStrides":"sum:0, count:1, min:0, max:0","numStorageRead":"sum:0, count:1, min:0, max:0","ioWaitNanos":"sum:0, count:1, min:0, max:0","processedStrides":"sum:1, count:1, min:1, max:1","numPrefetch":"sum:0, count:1, min:0, max:0","ramReadBytes":"sum:0, count:1, min:0, max:0","queryThreadIoLatency":"sum:0, count:1, min:0, max:0","numRamRead":"sum:0, count:1, min:0, max:0","dataSourceWallNanos":"sum:40000, count:1, min:40000, max:40000"},"numSplits":1,"numDrivers":1,"numMemoryAllocations":6,"outputRows":1,"inputRows":1,"operatorType":"TableScan","planNodeId":"0"}]

Copy link

github-actions bot commented Dec 5, 2023

Thanks for opening a pull request!

Could you open an issue for this pull request on Github Issues?

https://github.com/oap-project/gluten/issues

Then could you also rename commit message and pull request title in the following format?

[GLUTEN-${ISSUES_ID}][COMPONENT]feat/fix: ${detailed message}

See also:

@fyp711 fyp711 closed this Dec 5, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

[VL] Add more information to Velox Plan in debug mode
1 participant