Bump to rocm 6.3.1.

[stellaraccident]

Key changes:

• Moved llvm/ -> lib/llvm/
• libamdhip64 now depends on rocprofiler
• rccl:
  • switches to clang++ vs hipcc
  • depends on rocprofiler
  • disabled pending further work
• Drop 6.1 patches
• Setup rpaths to account for llvm move (required adding some goo for doing project interception in cmake)
• Move rocr to top-level and eliminate rocm-core-libs

[amd-chrissosa]

Adding @marbre to take a look as well.

Right now focused on reproducing what you have on my Azure vm. Did a full checkout and build of 6.3.1 using the easiest of the workflows and checking in sources directly into TheRock repo, Looks great so far. We should get the CI working once this is checked in. What's the bar for submitting?

[stellaraccident]

I'll land it tomorrow. Just need to dot some I'd I ran out of time for

[marbre]

Building and sanity check pass:

~/TheRock$ ./build/dlopen-hip install/lib/libamdhip64.so
HIP VERSION: 3938700