Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

rocprofiler::counters::callback_thread_start does not issue pre_create/post_create callbacks #44

Open
jmellorcrummey opened this issue Feb 8, 2025 · 1 comment

Comments

@jmellorcrummey
Copy link

rocprofiler::counters::callback_thread_start does not issue pre_create/post_create callbacks in the rocm 6.4.0 AFAR VII.

This causes hpctoolkit to try to monitor a pthread created as part of context initialization. That causes deadlock because hpctoolkit is in the middle of rocprofiler initialization and is not in a state where it can start monitoring a created thread.

Below is a callstack snippet to show where this problem occurs.

#0  pthread_create (t=0x7fffffff83c0, a=0x0, s=0x7ffff5820940 <execute_native_thread_routine>, d=0x1280760) at ../src/hpcrun/foil/libc-preload.c:209
#1  0x00007ffff5820cdc in std::thread::_M_start_thread(std::unique_ptr<std::thread::_State, std::default_delete<std::thread::_State> >, void (*)()) ()
   from /projects/deploy/install/linux-rhel8-zen/gcc-8.5.0/gcc-12.3.0-divrsxygeh66lizjnxflsbszif3tfrr5/lib64/libstdc++.so.6
#2  0x00007fffe6a75edf in rocprofiler::counters::callback_thread_start() () from /opt/rocm-6.4.0/lib/librocprofiler-sdk.so.0
#3  0x00007fffe6a6e021 in rocprofiler::counters::start_context(rocprofiler::context::context const*) () from /opt/rocm-6.4.0/lib/librocprofiler-sdk.so.0
#4  0x00007fffe6a4ebc7 in rocprofiler::context::start_context(rocprofiler_context_id_t) () f
@ppanchad-amd
Copy link

Hi @jmellorcrummey. Internal ticket has been created to investigate this issue. Thanks!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

2 participants