Error for Mixtral with torch compile

[taehyunzzz]

I am stuck on a CUDAGraph problem when running mixtral with torch compile as in the Tutorial instructions. My terminal shows the following error... I I am quite new to CUDA graphs and need some time to get to understand this error. For now, can anyone help me resolve this problem?

A summary of my settings :

• Converted Mixtral-8x7B-Instruct model (needed small fixes in the given code)
• CUDA12.1
• Two A100 PCIe GPUs connected with PCIe gen4 technology