Thunder Runtimeerror Internal Assert Failed At Optpytorchnvfuser

RuntimeError: 0 INTERNAL ASSERT FAILED at - PyTorch Forums
RuntimeError: 0 INTERNAL ASSERT FAILED at - PyTorch Forums
RuntimeError: 0 INTERNAL ASSERT FAILED at - PyTorch Forums
RuntimeError: 0 INTERNAL ASSERT FAILED at - PyTorch Forums
RuntimeError: 0 INTERNAL ASSERT FAILED at - PyTorch Forums
RuntimeError: 0 INTERNAL ASSERT FAILED at - PyTorch Forums
[thunder] RuntimeError: INTERNAL ASSERT FAILED at "/opt/pytorch/nvfuser ...
[thunder] RuntimeError: INTERNAL ASSERT FAILED at "/opt/pytorch/nvfuser ...
RuntimeError: handle_0 INTERNAL ASSERT FAILED at “/opt/conda/conda-bld ...
RuntimeError: handle_0 INTERNAL ASSERT FAILED at “/opt/conda/conda-bld ...
RuntimeError: NVML_SUCCESS == r INTERNAL ASSERT FAILED at "/opt/pytorch ...
RuntimeError: NVML_SUCCESS == r INTERNAL ASSERT FAILED at "/opt/pytorch ...
RuntimeError: has_marked_unused_parameters_ INTERNAL ASSERT FAILED at ...
RuntimeError: has_marked_unused_parameters_ INTERNAL ASSERT FAILED at ...
RuntimeError: 0 INTERNAL ASSERT FAILED at "../torch/csrc/jit/ir/ir.cpp ...
RuntimeError: 0 INTERNAL ASSERT FAILED at "../torch/csrc/jit/ir/ir.cpp ...
RuntimeError: NVML_SUCCESS == r INTERNAL ASSERT FAILED at "/opt/conda ...
RuntimeError: NVML_SUCCESS == r INTERNAL ASSERT FAILED at "/opt/conda ...
RuntimeError: 0 INTERNAL ASSERT FAILED at "../torch/csrc/jit/ir/alias ...
RuntimeError: 0 INTERNAL ASSERT FAILED at "../torch/csrc/jit/ir/alias ...
RuntimeError: unwrapped_count > 0 INTERNAL ASSERT FAILED at "../aten ...
RuntimeError: unwrapped_count > 0 INTERNAL ASSERT FAILED at "../aten ...
RuntimeError: outputs_[i]->uses().empty() INTERNAL ASSERT FAILED at ...
RuntimeError: outputs_[i]->uses().empty() INTERNAL ASSERT FAILED at ...
RuntimeError: optimized_plan_ INTERNAL ASSERT FAILED at "/opt/conda ...
RuntimeError: optimized_plan_ INTERNAL ASSERT FAILED at "/opt/conda ...
RuntimeError: 0 INTERNAL ASSERT FAILED at "../torch/csrc/jit/ir/alias ...
RuntimeError: 0 INTERNAL ASSERT FAILED at "../torch/csrc/jit/ir/alias ...
RuntimeError: handle_0 INTERNAL ASSERT FAILED at "../c10/cuda/driver ...
RuntimeError: handle_0 INTERNAL ASSERT FAILED at "../c10/cuda/driver ...
RuntimeError: 0 INTERNAL ASSERT FAILED at "/pytorch/torch/csrc/jit/ir ...
RuntimeError: 0 INTERNAL ASSERT FAILED at "/pytorch/torch/csrc/jit/ir ...
RuntimeError: false INTERNAL ASSERT FAILED at "../c10/cuda ...
RuntimeError: false INTERNAL ASSERT FAILED at "../c10/cuda ...
RuntimeError: NVML_SUCCESS == r INTERNAL ASSERT FAILED at "/opt/conda ...
RuntimeError: NVML_SUCCESS == r INTERNAL ASSERT FAILED at "/opt/conda ...
RuntimeError: false INTERNAL ASSERT FAILED at "C:\\actions-runner ...
RuntimeError: false INTERNAL ASSERT FAILED at "C:\\actions-runner ...
RuntimeError: NVML_SUCCESS == r INTERNAL ASSERT FAILED at "/opt/pytorch ...
RuntimeError: NVML_SUCCESS == r INTERNAL ASSERT FAILED at "/opt/pytorch ...
RuntimeError: INTERNAL ASSERT FAILED at "../aten/src/ATen/native/sparse ...
RuntimeError: INTERNAL ASSERT FAILED at "../aten/src/ATen/native/sparse ...
RuntimeError: tensors.size() > 0 INTERNAL ASSERT FAILED at /pytorch ...
RuntimeError: tensors.size() > 0 INTERNAL ASSERT FAILED at /pytorch ...
RuntimeError: handle_0 INTERNAL ASSERT FAILED at "../c10/cuda/driver ...
RuntimeError: handle_0 INTERNAL ASSERT FAILED at "../c10/cuda/driver ...
RuntimeError: NVML_SUCCESS == r INTERNAL ASSERT FAILED at "/tmp/pytorch ...
RuntimeError: NVML_SUCCESS == r INTERNAL ASSERT FAILED at "/tmp/pytorch ...
RuntimeError: outputs_[i]->uses().empty() INTERNAL ASSERT FAILED at ...
RuntimeError: outputs_[i]->uses().empty() INTERNAL ASSERT FAILED at ...
RuntimeError: diff_view_meta->output_nr_ == 0 INTERNAL ASSERT FAILED at ...
RuntimeError: diff_view_meta->output_nr_ == 0 INTERNAL ASSERT FAILED at ...
RuntimeError: iter.device(arg).is_cuda() INTERNAL ASSERT FAILED at ...
RuntimeError: iter.device(arg).is_cuda() INTERNAL ASSERT FAILED at ...
RuntimeError: diff_view_meta->output_nr_ == 0 INTERNAL ASSERT FAILED at ...
RuntimeError: diff_view_meta->output_nr_ == 0 INTERNAL ASSERT FAILED at ...
RuntimeError: has_marked_unused_parameters_ INTERNAL ASSERT FAILED at ...
RuntimeError: has_marked_unused_parameters_ INTERNAL ASSERT FAILED at ...
Pytorch报错:RuntimeError: handle_0 INTERNAL ASSERT FAILED at “../c10/cuda ...
Pytorch报错:RuntimeError: handle_0 INTERNAL ASSERT FAILED at “../c10/cuda ...
RuntimeError: iter.device(arg).is_cuda() INTERNAL ASSERT FAILED at ...
RuntimeError: iter.device(arg).is_cuda() INTERNAL ASSERT FAILED at ...
RuntimeError: r INTERNAL ASSERT FAILED at "../aten/src/ATen/core/jit ...
RuntimeError: r INTERNAL ASSERT FAILED at "../aten/src/ATen/core/jit ...
[ONNX] RuntimeError: r INTERNAL ASSERT FAILED at /pytorch/aten/src/ATen ...
[ONNX] RuntimeError: r INTERNAL ASSERT FAILED at /pytorch/aten/src/ATen ...
Pytorch报错:RuntimeError: handle_0 INTERNAL ASSERT FAILED at “../c10/cuda ...
Pytorch报错:RuntimeError: handle_0 INTERNAL ASSERT FAILED at “../c10/cuda ...
INTERNAL ASSERT FAILED at "/opt/conda/conda-bld/pytorch_1634272068185 ...
INTERNAL ASSERT FAILED at "/opt/conda/conda-bld/pytorch_1634272068185 ...
NVML_SUCCESS == r INTERNAL ASSERT FAILED at "../c10/cuda ...
NVML_SUCCESS == r INTERNAL ASSERT FAILED at "../c10/cuda ...

Loading image details...

Source
Dimensions