When can we support w8a8 fp8 quantization and sparse2:4 llm compress and adapt it on vllm?

[leoyuppieqnew]

No description provided.

[robertgshaw2-neuralmagic]

This is something we are actively working on supporting end-to-end.

In vllm, we currently support 2:4 sparsity with w4A16 and w8a16. We need to add inference kernels to support w8a8 fp8 with sparse 2:4. We are collaborating the cutlass teams on this.