NVILA FP8 training

[xpx9826]

Hi guys, thanks for your excellent work! I would like to know if fp8 training is now supported by NVILA? Because BF16 is still too big for my machine.

[Lyken17]

thanks for your interest in our work. However, fp8 usually require cards newer than hopper (h100 h200 h800), in which case you should have sufficient GPU memory. What is your hardware configuration?