Can't pass in dtype via CLI

[sweiss-google]

Hi, I'm trying to pass in the pipeline_dtype on the command line:

nemo llm pretrain --factory=llama3_8b trainer.devices=2 trainer.strategy.pipeline_model_parallel_size=2 trainer.strategy.pipeline_dtype=torch.bfloat16

It doesn't work with any of the following: b16, bf16, bfloat16, torch.bfloat16

How do I pass this in?

[hemildesai]

@marcromeyn Can you take a look at this? Thanks

[marcromeyn]

Thanks for reporting this! I put in a small fix: #99. With that we you can pass in: torch.bfloat16 etc.