Pydantic v2 Migration

[movchan74]

Summary:
This PR migrates the codebase to Pydantic >= 2.0.

Key Changes:

• Updated Pydantic to >=2.0
• Updated Ray to >=2.9
• Updated vLLVM to >= 0.3.0
• Updated Pytorch to 2.1.2
• Updated CUDA to 12.1
• Updated the codebase to use the new Pydantic API
• Increased the required memory for the LLaMa 2 7b Chat from 10GB to 13GB because new version of vLLM consumes more memory. There is an open issue in vLLM about this. Note that now vLLM requires 13GB of memory to run so if gets allocated on the GPU with less than 13GB of memory, it will fail. And because Ray still does not support GPU memory aware scheduling, we cannot enforce this requirement in the code. There is an open PR in Ray with the proposal to add GPU memory aware scheduling.

Related Issues: #49, #35

[HRashidi]

LGTM

[evanderiel]

Overall good. Just a couple of general things:

1. Why are we using typing_extensions instead of typing? The canonical module is typing; typing_extensions is a non-standard package. If we do want to use typing_extensions, then we need to add it to the dependencies in pyproject.toml

2. In the future this could maybe be split into a couple of different PRs - one for updating dependencies and fixing breaking changes, one for changing the config from MappingProxyType to ConfigDict, etc, and maybe a separate PR just for updating the test cache.

[movchan74]

In the future this could maybe be split into a couple of different PRs - one for updating dependencies and fixing breaking changes, one for changing the config from MappingProxyType to ConfigDict, etc, and maybe a separate PR just for updating the test cache.

It's all part of the same upgrade, doesn't make sense for me to split it.
"changing the config from MappingProxyType to ConfigDict" was part of the pydantic migration.
"updating the test cache" was also part of the migration. The cache was using old pydantic models and the tests were failing because of it.

[movchan74]

@evanderiel @HRashidi I've updated the submodule for Mobius Pipeline and merged the main branch. Please, take another look.

[HRashidi]

👍🏽