diff --git a/chapters/de/chapter4/3.mdx b/chapters/de/chapter4/3.mdx
index 343221b0b..260d1bb71 100644
--- a/chapters/de/chapter4/3.mdx
+++ b/chapters/de/chapter4/3.mdx
@@ -445,10 +445,10 @@ ls
{#if fw === 'pt'}
```bash
-config.json pytorch_model.bin README.md sentencepiece.bpe.model special_tokens_map.json tokenizer_config.json tokenizer.json
+added_tokens.json config.json model.safetensors sentencepiece.bpe.model special_tokens_map.json tokenizer_config.json tokenizer.json
```
-Wenn du dir die Dateigrößen anschaust (z.B. mit `ls -lh`), solltest du sehen, dass die Modell-Statedict Datei (*pytorch_model.bin*) der einzige Ausreißer ist mit über 400 MB.
+Wenn du dir die Dateigrößen anschaust (z.B. mit `ls -lh`), solltest du sehen, dass die Modell-Statedict Datei (*model.safetensors *) der einzige Ausreißer ist mit über 400 MB.
{:else}
```bash
@@ -460,7 +460,7 @@ Wenn du dir die Dateigrößen anschaust (z.B. mit `ls -lh`), solltest du sehen,
{/if}
-✏️ Wenn ein Repository mittels der Webinterface kreiert wird, wird die *.gitattributes* Datei automatisch gesetzt, um bestimmte Dateiendungen wie *.bin* und *.h5* als große Dateien zu betrachten, sodass git-lfs sie tracken kann, ohne dass du weiteres konfigurieren musst.
+✏️ Wenn ein Repository mittels der Webinterface kreiert wird, wird die *.gitattributes* Datei automatisch gesetzt, um bestimmte Dateiendungen wie *.safetensors* und *.h5* als große Dateien zu betrachten, sodass git-lfs sie tracken kann, ohne dass du weiteres konfigurieren musst.
Nun können wir weitermachen und so arbeiten wie wir es mit normalen Git Repositories machen. Wir können die Dateien stagen mit dem Git-Befehl `git add`:
@@ -483,12 +483,13 @@ Your branch is up to date with 'origin/main'.
Changes to be committed:
(use "git restore --staged ..." to unstage)
modified: .gitattributes
+ new file: added_tokens.json
new file: config.json
- new file: pytorch_model.bin
+ new file: model.safetensors
new file: sentencepiece.bpe.model
new file: special_tokens_map.json
- new file: tokenizer.json
new file: tokenizer_config.json
+ new file: tokenizer.json
```
{:else}
```bash
@@ -521,12 +522,13 @@ Objects to be pushed to origin/main:
Objects to be committed:
- config.json (Git: bc20ff2)
- pytorch_model.bin (LFS: 35686c2)
+ added_tokens.json (Git: 43734cd)
+ config.json (Git: acfd093)
+ model.safetensors (LFS: 2785d2e)
sentencepiece.bpe.model (LFS: 988bc5a)
- special_tokens_map.json (Git: cb23931)
- tokenizer.json (Git: 851ff3e)
- tokenizer_config.json (Git: f0f7783)
+ special_tokens_map.json (Git: b547935)
+ tokenizer.json (Git: 18d0f7a)
+ tokenizer_config.json (Git: c49982e)
Objects not staged for commit:
@@ -567,11 +569,11 @@ git commit -m "First model version"
{#if fw === 'pt'}
```bash
-[main b08aab1] First model version
- 7 files changed, 29027 insertions(+)
- 6 files changed, 36 insertions(+)
+[main c2ec5c9] First model version
+ 7 files changed, 128351 insertions(+)
+ create mode 100644 added_tokens.json
create mode 100644 config.json
- create mode 100644 pytorch_model.bin
+ create mode 100644 model.safetensors
create mode 100644 sentencepiece.bpe.model
create mode 100644 special_tokens_map.json
create mode 100644 tokenizer.json
@@ -597,15 +599,15 @@ git push
```
```bash
-Uploading LFS objects: 100% (1/1), 433 MB | 1.3 MB/s, done.
-Enumerating objects: 11, done.
-Counting objects: 100% (11/11), done.
-Delta compression using up to 12 threads
-Compressing objects: 100% (9/9), done.
-Writing objects: 100% (9/9), 288.27 KiB | 6.27 MiB/s, done.
-Total 9 (delta 1), reused 0 (delta 0), pack-reused 0
+Uploading LFS objects: 100% (2/2), 444 MB | 86 MB/s, done.
+Enumerating objects: 10, done.
+Counting objects: 100% (10/10), done.
+Delta compression using up to 2 threads
+Compressing objects: 100% (8/8), done.
+Writing objects: 100% (9/9), 592.02 KiB | 6.30 MiB/s, done.
+Total 9 (delta 0), reused 0 (delta 0), pack-reused 0
To https://huggingface.co/lysandre/dummy
- 891b41d..b08aab1 main -> main
+ 70fd9db..c2ec5c9 main -> main
```
{#if fw === 'pt'}
diff --git a/chapters/en/chapter4/3.mdx b/chapters/en/chapter4/3.mdx
index 9de3fb1d8..a9315e0e5 100644
--- a/chapters/en/chapter4/3.mdx
+++ b/chapters/en/chapter4/3.mdx
@@ -451,10 +451,10 @@ ls
{#if fw === 'pt'}
```bash
-config.json pytorch_model.bin README.md sentencepiece.bpe.model special_tokens_map.json tokenizer_config.json tokenizer.json
+added_tokens.json config.json model.safetensors sentencepiece.bpe.model special_tokens_map.json tokenizer_config.json tokenizer.json
```
-If you look at the file sizes (for example, with `ls -lh`), you should see that the model state dict file (*pytorch_model.bin*) is the only outlier, at more than 400 MB.
+If you look at the file sizes (for example, with `ls -lh`), you should see that the model state dict file (*model.safetensors *) is the only outlier, at more than 400 MB.
{:else}
```bash
@@ -466,7 +466,7 @@ If you look at the file sizes (for example, with `ls -lh`), you should see that
{/if}
-✏️ When creating the repository from the web interface, the *.gitattributes* file is automatically set up to consider files with certain extensions, such as *.bin* and *.h5*, as large files, and git-lfs will track them with no necessary setup on your side.
+✏️ When creating the repository from the web interface, the *.gitattributes* file is automatically set up to consider files with certain extensions, such as *.safetensors* and *.h5*, as large files, and git-lfs will track them with no necessary setup on your side.
We can now go ahead and proceed like we would usually do with traditional Git repositories. We can add all the files to Git's staging environment using the `git add` command:
@@ -489,12 +489,13 @@ Your branch is up to date with 'origin/main'.
Changes to be committed:
(use "git restore --staged ..." to unstage)
modified: .gitattributes
+ new file: added_tokens.json
new file: config.json
- new file: pytorch_model.bin
+ new file: model.safetensors
new file: sentencepiece.bpe.model
new file: special_tokens_map.json
- new file: tokenizer.json
new file: tokenizer_config.json
+ new file: tokenizer.json
```
{:else}
```bash
@@ -527,12 +528,13 @@ Objects to be pushed to origin/main:
Objects to be committed:
- config.json (Git: bc20ff2)
- pytorch_model.bin (LFS: 35686c2)
+ added_tokens.json (Git: 43734cd)
+ config.json (Git: acfd093)
+ model.safetensors (LFS: 2785d2e)
sentencepiece.bpe.model (LFS: 988bc5a)
- special_tokens_map.json (Git: cb23931)
- tokenizer.json (Git: 851ff3e)
- tokenizer_config.json (Git: f0f7783)
+ special_tokens_map.json (Git: b547935)
+ tokenizer.json (Git: 18d0f7a)
+ tokenizer_config.json (Git: c49982e)
Objects not staged for commit:
@@ -573,11 +575,11 @@ git commit -m "First model version"
{#if fw === 'pt'}
```bash
-[main b08aab1] First model version
- 7 files changed, 29027 insertions(+)
- 6 files changed, 36 insertions(+)
+[main c2ec5c9] First model version
+ 7 files changed, 128351 insertions(+)
+ create mode 100644 added_tokens.json
create mode 100644 config.json
- create mode 100644 pytorch_model.bin
+ create mode 100644 model.safetensors
create mode 100644 sentencepiece.bpe.model
create mode 100644 special_tokens_map.json
create mode 100644 tokenizer.json
@@ -603,15 +605,15 @@ git push
```
```bash
-Uploading LFS objects: 100% (1/1), 433 MB | 1.3 MB/s, done.
-Enumerating objects: 11, done.
-Counting objects: 100% (11/11), done.
-Delta compression using up to 12 threads
-Compressing objects: 100% (9/9), done.
-Writing objects: 100% (9/9), 288.27 KiB | 6.27 MiB/s, done.
-Total 9 (delta 1), reused 0 (delta 0), pack-reused 0
+Uploading LFS objects: 100% (2/2), 444 MB | 86 MB/s, done.
+Enumerating objects: 10, done.
+Counting objects: 100% (10/10), done.
+Delta compression using up to 2 threads
+Compressing objects: 100% (8/8), done.
+Writing objects: 100% (9/9), 592.02 KiB | 6.30 MiB/s, done.
+Total 9 (delta 0), reused 0 (delta 0), pack-reused 0
To https://huggingface.co/lysandre/dummy
- 891b41d..b08aab1 main -> main
+ 70fd9db..c2ec5c9 main -> main
```
{#if fw === 'pt'}
diff --git a/chapters/fr/chapter4/3.mdx b/chapters/fr/chapter4/3.mdx
index f349d7d9d..3ea75972d 100644
--- a/chapters/fr/chapter4/3.mdx
+++ b/chapters/fr/chapter4/3.mdx
@@ -450,10 +450,10 @@ ls
{#if fw === 'pt'}
```bash
-config.json pytorch_model.bin README.md sentencepiece.bpe.model special_tokens_map.json tokenizer_config.json tokenizer.json
+added_tokens.json config.json model.safetensors sentencepiece.bpe.model special_tokens_map.json tokenizer_config.json tokenizer.json
```
-Si vous regardez la taille des fichiers (par exemple, avec `ls -lh`), vous devriez voir que le fichier d'état du modèle (*pytorch_model.bin*) est la seule exception, avec plus de 400 Mo.
+Si vous regardez la taille des fichiers (par exemple, avec `ls -lh`), vous devriez voir que le fichier d'état du modèle (*model.safetensors *) est la seule exception, avec plus de 400 Mo.
{:else}
```bash
@@ -488,12 +488,13 @@ Your branch is up to date with 'origin/main'.
Changes to be committed:
(use "git restore --staged ..." to unstage)
modified: .gitattributes
+ new file: added_tokens.json
new file: config.json
- new file: pytorch_model.bin
+ new file: model.safetensors
new file: sentencepiece.bpe.model
new file: special_tokens_map.json
- new file: tokenizer.json
new file: tokenizer_config.json
+ new file: tokenizer.json
```
{:else}
```bash
@@ -526,12 +527,13 @@ Objects to be pushed to origin/main:
Objects to be committed:
- config.json (Git: bc20ff2)
- pytorch_model.bin (LFS: 35686c2)
+ added_tokens.json (Git: 43734cd)
+ config.json (Git: acfd093)
+ model.safetensors (LFS: 2785d2e)
sentencepiece.bpe.model (LFS: 988bc5a)
- special_tokens_map.json (Git: cb23931)
- tokenizer.json (Git: 851ff3e)
- tokenizer_config.json (Git: f0f7783)
+ special_tokens_map.json (Git: b547935)
+ tokenizer.json (Git: 18d0f7a)
+ tokenizer_config.json (Git: c49982e)
Objects not staged for commit:
@@ -572,11 +574,11 @@ git commit -m "First model version"
{#if fw === 'pt'}
```bash
-[main b08aab1] First model version
- 7 files changed, 29027 insertions(+)
- 6 files changed, 36 insertions(+)
+[main c2ec5c9] First model version
+ 7 files changed, 128351 insertions(+)
+ create mode 100644 added_tokens.json
create mode 100644 config.json
- create mode 100644 pytorch_model.bin
+ create mode 100644 model.safetensors
create mode 100644 sentencepiece.bpe.model
create mode 100644 special_tokens_map.json
create mode 100644 tokenizer.json
@@ -602,15 +604,15 @@ git push
```
```bash
-Uploading LFS objects: 100% (1/1), 433 MB | 1.3 MB/s, done.
-Enumerating objects: 11, done.
-Counting objects: 100% (11/11), done.
-Delta compression using up to 12 threads
-Compressing objects: 100% (9/9), done.
-Writing objects: 100% (9/9), 288.27 KiB | 6.27 MiB/s, done.
-Total 9 (delta 1), reused 0 (delta 0), pack-reused 0
+Uploading LFS objects: 100% (2/2), 444 MB | 86 MB/s, done.
+Enumerating objects: 10, done.
+Counting objects: 100% (10/10), done.
+Delta compression using up to 2 threads
+Compressing objects: 100% (8/8), done.
+Writing objects: 100% (9/9), 592.02 KiB | 6.30 MiB/s, done.
+Total 9 (delta 0), reused 0 (delta 0), pack-reused 0
To https://huggingface.co/lysandre/dummy
- 891b41d..b08aab1 main -> main
+ 70fd9db..c2ec5c9 main -> main
```
{#if fw === 'pt'}
diff --git a/chapters/it/chapter4/3.mdx b/chapters/it/chapter4/3.mdx
index 0a531c7fd..171e1f479 100644
--- a/chapters/it/chapter4/3.mdx
+++ b/chapters/it/chapter4/3.mdx
@@ -452,10 +452,10 @@ ls
{#if fw === 'pt'}
```bash
-config.json pytorch_model.bin README.md sentencepiece.bpe.model special_tokens_map.json tokenizer_config.json tokenizer.json
+added_tokens.json config.json model.safetensors sentencepiece.bpe.model special_tokens_map.json tokenizer_config.json tokenizer.json
```
-Guardando le dimensioni dei file (ad esempio con `ls -lh`), possiamo vedere che il file contenente lo stato del modello (model state dict file) (*pytorch_model.bin*) è l'unico file anomalo, occupando più di 400 MB.
+Guardando le dimensioni dei file (ad esempio con `ls -lh`), possiamo vedere che il file contenente lo stato del modello (model state dict file) (*model.safetensors *) è l'unico file anomalo, occupando più di 400 MB.
{:else}
```bash
@@ -467,8 +467,8 @@ Guardando le dimensioni dei file (ad esempio con `ls -lh`), possiamo vedere che
{/if}
-✏️ When creating the repository from the web interface, the *.gitattributes* file is automatically set up to consider files with certain extensions, such as *.bin* and *.h5*, as large files, and git-lfs will track them with no necessary setup on your side.
-✏️ Creando il reposiotry dall'interfaccia web, il file *.gitattributes* viene automaticamente configurato per considerare file con alcune estensioni, come *.bin* e *.h5*, come file grandi, e git-lfs li traccerà senza necessità di configurazione da parte dell'utente.
+✏️ When creating the repository from the web interface, the *.gitattributes* file is automatically set up to consider files with certain extensions, such as *.safetensors* and *.h5*, as large files, and git-lfs will track them with no necessary setup on your side.
+✏️ Creando il reposiotry dall'interfaccia web, il file *.gitattributes* viene automaticamente configurato per considerare file con alcune estensioni, come *.safetensors* e *.h5*, come file grandi, e git-lfs li traccerà senza necessità di configurazione da parte dell'utente.
Possiamo quindi procedere come faremo per un repository Git tradizionale. Possiamo aggiungere tutti i file all'ambiente di staging di Git con il comando `git add`:
@@ -491,12 +491,13 @@ Your branch is up to date with 'origin/main'.
Changes to be committed:
(use "git restore --staged ..." to unstage)
modified: .gitattributes
+ new file: added_tokens.json
new file: config.json
- new file: pytorch_model.bin
+ new file: model.safetensors
new file: sentencepiece.bpe.model
new file: special_tokens_map.json
- new file: tokenizer.json
new file: tokenizer_config.json
+ new file: tokenizer.json
```
{:else}
```bash
@@ -529,12 +530,13 @@ Objects to be pushed to origin/main:
Objects to be committed:
- config.json (Git: bc20ff2)
- pytorch_model.bin (LFS: 35686c2)
+ added_tokens.json (Git: 43734cd)
+ config.json (Git: acfd093)
+ model.safetensors (LFS: 2785d2e)
sentencepiece.bpe.model (LFS: 988bc5a)
- special_tokens_map.json (Git: cb23931)
- tokenizer.json (Git: 851ff3e)
- tokenizer_config.json (Git: f0f7783)
+ special_tokens_map.json (Git: b547935)
+ tokenizer.json (Git: 18d0f7a)
+ tokenizer_config.json (Git: c49982e)
Objects not staged for commit:
@@ -575,11 +577,11 @@ git commit -m "First model version"
{#if fw === 'pt'}
```bash
-[main b08aab1] First model version
- 7 files changed, 29027 insertions(+)
- 6 files changed, 36 insertions(+)
+[main c2ec5c9] First model version
+ 7 files changed, 128351 insertions(+)
+ create mode 100644 added_tokens.json
create mode 100644 config.json
- create mode 100644 pytorch_model.bin
+ create mode 100644 model.safetensors
create mode 100644 sentencepiece.bpe.model
create mode 100644 special_tokens_map.json
create mode 100644 tokenizer.json
@@ -605,15 +607,15 @@ git push
```
```bash
-Uploading LFS objects: 100% (1/1), 433 MB | 1.3 MB/s, done.
-Enumerating objects: 11, done.
-Counting objects: 100% (11/11), done.
-Delta compression using up to 12 threads
-Compressing objects: 100% (9/9), done.
-Writing objects: 100% (9/9), 288.27 KiB | 6.27 MiB/s, done.
-Total 9 (delta 1), reused 0 (delta 0), pack-reused 0
+Uploading LFS objects: 100% (2/2), 444 MB | 86 MB/s, done.
+Enumerating objects: 10, done.
+Counting objects: 100% (10/10), done.
+Delta compression using up to 2 threads
+Compressing objects: 100% (8/8), done.
+Writing objects: 100% (9/9), 592.02 KiB | 6.30 MiB/s, done.
+Total 9 (delta 0), reused 0 (delta 0), pack-reused 0
To https://huggingface.co/lysandre/dummy
- 891b41d..b08aab1 main -> main
+ 70fd9db..c2ec5c9 main -> main
```
{#if fw === 'pt'}
diff --git a/chapters/ja/chapter4/3.mdx b/chapters/ja/chapter4/3.mdx
index b6a8140db..9aa73252d 100644
--- a/chapters/ja/chapter4/3.mdx
+++ b/chapters/ja/chapter4/3.mdx
@@ -445,10 +445,10 @@ ls
{#if fw === 'pt'}
```bash
-config.json pytorch_model.bin README.md sentencepiece.bpe.model special_tokens_map.json tokenizer_config.json tokenizer.json
+added_tokens.json config.json model.safetensors sentencepiece.bpe.model special_tokens_map.json tokenizer_config.json tokenizer.json
```
-ファイルサイズを見ると（たとえば `ls -lh` で）、モデル状態のディクショナリファイル (*pytorch_model.bin*) が唯一、400 MB 以上あることがわかると思います。
+ファイルサイズを見ると（たとえば `ls -lh` で）、モデル状態のディクショナリファイル (*model.safetensors *) が唯一、400 MB 以上あることがわかると思います。
{:else}
```bash
@@ -460,7 +460,7 @@ config.json README.md sentencepiece.bpe.model special_tokens_map.json tf_mod
{/if}
-✏️ ウェブインターフェースからリポジトリを作成する場合、*.gitattributes* ファイルは自動的に *.bin* や *.h5* などの特定の拡張子を持つファイルを大きなファイルとみなすように設定され、git-lfs がそれらを追跡するようになります。ユーザー側で別途設定を行う必要はありません。
+✏️ ウェブインターフェースからリポジトリを作成する場合、*.gitattributes* ファイルは自動的に *.safetensors* や *.h5* などの特定の拡張子を持つファイルを大きなファイルとみなすように設定され、git-lfs がそれらを追跡するようになります。ユーザー側で別途設定を行う必要はありません。
これで、従来の Git リポジトリと同じように作業を進められるようになりました。すべてのファイルを Git のステージング環境に追加するには、`git add` コマンドを使います：
@@ -483,12 +483,13 @@ Your branch is up to date with 'origin/main'.
Changes to be committed:
(use "git restore --staged ..." to unstage)
modified: .gitattributes
+ new file: added_tokens.json
new file: config.json
- new file: pytorch_model.bin
+ new file: model.safetensors
new file: sentencepiece.bpe.model
new file: special_tokens_map.json
- new file: tokenizer.json
new file: tokenizer_config.json
+ new file: tokenizer.json
```
{:else}
```bash
@@ -521,12 +522,13 @@ Objects to be pushed to origin/main:
Objects to be committed:
- config.json (Git: bc20ff2)
- pytorch_model.bin (LFS: 35686c2)
+ added_tokens.json (Git: 43734cd)
+ config.json (Git: acfd093)
+ model.safetensors (LFS: 2785d2e)
sentencepiece.bpe.model (LFS: 988bc5a)
- special_tokens_map.json (Git: cb23931)
- tokenizer.json (Git: 851ff3e)
- tokenizer_config.json (Git: f0f7783)
+ special_tokens_map.json (Git: b547935)
+ tokenizer.json (Git: 18d0f7a)
+ tokenizer_config.json (Git: c49982e)
Objects not staged for commit:
@@ -567,11 +569,11 @@ git commit -m "First model version"
{#if fw === 'pt'}
```bash
-[main b08aab1] First model version
- 7 files changed, 29027 insertions(+)
- 6 files changed, 36 insertions(+)
+[main c2ec5c9] First model version
+ 7 files changed, 128351 insertions(+)
+ create mode 100644 added_tokens.json
create mode 100644 config.json
- create mode 100644 pytorch_model.bin
+ create mode 100644 model.safetensors
create mode 100644 sentencepiece.bpe.model
create mode 100644 special_tokens_map.json
create mode 100644 tokenizer.json
@@ -597,15 +599,15 @@ git push
```
```bash
-Uploading LFS objects: 100% (1/1), 433 MB | 1.3 MB/s, done.
-Enumerating objects: 11, done.
-Counting objects: 100% (11/11), done.
-Delta compression using up to 12 threads
-Compressing objects: 100% (9/9), done.
-Writing objects: 100% (9/9), 288.27 KiB | 6.27 MiB/s, done.
-Total 9 (delta 1), reused 0 (delta 0), pack-reused 0
+Uploading LFS objects: 100% (2/2), 444 MB | 86 MB/s, done.
+Enumerating objects: 10, done.
+Counting objects: 100% (10/10), done.
+Delta compression using up to 2 threads
+Compressing objects: 100% (8/8), done.
+Writing objects: 100% (9/9), 592.02 KiB | 6.30 MiB/s, done.
+Total 9 (delta 0), reused 0 (delta 0), pack-reused 0
To https://huggingface.co/lysandre/dummy
- 891b41d..b08aab1 main -> main
+ 70fd9db..c2ec5c9 main -> main
```
{#if fw === 'pt'}
diff --git a/chapters/pt/chapter4/3.mdx b/chapters/pt/chapter4/3.mdx
index 93c652963..b2549d084 100644
--- a/chapters/pt/chapter4/3.mdx
+++ b/chapters/pt/chapter4/3.mdx
@@ -451,10 +451,10 @@ ls
{#if fw === 'pt'}
```bash
-config.json pytorch_model.bin README.md sentencepiece.bpe.model special_tokens_map.json tokenizer_config.json tokenizer.json
+added_tokens.json config.json model.safetensors sentencepiece.bpe.model special_tokens_map.json tokenizer_config.json tokenizer.json
```
-Se você olhar para os tamanhos de arquivo (por exemplo, com `ls -lh`), você deve ver que o arquivo de estado do modelo (*pytorch_model.bin*) é o único outlier, com mais de 400 MB.
+Se você olhar para os tamanhos de arquivo (por exemplo, com `ls -lh`), você deve ver que o arquivo de estado do modelo (*model.safetensors *) é o único outlier, com mais de 400 MB.
{:else}
```bash
@@ -466,7 +466,7 @@ Se você olhar para os tamanhos de arquivo (por exemplo, com `ls -lh`), você de
{/if}
-✏️ Ao criar o repositório a partir da interface web, o arquivo *.gitattributes* é automaticamente configurado para considerar arquivos com certas extensões, como *.bin* e *.h5*, como arquivos grandes, e o git-lfs os rastreará sem nenhuma configuração necessária em seu lado.
+✏️ Ao criar o repositório a partir da interface web, o arquivo *.gitattributes* é automaticamente configurado para considerar arquivos com certas extensões, como *.safetensors* e *.h5*, como arquivos grandes, e o git-lfs os rastreará sem nenhuma configuração necessária em seu lado.
Agora podemos ir em frente e proceder como normalmente faríamos com os repositórios tradicionais da Git. Podemos adicionar todos os arquivos ao ambiente de encenação do Git utilizando o comando `git add`:
@@ -489,12 +489,13 @@ Your branch is up to date with 'origin/main'.
Changes to be committed:
(use "git restore --staged ..." to unstage)
modified: .gitattributes
+ new file: added_tokens.json
new file: config.json
- new file: pytorch_model.bin
+ new file: model.safetensors
new file: sentencepiece.bpe.model
new file: special_tokens_map.json
- new file: tokenizer.json
new file: tokenizer_config.json
+ new file: tokenizer.json
```
{:else}
```bash
@@ -527,12 +528,13 @@ Objects to be pushed to origin/main:
Objects to be committed:
- config.json (Git: bc20ff2)
- pytorch_model.bin (LFS: 35686c2)
+ added_tokens.json (Git: 43734cd)
+ config.json (Git: acfd093)
+ model.safetensors (LFS: 2785d2e)
sentencepiece.bpe.model (LFS: 988bc5a)
- special_tokens_map.json (Git: cb23931)
- tokenizer.json (Git: 851ff3e)
- tokenizer_config.json (Git: f0f7783)
+ special_tokens_map.json (Git: b547935)
+ tokenizer.json (Git: 18d0f7a)
+ tokenizer_config.json (Git: c49982e)
Objects not staged for commit:
@@ -573,11 +575,11 @@ git commit -m "First model version"
{#if fw === 'pt'}
```bash
-[main b08aab1] First model version
- 7 files changed, 29027 insertions(+)
- 6 files changed, 36 insertions(+)
+[main c2ec5c9] First model version
+ 7 files changed, 128351 insertions(+)
+ create mode 100644 added_tokens.json
create mode 100644 config.json
- create mode 100644 pytorch_model.bin
+ create mode 100644 model.safetensors
create mode 100644 sentencepiece.bpe.model
create mode 100644 special_tokens_map.json
create mode 100644 tokenizer.json
@@ -603,15 +605,15 @@ git push
```
```bash
-Uploading LFS objects: 100% (1/1), 433 MB | 1.3 MB/s, done.
-Enumerating objects: 11, done.
-Counting objects: 100% (11/11), done.
-Delta compression using up to 12 threads
-Compressing objects: 100% (9/9), done.
-Writing objects: 100% (9/9), 288.27 KiB | 6.27 MiB/s, done.
-Total 9 (delta 1), reused 0 (delta 0), pack-reused 0
+Uploading LFS objects: 100% (2/2), 444 MB | 86 MB/s, done.
+Enumerating objects: 10, done.
+Counting objects: 100% (10/10), done.
+Delta compression using up to 2 threads
+Compressing objects: 100% (8/8), done.
+Writing objects: 100% (9/9), 592.02 KiB | 6.30 MiB/s, done.
+Total 9 (delta 0), reused 0 (delta 0), pack-reused 0
To https://huggingface.co/lysandre/dummy
- 891b41d..b08aab1 main -> main
+ 70fd9db..c2ec5c9 main -> main
```
{#if fw === 'pt'}
diff --git a/chapters/ru/chapter4/3.mdx b/chapters/ru/chapter4/3.mdx
index 3a7fbf507..f886f83c6 100644
--- a/chapters/ru/chapter4/3.mdx
+++ b/chapters/ru/chapter4/3.mdx
@@ -444,10 +444,10 @@ ls
{#if fw === 'pt'}
```bash
-config.json pytorch_model.bin README.md sentencepiece.bpe.model special_tokens_map.json tokenizer_config.json tokenizer.json
+added_tokens.json config.json model.safetensors sentencepiece.bpe.model special_tokens_map.json tokenizer_config.json tokenizer.json
```
-If you look at the file sizes (for example, with `ls -lh`), you should see that the model state dict file (*pytorch_model.bin*) is the only outlier, at more than 400 MB.
+If you look at the file sizes (for example, with `ls -lh`), you should see that the model state dict file (*model.safetensors *) is the only outlier, at more than 400 MB.
{:else}
```bash
@@ -459,7 +459,7 @@ config.json README.md sentencepiece.bpe.model special_tokens_map.json tf_mod
{/if}
-✏️ При создании репозитория с помощью веб-интерфейса, файл *.gitattributes* автоматически фиксирует файлы с определенными расширениями (*.bin* и *.h5*) как большие файлы, и git-lfs отследит их без необходимости делать это вручную.
+✏️ При создании репозитория с помощью веб-интерфейса, файл *.gitattributes* автоматически фиксирует файлы с определенными расширениями (*.safetensors* и *.h5*) как большие файлы, и git-lfs отследит их без необходимости делать это вручную.
Теперь мы можем продолжить и продолжить, как обычно делаем с традиционными репозиториями Git. Мы можем добавить все файлы в промежуточную среду Git с помощью команды `git add`:
@@ -482,12 +482,13 @@ Your branch is up to date with 'origin/main'.
Changes to be committed:
(use "git restore --staged ..." to unstage)
modified: .gitattributes
+ new file: added_tokens.json
new file: config.json
- new file: pytorch_model.bin
+ new file: model.safetensors
new file: sentencepiece.bpe.model
new file: special_tokens_map.json
- new file: tokenizer.json
new file: tokenizer_config.json
+ new file: tokenizer.json
```
{:else}
```bash
@@ -520,12 +521,13 @@ Objects to be pushed to origin/main:
Objects to be committed:
- config.json (Git: bc20ff2)
- pytorch_model.bin (LFS: 35686c2)
+ added_tokens.json (Git: 43734cd)
+ config.json (Git: acfd093)
+ model.safetensors (LFS: 2785d2e)
sentencepiece.bpe.model (LFS: 988bc5a)
- special_tokens_map.json (Git: cb23931)
- tokenizer.json (Git: 851ff3e)
- tokenizer_config.json (Git: f0f7783)
+ special_tokens_map.json (Git: b547935)
+ tokenizer.json (Git: 18d0f7a)
+ tokenizer_config.json (Git: c49982e)
Objects not staged for commit:
@@ -566,11 +568,11 @@ git commit -m "First model version"
{#if fw === 'pt'}
```bash
-[main b08aab1] First model version
- 7 files changed, 29027 insertions(+)
- 6 files changed, 36 insertions(+)
+[main c2ec5c9] First model version
+ 7 files changed, 128351 insertions(+)
+ create mode 100644 added_tokens.json
create mode 100644 config.json
- create mode 100644 pytorch_model.bin
+ create mode 100644 model.safetensors
create mode 100644 sentencepiece.bpe.model
create mode 100644 special_tokens_map.json
create mode 100644 tokenizer.json
@@ -596,15 +598,15 @@ git push
```
```bash
-Uploading LFS objects: 100% (1/1), 433 MB | 1.3 MB/s, done.
-Enumerating objects: 11, done.
-Counting objects: 100% (11/11), done.
-Delta compression using up to 12 threads
-Compressing objects: 100% (9/9), done.
-Writing objects: 100% (9/9), 288.27 KiB | 6.27 MiB/s, done.
-Total 9 (delta 1), reused 0 (delta 0), pack-reused 0
+Uploading LFS objects: 100% (2/2), 444 MB | 86 MB/s, done.
+Enumerating objects: 10, done.
+Counting objects: 100% (10/10), done.
+Delta compression using up to 2 threads
+Compressing objects: 100% (8/8), done.
+Writing objects: 100% (9/9), 592.02 KiB | 6.30 MiB/s, done.
+Total 9 (delta 0), reused 0 (delta 0), pack-reused 0
To https://huggingface.co/lysandre/dummy
- 891b41d..b08aab1 main -> main
+ 70fd9db..c2ec5c9 main -> main
```
{#if fw === 'pt'}
diff --git a/chapters/th/chapter4/3.mdx b/chapters/th/chapter4/3.mdx
index 7558c85fc..9ae2a7b9c 100644
--- a/chapters/th/chapter4/3.mdx
+++ b/chapters/th/chapter4/3.mdx
@@ -451,10 +451,10 @@ ls
{#if fw === 'pt'}
```bash
-config.json pytorch_model.bin README.md sentencepiece.bpe.model special_tokens_map.json tokenizer_config.json tokenizer.json
+added_tokens.json config.json model.safetensors sentencepiece.bpe.model special_tokens_map.json tokenizer_config.json tokenizer.json
```
-ถ้าคุณดูที่ขนาดของไฟล์ (อย่างเช่น ใช้คำสั่ง `ls -lh`) คุณควรจะเห็นได้ว่าไฟล์ model state dict (*pytorch_model.bin*) มีขนาดที่โดดมาก นั่นคือมากกว่า 400 MB
+ถ้าคุณดูที่ขนาดของไฟล์ (อย่างเช่น ใช้คำสั่ง `ls -lh`) คุณควรจะเห็นได้ว่าไฟล์ model state dict (*model.safetensors *) มีขนาดที่โดดมาก นั่นคือมากกว่า 400 MB
{:else}
```bash
@@ -466,7 +466,7 @@ config.json README.md sentencepiece.bpe.model special_tokens_map.json tf_mod
{/if}
-✏️ ตอนที่สร้าง repository จาก web interface ไฟล์ *.gitattributes* ถูกตั้งค่าอย่างอัตโนมัติเพื่อให้พิจารณาไฟล์บางประเภท เช่น *.bin* และ *.h5* ว่าเป็นไฟล์ขนาดใหญ่ และ git-lfs จะติดตามไฟล์เหล่านั้นโดยคุณไม่จำเป็นต้องตั้งค่าอะไรเลย
+✏️ ตอนที่สร้าง repository จาก web interface ไฟล์ *.gitattributes* ถูกตั้งค่าอย่างอัตโนมัติเพื่อให้พิจารณาไฟล์บางประเภท เช่น *.safetensors* และ *.h5* ว่าเป็นไฟล์ขนาดใหญ่ และ git-lfs จะติดตามไฟล์เหล่านั้นโดยคุณไม่จำเป็นต้องตั้งค่าอะไรเลย
ต่อไปเราจะทำต่อโดยการทำแบบที่เราทำกับ Git repositories ดั้งเดิม เราสามารถเพิ่มไฟล์ทั้งหมดไปยัง staging environment ของ Git ได้ด้วยการใช้คำสั่ง `git add`:
@@ -489,12 +489,13 @@ Your branch is up to date with 'origin/main'.
Changes to be committed:
(use "git restore --staged ..." to unstage)
modified: .gitattributes
+ new file: added_tokens.json
new file: config.json
- new file: pytorch_model.bin
+ new file: model.safetensors
new file: sentencepiece.bpe.model
new file: special_tokens_map.json
- new file: tokenizer.json
new file: tokenizer_config.json
+ new file: tokenizer.json
```
{:else}
```bash
@@ -527,12 +528,13 @@ Objects to be pushed to origin/main:
Objects to be committed:
- config.json (Git: bc20ff2)
- pytorch_model.bin (LFS: 35686c2)
+ added_tokens.json (Git: 43734cd)
+ config.json (Git: acfd093)
+ model.safetensors (LFS: 2785d2e)
sentencepiece.bpe.model (LFS: 988bc5a)
- special_tokens_map.json (Git: cb23931)
- tokenizer.json (Git: 851ff3e)
- tokenizer_config.json (Git: f0f7783)
+ special_tokens_map.json (Git: b547935)
+ tokenizer.json (Git: 18d0f7a)
+ tokenizer_config.json (Git: c49982e)
Objects not staged for commit:
@@ -573,11 +575,11 @@ git commit -m "First model version"
{#if fw === 'pt'}
```bash
-[main b08aab1] First model version
- 7 files changed, 29027 insertions(+)
- 6 files changed, 36 insertions(+)
+[main c2ec5c9] First model version
+ 7 files changed, 128351 insertions(+)
+ create mode 100644 added_tokens.json
create mode 100644 config.json
- create mode 100644 pytorch_model.bin
+ create mode 100644 model.safetensors
create mode 100644 sentencepiece.bpe.model
create mode 100644 special_tokens_map.json
create mode 100644 tokenizer.json
@@ -603,15 +605,15 @@ git push
```
```bash
-Uploading LFS objects: 100% (1/1), 433 MB | 1.3 MB/s, done.
-Enumerating objects: 11, done.
-Counting objects: 100% (11/11), done.
-Delta compression using up to 12 threads
-Compressing objects: 100% (9/9), done.
-Writing objects: 100% (9/9), 288.27 KiB | 6.27 MiB/s, done.
-Total 9 (delta 1), reused 0 (delta 0), pack-reused 0
+Uploading LFS objects: 100% (2/2), 444 MB | 86 MB/s, done.
+Enumerating objects: 10, done.
+Counting objects: 100% (10/10), done.
+Delta compression using up to 2 threads
+Compressing objects: 100% (8/8), done.
+Writing objects: 100% (9/9), 592.02 KiB | 6.30 MiB/s, done.
+Total 9 (delta 0), reused 0 (delta 0), pack-reused 0
To https://huggingface.co/lysandre/dummy
- 891b41d..b08aab1 main -> main
+ 70fd9db..c2ec5c9 main -> main
```
{#if fw === 'pt'}
diff --git a/chapters/vi/chapter4/3.mdx b/chapters/vi/chapter4/3.mdx
index c80df00cd..5be431d59 100644
--- a/chapters/vi/chapter4/3.mdx
+++ b/chapters/vi/chapter4/3.mdx
@@ -493,10 +493,10 @@ ls
{#if fw === 'pt'}
```bash
-config.json pytorch_model.bin README.md sentencepiece.bpe.model special_tokens_map.json tokenizer_config.json tokenizer.json
+added_tokens.json config.json model.safetensors sentencepiece.bpe.model special_tokens_map.json tokenizer_config.json tokenizer.json
```
-Nếu bạn nhìn vào kích thước tệp (ví dụ: với `ls -lh`), bạn sẽ thấy rằng tệp dict trạng thái mô hình (_pytorch_model.bin_) là ngoại lệ duy nhất, với hơn 400 MB.
+Nếu bạn nhìn vào kích thước tệp (ví dụ: với `ls -lh`), bạn sẽ thấy rằng tệp dict trạng thái mô hình (_model.safetensors _) là ngoại lệ duy nhất, với hơn 400 MB.
{:else}
@@ -509,7 +509,7 @@ Nếu bạn nhìn vào kích thước tệp (ví dụ: với `ls -lh`), bạn s
{/if}
- ✏️ Khi tạo kho lưu trữ từ giao diện web, tệp *.gitattributes* được tự động thiết lập để xem xét các tệp có phần mở rộng nhất định, chẳng hạn như *.bin* và *.h5*, là tệp lớn và git-lfs sẽ theo dõi chúng mà không có thiết lập cần thiết về phía bạn.
+ ✏️ Khi tạo kho lưu trữ từ giao diện web, tệp *.gitattributes* được tự động thiết lập để xem xét các tệp có phần mở rộng nhất định, chẳng hạn như *.safetensors* và *.h5*, là tệp lớn và git-lfs sẽ theo dõi chúng mà không có thiết lập cần thiết về phía bạn.
{" "}
Bây giờ chúng ta có thể tiếp tục và tiến hành như chúng ta thường làm với các kho lưu trữ Git truyền thống. Chúng ta có thể thêm tất cả các tệp vào môi trường dàn dựng của Git bằng lệnh `git add`:
@@ -533,12 +533,13 @@ Your branch is up to date with 'origin/main'.
Changes to be committed:
(use "git restore --staged ..." to unstage)
modified: .gitattributes
+ new file: added_tokens.json
new file: config.json
- new file: pytorch_model.bin
+ new file: model.safetensors
new file: sentencepiece.bpe.model
new file: special_tokens_map.json
- new file: tokenizer.json
new file: tokenizer_config.json
+ new file: tokenizer.json
```
{:else}
@@ -575,12 +576,13 @@ Objects to be pushed to origin/main:
Objects to be committed:
- config.json (Git: bc20ff2)
- pytorch_model.bin (LFS: 35686c2)
+ added_tokens.json (Git: 43734cd)
+ config.json (Git: acfd093)
+ model.safetensors (LFS: 2785d2e)
sentencepiece.bpe.model (LFS: 988bc5a)
- special_tokens_map.json (Git: cb23931)
- tokenizer.json (Git: 851ff3e)
- tokenizer_config.json (Git: f0f7783)
+ special_tokens_map.json (Git: b547935)
+ tokenizer.json (Git: 18d0f7a)
+ tokenizer_config.json (Git: c49982e)
Objects not staged for commit:
@@ -623,11 +625,11 @@ git commit -m "First model version"
{#if fw === 'pt'}
```bash
-[main b08aab1] First model version
- 7 files changed, 29027 insertions(+)
- 6 files changed, 36 insertions(+)
+[main c2ec5c9] First model version
+ 7 files changed, 128351 insertions(+)
+ create mode 100644 added_tokens.json
create mode 100644 config.json
- create mode 100644 pytorch_model.bin
+ create mode 100644 model.safetensors
create mode 100644 sentencepiece.bpe.model
create mode 100644 special_tokens_map.json
create mode 100644 tokenizer.json
@@ -656,15 +658,15 @@ git push
```
```bash
-Uploading LFS objects: 100% (1/1), 433 MB | 1.3 MB/s, done.
-Enumerating objects: 11, done.
-Counting objects: 100% (11/11), done.
-Delta compression using up to 12 threads
-Compressing objects: 100% (9/9), done.
-Writing objects: 100% (9/9), 288.27 KiB | 6.27 MiB/s, done.
-Total 9 (delta 1), reused 0 (delta 0), pack-reused 0
+Uploading LFS objects: 100% (2/2), 444 MB | 86 MB/s, done.
+Enumerating objects: 10, done.
+Counting objects: 100% (10/10), done.
+Delta compression using up to 2 threads
+Compressing objects: 100% (8/8), done.
+Writing objects: 100% (9/9), 592.02 KiB | 6.30 MiB/s, done.
+Total 9 (delta 0), reused 0 (delta 0), pack-reused 0
To https://huggingface.co/lysandre/dummy
- 891b41d..b08aab1 main -> main
+ 70fd9db..c2ec5c9 main -> main
```
{#if fw === 'pt'}
diff --git a/chapters/zh-CN/chapter4/3.mdx b/chapters/zh-CN/chapter4/3.mdx
index ba5e26550..6ceba2022 100644
--- a/chapters/zh-CN/chapter4/3.mdx
+++ b/chapters/zh-CN/chapter4/3.mdx
@@ -456,10 +456,10 @@ ls
{#if fw === 'pt'}
```bash
-config.json pytorch_model.bin README.md sentencepiece.bpe.model special_tokens_map.json tokenizer_config.json tokenizer.json
+added_tokens.json config.json model.safetensors sentencepiece.bpe.model special_tokens_map.json tokenizer_config.json tokenizer.json
```
-If you look at the file sizes (for example, with `ls -lh`), you should see that the model state dict file (*pytorch_model.bin*) is the only outlier, at more than 400 MB.
+If you look at the file sizes (for example, with `ls -lh`), you should see that the model state dict file (*model.safetensors *) is the only outlier, at more than 400 MB.
{:else}
```bash
@@ -471,7 +471,7 @@ config.json README.md sentencepiece.bpe.model special_tokens_map.json tf_mod
{/if}
-✏️ 从 web 界面创建存储库时，*.gitattributes* 文件会自动设置为将具有某些扩展名的文件，例如 *.bin* 和 *.h5* 视为大文件，git-lfs 会对其进行跟踪您无需进行必要的设置。
+✏️ 从 web 界面创建存储库时，*.gitattributes* 文件会自动设置为将具有某些扩展名的文件，例如 *.safetensors* 和 *.h5* 视为大文件，git-lfs 会对其进行跟踪您无需进行必要的设置。
我们现在可以继续进行，就像我们通常使用传统 Git 存储库一样。我们可以使用以下命令将所有文件添加到 Git 的暂存环境中 **git add** 命令：
@@ -494,12 +494,13 @@ Your branch is up to date with 'origin/main'.
Changes to be committed:
(use "git restore --staged ..." to unstage)
modified: .gitattributes
+ new file: added_tokens.json
new file: config.json
- new file: pytorch_model.bin
+ new file: model.safetensors
new file: sentencepiece.bpe.model
new file: special_tokens_map.json
- new file: tokenizer.json
new file: tokenizer_config.json
+ new file: tokenizer.json
```
{:else}
```bash
@@ -532,12 +533,13 @@ Objects to be pushed to origin/main:
Objects to be committed:
- config.json (Git: bc20ff2)
- pytorch_model.bin (LFS: 35686c2)
+ added_tokens.json (Git: 43734cd)
+ config.json (Git: acfd093)
+ model.safetensors (LFS: 2785d2e)
sentencepiece.bpe.model (LFS: 988bc5a)
- special_tokens_map.json (Git: cb23931)
- tokenizer.json (Git: 851ff3e)
- tokenizer_config.json (Git: f0f7783)
+ special_tokens_map.json (Git: b547935)
+ tokenizer.json (Git: 18d0f7a)
+ tokenizer_config.json (Git: c49982e)
Objects not staged for commit:
@@ -578,11 +580,11 @@ git commit -m "First model version"
{#if fw === 'pt'}
```bash
-[main b08aab1] First model version
- 7 files changed, 29027 insertions(+)
- 6 files changed, 36 insertions(+)
+[main c2ec5c9] First model version
+ 7 files changed, 128351 insertions(+)
+ create mode 100644 added_tokens.json
create mode 100644 config.json
- create mode 100644 pytorch_model.bin
+ create mode 100644 model.safetensors
create mode 100644 sentencepiece.bpe.model
create mode 100644 special_tokens_map.json
create mode 100644 tokenizer.json
@@ -608,15 +610,15 @@ git push
```
```bash
-Uploading LFS objects: 100% (1/1), 433 MB | 1.3 MB/s, done.
-Enumerating objects: 11, done.
-Counting objects: 100% (11/11), done.
-Delta compression using up to 12 threads
-Compressing objects: 100% (9/9), done.
-Writing objects: 100% (9/9), 288.27 KiB | 6.27 MiB/s, done.
-Total 9 (delta 1), reused 0 (delta 0), pack-reused 0
+Uploading LFS objects: 100% (2/2), 444 MB | 86 MB/s, done.
+Enumerating objects: 10, done.
+Counting objects: 100% (10/10), done.
+Delta compression using up to 2 threads
+Compressing objects: 100% (8/8), done.
+Writing objects: 100% (9/9), 592.02 KiB | 6.30 MiB/s, done.
+Total 9 (delta 0), reused 0 (delta 0), pack-reused 0
To https://huggingface.co/lysandre/dummy
- 891b41d..b08aab1 main -> main
+ 70fd9db..c2ec5c9 main -> main
```
{#if fw === 'pt'}
diff --git a/chapters/zh-TW/chapter4/3.mdx b/chapters/zh-TW/chapter4/3.mdx
index 77bef09f3..3d1253471 100644
--- a/chapters/zh-TW/chapter4/3.mdx
+++ b/chapters/zh-TW/chapter4/3.mdx
@@ -456,10 +456,10 @@ ls
{#if fw === 'pt'}
```bash
-config.json pytorch_model.bin README.md sentencepiece.bpe.model special_tokens_map.json tokenizer_config.json tokenizer.json
+added_tokens.json config.json model.safetensors sentencepiece.bpe.model special_tokens_map.json tokenizer_config.json tokenizer.json
```
-If you look at the file sizes (for example, with `ls -lh`), you should see that the model state dict file (*pytorch_model.bin*) is the only outlier, at more than 400 MB.
+If you look at the file sizes (for example, with `ls -lh`), you should see that the model state dict file (*model.safetensors *) is the only outlier, at more than 400 MB.
{:else}
```bash
@@ -471,7 +471,7 @@ config.json README.md sentencepiece.bpe.model special_tokens_map.json tf_mod
{/if}
-✏️ 從 web 界面創建存儲庫時，*.gitattributes* 文件會自動設置為將具有某些擴展名的文件，例如 *.bin* 和 *.h5* 視為大文件，git-lfs 會對其進行跟蹤您無需進行必要的設置。
+✏️ 從 web 界面創建存儲庫時，*.gitattributes* 文件會自動設置為將具有某些擴展名的文件，例如 *.safetensors* 和 *.h5* 視為大文件，git-lfs 會對其進行跟蹤您無需進行必要的設置。
我們現在可以繼續進行，就像我們通常使用傳統 Git 存儲庫一樣。我們可以使用以下命令將所有文件添加到 Git 的暫存環境中 **git add** 命令：
@@ -494,12 +494,13 @@ Your branch is up to date with 'origin/main'.
Changes to be committed:
(use "git restore --staged ..." to unstage)
modified: .gitattributes
+ new file: added_tokens.json
new file: config.json
- new file: pytorch_model.bin
+ new file: model.safetensors
new file: sentencepiece.bpe.model
new file: special_tokens_map.json
- new file: tokenizer.json
new file: tokenizer_config.json
+ new file: tokenizer.json
```
{:else}
```bash
@@ -532,12 +533,13 @@ Objects to be pushed to origin/main:
Objects to be committed:
- config.json (Git: bc20ff2)
- pytorch_model.bin (LFS: 35686c2)
+ added_tokens.json (Git: 43734cd)
+ config.json (Git: acfd093)
+ model.safetensors (LFS: 2785d2e)
sentencepiece.bpe.model (LFS: 988bc5a)
- special_tokens_map.json (Git: cb23931)
- tokenizer.json (Git: 851ff3e)
- tokenizer_config.json (Git: f0f7783)
+ special_tokens_map.json (Git: b547935)
+ tokenizer.json (Git: 18d0f7a)
+ tokenizer_config.json (Git: c49982e)
Objects not staged for commit:
@@ -578,11 +580,11 @@ git commit -m "First model version"
{#if fw === 'pt'}
```bash
-[main b08aab1] First model version
- 7 files changed, 29027 insertions(+)
- 6 files changed, 36 insertions(+)
+[main c2ec5c9] First model version
+ 7 files changed, 128351 insertions(+)
+ create mode 100644 added_tokens.json
create mode 100644 config.json
- create mode 100644 pytorch_model.bin
+ create mode 100644 model.safetensors
create mode 100644 sentencepiece.bpe.model
create mode 100644 special_tokens_map.json
create mode 100644 tokenizer.json
@@ -608,15 +610,15 @@ git push
```
```bash
-Uploading LFS objects: 100% (1/1), 433 MB | 1.3 MB/s, done.
-Enumerating objects: 11, done.
-Counting objects: 100% (11/11), done.
-Delta compression using up to 12 threads
-Compressing objects: 100% (9/9), done.
-Writing objects: 100% (9/9), 288.27 KiB | 6.27 MiB/s, done.
-Total 9 (delta 1), reused 0 (delta 0), pack-reused 0
+Uploading LFS objects: 100% (2/2), 444 MB | 86 MB/s, done.
+Enumerating objects: 10, done.
+Counting objects: 100% (10/10), done.
+Delta compression using up to 2 threads
+Compressing objects: 100% (8/8), done.
+Writing objects: 100% (9/9), 592.02 KiB | 6.30 MiB/s, done.
+Total 9 (delta 0), reused 0 (delta 0), pack-reused 0
To https://huggingface.co/lysandre/dummy
- 891b41d..b08aab1 main -> main
+ 70fd9db..c2ec5c9 main -> main
```
{#if fw === 'pt'}