Add DeepSpeed ZeRO-3 integration
This commit is contained in:
parent
d4a0b377ab
commit
a97afa6965
4 changed files with 130 additions and 5 deletions
7
.gitignore
vendored
Normal file
7
.gitignore
vendored
Normal file
|
|
@ -0,0 +1,7 @@
|
|||
__pycache__/
|
||||
!models/place-your-models-here.txt
|
||||
models/*
|
||||
!torch-dumps/place-your-models-here.txt
|
||||
torch-dumps/*
|
||||
cache/
|
||||
logs/
|
||||
Loading…
Add table
Add a link
Reference in a new issue