Spaces:
Runtime error
Runtime error
Commit History
-
feat: reduce artifact space + offset step
34cf91c
-
feat: restore weights on CPU
5f954fc
-
fix: position embedding for generate method
ebac379
-
fix: typo
68cc185
-
fix: load from checkpoint
44b7c3e
-
feat(modeling): simplify abstract_init
fa72aa7
-
feat(train) - handle multiple nodes (#130)
Unverified signature0952927 -
feat: handle model parallel
1bb3269
-
fix: style
386f839
-
style(tokenizer): remove unused variables
605df32 -
feat: use fast tokenizer
767d78a
-
feat(train): improve pjit speed
f254058 -
fix(train): consider correct batch size
b7c7458
-
feat(train): distributed_shampoo with pjit
cc34d07
-
style: unsused import
7a176b9
-
feat(model): clean way to load on cpu
12f323d -
feat(train): no batch dimension with pjit
df1fe19 -
feat(train): progress on pjit
49597a2
-
feat: use_artifact if run existing
a5ed112 -
Load from wandb artifact (#121)
Unverified signatureLoad model & tokenizer from artifacts. Fixes #116f69b21b -
Style (isort).
Pedro Cuencaf9d51f7
-
Tokenizer, config, model can be loaded from wandb.
Pedro CuencaA mixin class is used to share the functionality.7e48337
-
feat(data): support accumulation in non-streaming
88c8e06 -
feat: custom gradient accumulation
2d07559
-
Change import order again.
Pedro CuencaMy version of `isort` has a different opinion than the one in the github action.2b2be9b -
Fix import order to make isort happy.
Pedro Cuenca64d99b2 -
Accept changes suggested by linter.
Pedro Cuenca9f522b8 -
Never consider local dirs as remote wandb references.
Pedro CuencaIn case the user provides a previously downloaded artifact directory.08dd098 -
Store resolved path after loading model.
Pedro CuencaThis should be useful to load additional artifacts such as the tokenizer, or the optimizer state. I couldn't find a better location to place this information.55a631d -
Override from_pretrained to support wandb artifacts.
Pedro Cuenca1023afa -
fix(data): no shuffling of validation data
ddcbc6a -
fix(train): handle seed_dataset
8b72ed8
-
feat: support pypi
f5dba1e