Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Fixed errors by upper-case of model name, and changed the description #82

Merged
merged 85 commits into from
Aug 29, 2022
Merged

Fixed errors by upper-case of model name, and changed the description #82

Changes from 1 commit
Commits
Show all changes
85 commits
Select commit Hold shift + click to select a range
83fceae
saved workd
Anhforth Jun 29, 2022
f113f7c
saved workd
Anhforth Jun 29, 2022
708ce15
saved work on 6.29
Anhforth Jun 30, 2022
0d1b079
transformed tokenizer: progressing
Anhforth Jul 1, 2022
2763b5d
Opt 30b (#16)
920232796 Jul 1, 2022
3e52907
fix bert tokenizer issue (#18)
Anhforth Jul 1, 2022
deb2612
reconstruct the tokenizer structure
ZhaodongYan1 Jul 3, 2022
c2c6e9d
tested the new tokenizer
Anhforth Jul 4, 2022
fc2b5d8
removed some redundant codes and added sp model
Anhforth Jul 4, 2022
7da1757
updated the tokenizer
ZhaodongYan1 Jul 4, 2022
7c8c0b1
saved work
Anhforth Jul 5, 2022
3a0c8cb
Opt 66b (#19)
920232796 Jul 6, 2022
265d35a
saved work on 7.6
Anhforth Jul 6, 2022
4f8d715
updated release version
Anhforth Jul 6, 2022
efc1310
fix tokenizer issue
Anhforth Jul 6, 2022
59531e7
temp save
Anhforth Jul 6, 2022
3b6c16a
tokenizer test passed
Anhforth Jul 6, 2022
a7ff8f3
fixed some errors
Anhforth Jul 7, 2022
f4ff1a8
test of tokenizer transform
Anhforth Jul 7, 2022
811d9e9
fixed conflicts
Anhforth Jul 7, 2022
1406d89
fixed error
Anhforth Jul 7, 2022
b30eefa
add encode_plus
Anhforth Jul 8, 2022
9b81869
fix bug multi_gpu_training
920232796 Jul 8, 2022
7ad38a0
Merge pull request #21 from baai-open-internal/fix_multi_gpu_training
Anhforth Jul 8, 2022
72ffd6a
changed the version
Anhforth Jul 8, 2022
e6f89a6
fix_validation_bug (#24)
920232796 Jul 11, 2022
29ea850
updated the version
Anhforth Jul 11, 2022
4c68936
updated
Anhforth Jul 15, 2022
4834f23
modified encoder_plus
Anhforth Jul 15, 2022
8d44329
add vit and examples
920232796 Jul 15, 2022
81c438d
vit and examples
920232796 Jul 15, 2022
da24628
Update base_model.py
marscrazy Jul 15, 2022
aff728b
Update vit.py
marscrazy Jul 15, 2022
e5a0ddb
modify readme.md
920232796 Jul 15, 2022
fe56b8b
modify readme.md
920232796 Jul 15, 2022
fc6c32e
delete annotating code
920232796 Jul 15, 2022
cd45e5c
Vit xzh (#25)
920232796 Jul 15, 2022
5448084
updated
Anhforth Jul 17, 2022
eb555fc
updated
Anhforth Jul 17, 2022
9649aa4
performing tests on examples
Anhforth Jul 17, 2022
67c1288
finished example testing
Anhforth Jul 18, 2022
faee281
Merge branch 'develop' into vit_xzh
BAAI-OpenPlatform Jul 19, 2022
06f0b69
Merge pull request #28 from baai-open-internal/vit_xzh
BAAI-OpenPlatform Jul 19, 2022
deaa120
Merge pull request #27 from baai-open-internal/develop
marscrazy Jul 20, 2022
9558a47
env trainer
920232796 Jul 20, 2022
c35d4b6
Merge pull request #29 from baai-open-internal/env_args
marscrazy Jul 20, 2022
437caa4
vit-checkpoint-activations
920232796 Jul 21, 2022
dc6fc3d
vit-checkpoint-activations
920232796 Jul 21, 2022
c1cec9f
Merge pull request #33 from baai-open-internal/vit-checkpointing-acti…
marscrazy Jul 21, 2022
d74cf92
update
jongjyh Jul 25, 2022
044bc80
Merge pull request #34 from baai-open-internal/fix_eval_loss
marscrazy Jul 25, 2022
d85f8af
merged the master
Anhforth Jul 26, 2022
1b5ecc6
inference and train
wchh-2000 Jul 29, 2022
1fe6d3e
fix bug bert model
xuanricheng Aug 5, 2022
0c243d6
add autoloader and example training data
wchh-2000 Aug 15, 2022
2c28a7d
updated seq2seq
shunxing1234 Aug 16, 2022
e03247e
update
wchh-2000 Aug 16, 2022
4a4b003
Merge pull request #52 from baai-open-internal/add_clip
marscrazy Aug 17, 2022
ce5fd31
Merge branch 'master' into transform_tokenizer
Anhforth Aug 18, 2022
8353cd3
Update train.py
marscrazy Aug 18, 2022
5d5e135
Delete tst_superglue.py
marscrazy Aug 18, 2022
4c6ba56
updated according to comments
BAAI-OpenPlatform Aug 19, 2022
6076287
Merge pull request #50 from baai-open-internal/bert_model
BAAI-OpenPlatform Aug 19, 2022
c11e232
merged the clip tokenizer
BAAI-OpenPlatform Aug 22, 2022
6e135ef
merged clip tokenizer
BAAI-OpenPlatform Aug 23, 2022
fd06e4d
Update inference_clip.py
marscrazy Aug 25, 2022
b61b708
Update auto_loader.py
marscrazy Aug 25, 2022
25b659b
Update glm_10b_en_tokenizer.py
marscrazy Aug 25, 2022
8cffa38
Merge pull request #20 from baai-open-internal/transform_tokenizer
marscrazy Aug 25, 2022
9117f78
swinv1v2
920232796 Aug 25, 2022
f3186d9
Merge pull request #58 from baai-open-internal/swinv1v2_checkpoint_ac…
marscrazy Aug 25, 2022
4bd211d
updated the version
Anhforth Aug 25, 2022
6ef4190
updated the requirement packages list
Anhforth Aug 25, 2022
036e337
fixed some issues
BAAI-OpenPlatform Aug 26, 2022
edfd518
fixed some issues
BAAI-OpenPlatform Aug 26, 2022
497d709
tried to fix the data directory not found error
BAAI-OpenPlatform Aug 26, 2022
1ac43c0
fixed issues in running glm_seq2seq
BAAI-OpenPlatform Aug 26, 2022
351fba7
Update test_glm_seq2seq.py
marscrazy Aug 26, 2022
35b5d9a
Merge pull request #59 from baai-open-internal/fix_issues
marscrazy Aug 26, 2022
b5a14ed
fix glm tokenizer bug
920232796 Aug 29, 2022
9f786e0
fix a glm tokenizer bug
920232796 Aug 29, 2022
18c95e2
Update tokenizer.py
marscrazy Aug 29, 2022
56c081f
Merge branch 'master' into fix_glm_tokenizer
marscrazy Aug 29, 2022
c3c3569
Merge pull request #60 from baai-open-internal/fix_glm_tokenizer
marscrazy Aug 29, 2022
1c28821
merged upstream
Anhforth Aug 29, 2022
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
tried to fix the data directory not found error 
Signed-off-by: BAAI-OpenPlatform <[email protected]>
  • Loading branch information
@BAAI-OpenPlatform
BAAI-OpenPlatform committed Aug 26, 2022
commit 497d709ea5c1d566a011869ddd61f87794e8b08f
4 changes: 2 additions & 2 deletions tests/test_glm_seq2seq.py
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -36,11 +36,11 @@ def test_init_trainer_pytorch(self):
tokenizer = Tokenizer.from_pretrained(model_name)

train_dataset = Seq2SeqDataset(task_name=task_name,
data_dir='./data/cmrc/',
data_dir='../data/cmrc/',
dataset_type='train',
tokenizer=tokenizer)
valid_dataset = Seq2SeqDataset(task_name=task_name,
data_dir='./data/cmrc/',
data_dir='../data/cmrc/',
dataset_type='dev',
tokenizer=tokenizer)

Expand Down