Skip to content

Commit aa7745c

Browse files
committed
update readme
1 parent 0247d32 commit aa7745c

5 files changed

Lines changed: 4 additions & 4 deletions

File tree

examples/finetune/reranker/README.md

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -201,7 +201,7 @@ torchrun --nproc_per_node 2 \
201201
--output_dir ./test_decoder_only_base_bge-reranker-v2-minicpm-layerwise \
202202
--overwrite_output_dir \
203203
--learning_rate 2e-4 \
204-
--fp16 \
204+
--bf16 \
205205
--num_train_epochs 1 \
206206
--per_device_train_batch_size 2 \
207207
--gradient_accumulation_steps 1 \
@@ -260,7 +260,7 @@ torchrun --nproc_per_node 2 \
260260
--output_dir ./test_decoder_only_base_bge-reranker-v2-minicpm-layerwise \
261261
--overwrite_output_dir \
262262
--learning_rate 2e-4 \
263-
--fp16 \
263+
--bf16 \
264264
--num_train_epochs 1 \
265265
--per_device_train_batch_size 2 \
266266
--gradient_accumulation_steps 1 \

examples/finetune/reranker/decoder_only/base.sh

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -46,7 +46,7 @@ training_args="\
4646
--output_dir ./test_decoder_only_base_bge-reranker-v2-gemma \
4747
--overwrite_output_dir \
4848
--learning_rate 2e-4 \
49-
--fp16 \
49+
--bf16 \
5050
--num_train_epochs $num_train_epochs \
5151
--per_device_train_batch_size $per_device_train_batch_size \
5252
--gradient_accumulation_steps $gradient_accumulation_steps \

examples/finetune/reranker/decoder_only/layerwise.sh

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -51,7 +51,7 @@ training_args="\
5151
--output_dir ./test_decoder_only_base_bge-reranker-v2-minicpm-layerwise \
5252
--overwrite_output_dir \
5353
--learning_rate 2e-4 \
54-
--fp16 \
54+
--bf16 \
5555
--num_train_epochs $num_train_epochs \
5656
--per_device_train_batch_size $per_device_train_batch_size \
5757
--gradient_accumulation_steps $gradient_accumulation_steps \

imgs/projects.png

-113 KB
Binary file not shown.

imgs/projects.png.png

260 KB
Loading

0 commit comments

Comments
 (0)