mv deepspeed flash-attn to FT

Author: 545999961

examples/README.md

@@ -69,6 +69,11 @@ print(scores)
 
 We support fine-tuning a variety of BGE series models, including `bge-large-en-v1.5`, `bge-m3`, `bge-en-icl`, `bge-multilingual-gemma2`, `bge-reranker-v2-m3`, `bge-reranker-v2-gemma`, and `bge-reranker-v2-minicpm-layerwise`, among others. As examples, we use the basic models `bge-large-en-v1.5` and `bge-reranker-large`. For more details, please refer to the [embedder](https://github.com/FlagOpen/FlagEmbedding/tree/master/examples/finetune/embedder) and [reranker](https://github.com/FlagOpen/FlagEmbedding/tree/master/examples/finetune/reranker) sections.
 
+```shell
+pip install deepspeed
+pip install flash-attn --no-build-isolation
+```
+
 ## 1. Embedder
 
 ```shell

examples/finetune/embedder/README.md

@@ -8,6 +8,8 @@ In this example, we show how to finetune the embedder with your data.
 
 ```shell
 pip install -U FlagEmbedding
+pip install deepspeed
+pip install flash-attn --no-build-isolation
 ```
 
 - **from source**
@@ -16,12 +18,16 @@ pip install -U FlagEmbedding
 git clone https://github.com/FlagOpen/FlagEmbedding.git
 cd FlagEmbedding
 pip install  .
+pip install deepspeed
+pip install flash-attn --no-build-isolation
 ```
 
 For development, install as editable:
 
 ```shell
 pip install -e .
+pip install deepspeed
+pip install flash-attn --no-build-isolation
 ```
 
 ## 2. Data format

examples/finetune/reranker/README.md

@@ -8,6 +8,8 @@ In this example, we show how to finetune the reranker with your data.
 
 ```shell
 pip install -U FlagEmbedding
+pip install deepspeed
+pip install flash-attn --no-build-isolation
 ```
 
 - **from source**
@@ -16,12 +18,16 @@ pip install -U FlagEmbedding
 git clone https://github.com/FlagOpen/FlagEmbedding.git
 cd FlagEmbedding
 pip install  .
+pip install deepspeed
+pip install flash-attn --no-build-isolation
 ```
 
 For development, install as editable:
 
 ```shell
 pip install -e .
+pip install deepspeed
+pip install flash-attn --no-build-isolation
 ```
 
 ## 2. Data format

setup.py

@@ -20,8 +20,6 @@
         'accelerate>=0.20.1',
         'sentence_transformers',
         'peft',
-        'deepspeed',
-        'flash-attn==2.5.6',
         'ir-datasets',
         'sentencepiece',
         'protobuf'