Langchain-Chatchat安装部署教程

 1
 2
 3
 4
 5
 6
 7
 8
 9
10
11
12
13
14
15

conda create -n Langchain-Chatchat  python=3.11.7
conda activate Langchain-Chatchat 
pushd  D:\Software\AI\Langchain-Chatchat

# 拉取仓库
$ git clone https://github.com/chatchat-space/Langchain-Chatchat.git

# 进入目录
$ cd Langchain-Chatchat

# 安装全部依赖
$ pip install -r requirements.txt 
$ pip install -r requirements_api.txt
$ pip install -r requirements_webui.txt  
# 默认依赖包括基本运行环境（FAISS向量库）。如果要使用 milvus/pg_vector 等向量库，请将 requirements.txt 中相应依赖取消注释再安装。

1
2
3

$ git lfs install  
$ git clone https://huggingface.co/THUDM/chatglm3-6b
$ git clone https://huggingface.co/BAAI/bge-large-zh

1
2

$ python copy_config_example.py
$ python init_database.py --recreate-vs

1

$ python startup.py -a

 1
 2
 3
 4
 5
 6
 7
 8
 9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41

PS E:\PyCharm2019\Langchain-Chatchat> python init_database.py --recreate-vs
recreating all vector stores
2023-12-05 23:49:57,505 - faiss_cache.py[line:80] - INFO: loading vector store in 'samples/vector_store/bge-large-zh' from disk.
2023-12-05 23:49:58,128 - SentenceTransformer.py[line:66] - INFO: Load pretrained SentenceTransformer: BAAI/bge-large-zh
2023-12-05 23:50:01,397 - embeddings_api.py[line:39] - ERROR: (MaxRetryError("HTTPSConnectionPool(host='huggingface.co', port=443): Max retries exceeded with url: /api/models/BAAI/bge-large-zh (Caused by SSLError(SSLEOFError(8, 'EOF
occurred in violation of protocol (_ssl.c:1002)')))"), '(Request ID: 768f0d91-383d-4f69-bfb6-1e49fa0801d7)')
AttributeError: 'NoneType' object has no attribute 'conjugate'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
File "E:\PyCharm2019\Langchain-Chatchat\init_database.py", line 108, in
folder2db(kb_names=args.kb_name, mode="recreate_vs", embed_model=args.embed_model)
File "E:\PyCharm2019\Langchain-Chatchat\server\knowledge_base\migrate.py", line 121, in folder2db
kb.create_kb()
File "E:\PyCharm2019\Langchain-Chatchat\server\knowledge_base\kb_service\base.py", line 81, in create_kb
self.do_create_kb()
File "E:\PyCharm2019\Langchain-Chatchat\server\knowledge_base\kb_service\faiss_kb_service.py", line 47, in do_create_kb
self.load_vector_store()
File "E:\PyCharm2019\Langchain-Chatchat\server\knowledge_base\kb_service\faiss_kb_service.py", line 28, in load_vector_store
return kb_faiss_pool.load_vector_store(kb_name=self.kb_name,
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "E:\PyCharm2019\Langchain-Chatchat\server\knowledge_base\kb_cache\faiss_cache.py", line 90, in load_vector_store
vector_store = self.new_vector_store(embed_model=embed_model, embed_device=embed_device)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "E:\PyCharm2019\Langchain-Chatchat\server\knowledge_base\kb_cache\faiss_cache.py", line 48, in new_vector_store
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Python311\Lib\site-packages\langchain\vectorstores\faiss.py", line 911, in from_texts
embeddings = embedding.embed_documents(texts)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "E:\PyCharm2019\Langchain-Chatchat\server\knowledge_base\kb_service\base.py", line 399, in embed_documents
return normalize(embeddings).tolist()
^^^^^^^^^^^^^^^^^^^^^
File "E:\PyCharm2019\Langchain-Chatchat\server\knowledge_base\kb_service\base.py", line 38, in normalize
norm = np.linalg.norm(embeddings, axis=1)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "<array_function internals>", line 200, in norm
File "C:\Python311\Lib\site-packages\numpy\linalg\linalg.py", line 2541, in norm
s = (x.conj() * x).real
^^^^^^^^
TypeError: loop of ufunc does not support argument 0 of type NoneType which has no callable conjugate method

 1
 2
 3
 4
 5
 6
 7
 8
 9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38

 Process model_worker - chatglm3-6b:
2024-02-04 11:24:09 | ERROR | stderr | Traceback (most recent call last):
2024-02-04 11:24:09 | ERROR | stderr |   File "D:\Software\miniconda3\envs\Langchain-Chatchat\Lib\multiprocessing\process.py", line 314, in _bootstrap
2024-02-04 11:24:09 | ERROR | stderr |     self.run()
2024-02-04 11:24:09 | ERROR | stderr |   File "D:\Software\miniconda3\envs\Langchain-Chatchat\Lib\multiprocessing\process.py", line 108, in run
2024-02-04 11:24:09 | ERROR | stderr |     self._target(*self._args, **self._kwargs)
2024-02-04 11:24:09 | ERROR | stderr |   File "D:\Software\AI\Langchain-Chatchat\startup.py", line 389, in run_model_worker
2024-02-04 11:24:09 | ERROR | stderr |     app = create_model_worker_app(log_level=log_level, **kwargs)
2024-02-04 11:24:09 | ERROR | stderr |           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2024-02-04 11:24:09 | ERROR | stderr |   File "D:\Software\AI\Langchain-Chatchat\startup.py", line 217, in create_model_worker_app
2024-02-04 11:24:09 | ERROR | stderr |     worker = ModelWorker(
2024-02-04 11:24:09 | ERROR | stderr |              ^^^^^^^^^^^^
2024-02-04 11:24:09 | ERROR | stderr |   File "D:\Software\miniconda3\envs\Langchain-Chatchat\Lib\site-packages\fastchat\serve\model_worker.py", line 77, in __init__
2024-02-04 11:24:09 | ERROR | stderr |     self.model, self.tokenizer = load_model(
2024-02-04 11:24:09 | ERROR | stderr |                                  ^^^^^^^^^^^
2024-02-04 11:24:09 | ERROR | stderr |   File "D:\Software\miniconda3\envs\Langchain-Chatchat\Lib\site-packages\fastchat\model\model_adapter.py", line 362, in load_model
2024-02-04 11:24:09 | ERROR | stderr |     model.to(device)
2024-02-04 11:24:09 | ERROR | stderr |   File "D:\Software\miniconda3\envs\Langchain-Chatchat\Lib\site-packages\transformers\modeling_utils.py", line 2460, in to
2024-02-04 11:24:09 | ERROR | stderr |     return super().to(*args, **kwargs)
2024-02-04 11:24:09 | ERROR | stderr |            ^^^^^^^^^^^^^^^^^^^^^^^^^^^
2024-02-04 11:24:09 | ERROR | stderr |   File "D:\Software\miniconda3\envs\Langchain-Chatchat\Lib\site-packages\torch\nn\modules\module.py", line 1160, in to
2024-02-04 11:24:09 | ERROR | stderr |     return self._apply(convert)
2024-02-04 11:24:09 | ERROR | stderr |            ^^^^^^^^^^^^^^^^^^^^
2024-02-04 11:24:09 | ERROR | stderr |   File "D:\Software\miniconda3\envs\Langchain-Chatchat\Lib\site-packages\torch\nn\modules\module.py", line 810, in _apply
2024-02-04 11:24:09 | ERROR | stderr |     module._apply(fn)
2024-02-04 11:24:09 | ERROR | stderr |   File "D:\Software\miniconda3\envs\Langchain-Chatchat\Lib\site-packages\torch\nn\modules\module.py", line 810, in _apply
2024-02-04 11:24:09 | ERROR | stderr |     module._apply(fn)
2024-02-04 11:24:09 | ERROR | stderr |   File "D:\Software\miniconda3\envs\Langchain-Chatchat\Lib\site-packages\torch\nn\modules\module.py", line 810, in _apply
2024-02-04 11:24:09 | ERROR | stderr |     module._apply(fn)
2024-02-04 11:24:09 | ERROR | stderr |   File "D:\Software\miniconda3\envs\Langchain-Chatchat\Lib\site-packages\torch\nn\modules\module.py", line 833, in _apply
2024-02-04 11:24:09 | ERROR | stderr |     param_applied = fn(param)
2024-02-04 11:24:09 | ERROR | stderr |                     ^^^^^^^^^
2024-02-04 11:24:09 | ERROR | stderr |   File "D:\Software\miniconda3\envs\Langchain-Chatchat\Lib\site-packages\torch\nn\modules\module.py", line 1158, in convert
2024-02-04 11:24:09 | ERROR | stderr |     return t.to(device, dtype if t.is_floating_point() or t.is_complex() else None, non_blocking)
2024-02-04 11:24:09 | ERROR | stderr |            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2024-02-04 11:24:09 | ERROR | stderr |   File "D:\Software\miniconda3\envs\Langchain-Chatchat\Lib\site-packages\torch\cuda\__init__.py", line 289, in _lazy_init
2024-02-04 11:24:09 | ERROR | stderr |     raise AssertionError("Torch not compiled with CUDA enabled")
2024-02-04 11:24:09 | ERROR | stderr | AssertionError: Torch not compiled with CUDA enabled

 1
 2
 3
 4
 5
 6
 7
 8
 9
10
11
12
13
14
15
16
17
18
19
20
21
22
23

File "D:\Software\miniconda3\envs\Langchain-Chatchat\Lib\site-packages\torch\cuda\__init__.py", line 289, in _lazy_init

2024-02-04 17:30:38 | ERROR | stderr | raise AssertionError("Torch not compiled with CUDA enabled")

2024-02-04 17:30:38 | ERROR | stderr | AssertionError: Torch not compiled with CUDA enabled

pip list |findstr torch

torch 2.1.2

torchaudio 2.1.2

torchvision 0.16.2

(Langchain-Chatchat) D:\Software\AI\Langchain-Chatchat>nvidia-smi

Sun Feb 4 17:38:34 2024

+---------------------------------------------------------------------------------------+

| NVIDIA-SMI 531.41 Driver Version: 531.41 CUDA Version: 12.1 |

|-----------------------------------------+----------------------+----------------------+

 1
 2
 3
 4
 5
 6
 7
 8
 9
10
11

看下我们的 pytorch 是否支持使用 GPU

import torch
torch.__version__
print(torch.cuda.is_available())

查看 cuda 版本： nvcc –V

查看 cuDNN版本：
import torch
torch.backends.cudnn.version()

 1
 2
 3
 4
 5
 6
 7
 8
 9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31

(Langchain-Chatchat) D:\Software\AI\Langchain-Chatchat>pip install scipy

Requirement already satisfied: scipy in c:\users\administrator\appdata\roaming\python\python311\site-packages (1.11.4)

Requirement already satisfied: numpy<1.28.0,>=1.21.6 in d:\software\miniconda3\envs\langchain-chatchat\lib\site-packages (from scipy) (1.24.4)

(Langchain-Chatchat) D:\Software\AI\Langchain-Chatchat>python

Python 3.11.7 | packaged by conda-forge | (main, Dec 23 2023, 14:27:59) [MSC v.1937 64 bit (AMD64)] on win32

Type "help", "copyright", "credits" or "license" for more information.

>>> from scipy.sparse import issparse

Traceback (most recent call last):

File "<stdin>", line 1, in <module>

ModuleNotFoundError: No module named 'scipy'
 
根据错误信息,scipy包明明已经安装在Python的site-packages中,但是导入时还是提示没有该模块。

这种情况常见的原因是Python正在找错环境中的模块。

我的推测是您使用的是conda管理的Python环境,但是pip install scipy默认安装是在全局基础环境中,而不是conda env。

为了解决这个问题,有以下两种方法:

在当前conda env内使用conda安装scipy:
 
conda install scipy

 1
 2
 3
 4
 5
 6
 7
 8
 9
10

Linux and Windows
# ROCM 5.6 (Linux only)
pip install torch==2.1.2 torchvision==0.16.2 torchaudio==2.1.2 --index-url https://download.pytorch.org/whl/rocm5.6
# CUDA 11.8
pip install torch==2.1.2 torchvision==0.16.2 torchaudio==2.1.2 --index-url https://download.pytorch.org/whl/cu118
# CUDA 12.1
pip install torch==2.1.2 torchvision==0.16.2 torchaudio==2.1.2 --index-url https://download.pytorch.org/whl/cu121
# CPU only
pip install torch==2.1.2 torchvision==0.16.2 torchaudio==2.1.2 --index-url https://download.pytorch.org/whl/cpu
v2.1.1

 1
 2
 3
 4
 5
 6
 7
 8
 9
10
11

看下我们的 pytorch 是否支持使用 GPU

import torch
torch.__version__
print(torch.cuda.is_available())

查看 cuda 版本： nvcc –V

查看 cuDNN版本：
import torch
torch.backends.cudnn.version()