使用配置文件运行时,如何指定并发任务量? #1889
Answered
by
tonysy
qing-yuan233
asked this question in
Q&A
使用配置文件运行时,如何指定并发任务量?
#1889
Replies: 1 comment
-
|
Beta Was this translation helpful? Give feedback.
0 replies
Answer selected by
qing-yuan233
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
例如,我本机有8张卡,在使用命令行进行启动时,可以通过设置
--hf-num-gpus 2
--max-num-workers 4
表示,每张模型使用两张卡加载,一共开4个任务/进程。
然而,我在使用配置文件时:
from opencompass.models import HuggingFaceCausalLM
models = [
dict(
...
run_cfg=dict(num_gpus=2, num_procs=4),
...
)
]
并不能生效。我应该如何设置?
Beta Was this translation helpful? Give feedback.
All reactions