Skip to content

[hybrid] Support tensor parallel and cache structure for fused attention op.#40101

Merged
wangxicoding merged 10 commits intoPaddlePaddle:developfrom FeixLiu:update_fused_attention_op_with_distMar 11, 2022

Commits

Commits on Mar 9, 2022

Commits on Mar 10, 2022

Commits on Mar 11, 2022