New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[GCU] Support gcu engine #1562

Open

EnflameGCU wants to merge 2 commits into PaddlePaddle:develop from EnflameGCU:for_custom_engine

+2,288 −48

Contributor

EnflameGCU commented Jan 21, 2025

Plugin接入GCU的子图编译加速方案

基础功能

PIR体系及OP管理的验证
paddle主仓与custom device子仓之间功能配合方面

图转换（圈图/切图/lowering）

gcu_engine_op
gcu_translate_pass（包含：圈图、切图、CustomEngineOp convert）
lower_pass

子图编译结果管理

GCUEngine实现

CustomEngineInstruction 子图编译

子图的 IR 转换、子图的编译、二进制可执行文件的管理等

CustomEngineInstruction 子图执行

底层的launch过程，包括内存管理、流管理等

整网功能

demo验证

EnflameGCU force-pushed the for_custom_engine branch from bcf5f87 to 6db9d1d Compare

January 21, 2025 07:42

EnflameGCU added 2 commits

January 21, 2025 11:19


          [GCU] Support gcu engine

f29906a


          [GCU] Demo for gcu engine

f87829a

EnflameGCU force-pushed the for_custom_engine branch from 807b397 to f87829a Compare

January 21, 2025 11:20

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet