New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

AMP 支持哪些算子 #108

Open

zh794390558 opened this issue Mar 4, 2022 · 1 comment

zh794390558 commented Mar 4, 2022

AMP 支持哪些算子，不支持哪些算子，目前有什么限制？

Collaborator

GuoxiaWang commented Mar 4, 2022

@zh794390558 目前代码已经适配了，至于哪些算子不支持，我没有统计过，不过现在开源的 ires50跑的模型算子都支持的。

模型的训练包在了 with paddle.amp.auto_cast(enable=args.fp16): 语句中
https://github.com/PaddlePaddle/PLSC/blob/release/2.2/dynamic/train.py#L213-L215

因此不支持的会自动转成FP32计算

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment