May I ask where I can find an example of mixed precision training? I converted the feature array and label array to half precision, and set the data type to half precision in the network configuration, but it fails to compute the gradients correctly. When I set the data type to FLOAT, it prompts a precision mismatch exception.
@cqiaoYc unfortunately support for that will only be in my mid term rewrite that’s being worked of the internals.
That will be in the next release. That might be possible in cudnn somehow but I haven’t explored much on that.