8000 Release Version 2.12.1 · lwtnn/lwtnn · GitHub
[go: up one dir, main page]
More Web Proxy on the site http://driver.im/
Skip to content

Version 2.12.1

Compare
Choose a tag to compare
@dguest dguest released this 08 Jul 11:15
· 22 commits to master since this release

This is a bugfix release. It should resolve some issues some people saw where the sigmoid activation function would throw floating point overflow warnings.

To avoid the FPEs we return 0 when the sigmoid input is less than -30, and 1 when the input is greater than 30. This is the same behavior we had prior to e3622dd. The outputs should be unchanged to O(1e-6), if they change at all.

0