torch.nn.Hardshrink

CLASS torch.nn.Hardshrink(lambd=0.5)

参数

• lambd ([float]) – the $\lambda$ 默认为 0.5

定义
$$\text{HardShrink}(x)=\{\begin{array}{ll}x,& \text{ if }x>\lambda \\ x,& \text{ if }x<-\lambda \\ 0,& \text{ otherwise }\end{array}$$

图

代码

import torch
import torch.nn as nn

m = nn.Hardshrink()
input = torch.randn(2)
output = m(input)
print("input: ", input)  # input:  tensor([ 0.2078, -1.4333])
print("output: ", output)  # output:  tensor([ 0.0000, -1.4333])

【参考】

Hardshrink — PyTorch 1.13 documentation