frozenleaves/kernels
1
0
Fork 0
mirror of https://github.com/huggingface/kernels.git synced 2025-10-20 20:56:31 +08:00
Code Issues Packages Projects Releases Wiki Activity

Merge pull request #3 from huggingface/improve_readme

Browse Source 
Improving README.
This commit is contained in:
Nicolas Patry
2025-01-13 18:15:29 +01:00
committed by GitHub
parent 69303b8ca5 f27bc2e5d1
commit 9446e355b4
1 changed files with 8 additions and 6 deletions
Download Patch File Download Diff File Expand all files Collapse all files

14
README.md
View File

@ -8,12 +8,14 @@ import torch
from kernels import get_kernel
# Download optimized kernels from the Hugging Face hub
layer_norm_kernels = get_kernel("kernels-community/layer-norm")
activation = get_kernel("kernels-community/activation")
# Initialize torch Module
optimized_layer_norm_layer = layer_norm_kernels.DropoutAddLayerNorm(128).cuda()
# Random tensor
x = torch.randn((10, 10), dtype=torch.float16, device="cuda")
# Forward
x = torch.randn(128).cuda()
print(optimized_layer_norm_layer(x))
# Run the kernel
y = torch.empty_like(x)
activation.gelu_fast(y, x)
print(y)
```