Kernels:

---

webgpu-kernels

/

ai.onnx.RNN

Like 0

Follow

WebGPU Kernels Community 43

---
library_name: kernels
license: apache-2.0
tags:
- kernel
- webgpu
- wgsl
---
# ai.onnx.RNN

`ai.onnx`  ·  standard ONNX operator  ·  ONNX opset ≥ 22

## Description

Computes a one-layer simple RNN, updating the hidden state each time step as `Ht = f(Xt*(Wi^T) + Ht-1*(Ri^T) + Wbi + Rbi)` where `f` defaults to `Tanh`. Supports `forward`, `reverse`, and `bidirectional` traversal; optional `clip` bounds pre-activation inputs to `[-clip, +clip]`.

See the [ONNX `RNN` spec](https://onnx.ai/onnx/operators/onnx__RNN.html) for the reference semantics.

## Inputs

| Name | Upstream name | Logical dtype | Rank | Shape | Description | Presence |
| --- | --- | --- | --- | --- | --- | --- |
| `x` | `X` | `T` | `3` | — | Input sequences with shape `[seq_length, batch_size, input_size]` when `layout=0`, or `[batch_size, seq_length, input_size]` when `layout=1`. | required |
| `w` | `W` | `T` | `3` | — | Weight tensor for the input gate, shape `[num_directions, hidden_size, input_size]`. | required |
| `r` | `R` | `T` | `3` | — | Recurrence weight tensor, shape `[num_directions, hidden_size, hidden_size]`. | required |
| `b` | `B` | `T` | `2` | — | Bias tensor concatenating input and recurrence biases, shape `[num_directions, 2*hidden_size]`. ONNX defines an omitted bias as zero; this package requires an explicit tensor, which may be zero-filled to represent omission. | required |
| `sequence_lens` | — | `int32` | `1` | — | Per-batch sequence lengths of shape `[batch_size]`; all sequences are treated as full length if absent. | optional |
| `initial_h` | — | `T` | `3` | — | Initial hidden state with shape `[num_directions, batch_size, hidden_size]` when `layout=0`, or `[batch_size, num_directions, hidden_size]` when `layout=1`; assumed zero if absent. | optional |

## Outputs

| Name | Upstream name | Logical dtype | Rank | Shape | Description | Presence |
| --- | --- | --- | --- | --- | --- | --- |
| `y` | `Y` | `T` | `4` | derived | All intermediate hidden outputs, with shape `[seq_length, num_directions, batch_size, hidden_size]` when `layout=0`, or `[batch_size, seq_length, num_directions, hidden_size]` when `layout=1`. | required |
| `y_h` | `Y_h` | `T` | `3` | derived | Final hidden state with shape `[num_directions, batch_size, hidden_size]` when `layout=0`, or `[batch_size, num_directions, hidden_size]` when `layout=1`. | required |

## Attributes

Attributes and default values (overridable per request):

| Attribute | Default | Description |
| --- | --- | --- |
| `activation_alpha` | — | Optional alpha parameters for activation functions that use them, consumed in activation order; omitted entries use each activation's standard default. |
| `activation_beta` | — | Optional beta parameters for activation functions that use them, consumed in activation order; omitted entries use each activation's standard default. |
| `activations` | `["Tanh","Tanh"]` | Activation function for each direction. ONNX defaults both directions to `Tanh`; `forward` and `reverse` use the first entry, while `bidirectional` execution uses both entries. |
| `clip` | — | Optional non-negative threshold applied to pre-activation values as `[-clip, +clip]`; omission disables clipping, while an explicit `0` clamps them to zero. |
| `direction` | `"forward"` | Traversal direction: `"forward"`, `"reverse"`, or `"bidirectional"`. |
| `hidden_size` | — | Optional number of neurons in the hidden layer; when omitted, it is inferred from the W and R tensor shapes. |
| `layout` | `0` | Shape format for `X`, `initial_h`, `Y`, and `Y_h`: `0` puts `seq_length` first; `1` puts `batch_size` first. |

## Type constraints

| Variable | Allowed dtypes |
| --- | --- |
| `T` | `float32` |

## Files

- [`metadata.json`](build/webgpu/metadata.json) — kernel metadata (id, digests, per-variant templates, provenance)
- [`manifest.json`](build/webgpu/manifest.json) — the op contract (source of truth)
- [`test.json`](build/webgpu/test.json) — correctness cases
- [`bench.json`](build/webgpu/bench.json) — benchmark cases
- [`datamove-transpose-2d-tiled.wgsl.jinja`](build/webgpu/datamove-transpose-2d-tiled.wgsl.jinja)
- [`dense-tiled-matmul.wgsl.jinja`](build/webgpu/dense-tiled-matmul.wgsl.jinja)
- [`rnn-general.wgsl.jinja`](build/webgpu/rnn-general.wgsl.jinja)
- [`rnn-input-proj.wgsl.jinja`](build/webgpu/rnn-input-proj.wgsl.jinja)
- [`rnn-parallel-global.wgsl.jinja`](build/webgpu/rnn-parallel-global.wgsl.jinja)
- [`rnn-parallel.wgsl.jinja`](build/webgpu/rnn-parallel.wgsl.jinja)
- [`rnn-recur-step.wgsl.jinja`](build/webgpu/rnn-recur-step.wgsl.jinja)
- [`rnn-recur-subgroup-step.wgsl.jinja`](build/webgpu/rnn-recur-subgroup-step.wgsl.jinja)
- [`rnn-sequence-mask.wgsl.jinja`](build/webgpu/rnn-sequence-mask.wgsl.jinja)

## Use with `@huggingface/kernels`

```sh
npm install --save-exact @huggingface/kernels@0.0.1-preview.3
```

Required output shapes and logical data types are inferred from the supplied inputs and attributes; result tensors are allocated automatically.

The `version: 1` option selects the published kernel contract; it is independent of any operator opset, contrib `since_version`, or model version.
It follows the `v1` branch as fixes land. To pin exact artifact bytes, pass a 40-character commit `revision` instead of `version`.

Replace each `*Data` placeholder with a typed array containing the corresponding input data.

```js
import { getKernel } from "@huggingface/kernels";

const kernel = await getKernel("webgpu-kernels/ai.onnx.RNN", { version: 1 });
const { y, y_h } = await kernel({
  x: { data: xData, shape: [1, 1, 1] },
  w: { data: wData, shape: [1, 1, 1] },
  r: { data: rData, shape: [1, 1, 1] },
  b: { data: bData, shape: [1, 2] },
});
```