Skip to content

Commit 8ea3e68

Browse files
committed
Update ContribOperators.md
1 parent f4ad940 commit 8ea3e68

File tree

1 file changed

+2
-0
lines changed

1 file changed

+2
-0
lines changed

docs/ContribOperators.md

+2
Original file line numberDiff line numberDiff line change
@@ -155,6 +155,8 @@ This version of the operator has been available since version 1 of the 'com.micr
155155
<dd>Corresponding past and present are same tensor, its size is (2, batch_size, num_heads, max_sequence_length, head_size)</dd>
156156
<dt><tt>qkv_hidden_sizes</tt> : list of ints</dt>
157157
<dd>Hidden dimension of Q, K, V: hidden_size, hidden_size and v_hidden_size</dd>
158+
<dt><tt>rotary_embedding_dim</tt> : int</dt>
159+
<dd>Dimension of rotary embedding. Limited to 32, 64 or 128. Default value is head_size</dd>
158160
<dt><tt>scale</tt> : float</dt>
159161
<dd>Custom scale will be used if specified. Default value is 1/sqrt(head_size)</dd>
160162
<dt><tt>unidirectional</tt> : int</dt>

0 commit comments

Comments
 (0)