QuantizedMatMulWithBias

public final class QuantizedMatMulWithBias

Performs a quantized matrix multiplication of `a` by the matrix `b` with bias add.

The inputs must be two-dimensional matrices and 1D bias vector. And the inner dimension of `a` (after being transposed if `transpose_a` is non-zero) must match the outer dimension of `b` (after being transposed if `transposed_b` is non-zero). Then do broadcast add operation with bias values on the matrix multiplication result. The bias size must match inner dimension of `b`.

Nested Classes

class QuantizedMatMulWithBias.Options Optional attributes for QuantizedMatMulWithBias  

Constants

String OP_NAME The name of this op, as known by TensorFlow core engine

Public Methods

static <W extends TType> QuantizedMatMulWithBias<W>
create(Scope scope, Operand<? extends TType> a, Operand<? extends TType> b, Operand<? extends TType> bias, Operand<TFloat32> minA, Operand<TFloat32> maxA, Operand<TFloat32> minB, Operand<TFloat32> maxB, Class<W> Toutput, Options... options)
Factory method to create a class wrapping a new QuantizedMatMulWithBias operation.
static QuantizedMatMulWithBias.Options
inputQuantMode(String inputQuantMode)
Output<TFloat32>
maxOut()
The float value that the highest quantized output value represents.
Output<TFloat32>
minOut()
The float value that the lowest quantized output value represents.
Output<W>
out()
static QuantizedMatMulWithBias.Options
transposeA(Boolean transposeA)
static QuantizedMatMulWithBias.Options
transposeB(Boolean transposeB)

Inherited Methods

org.tensorflow.op.RawOp
final boolean
equals(Object obj)
final int
hashCode()
Operation
op()
Return this unit of computation as a single Operation.
final String
toString()
boolean
equals(Object arg0)
final Class<?>
getClass()
int
hashCode()
final void
notify()
final void
notifyAll()
String
toString()
final void
wait(long arg0, int arg1)
final void
wait(long arg0)
final void
wait()
org.tensorflow.op.Op
abstract ExecutionEnvironment
env()
Return the execution environment this op was created in.
abstract Operation
op()
Return this unit of computation as a single Operation.

Constants

public static final String OP_NAME

The name of this op, as known by TensorFlow core engine

Constant Value: "QuantizedMatMulWithBias"

Public Methods

public static QuantizedMatMulWithBias<W> create (Scope scope, Operand<? extends TType> a, Operand<? extends TType> b, Operand<? extends TType> bias, Operand<TFloat32> minA, Operand<TFloat32> maxA, Operand<TFloat32> minB, Operand<TFloat32> maxB, Class<W> Toutput, Options... options)

Factory method to create a class wrapping a new QuantizedMatMulWithBias operation.

Parameters
scope current scope
a A matrix to be multiplied. Must be a two-dimensional tensor of type `quint8`.
b A matrix to be multiplied and must be a two-dimensional tensor of type `qint8`.
bias A 1D bias tensor with size matching inner dimension of `b` (after being transposed if `transposed_b` is non-zero).
minA The float value that the lowest quantized `a` value represents.
maxA The float value that the highest quantized `a` value represents.
minB The float value that the lowest quantized `b` value represents.
maxB The float value that the highest quantized `b` value represents.
options carries optional attributes values
Returns
  • a new instance of QuantizedMatMulWithBias

public static QuantizedMatMulWithBias.Options inputQuantMode (String inputQuantMode)

Parameters
inputQuantMode Input data quantization mode. Either MIN_FIRST(default) or SCALED.

public Output<TFloat32> maxOut ()

The float value that the highest quantized output value represents.

public Output<TFloat32> minOut ()

The float value that the lowest quantized output value represents.

public Output<W> out ()

public static QuantizedMatMulWithBias.Options transposeA (Boolean transposeA)

Parameters
transposeA If true, `a` is transposed before multiplication.

public static QuantizedMatMulWithBias.Options transposeB (Boolean transposeB)

Parameters
transposeB If true, `b` is transposed before multiplication.