Mandatory, Supported by Tizen Mobile emulator

MachineLearning API

Machine Learning features help you to handle Neural Network Frameworks (NNFWs), like TensorFlow and TensorFlow-Lite. The main features of the Machine Learning API include:

Single API: useful for a simple usage scenario of neural network models. It allows invoking a neural network model with a single instance of input data for the model directly. For more information, see ML Single API.
Pipeline API: useful for an advanced usage scenario of neural network models. It allows creating inference pipelines with multiple neural network models. For more information, see ML Pipeline API.

Since: 6.5

1. Type Definitions
- 1.1. TensorType
- 1.2. HWType
- 1.3. NNFWType
- 1.4. Bytes
2. Interfaces
- 2.1. MachineLearningManagerObject
- 2.2. MachineLearningManager
- 2.3. TensorRawData
- 2.4. TensorsData
- 2.5. TensorsInfo
3. Related Feature
4. Full WebIDL

Summary of Interfaces and Methods

Interface	Method
MachineLearningManagerObject
MachineLearningManager	boolean checkNNFWAvailability (NNFWType nnfw, HWType hw, optional DOMString customRequirement)
TensorRawData
TensorsData	TensorRawData getTensorRawData (long index, optional long[] location, optional long[] size) void setTensorRawData (long index, Bytes buffer, optional long[] location, optional long[] size) void dispose ()
TensorsInfo	long addTensorInfo (DOMString? name, TensorType type, long[] dimensions) TensorsInfo clone () boolean equals (TensorsInfo other) long[] getDimensions (long index) DOMString getTensorName (long index) TensorsData getTensorsData () long getTensorSize (long index) TensorType getTensorType (long index) void setDimensions (long index, long[] dimensions) void setTensorName (long index, DOMString name) void setTensorType (long index, TensorType type) void dispose ()

1. Type Definitions

1.1. TensorType

Specifies type of Tensor.

  enum TensorType { "INT8", "UINT8", "INT16", "UINT16", "FLOAT32", "INT32", "UINT32", "FLOAT64", "INT64", "UINT64", "UNKNOWN" };

Since: 6.5

INT8 - 8-bit integer.
UINT8 - 8-bit unsigned integer.
INT16 - 16-bit integer.
UINT16 - 16-bit unsigned integer.
FLOAT32 - 32-bit float.
INT32 - 32-bit integer.
UINT32 - 32-bit unsigned integer.
FLOAT64 - 64-bit float.
INT64 - 64-bit integer.
UINT64 - 64-bit unsigned integer.
UNKNOWN - Unknown type.

1.2. HWType

Specifies type of hardware resources to be used for NNFWs.

  enum HWType  { "ANY", "AUTO", "CPU", "CPU_NEON", "CPU_SIMD", "GPU", "NPU", "NPU_EDGE_TPU", "NPU_MOVIDIUS", "NPU_SLSI", "NPU_SR",
    "NPU_VIVANTE" };

Since: 6.5

Use checkNNFWAvailability() method to verify whether type is supported.

ANY - Hardware resource is not specified.
AUTO - Try to schedule and optimize if possible.
CPU - Any CPU if possible.
CPU_NEON - NEON in CPU.
CPU_SIMD - SIMD in CPU if possible.
GPU - Any GPU if possible.
NPU - Any NPU if possible.
NPU_EDGE_TPU - Google Coral Edge TPU (USB).
NPU_MOVIDIUS - Intel Movidius Stick.
NPU_SLSI - Samsung S.LSI.
NPU_SR - Any SR (Samsung Research) made NPU.
NPU_VIVANTE - VeriSilicon's Vivante.

1.3. NNFWType

Specifies type of Neural Network Framework.

  enum NNFWType { "ANY", "ARM_NN", "CUSTOM_FILTER", "EDGE_TPU", "MVNC", "NNFW", "NNTR_INF", "OPEN_VINO", "PYTORCH", "SNAP", "SNPE",
    "TRIX_ENGINE", "TENSORFLOW", "TENSORFLOW_LITE", "VD_AIFW", "VIVANTE" };

Since: 6.5

Use checkNNFWAvailability() method to verify whether type is supported.

ANY - NNFW is not specified (Try to determine the NNFW with file extension).
ARM_NN - Arm Neural Network framework (support for caffe and TensorFlow-lite).
CUSTOM_FILTER - Custom filter (Independent shared object).
EDGE_TPU - Google Coral Edge TPU (USB).
MVNC - Intel Movidius Neural Compute SDK (libmvnc).
NNFW - Neural Network Inference Framework, which is developed by Samsung Research.
NNTR_INF - Samsung Research On-device Training Framework (NNTrainer).
OPEN_VINO - Intel OpenVINO.
PYTORCH - PyTorch (.pt).
SNAP - Samsung Neural Acceleration Platform
SNPE - Qualcomm SNPE (Snapdragon Neural Processing Engine) (.dlc).
TRIX_ENGINE - TRIxENGINE which accesses TRIV/TRIA NPU low-level drivers directly (.tvn). In some commercial products with TRIx NPU series, the low-level drivers might be not available to applications. In such cases, high-level drivers that wrap the low-level drivers will be provided (e.g. VD-AIFW).
TENSORFLOW - TensorFlow (.pb).
TENSORFLOW_LITE - TensorFlow-lite (.tflite).
VD_AIFW - Inference framework for Samsung Tizen TV.
VIVANTE - VeriSilicon's Vivante.

1.4. Bytes

The Bytes type aggregates byte types in ML API and is used to pass binary data. It can be either a byte[] or a TypedArray.

  typedef (byte[] or TypedArray) Bytes;

Since: 6.5

2. Interfaces

2.1. MachineLearningManagerObject

The MachineLearningManagerObject interface defines what is instantiated by the Tizen object from the Tizen platform.

  [NoInterfaceObject] interface MachineLearningManagerObject {
    readonly attribute MachineLearningManager ml;
  };

  Tizen implements MachineLearningManagerObject;

Since: 6.5

The tizen.ml object allows access to the Machine Learning API.

Attributes

readonly MachineLearningManager ml
Object representing a machine learning manager.

Since: 6.5

2.2. MachineLearningManager

The MachineLearningManager entry interface provides methods to query the ML.

  [NoInterfaceObject] interface MachineLearningManager {
    readonly attribute MachineLearningSingle single;
    readonly attribute MachineLearningPipeline pipeline;
    boolean checkNNFWAvailability(NNFWType nnfw, HWType hw, optional DOMString customRequirement) raises(WebAPIException);
  };

Since: 6.5

Attributes

readonly MachineLearningSingle single
Provides methods for Machine Learning Single Shot API.

Since: 6.5
readonly MachineLearningPipeline pipeline
Provides methods for Machine Learning Pipeline API.

Since: 6.5

Methods

checkNNFWAvailability

Checks whether Neural Network Framework with provided configuration is supported.

boolean checkNNFWAvailability(NNFWType nnfw, HWType hw, optional DOMString customRequirement);

Since: 6.5

Parameters:

nnfw: Neural Network Framework to check. Set "ANY" to skip checking nnfw.
hw: Hardware resource to check. Set "ANY" to skip checking hw.
customRequirement [optional]: Custom requirement for a more fine-grained filtering of NNFWs. It is only supported by some NNFWs and hardware types.

Return value:

boolean:

true

false

Exceptions:

WebAPIException
- with error type TypeMismatchError, if any input parameter is not compatible with the expected type for that parameter.

Code example:

var fw = "TENSORFLOW_LITE";
var hw = "CPU";
var available = tizen.ml.checkNNFWAvailability(fw, hw);
console.log(fw + " with " + hw + " is " + (available ? "" : "not ") + "supported");

Output example:

TENSORFLOW_LITE with CPU is supported

2.3. TensorRawData

TensorRawData interface provides information about raw data gathered from tensor.

  [NoInterfaceObject] interface TensorRawData {
    readonly attribute TypedArray data;
    readonly attribute long size;
    readonly attribute long[] shape;
  };

Since: 6.5

Attributes

readonly TypedArray data

Raw tensor data. Array type inside TensorRawData is deduced by the type of the tensor.

Tensor type	Returned array type
`INT8`	Int8Array
`UINT8`	UInt8Array
`INT16`	Int16Array
`UINT16`	UInt16Array
`FLOAT32`	Float32Array
`INT32`	Int32Array
`UINT32`	Uint32Array
`FLOAT64`	Float64Array
`INT64`	BigInt64Array
`UINT64`	BigUInt64Array
`UNKNOWN`	Uint8Array

Since: 6.5

readonly long size
Size of returned data in bytes.

Since: 6.5

readonly long[] shape

Shape of raw tensor data - the length (number of elements) of each of the axes of a tensor. Tensors with rank up to 4 are supported, so length of the shape array will be always 4 and axes not defined by user will be filled with 1.

Since: 6.5

Code example:

var tensorsInfo = new tizen.ml.TensorsInfo();
tensorsInfo.addTensorInfo("tensor", "UINT8", [2, 3]);
var tensorsData = tensorsInfo.getTensorsData();
var rawData = tensorsData.getTensorRawData(0);
console.log("Shape: " + rawData.shape);

/* Always call dispose() when you no longer need the objects */
tensorsData.dispose();
tensorsInfo.dispose();

Output example:

Shape: 2,3,1,1

2.4. TensorsData

The TensorsData interface sets and gets the buffer data for each Tensor.

  [NoInterfaceObject] interface TensorsData {
    readonly attribute unsigned long count;
    readonly attribute TensorsInfo tensorsInfo raises(WebAPIException);
    TensorRawData getTensorRawData(long index, optional long[] location, optional long[] size) raises(WebAPIException);
    void setTensorRawData(long index, Bytes buffer, optional long[] location, optional long[] size) raises(WebAPIException);
    void dispose();
  };

Since: 6.5

Attributes

readonly unsigned long count
Number of tensors in TensorsData object.

Since: 6.5
readonly TensorsInfo tensorsInfo
Information about tensor.

Since: 6.5
Exceptions:
- WebAPIException
  - with error type NotSupportedError, if this feature is not supported.
  - with error type AbortError, if any other error occurs.

Methods

getTensorRawData

Gets tensor data at a given index. Data location and size can be provided to limit returned buffer, otherwise whole tensor will be returned.

TensorRawData getTensorRawData(long index, optional long[] location, optional long[] size);

Since: 6.5

Parameters:

index: The index of the tensor.
location [optional]: The location of the data start point. Array length can be less than tensor rank, rest will have implicit 0 as starting position.
size [optional]: The size of the data. Array length can be less than tensor rank, rest will have implicit -1. A value of -1 requests the rest of the data in selected dimension.

Return value:

TensorRawData:

type

Exceptions:

WebAPIException
- with error type InvalidValuesError, if any of the input parameters contain an invalid value.
- with error type NotSupportedError, if this feature is not supported, or given property is not available.
- with error type AbortError, if any other error occurs.

Code example:

Dimensions and location in Tizen ML API are explained as follows:

           /  0 1 2               0 1 2
          /   3 4 5               y 4 5
    dim3 /    6 7 8               6 7 8
        /     9 0 1               9 0 1
       /
      | 0 1 2               0 1 2
      | 3 4 5               3 4 5
 dim2 | 6 x 8               6 7 8
      | 9 0 1               9 0 1
        -----
        dim1
        ------------------------------
                    dim4

The order of axes is: [dim1, dim2, dim3, dim4], which means that the dimensions array of the tensor is equal to [3, 4, 2, 2].
Location of element marked as x is [1, 2, 0, 0] and location of y is [0, 1, 1, 1]

Code example:

var tensorsInfo = new tizen.ml.TensorsInfo();
tensorsInfo.addTensorInfo("tensor", "UINT8", [4, 4]);
var tensorsData = tensorsInfo.getTensorsData();
tensorsData.setTensorRawData(0, [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15]);
/* Data inside tensor: */
/*  0  1  2  3 */
/*  4  5  6  7 */
/*  8  9 10 11 */
/* 12 13 14 15 */

/* location [1, 0] means column 1 and row 0 - starting point is at element (1) */
/* size [3, 2] means 3 columns (elements in a row) and 2 rows (elements in a column) */
/* So return value should be equal to: */
/*  1  2  3 */
/*  4  5  6 */
var rawData1 = tensorsData.getTensorRawData(0, [1, 0], [3, 2]);
console.log(rawData1);

var rawData2 = tensorsData.getTensorRawData(0, [1, 0], [1, 1]);
console.log(rawData2);

/* Always call dispose() when you no longer need the objects */
tensorsData.dispose();
tensorsInfo.dispose();

Output example:

TensorRawData {data: Uint8Array(6), size: 6, shape: Array(4)}
  data: Uint8Array(6) [1, 2, 3, 5, 6, 7]
  shape: (4) [3, 2, 1, 1]
  size: 6
TensorRawData {data: Uint8Array(1), size: 1, shape: Array(4)}
  data: Uint8Array [1]
  shape: (4) [1, 1, 1, 1]
  size: 1

setTensorRawData

Sets tensor data at a given index. Location and size of modified data can be provided.

void setTensorRawData(long index, Bytes buffer, optional long[] location, optional long[] size);

Since: 6.5

Parameters:

index: The index of the tensor.
buffer: Raw tensor data to be set. If buffer is too small or too big, InvalidValuesError will be thrown.
location [optional]: The location of the data start point. Array length can be less than tensor rank, rest will have implicit 0 as starting position.
size [optional]: The size of the data. Array length can be less than tensor rank, rest will have implicit -1. A value of -1 sets the rest of the data in selected dimension.

Exceptions:

WebAPIException
- with error type InvalidValuesError, if any of the input parameters contain an invalid value.
- with error type TypeMismatchError, if any input parameter is not compatible with the expected type for that parameter.
- with error type NotSupportedError, if this feature is not supported, or given property is not available.
- with error type AbortError, if any other error occurs.

Code example:

var tensorsInfo = new tizen.ml.TensorsInfo();
tensorsInfo.addTensorInfo("tensor", "UINT8", [3, 3]);
var tensorsData = tensorsInfo.getTensorsData();

/* Set whole tensor */
tensorsData.setTensorRawData(0, [0, 1, 2, 3, 4, 5, 6, 7, 8]);
var rawData1 = tensorsData.getTensorRawData(0);
console.log(rawData1.data);

/* Set only one value */
tensorsData.setTensorRawData(0, [13], [1, 1], [1, 1]);
var rawData2 = tensorsData.getTensorRawData(0);
console.log(rawData2.data);

/* Set only one value. No need for size parameter, because there is exactly */
/* one value needed in tensor from location [2,2] to the end of the tensor */
tensorsData.setTensorRawData(0, [22], [2, 2]);
var rawData3 = tensorsData.getTensorRawData(0);
console.log(rawData3.data);

/* Set all values in one dimension */
tensorsData.setTensorRawData(0, [10, 11, 12], [0, 1], [-1, 1]);
var rawData4 = tensorsData.getTensorRawData(0);
console.log(rawData4.data);

/* Always call dispose() when you no longer need the objects */
tensorsData.dispose();
tensorsInfo.dispose();

Output example:

Uint8Array(9) [0, 1, 2, 3, 4, 5, 6, 7, 8]
Uint8Array(9) [0, 1, 2, 3, 13, 5, 6, 7, 8]
Uint8Array(9) [0, 1, 2, 3, 13, 5, 6, 7, 22]
Uint8Array(9) [0, 1, 2, 10, 11, 12, 6, 7, 22]

dispose

Disposes an object and releases the memory. Object should not be used after calling this method. Using diposed object will trigger AbortError.

void dispose();

Since: 6.5

Code example:

var tensorsInfo = new tizen.ml.TensorsInfo();
tensorsInfo.addTensorInfo("tensor", "UINT8", [2, 2]);
var tensorsData = tensorsInfo.getTensorsData();
console.log(tensorsData.getTensorRawData(0));
tensorsData.dispose();
try
{
  console.log(tensorsData.getTensorRawData(0));
}
catch (e)
{
  console.log("Exception occurred: " + e.message);
}

/* Always call dispose() when you no longer need the objects */
tensorsInfo.dispose();

Output example:

TensorRawData {data: Uint8Array(4), size: 4, shape: Array(4)}
Exception occurred: TensorsData is disposed

2.5. TensorsInfo

The TensorsInfo interface manages tensor information such as name, type, and dimensions.

  [Constructor() raises(WebAPIException)]
  interface TensorsInfo {
    readonly attribute unsigned long count;
    long addTensorInfo(DOMString? name, TensorType type, long[] dimensions) raises(WebAPIException);
    TensorsInfo clone() raises(WebAPIException);
    boolean equals(TensorsInfo other) raises(WebAPIException);
    long[] getDimensions(long index) raises(WebAPIException);
    DOMString getTensorName(long index) raises(WebAPIException);
    TensorsData getTensorsData() raises(WebAPIException);
    long getTensorSize(long index) raises(WebAPIException);
    TensorType getTensorType(long index) raises(WebAPIException);
    void setDimensions(long index, long[] dimensions) raises(WebAPIException);
    void setTensorName(long index, DOMString name) raises(WebAPIException);
    void setTensorType(long index, TensorType type) raises(WebAPIException);
    void dispose();
  };

Since: 6.5

Constructors

Constructor ()

Attributes

readonly unsigned long count
Number of tensor information already added to object.

Since: 6.5

Methods

addTensorInfo

Add a Tensor information to the TensorsInfo instance.

long addTensorInfo(DOMString? name, TensorType type, long[] dimensions);

Since: 6.5

Remark: TensorsInfo object can hold information of up to 16 tensors. An attempt to add more tensors will trigger AbortError.

Parameters:

name [nullable]: Name of Tensor.
type: Data element type of Tensor.
dimensions: Array with tensor's dimensions. Each value determines number of elements in each dimension. The maximum supported rank is 4. Values on bigger indexes are discarded. In case, the dimensions length is less than 4, the remaining values are filled with 1.

Return value:

long:

Exceptions:

WebAPIException
- with error type InvalidValuesError, if any of the input parameters contain an invalid value.
- with error type TypeMismatchError, if any input parameter is not compatible with the expected type for that parameter.
- with error type NotSupportedError, if this feature is not supported, or given property is not available.
- with error type AbortError, if any other error occurs.

Code example:

var tensorsInfo = new tizen.ml.TensorsInfo();
console.log("tensorsInfo.count: " + tensorsInfo.count);
tensorsInfo.addTensorInfo("tensor", "UINT8", [2, 2]);
console.log("tensorsInfo.count: " + tensorsInfo.count);

/* Always call dispose() when you no longer need the objects */
tensorsInfo.dispose();

Output example:

tensorsInfo.count: 0
tensorsInfo.count: 1

clone

Clones a TensorsInfo object.

TensorsInfo clone();

Since: 6.5

Return value:

TensorsInfo:

Exceptions:

WebAPIException
- with error type AbortError, if any error occurs.

Code example:

var t1 = new tizen.ml.TensorsInfo();
t1.addTensorInfo("tensor1", "UINT8", [1, 1]);
var t2 = t1.clone();

console.log("name: " + t1.getTensorName(0) + ", type: " + t1.getTensorType(0) + ", dimensions: " +
            t1.getDimensions(0));
console.log("name: " + t2.getTensorName(0) + ", type: " + t2.getTensorType(0) + ", dimensions: " +
            t2.getDimensions(0));

/* Always call dispose() when you no longer need the objects */
t2.dispose();
t1.dispose();

Output example:

name: tensor1, type: UINT8, dimensions: 1,1,1,1
name: tensor1, type: UINT8, dimensions: 1,1,1,1

equals

Compares object with TensorsInfo and checks whether it has the same contents or not. One TensorsInfo is equal to another when they both have the same type and dimensions.

boolean equals(TensorsInfo other);

Since: 6.5

Parameters:

other: Object to compare.

Return value:

boolean:

true

false

Exceptions:

WebAPIException
- with error type TypeMismatchError, if any input parameter is not compatible with the expected type for that parameter.

Code example:

var t1 = new tizen.ml.TensorsInfo();
t1.addTensorInfo("tensor1", "UINT8", [1, 1]);
var t2 = t1.clone();
console.log("Is t1 equal to t2: " + t1.equals(t2));
console.log("Changing name of first tensor in t2");
t2.setTensorName(0, "different");
console.log("Is t1 equal to t2: " + t1.equals(t2));
console.log("Changing type of first tensor in t2");
t2.setTensorType(0, "INT8");
console.log("Is t1 equal to t2: " + t1.equals(t2));

/* Always call dispose() when you no longer need the objects */
t2.dispose();
t1.dispose();

Output example:

Is t1 equal to t2: true
Changing name of first tensor in t2
Is t1 equal to t2: true
Changing type of first tensor in t2
Is t1 equal to t2: false

getDimensions

Gets the dimensions of the tensor at a given index.

long[] getDimensions(long index);

Since: 6.5

Parameters:

index: The index of the tensor.

Return value:

long[]:

Exceptions:

WebAPIException
- with error type InvalidValuesError, if any of the input parameters contain an invalid value.
- with error type NotSupportedError, if this feature is not supported, or given property is not available.
- with error type AbortError, if any other error occurs.

Code example:

var tensorsInfo = new tizen.ml.TensorsInfo();
tensorsInfo.addTensorInfo("tensor1", "UINT8", [2, 2]);
tensorsInfo.addTensorInfo("tensor2", "INT16", [4, 5, 3]);
console.log("Dimensions of first tensor in tensorsInfo: " + tensorsInfo.getDimensions(0));
console.log("Dimensions of second tensor in tensorsInfo: " + tensorsInfo.getDimensions(1));

/* Always call dispose() when you no longer need the objects */
tensorsInfo.dispose();

Output example:

Dimensions of first tensor in tensorsInfo: 2,2,1,1
Dimensions of second tensor in tensorsInfo: 4,5,3,1

getTensorName

Gets the name of the tensor at a given index.

DOMString getTensorName(long index);

Since: 6.5

Parameters:

index: The index of the tensor.

Return value:

DOMString:

Exceptions:

WebAPIException
- with error type InvalidValuesError, if any of the input parameters contain an invalid value.
- with error type NotSupportedError, if this feature is not supported, or given property is not available.
- with error type AbortError, if any other error occurs.

Code example:

var tensorsInfo = new tizen.ml.TensorsInfo();
tensorsInfo.addTensorInfo("tensor1", "UINT8", [2, 2]);
tensorsInfo.addTensorInfo("tensor2", "INT16", [4, 5, 3]);
console.log("Name of first tensor in tensorsInfo: " + tensorsInfo.getTensorName(0));
console.log("Name of second tensor in tensorsInfo: " + tensorsInfo.getTensorName(1));

/* Always call dispose() when you no longer need the objects */
tensorsInfo.dispose();

Output example:

Name of first tensor in tensorsInfo: tensor1
Name of second tensor in tensorsInfo: tensor2

getTensorsData

Creates a TensorsData instance based on information of TensorsInfo. Each execution of this method creates a new TensorsData object.

TensorsData getTensorsData();

Since: 6.5

Return value:

TensorsData:

Exceptions:

WebAPIException
- with error type NotSupportedError, if this feature is not supported, or given property is not available.
- with error type AbortError, if any other error occurs.

Code example:

/* 0 1 2 */
/* 3 4 5 */
/* 6 7 8 */
var tensorsInfo = new tizen.ml.TensorsInfo();
tensorsInfo.addTensorInfo("tensor", "UINT8", [3, 3]);
var tensorsData = tensorsInfo.getTensorsData();
tensorsData.setTensorRawData(0, [0, 1, 2, 3, 4, 5, 6, 7, 8]);

console.log("Get whole tensor");
var rawData1 = tensorsData.getTensorRawData(0);
console.log("shape: " + rawData1.shape + " data: " + rawData1.data);

console.log("Get only one value");
var rawData2 = tensorsData.getTensorRawData(0, [1, 1], [1, 1]);
console.log("shape: " + rawData2.shape + " data: " + rawData2.data);

console.log("Get all values from location to the end of tensor");
var rawData3 = tensorsData.getTensorRawData(0, [1, 1]);
console.log("shape: " + rawData3.shape + " data: " + rawData3.data);

/* Here we start from the value (3) and request all values in first dimension (column counter) */
/* and only one value in second dimension (row counter), so we expect to get: */
/* 3 4 5 */
console.log("Get all values in one dimension");
var rawData4 = tensorsData.getTensorRawData(0, [0, 1], [-1, 1]);
console.log("shape: " + rawData4.shape + " data: " + rawData4.data);

/* Always call dispose() when you no longer need the objects */
tensorsData.dispose();
tensorsInfo.dispose();

Output example:

Get whole tensor
shape: 3,3,1,1 data: 0,1,2,3,4,5,6,7,8
Get only one value
shape: 1,1,1,1 data: 4
Get all values from location to the end of tensor
shape: 2,2,1,1 data: 4,5,7,8
Get all values in one dimension
shape: 3,1,1,1 data: 3,4,5

getTensorSize

Calculates the byte size of tensor data.

long getTensorSize(long index);

Since: 6.5

Parameters:

index: The index of the tensor. If an application needs to get the total byte size of tensors, set the index to -1.

Return value:

long:

Exceptions:

WebAPIException
- with error type InvalidValuesError, if any of the input parameters contain an invalid value.
- with error type NotSupportedError, if this feature is not supported, or given property is not available.
- with error type AbortError, if any other error occurs.

Code example:

var tensorsInfo = new tizen.ml.TensorsInfo();
tensorsInfo.addTensorInfo("tensor1", "UINT8", [2, 2]);
tensorsInfo.addTensorInfo("tensor2", "INT16", [4, 5, 3]);
console.log("Size of first tensor in tensorsInfo: " + tensorsInfo.getTensorSize(0));
console.log("Size of second tensor in tensorsInfo: " + tensorsInfo.getTensorSize(1));
console.log("Total size of tensorsInfo: " + tensorsInfo.getTensorSize(-1));

/* Always call dispose() when you no longer need the objects */
tensorsInfo.dispose();

Output example:

Size of first tensor in tensorsInfo: 4
Size of second tensor in tensorsInfo: 120
Total size of tensorsInfo: 124

getTensorType

Gets the type of the tensor at a given index.

TensorType getTensorType(long index);

Since: 6.5

Parameters:

index: The index of the tensor.

Return value:

TensorType:

Exceptions:

WebAPIException
- with error type InvalidValuesError, if any of the input parameters contain an invalid value.
- with error type NotSupportedError, if this feature is not supported, or given property is not available.
- with error type AbortError, if any other error occurs.

Code example:

var tensorsInfo = new tizen.ml.TensorsInfo();
tensorsInfo.addTensorInfo("tensor1", "UINT8", [2, 2]);
tensorsInfo.addTensorInfo("tensor2", "INT16", [4, 5, 3]);
console.log("Type of first tensor in tensorsInfo: " + tensorsInfo.getTensorType(0));
console.log("Type of second tensor in tensorsInfo: " + tensorsInfo.getTensorType(1));

/* Always call dispose() when you no longer need the objects */
tensorsInfo.dispose();

Output example:

Type of first tensor in tensorsInfo: UINT8
Type of second tensor in tensorsInfo: INT16

setDimensions

Sets the dimensions of the tensor at a given index.

void setDimensions(long index, long[] dimensions);

Since: 6.5

Parameters:

index: The index of the tensor.
dimensions: Array with tensor's dimensions to be set. Each value determines number of elements in each dimension. Valid array contains only positive numbers. The maximum supported rank is 4. Values on bigger indexes are discarded. In case, the dimensions length is less than 4, the remaining values are filled with 1.

Exceptions:

WebAPIException
- with error type InvalidValuesError, if any of the input parameters contain an invalid value.
- with error type TypeMismatchError, if any input parameter is not compatible with the expected type for that parameter.
- with error type NotSupportedError, if this feature is not supported, or given property is not available.
- with error type AbortError, if any other error occurs.

Code example:

var tensorsInfo = new tizen.ml.TensorsInfo();
tensorsInfo.addTensorInfo("tensor1", "UINT8", [2, 2]);
console.log("Dimensions of first tensor in tensorsInfo: " + tensorsInfo.getDimensions(0));
tensorsInfo.setDimensions(0, [4, 4, 4, 4]);
console.log("Dimensions after update: " + tensorsInfo.getDimensions(0));

/* Always call dispose() when you no longer need the objects */
tensorsInfo.dispose();

Output example:

Dimensions of first tensor in tensorsInfo: 2,2,1,1
Dimensions after update: 4,4,4,4

setTensorName

Sets the name of the tensor at a given index.

void setTensorName(long index, DOMString name);

Since: 6.5

Parameters:

index: The index of the tensor.
name: The tensor name to be set.

Exceptions:

WebAPIException
- with error type InvalidValuesError, if any of the input parameters contain an invalid value.
- with error type NotSupportedError, if this feature is not supported, or given property is not available.
- with error type AbortError, if any other error occurs.

Code example:

var tensorsInfo = new tizen.ml.TensorsInfo();
tensorsInfo.addTensorInfo("tensor1", "UINT8", [2, 2]);
console.log("Name of first tensor in tensorsInfo: " + tensorsInfo.getTensorName(0));
tensorsInfo.setTensorName(0, "different_name");
console.log("Name after update: " + tensorsInfo.getTensorName(0));

/* Always call dispose() when you no longer need the objects */
tensorsInfo.dispose();

Output example:

Name of first tensor in tensorsInfo: tensor1
Name after update: different_name

setTensorType

Sets the type of the tensor at a given index.

void setTensorType(long index, TensorType type);

Since: 6.5

Parameters:

index: The index of the tensor.
type: The tensor type to be set.

Exceptions:

WebAPIException
- with error type InvalidValuesError, if any of the input parameters contain an invalid value.
- with error type TypeMismatchError, if any input parameter is not compatible with the expected type for that parameter.
- with error type NotSupportedError, if this feature is not supported, or given property is not available.
- with error type AbortError, if any other error occurs.

Code example:

var tensorsInfo = new tizen.ml.TensorsInfo();
tensorsInfo.addTensorInfo("tensor1", "UINT8", [2, 2]);
console.log("Type of first tensor in tensorsInfo: " + tensorsInfo.getTensorType(0));
tensorsInfo.setTensorType(0, "FLOAT32");
console.log("Type after update: " + tensorsInfo.getTensorType(0));

/* Always call dispose() when you no longer need the objects */
tensorsInfo.dispose();

Output example:

Type of first tensor in tensorsInfo: UINT8
Type after update: FLOAT32

dispose

Disposes an object and releases the memory. Object should not be used after calling this method. Using diposed object will trigger AbortError.

void dispose();

Since: 6.5

Code example:

var tensorsInfo = new tizen.ml.TensorsInfo();
tensorsInfo.addTensorInfo("tensor", "UINT8", [2, 2]);
console.log("Name of first tensor in tensorsInfo: " + tensorsInfo.getTensorName(0));
tensorsInfo.dispose();
try
{
  console.log("Name of first tensor in tensorsInfo: " + tensorsInfo.getTensorName(0));
}
catch (e)
{
  console.log("Exception occurred: " + e.message);
}

Output example:

Name of first tensor in tensorsInfo: tensor
Exception occurred: TensorsInfo is disposed

3. Related Feature

Method tizen.systeminfo.getCapability() can be used in application runtime to check whether this API is supported.

To guarantee the running of the application on a device which supports Machine Learning API feature, declare the following feature requirement in the config file:

http://tizen.org/feature/machine_learning

To guarantee the running of the application on a device which supports Machine Learning Inference API feature, declare the following feature requirement in the config file:

http://tizen.org/feature/machine_learning.inference

For more information, see Application Filtering.

4. Full WebIDL

module MachineLearning {
  typedef (byte[] or TypedArray) Bytes;
  enum TensorType { "INT8", "UINT8", "INT16", "UINT16", "FLOAT32", "INT32", "UINT32", "FLOAT64", "INT64", "UINT64", "UNKNOWN" };
  enum HWType  { "ANY", "AUTO", "CPU", "CPU_NEON", "CPU_SIMD", "GPU", "NPU", "NPU_EDGE_TPU", "NPU_MOVIDIUS", "NPU_SLSI", "NPU_SR",
    "NPU_VIVANTE" };
  enum NNFWType { "ANY", "ARM_NN", "CUSTOM_FILTER", "EDGE_TPU", "MVNC", "NNFW", "NNTR_INF", "OPEN_VINO", "PYTORCH", "SNAP", "SNPE",
    "TRIX_ENGINE", "TENSORFLOW", "TENSORFLOW_LITE", "VD_AIFW", "VIVANTE" };
  Tizen implements MachineLearningManagerObject;
  [NoInterfaceObject] interface MachineLearningManagerObject {
    readonly attribute MachineLearningManager ml;
  };
  [NoInterfaceObject] interface MachineLearningManager {
    readonly attribute MachineLearningSingle single;
    readonly attribute MachineLearningPipeline pipeline;
    boolean checkNNFWAvailability(NNFWType nnfw, HWType hw, optional DOMString customRequirement) raises(WebAPIException);
  };
  [NoInterfaceObject] interface TensorRawData {
    readonly attribute TypedArray data;
    readonly attribute long size;
    readonly attribute long[] shape;
  };
  [NoInterfaceObject] interface TensorsData {
    readonly attribute unsigned long count;
    readonly attribute TensorsInfo tensorsInfo raises(WebAPIException);
    TensorRawData getTensorRawData(long index, optional long[] location, optional long[] size) raises(WebAPIException);
    void setTensorRawData(long index, Bytes buffer, optional long[] location, optional long[] size) raises(WebAPIException);
    void dispose();
  };
  [Constructor() raises(WebAPIException)]
  interface TensorsInfo {
    readonly attribute unsigned long count;
    long addTensorInfo(DOMString? name, TensorType type, long[] dimensions) raises(WebAPIException);
    TensorsInfo clone() raises(WebAPIException);
    boolean equals(TensorsInfo other) raises(WebAPIException);
    long[] getDimensions(long index) raises(WebAPIException);
    DOMString getTensorName(long index) raises(WebAPIException);
    TensorsData getTensorsData() raises(WebAPIException);
    long getTensorSize(long index) raises(WebAPIException);
    TensorType getTensorType(long index) raises(WebAPIException);
    void setDimensions(long index, long[] dimensions) raises(WebAPIException);
    void setTensorName(long index, DOMString name) raises(WebAPIException);
    void setTensorType(long index, TensorType type) raises(WebAPIException);
    void dispose();
  };
};

MachineLearning API

Table of Contents

Summary of Interfaces and Methods

1. Type Definitions

1.1. TensorType

1.2. HWType

1.3. NNFWType

1.4. Bytes

2. Interfaces

2.1. MachineLearningManagerObject

Attributes

2.2. MachineLearningManager

Attributes

Methods

2.3. TensorRawData

Attributes

2.4. TensorsData

Attributes

Methods

2.5. TensorsInfo

Constructors

Attributes

Methods

3. Related Feature

4. Full WebIDL