GPUOptions.Experimental.VirtualDevicesOrBuilder

public static interface GPUOptions.Experimental.VirtualDevicesOrBuilder
Known Indirect Subclasses

Public Methods

abstract float
getMemoryLimitMb(int index) 
 Per "virtual" device memory limit, in MB.
abstract int
getMemoryLimitMbCount() 
 Per "virtual" device memory limit, in MB.
abstract List<Float>
getMemoryLimitMbList() 
 Per "virtual" device memory limit, in MB.
abstract int
getPriority(int index) 
 Priority values to use with the virtual devices.
abstract int
getPriorityCount() 
 Priority values to use with the virtual devices.
abstract List<Integer>
getPriorityList() 
 Priority values to use with the virtual devices.

Public Methods

public abstract float getMemoryLimitMb (int index) 

 Per "virtual" device memory limit, in MB. The number of elements in
 the list is the number of virtual devices to create on the
 corresponding visible GPU (see "virtual_devices" below).
 If empty, it will create single virtual device taking all available
 memory from the device.
 For the concept of "visible" and "virtual" GPU, see the comments for
 "visible_device_list" above for more information.
repeated float memory_limit_mb = 1;

public abstract int getMemoryLimitMbCount () 

 Per "virtual" device memory limit, in MB. The number of elements in
 the list is the number of virtual devices to create on the
 corresponding visible GPU (see "virtual_devices" below).
 If empty, it will create single virtual device taking all available
 memory from the device.
 For the concept of "visible" and "virtual" GPU, see the comments for
 "visible_device_list" above for more information.
repeated float memory_limit_mb = 1;

public abstract List<Float> getMemoryLimitMbList () 

 Per "virtual" device memory limit, in MB. The number of elements in
 the list is the number of virtual devices to create on the
 corresponding visible GPU (see "virtual_devices" below).
 If empty, it will create single virtual device taking all available
 memory from the device.
 For the concept of "visible" and "virtual" GPU, see the comments for
 "visible_device_list" above for more information.
repeated float memory_limit_mb = 1;

public abstract int getPriority (int index) 

 Priority values to use with the virtual devices. Use the cuda function
 cudaDeviceGetStreamPriorityRange to query for valid range of values for
 priority.
 On a P4000 GPU with cuda 10.1, the priority range reported was 0 for
 least priority and -1 for greatest priority.
 If this field is not specified, then the virtual devices will be
 created with the default. If this field has values set, then the size
 of this must match with the above memory_limit_mb.
repeated int32 priority = 2;

public abstract int getPriorityCount () 

 Priority values to use with the virtual devices. Use the cuda function
 cudaDeviceGetStreamPriorityRange to query for valid range of values for
 priority.
 On a P4000 GPU with cuda 10.1, the priority range reported was 0 for
 least priority and -1 for greatest priority.
 If this field is not specified, then the virtual devices will be
 created with the default. If this field has values set, then the size
 of this must match with the above memory_limit_mb.
repeated int32 priority = 2;

public abstract List<Integer> getPriorityList () 

 Priority values to use with the virtual devices. Use the cuda function
 cudaDeviceGetStreamPriorityRange to query for valid range of values for
 priority.
 On a P4000 GPU with cuda 10.1, the priority range reported was 0 for
 least priority and -1 for greatest priority.
 If this field is not specified, then the virtual devices will be
 created with the default. If this field has values set, then the size
 of this must match with the above memory_limit_mb.
repeated int32 priority = 2;