Topology |
CPU: Intel(R) Core(TM) i5-8600K CPU @ 3.60GHz, CPU family: x86_64, GPU: Intel(R) UHD Graphics 630, RAM size: 32789696 kB, OS family: Linux, OS version: Linux-4.15.0-47-generic-x86_64-with-Ubuntu-16.04-xenial, Python version: 3.5.2 |
CPU: Intel(R) Core(TM) i3-7100 CPU @ 3.90GHz, CPU family: Intel64 Family 6 Model 158 Stepping 9, GenuineIntel, GPU: Intel(R) HD Graphics 630, RAM size: 8256420 KB, OS family: Windows, OS version: Windows-10-10.0.17134-SP0, Python version: 3.6.0 |
CPU: Intel(R) Core(TM) i7-7700K CPU @ 4.20GHz, CPU family: Intel64 Family 6 Model 158 Stepping 9, GenuineIntel, GPU: Intel(R) HD Graphics 630, RAM size: 16641852 KB, OS family: Windows, OS version: Windows-10-10.0.17763-SP0, Python version: 3.6.5 |
CPU: Intel(R) Core(TM) i5-8300H CPU @ 2.30GHz, CPU family: Intel64 Family 6 Model 158 Stepping 10, GenuineIntel, GPU: Intel(R) UHD Graphics 630, RAM size: 8245928 KB, OS family: Windows, OS version: Windows-10-10.0.17763-SP0, Python version: 3.6.5 |
|
FP32;ImageNET;1; Sync;Plugin: CPU Iteration count: 1000 Thread count: 1 |
FP32;ImageNET;1; Sync;Plugin: CPU Iteration count: 1000 Thread count: 2 |
FP32;ImageNET;1; Sync;Plugin: CPU Iteration count: 1000 Thread count: 4 |
FP32;ImageNET;1; Sync;Plugin: CPU Iteration count: 1000 Thread count: 6 |
FP32;ImageNET;2; Sync;Plugin: CPU Iteration count: 1000 Thread count: 1 |
FP32;ImageNET;2; Sync;Plugin: CPU Iteration count: 1000 Thread count: 2 |
FP32;ImageNET;2; Sync;Plugin: CPU Iteration count: 1000 Thread count: 4 |
FP32;ImageNET;2; Sync;Plugin: CPU Iteration count: 1000 Thread count: 6 |
FP32;ImageNET;4; Sync;Plugin: CPU Iteration count: 1000 Thread count: 1 |
FP32;ImageNET;4; Sync;Plugin: CPU Iteration count: 1000 Thread count: 2 |
FP32;ImageNET;4; Sync;Plugin: CPU Iteration count: 1000 Thread count: 4 |
FP32;ImageNET;4; Sync;Plugin: CPU Iteration count: 1000 Thread count: 6 |
FP32;ImageNET;8; Sync;Plugin: CPU Iteration count: 1000 Thread count: 1 |
FP32;ImageNET;8; Sync;Plugin: CPU Iteration count: 1000 Thread count: 2 |
FP32;ImageNET;8; Sync;Plugin: CPU Iteration count: 1000 Thread count: 4 |
FP32;ImageNET;8; Sync;Plugin: CPU Iteration count: 1000 Thread count: 6 |
FP32;ImageNET;1; Async;Plugin: CPU Async request count: 1 Iteration count: 1000 Stream count: 1 |
FP32;ImageNET;1; Async;Plugin: CPU Async request count: 2 Iteration count: 1000 Stream count: 2 |
FP32;ImageNET;1; Async;Plugin: CPU Async request count: 4 Iteration count: 1000 Stream count: 4 |
FP32;ImageNET;1; Async;Plugin: CPU Async request count: 6 Iteration count: 1000 Stream count: 6 |
FP32;ImageNET;2; Async;Plugin: CPU Async request count: 1 Iteration count: 1000 Stream count: 1 |
FP32;ImageNET;2; Async;Plugin: CPU Async request count: 2 Iteration count: 1000 Stream count: 2 |
FP32;ImageNET;2; Async;Plugin: CPU Async request count: 4 Iteration count: 1000 Stream count: 4 |
FP32;ImageNET;2; Async;Plugin: CPU Async request count: 6 Iteration count: 1000 Stream count: 6 |
FP32;ImageNET;4; Async;Plugin: CPU Async request count: 1 Iteration count: 1000 Stream count: 1 |
FP32;ImageNET;4; Async;Plugin: CPU Async request count: 2 Iteration count: 1000 Stream count: 2 |
FP32;ImageNET;4; Async;Plugin: CPU Async request count: 4 Iteration count: 1000 Stream count: 4 |
FP32;ImageNET;4; Async;Plugin: CPU Async request count: 6 Iteration count: 1000 Stream count: 6 |
FP32;ImageNET;8; Async;Plugin: CPU Async request count: 1 Iteration count: 1000 Stream count: 1 |
FP32;ImageNET;8; Async;Plugin: CPU Async request count: 2 Iteration count: 1000 Stream count: 2 |
FP32;ImageNET;8; Async;Plugin: CPU Async request count: 4 Iteration count: 1000 Stream count: 4 |
FP32;ImageNET;8; Async;Plugin: CPU Async request count: 6 Iteration count: 1000 Stream count: 6 |
FP32;ImageNET;1; Sync;Plugin: GPU Iteration count: 1000 |
FP32;ImageNET;2; Sync;Plugin: GPU Iteration count: 1000 |
FP32;ImageNET;4; Sync;Plugin: GPU Iteration count: 1000 |
FP32;ImageNET;8; Sync;Plugin: GPU Iteration count: 1000 |
FP16;ImageNET;1; Sync;Plugin: GPU Iteration count: 1000 |
FP16;ImageNET;2; Sync;Plugin: GPU Iteration count: 1000 |
FP16;ImageNET;4; Sync;Plugin: GPU Iteration count: 1000 |
FP16;ImageNET;8; Sync;Plugin: GPU Iteration count: 1000 |
FP16;ImageNET;1; Sync;Plugin: MYRIAD Iteration count: 1000 |
FP16;ImageNET;2; Sync;Plugin: MYRIAD Iteration count: 1000 |
FP16;ImageNET;4; Sync;Plugin: MYRIAD Iteration count: 1000 |
FP16;ImageNET;8; Sync;Plugin: MYRIAD Iteration count: 1000 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
Average time of single pass |
FPS |
|
Average time of single pass |
FPS |
|
Average time of single pass |
FPS |
|
Average time of single pass |
FPS |
|
Average time of single pass |
FPS |
|
Average time of single pass |
FPS |
|
Average time of single pass |
FPS |
|
Average time of single pass |
FPS |
|
Average time of single pass |
FPS |
|
Average time of single pass |
FPS |
|
Average time of single pass |
FPS |
|
Average time of single pass |
FPS |
|
Average time of single pass |
FPS |
|
Average time of single pass |
FPS |
|
Average time of single pass |
FPS |
|
Average time of single pass |
FPS |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
FP32;ImageNET;1; Sync;Plugin: CPU Iteration count: 1000 Thread count: 1 |
FP32;ImageNET;1; Sync;Plugin: CPU Iteration count: 1000 Thread count: 2 |
FP32;ImageNET;1; Sync;Plugin: CPU Iteration count: 1000 Thread count: 4 |
FP32;ImageNET;2; Sync;Plugin: CPU Iteration count: 1000 Thread count: 1 |
FP32;ImageNET;2; Sync;Plugin: CPU Iteration count: 1000 Thread count: 2 |
FP32;ImageNET;2; Sync;Plugin: CPU Iteration count: 1000 Thread count: 4 |
FP32;ImageNET;4; Sync;Plugin: CPU Iteration count: 1000 Thread count: 1 |
FP32;ImageNET;4; Sync;Plugin: CPU Iteration count: 1000 Thread count: 2 |
FP32;ImageNET;4; Sync;Plugin: CPU Iteration count: 1000 Thread count: 4 |
FP32;ImageNET;8; Sync;Plugin: CPU Iteration count: 1000 Thread count: 1 |
FP32;ImageNET;8; Sync;Plugin: CPU Iteration count: 1000 Thread count: 2 |
FP32;ImageNET;8; Sync;Plugin: CPU Iteration count: 1000 Thread count: 4 |
FP32;ImageNET;1; Async;Plugin: CPU Async request count: 1 Iteration count: 1000 Stream count: 1 |
FP32;ImageNET;1; Async;Plugin: CPU Async request count: 2 Iteration count: 1000 Stream count: 2 |
FP32;ImageNET;2; Async;Plugin: CPU Async request count: 1 Iteration count: 1000 Stream count: 1 |
FP32;ImageNET;2; Async;Plugin: CPU Async request count: 2 Iteration count: 1000 Stream count: 2 |
FP32;ImageNET;4; Async;Plugin: CPU Async request count: 1 Iteration count: 1000 Stream count: 1 |
FP32;ImageNET;4; Async;Plugin: CPU Async request count: 2 Iteration count: 1000 Stream count: 2 |
FP32;ImageNET;8; Async;Plugin: CPU Async request count: 1 Iteration count: 1000 Stream count: 1 |
FP32;ImageNET;8; Async;Plugin: CPU Async request count: 2 Iteration count: 1000 Stream count: 2 |
FP32;ImageNET;1; Sync;Plugin: GPU Iteration count: 1000 |
FP32;ImageNET;2; Sync;Plugin: GPU Iteration count: 1000 |
FP32;ImageNET;4; Sync;Plugin: GPU Iteration count: 1000 |
FP32;ImageNET;8; Sync;Plugin: GPU Iteration count: 1000 |
FP16;ImageNET;1; Sync;Plugin: GPU Iteration count: 1000 |
FP16;ImageNET;2; Sync;Plugin: GPU Iteration count: 1000 |
FP16;ImageNET;4; Sync;Plugin: GPU Iteration count: 1000 |
FP16;ImageNET;8; Sync;Plugin: GPU Iteration count: 1000 |
|
|
|
|
|
|
|
|
|
|
|
|
Average time of single pass |
FPS |
|
Average time of single pass |
FPS |
|
Average time of single pass |
FPS |
|
Average time of single pass |
FPS |
|
Average time of single pass |
FPS |
|
Average time of single pass |
FPS |
|
Average time of single pass |
FPS |
|
Average time of single pass |
FPS |
|
|
|
|
|
|
|
|
|
|
FP32;ImageNET;1; Sync;Plugin: CPU Iteration count: 1000 Thread count: 1 |
FP32;ImageNET;1; Sync;Plugin: CPU Iteration count: 1000 Thread count: 2 |
FP32;ImageNET;1; Sync;Plugin: CPU Iteration count: 1000 Thread count: 4 |
FP32;ImageNET;1; Sync;Plugin: CPU Iteration count: 1000 Thread count: 8 |
FP32;ImageNET;2; Sync;Plugin: CPU Iteration count: 1000 Thread count: 1 |
FP32;ImageNET;2; Sync;Plugin: CPU Iteration count: 1000 Thread count: 2 |
FP32;ImageNET;2; Sync;Plugin: CPU Iteration count: 1000 Thread count: 4 |
FP32;ImageNET;2; Sync;Plugin: CPU Iteration count: 1000 Thread count: 8 |
FP32;ImageNET;4; Sync;Plugin: CPU Iteration count: 1000 Thread count: 1 |
FP32;ImageNET;4; Sync;Plugin: CPU Iteration count: 1000 Thread count: 2 |
FP32;ImageNET;4; Sync;Plugin: CPU Iteration count: 1000 Thread count: 4 |
FP32;ImageNET;4; Sync;Plugin: CPU Iteration count: 1000 Thread count: 8 |
FP32;ImageNET;8; Sync;Plugin: CPU Iteration count: 1000 Thread count: 1 |
FP32;ImageNET;8; Sync;Plugin: CPU Iteration count: 1000 Thread count: 2 |
FP32;ImageNET;8; Sync;Plugin: CPU Iteration count: 1000 Thread count: 4 |
FP32;ImageNET;8; Sync;Plugin: CPU Iteration count: 1000 Thread count: 8 |
FP32;ImageNET;1; Async;Plugin: CPU Async request count: 1 Iteration count: 1000 Stream count: 1 |
FP32;ImageNET;1; Async;Plugin: CPU Async request count: 2 Iteration count: 1000 Stream count: 2 |
FP32;ImageNET;1; Async;Plugin: CPU Async request count: 4 Iteration count: 1000 Stream count: 4 |
FP32;ImageNET;2; Async;Plugin: CPU Async request count: 1 Iteration count: 1000 Stream count: 1 |
FP32;ImageNET;2; Async;Plugin: CPU Async request count: 2 Iteration count: 1000 Stream count: 2 |
FP32;ImageNET;2; Async;Plugin: CPU Async request count: 4 Iteration count: 1000 Stream count: 4 |
FP32;ImageNET;4; Async;Plugin: CPU Async request count: 1 Iteration count: 1000 Stream count: 1 |
FP32;ImageNET;4; Async;Plugin: CPU Async request count: 2 Iteration count: 1000 Stream count: 2 |
FP32;ImageNET;4; Async;Plugin: CPU Async request count: 4 Iteration count: 1000 Stream count: 4 |
FP32;ImageNET;8; Async;Plugin: CPU Async request count: 1 Iteration count: 1000 Stream count: 1 |
FP32;ImageNET;8; Async;Plugin: CPU Async request count: 2 Iteration count: 1000 Stream count: 2 |
FP32;ImageNET;8; Async;Plugin: CPU Async request count: 4 Iteration count: 1000 Stream count: 4 |
FP32;ImageNET;1; Sync;Plugin: GPU Iteration count: 1000 |
FP32;ImageNET;2; Sync;Plugin: GPU Iteration count: 1000 |
FP32;ImageNET;4; Sync;Plugin: GPU Iteration count: 1000 |
FP32;ImageNET;8; Sync;Plugin: GPU Iteration count: 1000 |
FP16;ImageNET;1; Sync;Plugin: GPU Iteration count: 1000 |
FP16;ImageNET;2; Sync;Plugin: GPU Iteration count: 1000 |
FP16;ImageNET;4; Sync;Plugin: GPU Iteration count: 1000 |
FP16;ImageNET;8; Sync;Plugin: GPU Iteration count: 1000 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
Average time of single pass |
FPS |
|
Average time of single pass |
FPS |
|
Average time of single pass |
FPS |
|
Average time of single pass |
FPS |
|
Average time of single pass |
FPS |
|
Average time of single pass |
FPS |
|
Average time of single pass |
FPS |
|
Average time of single pass |
FPS |
|
Average time of single pass |
FPS |
|
Average time of single pass |
FPS |
|
Average time of single pass |
FPS |
|
Average time of single pass |
FPS |
|
|
|
|
|
|
|
|
|
|
FP32;ImageNET;1; Sync;Plugin: CPU Iteration count: 1000 Thread count: 1 |
FP32;ImageNET;1; Sync;Plugin: CPU Iteration count: 1000 Thread count: 2 |
FP32;ImageNET;1; Sync;Plugin: CPU Iteration count: 1000 Thread count: 4 |
FP32;ImageNET;2; Sync;Plugin: CPU Iteration count: 1000 Thread count: 1 |
FP32;ImageNET;2; Sync;Plugin: CPU Iteration count: 1000 Thread count: 2 |
FP32;ImageNET;2; Sync;Plugin: CPU Iteration count: 1000 Thread count: 4 |
FP32;ImageNET;4; Sync;Plugin: CPU Iteration count: 1000 Thread count: 1 |
FP32;ImageNET;4; Sync;Plugin: CPU Iteration count: 1000 Thread count: 2 |
FP32;ImageNET;4; Sync;Plugin: CPU Iteration count: 1000 Thread count: 4 |
FP32;ImageNET;8; Sync;Plugin: CPU Iteration count: 1000 Thread count: 1 |
FP32;ImageNET;8; Sync;Plugin: CPU Iteration count: 1000 Thread count: 2 |
FP32;ImageNET;8; Sync;Plugin: CPU Iteration count: 1000 Thread count: 4 |
FP32;ImageNET;1; Async;Plugin: CPU Async request count: 1 Iteration count: 1000 Stream count: 1 |
FP32;ImageNET;1; Async;Plugin: CPU Async request count: 2 Iteration count: 1000 Stream count: 2 |
FP32;ImageNET;2; Async;Plugin: CPU Async request count: 1 Iteration count: 1000 Stream count: 1 |
FP32;ImageNET;2; Async;Plugin: CPU Async request count: 2 Iteration count: 1000 Stream count: 2 |
FP32;ImageNET;4; Async;Plugin: CPU Async request count: 1 Iteration count: 1000 Stream count: 1 |
FP32;ImageNET;4; Async;Plugin: CPU Async request count: 2 Iteration count: 1000 Stream count: 2 |
FP32;ImageNET;8; Async;Plugin: CPU Async request count: 1 Iteration count: 1000 Stream count: 1 |
FP32;ImageNET;8; Async;Plugin: CPU Async request count: 2 Iteration count: 1000 Stream count: 2 |
|
|
|
|
|
|
|
|
|
|
|
|
Average time of single pass |
FPS |
|
Average time of single pass |
FPS |
|
Average time of single pass |
FPS |
|
Average time of single pass |
FPS |
|
Average time of single pass |
FPS |
|
Average time of single pass |
FPS |
|
Average time of single pass |
FPS |
|
Average time of single pass |
FPS |
|
|
alexnet |
|
|
|
|
densenet-121 |
|
|
|
|
densenet-161 |
|
|
|
|
densenet-169 |
|
|
|
|
densenet-201 |
|
|
|
|
googlenet-v1 |
|
|
|
|
googlenet-v2 |
|
|
|
|
googlenet-v3 |
|
|
|
|
googlenet-v4 |
|
|
|
|
inception-resnet-v2 |
|
|
|
|
mobilenet-ssd |
|
|
|
|
resnet-101 |
|
|
|
|
resnet-152 |
|
|
|
|
resnet-50 |
|
|
|
|
squeezenet1.0 |
|
|
|
|
squeezenet1.1 |
|
|
|
|
ssd300 |
|
|
|
|
ssd512 |
|
|
|
|
ssd_mobile_net_v2_coco |
|
|
|
|
vgg16 |
|
|
|
|
vgg19 |
|
|
|
|