Task type

Topology name

Framework

Input blob sizes

Batch size

CPU: Intel(R) Core(TM) i3-8100 CPU @ 3.60GHz, CPU family: x86_64, GPU: Intel(R) Gen9 HD Graphics, RAM size: 32757916 kB, OS family: Linux, OS version: Linux-5.3.0-51-generic-x86_64-with-Ubuntu-18.04-bionic, Python version: 3.6.9

OpenVINO DLDT

CPU

FP32
Latency Mode	Throughput Mode

INT8
Latency Mode	Throughput Mode

GPU

FP32
Latency Mode

FP16
Latency Mode

CPU: Intel(R) Core(TM) i7-8700 CPU @ 3.20GHz, CPU family: x86_64, GPU: Intel(R) Gen9 HD Graphics, RAM size: 65727564 kB, OS family: Linux, OS version: Linux-5.3.0-51-generic-x86_64-with-Ubuntu-18.04-bionic, Python version: 3.6.9

OpenVINO DLDT

CPU

FP32
Latency Mode	Throughput Mode

INT8
Latency Mode	Throughput Mode

GPU

FP32
Latency Mode

FP16
Latency Mode

MYRIAD

FP16
Throughput Mode

Object detection

face-detection-adas-0001

face-detection-retail-0004

face-detection-retail-0005

person-detection-retail-0013

pedestrian-detection-adas-0002

pedestrian-and-vehicle-detector-adas-0001

vehicle-detection-adas-0002

person-vehicle-bike-detection-crossroad-0078

person-vehicle-bike-detection-crossroad-1016

vehicle-license-plate-detection-barrier-0106

OpenVINO DLDT

1x3x384x672

1x3x300x300

1x3x320x544

1x3x384x672

1x3x1024x1024

1x3x512x512

1x3x300x300

95.226

99.792

90.393

99.095

N/A

48.271

55.724

71.86

96.114

251.291

311.997

259.328

304.387

N/A

125.422

170.007

150.436

244.744

263.296

268.78

N/A

106.839

136.127

139.794

148.993

100.39

92.752

78.411

80.695

N/A

51.924

58.371

74.881

67.889

92.994

97.923

85.977

98.398

N/A

51.108

59.866

77.228

100.679

71.388

73.502

65.329

73.538

N/A

41.906

47.408

65.466

83.932

94.364

98.534

87.345

99.272

N/A

52.637

61.035

80.951

102.333

32.782

35.659

31.191

34.169

N/A

24.834

27.392

33.14

30.972

69.416

73.597

N/A

39.926

46.202

57.662

83.349

370.915

418.743

N/A

168.179

197.463

155.158

174.836

122.012

132.042

N/A

56.677

65.125

82.092

108.489

23.46

24.809

401.446

552.218

407.828

486.199

N/A

138.016

190.715

167.264

271.694

122.271

127.593

416.742

496.756

N/A

120.077

155.316

154.566

167.841

51.342

52.377

179.998

172.286

107.204

92.634

N/A

63.582

66.746

84.655

77.007

15.469

15.848

151.326

170.45

120.065

134.174

N/A

60.959

69.361

88.179

114.041

24.392

24.484

120.741

130.664

94.935

99.113

N/A

49.472

55.039

74.981

94.845

20.001

20.365

154.632

169.249

122.095

134.786

N/A

61.537

70.822

93.753

116.13

23.969

25.032

51.317

55.636

41.077

45.884

N/A

28.729

31.215

37.679

35.121

7.468

7.472

114.611

113.629

N/A

45.974

52.681

65.298

94.558

15.87

15.555

569.375

550.797

N/A

198.585

222.109

73.538

Object recognition

age-gender-recognition-retail-0013

head-pose-estimation-adas-0001

license-plate-recognition-barrier-0001

landmarks-regression-retail-0009

facial-landmarks-35-adas-0002

person-attributes-recognition-crossroad-0230

gaze-estimation-adas-0002

OpenVINO DLDT

1x3x62x62

1x3x60x60

1x3x24x94, 88x1

1x3x48x48

1x3x60x60

1x3x160x80

1x3, 1x3x60x60, 1x3x60x60

1739.653

2252.962

2607.79

2986.068

N/A

600.215

1756.317

717.098

2037.43

1801.677

2332.737

2704.04

2914.438

N/A

537.525

1483.659

582.3

1764.815

799.982

932.969

N/A

277.199

315.836

6543.376

9975.892

13825.477

14589.93

N/A

1046.483

4545.439

1018.529

4298.544

653.013

1561.07

2410.433

3552.789

N/A

165.075

1100.109

178.527

1111.221

1028.52

1548.828

1494.164

1496.271

N/A

252.974

707.28

284.302

775.682

1271.001

1800.637

N/A

490.964

582.826

3043.762

4472.98

4230.795

5223.275

N/A

750.054

2027.948

873.268

2397.43

554.747

1111.137

2913.723

4517.558

4804.128

5604.384

N/A

666.927

1678.897

747.914

2055.276

464.519

861.756

1253.528

1584.87

N/A

324.16

366.731

364.379

7543.712

12704.391

20422.661

27055.597

N/A

1089.713

5201.431

1094.261

4675.273

507.586

1218.593

834.687

1831.085

2813.907

6040.701

N/A

182.401

1261.255

208.765

1286.202

248.587

362.011

1311.95

2459.46

2425.68

3057.795

N/A

322.701

781.408

362.202

856.636

264.128

363.129

2003.968

3104.42

N/A

604.628

754.914

445.094

Reidentification

face-reidentification-retail-0095

OpenVINO DLDT

1x3x128x128

342.197

417.449

414.836

392.371

N/A

166.295

309.593

193.786

500.469

550.289

781.929

715.462

606.16

N/A

187.313

362.692

248.008

555.5

83.693

88.163

Semantic segmentation

road-segmentation-adas-0001

semantic-segmentation-adas-0001

OpenVINO DLDT

1x3x512x896

1x3x1024x2048

26.975

27.101

22.789

24.315

N/A

19.894

18.75

32.024

20.822

3.648

4.107

3.62

4.057

N/A

4.028

4.25

6.262

7.714

38.676

37.916

26.433

26.821

N/A

23.062

21.666

37.427

23.64

N/A

5.228

6.123

5.097

6.11

N/A

4.779

5.005

7.174

8.949

N/A

Human pose estimation

human-pose-estimation-0001

OpenVINO DLDT

1x3x256x456

25.351

23.554

22.735

23.599

N/A

18.189

18.738

31.982

34.792

40.573

39.799

33.146

35.198

N/A

20.938

21.239

36.045

39.491

10.071

10.052

Image processing

single-image-super-resolution-1032

single-image-super-resolution-1033

OpenVINO DLDT

1x3x270x480, 1x3x1080x1920

1x3x360x640, 1x3x1080x1920

5.948

7.503

N/A

4.565

5.211

5.183

6.745

N/A

4.041

4.796

7.782

8.608

N/A

5.157

5.855

2.958

��.95

8.246

N/A

��.56

5.402

2.705

Action recognition

driver-action-recognition-adas-0002-encoder

driver-action-recognition-adas-0002-decoder

action-recognition-0001-encoder

action-recognition-0001-decoder

OpenVINO DLDT

1x3x224x224

1x16x512

1x3x224x224

1x16x512

366.251

438.509

421.877

427.312

N/A

185.228

242.821

235.45

438.987

32.209

37.455

N/A

132.442

128.506

51.159

52.281

54.35

53.285

N/A

37.687

43.744

65.041

80.352

99.942

114.815

N/A

138.166

134.532

503.095

647.723

672.582

636.278

N/A

206.861

273.619

261.327

504.601

92.104

95.959

54.905

100.631

N/A

144.164

141.786

168.988

80.243

84.143

88.607

85.872

N/A

43.419

49.705

74.187

90.749

52.966

54.341

142.055

279.196

N/A

150.145

147.515

157.193