Task type

Topology name

Framework

Input blob sizes

Batch size

CPU: Intel(R) Xeon(R) Gold 6138 CPU @ 2.00GHz CPU family: x86_64, GPU: None, RAM size: 526980036 kB, OS family: Linux OS version: Linux-5.8.0-53-generic-x86_64-with-Ubuntu-18.04-bionic, Python version: 3.6.9

OpenVINO DLDT

CPU

FP32
Latency Mode	Throughput Mode

INT8
Latency Mode	Throughput Mode

CPU: Intel(R) Core(TM) i7-8700 CPU @ 3.20GHz, CPU family: x86_64, GPU: Intel(R) Gen9 HD Graphics (iGPU), RAM size: 65727428 kB, OS family: Linux, OS version: Linux-5.4.0-52-generic-x86_64-with-Ubuntu-18.04-bionic, Python version: 3.6.9

OpenVINO DLDT

CPU

FP32
Latency Mode	Throughput Mode

INT8
Latency Mode	Throughput Mode

GPU

FP32
Latency Mode

FP16
Latency Mode

MYRIAD

FP16
Throughput Mode

CPU: Intel(R) Core(TM) i3-8100 CPU @ 3.60GHz, CPU family: x86_64, GPU: Intel(R) Gen9 HD Graphics (iGPU), RAM size: 32757700 kB, OS family: Linux, OS version: Linux-5.4.0-73-generic-x86_64-with-Ubuntu-18.04-bionic, Python version: 3.6.9

OpenVINO DLDT

CPU

FP32
Latency Mode	Throughput Mode

INT8
Latency Mode	Throughput Mode

GPU

FP32
Latency Mode

FP16
Latency Mode

MYRIAD

FP16
Throughput Mode

classification

alexnet

caffenet

densenet-121

densenet-161

densenet-169

densenet-201

densenet-121-tf

densenet-169-tf

efficientnet-b0

efficientnet-b0_auto_aug

efficientnet-b0-pytorch

efficientnet-b5

efficientnet-b5-pytorch

efficientnet-b7-pytorch

efficientnet-b7_auto_aug

googlenet-v1

googlenet-v2

googlenet-v3

googlenet-v3-pytorch

googlenet-v4-tf

googlenet-v1-tf

inception-resnet-v2-tf

mobilenet-v1-0.25-128

mobilenet-v1-0.50-160

mobilenet-v1-0.50-224

mobilenet-v1-1.0-224

mobilenet-v1-1.0-224-tf

mobilenet-v2

mobilenet-v2-pytorch

mobilenet-v2-1.4-224

mobilenet-v2-1.0-224

resnet-50-tf

resnet-50-pytorch

resnet-18-pytorch

se-inception

se-resnet-101

se-resnet-152

squeezenet1.0

squeezenet1.1

vgg16

vgg19

squeezenet1.1-caffe2

resnet-50-caffe2

vgg19-caffe2

densenet-121-caffe2

googlenet-v2-tf

mobilenet-v3-large-1.0-224-tf

mobilenet-v3-small-1.0-224-tf

octave-densenet-121-0.125

octave-resnet-26-0.25

octave-resnet-50-0.125

octave-resnet-101-0.125

octave-resnet-200-0.125

octave-resnext-50-0.25

octave-resnext-101-0.25

octave-se-resnet-50-0.125

Caffe

TensorFlow

PyTorch

TensorFlow

PyTorch

TensorFlow

Caffe

TensorFlow

PyTorch

TensorFlow

Caffe

TensorFlow

Caffe

PyTorch

TensorFlow

PyTorch

Caffe

Caffe2

TensorFlow

MXNet

1x3x227x227

1x3x224x224

1x3x456x456

1x3x600x600

1x3x224x224

1x3x299x299

1x3x224x224

1x3x299x299

1x3x128x128

1x3x160x160

1x3x224x224

1x3x227x227

1x3x224x224

1x3x227x227

1x3x224x224

470.009

749.503

1061.063

1370.34

N/A

376.294

758.309

1101.182

1409.721

N/A

115.764

474.355

290.595

437.178

N/A

51.913

191.36

119.834

180.7

N/A

80.729

379.498

223.06

368.691

N/A

62.251

294.318

172.397

278.11

N/A

113.349

474.625

287.79

441.167

N/A

81.012

380.824

225.282

368.666

N/A

289.42

1407.91

932.265

1635.669

N/A

288.586

1415.339

895.732

1622.145

N/A

283.762

1412.219

936.059

1644.683

N/A

32.77

88.984

61.629

82.887

N/A

32.752

89.09

62.693

83.147

N/A

12.689

26.124

18.79

25.814

N/A

12.948

26.247

19.583

25.714

N/A

313.846

922.973

725.618

1045.793

N/A

255.271

755.788

580.67

866.531

N/A

123.821

284.309

254.745

315.429

N/A

122.364

281.833

253.81

317.258

N/A

62.687

136.832

123.025

150.247

N/A

336.243

1002.297

766.759

1136.682

N/A

44.685

152.217

127.676

158.7

N/A

1122.664

11530.225

8714.678

16946.204

N/A

577.915

7042.894

5139.601

8499.163

N/A

813.38

4124.696

2951.816

4223.257

N/A

650.112

2174.978

1521.581

2153.072

N/A

657.033

2136.592

1512.466

2178.212

N/A

450.436

2187.336

1369.126

1969.6

N/A

527.173

2591.779

1615.845

2571.701

N/A

412.646

1652.528

1052.812

1660.188

N/A

540.175

2649.88

1560.935

2516.591

N/A

177.498

395.41

333.728

432.895

N/A

181.326

395.333

333.437

432.95

N/A

470.317

894.032

754.623

1028.736

N/A

209.852

719.089

524.01

834.667

N/A

71.455

206.988

152.474

219.299

N/A

48.916

139.941

105.203

147.878

N/A

646.44

1737.501

1353.623

1758.961

N/A

876.364

3131.494

2147.812

3123.109

N/A

82.265

102.023

106.921

117.336

N/A

68.352

85.893

84.733

94.006

N/A

668.921

3081.331

1940.754

2066.295

N/A

173.521

396.96

339.669

433.384

N/A

68.324

85.551

84.432

94.024

N/A

117.734

475.079

284.636

439.959

N/A

243.052

742.574

567.127

855.2

N/A

480.765

2750.035

1614.999

3154.932

N/A

646.919

3914.284

2808.75

4835.462

N/A

35.415

257.913

122.204

286.319

N/A

147.695

641.457

348.568

635.924

N/A

76.83

344.086

184.609

339.185

N/A

41.858

194.564

105.346

204.633

N/A

21.296

104.929

54.493

105.573

N/A

44.721

255.126

124.836

261.055

N/A

20.249

141.499

65.124

153.064

N/A

66.897

321.476

166.031

325.511

N/A

106.63

223.552

256.727

303.052

N/A

138.577

200.529

192.745

332.033

60.625

61.824

108.328

244.299

269.373

302.503

N/A

140.152

205.288

195.505

339.579

60.111

60.918

93.237

105.821

72.974

73.354

N/A

43.321

52.196

65.793

67.948

39.166

40.202

31.474

33.868

27.598

29.511

N/A

18.145

20.064

29.685

25.162

11.604

11.036

70.343

81.712

60.073

59.081

N/A

34.318

42.643

50.76

54.713

29.169

29.454

53.984

63.184

44.656

43.442

N/A

26.794

33.167

39.646

41.902

20.607

20.722

88.076

98.722

72.014

73.126

N/A

43.121

52.125

65.445

67.936

39.086

40.12

70.567

81.662

59.93

59.032

N/A

34.23

42.738

50.706

54.666

29.025

29.357

314.996

378.498

305.41

275.534

N/A

138.241

180.598

171.259

251.649

29.455

30.127

314.608

386.747

307.823

275.018

N/A

138.728

180.639

172.68

250.89

29.298

30.129

314.608

383.001

334.458

305.689

N/A

139.678

180.531

171.495

250.68

31.001

31.845

17.118

15.408

14.213

14.656

N/A

9.567

9.37

15.505

15.017

1.814

1.838

16.852

15.767

14.181

14.234

N/A

9.586

9.368

15.502

15.101

1.814

1.839

4.721

4.873

4.295

4.653

N/A

3.069

2.996

5.216

4.972

0.565

4.717

4.842

11780

4.649

N/A

3.068

2.996

5.216

4.967

0.564

169.783

183.582

171.644

178.667

N/A

83.299

102.626

113.625

167.356

92.845

95.105

132.232

146.932

144.229

145.519

N/A

70.247

84.497

108.338

147.831

86.929

90.04

49.676

53.326

51.466

53.531

N/A

25.687

29.105

41.324

49.971

20.745

21.239

49.796

54.075

51.53

54.219

N/A

25.718

29.148

41.407

50.141

20.812

21.219

23.916

25.344

24.79

25.237

N/A

12.078

13.369

20.458

24.927

10.392

10.371

191.805

203.75

189.313

199.232

N/A

91.727

108.088

140.397

185.897

111.831

116.718

27.76

28.911

28.929

28.55

N/A

13.077

14.947

21.643

27.443

9.035

9.448

5189.898

9049.278

12031.206

10708.363

N/A

1243.34

3243.093

1215.776

2987.38

358.455

646.385

2003.94

2911.702

2963.045

2273.198

N/A

726.938

1373.911

886.366

1825.789

276.744

337.227

1379.965

1637.005

1281.824

1049.119

N/A

500.3

752.01

667.293

1054.024

185.654

205.311

427.43

472.251

415.579

406.805

N/A

210.785

241.277

314.624

452.412

115.138

120.761

423.326

457.559

395.646

403.704

N/A

209.896

240.339

315.148

449.206

103.48

107.866

475.44

413.165

516.922

479.646

N/A

196.82

237.914

273.061

444.999

72.626

74.988

598.719

566.819

683.398

585.332

N/A

241.802

317.367

316.939

553.366

89.191

92.949

326.429

351.132

298.082

299.04

N/A

161.178

181.784

222.237

330.797

57.473

59.281

580.144

577.747

510.366

446.756

N/A

239.92

312.028

312.66

552.307

80.362

83.43

67.317

73.394

74.731

74.93

N/A

37.442

41.326

65.623

83.805

28.96

30.153

67.113

73.418

74.406

75.034

N/A

37.502

41.299

65.941

83.639

29.528

30.241

155.766

170.233

169.76

170.43

N/A

90.063

102.522

147.179

180.008

98.426

101.362

125.397

146.651

140.881

143.762

N/A

65.701

80.119

98.283

138.028

68.552

70.45

34.436

37.614

36.103

36.539

N/A

19.177

21.171

31.636

38.803

13.446

13.849

23.421

25.528

24.489

24.526

N/A

12.946

14.297

21.387

26.144

9.023

9.116

360.996

342.087

295.013

306.462

N/A

160.097

174.773

240.445

295.372

162.093

169.201

758.934

771.544

611.464

621.202

N/A

287.552

352.407

396.268

553.221

213.223

303.633

16.978

19.492

20.493

20.467

N/A

11.766

12.367

28.933

22.978

10.152

10.967

14.063

15.538

16.284

16.199

N/A

9.373

9.785

24.061

18.162

8.542

9.153

768.018

768.819

620.737

628.71

N/A

268.278

349.285

367.935

547.343

196.607

249.859

69.973

73.424

74.317

75.006

N/A

37.434

41.281

65.639

83.608

28.94

30.147

14.074

15.588

16.382

16.182

N/A

9.38

9.778

24.098

18.183

8.55

9.153

89.435

102.015

74.231

74.633

N/A

43.363

52.124

65.95

68.015

39.155

40.199

135.277

155.287

150.545

153.562

N/A

71.295

83.908

108.915

149.032

78.567

80.839

546.677

794.906

759.529

557.901

N/A

205.294

338.001

260.858

477.951

69.423

71.741

1341.88

2021.404

2349.298

1971.978

N/A

351.263

881.345

445.327

981.302

138.55

150.691

61.916

75.668

49.5

46.673

N/A

22.577

36.035

29.061

43.453

19.481

19.737

118.746

120.624

104.352

109.016

N/A

61.369

70.675

89.015

100.648

33.048

33.712

61.948

65.039

55.289

58.654

N/A

31.791

36.315

46.452

51.484

16.858

17.24

33.989

38.395

33.607

33.93

N/A

16.816

20.844

24.748

30.822

8.709

8.994

18.241

20.156

17.166

17.564

N/A

8.999

10.942

12.841

15.49

4.233

4.05

52.894

59.151

48.154

48.054

N/A

28.892

32.763

38.658

32.268

11.46

11.494

29.345

35.86

29.785

29.232

N/A

15.824

19.429

20.743

19.81

5.846

5.887

58.989

63.067

53.356

56.472

N/A

28.118

32.901

38.673

45.587

14.884

15.139

86.785

141.776

170.966

188.928

N/A

115.188

174.611

152.491

288.779

60.585

61.887

89.323

127.3

179.683

198.925

N/A

116.525

179.849

154.351

296.674

59.688

57.887

59.059

61.967

47.096

53.089

N/A

37.966

45.84

58.705

60.712

39.189

40.2

20.363

22.422

18.129

20.145

N/A

15.395

17.722

25.538

22.293

11.194

11.033

47.711

51.281

38.65

42.998

N/A

30.275

37.4

45.765

48.936

29.167

29.38

37.124

39.734

28.898

32.207

N/A

23.775

29.124

36.117

37.542

20.594

20.694

59.12

62.286

47.2

53.334

N/A

37.953

45.907

58.336

60.714

39.099

40.115

47.617

51.632

38.76

43.127

N/A

30.223

37.502

45.566

48.924

29.082

29.348

202.887

220.324

201.744

204.97

N/A

120.837

158.764

150.511

220.693

29.287

30.133

203.379

220.254

201.086

204.698

N/A

120.15

158.833

149.971

220.699

29.352

30.138

204.236

228.227

207.738

213.822

N/A

120.867

158.987

151.551

220.733

31.085

31.824

10.455

10.747

9.967

10.828

N/A

8.219

N/A

13.394

13.269

1.814

1.883

10.443

10.721

9.965

10.817

N/A

8.234

8.2

13.415

13.32

1.813

1.883

3.056

3.238

2.977

3.227

N/A

2.591

2.581

4.528

4.416

0.564

3.053

3.227

3.007

3.245

N/A

2.586

2.584

4.531

4.413

0.565

104.87

111.281

109.668

112.343

N/A

70.807

89.391

99.493

147.369

92.836

95.106

86.714

93.152

92.073

94.152

N/A

61.714

74.457

95.182

130.369

86.783

88.632

31.783

33.649

33.206

33.723

N/A

22.579

25.58

36.705

44.274

20.725

21.24

31.89

33.595

33.238

33.793

N/A

22.565

25.629

36.839

44.418

20.803

21.229

15.164

15.599

15.471

15.701

N/A

10.59

11.753

18.189

22.009

10.399

10.397

116.763

124.439

122.118

125.15

N/A

80.521

95.051

122.96

163.477

111.68

116.767

17.577

17.915

17.672

17.842

N/A

11.617

13.146

19.37

24.226

8.995

9.082

4274.107

6678.69

7543.754

5998.219

N/A

785.921

2700.24

819.541

2439.409

323.291

646.96

1340.92

1741.244

1677.571

1575.565

N/A

504.406

1117.179

595.768

1546.614

246.448

337.209

842.393

923.404

806.699

809.326

N/A

387.355

624.319

466.218

878.603

188.6

205.354

274.793

290.606

264.806

274.62

N/A

182.859

209.551

267.443

390.856

115.099

120.727

272.087

281.083

259.622

272.213

N/A

181.763

208.775

266.143

389.443

103.772

107.866

310.626

322.71

334.073

332.35

N/A

172.151

205.9

231.491

371.588

72.585

74.919

405.817

449.148

437.423

446.445

N/A

209.01

277.071

270.864

473.676

89.226

93.035

211.643

223.352

208.954

220.115

N/A

135.174

156.466

195.323

284.565

57.574

58.728

380.344

395.767

354.026

353.115

N/A

207.94

273.333

265.749

471.238

79.766

83.441

43.626

46.461

46.72

46.369

N/A

32.677

36.394

57.764

73.68

28.943

30.165

43.706

46.184

46.71

46.12

N/A

32.698

36.38

57.842

73.426

29.329

29.968

98.8

104.05

105.226

104.875

N/A

75.833

90.139

125.579

159.052

98.561

101.615

82.99

89.894

87.305

90.789

N/A

58.077

70.489

86.566

122.139

68.562

70.511

22.205

23.28

22.695

23.826

N/A

16.758

18.504

28.04

33.803

13.373

13.83

15.141

15.885

15.369

16.191

N/A

11.394

12.477

18.949

22.728

8.873

9.135

202.233

202.214

188.575

198.751

N/A

138.051

152.495

201.449

260.726

162.277

168.732

435.536

433.858

389.936

420.846

N/A

243.875

305.61

313.945

489.008

209.409

303.43

11.128

12.464

12.818

13.14

N/A

10.346

10.879

24.792

20.204

10.157

10.964

9.097

10.013

10.236

10.444

N/A

8.251

8.608

20.74

15.99

8.558

9.153

434.06

429.083

390.269

417.625

N/A

241.685

306.067

312.863

488.439

196.516

250.252

43.685

46.312

46.722

46.198

N/A

32.709

36.386

57.716

73.486

28.978

30.167

9.125

10.047

10.233

10.443

N/A

8.251

8.608

20.743

15.99

8.534

9.151

59.16

61.739

47.135

53.009

N/A

38.044

45.822

58.555

60.721

39.183

40.207

88.33

94.276

93.031

96.146

N/A

63.005

73.833

95.67

130.924

78.867

80.65

374.119

472.384

449.693

397.136

N/A

183.638

289.086

225.029

417.58

69.331

71.766

909.921

1359.467

1507.089

1108.763

N/A

297.121

738.759

325.099

833.12

138.687

150.755

39.851

43.081

32.155

35.593

N/A

19.974

31.376

25.839

29.498

19.485

19.735

73.531

76.841

69.415

75.876

N/A

52.009

61.862

77.946

89.03

33.052

33.714

39.408

41.162

36.568

40.586

N/A

27.35

31.877

41.029

45.624

16.79

17.239

22.427

23.705

21.359

23.285

N/A

15.074

18.195

22.115

27.235

8.722

8.992

11.969

12.475

10.905

12.156

N/A

5.217

9.537

6.582

12.477

4.243

4.513

34.866

36.343

31.328

34.891

N/A

25.074

28.719

34.399

28.809

11.445

11.484

19.571

21.544

18.436

20.472

N/A

13.922

16.972

18.401

17.576

5.844

5.887

37.531

39.366

35.132

38.928

N/A

24.024

28.825

34.29

40.57

14.265

15.136

semantic segmentation

deeplabv3

road-segmentation-adas-0001

semantic-segmentation-adas-0001

TensorFlow

OpenVINO DLDT

1x3x513x513

1x3x512x896

1x3x1024x2048

68.036

117.196

80.705

115.074

N/A

69.118

185.39

102.525

133.322

N/A

17.959

30.598

22.798

30.431

N/A

24.571

23.22

21.676

22.688

N/A

11.841

12.915

19.591

23.368

3.529

3.538

46.625

37.12

28.923

26.763

N/A

25.665

24.004

43.115

25.999

5.629

5.638

6.554

5.588

6.446

N/A

5.474

5.537

9.113

9.46

15.594

16.642

15.313

16.611

N/A

9.796

10.815

16.825

20.893

3.529

3.548

30.208

26.324

24.127

24.179

N/A

21.304

20.862

35.641

22.745

5.628

4.047

4.084

4.025

3.992

N/A

4.686

4.754

7.979

8.339

detection

ssd300

ssd512

ssd_mobilenet_v1_coco

mobilenet-ssd

ssd_mobilenet_v1_fpn_coco

ssd_mobilenet_v2_coco

yolo-v1-tiny-tf

yolo-v2-tiny-tf

yolo-v2-tf

ssd_resnet50_v1_fpn_coco

Caffe

TensorFlow

Caffe

TensorFlow

TensorFlow.js

Keras

TensorFlow

1x3x300x300

1x3x512x512

1x3x300x300

1x3x640x640

1x3x300x300

1x3x416x416

1x3x608x608

1x3x640x640

45.734

60.635

53.261

60.739

N/A

17.176

20.894

18.688

21.093

N/A

202.949

860.329

426.912

555.297

N/A

303.35

1049.508

699.486

1040.657

N/A

16.052

27.337

17.044

27.915

N/A

174.131

641.414

371.507

691.629

N/A

290.697

477.832

383.845

459.655

N/A

309.035

574.296

409.338

573.09

N/A

40.632

58.663

52.509

58.511

N/A

12.174

19.279

13.747

19.788

N/A

10.309

10.285

10.284

10.196

N/A

5.69

5.854

12.22

10.083

4.135

4.304

3.534

3.548

3.496

3.528

N/A

2.196

2.075

4.078

3.851

1.514

1.56

184.772

202.8

173.834

187.362

N/A

84.485

99.154

117.817

158.264

44.551

42.198

222.553

252.472

196.22

203.232

N/A

106.162

118.285

156.052

201.383

56.184

56.519

4.95

5.024

4.842

5.015

N/A

2.864

2.912

5.026

4.663

2.008

2.046

120.605

133.332

121.549

133.615

N/A

52.211

60.936

78.891

112.985

30.254

30.728

81.344

83.198

82.024

83.439

N/A

49.788

49.686

74.973

82.087

48.447

48.559

104.244

107.312

103.476

107.445

N/A

59.374

63.3

89.447

101.882

58.57

59.239

9.986

10.005

10.038

9.942

N/A

5.42

5.656

11.018

10.583

3.058

3.234

3.511

3.542

3.496

3.547

N/A

2.003

2.037

3.593

3.403

1.401

1.436

6.355

6.205

6.344

5.876

N/A

4.958

5.112

10.62

8.773

4.177

3.923

2.198

2.078

2.178

2.048

N/A

1.915

1.819

3.543

3.369

1.514

1.346

118.788

125.331

115.495

126.503

N/A

73.256

87.091

104.541

139.832

44.603

42.399

138.413

140.443

131.166

138.77

N/A

90.786

103.66

136.356

176.749

56.188

57.395

3.042

3.198

2.991

3.207

N/A

2.503

2.549

4.394

4.077

2.009

2.048

74.389

81.32

78.301

84.387

N/A

45.079

53.228

69.361

99.217

30.254

30.717

51.454

52.636

52.059

53.029

N/A

41.432

43.576

59.685

72.257

48.43

48.564

65.006

67.382

65.789

68.071

N/A

49.995

55.591

74.875

89.97

58.6

59.242

6.314

6.429

6.341

6.446

N/A

4.826

4.942

9.764

9.296

3.058

2.942

2.151

2.244

2.178

2.251

N/A

1.724

1.755

3.147

2.994

1.383

1.437

object detection

face-detection-adas-0001

face-detection-retail-0004

face-detection-retail-0005

person-detection-retail-0002

person-detection-retail-0013

person-detection-action-recognition-0005

person-detection-action-recognition-0006

person-detection-action-recognition-teacher-0002

pedestrian-detection-adas-0002

pedestrian-and-vehicle-detector-adas-0001

person-vehicle-bike-detection-crossroad-0078

person-vehicle-bike-detection-crossroad-1016

vehicle-detection-adas-0002

product-detection-0001

yolo-v2-ava-0001

yolo-v2-ava-sparse-35-0001

yolo-v2-ava-sparse-70-0001

yolo-v2-tiny-ava-0001

yolo-v2-tiny-ava-sparse-30-0001

yolo-v2-tiny-ava-sparse-60-0001

OpenVINO DLDT

1x3x384x672

1x3x300x300

1x3x544x992, 1x6

1x3x320x544

1x3x400x680

1x3x384x672

1x3x1024x1024

1x3x512x512

1x3x384x672

1x3x512x512

1x3x416x416

182.486

515.222

371.263

535.272

N/A

485.454

1842.811

1036.834

1969.517

N/A

357.373

1536.169

972.299

1398.095

N/A

42.787

109.957

48.452

69.311

N/A

180.977

779.615

581.499

550.463

N/A

50.912

253.27

137.418

89.644

N/A

73.018

263.258

176.569

187.929

N/A

88.51

313.319

217.422

214.905

N/A

188.178

615.07

368.132

533.94

N/A

169.334

513.691

321.682

471.796

N/A

96.944

192.282

197.49

183.456

N/A

147.959

465.377

281.098

369.221

N/A

211.853

569.078

N/A

144.128

434.014

281.243

382.883

N/A

81.194

124.561

108.778

123.666

N/A

81.049

124.078

109.181

124.185

N/A

80.638

125.601

110.496

125.392

N/A

288.544

476.322

375.162

471.738

N/A

286.609

475.936

372.388

469.979

N/A

288.729

473.776

361.85

461.548

N/A

163.242

146.017

115.508

116.475

N/A

64.869

70.495

97.639

113.981

23.079

24.284

465.29

548.206

451.641

475.012

N/A

174.003

195.2

220.801

295.505

121.0

126.384

485.246

500.033

401.601

385.127

N/A

149.47

167.539

201.14

173.988

50.398

51.451

33.968

35.056

25.868

29.935

N/A

16.436

18.445

21.983

22.258

10.869

10.931

202.83

179.711

112.993

93.914

N/A

72.337

69.301

102.041

79.582

15.67

15.192

66.164

56.64

42.055

37.081

N/A

16.305

16.605

22.579

35.6

7.126

7.244

59.208

46.466

35.968

31.812

N/A

15.201

14.907

21.228

33.157

6.578

6.699

66.44

56.9

42.109

37.183

N/A

16.342

16.529

22.676

35.521

7.129

7.336

145.979

142.607

110.552

111.385

N/A

67.495

74.137

106.537

120.312

23.824

24.016

116.479

111.324

88.525

88.16

N/A

54.818

59.046

88.602

99.193

19.438

20.173

63.655

58.457

48.177

48.734

N/A

34.8

35.188

47.996

39.156

7.314

7.301

118.043

104.588

89.302

97.952

N/A

55.289

56.747

87.362

98.884

15.767

15.765

149.767

141.956

N/A

69.924

113.367

23.544

117.341

102.061

87.38

97.266

N/A

55.566

58.093

88.262

102.676

16.023

16.111

20.474

20.71

20.953

20.79

N/A

12.389

12.54

27.177

22.549

12.605

13.32

20.488

20.735

20.967

20.78

N/A

12.373

12.55

27.169

22.562

12.634

13.546

20.08

20.823

21.123

20.87

N/A

12.38

12.542

27.162

22.547

12.712

13.541

82.371

83.221

81.706

83.182

N/A

49.859

49.745

75.359

81.001

49.157

49.337

82.492

83.529

81.877

83.389

N/A

49.88

49.659

75.667

80.785

49.16

49.332

83.205

83.652

82.092

83.798

N/A

49.944

49.679

75.559

80.86

49.178

49.34

92.326

93.325

84.32

92.957

N/A

52.991

58.893

82.573

98.85

23.044

24.287

283.278

315.239

276.972

307.251

N/A

151.306

168.884

186.513

258.004

121.451

126.28

293.873

273.971

260.82

274.244

N/A

127.514

143.204

173.726

151.358

50.412

51.53

26.04

23.965

18.431

22.203

N/A

14.614

16.256

19.409

19.467

10.966

11.112

107.101

92.058

80.441

80.827

N/A

57.815

59.763

87.887

69.848

15.682

15.239

39.075

34.857

29.647

31.808

N/A

14.464

14.836

19.674

30.995

7.129

7.346

33.494

29.836

26.072

27.603

N/A

13.37

13.422

18.327

28.913

6.589

6.688

39.056

34.755

30.119

31.798

N/A

14.428

14.777

19.663

30.875

7.128

7.346

88.574

90.023

81.763

90.281

N/A

56.088

62.88

89.218

104.231

23.842

24.107

67.983

69.994

63.681

70.441

N/A

44.993

49.529

74.33

86.671

19.553

20.157

38.05

37.038

34.71

35.62

N/A

28.831

30.38

41.98

34.218

7.297

7.03

73.876

71.056

66.711

72.177

N/A

46.557

48.458

75.474

84.871

15.747

15.755

88.66

90.713

N/A

57.571

93.346

23.546

73.161

70.98

67.022

72.201

N/A

47.258

49.69

78.202

89.104

16.006

16.177

N/A

13.276

13.156

13.263

N/A

10.293

11.031

22.814

19.843

12.597

13.537

13.011

13.254

13.147

13.272

N/A

10.295

11.031

22.812

19.842

12.094

10.547

13.052

13.249

13.136

13.253

N/A

10.289

11.031

22.813

19.845

12.561

13.544

51.105

52.518

51.552

52.798

N/A

41.483

43.626

60.721

71.094

49.123

49.576

51.069

52.512

51.63

52.734

N/A

41.452

43.628

60.676

71.081

49.133

49.329

51.161

52.531

51.573

52.774

N/A

41.445

43.624

60.707

71.125

49.116

49.334

object recognition

age-gender-recognition-retail-0013

head-pose-estimation-adas-0001

license-plate-recognition-barrier-0001

landmarks-regression-retail-0009

facial-landmarks-35-adas-0002

person-attributes-recognition-crossroad-0230

gaze-estimation-adas-0002

OpenVINO DLDT

1x3x62x62

1x3x60x60

Undefined

1x3x48x48

1x3x60x60

1x3x160x80

1x3, 1x3x60x60, 1x3x60x60

2639.435

15196.203

12579.882

25719.106

N/A

2148.865

12869.437

10615.754

26037.447

N/A

3271.406

24521.354

20735.541

81622.484

N/A

318.866

4780.891

1596.811

17857.468

N/A

475.11

5594.36

2634.992

9795.813

N/A

1768.806

10510.144

N/A

3719.283

4791.338

4616.192

5131.248

N/A

1157.121

2328.239

1407.662

2763.213

563.332

1146.884

3777.591

4790.78

5153.811

5117.797

N/A

929.127

1894.097

1006.9

2353.497

461.525

883.213

N/A

10721.791

16634.096

24488.796

28489.873

N/A

2413.955

7625.006

1895.771

6503.431

431.68

1198.034

831.46

1948.133

3013.563

6418.157

N/A

209.685

1459.012

246.262

1550.0

247.753

358.406

1482.553

2550.793

2571.981

2797.803

N/A

396.106

871.561

456.863

840.623

253.854

356.805

2984.411

3807.452

N/A

834.945

1064.06

440.165

1934.973

2397.597

2698.718

2975.659

N/A

677.79

1851.65

816.002

2151.332

530.563

1118.523

2038.196

2425.857

2803.487

2859.707

N/A

601.76

1552.045

643.467

1897.884

442.45

876.433

N/A

8568.099

12747.172

15337.835

14924.516

N/A

1181.804

5212.84

1083.853

4784.374

464.877

1193.627

623.852

1873.292

2508.236

4045.533

N/A

201.928

1269.976

220.033

1365.262

247.216

355.98

1102.708

1514.801

1508.518

1399.067

N/A

294.506

770.868

339.327

744.967

249.619

356.758

1576.639

1943.206

N/A

567.425

648.073

424.94

reidentification

face-reidentification-retail-0095

OpenVINO DLDT

1x3x128x128

431.512

3170.923

1786.163

4056.729

N/A

694.376

938.479

800.726

656.571

N/A

225.498

399.041

300.784

588.179

100.412

104.77

446.448

510.034

470.643

467.943

N/A

191.917

338.174

225.787

511.507

100.548

104.771

human pose estimation

human-pose-estimation-0001

OpenVINO DLDT

1x3x256x456

121.863

224.067

203.237

219.909

N/A

41.481

40.14

35.269

35.233

N/A

21.732

21.885

38.806

39.89

9.924

10.002

25.526

24.423

23.191

24.405

N/A

18.811

19.27

34.092

35.131

9.921

10.006

image processing

single-image-super-resolution-1032

single-image-super-resolution-1033

OpenVINO DLDT

1x3x270x480, 1x3x1080x1920

1x3x360x640, 1x3x1080x1920

24.551

32.422

N/A

22.567

29.489

21.067

29.124

N/A

10.243

10.513

N/A

10.69

14.163

2.962

8.058

8.414

7.731

8.213

N/A

8.31

8.351

11.336

12.767

2.661

N/A

7.442

7.845

N/A

9.527

12.803

2.949

5.858

6.423

5.708

6.068

N/A

7.338

7.388

10.087

11.253

2.658

N/A