Task type

Topology name

Framework

Input blob sizes

Batch size

CPU: Intel(R) Xeon(R) Gold 6138 CPU @ 2.00GHz, CPU family: x86_64, GPU: Undefined, RAM size: 526963328 kB, OS family: Linux, OS version: Linux-5.15.0-52-generic-x86_64-with-Ubuntu-18.04-bionic, Python version: 3.6.9

OpenVINO DLDT

CPU

FP32
Latency Mode	Throughput Mode

INT8
Latency Mode	Throughput Mode

CPU: Intel(R) Core(TM) i7-8700 CPU @ 3.20GHz, CPU family: x86_64, GPU: Intel(R) UHD Graphics 630 [0x3e92] (iGPU), RAM size: 65714756 kB, OS family: Linux, OS version: Linux-5.15.0-52-generic-x86_64-with-Ubuntu-18.04-bionic, Python version: 3.6.9

OpenVINO DLDT

CPU

FP32
Latency Mode	Throughput Mode

INT8
Latency Mode	Throughput Mode

GPU

FP32
Latency Mode

FP16
Latency Mode

INT8
Latency Mode

MYRIAD

FP16
Throughput Mode

CPU: Intel(R) Core(TM) i3-8100 CPU @ 3.60GHz, CPU family: x86_64, GPU: Intel(R) UHD Graphics 630 [0x3e91] (iGPU), RAM size: 32753200 kB, OS family: Linux, OS version: Linux-5.4.0-131-generic-x86_64-with-Ubuntu-18.04-bionic, Python version: 3.6.9

OpenVINO DLDT

CPU

FP32
Latency Mode	Throughput Mode

INT8
Latency Mode	Throughput Mode

GPU

FP32
Latency Mode

FP16
Latency Mode

INT8
Latency Mode

MYRIAD

FP16
Throughput Mode

classification

alexnet

caffenet

densenet-121

densenet-121-tf

efficientnet-b0

efficientnet-b0-pytorch

hbonet-0.25

googlenet-v1

googlenet-v2

googlenet-v3

googlenet-v3-pytorch

googlenet-v4-tf

googlenet-v1-tf

inception-resnet-v2-tf

mobilenet-v1-0.25-128

mobilenet-v1-1.0-224

mobilenet-v1-1.0-224-tf

mobilenet-v2

mobilenet-v2-pytorch

mobilenet-v2-1.4-224

mobilenet-v2-1.0-224

resnet-50-tf

resnet-50-pytorch

resnet-18-pytorch

resnet-34-pytorch

se-inception

se-resnet-50

se-resnext-50

squeezenet1.0

squeezenet1.1

vgg16

vgg19

googlenet-v2-tf

mobilenet-v3-large-1.0-224-tf

mobilenet-v3-small-1.0-224-tf

octave-resnet-26-0.25

pelee-coco

retinanet-tf

Caffe

TensorFlow

PyTorch

Caffe

TensorFlow

PyTorch

TensorFlow

Caffe

TensorFlow

Caffe

PyTorch

TensorFlow

PyTorch

Caffe

TensorFlow

MXNet

Caffe

TensorFlow

1x3x227x227

1x3x224x224

1x224x224x3

1x3x224x224

1x299x299x3

1x3x299x299

1x299x299x3

1x224x224x3

Undefined

1x128x128x3

1x3x224x224

1x224x224x3

1x3x224x224

1x224x224x3

1x3x224x224

1x3x227x227

1x3x224x224

1x224x224x3

Undefined

1x3x304x304

1x1333x1333x3

477.975

732.413

1136.06

1556.061

738.775

1736.658

1674.088

2430.811

473.463

696.21

1177.285

1596.058

803.195

1895.803

1793.597

2598.039

120.644

487.045

254.609

457.096

158.511

674.554

517.91

834.632

115.956

478.815

248.229

450.539

161.364

662.139

504.316

826.199

291.102

1317.874

636.507

1533.368

320.494

1528.547

855.64

1963.742

291.837

1338.278

636.94

1555.035

330.211

1537.39

850.04

1975.606

250.983

2389.499

857.814

3755.402

375.24

3276.713

1788.631

4902.449

312.329

894.075

681.614

1006.787

374.066

1189.267

980.633

1399.84

256.592

732.661

557.7

856.302

332.376

1137.385

938.021

1334.304

123.793

284.549

240.093

310.804

182.816

441.041

395.006

496.285

125.169

284.798

242.131

309.981

190.022

436.941

395.684

500.176

64.363

136.768

119.846

146.936

102.536

216.618

195.189

240.249

328.89

954.834

717.112

1092.339

438.205

1448.014

1222.06

1699.984

1189.443

6980.13

7830.67

17734.319

1348.758

6978.887

8968.369

19801.102

630.414

2123.92

1505.126

2192.427

969.065

2963.04

2605.306

3499.413

616.274

2063.293

1511.17

2186.5

935.099

2888.003

2605.136

3431.966

429.804

2074.056

1314.448

1986.962

550.663

2844.12

2210.813

3401.079

522.722

2582.903

1654.913

2691.742

537.928

3312.278

2588.863

4423.916

393.386

1549.717

1039.794

1588.721

497.875

2337.544

1959.442

2788.681

511.311

2521.87

1497.897

2685.106

554.464

3330.914

2648.291

4196.947

176.031

389.063

335.851

432.917

309.363

613.587

558.514

685.071

172.572

393.352

339.18

433.096

313.504

623.028

564.308

686.073

463.892

869.402

775.154

1031.014

687.786

1413.483

1261.291

1520.379

261.903

470.723

422.447

535.212

371.636

749.091

685.839

824.568

208.563

691.002

440.933

809.592

263.836

1025.08

737.479

1264.49

130.77

376.441

226.822

400.308

197.403

563.111

387.769

651.597

106.797

292.212

194.555

308.335

201.112

482.766

353.34

555.559

627.675

1669.742

1027.978

1487.069

801.355

2306.38

1813.5

2494.87

854.243

3030.669

1740.587

2721.074

900.893

3771.697

2940.234

4420.782

81.543

103.466

108.511

114.59

140.791

178.935

179.099

191.409

68.987

85.689

88.104

91.908

117.057

144.184

143.598

152.179

243.906

719.055

538.848

837.57

272.954

944.699

796.824

1127.909

424.882

2309.872

1157.402

2880.693

461.936

2910.32

1593.938

3940.776

618.835

3786.225

1954.142

5017.258

566.474

3742.235

2537.333

6876.345

153.017

709.702

316.731

757.136

N/A

03.04

4.478

4.145

4.429

N/A

108.106

223.552

258.77

304.505

233.232

421.792

580.316

584.874

131.825

192.897

188.062

331.875

125.295

193.272

59.279

57.389

108.328

212.283

270.468

318.123

247.903

420.531

665.876

725.578

128.861

197.632

191.308

338.484

126.858

198.503

58.78

59.585

94.126

111.413

75.576

74.182

147.588

189.609

172.276

183.98

42.489

51.956

62.398

67.187

41.176

50.778

38.66

39.636

93.572

110.673

73.919

72.781

144.999

188.4

169.937

179.925

41.332

50.616

60.791

63.312

40.194

49.555

37.558

38.581

293.667

380.979

306.202

279.037

340.961

467.515

403.383

494.294

128.897

182.56

155.905

268.745

119.344

170.637

28.075

29.313

295.038

393.061

334.384

320.383

343.047

470.909

409.875

502.24

128.856

182.741

155.923

268.737

118.334

170.729

30.287

30.743

744.532

1209.711

1243.839

783.609

1019.25

1682.81

1607.692

2261.085

194.617

481.276

223.648

568.173

155.54

402.015

116.9

125.465

169.398

206.023

184.729

182.45

294.262

339.097

276.279

317.014

80.906

101.697

87.929

166.624

68.206

88.094

89.792

93.031

140.371

169.154

159.647

148.731

269.103

308.189

296.982

301.18

69.333

84.263

87.522

146.846

69.027

83.267

85.042

86.754

53.409

60.883

51.693

53.287

99.398

114.499

102.599

107.107

26.677

29.024

44.273

50.753

26.357

28.782

19.894

20.911

54.304

58.885

51.952

53.591

99.654

114.708

103.506

107.987

26.706

29.077

44.644

50.629

26.392

28.854

20.746

20.97

26.086

26.121

23.838

24.663

48.298

53.839

47.922

49.196

12.253

13.344

21.188

25.071

12.483

13.267

10.405

10.52

188.321

224.526

203.407

193.395

357.769

406.889

389.273

399.427

80.224

107.194

114.708

184.415

82.974

106.081

104.22

109.822

4527.755

6288.604

12161.798

11080.598

5232.52

6716.636

12770.21

14008.289

1075.384

2943.396

1074.413

2990.402

977.072

2788.965

323.594

554.68

410.565

511.588

428.322

466.392

715.83

839.332

760.751

886.876

189.3

236.331

284.042

446.534

193.087

231.395

111.155

116.757

410.204

510.539

397.389

433.365

706.498

834.397

747.697

867.994

181.214

237.349

300.011

451.261

187.105

229.917

97.051

100.777

462.207

523.094

528.513

503.188

643.49

815.174

711.01

848.36

164.382

233.941

224.215

435.097

128.617

225.02

70.105

72.148

580.47

658.266

688.495

624.541

809.844

1053.718

940.972

1143.346

196.356

313.361

277.06

553.418

183.683

299.282

85.467

89.043

319.99

334.227

305.523

299.657

506.656

648.101

547.02

676.271

127.41

179.261

181.98

329.094

126.745

172.681

55.246

56.929

552.943

670.372

514.852

447.754

808.77

1051.677

918.699

1096.32

192.757

308.055

271.227

545.375

181.453

294.914

77.895

80.876

71.49

80.584

74.48

75.047

126.082

154.255

138.18

145.723

37.008

41.262

64.751

82.976

36.595

40.427

28.376

29.468

71.855

82.39

74.674

75.249

126.562

154.66

136.602

146.297

37.071

41.131

64.471

82.888

36.641

40.507

29.628

30.077

165.558

188.971

187.811

170.919

341.911

362.61

342.523

351.329

88.697

101.926

134.303

179.281

87.668

100.699

97.491

100.3

84.705

96.081

87.327

84.844

172.123

187.665

173.332

175.45

45.159

51.286

76.624

91.207

44.783

50.839

52.319

53.647

132.249

161.672

142.637

144.548

243.504

292.586

283.48

297.372

63.471

80.026

92.754

136.053

63.445

78.897

66.43

68.386

68.141

76.834

66.485

69.227

112.511

148.257

130.769

142.796

36.225

40.113

59.406

72.36

35.867

39.372

26.227

27.22

57.566

64.947

55.737

58.883

102.026

129.609

110.024

122.727

28.131

29.09

49.212

42.499

27.354

28.84

18.058

18.141

360.339

374.735

245.726

250.311

583.019

650.653

606.504

622.309

153.324

173.152

178.788

288.825

137.369

169.624

158.52

167.235

755.332

796.638

499.152

480.52

1088.419

1286.24

1252.431

1270.832

202.581

351.529

375.759

536.085

205.414

342.781

216.724

296.62

17.663

20.487

20.476

20.582

32.538

39.143

35.896

38.984

11.719

12.352

28.749

22.885

11.648

12.302

10.021

10.632

14.751

16.488

16.297

16.267

26.658

30.708

28.372

30.905

9.354

9.774

23.923

18.128

9.309

9.751

8.423

8.461

141.794

168.257

157.264

152.436

249.916

291.226

275.049

283.644

69.137

83.862

101.53

147.977

68.947

83.049

74.85

77.022

458.353

713.077

633.267

504.369

726.97

1043.095

906.748

1183.62

178.265

299.807

227.398

395.146

161.721

287.293

63.533

65.523

1045.54

1716.328

1847.814

1557.009

1453.401

2171.972

2118.876

2799.686

307.582

733.571

366.751

963.378

263.596

680.476

117.466

126.5

148.069

199.05

134.472

142.266

N/A

52.768

72.773

69.413

100.933

N/A

32.034

33.788

0.807

0.808

0.787

0.802

N/A

0.406

0.409

0.731

0.751

N/A

87.539

123.44

170.052

193.807

168.024

213.736

340.961

355.517

109.805

169.123

145.584

283.702

110.589

169.649

59.136

61.261

89.607

133.865

178.276

198.451

178.928

221.637

401.683

416.379

110.086

173.819

146.878

292.875

111.597

174.853

59.093

59.081

59.755

62.414

46.97

52.688

93.082

106.395

102.718

104.182

36.594

45.67

53.985

60.182

35.431

44.682

38.73

39.718

59.123

61.464

46.22

51.721

92.486

105.361

101.225

103.45

35.859

44.566

52.786

56.353

34.738

43.593

37.581

38.596

194.684

214.274

195.177

201.391

209.684

242.902

246.682

253.945

107.469

159.337

131.788

234.586

100.669

149.144

28.121

29.303

196.821

222.651

203.659

212.081

212.261

244.419

251.439

256.527

107.638

159.726

131.969

234.079

100.702

149.336

30.401

30.757

522.766

840.831

681.976

560.158

686.864

930.777

1015.807

1092.585

155.265

411.395

166.093

494.312

128.683

343.418

117.763

120.63

105.076

111.773

106.088

110.281

176.068

178.839

175.752

182.517

68.177

88.645

80.836

146.16

57.479

76.59

90.016

93.057

86.914

94.277

90.682

93.132

159.501

174.294

177.394

177.858

59.559

73.791

88.995

127.758

59.115

73.297

84.834

86.762

31.828

33.748

32.32

33.346

59.694

64.134

63.832

64.095

23.439

25.479

39.206

44.715

22.976

25.289

19.931

20.91

32.1

33.816

32.501

33.615

59.87

64.354

64.329

64.389

23.444

25.531

39.282

44.655

23.171

25.342

20.719

20.966

15.26

15.74

15.024

15.552

28.413

29.995

29.486

29.522

10.749

11.736

18.591

22.048

10.927

11.663

10.368

10.53

116.352

124.87

117.1

121.717

211.624

229.384

230.934

232.778

76.065

93.826

111.497

161.73

76.19

92.908

104.179

109.86

3632.361

5751.523

6731.856

5365.086

4036.294

6329.468

7446.183

7687.583

517.727

2215.869

534.236

2188.923

492.738

2173.093

321.099

555.698

270.887

290.06

265.991

276.774

428.565

450.27

464.33

461.315

164.543

205.768

231.656

379.474

160.344

200.154

111.348

116.941

268.74

277.526

249.297

266.837

424.835

445.08

450.978

452.362

162.086

204.88

232.907

378.683

157.954

199.048

97.235

100.877

305.695

323.55

332.059

334.86

388.49

419.809

432.98

427.991

152.976

202.822

196.581

362.946

143.42

196.05

70.002

72.073

401.034

447.645

437.414

451.965

500.959

548.636

582.369

582.455

179.926

273.582

225.082

466.353

171.873

261.381

85.665

89.018

211.055

222.764

206.392

221.161

310.181

339.182

346.705

346.541

122.458

156.598

171.141

276.599

116.531

150.226

55.212

56.818

364.919

393.181

347.978

349.415

498.11

550.707

560.978

571.13

179.074

269.547

221.351

465.072

171.851

257.406

76.962

79.709

43.802

46.864

46.813

47.349

80.461

85.206

85.678

85.878

31.787

36.159

55.063

72.457

31.474

35.528

28.427

29.479

43.831

47.132

46.913

46.676

80.875

85.44

86.224

86.116

31.957

36.147

55.311

72.929

31.576

35.595

29.604

30.086

98.945

104.981

105.536

106.175

194.977

203.566

207.467

208.631

72.51

89.328

116.494

158.201

71.348

88.453

97.611

100.319

50.475

53.278

53.485

53.439

100.385

105.373

106.707

107.522

38.133

44.949

64.186

80.549

37.872

44.59

52.082

51.849

83.301

90.203

86.151

89.808

147.587

166.951

169.824

171.302

54.831

70.157

79.577

119.402

54.855

69.301

66.491

68.389

41.696

43.519

42.673

45.069

73.976

81.248

81.51

82.881

30.885

35.068

51.281

63.374

30.627

34.436

26.159

27.22

35.327

37.788

35.649

37.708

65.167

69.981

69.721

70.237

24.602

26.517

43.058

37.709

24.048

25.563

18.01

18.147

199.503

201.926

157.116

159.867

340.324

343.975

335.703

337.538

128.87

151.447

177.582

254.554

128.771

148.122

159.343

167.301

428.293

411.493

321.826

351.559

667.815

702.896

698.765

698.395

214.62

299.243

266.808

464.981

203.955

293.646

204.748

297.91

11.139

12.585

12.854

13.222

21.464

22.524

24.525

24.585

10.31

10.874

24.503

20.121

10.255

10.834

9.133

10.089

10.26

10.467

17.695

18.322

19.478

19.494

8.226

8.605

20.525

15.938

8.191

8.576

88.264

94.933

91.006

94.687

148.425

163.885

163.741

166.658

60.144

73.801

89.394

129.756

59.385

72.855

75.048

77.268

334.71

417.783

390.688

371.581

458.473

563.433

582.532

603.61

152.29

255.665

187.396

337.226

143.371

244.574

63.711

65.514

721.637

1124.763

1125.31

977.463

999.203

1320.038

1377.951

1542.653

234.254

600.869

265.243

786.49

212.987

566.641

118.033

126.566

96.223

111.859

88.178

99.611

N/A

47.063

66.625

60.805

92.981

N/A

34.324

35.462

0.505

N/A

0.5

N/A

0.352

N/A

0.629

0.661

N/A

semantic segmentation

deeplabv3

road-segmentation-adas-0001

semantic-segmentation-adas-0001

TensorFlow

OpenVINO DLDT

1x513x513x3

1x3x512x896

1x3x1024x2048

68.58

125.883

84.161

113.314

N/A

71.542

193.135

106.56

127.109

N/A

19.714

34.799

24.48

29.353

N/A

25.653

23.592

21.549

22.437

N/A

13.839

13.756

26.829

26.568

N/A

3.498

3.397

46.109

36.522

28.803

26.967

N/A

25.407

24.133

42.029

26.495

N/A

5.607

5.747

6.664

5.785

6.359

N/A

5.404

5.453

8.889

9.208

N/A

15.714

16.533

15.308

16.456

N/A

11.328

11.512

22.179

23.563

N/A

3.497

3.211

30.047

26.754

24.261

24.251

N/A

21.291

21.502

33.956

23.274

N/A

5.613

3.822

4.175

3.563

3.886

N/A

4.608

4.685

7.86

8.153

N/A

detection

ssd300

ssd512

ssd_mobilenet_v1_coco

mobilenet-ssd

ssd_mobilenet_v1_fpn_coco

yolo-v1-tiny-tf

yolo-v2-tiny-tf

Caffe

TensorFlow

Caffe

TensorFlow

TensorFlow.js

Keras

1x3x300x300

1x3x512x512

1x3x300x300

1x640x640x3

1x416x416x3

43.207

60.187

51.36

59.709

N/A

17.642

20.661

19.358

20.569

N/A

202.949

860.329

426.912

555.297

N/A

310.643

1007.583

744.671

1071.359

N/A

23.105

29.375

26.418

29.641

N/A

279.919

469.175

378.587

470.53

N/A

300.652

564.491

412.165

574.111

N/A

10.175

10.409

10.178

10.159

N/A

5.594

5.741

9.86

10.08

N/A

4.195

4.053

3.542

3.563

3.501

3.52

N/A

2.19

2.169

04.04

3.829

N/A

1.433

1.415

184.772

202.8

173.834

187.362

N/A

84.485

99.154

117.817

158.264

N/A

44.551

42.198

222.688

250.217

206.081

204.114

N/A

101.134

116.803

146.761

202.074

N/A

55.099

56.132

5.173

5.193

5.019

4.998

N/A

2.875

2.925

5.014

4.704

N/A

2.0

1.992

88.064

87.484

80.954

83.133

N/A

48.207

47.218

67.836

74.22

N/A

31.541

30.64

109.688

112.35

100.681

106.929

N/A

57.091

60.951

81.711

90.781

N/A

36.822

35.887

6.348

6.156

6.314

6.096

N/A

4.891

4.994

8.602

8.715

N/A

4.191

3.843

2.195

1.981

2.158

1.882

N/A

1.919

1.923

3.558

3.346

N/A

1.336

1.337

118.788

125.331

115.495

126.503

N/A

73.256

87.091

104.541

139.832

N/A

44.101

41.998

137.976

141.463

135.439

141.993

N/A

85.127

103.005

124.361

177.113

N/A

55.095

55.694

3.234

3.285

3.188

3.287

N/A

2.514

2.565

4.41

4.133

N/A

2.001

1.961

51.49

52.678

51.733

53.971

N/A

39.019

41.484

53.247

65.489

N/A

31.912

31.339

64.68

67.933

65.097

68.79

N/A

46.543

53.651

66.696

80.489

N/A

39.657

37.739

detetction

yolo-v2-tf

yolo-v3-tf

Keras

1x608x608x3

1x416x416x3

41.03

58.339

51.548

55.49

N/A

32.183

54.19

46.653

52.343

N/A

9.976

10.009

10.012

9.78

N/A

05.11

5.362

10.939

10.483

N/A

2.748

2.616

9.396

9.511

9.172

9.115

N/A

5.266

5.402

9.604

10.071

N/A

3.273

3.603

6.342

6.413

6.359

6.455

N/A

4.554

4.685

9.679

9.203

N/A

2.815

2.728

5.908

5.999

5.842

6.021

N/A

4.635

4.762

8.431

8.857

N/A

3.485

3.305

object detection

face-detection-adas-0001

face-detection-retail-0004

face-detection-retail-0005

person-detection-retail-0002

person-detection-retail-0013

person-detection-action-recognition-0005

person-detection-action-recognition-0006

person-detection-action-recognition-teacher-0002

person-detection-raisinghand-recognition-0001

pedestrian-detection-adas-0002

pedestrian-and-vehicle-detector-adas-0001

person-vehicle-bike-detection-crossroad-0078

person-vehicle-bike-detection-crossroad-1016

vehicle-detection-adas-0002

product-detection-0001

yolo-v2-ava-0001

yolo-v2-ava-sparse-35-0001

yolo-v2-ava-sparse-70-0001

yolo-v2-tiny-ava-0001

yolo-v2-tiny-ava-sparse-30-0001

yolo-v2-tiny-ava-sparse-60-0001

OpenVINO DLDT

1x3x384x672

1x3x300x300

1x3x544x992, 1x6

1x3x320x544

1x3x400x680

1x400x680x3

1x3x400x680

1x3x384x672

1x3x1024x1024

1x3x512x512

1x3x384x672

1x3x512x512

1x416x416x3

190.381

613.015

370.388

575.562

N/A

474.599

1810.706

886.905

1579.082

N/A

386.849

1643.033

980.316

1422.832

N/A

43.582

109.957

48.452

81.321

N/A

170.88

805.521

624.418

552.411

N/A

50.541

257.30

140.11

90.17

N/A

77.652

279.405

183.233

187.406

N/A

82.492

332.989

212.893

222.356

N/A

90.816

328.187

210.514

219.449

N/A

186.143

622.013

390.186

587.253

N/A

167.94

519.051

328.904

467.773

N/A

33.559

217.934

37.015

85.069

N/A

148.886

464.037

277.551

383.229

N/A

208.469

646.052

N/A

151.21

454.42

285.511

390.973

N/A

81.676

125.537

106.337

123.009

N/A

81.043

126.326

109.412

122.551

N/A

80.935

125.111

108.929

124.573

N/A

279.787

468.903

371.733

464.125

N/A

279.874

465.884

377.741

466.937

N/A

278.366

471.915

356.143

473.27

N/A

163.456

153.809

121.582

115.124

N/A

62.196

68.349

92.387

110.187

N/A

22.929

24.105

477.619

537.924

319.206

331.391

N/A

163.026

200.185

207.868

294.873

N/A

118.481

123.917

494.647

489.075

399.417

376.385

N/A

140.017

161.137

188.284

194.052

N/A

49.992

50.597

33.968

35.056

25.868

29.935

N/A

16.436

18.445

21.983

22.258

N/A

10.869

10.931

202.85

170.162

113.45

94.689

N/A

68.855

68.324

98.05

78.204

N/A

14.908

14.518

66.164

56.64

42.055

37.081

N/A

16.305

16.605

22.579

35.6

N/A

7.126

7.244

59.764

46.936

35.544

31.769

N/A

24.103

22.453

37.291

33.005

N/A

6.105

6.14

66.235

58.106

42.1

37.187

N/A

26.719

25.138

40.449

35.812

N/A

6.689

6.86

66.532

58.506

41.977

37.207

N/A

26.669

25.133

40.478

35.822

N/A

6.696

6.861

149.222

144.861

117.881

112.381

N/A

65.274

72.969

99.182

115.077

N/A

23.676

24.002

116.021

115.271

90.999

84.681

N/A

53.089

57.875

82.978

95.714

N/A

19.438

20.120

62.366

58.863

47.944

48.208

N/A

34.655

35.246

44.072

36.776

N/A

7.347

7.36

115.186

103.232

90.297

97.03

N/A

54.059

56.118

82.062

91.516

N/A

15.739

15.73

150.849

150.469

N/A

67.471

104.848

N/A

23.469

115.382

103.112

87.967

97.429

N/A

53.989

57.386

81.887

95.959

N/A

15.883

15.76

20.771

21.121

20.885

20.734

N/A

11.762

11.993

26.135

22.617

N/A

10.61

9.573

22.562

21.293

20.903

20.81

N/A

11.758

11.987

26.103

22.616

N/A

10.533

9.926

22.601

21.655

21.054

20.992

N/A

11.763

11.984

26.12

22.627

N/A

10.677

10.739

87.438

89.01

80.566

83.24

N/A

48.484

47.473

72.398

74.382

N/A

37.081

36.483

87.467

91.108

80.562

83.617

N/A

48.45

47.449

72.284

74.259

N/A

37.162

36.65

87.652

90.456

80.858

83.713

N/A

48.37

47.492

72.327

74.362

N/A

36.752

37.222

93.296

94.002

88.077

93.868

N/A

49.762

57.695

76.742

96.571

N/A

22.909

24.217

282.254

315.232

212.884

247.69

N/A

138.617

175.444

174.286

255.317

N/A

118.426

125.142

297.249

275.181

263.011

278.652

N/A

115.027

139.46

154.554

165.519

N/A

50.112

50.799

26.04

23.965

18.431

22.203

N/A

14.614

16.256

19.409

19.467

N/A

10.870

10.952

106.184

92.223

81.505

82.577

N/A

54.373

59.774

83.178

68.388

N/A

14.934

14.558

39.075

34.857

29.647

31.808

N/A

14.464

14.836

19.674

30.995

N/A

7.002

7.23

33.498

30.006

26.011

27.734

N/A

19.738

19.882

31.612

28.983

N/A

6.107

6.141

39.167

35.26

30.291

32.027

N/A

21.565

21.964

33.821

31.135

N/A

6.698

6.853

39.037

34.468

30.283

31.777

N/A

21.523

21.991

33.855

31.135

N/A

6.737

6.853

91.308

92.568

85.424

92.38

N/A

53.797

62.077

81.608

101.64

N/A

23.685

24.147

68.601

69.891

64.199

71.083

N/A

42.946

48.956

68.941

83.997

N/A

19.453

20.026

37.179

36.278

34.525

33.977

N/A

28.762

31.395

38.583

32.596

N/A

7.353

7.362

69.042

71.0

62.347

72.183

N/A

45.108

48.357

70.123

79.805

N/A

15.707

15.713

90.377

92.412

N/A

54.822

86.547

N/A

23.488

68.644

70.73

60.63

72.121

N/A

45.033

49.614

70.274

83.878

N/A

15.879

15.746

13.12

13.294

13.242

13.457

N/A

9.623

10.532

21.876

19.881

N/A

10.612

8.419

13.117

13.314

13.244

13.461

N/A

9.626

10.532

21.925

19.884

N/A

9.182

8.735

13.106

13.308

13.246

13.425

N/A

9.619

10.536

21.971

19.885

N/A

10.637

10.351

51.423

53.278

51.478

53.826

N/A

39.209

41.717

57.127

65.892

N/A

33.602

30.0

51.266

53.241

51.528

53.837

N/A

39.191

41.671

56.506

65.879

N/A

34.614

32.84

51.5

52.928

51.528

53.887

N/A

39.242

41.637

57.25

65.723

N/A

36.801

34.895

object recognition

age-gender-recognition-retail-0013

head-pose-estimation-adas-0001

license-plate-recognition-barrier-0001

landmarks-regression-retail-0009

facial-landmarks-35-adas-0002

person-attributes-recognition-crossroad-0230

gaze-estimation-adas-0002

OpenVINO DLDT

1x3x62x62

1x3x60x60

Undefined

1x3x48x48

1x3x60x60

1x3x160x80

1x3x60x60, 1x3x60x60, 1x3

2025.118

7283.839

10954.035

24296.566

N/A

1812.813

6923.27

11494.517

24450.061

N/A

3350.757

9566.034

17459.091

52114.161

N/A

320.111

4811.01

1612.102

17801.891

N/A

480.438

4992.512

2401.665

9784.733

N/A

1608.865

4719.032

N/A

3456.835

4073.659

4442.233

5014.792

N/A

946.476

2217.719

1139.315

2544.671

N/A

531.146

1114.164

3514.63

4150.701

5078.09

4975.325

N/A

852.63

1549.351

816.199

1500.602

N/A

437.14

802.42

N/A

9392.582

11170.75

23611.009

26517.277

N/A

1634.289

7146.073

1759.501

7299.716

N/A

462.276

1075.203

831.46

1948.133

3013.563

6418.157

N/A

209.685

1459.012

246.262

1550.0

N/A

247.753

358.406

1476.737

2470.884

2519.808

2795.503

N/A

355.357

836.589

409.397

819.153

N/A

238.273

340.722

2751.887

3061.594

N/A

646.64

794.744

N/A

417.322

1775.373

2194.313

2664.12

2826.813

N/A

504.863

1676.202

534.952

1956.563

N/A

499.51

1109.781

1868.345

2234.524

2751.589

2884.454

N/A

448.936

1429.641

425.795

1560.841

N/A

389.679

800.444

N/A

7671.771

9041.027

14618.213

14468.293

N/A

684.34

3746.072

708.885

3886.012

N/A

436.746

1080.334

623.852

1873.292

2508.236

4045.533

N/A

201.928

1269.976

220.033

1365.262

N/A

224.235

324.651

1103.839

1488.78

1512.693

1440.362

N/A

243.823

704.856

260.085

705.572

N/A

229.654

340.638

1434.046

1708.812

N/A

411.405

462.022

N/A

385.805

reidentification

face-reidentification-retail-0095

OpenVINO DLDT

1x3x128x128

470.306

2968.019

1908.124

3892.934

N/A

678.376

912.965

801.692

664.94

N/A

202.707

389.677

257.156

553.7

N/A

93.728

99.877

433.928

503.62

441.656

460.552

N/A

169.493

323.322

194.803

471.365

N/A

93.82

99.911

human pose estimation

human-pose-estimation-0001

OpenVINO DLDT

1x3x256x456

121.666

222.584

202.012

219.972

N/A

40.866

40.963

33.468

32.176

N/A

21.45

21.793

38.211

39.594

N/A

9.938

9.987

25.347

23.034

22.513

22.994

N/A

18.444

19.236

32.979

34.829

N/A

9.953

8.871

image processing

single-image-super-resolution-1032

single-image-super-resolution-1033

OpenVINO DLDT

1x3x270x480, 1x3x1080x1920

1x3x360x640, 1x3x1080x1920

23.661

32.065

N/A

22.934

29.534

20.581

26.286

N/A

10.831

11.281

N/A

13.452

13.571

N/A

2.945

8.796

9.287

8.378

9.035

N/A

9.825

9.476

12.901

13.792

N/A

2.646

7.948

8.755

N/A

12.149

12.032

N/A

2.952

6.341

07.12

6.242

6.768

N/A

8.836

8.486

11.679

12.016

N/A

2.645

image retrieval

image-retrieval-0001

OpenVINO DLDT

1x224x224x3

495.606

2551.941

1562.138

2660.086

N/A

605.318

699.97

517.506

454.869

N/A

196.135

311.944

279.365

550.792

N/A

78.167

79.851

389.681

407.158

347.541

358.756

N/A

182.982

273.932

224.815

466.771

N/A

78.468

81.209

compressed

resnet18-xnor-binary-onnx-0001

OpenVINO DLDT

1x3x224x224

590.084

1868.05

1628.364

2309.004

N/A

558.534

616.497

519.572

570.729

N/A

215.836

364.561

309.849

451.083

N/A

292.13

300.383

253.272

298.694

N/A

198.106

309.245

217.058

387.95

N/A