Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

where are benchmark results being saved? #759

Open
umairjavaid opened this issue Feb 10, 2022 · 1 comment
Open

where are benchmark results being saved? #759

umairjavaid opened this issue Feb 10, 2022 · 1 comment

Comments

@umairjavaid
Copy link

umairjavaid commented Feb 10, 2022

I have downloaded the latest docker image. I can't find the model benchmark results. model = resnet50-v2
command for benchmark

python tools/converter.py run --config=mace-models/resnet-v2-50/resnet-v2-50.yml --benchmark --debug_mode --report

CMD> bazel build //mace/proto:mace_py
WARNING: --batch mode is deprecated. Please instead explicitly shut down your Bazel server using the command "bazel shutdown".
Loading:
Loading: 0 packages loaded
Analyzing: target //mace/proto:mace_py (17 packages loaded)
INFO: Analysed target //mace/proto:mace_py (17 packages loaded).
INFO: Found 1 target...
[0 / 4] [-----] BazelWorkspaceStatusAction stable-status.txt
Target //mace/proto:mace_py up-to-date:
bazel-genfiles/mace/proto/mace_pb2.py
INFO: Elapsed time: 1.542s, Critical Path: 0.03s
INFO: 0 processes.
INFO: Build completed successfully, 1 total action
INFO: Build completed successfully, 1 total action

CMD> cp -f bazel-genfiles/mace/proto/mace_pb2.py /home/umair/Desktop/umair/mace/tools/python/py_proto

CMD> bazel build //mace/proto:micro_mem_py
WARNING: --batch mode is deprecated. Please instead explicitly shut down your Bazel server using the command "bazel shutdown".
Loading:
Loading: 0 packages loaded
Analyzing: target //mace/proto:micro_mem_py (16 packages loaded)
INFO: Analysed target //mace/proto:micro_mem_py (17 packages loaded).
INFO: Found 1 target...
[0 / 21] [-----] BazelWorkspaceStatusAction stable-status.txt
Target //mace/proto:micro_mem_py up-to-date:
bazel-genfiles/mace/proto/micro_mem_pb2.py
INFO: Elapsed time: 1.514s, Critical Path: 0.03s
INFO: 0 processes.
INFO: Build completed successfully, 1 total action
INFO: Build completed successfully, 1 total action

CMD> cp -f bazel-genfiles/mace/proto/micro_mem_pb2.py /home/umair/Desktop/umair/mace/tools/python/py_proto

CMD> bazel build //third_party/caffe:caffe_py
WARNING: --batch mode is deprecated. Please instead explicitly shut down your Bazel server using the command "bazel shutdown".
Loading:
Loading: 0 packages loaded
INFO: Analysed target //third_party/caffe:caffe_py (17 packages loaded).
Building: no action
INFO: Found 1 target...
[2 / 24] [-----] BazelWorkspaceStatusAction stable-status.txt
Target //third_party/caffe:caffe_py up-to-date:
bazel-genfiles/third_party/caffe/caffe_pb2.py
INFO: Elapsed time: 1.585s, Critical Path: 0.04s
INFO: 0 processes.
INFO: Build completed successfully, 1 total action
INFO: Build completed successfully, 1 total action

CMD> cp -f bazel-genfiles/third_party/caffe/caffe_pb2.py /home/umair/Desktop/umair/mace/tools/python/py_proto

CMD> bazel build //mace/proto:mace_py
WARNING: --batch mode is deprecated. Please instead explicitly shut down your Bazel server using the command "bazel shutdown".
Loading:
Loading: 0 packages loaded
Analyzing: target //mace/proto:mace_py (12 packages loaded)
INFO: Analysed target //mace/proto:mace_py (17 packages loaded).
INFO: Found 1 target...
[0 / 4] [-----] BazelWorkspaceStatusAction stable-status.txt
Target //mace/proto:mace_py up-to-date:
bazel-genfiles/mace/proto/mace_pb2.py
INFO: Elapsed time: 1.596s, Critical Path: 0.05s
INFO: 0 processes.
INFO: Build completed successfully, 1 total action
INFO: Build completed successfully, 1 total action

CMD> cp -f bazel-genfiles/mace/proto/mace_pb2.py tools/python/py_proto

CMD> bazel build //mace/proto:micro_mem_py
WARNING: --batch mode is deprecated. Please instead explicitly shut down your Bazel server using the command "bazel shutdown".
Loading:
Loading: 0 packages loaded
Analyzing: target //mace/proto:micro_mem_py (12 packages loaded)
INFO: Analysed target //mace/proto:micro_mem_py (17 packages loaded).
INFO: Found 1 target...
[0 / 7] [-----] BazelWorkspaceStatusAction stable-status.txt
Target //mace/proto:micro_mem_py up-to-date:
bazel-genfiles/mace/proto/micro_mem_pb2.py
INFO: Elapsed time: 1.616s, Critical Path: 0.05s
INFO: 0 processes.
INFO: Build completed successfully, 1 total action
INFO: Build completed successfully, 1 total action

CMD> cp -f bazel-genfiles/mace/proto/micro_mem_pb2.py tools/python/py_proto

CMD> bazel build //third_party/caffe:caffe_py
WARNING: --batch mode is deprecated. Please instead explicitly shut down your Bazel server using the command "bazel shutdown".
Loading:
Loading: 0 packages loaded
Analyzing: target //third_party/caffe:caffe_py (12 packages loaded)
INFO: Analysed target //third_party/caffe:caffe_py (17 packages loaded).
INFO: Found 1 target...
[0 / 7] [-----] BazelWorkspaceStatusAction stable-status.txt
Target //third_party/caffe:caffe_py up-to-date:
bazel-genfiles/third_party/caffe/caffe_pb2.py
INFO: Elapsed time: 1.552s, Critical Path: 0.04s
INFO: 0 processes.
INFO: Build completed successfully, 1 total action
INFO: Build completed successfully, 1 total action

CMD> cp -f bazel-genfiles/third_party/caffe/caffe_pb2.py tools/python/py_proto

* Package libs for resnet-v2-50
Start packaging 'resnet-v2-50' libs into build/resnet-v2-50/libmace_resnet-v2-50.tar.gz
build/resnet-v2-50/include/
build/resnet-v2-50/include/mace/
build/resnet-v2-50/include/mace/public/
build/resnet-v2-50/include/mace/public/mace_engine_factory.h
build/resnet-v2-50/include/mace/public/resnet_v2_50.h
build/resnet-v2-50/build/
build/resnet-v2-50/build/resnet-v2-50/
build/resnet-v2-50/build/resnet-v2-50/include/
build/resnet-v2-50/build/resnet-v2-50/include/mace/
build/resnet-v2-50/build/resnet-v2-50/include/mace/public/
build/resnet-v2-50/build/resnet-v2-50/include/mace/public/mace_engine_factory.h
build/resnet-v2-50/build/resnet-v2-50/include/mace/public/resnet_v2_50.h
build/resnet-v2-50/build/resnet-v2-50/model/
build/resnet-v2-50/build/resnet-v2-50/model/arm64-v8a/
build/resnet-v2-50/build/resnet-v2-50/model/arm64-v8a/resnet-v2-50.a
build/resnet-v2-50/build/resnet-v2-50/model/armeabi-v7a/
build/resnet-v2-50/build/resnet-v2-50/model/armeabi-v7a/resnet-v2-50.a
build/resnet-v2-50/build/resnet-v2-50/model/resnet_v2_50.data
build/resnet-v2-50/model/
build/resnet-v2-50/model/arm64-v8a/
build/resnet-v2-50/model/arm64-v8a/resnet-v2-50.a
build/resnet-v2-50/model/armeabi-v7a/
build/resnet-v2-50/model/armeabi-v7a/resnet-v2-50.a
build/resnet-v2-50/model/resnet_v2_50.data
Packaging Done!

--------------------------------------------------------------------------
                                 Library                                  
--------------------------------------------------------------------------
|          key           |                     value                     |
==========================================================================
| MACE Model package Path| build/resnet-v2-50/libmace_resnet-v2-50.tar.gz|
--------------------------------------------------------------------------
```
`
------------------------

### System information
- **LINUX 18.04 (e.g., Linux Ubuntu 16.04)**:
- **MACE 1.1.1 (Use the command: git describe --long --tags)**:
- **Python version(2.7)**: 
- **Bazel version (e.g., 0.13.0)**:

### Model deploy file (*resnet50.yml)
```yaml
......
```
@lu229
Copy link
Collaborator

lu229 commented Mar 29, 2022

The benchmark did not start for MACE can not find mobile device whose abi was specified in the yml file

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants