Skip to content

aquapapaya/How-to-Test-TVM-quantized-model-on-CUDA

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

6 Commits
 
 

Repository files navigation

How to Test TVM quantized model on CUDA

#/~https://github.com/vinx13/tvm-cuda-int8-benchmark

git clone --recursive /~https://github.com/dmlc/tvm.git

vi .bashrc #Add the following two lines, and then reboot; NOTE! Set [YOUR_HOME_DIRECTORY] correctly!

#export TVM_HOME=/[YOUR_HOME_DIRECTORY]/tvm

#export PYTHONPATH=$TVM_HOME/python:$TVM_HOME/topi/python:$TVM_HOME/nnvm/python:${PYTHONPATH}

#reboot

cd tvm

git checkout e22b5802a3e6c269d76e52428ca81cbd4b7d8304

git submodule update --init

mkdir build

cp cmake/config.cmake build

cd build

vi config.cmake #enable CUDA and LLVM

cmake ..

make -j4

cd ~

git clone --recursive /~https://github.com/vinx13/tvm-cuda-int8-benchmark.git

cd tvm-cuda-int8-benchmark

pip3 install mxnet-cu101mkl

python3 run_tvm.py --log_file logs/history_best_1080.log

About

No description, website, or topics provided.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published