Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[arm] add V9 int8 gemm implementation #9116

Merged
merged 26 commits into from
Jun 15, 2022
Merged

[arm] add V9 int8 gemm implementation #9116

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
26 commits
Select commit Hold shift + click to select a range
00a6beb
add gemm sve implementation
chenjiaoAngel May 26, 2022
10828be
fix precision
chenjiaoAngel May 26, 2022
a563e58
neon
chenjiaoAngel May 28, 2022
32acf8a
fix hard_Swish error
chenjiaoAngel May 30, 2022
9c09e45
fix gemm sve compute error
chenjiaoAngel May 30, 2022
9ac3141
Update gemv_fp16.cc
chenjiaoAngel May 30, 2022
f5f1cd3
Update gemv_fp16.cc
chenjiaoAngel May 30, 2022
52d5677
Update conv_impl_sve.cc
chenjiaoAngel May 30, 2022
f107f6b
Update gemv_fp16.cc
chenjiaoAngel May 31, 2022
25c3be4
Update conv_gemmlike.cc
chenjiaoAngel May 31, 2022
f3f3cac
Update conv_gemmlike.h
chenjiaoAngel May 31, 2022
8fa4fbd
Update conv_gemmlike.cc
chenjiaoAngel May 31, 2022
f2dfcd8
add i8mm and f32mm support
chenjiaoAngel May 31, 2022
9ef95c8
Update sgemm_compute_test.cc
chenjiaoAngel Jun 1, 2022
b37d2f7
Update sgemm_compute_test.cc
chenjiaoAngel Jun 1, 2022
e875882
add int8-gemm support
chenjiaoAngel Jun 7, 2022
b6ccccb
add sve int8 ut
chenjiaoAngel Jun 7, 2022
6133b76
fix build error
chenjiaoAngel Jun 7, 2022
66b8d83
add 8x1 8x2
chenjiaoAngel Jun 8, 2022
2ce2e15
fix 8x1 error
chenjiaoAngel Jun 8, 2022
99e562c
fix 8x1 error
chenjiaoAngel Jun 8, 2022
2d954fa
fix fp32 error
chenjiaoAngel Jun 9, 2022
d8cdf11
fix int8 error
chenjiaoAngel Jun 10, 2022
485d24f
Merge branch 'develop' into v9_gemm
chenjiaoAngel Jun 10, 2022
e71f0e2
fix conflict
chenjiaoAngel Jun 10, 2022
c2dd905
improve int8 proflier
chenjiaoAngel Jun 10, 2022
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
1 change: 1 addition & 0 deletions lite/backends/arm/math/sve/funcs_sve.h
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -46,6 +46,7 @@
#include <cmath>
#include <limits>
#include "lite/backends/arm/math/funcs.h"
#include "lite/backends/arm/math/sve/gemm_sve_i8mm.h"
#include "lite/backends/arm/math/sve/softmax_sve.h"

#ifdef ENABLE_ARM_FP16
Expand Down
2 changes: 1 addition & 1 deletion lite/backends/arm/math/sve/gemm_sve.h
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -30,7 +30,7 @@ const int MBLOCK_SVE = 8;
const int NBLOCK_SVE_FP16 = 16;
const int NBLOCK_SVE_FP32 = 12;

inline int get_hblock_sve(ARMContext* ctx, int m, int dytpe) {
inline int get_hblock_sve(ARMContext* ctx, int m, int dtype) {
if (m <= 4) {
return 4;
} else {
Expand Down
Loading