root
/
MNN
mirror of https://github.com/alibaba/MNN.git
1
0
Fork 0
Code Issues Actions 1 Packages Projects Releases Wiki Activity
2,052 Commits 20 Branches 109 Tags 396 MiB
Commit Graph

705 Commits

Author SHA1 Message Date
yanzhang 4c9f48b76b Minor fixes after rebase. 
- Enable fp32 1x1 impl after it's right.
- Remove winograd memory test because kleidiai not support.

Change-Id: Ia61ad8c251490e93a2a365020a6183a944e769b2
Signed-off-by: yanzhang <yanzhang.wang@arm.com>
 2025-07-10 15:42:55 +08:00
yanzhang 5e3c8a3c12 Integrate the KleidiAI imatmul with fp32. 
Note,
        - No support for fp16 and int8 currently.

Signed-off-by: yanzhang <yanzhang.wang@arm.com>
Change-Id: If17c911977dd7eb0603f41d64b8ba879f468ab98
 2025-07-10 15:42:19 +08:00
SixtyWang b5b5845787 Refactor Kleidiai code to fix MNN unit test issues 
- Refactor getInstance function
- Add 1x1 convolution check in canAccelerate
- Use NHWC as input/output format for Kleidiai and convert format in onExecute
- Remove KAI_CONV_NCHW_IN_OUT macro
- Fix SME build issue on M4
 2025-07-08 16:22:23 +08:00
SixtyWang da8b7337c4 Refactor the KleidiAI integration ConvInt8 code in MNN 2025-07-08 16:21:26 +08:00
Shuheng Deng 875814bfb9 Refactor the KleidiAI integration convolution code in MNN 
Change-Id: I2e45fb7ec10793afffad8c25c305c1cb1e260753
 2025-07-04 09:54:00 +08:00
王召德 5f35d621e1
Merge pull request #3670 from yanzhang-dev/features/upgrade-kai-1.9.0
android / android_build (push) Has been cancelled Details
ios / ios_build (push) Has been cancelled Details
linux / linux_buil_test (push) Has been cancelled Details
macos / macos_buil_test (push) Has been cancelled Details
windows / windows_build_test (push) Has been cancelled Details 
Upgrade KleidiAI to v1.9.0
 2025-07-02 17:54:46 +08:00
emil fa3a03d6e3 只将OpenCL的context作为全局变量，并且只创建一次。将OpenCLRutime修改为每次创建新对象 2025-06-30 11:13:51 +08:00
yanzhang 9a56fe323e Upgrade KleidiAI to v1.9.0 
Change-Id: Ia910d9c296aa1569e9e4449b56bb7614fe6c85e0
Signed-off-by: yanzhang <yanzhang.wang@arm.com>
 2025-06-26 13:46:40 +08:00
Jules 38c15d853b align OneDNNConvInt8 with updated function signature 2025-06-24 01:46:34 +00:00
xiaying aeac75acbf [MNN:Bugfix] Fix opencl execute llm decode error (issue 3623) 2025-06-20 14:41:23 +08:00
jxt1234 3db3cc904d
Merge pull request #3635 from alibaba/feature/sync
android / android_build (push) Has been cancelled Details
ios / ios_build (push) Has been cancelled Details
linux / linux_buil_test (push) Has been cancelled Details
macos / macos_buil_test (push) Has been cancelled Details
pymnn-linux / pymnn_linux_buil_test (push) Has been cancelled Details
pymnn-macos / pymnn_macos_buil_test (push) Has been cancelled Details
pymnn-windows / pymnn_windows_buil_test (push) Has been cancelled Details
wiki / sync_wiki (push) Has been cancelled Details
windows / windows_build_test (push) Has been cancelled Details 
MNN:Sync: Sync Internal 3.2.1
 2025-06-17 11:30:08 +08:00
xiaying e5e7fccd99 MNN:Sync: Sync Internal 3.2.1 2025-06-17 11:08:21 +08:00
Jules d30f99a2ae remove unused variables 2025-06-17 02:06:28 +00:00
jxt1234 f9720f994e
Merge pull request #3588 from jules-ai/fix_int_offset_overflow 
a propose to fix address offset overflow caused by using int
 2025-06-11 13:54:04 +08:00
xiaying 210e861650 MNN:Sync: Sync some bugfix 2025-06-09 09:51:46 +08:00
xiaying b66ec85018 OpenCL:Bugfix: Fix bug for recordable bug for llm 2025-06-06 08:48:18 +08:00
xiaying 09b6cd9862 MNN:Sync: Sync 3.2.0 2025-06-05 15:15:29 +08:00
Jules 7a08d2e2ee Fix address offset overflow caused by using int 2025-05-30 10:38:23 +00:00
jxt1234 97223628bc
Merge pull request #3569 from linlinxu-1989/sme_fp16_fp32_new 
Bump MNN KleidiAI ukernel to fp16_sme2 fp32_sme2 ukernel
 2025-05-27 15:37:07 +08:00
jxt1234 c0dde12d89
Merge pull request #3564 from tumuyan/patch-1 
fix MNN_SUPPORT_RENDER OFF
 2025-05-27 15:07:56 +08:00
jxt1234 eef4a726cd
Merge pull request #3546 from HenryDen/buf_fix 
Bugs fix for the KleidiAi integration of MNN
 2025-05-27 14:54:37 +08:00
linlin.xu 556acbfea2 Add macro for kleidiai only resource 2025-05-27 14:46:50 +08:00
linlin.xu a8f2d34b15 Bump MNN KleidiAI ukernel to fp16_sme2 fp32_sme2 ukernel 
Add fp16 and fp32 sme2 kernel
1. Add rhs pack nxk kernel lhs pack kernel
2. Add fp16 GEMM kernel and GEMV kernel
3. Add fp32 GEMM kernel and GEMV kernel
 2025-05-27 10:21:24 +08:00
tumuyan caf73d6859
fix MNN_SUPPORT_RENDER OFF 2025-05-24 10:42:48 +08:00
zhaode.wzd bd36a3f749 [MNN:Sync] Sync internal: 
1. SmolVLM, FastVLM support.
    2. QNN backend init.
    3. Qwen3 MoE support.
    4. Speculative decodeing init.
    5. Some bugfix.
 2025-05-23 15:24:18 +08:00
Shuheng Deng 986a065fff Bugs fix for the KleidiAi integration of MNN 2025-05-22 17:35:57 +08:00
xiaying d2477b3091 MNN:Bugfix: Fix bug for ios Compile error 2025-05-09 14:19:41 +08:00
xiaying e457f0ce33 OpenCL:Bugfix: Fix bug for llm bench opencl crash 2025-05-09 14:12:58 +08:00
zhaode.wzd a019d971ad [MNN:Sync] Sync Internal 3.1.4. 2025-05-08 12:39:44 +08:00
xiaying ba766b8bea LLM:Feature, OpenCL:Bugfix: Sync internal bugfix( support llm prompt 
dynamic setting, fix bug for opencl softmax in nvidia error)
 2025-04-30 18:00:38 +08:00
jxt1234 f65ff90302
Merge pull request #3397 from xhzheng1895/kai_1.7.0_integration
android / android_build (push) Waiting to run Details
ios / ios_build (push) Waiting to run Details
linux / linux_buil_test (push) Waiting to run Details
macos / macos_buil_test (push) Waiting to run Details
windows / windows_build_test (push) Waiting to run Details 
Integrate Asym int4 ukernels to MNN
 2025-04-30 11:15:41 +08:00
xiaying 0769b81b58 MNN:Sync: Sync Internal 3.1.3 2025-04-28 11:50:24 +08:00
xinhao.zheng 9471946f9a Refine some code to avoid redundant data reorder. 2025-04-27 15:57:31 +08:00
xinhao.zheng 81530694c8 Revert some change to avoid compile warning 2025-04-25 15:33:55 +08:00
xinhao.zheng c043aed737 Fix thread num calculate bug 2025-04-25 08:27:01 +08:00
xinhao.zheng e376109335 Integrate Asym int4 ukernels to MNN 
Integrate two kernels matmul_clamp_f16_qsi8d32p_qai4c32p
and matmul_clamp_f32_qsi8d32p_qai4c32p. Now KleidiAI support
asymmetric & block wise quantified & f32/f16activation.

Remove .tar.gz package from source code. Will download from
https://gitlab.arm.com/kleidi/kleidiai/-/releases when cmake.
 2025-04-24 08:32:00 +08:00
王召德 513bf36512
Merge pull request #3350 from xhzheng1895/kai_update
android / android_build (push) Has been cancelled Details
ios / ios_build (push) Has been cancelled Details
linux / linux_buil_test (push) Has been cancelled Details
macos / macos_buil_test (push) Has been cancelled Details
windows / windows_build_test (push) Has been cancelled Details
stale / stale (push) Has been cancelled Details 
Update KleidiAI version to 1.5.0
 2025-04-01 14:54:22 +08:00
xiaying 7391896be3 OpenCL:Bugfix: Fix bug for LayerNorm init bug 2025-03-28 18:48:22 +08:00
xiaying e9c3296942 MNN:Sync: Sync Internal 3.1.2 2025-03-27 11:30:13 +08:00
xinhao.zheng dae2266a43 Update KleidiAI version to 1.5.0 2025-03-27 09:41:26 +08:00
Xi Guo b41edfc29e
Merge branch 'master' into build-qnx 2025-03-12 13:07:45 +08:00
xiaying c0247c6998 MNN:Sync: Sync Internal 3.1.1 2025-03-12 11:35:16 +08:00
Xi Guo d0487ac726 fix: incompatible insertion of unique_ptr in mTensorIdxMap 2025-03-10 20:08:03 +08:00
Xi Guo db0311da39 feat: add compatibility support for QNX Neutrino 2025-03-10 19:14:25 +08:00
garryling 6fe7f9a8c4 fix(nnapi): fix when input is constant, convert tensor to nchw or nhwc 2025-03-05 23:19:37 +08:00
xiaying 4497538e38 HIAI:Bugfix: Fix bug for ohos hiai backend compile, fix bug for resize and unary 
op adapter
 2025-03-05 10:16:05 +08:00
Weizhao Ouyang aca7c96cfa Fix MNN_HEADERS_KLEIDIAI compile warnings 
Signed-off-by: Weizhao Ouyang <o451686892@gmail.com>
 2025-03-03 09:48:42 +08:00
zhaode.wzd d9a6ce3ac1 [MNN:Sync] Sync Internal 3.1.0. 2025-02-24 11:44:27 +08:00
xiaying b935891ece MNN:Sync: Sync a few bugfix, add qwen2.5-vl support 2025-02-17 19:11:14 +08:00
xiaying ee9fff2d6c Vulkan:Bugfix: Fix bug for windows compile error 2025-02-12 11:56:52 +08:00