[MNNCLI] 编译android版本的mnncli失败

[blueskycoco]

幸苦大佬帮忙看看以下命令执行的是否有问题？多谢.
最后是检测不到apps/mnncli/mnncli

ANDROID_NDK=/home/dillon/Android/Sdk/ndk/27.0.12077973 ./apps/mnncli/android_build.sh
libyuv directory already exists. Skipping clone.
Building MNNCLI for Android with OpenCV support...
OpenCV version: 4.8.0
OpenCV SDK directory: /home/dillon/Downloads/tmp/MNN/opencv-android-sdk
OpenCV Android SDK already exists at: /home/dillon/Downloads/tmp/MNN/opencv-android-sdk
OpenCV Android SDK path set: /home/dillon/Downloads/tmp/MNN/opencv-android-sdk
Building for single architecture: arm64-v8a
-- Use Threadpool, forbid openmp
-- >>>>>>>>>>>>>
-- MNN BUILD INFO:
-- System: Android
-- Processor: aarch64
-- Version: 3.5.0
-- Metal: OFF
-- OpenCL: OFF
-- OpenGL: OFF
-- Vulkan: OFF
-- ARM82: ON
-- KleidiAI: ON
-- oneDNN: OFF
-- TensorRT: OFF
-- CoreML: OFF
-- NNAPI: OFF
-- QNN: OFF
-- CUDA: OFF
-- MUSA: OFF
-- OpenMP: OFF
-- BF16: OFF
-- ThreadPool: ON
-- Hidden: TRUE
-- Build Path: /home/dillon/Downloads/tmp/MNN/build_mnncli_android
-- CUDA PROFILE: OFF
-- WIN_USE_ASM:
-- Enabling AArch64 Assemblies
-- Configuring done (0.0s)
-- Generating done (0.1s)
-- Build files have been written to: /home/dillon/Downloads/tmp/MNN/build_mnncli_android
Building MNNCLI for arm64-v8a...
[ 0%] Built target checkFile.out
[ 0%] Built target MNNUtils
[ 1%] Built target MNNMath
[ 1%] Built target checkDir.out
[ 2%] Built target MNNCV
[ 7%] Built target MNN_Arm82
[ 12%] Built target MNNCore
[ 50%] Built target MNNARM64
[ 67%] Built target MNNCPU
[ 89%] Built target MNNTransform
[ 90%] Built target MNN
[ 92%] Built target MNN_Express
[ 93%] Built target OpenCLProgramBuildTest.out
[ 93%] Built target GpuInterTest.out
[ 93%] Built target MNNV2Basic.out
[ 93%] Built target GetMNNInfo
[ 93%] Built target ModuleBasic.out
[ 93%] Built target SequenceModuleTest.out
[ 93%] Built target modelCompare.out
[ 93%] Built target mergeInplaceForCPU
[ 95%] Built target mobilenetTest.out
[ 95%] Built target backendTest.out
[ 95%] Built target testModel_expr.out
[ 95%] Built target testModel.out
[ 95%] Built target getPerformance.out
[ 96%] Built target testModelWithDescribe.out
[ 97%] Built target checkInvalidValue.out
[ 97%] Built target compilefornpu
[ 99%] Built target fuseTest
[ 99%] Built target testTrain.out
[ 99%] Built target winogradExample.out
[100%] Built target timeProfile.out
Build failed! Executable not found

[blueskycoco]

./apps/mnncli/build_integrated.sh 在我这边也是有同样的问题.

sh ./apps/mnncli/build_integrated.sh
[ 99%] Built target testTrain.out
[100%] Linking CXX executable backendTest.out
[100%] Built target backendTest.out
[100%] Linking CXX executable testModelWithDescribe.out
[100%] Built target testModelWithDescribe.out
[100%] Linking CXX executable SequenceModuleTest.out
[100%] Built target SequenceModuleTest.out
[100%] Linking CXX executable apply_template
[100%] Linking CXX executable mobilenetTest.out
[100%] Built target apply_template
[100%] Built target mobilenetTest.out
[100%] Linking CXX executable mergeInplaceForCPU
[100%] Built target mergeInplaceForCPU
[100%] Linking CXX executable tokenizer_demo
[100%] Built target tokenizer_demo
[100%] Linking CXX executable quantize_llm
[100%] Built target quantize_llm
[100%] Linking CXX executable fuseTest
[100%] Built target fuseTest
[100%] Linking CXX executable timeProfile.out
[100%] Built target timeProfile.out
[100%] Linking CXX executable compilefornpu
[100%] Built target compilefornpu
Build failed! Executable not found.

[wangzhaode]

Hi @blueskycoco, thanks for reporting. We have confirmed this is a bug in the Android build script.

The android_build.sh runs cmake .. (pointing to the MNN root), but the root CMakeLists.txt does not include add_subdirectory(apps/mnncli), so the mnncli target is never built. The same issue exists with build_integrated.sh — it passes -DBUILD_MNNCLI=ON but that flag is not consumed by the root CMake.

We will fix the build scripts. For now, apps/mnncli/build.sh (native two-stage build) works correctly and can be used as a reference for the expected behavior.

Thanks for your patience!

[wangzhaode]

Update: After further investigation, the Android build issue is not just a script problem. The mnncli Android support is currently incomplete at the code level:

1. android_build.sh uses cmake .. (MNN root) which does not include the mnncli target
2. Even after fixing the script to use two-stage build (static lib + independent mnncli cmake), compilation still fails because:
   • src/AndroidVideoDecoder.cpp and its header do not exist yet
   • model_downloader module hard-depends on httplib::SSLClient (requires OpenSSL), but Android NDK does not ship OpenSSL
   • mnncli source files include downloader headers that reference SSLClient types

These require code-level adaptation (OpenSSL for Android or conditional SSL-free builds) beyond a build script fix. We will work on proper Android support for mnncli in a future update.

[blueskycoco]

Yes, it's not finished with mnncli code level support for Android.

I think, we don't need model download & manage on android side (like llama.cpp) , just transfer outside http post to tigger model inference is enough for debug purpose.

here is my local changes (delete some code to support mnncli serve) , and build step for someone might need quick debug. thanks.

build:
./apps/mnncli/android_build.sh -c
cd build_mnncli;rm -rf *;cmake ../apps/mnncli -DCMAKE_TOOLCHAIN_FILE=/home/user/Downloads/android-ndk-r30-beta1/build/cmake/android.toolchain.cmake -DANDROID_ABI=arm64-v8a -DANDROID_PLATFORM=android-24 -DCMAKE_BUILD_TYPE=Release -DMNN_BUILD_FOR_ANDROID=ON;make

test:
push host ~/.cache/mnncli/mnnmodels/mnncli_config.json to /data/local/tmp/mnncli/.mnnmodels/
push mnn model to /data/local/tmp/mnncli/.mnnmodels/ModelScope/MNN
adb shell
cd /data/local/tmp/mnncli
LD_LIBRARY_PATH=/data/local/tmp/mnncli ./mnncli serve xxx(your model) --port 8000 -v

patch:

diff --git a/apps/frameworks/model_downloader/cpp/CMakeLists.txt b/apps/frameworks/model_downloader/cpp/CMakeLists.txt
index bb08ba40..70c4afd0 100644
--- a/apps/frameworks/model_downloader/cpp/CMakeLists.txt
+++ b/apps/frameworks/model_downloader/cpp/CMakeLists.txt
@@ -26,7 +26,12 @@ endif()
 
 # Source files
 file(GLOB SOURCES 
-    "src/*.cpp"
+    "src/file_utils.cpp"
+    "src/model_repo_downloader.cpp"
+    "src/model_market_data.cpp"
+    "src/model_sources.cpp"
+    "src/log_utils.cpp"
+    "src/model_name_utils.cpp"
 )
 
 # Header files
diff --git a/apps/mnncli/CMakeLists.txt b/apps/mnncli/CMakeLists.txt
index f148fa82..f4f9e05d 100644
--- a/apps/mnncli/CMakeLists.txt
+++ b/apps/mnncli/CMakeLists.txt
@@ -24,7 +24,18 @@ if(APPLE)
     message(STATUS "  SSL: ${OPENSSL_SSL_LIBRARY}")
     message(STATUS "  Crypto: ${OPENSSL_CRYPTO_LIBRARY}")
 else()
-    find_package(OpenSSL REQUIRED)
+    find_package(OpenSSL)
+    # set(OPENSSL_ROOT_DIR "~/work/gst/gstreamer/cerbero/build/dist/android_arm64")
+    # set(OPENSSL_USE_STATIC_LIBS TRUE)
+    # set(OPENSSL_INCLUDE_DIR "${OPENSSL_ROOT_DIR}/include" CACHE PATH "OpenSSL include directory" FORCE)
+    # set(OPENSSL_SSL_LIBRARY "${OPENSSL_ROOT_DIR}/lib/libssl.a" CACHE FILEPATH "OpenSSL SSL library" FORCE)
+    # set(OPENSSL_CRYPTO_LIBRARY "${OPENSSL_ROOT_DIR}/lib/libcrypto.a" CACHE FILEPATH "OpenSSL Crypto library" FORCE)
+    # set(OPENSSL_LIBRARIES "${OPENSSL_SSL_LIBRARY};${OPENSSL_CRYPTO_LIBRARY}" CACHE STRING "OpenSSL libraries" FORCE)
+    # set(OpenSSL_FOUND TRUE CACHE BOOL "OpenSSL found" FORCE)
+    # message(STATUS "Pre-configured OpenSSL static libraries:")
+    # message(STATUS "  Include: ${OPENSSL_INCLUDE_DIR}")
+    # message(STATUS "  SSL: ${OPENSSL_SSL_LIBRARY}")
+    # message(STATUS "  Crypto: ${OPENSSL_CRYPTO_LIBRARY}")
 endif()
 
 # Use httplib from MNN transformers directory instead of fetching it
@@ -35,25 +46,26 @@ set(MNN_BUILD_DIR "${CMAKE_CURRENT_LIST_DIR}/../../build_mnn_static" CACHE PATH
 set(MNN_SOURCE_DIR "${CMAKE_CURRENT_LIST_DIR}/../.." CACHE PATH "MNN source directory")
 
 # Find pre-built MNN library
-find_library(MNN_LIBRARY 
-    NAMES libMNN.a MNN
-    PATHS ${MNN_BUILD_DIR}
-    NO_DEFAULT_PATH
-    REQUIRED
-)
-
+# find_library(MNN_LIBRARY 
+#     NAMES libMNN.a MNN
+#     PATHS ${MNN_BUILD_DIR}
+#     NO_DEFAULT_PATH
+#     REQUIRED
+# )
+set(LLM_LIBRARY "${CMAKE_CURRENT_LIST_DIR}/../../build_mnncli_android/OFF/arm64-v8a/libllm.so")
+set(MNN_LIBRARY "${CMAKE_CURRENT_LIST_DIR}/../../build_mnncli_android/OFF/arm64-v8a/libMNN.so")
 message(STATUS "Found MNN library: ${MNN_LIBRARY}")
 message(STATUS "MNN source directory: ${MNN_SOURCE_DIR}")
 
 # Add libyuv dependency from the local git submodule for Android builds
-if(CMAKE_SYSTEM_NAME STREQUAL "Android")
-    # Ensure the submodule is available before adding it
-    if(EXISTS ${CMAKE_CURRENT_LIST_DIR}/../../3rd_party/libyuv/CMakeLists.txt)
-        add_subdirectory(../../3rd_party/libyuv ${CMAKE_BINARY_DIR}/libyuv)
-    else()
-        message(FATAL_ERROR "libyuv submodule not found. Please ensure it is available in 3rd_party/libyuv.")
-    endif()
-endif()
+# if(CMAKE_SYSTEM_NAME STREQUAL "Android")
+#     # Ensure the submodule is available before adding it
+#     if(EXISTS ${CMAKE_CURRENT_LIST_DIR}/../../3rd_party/libyuv/CMakeLists.txt)
+#         add_subdirectory(../../3rd_party/libyuv ${CMAKE_BINARY_DIR}/libyuv)
+#     else()
+#         message(FATAL_ERROR "libyuv submodule not found. Please ensure it is available in 3rd_party/libyuv.")
+#     endif()
+# endif()
 
 # Function to convert file to C++ array
 function(embed_file_as_c_array input_file output_file symbol_name)
@@ -85,30 +97,23 @@ set(MNNCLI_SOURCES
     ${CMAKE_CURRENT_LIST_DIR}/src/llm_benchmark.cpp
     ${CMAKE_CURRENT_LIST_DIR}/../../transformers/llm/engine/app/llm_benchmark_common.cpp
     ${CMAKE_CURRENT_LIST_DIR}/src/mnncli_server.cpp
-    ${CMAKE_CURRENT_LIST_DIR}/src/model_repository.cpp
-    ${CMAKE_CURRENT_LIST_DIR}/src/cli_download_listener.cpp
     ${CMAKE_CURRENT_LIST_DIR}/src/cli_config_manager.cpp
     ${CMAKE_CURRENT_LIST_DIR}/src/llm_manager.cpp
-    ${CMAKE_CURRENT_LIST_DIR}/src/model_manager.cpp
     ${CMAKE_CURRENT_LIST_DIR}/src/local_model_utils.cpp
     ${CMAKE_CURRENT_LIST_DIR}/src/cli_command_handler.cpp
     ${CMAKE_CURRENT_LIST_DIR}/src/cli_command_parser.cpp
     ${CMAKE_CURRENT_LIST_DIR}/src/cli_command_spec.cpp
     ${CMAKE_CURRENT_LIST_DIR}/src/handlers/run_command_handler.cpp
-    ${CMAKE_CURRENT_LIST_DIR}/src/handlers/delete_command_handler.cpp
     ${CMAKE_CURRENT_LIST_DIR}/src/handlers/list_command_handler.cpp
-    ${CMAKE_CURRENT_LIST_DIR}/src/handlers/search_command_handler.cpp
-    ${CMAKE_CURRENT_LIST_DIR}/src/handlers/download_command_handler.cpp
-    ${CMAKE_CURRENT_LIST_DIR}/src/handlers/model_info_command_handler.cpp
     ${CMAKE_CURRENT_LIST_DIR}/src/handlers/serve_command_handler.cpp
     ${CMAKE_CURRENT_LIST_DIR}/src/handlers/benchmark_command_handler.cpp
     ${CMAKE_CURRENT_LIST_DIR}/src/handlers/config_command_handler.cpp
     ${CMAKE_CURRENT_LIST_DIR}/src/handlers/info_command_handler.cpp
 )
 
-if(CMAKE_SYSTEM_NAME STREQUAL "Android")
-    list(APPEND MNNCLI_SOURCES ${CMAKE_CURRENT_LIST_DIR}/src/AndroidVideoDecoder.cpp)
-endif()
+# if(CMAKE_SYSTEM_NAME STREQUAL "Android")
+#     list(APPEND MNNCLI_SOURCES ${CMAKE_CURRENT_LIST_DIR}/src/AndroidVideoDecoder.cpp)
+# endif()
 
 add_executable(mnncli ${MNNCLI_SOURCES})
 
@@ -118,14 +123,15 @@ target_include_directories(mnncli PRIVATE
     ${MNN_SOURCE_DIR}/transformers/llm/engine/include
     ${MNN_SOURCE_DIR}/transformers/llm/engine/src
     ${MNN_SOURCE_DIR}/3rd_party
-    ${OPENSSL_INCLUDE_DIR}
     ${MNN_SOURCE_DIR}/transformers/llm/engine/app/jsonhpp
+    ${CMAKE_CURRENT_LIST_DIR}/../frameworks/model_downloader/cpp/include
 )
 
 # ... OpenCV configuration ...
 
 # Link to pre-built MNN static library
 target_link_libraries(mnncli PRIVATE ${MNN_LIBRARY})
+target_link_libraries(mnncli PRIVATE ${LLM_LIBRARY})
 
 # Link model downloader
 target_link_libraries(mnncli PRIVATE mnn_model_downloader)
@@ -143,10 +149,13 @@ if(APPLE)
 endif()
 
 # Link pthread and dl on Linux/macOS
-if(UNIX)
-    target_link_libraries(mnncli PRIVATE pthread dl)
-endif()
+# if(UNIX)
+#     target_link_libraries(mnncli PRIVATE pthread dl)
+# endif()
 
+if(CMAKE_SYSTEM_NAME STREQUAL "Android")
+  target_link_libraries(mnncli PRIVATE log m android)
+endif()
 # Link OpenSSL static libraries
 if(OpenSSL_FOUND)
     # Add OpenSSL support
diff --git a/apps/mnncli/android_build.sh b/apps/mnncli/android_build.sh
index b5cfaa96..d7ef5aab 100755
--- a/apps/mnncli/android_build.sh
+++ b/apps/mnncli/android_build.sh
@@ -233,6 +233,7 @@ else
         -DANDROID_ABI="$TARGET_ARCH" \
         -DANDROID_PLATFORM=android-24 \
         -DCMAKE_BUILD_TYPE=Release \
+        -DMNN_BUILD_SHARED_LIBS=ON \
         -DMNN_BUILD_TRAIN=OFF \
         -DMNN_BUILD_TRAIN_MINI=OFF \
         -DMNN_BUILD_DEMO=OFF \
@@ -241,6 +242,13 @@ else
         -DMNN_BUILD_BENCHMARK=OFF \
         -DMNN_BUILD_FOR_ANDROID=ON \
         -DMNN_USE_OPENCV=ON \
+        -DMNN_OPENCL=ON \
+        -DMNN_USE_LOGCAT=ON \
+        -DMNN_QNN=ON \
+        -DMNN_NNAPI=ON \
+        -DMNN_BUILD_LLM=ON \
+        -DMNN_BUILD_LLM_OMNI=ON \
+        -DMNN_WITH_PLUGIN=ON \
         -DOPENCV_ANDROID_SDK="$OPENCV_ANDROID_SDK" \
         -DCMAKE_VERBOSE_MAKEFILE="$VERBOSE"
     
diff --git a/apps/mnncli/src/mnncli.cpp b/apps/mnncli/src/mnncli.cpp
index 4313bfc5..adfd0066 100644
--- a/apps/mnncli/src/mnncli.cpp
+++ b/apps/mnncli/src/mnncli.cpp
@@ -64,11 +64,11 @@ public:
                 
                 // Register all handlers
                 dispatcher.Register(std::make_unique<mnncli::RunCommandHandler>());
-                dispatcher.Register(std::make_unique<mnncli::DeleteCommandHandler>());
+                // dispatcher.Register(std::make_unique<mnncli::DeleteCommandHandler>());
                 dispatcher.Register(std::make_unique<mnncli::ListCommandHandler>());
-                dispatcher.Register(std::make_unique<mnncli::SearchCommandHandler>());
-                dispatcher.Register(std::make_unique<mnncli::DownloadCommandHandler>());
-                dispatcher.Register(std::make_unique<mnncli::ModelInfoCommandHandler>());
+                // dispatcher.Register(std::make_unique<mnncli::SearchCommandHandler>());
+                // dispatcher.Register(std::make_unique<mnncli::DownloadCommandHandler>());
+                // dispatcher.Register(std::make_unique<mnncli::ModelInfoCommandHandler>());
                 dispatcher.Register(std::make_unique<mnncli::ServeCommandHandler>());
                 dispatcher.Register(std::make_unique<mnncli::BenchmarkCommandHandler>());
                 dispatcher.Register(std::make_unique<mnncli::ConfigCommandHandler>());
diff --git a/apps/mnncli/src/model_runner.cpp b/apps/mnncli/src/model_runner.cpp
index ba13d474..4073e3ce 100644
--- a/apps/mnncli/src/model_runner.cpp
+++ b/apps/mnncli/src/model_runner.cpp
@@ -6,7 +6,7 @@
 //
 
 #include "model_runner.hpp"
-#include "log_utils.hpp"
+// #include "log_utils.hpp"
 #include "../../../transformers/llm/engine/include/llm/llm.hpp"
 #include <MNN/AutoTime.hpp>
 #include <MNN/expr/ExecutorScope.hpp>
@@ -19,9 +19,9 @@
 #include <future>
 #include <string>
 
-#ifdef __ANDROID__
-#include "AndroidVideoDecoder.hpp"
-#endif
+// #ifdef __ANDROID__
+// #include "AndroidVideoDecoder.hpp"
+// #endif
 
 using namespace MNN::Transformer;
 
@@ -160,51 +160,51 @@ int ModelRunner::ProcessVideoPrompt(const std::string& prompt_str, std::ostream*
 
 #ifdef __ANDROID__
     // Android native decoding path
-    LOG_DEBUG("Using Android native decoder for: " + video_path);
-
-    MNN::AndroidVideoDecoder decoder;
-    if (!decoder.init(video_path)) {
-        LOG_ERROR("Failed to initialize AndroidVideoDecoder for path: " + video_path);
-        return 1;
-    }
-
-    double fps = decoder.get_fps();
-    if (fps <= 0) fps = 30.0; // Fallback fps
-    int sample_rate = 2; // frames per second
-    int frame_interval = static_cast<int>(fps / sample_rate);
-    if (frame_interval <= 0) frame_interval = 1;
-
-            LOG_DEBUG("Sampling video at " + std::to_string(sample_rate) + " fps, interval: " + std::to_string(frame_interval));
-
-    int frame_idx = 0;
-    int frames_processed = 0;
-    while (frames_processed < 100 && !decoder.is_eos()) {
-        cv::Mat frame = decoder.decode_one_frame();
-        if (frame.empty()) {
-            if (decoder.is_eos()) break;
-            continue;
-        }
-
-        if (frame_idx % frame_interval == 0) {
-            int current_second = static_cast<int>(frame_idx / fps);
-            char timestamp[32];
-            snprintf(timestamp, sizeof(timestamp), "Frame at %02d:%02d: ", current_second / 60, current_second % 60);
-            final_prompt += timestamp;
-            final_prompt += "<img></img>";
+    // LOG_DEBUG("Using Android native decoder for: " + video_path);
+
+    // MNN::AndroidVideoDecoder decoder;
+    // if (!decoder.init(video_path)) {
+    //     LOG_ERROR("Failed to initialize AndroidVideoDecoder for path: " + video_path);
+    //     return 1;
+    // }
+
+    // double fps = decoder.get_fps();
+    // if (fps <= 0) fps = 30.0; // Fallback fps
+    // int sample_rate = 2; // frames per second
+    // int frame_interval = static_cast<int>(fps / sample_rate);
+    // if (frame_interval <= 0) frame_interval = 1;
+
+    //         LOG_DEBUG("Sampling video at " + std::to_string(sample_rate) + " fps, interval: " + std::to_string(frame_interval));
+
+    // int frame_idx = 0;
+    // int frames_processed = 0;
+    // while (frames_processed < 100 && !decoder.is_eos()) {
+    //     cv::Mat frame = decoder.decode_one_frame();
+    //     if (frame.empty()) {
+    //         if (decoder.is_eos()) break;
+    //         continue;
+    //     }
+
+    //     if (frame_idx % frame_interval == 0) {
+    //         int current_second = static_cast<int>(frame_idx / fps);
+    //         char timestamp[32];
+    //         snprintf(timestamp, sizeof(timestamp), "Frame at %02d:%02d: ", current_second / 60, current_second % 60);
+    //         final_prompt += timestamp;
+    //         final_prompt += "<img></img>";
             
-            auto var = MatToVar(frame);
-            if (var.get() != nullptr) {
-                images.push_back(var);
-                frames_processed++;
-                LOG_DEBUG("Successfully processed frame " + std::to_string(frame_idx));
-            } else {
-                LOG_DEBUG("Failed to convert frame " + std::to_string(frame_idx) + " to VARP");
-            }
-        }
-        frame_idx++;
-    }
-    decoder.release();
-    LOG_DEBUG("Android native decoding finished. Processed " + std::to_string(frames_processed) + " frames.");
+    //         auto var = MatToVar(frame);
+    //         if (var.get() != nullptr) {
+    //             images.push_back(var);
+    //             frames_processed++;
+    //             LOG_DEBUG("Successfully processed frame " + std::to_string(frame_idx));
+    //         } else {
+    //             LOG_DEBUG("Failed to convert frame " + std::to_string(frame_idx) + " to VARP");
+    //         }
+    //     }
+    //     frame_idx++;
+    // }
+    // decoder.release();
+    // LOG_DEBUG("Android native decoding finished. Processed " + std::to_string(frames_processed) + " frames.");
 
 #else
     // Original OpenCV path for non-Android platforms