exception on FaceAiSharpBundleFactory.CreateFaceDetectorWithLandmarks()

[wsoftone]

Hi,
I tried your example to compare two face (code below) and it worked fine on .net maui (win & andtoid).
After making an update of the faceaisharp, the android app throw an exception:
Microsoft.ML.OnnxRuntime.OnnxRuntimeException: '[ErrorCode:NoSuchFile] Load model from /data/data/com.companyname.facerecognitiontest/files/.override/onnx/scrfd_2.5g_kps.onnx failed:Load model /data/data/com.companyname.facerecognitiontest/files/.override/onnx/scrfd_2.5g_kps.onnx failed. File doesn't exist'

On windows it still working. but on Adroid i am getting the exception on this line:
var det = FaceAiSharpBundleFactory.CreateFaceDetectorWithLandmarks();
I am not able to resolve this issue. Can you please help with this. Is it possible to provide an example that works on .net maui for Android.

thanks in advance.

[georg-jung]

Sorry for the delay in responding. A working MAUI on Android example is available here: https://github.com/georg-jung/explain-face-rec/tree/master/src/BlazorFace.Maui

Your issue might be related to how assets are handled on the different platforms. Take a look at the csproj in the linked repo:

  <Target Name="ConvertToMauiAsset" DependsOnTargets="ResolveProjectReferences" BeforeTargets="PrepareForBuild">
    <ItemGroup>
      <ContentToMauiAsset Include="@(Content)" Condition="'%(Extension)' == '.onnx'" />
      <MauiAsset Include="@(ContentToMauiAsset)" />
      <Content Remove="@(ContentToMauiAsset)" />
    </ItemGroup>
  </Target>

And also here: https://github.com/georg-jung/explain-face-rec/blob/fe8a4e5d783b2a8eb22c33f8fcb9c8d3a89665eb/src/BlazorFace.Maui/MauiProgram.cs#L31

Let me know if this works for you or if you need further assistance.

[wsoftone]

thank for your reply.
I tried all your procedures. I am still having the same exception.

[georg-jung]

Could you provide a more complete repro, probably a repository that contains a project where this does not work?

This is most probably related to Android specifics when reading ressource files. Do you have something like https://github.com/georg-jung/explain-face-rec/blob/fe8a4e5d783b2a8eb22c33f8fcb9c8d3a89665eb/src/BlazorFace.Maui/MauiResourceOpener.cs in your project? If not, it can not work on Android.

[wsoftone]

faceaitestmaui.zip

Hi Georg, I attached the Maui project. I integrated all necessery code from your example. It still not working on Adroid: Microsoft.ML.OnnxRuntime.OnnxRuntimeException: '[ErrorCode:NoSuchFile] .

Thank you for your assistance and help.

[georg-jung]

I couldn't find a ConvertToMauiAsset target (or similar) in your FaceAiMaui.csproj.

Please try adding something like this:

  <Target Name="ConvertToMauiAsset" DependsOnTargets="ResolveProjectReferences" BeforeTargets="PrepareForBuild">
    <ItemGroup>
      <ContentToMauiAsset Include="@(Content)" Condition="'%(Extension)' == '.onnx'" />
      <MauiAsset Include="@(ContentToMauiAsset)" />
      <Content Remove="@(ContentToMauiAsset)" />
    </ItemGroup>
  </Target>

[wsoftone]

Hi Georg, I added the missing code and revised the code again. still does not work.

[wsoftone]

Hi Georg, I added the missing code and revised the code again. still does not work.
on Adroid i am getting the exception on this line: var det = FaceAiSharpBundleFactory.
I checked the source code of FaceAiSharpBundleFactory and i found that GetExeDir() is the issue. The flles: scrfd_2.5g_kps.onnx, arcfaceresnet100-11-int8.onnx and open_closed_eye.onnx are not copied to the device after deployment.

[Abbossbek]

Hello, I also faced the same problem on avalonia android. Did you find a solution to this?

[wsoftone]

Just to make this work on your android device :
1-copy the files : scrfd_2.5g_kps.onnx, arcfaceresnet100-11-int8.onnx and open_closed_eye.onnx to the app location on your android device.
2- replace the GetExeDir() methods in the FaceAiSharpBundleFactory class with the absolute path of the previously copied files.

One solution could be to add a new method to the FaceAiSharpBundleFactory class that copies the mentioned files from the project to the Android device. This will be a decision for Georg.

[georg-jung]

I'm currently on holiday, sorry, but I'll probably take a look at this in the coming weeks. In the meantime, https://github.com/georg-jung/explain-face-rec/ has a fully working android app based on FaceAiSharp. Android has some specifics about how to access files bundled with the app instead of it's data directory. The repo contains a working example for this though. To take a look at your specific problems it would be very helpful to look at the specific code you're trying to make work. Easiest would be an up to date minimal working example in a git repo.

[NguyenDucTheAn]

Has there been any update regarding this issue?

[NguyenDucTheAn]

The .onnx files do exist in the package folder. But no matter what i tried (your convert code or full path indication to make the build action fixed as MauiAsset), the error just persists. During the struggle, I discovered that visual studio (2022) has a thing with .onnx file.
I tried copying one of the .onnx files (the scrfd one), rename it, put it in the project folder, change the build action to EmbeddedResource and then use the Assembly.GetManifestResourceNames() to list and check if the .onnx file is included (debug on Adroid phone with USB cable).........The result is no, the .onnx file isn't found in the listed names (try that with a text file and it works though). Does that mean Visual Studio somehow doesn't support .onnx file?

(Just in case: my .net maui project is just a blank one whose inital button function got modified so that it only contains 3 lines for debug purpose "mylabel.Text += "Start..."; var det = FaceAiSharpBundleFactory.CreateFaceDetector(); mylabel.Text += "...OK";)

[NguyenDucTheAn]

I use the command prompt and adb root to navigate the folder tree on the android emulator......and I see that: not to mention the .onnx files, the onnx folder doesn't even exist! Therefore, I fiddle with the adb shell a bit to create directory "onnx" and copy the .onnx file (from package folder) to it. It finally works.......on my android emulator only. My real android phone is a different story.

[NguyenDucTheAn]

I finally make my blank project work on my real android phone.

1. Copy the crfd_2.5g_kps.onnx file from the package folder to my project folder "Resource/Raw".
2. Right click it > Properties > Change its build action to MauiAsset (and also the CopyToOutputDirectory to Always, maybe?)
3. Create a better version of this clumsy function (or copy it):
   private void MakeOnnxFileExist() { #if ANDROID string assetName = "scrfd_2.5g_kps.onnx"; string errorPath = "/data/data/com.companyname.mauiappplayface/files/.__override__/onnx/"; Directory.CreateDirectory(errorPath); var assetManager = Android.App.Application.Context.Assets; using (Stream assetStream = assetManager.Open(assetName)) { string destinationPath = Path.Combine(errorPath, assetName); using (FileStream destinationStream = File.Create(destinationPath)) assetStream.CopyTo(destinationStream); } #endif }
4. That function should run before the FaceAiSharpBundleFactory.CreateFaceDetector() fucntion.

I hope this temporary solution can help.