batch infrastructure

[nihui]

No description provided.

[tencent-adm]

Thank you for your submission, we really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.
_{You have signed the CLA already but the status is still pending? Let us recheck it.}

[codecov-commenter]

Codecov Report

❌ Patch coverage is 91.77730% with 192 lines in your changes missing coverage. Please review.
✅ Project coverage is 95.47%. Comparing base (a5392dd) to head (974859f).
⚠️ Report is 3 commits behind head on master.

Files with missing lines	Patch %	Lines
src/mat.cpp	73.41%	84 Missing ⚠️
src/net.cpp	82.87%	31 Missing ⚠️
src/c_api.cpp	36.84%	24 Missing ⚠️
src/command.cpp	55.00%	18 Missing ⚠️
src/layer/arm/cast_arm.cpp	50.00%	6 Missing ⚠️
src/layer/loongarch/cast_loongarch.cpp	83.33%	6 Missing ⚠️
src/layer/mips/cast_mips.cpp	83.33%	6 Missing ⚠️
src/layer/x86/cast_x86.cpp	50.00%	6 Missing ⚠️
src/mat.h	94.49%	6 Missing ⚠️
src/layer/vulkan/packing_vulkan.cpp	95.00%	5 Missing ⚠️

Additional details and impacted files

@@            Coverage Diff             @@
##           master    #6656      +/-   ##
==========================================
- Coverage   95.49%   95.47%   -0.02%     
==========================================
  Files         946      946              
  Lines      410295   411466    +1171     
==========================================
+ Hits       391791   392829    +1038     
- Misses      18504    18637     +133     

☔ View full report in Codecov by Harness.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:

• ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

[futz12]

is it will be support that if input is single batch but middle tensor is multi-batch

[nihui]

@codex review

[chatgpt-codex-connector]

💡 Codex Review

Here are some automated review suggestions for this pull request.

Reviewed commit: c48157794d

ℹ️ About Codex in GitHub

Your team has set up Codex to review pull requests in this repo. Reviews are triggered when you

• Open a pull request for review
• Mark a draft as ready
• Comment "@codex review".

If Codex has suggestions, it will comment; otherwise it will react with 👍.

Codex can also answer questions or update the PR. Try commenting "@codex address that feedback".

[chatgpt-codex-connector]

💡 Codex Review

Here are some automated review suggestions for this pull request.

Reviewed commit: 974859f423

ℹ️ About Codex in GitHub

Your team has set up Codex to review pull requests in this repo. Reviews are triggered when you

• Open a pull request for review
• Mark a draft as ready
• Comment "@codex review".

If Codex has suggestions, it will comment; otherwise it will react with 👍.

Codex can also answer questions or update the PR. Try commenting "@codex address that feedback".