Qualcomm AI Engine Direct - Minimal Inference Runtime Core Requirment

[winskuo-quic]

Summary

1. Removed from_blob tensor creation
2. Compile and Linking Option optimization
3. Function visibility optimization
4. Expose Power Config to user: This is a quick workaround, however, we should expose more configs for user to set. To make it easier for user to set all configs, we have also perform some refactor on Python API to make it easier to achieve this. Python API refactor PR: Qualcomm AI Engine Direct - Python API Refactor #18312

Test plan

add --direct_build_folder build-hexagon/ at end of any TestQNNQuantizedUtils, TestQNNQuantizedModel, TestQNNFloatingPointModel, TestQNNFloatingPointOperator

Author: @haowhsu-quic, @shewu-quic, @winskuo-quic

[pytorch-bot]

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/executorch/18434

• 📄 Preview Python docs built from this PR

Note: Links to docs will display an error until the docs builds have been completed.

❌ 1 New Failure, 2 Unrelated Failures

As of commit 3c9a652 with merge base c7f1d72 ():

NEW FAILURE - The following job has failed:

• Cadence Build & Test / cpu-test / test-ops / test-ops (gh)
  examples/cadence/operators/test_g3_ops.py::ATenOpTestCases::test_g3_neg_out_4

BROKEN TRUNK - The following jobs failed but were present on the merge base:

👉 Rebase onto the `viable/strict` branch to avoid these failures

• pull / unittest / windows / windows-job (gh) (trunk failure)
  ##[error]The operation was canceled.
• pull / unittest-editable / windows / windows-job (gh) (trunk failure)
  ##[error]The operation was canceled.

This comment was automatically generated by Dr. CI and updates every 15 minutes.

[github-actions]

This PR needs a release notes: label

If your change should be included in the release notes (i.e. would users of this library care about this change?), please use a label starting with release notes:. This helps us keep track and include your important work in the next release notes.

To add a label, you can comment to pytorchbot, for example
@pytorchbot label "release notes: none"

For more information, see
https://github.com/pytorch/pytorch/wiki/PyTorch-AutoLabel-Bot#why-categorize-for-release-notes-and-how-does-it-work.

[abhinaykukkadapu]

@winskuo-quic can you please rebase.

[winskuo-quic]

@winskuo-quic can you please rebase.

I have rebased. Thanks

[meta-codesync]

@abhinaykukkadapu has imported this pull request. If you are a Meta employee, you can view this in D99394613.

[abhinaykukkadapu]

@winskuo-quic do we want to init zeros for stride?

[winskuo-quic]

Updated to align with from_blob behavior. Thanks