8000 [BUG] File bug report：can not use --device "Snapdragon 8 Gen 3 QRD" · Issue #189 · quic/ai-hub-models · GitHub
[go: up one dir, main page]
More Web Proxy on the site http://driver.im/
Skip to content

[BUG] File bug report：can not use --device "Snapdragon 8 Gen 3 QRD" #189

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Open
ZJY0516 opened this issue Apr 18, 2025 · 1 comment
Open

[BUG] File bug report：can not use --device "Snapdragon 8 Gen 3 QRD" #189

ZJY0516 opened this issue Apr 18, 2025 · 1 comment
Labels
bug Something isn't working

Comments

@ZJY0516
Copy link
ZJY0516 commented Apr 18, 2025

Describe the bug
A clear and concise description of what the bug is.

To Reproduce
Steps to reproduce the behavior:

python -m qai_hub_models.models.llama_v3_2_3b_chat_quantized.export --device "Snapdragon 8 Gen 3 QRD" --skip-inferencing --skip-profiling --output-dir /genie_bundle

Traceback (most recent call last):
  File "/usr/lib/python3.10/runpy.py", line 196, in _run_module_as_main
    return _run_code(code, main_globals, None,
  File "/usr/lib/python3.10/runpy.py", line 86, in _run_code
    exec(code, run_globals)
  File "/ai-hub-apps/llm_on_genie_venv/lib/python3.10/site-packages/qai_hub_models/models/llama_v3_2_3b_chat_quantized/export.py", line 60, in <module>
    main()
  File "/ai-hub-apps/llm_on_genie_venv/lib/python3.10/site-packages/qai_hub_models/models/llama_v3_2_3b_chat_quantized/export.py", line 48, in main
    export_model(
  File "/ai-hub-apps/llm_on_genie_venv/lib/python3.10/site-packages/qai_hub_models/models/_shared/llama3/export.py", line 124, in export_model
    hub_device = hub_devices[-1]
IndexError: list index out of range

Stack trace
If applicable, add screenshots to help explain your problem.

Host configuration:

Here is my dockerfile

FROM ubuntu:22.04

ARG DEBIAN_FRONTEND=noninteractive
ENV TZ=Asia/Shanghai

RUN sed -i 's/archive.ubuntu.com/mirrors.nju.edu.cn/g' /etc/apt/sources.list \
    && sed -i 's/security.ubuntu.com/mirrors.nju.edu.cn/g' /etc/apt/sources.list \
    && apt-get update \
    && apt-get install -y --no-install-recommends \
    gcc g++ git build-essential cmake wget python3-venv python3-pip \
    && rm -rf /var/lib/apt/lists/*

COPY ./install/* /tmp

RUN apt install /tmp/*.deb -y \
    && qpm-cli --login riverclouds.zhu@qq.com 4DWK!WpcBYiJed \
    && qpm-cli --install QPM3 \
    && qpm-cli --license-activate qualcomm_ai_engine_direct \
    && qpm-cli --extract /tmp/qualcomm_ai_engine_direct.2.31.0.250130.Linux-AnyCPU.qik --silent \
    && rm -rf /tmp/*.deb \
    && apt-get clean \
    && apt-get autoclean \
    && rm -rf /var/lib/apt/lists/*

ENV QNN_SDK_ROOT=/opt/qcom/aistack/qairt/2.31.0.250130

RUN git clone https://github.com/quic/ai-hub-apps /ai-hub-apps

WORKDIR /ai-hub-apps

RUN python3.10 -m venv llm_on_genie_venv \
    && . llm_on_genie_venv/bin/activate \
    && pip config set global.index-url https://mirror.nju.edu.cn/pypi/web/simple \
    && pip install -U "qai_hub_models[llama-v3-2-3b-chat-quantized]"

ENV HF_ENDPOINT=https://hf-mirror.com

Additional context
qai-hub list-devices

+-------------------------------+------------+----------+---------+---------------------------------------------+---------------------------------------------------------+
|             Device            |     OS     |  Vendor  |   Type  |                   Chipset                   |                      CLI Invocation                     |
+-------------------------------+------------+----------+---------+---------------------------------------------+---------------------------------------------------------+
|    Google Pixel 3 (Family)    | Android 10 |  Google  |  Phone  |       qualcomm-snapdragon-845, sdm845       |    --device "Google Pixel 3 (Family)" --device-os 10    |
|         Google Pixel 3        | Android 10 |  Google  |  Phone  |       qualcomm-snapdragon-845, sdm845       |         --device "Google Pixel 3" --device-os 10        |
|        Google Pixel 3a        | Android 10 |  Google  |  Phone  |       qualcomm-snapdragon-670, sdm670       |        --device "Google Pixel 3a" --device-os 10        |
|       Google Pixel 3 XL       | Android 10 |  Google  |  Phone  |       qualcomm-snapdragon-845, sdm845       |       --device "Google Pixel 3 XL" --device-os 10       |
|         Google Pixel 4        | Android 10 |  Google  |  Phone  |       qualcomm-snapdragon-855, sm8150       |         --device "Google Pixel 4" --device-os 10        |
|         Google Pixel 4        | Android 11 |  Google  |  Phone  |       qualcomm-snapdragon-855, sm8150       |         --device "Google Pixel 4" --device-os 11        |
|        Google Pixel 4a        | Android 11 |  Google  |  Phone  |     qualcomm-snapdragon-730g, sm7150-ab     |        --device "Google Pixel 4a" --device-os 11        |
|         Google Pixel 5        | Android 11 |  Google  |  Phone  |       qualcomm-snapdragon-765g, sm7250      |         --device "Google Pixel 5" --device-os 11        |
|     Samsung Galaxy Tab S7     | Android 11 | Samsung  |  Tablet |     qualcomm-snapdragon-865+, sm8250-ab     |     --device "Samsung Galaxy Tab S7" --device-os 11     |
|  Samsung Galaxy Tab A8 (2021) | Android 11 | Samsung  |  Tablet |       qualcomm-snapdragon-429, sdm429       |  --device "Samsung Galaxy Tab A8 (2021)" --device-os 11 |
| Samsung Galaxy Note 20 (Intl) | Android 11 | Samsung  |  Phone  |              samsung-exynos-990             | --device "Samsung Galaxy Note 20 (Intl)" --device-os 11 |
|  Samsung Galaxy S21 (Family)  | Android 11 | Samsung  |  Phone  |       qualcomm-snapdragon-888, sm8350       |  --device "Samsung Galaxy S21 (Family)" --device-os 11  |
|       Samsung Galaxy S21      | Android 11 | Samsung  |  Phone  |       qualcomm-snapdragon-888, sm8350       |       --device "Samsung Galaxy S21" --device-os 11      |
|      Samsung Galaxy S21+      | Android 11 | Samsung  |  Phone  |       qualcomm-snapdragon-888, sm8350       |      --device "Samsung Galaxy S21+" --device-os 11      |
|    Samsung Galaxy S21 Ultra   | Android 11 | Samsung  |  Phone  |       qualcomm-snapdragon-888, sm8350       |    --device "Samsung Galaxy S21 Ultra" --device-os 11   |
|    Xiaomi Redmi Note 10 5G    | Android 11 | Oneplus  |  Phone  |      qualcomm-snapdragon-678, sm6150-ac     |    --device "Xiaomi Redmi Note 10 5G" --device-os 11    |
|       Google Pixel 3a XL      | Android 12 |  Google  |  Phone  |       qualcomm-snapdragon-670, sdm670       |       --device "Google Pixel 3a XL" --device-os 12      |
|        Google Pixel 4a        | Android 12 |  Google  |  Phone  |     qualcomm-snapdragon-730g, sm7150-ab     |        --device "Google Pixel 4a" --device-os 12        |
|    Google Pixel 5 (Family)    | Android 12 |  Google  |  Phone  |       qualcomm-snapdragon-765g, sm7250      |    --device "Google Pixel 5 (Family)" --device-os 12    |
|         Google Pixel 5        | Android 12 |  Google  |  Phone  |       qualcomm-snapdragon-765g, sm7250      |         --device "Google Pixel 5" --device-os 12        |
|       Google Pixel 5a 5G      | Android 12 |  Google  |  Phone  |       qualcomm-snapdragon-765g, sm7250      |       --device "Google Pixel 5a 5G" --device-os 12      |
|         Google Pixel 6        | Android 12 |  Google  |  Phone  |                google-tensor                |         --device "Google Pixel 6" --device-os 12        |
|     Samsung Galaxy A53 5G     | Android 12 | Samsung  |  Phone  |             samsung-exynos-1280             |     --device "Samsung Galaxy A53 5G" --device-os 12     |
|     Samsung Galaxy A73 5G     | Android 12 | Samsung  |  Phone  |       qualcomm-snapdragon-778g, sm7325      |     --device "Samsung Galaxy A73 5G" --device-os 12     |
|       RB3 Gen 2 (Proxy)       | Android 12 | Qualcomm |   Iot   |            qualcomm-qcs6490-proxy           |       --device "RB3 Gen 2 (Proxy)" --device-os 12       |
|        QCS6490 (Proxy)        | Android 12 | Qualcomm |   Iot   |            qualcomm-qcs6490-proxy           |        --device "QCS6490 (Proxy)" --device-os 12        |
|          RB5 (Proxy)          | Android 12 | Qualcomm |   Iot   |            qualcomm-qcs8250-proxy           |          --device "RB5 (Proxy)" --device-os 12          |
|        QCS8250 (Proxy)        | Android 12 | Qualcomm |   Iot   |            qualcomm-qcs8250-proxy           |        --device "QCS8250 (Proxy)" --device-os 12        |
|        QCS8550 (Proxy)        | Android 12 | Qualcomm |   Iot   |            qualcomm-qcs8550-proxy           |        --device "QCS8550 (Proxy)" --device-os 12        |
|  Samsung Galaxy S21 (Family)  | Android 12 | Samsung  |  Phone  |       qualcomm-snapdragon-888, sm8350       |  --device "Samsung Galaxy S21 (Family)" --device-os 12  |
|       Samsung Galaxy S21      | Android 12 | Samsung  |  Phone  |       qualcomm-snapdragon-888, sm8350       |       --device "Samsung Galaxy S21" --device-os 12      |
|    Samsung Galaxy S21 Ultra   | Android 12 | Samsung  |  Phone  |       qualcomm-snapdragon-888, sm8350       |    --device "Samsung Galaxy S21 Ultra" --device-os 12   |
|  Samsung Galaxy S22 (Family)  | Android 12 | Samsung  |  Phone  |      qualcomm-snapdragon-8gen1, sm8450      |  --device "Samsung Galaxy S22 (Family)" --device-os 12  |
|  Samsung Galaxy S22 Ultra 5G  | Android 12 | Samsung  |  Phone  |      qualcomm-snapdragon-8gen1, sm8450      |  --device "Samsung Galaxy S22 Ultra 5G" --device-os 12  |
|     Samsung Galaxy S22 5G     | Android 12 | Samsung  |  Phone  |      qualcomm-snapdragon-8gen1, sm8450      |     --device "Samsung Galaxy S22 5G" --device-os 12     |
|     Samsung Galaxy S22+ 5G    | Android 12 | Samsung  |  Phone  |      qualcomm-snapdragon-8gen1, sm8450      |     --device "Samsung Galaxy S22+ 5G" --device-os 12    |
|     Samsung Galaxy Tab S8     | Android 12 | Samsung  |  Tablet |      qualcomm-snapdragon-8gen1, sm8450      |     --device "Samsung Galaxy Tab S8" --device-os 12     |
|       Xiaomi 12 (Family)      | Android 12 |  Xiaomi  |  Phone  |      qualcomm-snapdragon-8gen1, sm8450      |       --device "Xiaomi 12 (Family)" --device-os 12      |
|           Xiaomi 12           | Android 12 |  Xiaomi  |  Phone  |      qualcomm-snapdragon-8gen1, sm8450      |           --device "Xiaomi 12" --device-os 12           |
|         Xiaomi 12 Pro         | Android 12 |  Xiaomi  |  Phone  |      qualcomm-snapdragon-8gen1, sm8450      |         --device "Xiaomi 12 Pro" --device-os 12         |
|    Google Pixel 6 (Family)    | Android 13 |  Google  |  Phone  |                google-tensor                |    --device "Google Pixel 6 (Family)" --device-os 13    |
|         Google Pixel 6        | Android 13 |  Google  |  Phone  |                google-tensor                |         --device "Google Pixel 6" --device-os 13        |
|        Google Pixel 6a        | Android 13 |  Google  |  Phone  |                google-tensor                |        --device "Google Pixel 6a" --device-os 13        |
|    Google Pixel 7 (Family)    | Android 13 |  Google  |  Phone  |               google-tensor-g2              |    --device "Google Pixel 7 (Family)" --device-os 13    |
|         Google Pixel 7        | Android 13 |  Google  |  Phone  |               google-tensor-g2              |         --device "Google Pixel 7" --device-os 13        |
|       Google Pixel 7 Pro      | Android 13 |  Google  |  Phone  |               google-tensor-g2              |       --device "Google Pixel 7 Pro" --device-os 13      |
|     Samsung Galaxy A14 5G     | Android 13 | Samsung  |  Phone  |             samsung-exynos-1330             |     --device "Samsung Galaxy A14 5G" --device-os 13     |
|     Samsung Galaxy S22 5G     | Android 13 | Samsung  |  Phone  |      qualcomm-snapdragon-8gen1, sm8450      |     --device "Samsung Galaxy S22 5G" --device-os 13     |
|        QCS8450 (Proxy)        | Android 13 | Qualcomm |    Xr   |            qualcomm-qcs8450-proxy           |        --device "QCS8450 (Proxy)" --device-os 13        |
|       XR2 Gen 2 (Proxy)       | Android 13 | Qualcomm |    Xr   |            qualcomm-qcs8450-proxy           |       --device "XR2 Gen 2 (Proxy)" --device-os 13       |
|  Samsung Galaxy S23 (Family)  | Android 13 | Samsung  |  Phone  |      qualcomm-snapdragon-8gen2, sm8550      |  --device "Samsung Galaxy S23 (Family)" --device-os 13  |
|         SA8650 (Proxy)        | Android 13 | Qualcomm |   Auto  |            qualcomm-sa8650p-proxy           |         --device "SA8650 (Proxy)" --device-os 13        |
|         S
99FD
A8775 (Proxy)        | Android 13 | Qualcomm |   Auto  |            qualcomm-sa8775p-proxy           |         --device "SA8775 (Proxy)" --device-os 13        |
|         SA8255 (Proxy)        | Android 13 | Qualcomm |   Auto  |            qualcomm-sa8255p-proxy           |         --device "SA8255 (Proxy)" --device-os 13        |
|       Samsung Galaxy S23      | Android 13 | Samsung  |  Phone  |      qualcomm-snapdragon-8gen2, sm8550      |       --device "Samsung Galaxy S23" --device-os 13      |
|      Samsung Galaxy S23+      | Android 13 | Samsung  |  Phone  |      qualcomm-snapdragon-8gen2, sm8550      |      --device "Samsung Galaxy S23+" --device-os 13      |
|    Samsung Galaxy S23 Ultra   | Android 13 | Samsung  |  Phone  |      qualcomm-snapdragon-8gen2, sm8550      |    --device "Samsung Galaxy S23 Ultra" --device-os 13   |
|         Google Pixel 7        | Android 14 |  Google  |  Phone  |               google-tensor-g2              |         --device "Google Pixel 7" --device-os 14        |
|    Google Pixel 8 (Family)    | Android 14 |  Google  |  Phone  |               google-tensor-g3              |    --device "Google Pixel 8 (Family)" --device-os 14    |
|         Google Pixel 8        | Android 14 |  Google  |  Phone  |               google-tensor-g3              |         --device "Google Pixel 8" --device-os 14        |
|       Google Pixel 8 Pro      | Android 14 |  Google  |  Phone  |               google-tensor-g3              |       --device "Google Pixel 8 Pro" --device-os 14      |
|  Samsung Galaxy S24 (Family)  | Android 14 | Samsung  |  Phone  |      qualcomm-snapdragon-8gen3, sm8650      |  --device "Samsung Galaxy S24 (Family)" --device-os 14  |
|       Samsung Galaxy S24      | Android 14 | Samsung  |  Phone  |      qualcomm-snapdragon-8gen3, sm8650      |       --device "Samsung Galaxy S24" --device-os 14      |
|    Samsung Galaxy S24 Ultra   | Android 14 | Samsung  |  Phone  |      qualcomm-snapdragon-8gen3, sm8650      |    --device "Samsung Galaxy S24 Ultra" --device-os 14   |
|      Samsung Galaxy S24+      | Android 14 | Samsung  |  Phone  |      qualcomm-snapdragon-8gen3, sm8650      |      --device "Samsung Galaxy S24+" --device-os 14      |
|    Google Pixel 9 (Family)    | Android 15 |  Google  |  Phone  |               google-tensor-g4              |    --device "Google Pixel 9 (Family)" --device-os 15    |
|         Google Pixel 9        | Android 15 |  Google  |  Phone  |               google-tensor-g4              |         --device "Google Pixel 9" --device-os 15        |
|       Google Pixel 9 Pro      | Android 15 |  Google  |  Phone  |               google-tensor-g4              |       --device "Google Pixel 9 Pro" --device-os 15      |
|     Google Pixel 9 Pro XL     | Android 15 |  Google  |  Phone  |               google-tensor-g4              |     --device "Google Pixel 9 Pro XL" --device-os 15     |
|    Snapdragon 8cx Gen 3 CRD   | Windows 11 | Qualcomm | Compute |     qualcomm-snapdragon-8cxgen3, sc8280x    |    --device "Snapdragon 8cx Gen 3 CRD" --device-os 11   |
|     Snapdragon X Elite CRD    | Windows 11 | Qualcomm | Compute |    qualcomm-snapdragon-x-elite, sc8380xp    |     --device "Snapdragon X Elite CRD" --device-os 11    |
|  Snapdragon X Plus 8-Core CRD | Windows 11 | Qualcomm | Compute | qualcomm-snapdragon-x-plus-8-core, sc8340xp |  --device "Snapdragon X Plus 8-Core CRD" --device-os 11 |
|     Snapdragon 8 Elite QRD    | Android 15 | Qualcomm |  Phone  |     qualcomm-snapdragon-8-elite, sm8750     |     --device "Snapdragon 8 Elite QRD" --device-os 15    |
|          SA8295P ADP          | Android 14 | Qualcomm |   Auto  |               qualcomm-sa8295p              |          --device "SA8295P ADP" --device-os 14          |
|          SA8775P ADP          | Android 14 | Qualcomm |   Auto  |               qualcomm-sa8775p              |          --device "SA8775P ADP" --device-os 14          |
|          SA7255P ADP          | Android 14 | Qualcomm |   Auto  |               qualcomm-sa7255p              |          --device "SA7255P ADP" --device-os 14          |
|        QCS9075 (Proxy)        | Android 14 | Qualcomm |   Iot   |            qualcomm-qcs9075-proxy           |        --device "QCS9075 (Proxy)" --device-os 14        |
|        QCS8275 (Proxy)        | Android 14 | Qualcomm |   Iot   |            qualcomm-qcs8275-proxy           |        --device "QCS8275 (Proxy)" --device-os 14        |
+-------------------------------+------------+----------+---------+---------------------------------------------+---------------------------------------------------------+
@ZJY0516 ZJY0516 changed the title [BUG] File bug report： can not use --device "Snapdragon 8 Gen 3 QRD" [BUG] File bug report：can not use --device "Snapdragon 8 Gen 3 QRD" Apr 18, 2025
@mestrona-3 mestrona-3 added the bug Something isn't working label Apr 18, 2025
@mestrona-3
Copy link

Hi @ZJY0516, sorry for the delayed response here! Our naming of this device changed recently (as an aside, did you provide that device name or was it baked in to our export script, if its baked in we should fix it up!), based on the output of list-devices you've provided above you'll want to specify the chipset to be qualcomm-snapdragon-8gen3.

For example, hub.get_devices(attributes=["chipset:qualcomm-snapdragon-8gen3"])

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
bug Something isn't working
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@ZJY0516 @mestrona-3
0