10000 KWS Test does not pass when Porting Audiomark · Issue #77 · eembc/audiomark · GitHub
[go: up one dir, main page]
More Web Proxy on the site http://driver.im/
Skip to content
KWS Test does not pass when Porting Audiomark #77
Open
@JayeshEngibrains

Description

@JayeshEngibrains

Hi I am trying to Port Audiomark on one of the SoC.

SoC does not have Ethos-U55 but a custom neural accelertor. I have ported Audiomark to SoC but to verify if it is ported correctly I ran the kws_test but it fails. I added few prints to determine the failures in KWS.

Below is the code in KWS
ratio = ((float)B / (float)A); /* Noise to signal ratio */
if (ratio > NSRM35DB)
{
err = true;
printf_err("KWS FAIL: Inference #%d exceeded -35 dB SNR, ratio = %f\n", i, ratio);
}

The error log is as follow. What could be the reason behind the failures? Some pointers would be help full.

INFO - Executing test: KWS
INFO - KWS F32 MEMREQ = 8308 bytes
INFO - Model init done
ERROR - KWS FAIL: Inference 8 exceeded -35 dB SNR, ratio = 0.085938
ERROR - KWS FAIL: Inference 9 exceeded -35 dB SNR, ratio = 0.093750
ERROR - KWS FAIL: Inference 11 exceeded -35 dB SNR, ratio = 0.023438
ERROR - KWS FAIL: Inference 43 exceeded -35 dB SNR, ratio = 0.031250
ERROR - KWS FAIL: Inference 44 exceeded -35 dB SNR, ratio = 0.109804
ERROR - KWS FAIL: Inference 46 exceeded -35 dB SNR, ratio = 0.078125
ERROR - KWS FAIL: Inference 47 exceeded -35 dB SNR, ratio = 0.144531
ERROR - KWS FAIL: Inference 48 exceeded -35 dB SNR, ratio = 0.175781
ERROR - KWS FAIL: Inference 49 exceeded -35 dB SNR, ratio = 0.113725
ERROR - KWS FAIL: Inference 52 exceeded -35 dB SNR, ratio = 0.043307
ERROR - KWS FAIL: Inference 53 exceeded -35 dB SNR, ratio = 0.105882
ERROR - KWS FAIL: Inference 54 exceeded -35 dB SNR, ratio = 0.027451
ERROR - KWS FAIL: Inference 56 exceeded -35 dB SNR, ratio = 0.125490
ERROR - KWS FAIL: Inference 57 exceeded -35 dB SNR, ratio = 0.116732
ERROR - KWS FAIL: Inference 58 exceeded -35 dB SNR, ratio = 0.312500
ERROR - KWS FAIL: Inference 59 exceeded -35 dB SNR, ratio = 0.137255
ERROR - KWS FAIL: Inference 61 exceeded -35 dB SNR, ratio = 0.074219
ERROR - KWS FAIL: Inference 62 exceeded -35 dB SNR, ratio = 0.058824
ERROR - KWS FAIL: Inference 63 exceeded -35 dB SNR, ratio = 0.125490
ERROR - KWS FAIL: Inference 64 exceeded -35 dB SNR, ratio = 0.177165
ERROR - KWS FAIL: Inference 66 exceeded -35 dB SNR, ratio = 0.410853
ERROR - KWS FAIL: Inference 67 exceeded -35 dB SNR, ratio = 0.118110
ERROR - KWS FAIL: Inference 68 exceeded -35 dB SNR, ratio = 0.231373
ERROR - KWS FAIL: Inference 69 exceeded -35 dB SNR, ratio = 0.227451
ERROR - KWS FAIL: Inference 71 exceeded -35 dB SNR, ratio = 0.093750
ERROR - KWS FAIL: Inference 72 exceeded -35 dB SNR, ratio = 0.070866
ERROR - KWS FAIL: Inference 73 exceeded -35 dB SNR, ratio = 0.047244
ERROR - KWS FAIL: Inference 74 exceeded -35 dB SNR, ratio = 0.054688
ERROR - KWS FAIL: Inference 76 exceeded -35 dB SNR, ratio = 0.082031
ERROR - KWS FAIL: Inference 77 exceeded -35 dB SNR, ratio = 0.054902
ERROR - KWS test failed

I have also captured more detailed log for inference result. Please find attached log

KWS_Test_Full_Log.txt

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions

      0