HTML report show no params when the test has params

[marioaag]

Running couple of test using the nrunner and generating the HTML report noticed that when I pass the cursor over the test name it shows "No params" when it actually use some params and are accesible using self.params.get()

Is this the expected behaviour? when are parameters show at this level?

Note: I'm generating the runnables and the suits through the API and the parameters are specified at the runnable level.

[beraldoleal]

Hi @marioaag, I can' t see the mouse over "hint" and I tested with two different browsers. Can you please, send us a screenshot?

[marioaag]

ok, ic
In this case we have a bug due it is working whit params defined via run.dic_variants but not with run.test_parameters

I did another quick test running directly from cmd line and it has the same effect the params are reported as None when just one test is executed using --test-parameter

Execution:

[mario@mario iLabConfig]$ avocado run --test-runner='nrunner' /home/mario/git/iLabConfig/test/avocado/testcases/CheckHostStatus/CheckHostStatus.py:CheckHostStatus.test_os_info -p HOST_NAME=ilzlnx1 -p INVENTORI_DIR=/home/mario/git/iLabConfig/uuts/hosts
JOB ID     : cc828d414698b2117542ffe46990afcc49b15f52
JOB LOG    : /tmp/avocado_logs/job-2021-09-28T09.32-cc828d4/job.log
 (1/1) /home/mario/git/iLabConfig/test/avocado/testcases/CheckHostStatus/CheckHostStatus.py:CheckHostStatus.test_os_info: STARTED
 (1/1) /home/mario/git/iLabConfig/test/avocado/testcases/CheckHostStatus/CheckHostStatus.py:CheckHostStatus.test_os_info: ERROR: expected str, bytes or os.PathLike object, not NoneType (0.27 s)
RESULTS    : PASS 0 | ERROR 1 | FAIL 0 | SKIP 0 | WARN 0 | INTERRUPT 0 | CANCEL 0
JOB HTML   : /tmp/avocado_logs/job-2021-09-28T09.32-cc828d4/results.html
JOB TIME   : 2.67 s
[mario@mario iLabConfig]$ avocado run --test-runner='nrunner' /home/mario/git/iLabConfig/test/avocado/testcases/CheckHostStatus/CheckHostStatus.py:CheckHostStatus.test_os_info -p HOST_NAME=ilzlnx1 -p INVENTORY_DIR=/home/mario/git/iLabConfig/uuts/hosts
JOB ID     : ecdeb6cc1d8fc3c4657e3dafac20fbfafd5d9dc9
JOB LOG    : /tmp/avocado_logs/job-2021-09-28T09.33-ecdeb6c/job.log
 (1/1) /home/mario/git/iLabConfig/test/avocado/testcases/CheckHostStatus/CheckHostStatus.py:CheckHostStatus.test_os_info: STARTED
 (1/1) /home/mario/git/iLabConfig/test/avocado/testcases/CheckHostStatus/CheckHostStatus.py:CheckHostStatus.test_os_info: PASS (0.53 s)
RESULTS    : PASS 1 | ERROR 0 | FAIL 0 | SKIP 0 | WARN 0 | INTERRUPT 0 | CANCEL 0
JOB HTML   : /tmp/avocado_logs/job-2021-09-28T09.33-ecdeb6c/results.html
JOB TIME   : 3.04 s

Logs:

[stdlog] 2021-09-28 09:33:08,394 test             L0312 INFO | INIT 1-CheckHostStatus.test_os_info
[stdlog] 2021-09-28 09:33:08,395 parameters       L0142 DEBUG| PARAMS (key=timeout, path=*, default=None) => None
[stdlog] 2021-09-28 09:33:08,395 test             L0340 DEBUG| Test metadata:
[stdlog] 2021-09-28 09:33:08,395 test             L0342 DEBUG|   filename: /home/mario/git/iLabConfig/test/avocado/testcases/CheckHostStatus/CheckHostStatus.py
[stdlog] 2021-09-28 09:33:08,395 test             L0348 DEBUG|   teststmpdir: /var/tmp/avocado_ybrqfanf
[stdlog] 2021-09-28 09:33:08,396 test             L0538 INFO | START 1-CheckHostStatus.test_os_info
[stdlog] 2021-09-28 09:33:08,396 test             L0207 DEBUG| DATA (filename=output.expected) => NOT FOUND (data sources: variant, test, file)
[stdlog] 2021-09-28 09:33:08,397 parameters       L0142 DEBUG| PARAMS (key=HOST_NAME, path=*, default=None) => 'ilzlnx1'
[stdlog] 2021-09-28 09:33:08,397 parameters       L0142 DEBUG| PARAMS (key=INVENTORY_DIR, path=*, default=None) => '/home/mario/git/iLabConfig/uuts/hosts'
[stdlog] 2021-09-28 09:33:08,397 CheckHostStatus  L0033 INFO | Testing Host: ilzlnx1
[stdlog] 2021-09-28 09:33:08,722 CheckHostStatus  L0048 INFO | === STDOUT ===
[stdlog] 2021-09-28 09:33:08,723 CheckHostStatus  L0050 INFO | NAME="Red Hat Enterprise Linux"
[stdlog] 2021-09-28 09:33:08,723 CheckHostStatus  L0050 INFO | VERSION="8.2 (Ootpa)"
[stdlog] 2021-09-28 09:33:08,723 CheckHostStatus  L0050 INFO | ID="rhel"
[stdlog] 2021-09-28 09:33:08,723 CheckHostStatus  L0050 INFO | ID_LIKE="fedora"
[stdlog] 2021-09-28 09:33:08,723 CheckHostStatus  L0050 INFO | VERSION_ID="8.2"
[stdlog] 2021-09-28 09:33:08,724 CheckHostStatus  L0050 INFO | PLATFORM_ID="platform:el8"
[stdlog] 2021-09-28 09:33:08,724 CheckHostStatus  L0050 INFO | PRETTY_NAME="Red Hat Enterprise Linux 8.2 (Ootpa)"
[stdlog] 2021-09-28 09:33:08,724 CheckHostStatus  L0050 INFO | ANSI_COLOR="0;31"
[stdlog] 2021-09-28 09:33:08,724 CheckHostStatus  L0050 INFO | CPE_NAME="cpe:/o:redhat:enterprise_linux:8.2:GA"
[stdlog] 2021-09-28 09:33:08,724 CheckHostStatus  L0050 INFO | HOME_URL="https://www.redhat.com/"
[stdlog] 2021-09-28 09:33:08,725 CheckHostStatus  L0050 INFO | BUG_REPORT_URL="https://bugzilla.redhat.com/"
[stdlog] 2021-09-28 09:33:08,725 CheckHostStatus  L0050 INFO | 
[stdlog] 2021-09-28 09:33:08,725 CheckHostStatus  L0050 INFO | REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
[stdlog] 2021-09-28 09:33:08,725 CheckHostStatus  L0050 INFO | REDHAT_BUGZILLA_PRODUCT_VERSION=8.2
[stdlog] 2021-09-28 09:33:08,725 CheckHostStatus  L0050 INFO | REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
[stdlog] 2021-09-28 09:33:08,726 CheckHostStatus  L0050 INFO | REDHAT_SUPPORT_PRODUCT_VERSION="8.2"
[stdlog] 2021-09-28 09:33:08,726 CheckHostStatus  L0051 INFO | === RETVAL ===
[stdlog] 2021-09-28 09:33:08,726 CheckHostStatus  L0052 INFO | 0
[stdlog] 2021-09-28 09:33:08,726 CheckHostStatus  L0053 INFO | === STDERR ===
[stdlog] 2021-09-28 09:33:08,726 CheckHostStatus  L0054 INFO | 
[stdlog] 2021-09-28 09:33:08,727 CheckHostStatus  L0084 INFO | === Results Summary ===
[stdlog] 2021-09-28 09:33:08,727 CheckHostStatus  L0087 INFO | NAME      | EXPECTED  | ACTUAL    
[stdlog] 2021-09-28 09:33:08,727 CheckHostStatus  L0087 INFO | ----------| ----------| ----------
[stdlog] 2021-09-28 09:33:08,727 CheckHostStatus  L0087 INFO | Distro    | rhel      | rhel      
[stdlog] 2021-09-28 09:33:08,728 CheckHostStatus  L0087 INFO | Version   | 8.2       | 8.2       
[stdlog] 2021-09-28 09:33:08,728 CheckHostStatus  L0088 INFO | 
[stdlog] 2021-09-28 09:33:08,728 test             L0207 DEBUG| DATA (filename=output.expected) => NOT FOUND (data sources: variant, test, file)
[stdlog] 2021-09-28 09:33:08,729 test             L0207 DEBUG| DATA (filename=stdout.expected) => NOT FOUND (data sources: variant, test, file)
[stdlog] 2021-09-28 09:33:08,729 test             L0207 DEBUG| DATA (filename=stderr.expected) => NOT FOUND (data sources: variant, test, file)
[stdlog] 2021-09-28 09:33:08,729 test             L0965 INFO | PASS 1-CheckHostStatus.test_os_info
[stdlog] 2021-09-28 09:33:08,729 test             L0949 INFO | 

HTML report

:

I will do another couple of test to check if run.dic_variants could be used at runnable level to workaround this

[willianrampazzo]

Ah, okay, let me run some tests with -p option too. It seems like a bug. I'll confirm that.

[marioaag]

Confirmed at runnable level the option run.dict_variants is not supported so run.test_parameters need to be included as part of the params reported at HTML report

[willianrampazzo]

I opened issue #4990 to track this problem @marioaag

[marioaag]

Thanks!