aboutsummaryrefslogtreecommitdiffstats
path: root/host/tests/pytests
Commit message (Collapse)AuthorAgeFilesLines
* ci: Fix mgmt_addr=None entry for X310 DPDK caseSteven Koo2022-06-101-1/+7
| | | | | | | | X310 differs from X410 in that it doesn't require the mgmt_addr to function. This does a check to see if the field has been added, instead of assuming that it has a value. Signed-off-by: Steven Koo <steven.koo@ni.com>
* Revert "tests: streaming: temporarily mark b210 dropped samples as an xfail"Steven Koo2022-06-101-12/+4
| | | | This reverts commit 50bda84c75c2087caebc2bfd5f8e8cd64b41e739.
* ci: Add recv and send frame tuning for streamingSteven Koo2022-06-102-1/+26
| | | | | | | | This adds the ability to tune the recv and send frames as a parameter. This is useful since some rates will fail with jitter in the system with the default settings. Signed-off-by: Steven Koo <steven.koo@ni.com>
* ci: set benchmark rate priority to highSteven Koo2022-06-101-0/+1
| | | | | | | | This change increases the benchmark rate priority to high, which reduces the jitter. This prevents UI interactions from causing overruns and underruns. Signed-off-by: Steven Koo <steven.koo@ni.com>
* tests: streaming: temporarily mark b210 dropped samples as an xfailMatthew Crymble2022-06-101-4/+12
|
* tests: streaming: use assert instead of pytest.fail for underruns/overrunsMatthew Crymble2022-06-101-2/+2
| | | | | | | When an assert statement fails, pytest will determine whether that should be a fail or an xfail. By explicitly calling pytest.fail, we were preventing pytest from doing that determination, so an individual test case that had an xfail mark would have been a hard failure.
* tests: streaming: mark non-dpdk failures as xfailsMatthew Crymble2022-06-101-8/+20
|
* tests: streaming: select appropriate uhd config file before test runsMatthew Crymble2022-06-102-0/+44
|
* tests: streaming: don't set master clock rate on x310Matthew Crymble2022-06-101-2/+5
|
* tests: streaming: fix x310 test case valuesMatthew Crymble2022-06-101-3/+3
|
* tests: streaming: add support for B210 DUTsMatthew Crymble2022-06-101-2/+7
| | | | | | The use_dpdk will be false for all B210 test cases, but still needs to be defined since the main test_streaming() function requires a value for it.
* tests: streaming: include dual_SFP parameter for all casesMatthew Crymble2022-06-101-20/+18
| | | | | | The dual_SFP test case parameter will be false for all B210 and E320 test cases, but it still needs to be defined since the main test_streaming() function requires a value for it.
* tests: streaming: add support for more DUTsMatthew Crymble2022-06-101-0/+4
| | | | | | | | | | This commit enables runs for X310, X310 TwinRx, E320, and N310. By default, python's argparse module will expect a value to be provided for each argument defined. Specifying an nargs value of '?' for the pytest options allows us to use a single pytest invocation in our pipeline configuration, even though some options don't apply to some DUT types.
* tests: streaming tests setupVirendra Kakade2022-04-062-5/+5
| | | | | | | Add auto DUT bitfile configuration. Add special network configuration commands for X410. Signed-off-by: Virendra Kakade <virendra.kakade@ni.com>
* tests: enable automated streaming tests on X410Virendra Kakade2022-03-311-8/+9
| | | | | | | | | | | | Enable automated streaming tests to run on X410. Disable tests on non-X410 devices for now. Run only DPDK tests since the setup can not withstand 4Rx 4Tx and 4FDx in non-DPDK mode in manual testing. And we need to enable running these tests for 100GbE testing. Adjust streaming test thresholds to new values which seemed to work fine in manual testing. Might make them tighter in future based on more data.
* tests: add X410 100GbE testsVirendra Kakade2022-03-311-23/+29
| | | | | | | | Disable non 100GbE X410 tests for now since the test framework currently assumes that the required bitfile(personality) is already loaded onto the device. Re-enable these tests when the above support is added. Signed-off-by: Virendra Kakade <virendra.kakade@ni.com>
* tests: use new args for x410 streaming testsVirendra Kakade2022-03-281-0/+6
| | | | | | | | Use new benchmark_rate args "--multi_streamer" and "--priority" for X410 streaming tests. This gets the best performance from the streaming host machine. Signed-off-by: Virendra Kakade <virendra.kakade@ni.com>
* tests: add automated streaming testsMatthew Crymble2021-11-303-0/+382