History log of /trex/scripts/automation/regression/stateful_tests/
Revision Date Author Comments
(<<< Hide modified files)
(Show modified files >>>)
8bd778d0 06-Mar-2017 Yaroslav Brustinov <ybrustin@cisco.com>

* add trex22 (Mellanox VF) and trex23(XL710 VF) regression configs
* fix test_fcs_stream:
it did not fail on virtual NICs at all
now accumulating all the errors instread of failing on first one
* fix XL710 VF input counters (+4 bytes)

Change-Id: I7661b4e14a037e5ee2a9c1bc116d835c9a16df91
Signed-off-by: Yaroslav Brustinov <ybrustin@cisco.com>

af52e17f 15-Feb-2017 Ido Barnea <ibarnea@cisco.com>

VLAN keyword in platform config file will now make all traffic be sent over vlan

Signed-off-by: Ido Barnea <ibarnea@cisco.com>

d3c7c398 07-Feb-2017 Yaroslav Brustinov <ybrustin@cisco.com>

Regression: another fix for ipv6 STL test, add flag --no-dut-config to disable DUT config

Change-Id: I56c38324086cfc81d2ad0a451d528707f5357b51
Signed-off-by: Yaroslav Brustinov <ybrustin@cisco.com>

21760765 31-Jan-2017 Yaroslav Brustinov <ybrustin@cisco.com>

regression fix elk

Change-Id: I9c064305dac5907df0cc6cb15298ebcf0bd1a62a
Signed-off-by: Yaroslav Brustinov <ybrustin@cisco.com>

8c3c9822 31-Jan-2017 Yaroslav Brustinov <ybrustin@cisco.com>

regression: fill-in some of ELK fields

Change-Id: I0dced2fb88bcccabdfd8aef745d8408b389099a8
Signed-off-by: Yaroslav Brustinov <ybrustin@cisco.com>

b901fb41 25-Jan-2017 Ido Barnea <ibarnea@cisco.com>

Do not check latency on stateful regression for virt NICs

Signed-off-by: Ido Barnea <ibarnea@cisco.com>

030c1244 23-Jan-2017 Hanoh Haim <hhaim@cisco.com>

fix trex-333

Signed-off-by: Hanoh Haim <hhaim@cisco.com>

193013a8 22-Jan-2017 Hanoh Haim <hhaim@cisco.com>

fix VMXNET3 regreesion issue

Signed-off-by: Hanoh Haim <hhaim@cisco.com>

b81cdb6c 22-Jan-2017 Hanoh Haim <hhaim@cisco.com>

Stateful - add short flow test with high active flow 8-4Mflows

Signed-off-by: Hanoh Haim <hhaim@cisco.com>

9fa4e8f9 21-Jan-2017 Yaroslav Brustinov <ybrustin@cisco.com>


Change-Id: I6865ee1dd8ac43402e1d8a3e6ea9711040c2b29a
Signed-off-by: Yaroslav Brustinov <ybrustin@cisco.com>

c429b75f 20-Jan-2017 Yaroslav Brustinov <ybrustin@cisco.com>

regression: static routing should be used with -e and not -p

Change-Id: I4b7f052b79845568f31ee268593778b564d211fb
Signed-off-by: Yaroslav Brustinov <ybrustin@cisco.com>

cb8b3426 15-Jan-2017 Ido Barnea <ibarnea@cisco.com>

refactor regression tests so that nbar test will not run twice

Signed-off-by: Ido Barnea <ibarnea@cisco.com>

e1538ec8 16-Jan-2017 Hanoh Haim <hhaim@cisco.com>

fix statful total dp cores calculation

Signed-off-by: Hanoh Haim <hhaim@cisco.com>

c376394c 16-Jan-2017 Yaroslav Brustinov <ybrustin@cisco.com>

another fix to elk @ regression

Change-Id: I6c97c9e6c9ec9f5b12e586c03daf2b53a540cefc
Signed-off-by: Yaroslav Brustinov <ybrustin@cisco.com>

120746ed 15-Jan-2017 Hanoh Haim <hhaim@cisco.com>

hotfix for get model - does not work on regression

Signed-off-by: Hanoh Haim <hhaim@cisco.com>

420216e5 12-Jan-2017 Hanoh Haim <hhaim@cisco.com>

add elk

Signed-off-by: Hanoh Haim <hhaim@cisco.com>

32366ab4 12-Jan-2017 Yaroslav Brustinov <ybrustin@cisco.com>

Regression: fix call to __init__ of parent of CTRexClientCfg_Test, which skips not supported modes

Change-Id: Ib9a26496f8c1ca64e5ffa4c0e668c6e15c7116fd
Signed-off-by: Yaroslav Brustinov <ybrustin@cisco.com>

a6e3bf69 12-Jan-2017 Ido Barnea <ibarnea@cisco.com>

client config regression tests with NBAR and VLAN

Signed-off-by: Ido Barnea <ibarnea@cisco.com>

63c6f35a 22-Dec-2016 Yaroslav Brustinov <ybrustin@cisco.com>

Regression stateful: division by zero due to rounding of small numbers, only warn for too high BW, not fail. (will be noticed by failured of queue full etc.)

Change-Id: I4ecfb13032a3d8cb27fb224fb5ed8dd4e10f68a2
Signed-off-by: Yaroslav Brustinov <ybrustin@cisco.com>

48cb48c6 22-Dec-2016 Yaroslav Brustinov <ybrustin@cisco.com>

Less strict check on end of warmup state in Stateful API (96% of expected)
Regression: (stateful) check that the BW is less than expected + 5%.

Change-Id: Ie181a970d81fbca30a17d17ee98d0228603db11c
Signed-off-by: Yaroslav Brustinov <ybrustin@cisco.com>

d9934626 21-Dec-2016 Ido Barnea <ibarnea@cisco.com>

UDP NAT --learn mode 1,3 support - doc + regression tests

Signed-off-by: Ido Barnea <ibarnea@cisco.com>

feda9e92 13-Dec-2016 Ido Barnea <ibarnea@cisco.com>

Small fix left out in 6c31c0534acf57fc3e0e26fe964bbc67d9d7d63c

Signed-off-by: Ido Barnea <ibarnea@cisco.com>

45e85256 13-Dec-2016 Ido Barnea <ibarnea@cisco.com>

Temporary Revert "Small fix left out in 6c31c0534acf57fc3e0e26fe964bbc67d9d7d63c"
since it brakes regression on 06 and 25. Seems like real issue on these setups.

This reverts commit fe755604ec04ed7f8622394f99f0048901dad4e1.

fe755604 13-Dec-2016 Ido Barnea <ibarnea@cisco.com>

Small fix left out in 6c31c0534acf57fc3e0e26fe964bbc67d9d7d63c

Signed-off-by: Ido Barnea <ibarnea@cisco.com>

6c31c053 12-Dec-2016 Ido Barnea <ibarnea@cisco.com>

Added VIC tests + VIC small fix + fail tests if latency packets fail

Signed-off-by: Ido Barnea <ibarnea@cisco.com>

8b410454 29-Nov-2016 Ido Barnea <ibarnea@cisco.com>

temporarely disable client config test on kiwi02

Signed-off-by: Ido Barnea <ibarnea@cisco.com>

2f7f320e 27-Nov-2016 Ido Barnea <ibarnea@cisco.com>

client config regression

Signed-off-by: Ido Barnea <ibarnea@cisco.com>

f34b7915 15-Nov-2016 Hanoh Haim <hhaim@cisco.com>

add a way to load default args from config file

Signed-off-by: Hanoh Haim <hhaim@cisco.com>

d821c0b9 30-Oct-2016 imarom <imarom@cisco.com>

for now shutdown stateful GA

Signed-off-by: imarom <imarom@cisco.com>

68c71be2 27-Oct-2016 Ido Barnea <ibarnea@cisco.com>

Putting back MAC config in IPv6 regression tests

Signed-off-by: Ido Barnea <ibarnea@cisco.com>

3fb8837d 27-Oct-2016 Yaroslav Brustinov <ybrustin@cisco.com>

regression: fix for python3 client test

04300e56 26-Oct-2016 Yaroslav Brustinov <ybrustin@cisco.com>


572c98db 26-Oct-2016 Yaroslav Brustinov <ybrustin@cisco.com>

regression: stateless rx_check allow 0.1% errors

270cf64a 26-Oct-2016 Yaroslav Brustinov <ybrustin@cisco.com>

regression: fix client pkg test to configure the dut interfaces

7e953084 13-Oct-2016 Ido Barnea <ibarnea@cisco.com>

Revert "Another small fix to regression"

This reverts commit cf40f4d078a847eb05de1c880f349c8dcb20fb29.

Signed-off-by: Ido Barnea <ibarnea@cisco.com>

cf40f4d0 13-Oct-2016 Ido Barnea <ibarnea@cisco.com>

Another small fix to regression

Signed-off-by: Ido Barnea <ibarnea@cisco.com>

af419f1d 24-Aug-2016 Yaroslav Brustinov <ybrustin@cisco.com>

regression: fix case of division by zero in cpu benchmark calculation

34a4ff7b 25-Jul-2016 Yaroslav Brustinov <ybrustin@cisco.com>

Add Ubuntu 16.04.1 LTS ko
Remove skip of test_static_routing_imix
Add trex15 setup details

340372e2 15-Jul-2016 Hanoh Haim <hhaim@cisco.com>

remove IMIX for now due to an issue in trex09

333f41bb 12-Jul-2016 Ido Barnea <ibarnea@cisco.com>

NAT seq num randomization regression tests

a76479bc 03-Jul-2016 Yaroslav Brustinov <ybrustin@cisco.com>

trex_client: sample each second
stateful result object: add method to get avg value at steady state
regression: add -t flag to run specific test by name (without file and class)
update trex07 benchmarks

cacad4a8 08-Jun-2016 Yaroslav Brustinov <ybrustin@cisco.com>

regression: speedup stateless with --skip-clean flag

d279c8c1 23-May-2016 Yaroslav Brustinov <ybrustin@cisco.com>

replace t-rex to TRex
regression: instead of checking map and reconnecting for eact STL test, do in only for those with disconnect
(+revert of commit 0f8e6065f467703b1461e87c3912f8d4bd616807)

8e230286 22-May-2016 Yaroslav Brustinov <ybrustin@cisco.com>

regression: add disconnects + delay before running examples + at end of regression
revert profile udp_1ptk_simple.py and add new upd_for_benchmarks.py

fad99b60 17-May-2016 Yaroslav Brustinov <ybrustin@cisco.com>

regression: add no-daemon flag that specifies stl server is running, no need daemons etc.

e75dc535 15-May-2016 Yaroslav Brustinov <ybrustin@cisco.com>

regression and master daemon updates

ccd12c1e 14-May-2016 Yaroslav Brustinov <ybrustin@cisco.com>

add master daemon to package, little fixes to update method

89b608ae 13-May-2016 Yaroslav Brustinov <ybrustin@cisco.com>

add master daemon

0aaabef8 11-May-2016 Yaroslav Brustinov <ybrustin@cisco.com>

Disable temporary bw_per_core test due to improvements in performance

cd380381 11-May-2016 Hanoh Haim <hhaim@cisco.com>

remove GA from regression

a909225e 11-May-2016 Hanoh Haim <hhaim@cisco.com>

mask the low CPU errors

64847bb6 04-May-2016 Yaroslav Brustinov <ybrustin@cisco.com>

regression: don't fail because of GA sending errors.

7007bf04 03-May-2016 Yaroslav Brustinov <ybrustin@cisco.com>

bp_sim: correct description of supported stateful layers
main_dpdk: send bw_per_core with json, return back precision of low values
jsonrpcserver: disable logging
regression: use bw_per_core from cpp calculation
correct test name for GA

849fd28e 29-Apr-2016 Yaroslav Brustinov <ybrustin@cisco.com>


e831a539 29-Apr-2016 Yaroslav Brustinov <ybrustin@cisco.com>

regression: add GA

f35edfa4 28-Apr-2016 Yaroslav Brustinov <ybrustin@cisco.com>


34587f93 27-Apr-2016 Yaroslav Brustinov <ybrustin@cisco.com>

regression: fail on low bw_per_core

ba14992c 25-Apr-2016 Yaroslav Brustinov <ybrustin@cisco.com>

regression: add bw per core for trex-dan, trex08, trex14, trex17, trex25
flush printing buffer at beginning and end of tests

f178b53b 24-Apr-2016 Yaroslav Brustinov <ybrustin@cisco.com>

regression: imix assymetric - reduce cpu util demand because only half of ports working

8d486851 24-Apr-2016 Yaroslav Brustinov <ybrustin@cisco.com>

regression: nbar cpu util check

31e26b04 24-Apr-2016 Yaroslav Brustinov <ybrustin@cisco.com>

regression: bw per core x2

cc53c3d2 24-Apr-2016 Yaroslav Brustinov <ybrustin@cisco.com>

stateful API: add get_ports_count based on result
regression: be per core takes into account number of ports

19f6e930 23-Apr-2016 Yaroslav Brustinov <ybrustin@cisco.com>

revert added by mistake code

9b05a9d6 23-Apr-2016 Yaroslav Brustinov <ybrustin@cisco.com>


22a3fc2b 23-Apr-2016 Yaroslav Brustinov <ybrustin@cisco.com>

regression: correct the BW per core calculation

6c46ecab 19-Apr-2016 Yaroslav Brustinov <ybrustin@cisco.com>

regression: add trex07, trex14, trex25.
skip rx_check negative on kiwi02 for now.

b577ba68 14-Apr-2016 Yaroslav Brustinov <ybrustin@cisco.com>

regression: add --python2 and --python3 to run_regression, if nothing provided, use python2.
hltapi: fix bug of not reducing 4 bytes from produced packets because of fcs.
doc: add trex_client package stl/stf example of running examples :)

501fb3b4 14-Apr-2016 Yaroslav Brustinov <ybrustin@cisco.com>

regression: python3 support

af49c70a 10-Apr-2016 Yaroslav Brustinov <ybrustin@cisco.com>

hltapi stream stats, port tx/rx graphs at console

0eb15b2e 03-Apr-2016 Yaroslav Brustinov <ybrustin@cisco.com>

remove timeouts from trex_client pkg tests, filter out 0.1% of highest latencies, increase priority of TRex process

55a12c82 03-Apr-2016 Yaroslav Brustinov <ybrustin@cisco.com>


82a3c6f2 03-Apr-2016 Yaroslav Brustinov <ybrustin@cisco.com>

regression: add testing of TRex client package

3fa5b5bc 03-Apr-2016 Yaroslav Brustinov <ybrustin@cisco.com>

workaround for kiwi02 latency

fff0f8ef 31-Mar-2016 Yaroslav Brustinov <ybrustin@cisco.com>

stateless examples: don't fail on result problems, only check python functionality
stateful add --warmup flag for 30 seconds 9k imix run before other tests.

3804a5dd 27-Mar-2016 Yaroslav Brustinov <ybrustin@cisco.com>

regression: fix failing on positive return status of server

9518c16c 16-Mar-2016 Yaroslav Brustinov <ybrustin@cisco.com>

regression: trex14 updated classification

cf2424df 09-Mar-2016 Yaroslav Brustinov <ybrustin@cisco.com>


2258ea30 09-Mar-2016 Yaroslav Brustinov <ybrustin@cisco.com>

regression: stl updates