History log of /csit/resources/libraries/
Revision Date Author Comments
(<<< Hide modified files)
(Show modified files >>>)
de08ebfe 07-May-2020 Jan Gelety <jgelety@cisco.com>

Add csit-vpp-perf-report-iterative job

- job will be used to collect vpp performance iterative data
for csit report

Change-Id: I4cff5caa0a97d08b11f3eb9b72963deaf1b04c73
Signed-off-by: Jan Gelety <jgelety@cisco.com>

936deb75 24-Mar-2020 Peter Mikus <pmikus@cisco.com>

Performance: Tests with virtio driver in VM

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I20e01dfe83a961dc8202d33783a678d38e71cff2

c0a974f0 07-May-2020 Jan Gelety <jgelety@cisco.com>

FIX: Download only vpp packages

Signed-off-by: Jan Gelety <jgelety@cisco.com>
Change-Id: I88682b972947d73ae8433b550bd5e96b0b7c2c76
(cherry picked from commit 36237cf89a092fee57faa6b2b1726d40df493845)

f80a0bee 09-Apr-2020 Vratko Polak <vrpolak@cisco.com>

Execute also show runtime CLI

Example of a test with missing info:
https://logs.fd.io/production/vex-yul-rot-jenkins-1/csit-vpp-perf-mrr-daily-master-2n-clx/287/archives/log.html.gz#s1-s1-s1-s4-s8-t3-k2-k9-k1-k1-k4-k1
- Missing any -outpt and -tx nodes.
- Zeros in vectors in rdma-input node (even though calls are there).

Placing the CLI call after the stats one,
to confirm stats does not "break" the CLI.

+ Using an earlier parent, to dodge some test failures.

Change-Id: I79072b54b6bf964dab4f21428e186394bafda72a
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

49bf7821 13-May-2020 pmikus <pmikus@cisco.com>

Infra: PIP installation freeze

+ Waiting for Docker image to be updated. Then next step
I will disable any update attempt.

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I92d4e27be0537a95473cd723a45e6185b26ce599

42e546fa 03-Mar-2020 Jan Gelety <jgelety@cisco.com>

job-specs: new job test spec files including test count and durations

Change-Id: I4ad87092bff1c072051ca1c7243d8dedb1c4576e
Signed-off-by: Jan Gelety <jgelety@cisco.com>
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>

8a55a351 07-May-2020 Jan Gelety <jgelety@cisco.com>

FIX: SRv6 encap

Change-Id: I4b75b343fc144489d81f82dbb4917b4a70a9911b
Signed-off-by: Jan Gelety <jgelety@cisco.com>

157a5f2d 12-May-2020 pmikus <pmikus@cisco.com>

FIX: L3fwd properly

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: Ibdfc0350a101c4815f25456176e25bb1d90fd881

8c90273f 29-Apr-2020 Jan Gelety <jgelety@cisco.com>

CSIT-1597 API cleanup: ipsec

- cover API changes in VPP: https://gerrit.fd.io/r/c/vpp/+/26276
- update vpp stable to version 20.05-rc0~727

Change-Id: I39a0b5e60fac6a74aff2426f6a448c0e117ab647
Signed-off-by: Jan Gelety <jgelety@cisco.com>

424346c5 23-Apr-2020 Dave Wallace <dwallacelf@gmail.com>

perf: refactor 'setup suite topology interfaces'

- and 'setup suite topology interfaces no tg' to
use a common keyword to create suite variables
using the required topology information.

Change-Id: I46894948bc86eb7ce72d036e5b84f09c5c1385db
Signed-off-by: Dave Wallace <dwallacelf@gmail.com>

007b6075 06-May-2020 pmikus <pmikus@cisco.com>

FIX: dot1q-ip6

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: Ied48646bd9de41e5a55e0006440d057c5fddf694

79f5ba9b 04-May-2020 Vratko Polak <vrpolak@cisco.com>

Separate files needing GPL license

+ Keep apache license for now, until this is completed:
https://wiki.fd.io/view/TSC/Relicensing_Procedure
+ Add utilities for switching license comment blocks.
- They do not preserve attributes, so executable flag is lost.
+ Move the affected files to GPL/.
+ Update paths so files are executed from the new location.
+ Change the way scripts are started to do not require executable flag.
+ Employ OptionString when constructing longer command lines.
+ Move also PacketVerifier.py and TrafficScriptArg.py
as they are linked with traffic scripts.
+ That means the two files are outside "resources" package tree now.
+ Added __init__.py files so relative imports work in new package tree.
+ Start traffic scripts as python modules to allow relative imports.
+ Once again needed because they are outside the default PYTHONPATH.

Change-Id: Ieb135629e890adbaf5b79497570f3be25b746f9f
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

16ef90a2 06-May-2020 pmikus <pmikus@cisco.com>

Performance: Fix l3fwd in 3node

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I32fd935078fb117bb1570e20a11baa2de46447e8

efa0e0bd 04-May-2020 vagrant <vagrant@dieter-lnx.cisco.com>

FIX: IPsec

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Iacd7aa49d9832233033fe18fc228ccd45c12b4db

a54bbbf9 04-May-2020 Vratko Polak <vrpolak@cisco.com>

Print more info when checking out oper branch

Change-Id: Ic8d1080edacea1d27eb80e61f48cd4cd4430c139
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

a6f1a151 31-Mar-2020 Jan Gelety <jgelety@cisco.com>

VPP-DEV API Coverages: SRv6

Jira: CSIT-1698

Change-Id: I6d9154284990df8877850e4014716510016e485b
Signed-off-by: Jan Gelety <jgelety@cisco.com>

f6e52303 29-Apr-2020 Peter Mikus <pmikus@cisco.com>

FIX: dot1qip4vxlan-l2bd

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Ia4415090263357d16cfd5f5bc93931ded5688557

99b2e6a8 31-Mar-2020 Jan Gelety <jgelety@cisco.com>

CSIT-1597 API cleanup: lisp

- cover API changes in VPP: https://gerrit.fd.io/r/c/vpp/+/24663
- update vpp stable to version 20.05-rc0~637
- remove unused L1 and L2 lisp KWs

Change-Id: I2672b6a375ad70c82f331dcc991c145e868108b9
Signed-off-by: Jan Gelety <jgelety@cisco.com>

1c1d5cbe 23-Apr-2020 Peter Mikus <pmikus@cisco.com>

Performance: MLX best practice

- Part II

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I869a3d7e051dcbae3a230d4646219e70e5de2e87

fcce2ca1 10-Jan-2020 Peter Mikus <pmikus@cisco.com>

Performance: TRex approximatedDuration and approximateRate

- API to provide duration for send and receive traffic

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Id186a200be66b7703348e6fd3099ffd405e915ae

fd70b678 27-Apr-2020 Peter Mikus <pmikus@cisco.com>

FIX: NF_density IPv4 profile

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I471c0cb98c24416d893248b55b376b03a4b8830a

a50057d4 27-Apr-2020 Peter Mikus <pmikus@cisco.com>

FIX: NAT44 3-node tests

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I3d9074175e1aaf5afba4e351790644df4ad33914

0e8a09b2 23-Apr-2020 Vratko Polak <vrpolak@cisco.com>

Fix 3n ip4 scale init

Last argument to Vpp Add Ip Neighbor should be a MAC address.

Change-Id: Ia93ddf68aa2b8647c66b6a72210db3a8a01b81fb
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

01015c90 22-Apr-2020 Peter Mikus <pmikus@cisco.com>

FIX: Mellanox jumbo frames

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I84b3c07e22a313e96ac59fc7818960c502507651

54beb458 17-Apr-2020 Peter Mikus <pmikus@cisco.com>

Performance: DPDK refactor

+ Rework BASH scripts (more code to python).
+ Move BASH into libraries.
+ Allows RDMA usage.
+ Fix 9000B tests.
+ Rename confusing l2fwd -> testpmd.
+ Fix suite setup.
+ Fix PCI whitelist to not accidentally pickup wrong interface.
+ Fix deprecated DPDK cli arguments.

- MLX5 jumbo are disabled on NIC (i will increase separately).
https://jenkins.fd.io/job/csit-dpdk-perf-verify-master-2n-clx/6/console (l3fwd still broken)
- MLX5 IMIX seems to be some TRex issue with IMIX for mlx5 (i will handle separately)

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I31d1b67305fa247cb5e1f57e739d3ef30dc1a04b

5dc176ab 21-Apr-2020 Peter Mikus <pmikus@cisco.com>

FIX: NF_density MAC addresses

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I0e773060c344fda7b06937a81a53863a96a4373a

a00151f4 20-Apr-2020 Peter Mikus <pmikus@cisco.com>

FIX: NF_density tests

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Ic305d135b14697332436d6afd76173eff0c3874b

7a9dfe35 31-Mar-2020 Jan Gelety <jgelety@cisco.com>

FIX: ip4

Change-Id: I57fcb06c72caf517231f09478d9d6089d2f46af4
Signed-off-by: Jan Gelety <jgelety@cisco.com>

b778a148 17-Apr-2020 Peter Mikus <pmikus@cisco.com>

FIX: Proper NUMA compute

+ FIX for Vratko's FIX

Change-Id: Ia6ff137120d84bdd2b9e02e3e935c62d1c732b7b
Signed-off-by: Peter Mikus <pmikus@cisco.com>

ffa19fdd 17-Apr-2020 Vratko Polak <vrpolak@cisco.com>

Fix numa detection

On 3n-hsw, xl-710 is numa 1.
The old code returned 0, causing performance regression.

Fixes: 14a71b74b414df7616ccb5ada3d50ecb90d96bae

Change-Id: I81d3f711b6a37438f6411e29baafae9dec1c00a4
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

aada4992 28-Mar-2020 Jan Gelety <jgelety@cisco.com>

VPP-DEV API Coverages: IPSEC interface

+ some pylint fixies

Change-Id: I650ce16282ae953a1a5ee96e810702c01f71efd6
Signed-off-by: Jan Gelety <jgelety@cisco.com>

316988e4 14-Apr-2020 Peter Mikus <pmikus@cisco.com>

FIX: RDMA typo

Change-Id: Ie2f11cd5144daf249200fe07430b0809185bccce
Signed-off-by: Peter Mikus <pmikus@cisco.com>

8e3a326c 09-Apr-2020 Peter Mikus <pmikus@cisco.com>

Performance: FIX T-Rex config

- MLX, ENA
- Part I

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I9f4b407770515fe6009ef5dfdba2b27fa2ff654f

56440df4 06-Apr-2020 Peter Mikus <pmikus@cisco.com>

FIX: Add show log output when test failed.

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I6bdce8156ba214be210c195a9f3effd718301a86

dbffa6cf 06-Apr-2020 Peter Mikus <pmikus@cisco.com>

Ansible: Speed up by pipelining

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I3ad5675cda017b3dcf8cba88d56d5d6c11184e20

14a71b74 21-Feb-2020 Peter Mikus <pmikus@cisco.com>

Improve pf layer

+ Merge single/double link
+ Introduce _pf{n}[0] variables so we can access physical function
same way as virtual function
+ Cleanup code by moving complex logic to python
+ Prepare code for multiple vf functions

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Ic2e74a38bfa146441357de8f0916aeb638941c49

5bff1207 27-Mar-2020 Jan Gelety <jgelety@cisco.com>

Fix: select correct oper branch checkout_csit_for_vpp

Signed-off-by: Jan Gelety <jgelety@cisco.com>
Change-Id: I2e72b7e136d3907a038cb7729c11d155a12c486f
(cherry picked from commit 9e2e4eaa2c6854eee47f7057d16b75339f453f89)

925c5bfc 31-Mar-2020 Vratko Polak <vrpolak@cisco.com>

Tweak TRex cores and RDMA pps limit

The previous values lead to duration stretching,
which affects MRR results (making receive rate bigger than it really is).

+ Move timestamp for starting of traffic,
the previous position was too conservative.

Change-Id: Ie983f0d3eacf56d57caa551d1b7fbb87ece6c158
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

423995e9 27-Mar-2020 Vratko Polak <vrpolak@cisco.com>

SRv6: Make show command output visible

Change-Id: Ie8764f1746fa51d8b6e8621db68ffd2966168a07
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

bb7d2f05 21-Mar-2020 Jan Gelety <jgelety@cisco.com>

CSIT-1597 API cleanup: acl

- cover API changes in VPP: https://gerrit.fd.io/r/c/vpp/+/26184
- update vpp stable to version 20.05-rc0~424

Change-Id: Ie621a29db25755151bfee76a045a423fd1267ada
Signed-off-by: Jan Gelety <jgelety@cisco.com>

45f5b2da 25-Mar-2020 Jan Gelety <jgelety@cisco.com>

FIX: vxlan_add_del_tunnel in TestConfig.py

Change-Id: I1e4ab1b40fd4a2f48df1dc33b7b17266382df20b
Signed-off-by: Jan Gelety <jgelety@cisco.com>

a0d87052 12-Mar-2020 Jan Gelety <jgelety@cisco.com>

CSIT-1597 API cleanup: srv6

- cover API changes in VPP: https://gerrit.fd.io/r/c/vpp/+/25647
- update vpp stable to version 20.05-rc0~398

Change-Id: I5ebc84a702264b0b37e3886b48ec0713d174f880
Signed-off-by: Jan Gelety <jgelety@cisco.com>

2a35fc8c 13-Mar-2020 Dave Wallace <dwallacelf@gmail.com>

perf: Fix broken hoststack tests

- Rename NSIM attribute names as changed in b9f4ba11

Change-Id: I6bc232c9954cfd9004d1d0cf22446957e78a641a
Signed-off-by: Dave Wallace <dwallacelf@gmail.com>

37da7642 18-Mar-2020 Peter Mikus <pmikus@cisco.com>

FIX: qsz typo

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I56e87868de0bb45e863f1d806e2efc3f5ec5df96

11e9514a 10-Mar-2020 Vratko Polak <vrpolak@cisco.com>

NodePath: Make path computation deterministic

In Python3, set operations seem to result in indeterministic order.

+ Remove verbose logging from topology.py

Change-Id: I47cc90637a0b2969e1686b4216b7d8fe4fe2aaab
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

54ff8d82 11-Mar-2020 Jan Gelety <jgelety@cisco.com>

CSIT-1597 API cleanup: vpe

- cover API changes in VPP: https://gerrit.fd.io/r/c/vpp/+/25567
- update vpp stable to version 20.05-rc0~352

Change-Id: I205d7d3de48d480e070d3e2d3e3ab83480b69c77
Signed-off-by: Jan Gelety <jgelety@cisco.com>

2896038b 12-Mar-2020 Peter Mikus <pmikus@cisco.com>

FIX: VHOST vpp

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Id0d41a2e62ee6cce212fb2c09a0357d794426a00

ac683d23 11-Mar-2020 Jan Gelety <jgelety@cisco.com>

CSIT-1597 API cleanup: vxlan

- cover API changes in VPP: https://gerrit.fd.io/r/c/vpp/+/25569
- update vpp stable to version 20.05-rc0~345

- some pylint fixies in Policer.py

Change-Id: Iba2c877d0e74526c69826c5ec4afd64ed2055d31
Signed-off-by: Jan Gelety <jgelety@cisco.com>

41b29c01 10-Mar-2020 Maros Mullner <maros.mullner@pantheon.tech>

Final changes for AWS.

Modified cpuutils numa to work with aws 18xlarge instances.
Added dmidecode package to calibration role as is not installed by default.
Added required constants

Signed-off-by: Maros Mullner <maros.mullner@pantheon.tech>
Change-Id: I99608d9df3cff0b085ad26c30e339216b17581eb

ee33baa6 11-Mar-2020 Jan Gelety <jgelety@cisco.com>

Use separate module for ip address object

Reason: with upcomming vpp api changes the ip object will be used
in more csit python libraries, e.g. InterfaceUtil.py, so we need
to avoid circular import issue
(e.g. InterfaceUtil.pyu <-> IPUtil.py)

Change-Id: Ia658b187d4e326f58e33019dd54f8ac7b9137d78
Signed-off-by: Jan Gelety <jgelety@cisco.com>

a765b82b 06-Mar-2020 Dave Wallace <dwallacelf@gmail.com>

rls2001 perf: fix hoststack test packet sizes

- TCP packet size is 1460B not 9000B
- QUIC packet size is 1280B not 9000B

Change-Id: I6604a74fa533db4ac782782c85ea54038688627a
Signed-off-by: Dave Wallace <dwallacelf@gmail.com>

9902cc2a 09-Mar-2020 Jan Gelety <jgelety@cisco.com>

CSIT-1597 API cleanup: policer

- cover API changes in VPP: https://gerrit.fd.io/r/c/vpp/+/25566
- update vpp stable to version 20.05-rc0~327

Change-Id: I6af2e4e21c9190e87a63c5a9c8529bbc7f8adf1a
Signed-off-by: Jan Gelety <jgelety@cisco.com>

b06f59a3 10-Mar-2020 Jan Gelety <jgelety@cisco.com>

FIX: typo in VppCounters.py

Change-Id: I4b5955af9732dd3ef185a618ffcf939d0a05ac17
Signed-off-by: Jan Gelety <jgelety@cisco.com>

8d954d6b 11-Mar-2020 Peter Mikus <pmikus@cisco.com>

FIX: Counters

Change-Id: Ib7eeea5338491b4bd9ecd96b30da95f5dc116937
Signed-off-by: Peter Mikus <pmikus@cisco.com>

dcbf9830 12-Dec-2019 Jan Gelety <jgelety@cisco.com>

CSIT-1597 API cleanup: ipsec

- cover API changes in VPP: https://gerrit.fd.io/r/c/vpp/+/25529
- update vpp stable to version 20.05-rc0~312-g287d5e109

Change-Id: I6c7b3520f4bb306c3b0b59247b4ba2d5f170686c
Signed-off-by: Jan Gelety <jgelety@cisco.com>

70382073 05-Mar-2020 Tibor Frank <tifrank@cisco.com>

Regenerator: Fix pylint errors

Change-Id: I91458b897003f5d8f7f7ac9214aa824c113cecea
Signed-off-by: Tibor Frank <tifrank@cisco.com>

6db8aec1 28-Feb-2020 Peter Mikus <pmikus@cisco.com>

Ansible: LTS support

- There is currently no other way to support multiple version of
playbooks.

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I2ade4a57d726b793e422996e83bf767ac4315488

6daa2d79 28-Feb-2020 Peter Mikus <pmikus@cisco.com>

Make RXQs/TXQs configurable

Change-Id: Ib30bc4697fcba93a6723ee492a59a0523425f623
Signed-off-by: Peter Mikus <pmikus@cisco.com>

b9f4ba11 09-Mar-2020 Dave Wallace <dwallacelf@gmail.com>

Clean up long lines in nsim.robot

Change-Id: Ic9def0376ecb49c12e63aafa747fcc524ebb79c2
Signed-off-by: Dave Wallace <dwallacelf@gmail.com>

5fc9a9c0 12-Dec-2019 Jan Gelety <jgelety@cisco.com>

CSIT-1597 API cleanup: l2

- cover API changes in VPP: https://gerrit.fd.io/r/c/vpp/+/22970
- update vpp stable to version 20.05-rc0~307

Change-Id: I3b4c69ee60b0add12edeb8d5e6ac6006b519593b
Signed-off-by: Jan Gelety <jgelety@cisco.com>

5570bf3a 11-Feb-2020 Dave Wallace <dwallacelf@gmail.com>

perf: Clean up Hoststack tests

- Update test names with clients/streams
- Convert test results to JSON output
* iperf3 results include bits_per_second
* vpp_echo results include both client
and server output which includes time in seconds
and rx_data/tx_data in bytes which can be used
to calculate the average bits per second.
Tx and Rx data will always be the same:
BPS = (client tx_data * 8) / ((client time + server time) / 2)
- Fix WRK test results data formatting errors

Change-Id: Ie2aeb665e3cc0739b16f97ba2628eebe6e041d22
Signed-off-by: Dave Wallace <dwallacelf@gmail.com>

8c85cc69 26-Feb-2020 Vratko Polak <vrpolak@cisco.com>

bash: tolerate -dev as a package name

Misbehaving projects can create it, and apt thinks it is a cli option.

Change-Id: Icc42231e2d498f976281ce725373c6679fe61fa4
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

070500f1 03-Feb-2020 Vratko Polak <vrpolak@cisco.com>

Fix argument order in MLRsearch

Introduced in last refactor.
Luckily, the result were still correct, just with confusing logs
and perhaps longer search time in unstable test cases.

Change-Id: I26dd5714fb588ea07afe85583b3ab3b4bd53d9ec
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

50ca8535 25-Feb-2020 Jan Gelety <jgelety@cisco.com>

FIX: check if t-rex is running at test setup of all perf tests

Change-Id: I9af632035a1415666b2470c62a41d1b6acbf33c8
Signed-off-by: Jan Gelety <jgelety@cisco.com>

cc02a78e 24-Feb-2020 Jan Gelety <jgelety@cisco.com>

FIX: avoid t-rex suite tear down action to fail successfull tests

- try to kill t-rex only if it is running
- do not fail the whole test suite when t-rex test suite tear down
action has failed

Change-Id: I3748a08a3da4dd3617cb54e8fdd344d49566fc7d
Signed-off-by: Jan Gelety <jgelety@cisco.com>

815cbb45 21-Feb-2020 Vratko Polak <vrpolak@cisco.com>

Tox: Add copyright year tox checker

Only added/edited files already containing copyright notice
are checked for the correct year (and only if in first 3 lines).

Change-Id: I22c057431847fda3a7dfd4577f8346fadfe4c4f6
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

e4444934 18-Feb-2020 Vratko Polak <vrpolak@cisco.com>

Perpatch: Fix bash ansible calls

The function ansible_hosts got renamed to ansible_playbook
in https://gerrit.fd.io/r/c/csit/+/24511

Change-Id: Ife4e7b13f634fcdda95f80c18bc86cfded139b5d
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

eb774c3e 17-Feb-2020 Maros Mullner <maros.mullner@pantheon.tech>

Add option to run Trex with --force parameter to start
regardless of ports state.

Signed-off-by: Maros Mullner <maros.mullner@pantheon.tech>
Change-Id: Iaafb5ff3a53a290ca79506bdb559a32d39570482

c8bc6ec5 17-Feb-2020 juraj.linkes <juraj.linkes@pantheon.tech>

Download latest VPP packages for hourly jobs

1n-tx2 vpp-device tests are supposed to give us a view of how VPP
patches affect VPP device tests, so download the latest packages for
them as well.
Also replace round brackets with curly brackets in the condition to make
it faster according to
https://github.com/koalaman/shellcheck/wiki/SC2235.

Change-Id: I9caafea3590d04af9cb34d6bb536ff786fe08411
Signed-off-by: juraj.linkes <juraj.linkes@pantheon.tech>

711ee276 15-Feb-2020 Jan Gelety <jgelety@cisco.com>

daily: Do not run nf_density chain_ipsec tests on 3n-hsw

Change-Id: I9a1afaf3654b96161c4c1de483c99c1f849b6980
Signed-off-by: Jan Gelety <jgelety@cisco.com>

35bbc365 13-Feb-2020 juraj.linkes <juraj.linkes@pantheon.tech>

Aarch64 fixes for vfio-pci in kernel VM

- Add enable_unsafe_noiommu_mode for aarch64 architecture to kernel VM
init script
- Add binding of pci device through /sys/bus/pci/drivers/vfio-pci/bind
- Minor refactor to enhance readability of differences between
architectures

Change-Id: Ib0ec35bfae054582d9ffcf7a82f8f8b3e3e24856
Signed-off-by: juraj.linkes <juraj.linkes@pantheon.tech>

1ff1a79c 13-Feb-2020 Peter Mikus <pmikus@cisco.com>

Ansible: Update DPDK

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Ia5c1e40b952c14775f2f038d3a8a293335172f47

256743b5 19-Jan-2020 Jan Gelety <jgelety@cisco.com>

FIX: set host physical interface mac address to rdma interface

Reason is that the traffic generator is initialized with MAC addresses
of physical interfaces in the suite setup while rdma interfaces
are created later.

Change-Id: I2cf182cde20f14778624740a1f0467096c336306
Signed-off-by: Jan Gelety <jgelety@cisco.com>

b968e370 22-Jan-2020 Jan Gelety <jgelety@cisco.com>

FIX: Detection if l2fwd/l3fwd is up/down

Change-Id: Ide5de222e8314a0ea0be59f9a478f8d59147f722
Signed-off-by: Jan Gelety <jgelety@cisco.com>

2cf07559 24-Jan-2020 Peter Mikus <pmikus@cisco.com>

Ansible: Cleanup and speedup

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Ia2ce482798204ad426f93f334c97e28eb51139fd

35024b69 01-Dec-2019 juraj.linkes <juraj.linkes@pantheon.tech>

Revert "Change startup show pci to show ver"

This reverts commit bb33f1d16f1451253f942da0c55cdea72e71c398.

Change-Id: Ida80af970e400460860602db884a943e5599a849
Signed-off-by: juraj.linkes <juraj.linkes@pantheon.tech>

8bf02005 28-Jan-2020 Vratko Polak <vrpolak@cisco.com>

Add more reconf tests, for IPsec

- Not adding nf_density tests.
- Not adding hardware ipsec tests.
- Not adding -policy- tests.
- Using old crypto_ia32_plugin.so plugin name.
+ Suitable for cherry-picking to rls2001.

Change-Id: Ibf44d6d91e2afa2320637ecd9eb69d5d5dc364aa
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

7a035831 03-Feb-2020 Vratko Polak <vrpolak@cisco.com>

Autogen: Fix typo affecting DPDK

With the typo, only the first type+nic combination is generated.
With fix, all combinations are generated.

Change-Id: Ieb2db31cebed4940b063505b70f4d12a30da489c
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

7472410f 09-Jul-2019 Vratko Polak <vrpolak@cisco.com>

Remove trailing space from CLI command

Change-Id: I49adff478302da036ecfacb675983923dc3f1ce1
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

6bcf4d40 30-Jan-2020 Peter Mikus <pmikus@cisco.com>

T-Rex: CPU pinning

+ Detect NUMA
+ Pin based on numa location

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Ife350f8c70e5437ac7c1413c7753f2a2f62777d9

d79b753c 15-Jan-2020 Dave Wallace <dwallacelf@gmail.com>

perf: Add hoststack NSIM+LDPRELOAD+IPERF3 test suite

Change-Id: Ia7a876b1aa240676e1f2d23618c1d4e09ead14f0
Signed-off-by: Dave Wallace <dwallacelf@gmail.com>

401c2491 29-Jan-2020 Vratko Polak <vrpolak@cisco.com>

Display target_tr for ndr/pdr results

Small differences in Tx packet counts can cause
the previous way (which used transmit_rate,
computed from packets sent and nominal duration)
to report lower bounds as higher than upper bounds.

Also, reconf tests need the target (not actual) rate.

Change-Id: If5222dabd9762b8d9c2e22d875c12ad355bc6838
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

703d013c 28-Jan-2020 Vratko Polak <vrpolak@cisco.com>

Ndrpdr: Remove unused latency measurements

+ Improve keyword Documentation.
+ Reorder measurements, higher loads first.

Change-Id: I1aeab1c8ada268422e9f421e075aff2ac9eec23f
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

074ae973 08-Jan-2020 Dave Wallace <dwallacelf@gmail.com>

perf: QUIC transport hoststack test suite

Change-Id: I73f4be7ea315c7a5dcce46e1bd3034bcb0a97ee2
Signed-off-by: Dave Wallace <dwallacelf@gmail.com>

827c0c01 29-Jan-2020 Peter Mikus <pmikus@cisco.com>

IPSEC: Change plugin naming

https://gerrit.fd.io/r/c/vpp/+/24574

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Ic2b7c925ceba1e16de87c64003ecceeea69c681c

b340b5c9 21-Jan-2020 Dave Wallace <dwallacelf@gmail.com>

perf: hoststack iperf3 test tuning

Change-Id: I53425f57fe9ecef9cff2c94642cc7cb24537a961
Signed-off-by: Dave Wallace <dwallacelf@gmail.com>

6ac704e7 24-Jan-2020 Vratko Polak <vrpolak@cisco.com>

Check interval validity in reconf tests

Without this, if the search part returns min_rate,
then reconf part reports few seconds with a small loss count.

But min_rate means there is a bug or misconfiguration,
so the tests should fail, instead of returning misleading results.

Change-Id: I566608b40ae11d6aaa3fe022a32da97901e1999c
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

ceaa2959 23-Jan-2020 Vratko Polak <vrpolak@cisco.com>

Perform some cleanup discovered by GPL work

+ Remove one __init__.robot file with no function.
+ Remove executable flags from traffic profiles.
+ Improve indentation in some traffic profiles.

Change-Id: I099e63069003fba788976a9470a909ccff51a88c
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

f7452e82 27-Jan-2020 Vratko Polak <vrpolak@cisco.com>

Increase min_rate for NDRPDR tests

Latency measurements break for loads less than 9 kpps per direction.
Setting min_rate to 90 kpps prevents 10% latency trial from breaking.
90 kpps should be enough for any type of test.

When some test finds a lower value, this patch will make the fail
with a message saying the loss rate at minimal load is too high
(instead of a cryptic error from 10% measurement without this patch).

Change-Id: I97b8428aa5044da23343b86447857b3a101f6baa
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

f7699715 27-Jan-2020 Vratko Polak <vrpolak@cisco.com>

Restore PDR stat run for NDRPDR

Before [0], the NDRPDR test ended with two measurements
that perform runtime stats collection, each 2 seconds long.
[0] then decreased that duration to one second,
and removed the PDR measurement.

This change re-adds the PDR measurement,
while keeping the duration at 1 second.

[0] https://gerrit.fd.io/r/c/csit/+/24427

Change-Id: I76828f11863a9e278cdd0cf60f2792d5b614ce43
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

eb2723bb 24-Jan-2020 Peter Mikus <pmikus@cisco.com>

Attempt to fix journalctl

- AWK
- ECHO
- pipe
+ Much simpler

Change-Id: I4876f4eae68c96571dc38fd21e53ba269f5f888e
Signed-off-by: Peter Mikus <pmikus@cisco.com>

f31b70ee 17-Jan-2020 Jan Gelety <jgelety@cisco.com>

FIX: nfv_density

- use correct osi_layer=L2 (so L2 spoofing check is switched off
in case of avf driver)
- add pci address information to eth interface in topology file
- nfv_density chain_ipsec tests work only with DPDK
in current implementation

Change-Id: I233c6e5634a14581960c7459b87f11fcee8365bd
Signed-off-by: Jan Gelety <jgelety@cisco.com>

6ccc6d68 22-Jan-2020 Peter Mikus <pmikus@cisco.com>

FIX: Various issues

- TrafficProfile
- IPsec jumbo
- TDLK leftover
- Trex scapy server

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I0601ea75ed6e7318c46124fb02e9c61066089791

774d8a34 20-Jan-2020 Vratko Polak <vrpolak@cisco.com>

Generate tests in deterministic order

Change-Id: I47e45f395976fd65a8da0e93bc33588cc213c79e
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

8aa83d92 21-Jan-2020 haiyanx1.zhang <haiyanx1.zhang@intel.com>

fix loadbalancer running error(Caused by code upgrades)

Signed-off-by: haiyanx1.zhang <haiyanx1.zhang@intel.com>
Change-Id: I39bd1d9ad59971bb8cba6e664ba5509abba6a527

8840972e 20-Jan-2020 Vratko Polak <vrpolak@cisco.com>

Ndrpdr: Add latency trials for smaller loads

Change-Id: I46bd4b58bdd02a3deed38c158214e1e9977dde05
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

b693dede 19-Jan-2020 Yulong Pei <yulong.pei@intel.com>

reduce test cases for 2n-dnv and 3n-dnv mrr daily test

since dnv platform is to use by low end market product, no need care
more about too much flows performance test.

Change-Id: Id7204b0353cbf968e641f14ed980f01af75971b2
Signed-off-by: Yulong Pei <yulong.pei@intel.com>

2b3a18b0 19-Dec-2019 Peter Mikus <pmikus@cisco.com>

FIX: Hugepages should be detected also from overcommit

Change-Id: I36ec9d61f775791ad0632a579c4921889d1f5acf
Signed-off-by: Peter Mikus <pmikus@cisco.com>

6518c73a 08-Jan-2020 Dave Wallace <dwallacelf@gmail.com>

perf: add TCP Iperf3+LDPRELOAD test suite

Change-Id: Icff49fb31cce342a2a4ae799e844ec91f9e5e366
Signed-off-by: Dave Wallace <dwallacelf@gmail.com>

8b64d3f9 16-Jan-2020 Jan Gelety <jgelety@cisco.com>

FIX: remove 4drc nfv_density chain ipsec tests from 3n-hsw daily job

- not enough cpu cores reported

Change-Id: If3ddbbf4f5af741f328c45ac6b8c874e61d348ab
Signed-off-by: Jan Gelety <jgelety@cisco.com>

633e1f40 16-Jan-2020 Jan Gelety <jgelety@cisco.com>

FIX: L2XC with vhost and VLAN

Change-Id: Ia87abadba431099eeacd8b50ce5d116597a1f393
Signed-off-by: Jan Gelety <jgelety@cisco.com>

30be9d16 22-Nov-2019 Vratko Polak <vrpolak@cisco.com>

Remove everything related to TLDK

- Leftovers from kubernetes found, but not removed here.

Change-Id: If8cb9269d0f3e69f642d7fe02c59122e17925a4d
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

cf9fbdf9 13-Dec-2019 Jan Gelety <jgelety@cisco.com>

Trending: new daily set

New daily sets are prepared based on information in
https://gerrit.fd.io/r/c/csit/+/24073/1/docs/job_specs/perf_tests_job_specs.md
and previous test set definitions in
docs/job_specs/test_select_list_[2n|3n]_[clx|skx|hsw|tsh|dnv].md
files.

- mrr-daily-2n-clx: 510 TCs (incl. nfv_density), expected exec. time 8:50h
- mrr-daily-2n-skx: 525 TCs (incl. nfv_density), expected exec. time 7:55h
- mrr-daily-3n-skx: 393 TCs (incl. nfv_density), expected exec. time 11:00h
- mrr-daily-3n-hsw: 177 TCs (incl. nfv_density), expected exec. time 7:10h
- mrr-daily-3n-tsh: 204 TCs, expected exec. time 21:00h
- mrr-daily-2n-dnv: 84 TCs, expected exec. time 2:25h
- mrr-daily-3n-dnv: 144 TCs, expected exec. time 6:35h

+ add some missing test suites
+ add trex-sl-2n-ethip4udp-1000u15p.py T-Rex traffic profile
+ correction of TS and TC names and tags in directory
tests/vpp/perf/nfv_density/chain_ipsec

Change-Id: Icfc86e9af97ed8dd8ccd2a34355c99aad69a28c0
Signed-off-by: Jan Gelety <jgelety@cisco.com>

e916ab4d 02-Jan-2020 Vratko Polak <vrpolak@cisco.com>

Support suite tags in autogen

+ Include a script to add suite tags to many suites at once.
+ Add suite tags also to device tests (not covered by autogen).

Change-Id: I514ee6178e22999b43460028fe2696738b012f04
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

b55e324d 03-Jan-2020 Vratko Polak <vrpolak@cisco.com>

Autogen: Generate also NIC drivers.

+ Disallowed -avf- (or -rdma-) as "template" suites.
+ GBP suite switched to DPDK driver in repo.
+ Each NIC has its own list of supported drivers, in Constants.
+ Updated tag expressions for daily jobs:
+ Feature, ipsec, memif, scale, srv6, tunnels, vhost and vts
are tested only with vfio-pci.
+ Other (base, dot1q, dot1ad) tested with all drivers.
+ Setup actions currently depend on driver, generated.
- The performance_rdma action is trivial for now.
- Several tests fail, to be fixed later, e.g. by performance_rdma.
+ Reconf tests are also supported.
+ Added DRV_VFIO_PCI tags missing, mainly in density tests.
- Vhost suites (density, reconf) are failing, but suites look good.
- TCP suites do not support NIC drivers yet.
- DPDK obviously not supported.
+ Use Python 3 in regenerate scripts.
+ Fix typos binded => bound.
+ File open modes set either u"rt" or u"wt" everywhere.
+ Remove a trailing space in an environment variable name.

Change-Id: I290470675dc5c9e88b2eaa5ab6285ecd9ed7827a
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

2da2aa12 20-Dec-2019 Dave Wallace <dwallacelf@gmail.com>

Hoststack perf infrastructure refactoring

- DUT only topology (hoststack test
apps are co-located with vpp)
- Make vpp app specific keywords generic
where applicable
- Add IP4 Prefix to topology file
- Support running wrk in linux namespace
- Refactor namespace cleanup
- Remove redundant namespace creation code
- Refactor test/keyword dirs: tcp -> hoststack
- Add hoststack utility keywords
- Refactor wrk suite setup/teardown
- Update tests with recent perf infra changes

Change-Id: Ia1cf07978d579393eef94923819a87c8c1f36f34
Signed-off-by: Dave Wallace <dwallacelf@gmail.com>

6ae8614c 14-Jan-2020 Peter Mikus <pmikus@cisco.com>

FIX: VXLAN scale

+ Another stupid arp -> neighbor rename

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Ia873d6c2a485659033f71cdf546782db74787d13

3aae7cbc 13-Jan-2020 Peter Mikus <pmikus@cisco.com>

FIX: NF_density tests

+ Because arp->neigbor was so important to do.

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I552e175b7555ebf5053d7994c0c9173c0c96fc58

b313ae41 09-Jan-2020 Jan Gelety <jgelety@cisco.com>

CSIT-1597 API cleanup: rdma

- cover API changes in VPP: https://gerrit.fd.io/r/c/vpp/+/24225
- update vpp stable to version 20.01-rc0~1011

Change-Id: Ibbfdbe867cf89715619efc5c5507859983025ece
Signed-off-by: Jan Gelety <jgelety@cisco.com>

a08fc340 09-Jan-2020 Peter Mikus <pmikus@cisco.com>

FIX: Container test

+ We should check if container is UP
+ We should adjust privileges.

Change-Id: I3f604b7b9740943b4fd3b0574c18d2729e88b816
Signed-off-by: Peter Mikus <pmikus@cisco.com>

164b36d2 14-Nov-2019 Tibor Frank <tifrank@cisco.com>

DMM: Remove

Change-Id: Ibbfbed79e473c804390802ae1ecd737b50c06aa3
Signed-off-by: Tibor Frank <tifrank@cisco.com>

45b4d916 10-Dec-2019 Peter Mikus <pmikus@cisco.com>

T-Rex: Upgrade to 2.73 with DDP profile fix

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Icaa99e0a71a19ba23697c21a4b5aa046813a718a

ae652334 02-Jan-2020 Peter Mikus <pmikus@cisco.com>

Vhost: Add GSO option

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Iba9af71c293645b480203af72fcf940cbe9ccb3a

3a001f6b 07-Jan-2020 Vratko Polak <vrpolak@cisco.com>

Fix Trex start configuration

Since https://gerrit.fd.io/r/c/csit/+/24056
csit-vpp perf tests are failing.

Turns out the reason is too large limit_memory value,
but other improvements applied during investigation
are included as well.

+ Cat trex.log if trex fails to start.
+ Improve trex startup command formatting (remove double spaces).
+ Reorder imports.

Change-Id: I2c1106ea6f88a1a275682e73eba212d08c7947c8
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

aa5f30a2 06-Jan-2020 Vratko Polak <vrpolak@cisco.com>

Remove leftovers related to Xenial

+ File VPP_STABLE_VER_UBUNTU.
+ Subtree docs/report/vpp_functional_tests/.

Change-Id: Ifd9dd922152199de9f1352da709b1533d6c15aba
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

325bc9b1 02-Jan-2020 Peter Mikus <pmikus@cisco.com>

Add new NIC limits

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I2b1a0d1455ae74a2ad4fdb553286aef5942f2a99

efcdd3ea 18-Dec-2019 Peter Mikus <pmikus@cisco.com>

TREX: Ability to configure from outside TrafficGenerator.py

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Ia9832e5e65dbcf2d4f99c52fd0570d456262ab9a

13d39ef2 11-Dec-2019 Peter Mikus <pmikus@cisco.com>

VTS: Unify the tests

- Converting to 2n as they were always 2n (with l2xc on 3rd node)
- Removing KW and converting to layered approach

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Ie349c50f72eb362815e7c5ede076d421ab386e76

14fdc4a1 16-Dec-2019 Dave Wallace <dwallacelf@gmail.com>

Add VPP NSIM Plugin Keywords

Change-Id: I1e080a50a68ded8eebc5e6093c55d06281726684
Signed-off-by: Dave Wallace <dwallacelf@gmail.com>

e0f0c32f 18-Dec-2019 Dave Wallace <dwallacelf@gmail.com>

python3: fix RF 'only continuation marker' warning

Change-Id: I250ffd196045bc623d5d38f30f16a08bcaea137c
Signed-off-by: Dave Wallace <dwallacelf@gmail.com>

3ff919f8 19-Nov-2019 Peter Mikus <pmikus@cisco.com>

Telemetry: Add more operational data

+ Add both NDR and PDR telemetry capture
+ Speedup sockets
+ Adjust privileges

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Ia6fd5d405e6fb410651d8b705c921653753aea10

20083f2e 13-Dec-2019 Jan Gelety <jgelety@cisco.com>

FIX: eth interfaces need numa_node information in topology file

Change-Id: I9a3c6947da8ab5033e29b39833c97bcdafdc3ca9
Signed-off-by: Jan Gelety <jgelety@cisco.com>

e8b2b5a9 16-Dec-2019 Peter Mikus <pmikus@cisco.com>

Vagrant: Introduce CentOS8

+ Full ansible compatibility
- Docker currently not working in Centos8 as it was not yet released

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I837091621db6bbebc9fee729496384cabe2f5357

3111f250 13-Dec-2019 Peter Mikus <pmikus@cisco.com>

FIX PIP requirement packages

+ CSIT will only use packages installed from master
PIP requirement.txt file
+ All CSIT subsequent code must use single function
and PIP list for virtualenv
- Report/PAL/doc/trending will follow in next patch

Change-Id: Ia9150fb05a144182a5a163178d553370ede55cdd
Signed-off-by: Peter Mikus <pmikus@cisco.com>

dee46d5c 13-Dec-2019 Peter Mikus <pmikus@cisco.com>

Remove supervisord dependency from containers

+ Startup config stream-line

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Ia12e48202a5fc88461d3d24ac9b9599e7175b1d8

722aaac1 13-Dec-2019 Vratko Polak <vrpolak@cisco.com>

Reduce spam from device bootstrap

It uses "declare -f" to paste the complete common.sh file. Twice.
The output from ssh remote side still remains visible,
but avoiding the spam should ease scrolling to Robot console output.

Change-Id: I746484ada7650a6dfa6794e76550757af5413a82
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

ab0c87c7 12-Dec-2019 Dave Wallace <dwallacelf@gmail.com>

Python3: refactor ':FOR' statements

Signed-off-by: Dave Wallace <dwallacelf@gmail.com>
Change-Id: I76835e3d3acf6955e328f30427f9dd0098947e41

9d8845d7 12-Dec-2019 Jan Gelety <jgelety@cisco.com>

CSIT-1597, CSIT-1647 API cleanup: gbp

- cover API changes in VPP: https://gerrit.fd.io/r/c/vpp/+/23835
- update vpp stable to version 20.01-rc0~843

Change-Id: Idb1299cbbba578c09542c23858fb1fc55d090f26
Signed-off-by: Jan Gelety <jgelety@cisco.com>

cef423a9 01-Dec-2019 Jan Gelety <jgelety@cisco.com>

CSIT-1597 API cleanup: vhost

- cover API changes in VPP: https://gerrit.fd.io/r/c/vpp/+/22277
- update vpp stable to version 20.01-rc0~831

Change-Id: Icb3801d6a7bc738cf48bc5ecbb0767f115dde964
Signed-off-by: Jan Gelety <jgelety@cisco.com>

46224ef4 30-Nov-2019 Jan Gelety <jgelety@cisco.com>

CSIT-1597 API cleanup: tap

- cover API changes in VPP: https://gerrit.fd.io/r/c/vpp/+/21706
- cover API cahnges in VPP: https://gerrit.fd.io/r/c/vpp/+/23887
- update vpp stable to version 20.01-rc0~828

Change-Id: I70d88741a02729421d4b31010910138838811518
Signed-off-by: Jan Gelety <jgelety@cisco.com>

53f3ee86 11-Dec-2019 Peter Mikus <pmikus@cisco.com>

FIX: NF_Density pipeline ip4 profile

- Because they are failing

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I55c51bd3e4673414e5394cc6ba990257574ab002

3d5a75be 17-Jul-2019 Ludovit Mikula <ludovit.mikula@pantheon.tech>

Introduce VPP-IPsec container tests.

Change-Id: Ie64d662e81879bd52785e0188450d998bf056bda
Signed-off-by: Ludovit Mikula <ludovit.mikula@pantheon.tech>

84c5ded9 08-Nov-2019 Peter Mikus <pmikus@cisco.com>

VPPD: Add L2patch

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Iebdc03e56cf9ecf0322ff5c2c8698e9e3daf4407

8fc9b28d 11-Sep-2019 Jan Gelety <jgelety@cisco.com>

CSIT-1597 API cleanup: classify

- cover API changes in VPP: https://gerrit.fd.io/r/c/vpp/+/21551
- move vpp stable build to 20.01-rc0~821
- tap tests tagged 'EXPECTED_FAILING' until necessary vpp api change
https://gerrit.fd.io/r/c/vpp/+/21706 and csit code is adapted

Change-Id: If4b9b7b5bc207612d08aa8aa4469a5361e058fc3
Signed-off-by: Jan Gelety <jgelety@cisco.com>

526d34a0 29-Nov-2019 Jan Gelety <jgelety@cisco.com>

FIX: ip route config for ipsec via VAT

Change-Id: Ibf1979b87aeea0f4c195b97c8e6b59a4a23b1b77
Signed-off-by: Jan Gelety <jgelety@cisco.com>

6b893681 30-Nov-2019 Jan Gelety <jgelety@cisco.com>

FIX: integer divisions

Change-Id: I28caf62f418bf18601cd379603d03c307e3ba9c8
Signed-off-by: Jan Gelety <jgelety@cisco.com>

1ae2fdf1 05-Dec-2019 Vratko Polak <vrpolak@cisco.com>

Improve quoting of asterisks

When quoted, the asterisks are understood as literal characters.
When unquoted, so they act as globs patterns.

When used to match files already present in the filesystem,
the asterisks should be unquoted.
When used to match a package name (not a file),
the asterisks should be quoted to prevent the bash expansion,
as programs such as apt-get and yum do their own expasion afterwards.

Unquoted asterisks for matching package names
may happen to work when there are no files to match the bash expansion,
but quoted asterisks are sure to avoid accidents.

Also, we want an asterisk both before and after "vpp",
due to package names such as libvppinfra-dev and python3-vpp-api.

Change-Id: I657a24c24a71d865915aba201bd0d3276cb33281
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

a78df8f2 05-Dec-2019 Peter Mikus <pmikus@cisco.com>

FIX: Some leftovers + csit_sut image sync

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I9b47f9a31c11f155ba5b4676ccf0fc4c413a3942

1d9a0ce3 29-Nov-2019 Vratko Polak <vrpolak@cisco.com>

Use new gdb commands for core dump examination

Change-Id: I96f40fa816055a656209cbbcae8259a74cc4bd80
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

4bddfe8c 05-Dec-2019 Peter Mikus <pmikus@cisco.com>

FIX: Deal with some "pylint: disable=" comments

Same rules for all

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Iaf6b6313750d19132e2f2886e676100878719690

063abf35 04-Dec-2019 Vratko Polak <vrpolak@cisco.com>

Deal with some "pylint: disable=" comments

+ When possible, fix the violation.
+ Else, add a comment:
+ An explanation (if not already present) and keep disable.
+ A TODO (if not already present) and remove the disable.
- This makes tox job report more pylint violations,
but any such violation is fixable and should be fixed.
- Although some need to be fixed in VPP, such as enum item long names.

Change-Id: I48604b5eda070083d79dff1439620dbd9e798e1f
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

bb33f1d1 29-Nov-2019 juraj.linkes <juraj.linkes@pantheon.tech>

Change startup show pci to show ver

When testing whether a socket is listetning, show pci results in a crash
on the Taishan platform. Temporarily work around this by changing it to
show ver.

Change-Id: Id0f995373bc2f429d59de200e51959b2da408052
Signed-off-by: juraj.linkes <juraj.linkes@pantheon.tech>

53fb7dad 03-Dec-2019 Peter Mikus <pmikus@cisco.com>

Remove: VIRL

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I2b1672412e19f15cb46246fffa931351cd3d518b

af7b5938 29-Nov-2019 Jan Gelety <jgelety@cisco.com>

FIX: vxlan+vlan perf tests

Change-Id: I7115456a1ef64a0b92113a77fba2949005208b07
Signed-off-by: Jan Gelety <jgelety@cisco.com>

627cddca 02-Dec-2019 Vratko Polak <vrpolak@cisco.com>

Refactor jumpavg to be more readable and usable

This is the python3 change, the python2 is still used for testing bisect.

+ New version is 0.2.0 due to amount o API changes.
+ Jumpavg is now part of CSIT resource package tree.
+ Perpatch migrated to new jumpavg.
- PAL NOT updated (the update moved to a different Change).

Change-Id: I7d7a8bf8a411196c20c2a40a8c64478d6709bc07
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

9a936616 02-Dec-2019 Peter Mikus <pmikus@cisco.com>

FIX: Perpatch PY3

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Iae97cf4490fea38f5f03bdaa120ee7ae48b941ab

f6eacaa9 28-Nov-2019 Jan Gelety <jgelety@cisco.com>

FIX: SRV6 proxy

Change-Id: I4afbb0261c21c800bf24e423e505307f596c0045
Signed-off-by: Jan Gelety <jgelety@cisco.com>

edc17958 28-Nov-2019 Jan Gelety <jgelety@cisco.com>

FIX: acl

Change-Id: Ieb1569a1dce9fd7c00041ba00f72c67142a581ed
Signed-off-by: Jan Gelety <jgelety@cisco.com>

b036f558 01-Dec-2019 Peter Mikus <pmikus@cisco.com>

FIX: VAT terminal

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I98fd62e6b5367b23694017d99a1dae7d893326c9

0c6c9884 30-Nov-2019 Peter Mikus <pmikus@cisco.com>

FIX: IPsec naming creation

Change-Id: I066a8b85649654c1c575eb63722de6c51f3d4f78
Signed-off-by: Peter Mikus <pmikus@cisco.com>

d68951ac 12-Nov-2019 Jan Gelety <jgelety@cisco.com>

Python3: resources and libraries

Change-Id: I1392c06b1d64f62b141d24c0d42a8e36913b15e2
Signed-off-by: Jan Gelety <jgelety@cisco.com>


python/Classify.py
python/Constants.py
python/ContainerUtils.py
python/Cop.py
python/CoreDumpUtil.py
python/CpuUtils.py
python/DMM/DMMConstants.py
python/DMM/SetupDMMTest.py
python/DMM/SingleCliSer.py
python/DPDK/DPDKTools.py
python/DPDK/L2fwdTest.py
python/DPDK/L3fwdTest.py
python/DUTSetup.py
python/Dhcp.py
python/DpdkUtil.py
python/DropRateSearch.py
python/FilteredLogger.py
python/GBP.py
python/HTTPRequest.py
python/IPUtil.py
python/IPsecUtil.py
python/IPv6Util.py
python/InterfaceUtil.py
python/KubernetesUtils.py
python/L2Util.py
python/LimitUtil.py
python/LispSetup.py
python/LispUtil.py
python/LoadBalancerUtil.py
python/LocalExecution.py
python/MLRsearch/AbstractMeasurer.py
python/MLRsearch/AbstractSearchAlgorithm.py
python/MLRsearch/MultipleLossRatioSearch.py
python/MLRsearch/NdrPdrResult.py
python/MLRsearch/ReceiveRateInterval.py
python/MLRsearch/ReceiveRateMeasurement.py
python/Memif.py
python/NATUtil.py
python/Namespaces.py
python/NodePath.py
python/OptionString.py
python/PLRsearch/Integrator.py
python/PLRsearch/PLRsearch.py
python/PLRsearch/log_plus.py
python/PLRsearch/stat_trackers.py
python/PacketVerifier.py
python/PapiExecutor.py
python/PapiHistory.py
python/Policer.py
python/PythonThree.py
python/QemuManager.py
python/QemuUtils.py
python/SRv6.py
python/SchedUtils.py
python/SetupFramework.py
python/SysctlUtil.py
python/TGSetup.py
python/TLDK/SetupTLDKTest.py
python/TLDK/TLDKConstants.py
python/TLDK/UdpTest.py
python/Tap.py
python/TestConfig.py
python/Trace.py
python/TrafficGenerator.py
python/TrafficScriptArg.py
python/TrafficScriptExecutor.py
python/VPPUtil.py
python/VatExecutor.py
python/VatJsonUtil.py
python/VhostUser.py
python/VppApiCrc.py
python/VppConfigGenerator.py
python/VppCounters.py
python/autogen/Regenerator.py
python/autogen/Testcase.py
python/parsers/JsonParser.py
python/ssh.py
python/tcp.py
python/telemetry/SPAN.py
python/telemetry/__init__.py
python/topology.py
robot/crypto/ipsec.robot
robot/dpdk/default.robot
robot/features/acl.robot
robot/features/gbp.robot
robot/features/policer.robot
robot/ip/ip4.robot
robot/ip/ip6.robot
robot/ip/nat.robot
robot/l2/l2_bridge_domain.robot
robot/l2/l2_patch.robot
robot/l2/l2_traffic.robot
robot/l2/l2_xconnect.robot
robot/l2/tagging.robot
robot/lb/load_balancer.robot
robot/overlay/lisp.robot
robot/overlay/lisp_api.robot
robot/overlay/lisp_static_adjacency.robot
robot/overlay/lispgpe.robot
robot/overlay/srv6.robot
robot/overlay/vxlan.robot
robot/performance/performance_configuration.robot
robot/performance/performance_limits.robot
robot/performance/performance_utils.robot
robot/shared/container.robot
robot/shared/default.robot
robot/shared/interfaces.robot
robot/shared/memif.robot
robot/shared/suite_setup.robot
robot/shared/suite_teardown.robot
robot/shared/test_setup.robot
robot/shared/test_teardown.robot
robot/shared/testing_path.robot
robot/shared/traffic.robot
robot/shared/vm.robot
robot/tcp/tcp_setup.robot
robot/wrk/wrk_utils.robot
ed0258a4 04-Nov-2019 Peter Mikus <pmikus@cisco.com>

Python3: PIP requirement

- Install via PIP3
- Use virtualenv Python3 interpret

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Iad22b344b418a1d91774d23d5ea17bfd48d394b3

497f6069 14-Nov-2019 Tibor Frank <tifrank@cisco.com>

NSH_SFC: Remove

Change-Id: Ib7f9dff7bede4f8ec3148f234109132be920de82
Signed-off-by: Tibor Frank <tifrank@cisco.com>

e7ad66f3 11-Nov-2019 Peter Mikus <pmikus@cisco.com>

HONEYCOMB: Remove

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I60d80564050cb786c7b1e0a08f31f8292f82197e


bash/function/artifacts_hc.sh
python/Constants.py
python/honeycomb/BGP.py
python/honeycomb/DHCP.py
python/honeycomb/FIB.py
python/honeycomb/HcAPIKwACL.py
python/honeycomb/HcAPIKwBridgeDomain.py
python/honeycomb/HcAPIKwInterfaces.py
python/honeycomb/HcAPIKwNSH.py
python/honeycomb/HcPersistence.py
python/honeycomb/HoneycombSetup.py
python/honeycomb/HoneycombUtil.py
python/honeycomb/IPv6Management.py
python/honeycomb/Lisp.py
python/honeycomb/NAT.py
python/honeycomb/Netconf.py
python/honeycomb/Notifications.py
python/honeycomb/Performance.py
python/honeycomb/ProxyARP.py
python/honeycomb/Routing.py
python/honeycomb/__init__.py
robot/honeycomb/access_control_lists.robot
robot/honeycomb/bgp.robot
robot/honeycomb/bridge_domain.robot
robot/honeycomb/dhcp.robot
robot/honeycomb/fib.robot
robot/honeycomb/honeycomb.robot
robot/honeycomb/interfaces.robot
robot/honeycomb/ipv6_control.robot
robot/honeycomb/l2_fib.robot
robot/honeycomb/lisp.robot
robot/honeycomb/lisp_gpe.robot
robot/honeycomb/nat.robot
robot/honeycomb/netconf.robot
robot/honeycomb/notifications.robot
robot/honeycomb/nsh.robot
robot/honeycomb/papi.robot
robot/honeycomb/performance.robot
robot/honeycomb/persistence.robot
robot/honeycomb/policer.robot
robot/honeycomb/port_mirroring.robot
robot/honeycomb/provider_backbone_bridge.robot
robot/honeycomb/proxyarp.robot
robot/honeycomb/routing.robot
robot/honeycomb/slaac.robot
robot/honeycomb/sub_interface.robot
robot/honeycomb/tap.robot
robot/honeycomb/vhost_user.robot
robot/honeycomb/vxlan.robot
robot/honeycomb/vxlan_gpe.robot
20cc67d5 15-Nov-2019 Vratko Polak <vrpolak@cisco.com>

Improve test tag string parsing

Instead of just adding the missing -clx,
the new way aims to be forward compatible.

The new implementation is quite permissive,
ignoring all "word" chars sticking to the trigger word
and returning everything after that and space up to the endline.

+ Unified perftest and devicetest handling.
+ Consequently, triggers like "devicetest-1n-skx GBP" will work now.

Change-Id: I3bda6105195180d35a589a75318f569e36f03461
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

080b0394 15-Nov-2019 Peter Mikus <pmikus@cisco.com>

FIX: LXC Container directory initialization

Change-Id: I7d2f81e03316410073b2b3ff7d6d754f5ac90df7
Signed-off-by: Peter Mikus <pmikus@cisco.com>

f23b0e35 13-Nov-2019 Peter Mikus <pmikus@cisco.com>

FIX: Ipsec perf

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I6e3ce086978c383303724d989702b1c1273c50c0

7de465c0 13-Nov-2019 Peter Mikus <pmikus@cisco.com>

LIGATO: Remove

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I0c9b8b07ed3a113e24a38faaddd5ed06fae67768

3a42930d 11-Nov-2019 Jan Gelety <jgelety@cisco.com>

FIX: missing param in gbp_contract_add_del

Change-Id: I5c2354911505a9d7a95bef894eda8bf7b14b8dc8
Signed-off-by: Jan Gelety <jgelety@cisco.com>

06e6da52 10-Oct-2019 haiyanx1.zhang <haiyanx1.zhang@intel.com>

Add vpp loadbalancer l3dsr/nat4 mode test suites

Change-Id: I03603108fe7128fb4bde4abddb6a0959dd5b5c73
Signed-off-by: haiyanx1.zhang <haiyanx1.zhang@intel.com>

dfcefbd9 07-Nov-2019 Jan Gelety <jgelety@cisco.com>

New weekly mrr trigger

Change-Id: Iff21ad109e5f0a8ed06bd561e75c8a708e84c036
Signed-off-by: Jan Gelety <jgelety@cisco.com>

a6721ae4 12-Nov-2019 Peter Mikus <pmikus@cisco.com>

FIX: Supervisor initialization

- Next step: remove supervisor entirely

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I7ff5d76168d5d0f77e335975552638efac77cfc8

a31a47b1 11-Nov-2019 Vratko Polak <vrpolak@cisco.com>

Remove the leftovers of the old testbed cleanup

Change-Id: I464db6fb6c220f23f2fe69df2c793175975d7b72
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

a4cad14b 30-Oct-2019 Jan Gelety <jgelety@cisco.com>

FIX: do not use ping in vpp-device tests

Change-Id: Ic11f863e7ffad70d45e6e8dc39c70efc62cecc96
Signed-off-by: Jan Gelety <jgelety@cisco.com>

d5e00a36 11-Nov-2019 Peter Mikus <pmikus@cisco.com>

FIX: Paths for new Docker images

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Ia39ff6445e4029a78d008d5690661610a1e9ed50

b0d6fc97 08-Nov-2019 Vratko Polak <vrpolak@cisco.com>

Prevent many TC triggered by bad tag expressions

Typical example: Use multiple perftest lines in a comment.
Atypical example: Use perftest as an expression (without any ANDs).

Fix: Die if "perftest" is found in the tag expression (before prefixing).

Change-Id: I0230541b30557ce7a4e9d57c8303cd432f86747d
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

e426a0bd 07-Nov-2019 Jan Gelety <jgelety@cisco.com>

FIX: use correct NIC for mr-daily-master job

Change-Id: I57bc8c7eda7ea959d92f7e35b7989d64b20743a0
Signed-off-by: Jan Gelety <jgelety@cisco.com>

0227e20f 07-Nov-2019 Vratko Polak <vrpolak@cisco.com>

Source ansible.sh for entry scripts using cleanup

Change-Id: Iee02577ee0c054feb61edee807182c6808f235b0
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

d01411c3 10-Oct-2019 Peter Mikus <pmikus@cisco.com>

Cleanup via Ansible

+ Remove dependency on topo_ scripts that depends on custom SSH()
that depends on framework itself. This way the cleanup is independent
of failure in our SSH libs.
+ Simple ansible command can do cleanup of a machine:
ansible-playbook --inventory inventories/lf_inventory/hosts site.yaml \
--limit '10.32.8.18' --tags 'cleanup'
+ Add vpp_device reset and cleanup.
+ Remove historical scripts.

- Still in testing beta phase.
- Need to add SRIOV cleanup.

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I68e23304c7ad01041f51263c328c6e8d9b555cb7

9bdcc0e3 25-Oct-2019 Jan Gelety <jgelety@cisco.com>

New daily triggers

New daily triggers defined based on requirements defined in
https://gerrit.fd.io/r/c/csit/+/22341/34/resources/tools/presentation/doc/trending_test_groups.md

Change-Id: I95bff10d9a2e29c712a33f7c043933244b712fd0
Signed-off-by: Jan Gelety <jgelety@cisco.com>

3ccfe8cd 30-Oct-2019 Peter Mikus <pmikus@cisco.com>

Framework: Add show log as tear down action

+ We can see what is happening when debug level is increased
+ Big caveat of VPP is that it does not allow to configure
default global level.

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I5ea1a618161cdb3170cab022d7451e52271f83c0

96eaabff 13-Sep-2019 Peter Mikus <pmikus@cisco.com>

Add: Use containers for shared TG

+ Ansible
+ Service for auto load during restart
+ By default created 2 instances of Docker container
+ Small modification of Trex to use prefixes
+ DNV topology to use ssh port to connect to docker

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Ibc2b2f0e509d920fc3e05d012b88abc388f5c3e7

9fa0aef9 28-Oct-2019 Vratko Polak <vrpolak@cisco.com>

TrafficGenerator: Skip only the first equals

HRDhistogram output contains essential trailing equals.
Edit all fields even though we do not expect equals in others.

Change-Id: I9f4f07fc4d6f4583989a9c0e45f68bc0cd9a65fe
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

eaf3cde2 25-Oct-2019 Peter Mikus <pmikus@cisco.com>

FIX: Limitation for NICs

Change-Id: I8e0a14f59e20d61096e069bb80a0e2c00977ac5c
Signed-off-by: Peter Mikus <pmikus@cisco.com>

909a91c2 15-Oct-2019 Peter Mikus <pmikus@cisco.com>

ADD: Mellanox RDMA interface support

+ Add functions for creating rdma interface
+ Fix traffic generator

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I81787b72ff5ee926ed652d350888c4f86da766f1

ac89ba8a 21-Oct-2019 Peter Mikus <pmikus@cisco.com>

Introduce pre-initialize driver layer

+ This will help unify driver base differences between TCs.
+ Decrease amount of logic needed for suite generator.

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I1e84ba361dc1e829f0612c58a61096e2633ce0c5

23b5bfe6 21-Oct-2019 Vratko Polak <vrpolak@cisco.com>

CRCs: Update comments and improve CSIT checks.

+ Restore alphabetic order in yaml.
+ Mark the lisp messages verified to be covered by dev instead of virl.
+ Mark the GBP messages verified by devicetest now.
+ Mark acl_add_replace as dev and create_subif as perf.
+ Mark ip_probe_neighbor as unused L1.
+ Improve loadbalancer comments.
- Nat4 testcase is described, even if not merged yet.
+ Forget reported CRC after initial dir report,
and report them again (once) in test cases (if hit).
With this, single run (with fail on crc off) gives full info.
+ Small improvements to CRC library docstrings and messages.

Change-Id: Ic1cfad45e10d437be827af2a89eac49e25267b59
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

fcc77752 18-Oct-2019 Peter Mikus <pmikus@cisco.com>

Tests: Introduce driver layer

+ Small bugfixes in various suites

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I051af0a6da7340fe3f617400370c3846ca5241ab

510f6d51 18-Oct-2019 Vratko Polak <vrpolak@cisco.com>

Autogen checker: Fix difference reporting branch

Change-Id: I85da5ec38643524fa1af7ed7628025a4a52463f5
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

bf0ea7ae 15-Oct-2019 Peter Mikus <pmikus@cisco.com>

Core-keeper: Process files instead transfer

+ Instead of transferring large files, post-process directly
via CSIT. Extract backtrace as a start point.

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I79ad760d310c95d807242ad1997dd657d5142459

fba70865 09-Aug-2019 Peter Mikus <pmikus@cisco.com>

VPPD: GBP test case

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I020cdb6ced70a9c22773dfbe1662aecd2b744d2d

18479dee 17-Sep-2019 haiyanX1.zhang <haiyanx1.zhang@intel.com>

Add vpp loadbalancer maglev mode test suite

Change-Id: I61555ba566efef0a2151db9a30bf7f5d9ccad1df
Signed-off-by: haiyanx1.zhang <haiyanx1.zhang@intel.com>

f6a8c61f 07-Oct-2019 Peter Mikus <pmikus@cisco.com>

FIX: LXC tmpfs mount

- Should fix the read/write to socket for LXC

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I56a84145cf2fb95742423789681ca2e24ddf0c98

fdd42115 04-Oct-2019 Jan Gelety <jgelety@cisco.com>

FIX: put back the correct value of FAIL_ON_CRC_MISMATCH constant

Change-Id: Ia395cfbc5325d292bf8c32bb24e9a1478c140780
Signed-off-by: Jan Gelety <jgelety@cisco.com>

b38e5bc9 26-Sep-2019 Jan Gelety <jgelety@cisco.com>

Update of VPP_STABLE_VER files

- use new vpp ref build - ubuntu 16.04:
20.01-rc0~324-g66a332c~b8122

- use new vpp ref build - ubuntu 18.04:
20.01-rc0~324-g66a332cf1

- use new vpp ref build - centos7:
20.01-rc0~324_g66a332c~b7936

Change-Id: I82c6032742939417914f5210b1fba4464ab1e70d
Signed-off-by: Jan Gelety <jgelety@cisco.com>

3691bd34 03-Oct-2019 Jan Gelety <jgelety@cisco.com>

FIX: use int of sw_if_index in call of sw_interface_set_flags api

- it will avoid situation that corresponding port is not up and
its sw_if_index value in topology file is None that is interpreted
as 0 in vpp api so it set flag for local0 interface

Change-Id: I9145077d787ddde50a29bcd4091035e95077f946
Signed-off-by: Jan Gelety <jgelety@cisco.com>

7b73d468 24-Jul-2019 premkumarv <preym17@gmail.com>

CSIT-1471: Policer - VAT API to PAPI

Change-Id: I6c7eff8d9cbb196ccb684a45579ac59942351cfe
Signed-off-by: premkumarv <preym17@gmail.com>

1b95782e 13-Sep-2019 Vratko Polak <vrpolak@cisco.com>

Add support for HDRhistogram

+ Enable hdrh in trex server.
+ Append hdrh coded output after min/avg/max/.
+ Read (not show nor decode) hdrh value in PAL.
+ Also, remove old ndrpdrdisc code.

Change-Id: I99d99f10386a621772b5419ca1f36080fa15aca7
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

bab0b570 23-Sep-2019 Vratko Polak <vrpolak@cisco.com>

Reconf tests: Fix async measurements

TRex does not zero the server counters.
It copies the values to use as reference,
and subtracts them when asked for results.

But the reference is stored in the client (not the server).
And CSIT uses different scripts to start and stop async traffic,
which means different clients.

This patch introduces a workaround.
Async start will return xstats objects to use as reference,
and async stop will use the objects to compute the correct results.
The xstats objects are stored in TrafficGenerator instance.
Sync measurement does not export the counters, to shorten logs.

Other improvements:
+ Make stop_traffic_on_tg return measurement results directly.
+ Rename --async to --async_start as "async" is reserved in Python 3.7
+ Minor pylint, docstring and typo fixes.

Change-Id: I5fc56a0763afb7d62cfa7c0651f96b6867de3e15
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

aafa2efa 31-Aug-2019 Nidhy <nidhyanandhan.a@hcl.com>

LISP: 3-node (func) to 2-node (dev) converstion

Change-Id: I0fbe4d9ef1b30a1ac1382ea43b5b52aeb8a7d39f
Signed-off-by: Nidhy <nidhyanandhan.a@hcl.com>

a295b175 12-Sep-2019 Jan Gelety <jgelety@cisco.com>

CSIT-1597 API cleanup: cop

cover API changes in VPP: https://gerrit.fd.io/r/c/vpp/+/21458

Change-Id: I596cfcd192bf48b0d0a91b1953746a484e2c9793
Signed-off-by: Jan Gelety <jgelety@cisco.com>

3e0d781e 13-Sep-2019 Vratko Polak <vrpolak@cisco.com>

Fix errors found by pylint

Change-Id: I0c2bee5a1ff8ad29e47c4f947388e7b97dd17fff
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

8b1bead7 17-Sep-2019 Vratko Polak <vrpolak@cisco.com>

Update CRC list and support 21997/7

- Attempt to repair IPsec LispGpe perf suite.
+ Collection name to reflect the current stable vpp.
+ Add messages found in CSIT L1 keywords.
- Uncommented (instead of deleted) untestable messages. Reasons:
- Honeycomb.
- Messages used by unused keywords.
+ Listed reasons. Honeycomb not mentioned if both reasons apply.
+ Delete CRC items for commands not found in keywords anymore.
+ Add CRCs from .json.api files (as teardown is hard to execute).
+ Define and restore alphabetical order.
+ Add hints to find used API commands (not entirely reliable).
+ Move used commands to "cmd = " form so hints find them.
+ Argument to run_cli_command changed from "cmd" to "cli_cmd".
+ Except also struct.error where IOError is excepted.

Change-Id: I61058dbe1e33296908aabd0c13433bb16cfa6adf
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

9efba1d5 13-Sep-2019 Peter Mikus <pmikus@cisco.com>

FIX: Pylint + Container mount

- Mount is affecting only LXC container

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I84140ea5e48120792fc84182a97eb7d06c954a84

8be5c348 12-Sep-2019 Vratko Polak <vrpolak@cisco.com>

CRC checker: Sort and indent dict output

Also, use double quotes, so the dict is shown
not only as a valid Python code, but also a valid JSON.
This should make it easier to handle big CRC changes such as:
https://logs.fd.io/production/vex-yul-rot-jenkins-1
/vpp-csit-verify-api-crc-master/646/console.log.gz

+ Log indented message about CRC conflict to console even on failure,
as in the exception, endlines are escaped.

Change-Id: If4fe3003f612d4b0c156004a0aa2dab088e50723
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

4fa06bcf 06-Sep-2019 Vratko Polak <vrpolak@cisco.com>

Support unidirection in all searches

+ Rename bool unidirection to int traffic_directions.
+ Rename "untagged" to "initial" for bandwidth calculation.
+ Fix latency measurement for unidirectional traffic.
+ Remove duplicate colon in soak test message.
+ Edit PAL to accept both forms.
+ Fix minor documentation issues.

Change-Id: I6c76f2dc090ae493f2fbd7e9ccd45229d2306dea
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

a6d9745a 11-Sep-2019 Vratko Polak <vrpolak@cisco.com>

Skip CRC checking by default

During https://gerrit.fd.io/r/c/ci-management/+/21955
we decided this new default is more convenient for development.

Change-Id: I07f10cbb586e79f6ac714ad635dda35561c07125
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

6a80c902 11-Sep-2019 Peter Mikus <pmikus@cisco.com>

TRex: 2.61

- HDRhistogram can be rebased and used in separate patch.

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Ic7ce752344c6e1791af7cf7b7effde65ac2be680

45882a27 11-Sep-2019 Peter Mikus <pmikus@cisco.com>

Topology: Cascadelake

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I1533f00dd4b40f9dda82b1e9b5b15a81bbb9f7fb

f0d7edd5 11-Sep-2019 Vratko Polak <vrpolak@cisco.com>

Revert "API cleanup: tap" and bump stable_vpp

The VPP change got a temporary -1,
as other change has higher priority.

Bumping stable VPP version, so this passes verify right away.

This reverts commit ae62a4348f7de53cfb91a5ae25a10723d5f9b398.

Change-Id: If2813b0e41451a3a9e7f8b1512521cf508ac92c7
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

ae62a434 03-Sep-2019 Jan Gelety <jgelety@cisco.com>

CSIT-1597 API cleanup: tap

cover API changes in VPP: https://gerrit.fd.io/r/c/vpp/+/21706

Change-Id: I16b3e3e29e7e7491cd19c067e8f3d8ced4947852
Signed-off-by: Jan Gelety <jgelety@cisco.com>

e7a8aec5 04-Sep-2019 Jan Gelety <jgelety@cisco.com>

CSIT-1597: API cleanup: bond

Change-Id: I7c2a29cfe48eee521cce5fcc3506cef39d51d37b
Signed-off-by: Jan Gelety <jgelety@cisco.com>

891f932d 10-Sep-2019 Peter Mikus <pmikus@cisco.com>

Ansible: Trex installation

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I5ab8fe05074a842301a511bbd3ab5e67f8d1a9f0

c4528bcd 30-Aug-2019 Peter Mikus <pmikus@cisco.com>

Refactor getting telemetry

+ Ability to get stats from CNF via SocketPAPI
- Remove obsolete functions

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I4d1b32a7279244592be96644e4f8a530c4f29a15

2b67e806 03-Sep-2019 Jan Gelety <jgelety@cisco.com>

API cleanup: memif

Change-Id: I4a2d4719dfa7c993c54b278a0093ea833307bb87
Signed-off-by: Jan Gelety <jgelety@cisco.com>

e310a40e 05-Sep-2019 Vratko Polak <vrpolak@cisco.com>

Read environment variables in Constants.py

Instead of using EnsureGlobalVariable,
which is clunky to use from Python.

As a consequence, all caps variables from Constants.py are used directly
and tests/__init__.robot and robot_enhancements.robot are deleted.

+ Rename the CRC global kill switch based on ci-man review.

Change-Id: I10723792475bc83352bf8c3b7f7946ecf885a194
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

2570a7fa 04-Sep-2019 Vratko Polak <vrpolak@cisco.com>

Allow CRC checking to be controlled via env var

The plan is to override the default in some (but not all) jobs.
The csit-vpp jobs shall do the checking, but vpp-csit jobs shall not
(except api-crc job of course) in order to confirm benign changes.

Change-Id: If59d17991de3fb0e847113a87e0533a8ee62af7f
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

474034ac 02-Sep-2019 Jan Gelety <jgelety@cisco.com>

FIX: Use vhost macs when testpmd_mac forwarding used in VM

Change-Id: I291c3dc852e7c1bde6fb6102a9168cfec9992682
Signed-off-by: Jan Gelety <jgelety@cisco.com>

a5629ca2 02-Sep-2019 Vratko Polak <vrpolak@cisco.com>

Clarify why 9000B tests are skipped for IPsec

Ticket: VPP-1207

Change-Id: I506b4a24dfa6b10578407b261926f37215a714f4
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

6cdc335b 22-Aug-2019 Vratko Polak <vrpolak@cisco.com>

Delete unused SR keywords

Trim both Python (L1) and Robot (L2) keywords,
as no test performs SR related deletions.

Change-Id: Ic76d870c3f58e927ea222b350e149d0770985072
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

ac37499e 26-Aug-2019 Ludovit Mikula <ludovit.mikula@pantheon.tech>

- Removed 9000B test cases from ipsec test suites.
- Added new traffic profiles.

Signed-off-by: Ludovit Mikula <ludovit.mikula@pantheon.tech>
Change-Id: Ie06b7a1cf4d9df403d098b7a495219fd95e5869e

a6d233d8 23-Aug-2019 Vratko Polak <vrpolak@cisco.com>

Stop using SSH() in TrafficGenerator.py

This is a partial fix for:
Ticket: CSIT-1434
and should fix one pylint violation.
Many files to remove SSH() from remain.

+ Use -E (together with previous -S) in ssh.py when sudo=True.
Needed in some cases, no downsides expected.

Change-Id: Ie2ad03b3c656a4d3965a61a1e5435276f99a28c0
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

ff820e3d 23-Aug-2019 Vratko Polak <vrpolak@cisco.com>

Introduce reconfig suites, for dot1q+ip4+vxlan

Ticket: CSIT-1551

+ Config copied from other suites.
+ Layer keywords prepared for additional chains.
+ Renamed "create" argument to "vlan_per_chain".
+ TrafficGenerator result extraction improvements.
+ Also unified TG type and subtype checking.
+ Throughput estimated as PDR for zero PLR.
+ Actual Qemu start is skipped.
+ Parse xstats instead of stats in trex stop scipt.
- Because stats are unconditionally cleared on each script connect.
+ Remember start values to get better ReceiveMeasurementResult at stop.
+ Expose loss count and time as appropriate test message.
+ Autogen support.
+ Multiple chain amounts and core densities.
- Only 1 additional chain.
+ Proper TAGs. Documented.
+ Clarified min framesize tags are for TG-DUT.
+ Added a TODO concerning overhead values.
+ Added 118B tag.
+ Robot performance keywords improvements.
+ Added missing return value documentation.
+ Frame size as required test variable, not an explicit argument.
+ MLRsearch keyword to store result (not into test message).
- TODO: De-duplicate: main keyword to measure, minor to set test message.
- But implementation uses the fact default arguments are different.
+ Keywords for starting and stopping background traffic.
- No checks whether start-stop pair is complete.
+ Multiple minor indentation and logging improvements.
- Missing / TODOs:
- Support also vlan_per_chain=True?
- Support dot1q without vxlan?
- Support also deletion?
- How to package config steps so -reconf can be generated from -ndrpdr?

Change-Id: If0270697f9ffa837c34ef802917220a53f156703
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

fbbc4735 22-Aug-2019 Vratko Polak <vrpolak@cisco.com>

Improve PLRsearch yet again

Logic improvements for rls1908 and post-pylint fixes:

+ Reduce search time to 30 minutes.
+ Use average instead alternating loads.
+ Rework log/exp avg/stdev from two estimates.
+ Introduce and use pessimistic variance of dual trackers.
+ Introduce safe_exp to use when None does not skip code.
+ Use dot relative imports (instead of disabling pylint).
+ Complete docstrings for simpler functions.
+ Append docstrings to named tuples.
+ Somewhat unify docstrings related to the same arguments.
+ Slightly improve intentation.
+ State named tuples as rtype where used.
+ Add returns and rtype to __repr__ where missing.
+ Return what docstring say (or update them).
+ Explicit copying for vector and matrix values.

Change-Id: I884c68b4839c5df5e8bef95e463666599603a0ff
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

91051c28 15-Aug-2019 Miroslav Los <miroslav.los@pantheon.tech>

Framework: simplify CpuUtils

Signed-off-by: Miroslav Los <miroslav.los@pantheon.tech>
Change-Id: I7682d802f405070e34f72bc4a80cbe6a63b03619

a0a1bdba 20-Aug-2019 Peter Mikus <pmikus@cisco.com>

Add: avf-dot1q testcases

+ Few fixes in doc
+ Align testcases

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I5575db8255a74fd46f37d5cc2637b9b4448bcd7f

b6cd8aba 20-Aug-2019 Vratko Polak <vrpolak@cisco.com>

Fix Initialize layer dot1q on node

By using Get Variable Value keyword.

Change-Id: I3a9650b6f802d60422ffa6b6b00d444ebb050d89
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

a46ab8cc 07-Aug-2019 Jan Gelety <jgelety@cisco.com>

Interface API cleanup

CSIT code alignment with API changes in VPP introduced
by patch https://gerrit.fd.io/r/c/vpp/+/18361

Change-Id: Ib0357bba79f55d297ef1086fbf3b760caca16cdb
Signed-off-by: Jan Gelety <jgelety@cisco.com>
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

329e0ace 19-Aug-2019 Peter Mikus <pmikus@cisco.com>

Align NF_denisty tests

+ Apply layer approach for interfaces

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I6c1898b9833f9f42b8912f1b521e30093360d7ea

103d029d 19-Aug-2019 Vratko Polak <vrpolak@cisco.com>

VPP perf per patch: Reverse the order of tests

If current VPP is broken, we want to fail early.
If there is API change, we are more interested in current results,
even if parent is likely to fail.

Change-Id: I552485bbb9fe0053bae39de7939f94a5971bb63b
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

ae7dc001 16-Aug-2019 Vratko Polak <vrpolak@cisco.com>

Autogen: Create NICs for TCP suites.

+ Put Regenerator internal functions ourside class.
+ Duplicate into _default_ and _tcp_ functions.
+ Rework Testcase to be a single class with two factories.
+ Improve suite and testcase naming.

Change-Id: I1f835b576c476c1a40c8c52469b1876695f9ae73
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

b1385ce4 15-Aug-2019 Miroslav Los <miroslav.los@pantheon.tech>

Framework: MLRSearch refactor of ndrpdr

Signed-off-by: Miroslav Los <miroslav.los@pantheon.tech>
Change-Id: I86bc69f8b2f38b58cb3eb030bec7d0ce5c79d040

281b230b 16-Aug-2019 Miroslav Los <miroslav.los@pantheon.tech>

Framework: Refactor complex functions in PLRSearch

Signed-off-by: Miroslav Los <miroslav.los@pantheon.tech>
Change-Id: Ie2f19a2e3b37e8d85656ab31ece59b89c76bea25

00b3327c 19-Aug-2019 Peter Mikus <pmikus@cisco.com>

FIX: Missing ACL library

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I1497a9b031603d09d69a29ed7167686848d4b7c5

f893de60 19-Aug-2019 Tibor Frank <tifrank@cisco.com>

Write DPDK version to log

Change-Id: Ia9ec0d420c8db9e71234f74e4013c21d039931b2
Signed-off-by: Tibor Frank <tifrank@cisco.com>

db24a2e6 16-Aug-2019 Peter Mikus <pmikus@cisco.com>

FIX: Topology reservation

Last attempt [0] is doing more harm then good. If testbed is down
but recovered quickly enough (reboot, temporary ssh connectivity
issue, ...) it never gets back into pool making other testbeds
overloaded and queued.

This patch is suppose to partially revert previous behavior until
proper patch will follow.

[0] https://gerrit.fd.io/r/c/csit/+/21148

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I8203946d10d3e7dd51e97519d679246b5dae59e3

660e18c0 13-Aug-2019 Peter Mikus <pmikus@cisco.com>

TOX: DOC verify

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Ifa4de8e60742f5c4cf4c2f377692313e23f9983b

e6dd7724 13-Aug-2019 Jan Gelety <jgelety@cisco.com>

FIX: Remove eth_avf and portX_vifY interfaces from topo in TC/TS tear down

Change-Id: I90901c4ab14dfa76dc3e1f786a4b986479e0ba47
Signed-off-by: Jan Gelety <jgelety@cisco.com>

16226fd2 15-Aug-2019 Tibor Frank <tifrank@cisco.com>

Add testbed info to output_info.xml

Change-Id: I2ff45926a754647c1be6263cf8e5e0c7cbfedfef
Signed-off-by: Tibor Frank <tifrank@cisco.com>

545216fd 15-Aug-2019 Peter Mikus <pmikus@cisco.com>

Reduce disabled pylint to address them not hide

+ Fixed Qemu
- Broad Exception should be addressed
- Policer is about to be refactored
- Drop search to be refactored

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I97eb992497ff6334057bf82a0f413387706e17fd

6d941885 14-Aug-2019 Peter Mikus <pmikus@cisco.com>

FIX: VM startup after socket move

+ Still workaround for VPP bug not creating dir at startup

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I8b87ac70e5f85d538a25058dcb5453f89e21498f

6da72667 06-Aug-2019 Dave Wallace <dwallacelf@gmail.com>

VAT-to-PAPI: Fix HTTP/TCP tests

Change-Id: Ie728bc73eb7429d246e82dd195fc63191c3ac51d
Signed-off-by: Dave Wallace <dwallacelf@gmail.com>

669d320b 14-Aug-2019 Miroslav Los <miroslav.los@pantheon.tech>

DO_NOT_MERGE CSIT-1194 - Framework easy pylint improvements

- force a python2 environment in tox for pylint
- let pylint load some compiled modules for member checking
- allow locally enabled pylint rules
- ignore bad enum names
- ignore complexity for code to be refactored by other tickets
- broad excepts are acceptable sometimes

Signed-off-by: Miroslav Los <miroslav.los@pantheon.tech>
Change-Id: If4c3a1b85e8609f074e1de8ce91fc9c4fedbeb38

37a94513 14-Aug-2019 Peter Mikus <pmikus@cisco.com>

Move: WRK installation into ansible

- Remove ability to install from framework.
- Control via ansible with other dependencies.

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I5fd0ca18b4f76c30b6c28b4dcd15e538e01cb315

be39339d 14-Aug-2019 Peter Mikus <pmikus@cisco.com>

FIX: Container VPP pid detection

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I47163aa9ee0114f13ab17badde773560243ce319

74bdfde7 13-Aug-2019 Vratko Polak <vrpolak@cisco.com>

Revert "Disable CRC checking at runtime"

Needed to verify CSIT expects the correct CRCs.

This reverts commit d541b2b7d99651b53bd21ff75cd5fdacf8472a98.
This reverts commit 2dd27f5a638b5231c0f074ca61e6b67fed9d1faf.

+ Some pylint related improvements since then.
+ Less and better documented caching to class fields.
+ Global kill switch in Constants.

Change-Id: Id459800744cd93c578eab9c2e84cb9528235b064
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

8f41f1d0 07-Aug-2019 Peter Mikus <pmikus@cisco.com>

FIX: Vhost teardown

If test failed before vnf_manager is created then teardown
does fail as well due to missing variable.

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I0b23648bce78738cf4c377979d7a06fb488d990d

ee01931e 13-Aug-2019 Vratko Polak <vrpolak@cisco.com>

Add show memory to show_vpp_statistics

https://lists.fd.io/g/csit-dev/message/2867

Change-Id: I8934218f2ccac9a458cec37e71e403db7d49281c
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

9e1bb284 13-Aug-2019 Tibor Frank <tifrank@cisco.com>

PAL: Get DPDK Version

- Needed for trending

Change-Id: I3d576e39d6e3b91821050fbd4a8a95380275797b
Signed-off-by: Tibor Frank <tifrank@cisco.com>

d7c29749 12-Aug-2019 Peter Mikus <pmikus@cisco.com>

FIX: Vhost tests in latest VPP nightly

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I26ec27b00e5cd48143a2389f2ff41ed876a7a013

5dea7e63 13-Aug-2019 Tibor Frank <tifrank@cisco.com>

Add testbed info to output_info.xml

- Needed for trending

Change-Id: I59fc115ce62d1ad839e7c8a39c74af0497b9012d
Signed-off-by: Tibor Frank <tifrank@cisco.com>

9c75b7bf 09-Aug-2019 Peter Mikus <pmikus@cisco.com>

Clean: Various libraries

- Remove translate TC as they have no perf opposite
- Remove unused keywords
- Merge similar keywords / rename
- Move keywords from perf library to categories

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I6433006136e2497ad8fb17193aa20c578d836999

3e664d4a 07-Aug-2019 Jan Gelety <jgelety@cisco.com>

FIX: if MAC address must be updated after AVF interface creation

Change-Id: I9fc26a7d1bf8d9eed620173a73febe3d874a1351
Signed-off-by: Jan Gelety <jgelety@cisco.com>

4929e57e 12-Aug-2019 Peter Mikus <pmikus@cisco.com>

FIX: Remove unwanted Jenkins dependency

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I7a43c3183dc276fa5e4806f31a52cf5844792d4d

42fdef70 09-Aug-2019 Peter Mikus <pmikus@cisco.com>

Clean: L2 bridge domain

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I3721900b91a9c8e9db8766bdcb9771b6bcf95bca

6f1ff57c 08-Aug-2019 Vratko Polak <vrpolak@cisco.com>

Skip bad testbeds in reservation

Previously, ssh-inaccesible testbeds
were handled the same way as reserved,
never ending the wait loop.

With this, if no testbed is accessible,
the job fails early.

Change-Id: I01bc79094fe0232a47d795e53e3daa52e8742bac
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

5b28bc8c 07-Aug-2019 Jan Gelety <jgelety@cisco.com>

FIX: macip_acl_rule needs binary mac data

Change-Id: I0d26b2b31f0ce7497c91b4ae965f9cc45a66ef0c
Signed-off-by: Jan Gelety <jgelety@cisco.com>

a4c6a63b 08-Aug-2019 Vratko Polak <vrpolak@cisco.com>

Bump VPP stable version: socksvr

VPP changed the default socket path in:
https://gerrit.fd.io/r/c/vpp/+/21100

Instead of "default", explicit value is used now.
It coincides with VPP default one,
and is stored in Constants.py (except documentation).

The file name for robot side forwarded socket remains,
as the path leading to is is different anyway.

Change-Id: I0058d16794a3cd04411640c2c8d5fd4ee8cb997d
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

181e882d 08-Aug-2019 Peter Mikus <pmikus@cisco.com>

Clean: L2_xconnect keywords

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Ic15a15c426db04defc15840883a772a0eb8e4885

016fb598 08-Aug-2019 Peter Mikus <pmikus@cisco.com>

Clean: L2_patch

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Ib3620689acb3641b2ec9a49e2ce552bab3f00eef

484cb0bd 08-Aug-2019 Peter Mikus <pmikus@cisco.com>

Clean: Interface Keywords

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Ideddcea56120cf770aec78ca24813baf7d05ba11

a9711472 07-Aug-2019 Vratko Polak <vrpolak@cisco.com>

Fix: Deep-copy arguments in papi executors

Without this, it is not safe to re-use the original argument dicts
with additional edits for subsequent commands.

Change-Id: Ib4f67d09e6bf7438dfdf7669263957a42c8d4dbe
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

6dc4c630 08-Aug-2019 Peter Mikus <pmikus@cisco.com>

Remove: Obsolete bash code

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Ide17a2e2ae7e1311f00093c14f6c4879406e5868

c502f713 08-Aug-2019 Peter Mikus <pmikus@cisco.com>

FIX: Various typos in nf_density + missing KW

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I73878542672ab2dcfa1db046fbca4b7d931e744c

b8dcaf61 07-Aug-2019 Peter Mikus <pmikus@cisco.com>

Clean: IPv6 keywords

+ Move all base ipv6 related KW to library
+ Remove useless KW to save space in output.xml
+ Remove cross dependency in ip6.robot

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I8c5f72e9852c1017356ab6034c4d271cf7b53265

402633a2 07-Aug-2019 Peter Mikus <pmikus@cisco.com>

Clean: IPv4 keywords

+ Move all base ipv4 related KW to library
+ Remove useless KW to save space in output.xml
+ Remove cross dependency in ip4.robot

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: If1e3a6370d36caf4ce7411fb956a0b7d0f939b6b

6c6b9edc 07-Aug-2019 Peter Mikus <pmikus@cisco.com>

FIX: Pylint

- my bad

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I8c1f57f6b648b99338f3f6a6ff9ec943082e9bc4

c8ea6f1f 06-Aug-2019 Jan Gelety <jgelety@cisco.com>

FIX: IPsecUtil - create IP object separately in ever iteration

- if we are trying to update ip field of already existing IP object
in more iterations of e.g. ip_route_add_del the PapiExecutor uses
value from last iteration for all iterations so it ends up in
creation of ip route only for one IP not for all required IPs

Change-Id: I5ffa622e2a06d0c5c71720d2cf743a4c2104ab79
Signed-off-by: Jan Gelety <jgelety@cisco.com>

fc1ad1d8 06-Aug-2019 Jan Gelety <jgelety@cisco.com>

FIX: Remove PAPI_MAX_API_BULK

- it's not needed anymore as PapiSocketExecutor is used

Change-Id: Ia9fad1d18991821d14e9261d27f7f26fca03c14a
Signed-off-by: Jan Gelety <jgelety@cisco.com>

fb2fb651 12-Jul-2019 Jan Gelety <jgelety@cisco.com>

CSIT-1473: Migrate Tap library from VAT to PAPI

Change-Id: Ibf4a4839c2e8b799b03eebd9dffae891d8f00dd4
Signed-off-by: Jan Gelety <jgelety@cisco.com>

97e93cd2 29-Jul-2019 Peter Mikus <pmikus@cisco.com>

Add: Dot1Q + L2BD + GBP

Change-Id: I0050f715011ecfa92b3ee88b301809a56abb7946
Signed-off-by: Peter Mikus <pmikus@cisco.com>

11aa6d6c 06-Aug-2019 juraj.linkes <juraj.linkes@pantheon.tech>

Change show hardware detail to show hardware verbose

After https://gerrit.fd.io/r/#/c/vpp/+/21071/, show hardware verbose
doesn't output slowly processed module info which is not needed for
debugging purposes.

Change-Id: I2f91a0ce1bfc082b46f2fe43df968750bcd1cf3a
Signed-off-by: juraj.linkes <juraj.linkes@pantheon.tech>

7d7259ab 25-Jul-2019 Peter Mikus <pmikus@cisco.com>

VPPD: Dot1Q

Change-Id: I0d3c925ea4a6896a0df98db6ddaf4238e6291bf1
Signed-off-by: Peter Mikus <pmikus@cisco.com>

fb3aba8b 24-Jul-2019 Vratko Polak <vrpolak@cisco.com>

PapiHistory: Use repr strings for argument values

Composite arguments frequently do not have valid __str__ method
so the values were not visible.

Change-Id: If302934cb227f212580bb2f5c277a755ace51bcf
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

916de0c1 05-Aug-2019 Peter Mikus <pmikus@cisco.com>

FIX: Layer dot1q logic

Bug found by vrpolak

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Ibf61f14a838d0b49220ab8079a2d999f860a18e7

38bbf1ef 01-Aug-2019 Vratko Polak <vrpolak@cisco.com>

Fix CRCs, bump stable VPP version

+ Migrate the data to a separate yaml file.
+ Improve some argument names.
+ Unify handling of unicode (to always utf-8 encode to str).

Change-Id: Id0622b24202be796c1cd33ad52c3b8dca81cff50
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

d541b2b7 02-Aug-2019 Peter Mikus <pmikus@cisco.com>

FIX: Disable API checker during runtime

Change-Id: Id530710aaedc30472d8bcd33d24b7fbcaa7c011b
Signed-off-by: Peter Mikus <pmikus@cisco.com>

2dd27f5a 31-Jul-2019 Vratko Polak <vrpolak@cisco.com>

Disable CRC checking at runtime

Temporarily, will be re-enabled once VPP and CSIT are in sync again.

Change-Id: I0d3bb5b70ea04155972093102a26a81f86119c37
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

e8e655c1 19-Jul-2019 Peter Mikus <pmikus@cisco.com>

TOX: Coverage check

Change-Id: Ib4585729f7b84bbcf1db62db801a6b2f24337803
Signed-off-by: Peter Mikus <pmikus@cisco.com>

17983da5 31-Jul-2019 Peter Mikus <pmikus@cisco.com>

Add: Prerequisites checker

Change-Id: Ida54722ee5c73a0b3e0a8e22692795daf5bb09f3
Signed-off-by: Peter Mikus <pmikus@cisco.com>

29726f92 30-Jul-2019 Vratko Polak <vrpolak@cisco.com>

Add VPP API CRC checking

+ Include both checking at runtime and standalone static quick check.
+ Runtime checking does not look for missing messages,
as messages belonging to disabled plugins are not visible.
+ Standalone check script has nice loud output.

Change-Id: I1dfc3846d1bcdad0b09017d4ce8edd5028e17e0c
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

d78e6a68 29-Jul-2019 Vratko Polak <vrpolak@cisco.com>

Fix logic error in AVF compatibility check

Change-Id: I7f1b47725648c8c26e21f42c305395ad620beea6
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

b5ee1c01 26-Jul-2019 Peter Mikus <pmikus@cisco.com>

Remove obsolete L2 KW

Change-Id: I9a8aa6f5ccf95d632f4e677c8bf14f50b982d930
Signed-off-by: Peter Mikus <pmikus@cisco.com>

0e853acb 28-Jul-2019 Yulong Pei <yulong.pei@intel.com>

make sudo to preserve user existing environment variables

Change-Id: I83470b059b9ca59bb3725f1ebef6718adf8f91ae
Signed-off-by: Yulong Pei <yulong.pei@intel.com>

f7f3d8bc 26-Jul-2019 Peter Mikus <pmikus@cisco.com>

Change: Move few KW

Change-Id: I8c8ae1d7eed8cf28fc63ce42b2dc36dd16a5c0da
Signed-off-by: Peter Mikus <pmikus@cisco.com>

ceb9df53 26-Jul-2019 Peter Mikus <pmikus@cisco.com>

Add: AVF into trace group

Change-Id: I3399d5fb2754eb67734e8f76a5743283fe9c074c
Signed-off-by: Peter Mikus <pmikus@cisco.com>

a426e41f 26-Jul-2019 Peter Mikus <pmikus@cisco.com>

Change: AVF can run also on i40evf

Change-Id: I375b7c9f8fe81428cb16fea35128bddec089da1b
Signed-off-by: Peter Mikus <pmikus@cisco.com>

dd6ca76e 25-Jul-2019 Peter Mikus <pmikus@cisco.com>

FIX: IPsec Util

Because:

>>> for i in xrange(4):
... if i > 0 and i % 250 / 3 == 0:
... i
...
1
2

Change-Id: Ia4eba227ea1e4c6222f32ac598f254428d95adc9
Signed-off-by: Peter Mikus <pmikus@cisco.com>

7ac38855 25-Jul-2019 Peter Mikus <pmikus@cisco.com>

VPPD: VXLAN

Change-Id: Iac518341e6a0fff4a31ad3692ccc5697690db8be
Signed-off-by: Peter Mikus <pmikus@cisco.com>

882c4df8 19-Jul-2019 Andrej Marcinek <andrej.marcinek@pantheon.tech>

VAT-to-PAPI: LISPSetup

Removed CRUD parts from tests

Change-Id: Iaca36e62be5144ea3f2831457113959b65489db8
Signed-off-by: Andrej Marcinek <andrej.marcinek@pantheon.tech>

c58cba70 13-Jun-2019 Peter Mikus <pmikus@cisco.com>

NF_density dot1qip4udpvxlan

+ NF_density compatible
+ Baseline VM tests compatible
+ Scalability NxM
- 3n variant is missing in VXLAN and DOT1Q due to requests to have it
asymmetrical - TODO

Change-Id: Ia817d7be00622b594b451bc07756240d1a379e04
Signed-off-by: Peter Mikus <pmikus@cisco.com>

3cd17847 23-Jul-2019 juraj.linkes <juraj.linkes@pantheon.tech>

Fix arm sut docker image name

Change-Id: I548b176baeec39362b9c0a4e02a664d1e95574a3
Signed-off-by: juraj.linkes <juraj.linkes@pantheon.tech>

80d851c9 23-Jul-2019 Dave Wallace <dwallacelf@gmail.com>

vppdevice: fix install-dep failure when component install is required

Change-Id: Ibc4379ef25c1bf536da68eb6d0b035993e907c7a
Signed-off-by: Dave Wallace <dwallacelf@gmail.com>

141d5420 09-Jul-2019 Peter Mikus <pmikus@cisco.com>

Add scale ipsec tunnel tests 40K, 60K

Change-Id: Iecfd7e69a72c8d5893a703fa93439cde0a3edf5f
Signed-off-by: Peter Mikus <pmikus@cisco.com>

01d9a0df 23-Jul-2019 Peter Mikus <pmikus@cisco.com>

FIX: Vhost optimization

- Testpmd 9000B
- Disable fsck
- Remove redundant init mounts

Change-Id: Ia063520d0a206e9eee831a5cc692e32baf5a92c8
Signed-off-by: Peter Mikus <pmikus@cisco.com>

674dc2fb 23-Jul-2019 Vratko Polak <vrpolak@cisco.com>

Update documentation of select_arch_os

Change-Id: I619a18918b0710a59a3b36283aa79da06d640fae
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

c788beae 18-Jul-2019 juraj.linkes <juraj.linkes@pantheon.tech>

3n-tsh timeout, testbed tags and ansible update

* disable AVF tests which don't work with x520
* increase VPPApiClient timeout to 14s, as x520 show hardware is slower
on Taishan
* re-enable vhost and memif tests
* remove tx2 mrr daily tag list; no tx2 is used for perf testing
* remove taishan workaround
* add scipy arm prerequisites and scipy workaround
* rework inventories/lf_inventory/hosts; move cpu_microarchitecture to
host files

Change-Id: I5f10bd07b8146ac3b8be8c54fbb4d924a9373813
Signed-off-by: juraj.linkes <juraj.linkes@pantheon.tech>

c79c7480 17-Jul-2019 juraj.linkes <juraj.linkes@pantheon.tech>

Add support for aarch64 container images

Change-Id: I84f13d7139a6e5f7004426018c2d27425c5fa97e
Signed-off-by: juraj.linkes <juraj.linkes@pantheon.tech>

13bc34ab 12-Jul-2019 Jan Gelety <jgelety@cisco.com>

CSIT-1471: Migrate Dhcp library from VAT to PAPI

Change-Id: Ibc9b9b736532cce31994537e632daa4d4e62459c
Signed-off-by: Jan Gelety <jgelety@cisco.com>

385f2246 19-Jul-2019 Peter Mikus <pmikus@cisco.com>

FIX: naming convention fixes for TOX

Change-Id: I0644fbd0e136dee3a91fd9406155f971b3c726eb
Signed-off-by: Peter Mikus <pmikus@cisco.com>

fa6ce30b 04-Jul-2019 premkumarv <preym17@gmail.com>

VAT API to PAPI CONVERSION

Change-Id: I9c87cdfb99780f398da5cd90351b303caa89bda9
Signed-off-by: premkumarv <preym17@gmail.com>

44a12d1a 12-Jul-2019 Peter Mikus <pmikus@cisco.com>

TOX: Naming conventions

Change-Id: I038d90fc481e5f74085d0fe6165b12769d98e8a1
Signed-off-by: Peter Mikus <pmikus@cisco.com>

857bd695 11-Jul-2019 Jan Gelety <jgelety@cisco.com>

CSIT-1469: Migrate SRv6 library from VAT to PAPI

Change-Id: Ibbec3d1bbda2af9fcab3230fd1747406a89f0cc5
Signed-off-by: Jan Gelety <jgelety@cisco.com>

87c41b8d 12-Jul-2019 Jan Gelety <jgelety@cisco.com>

Remove un-interested VIRL tests and related resources

Change-Id: I712f5dc238fdf480c7c35250148c12d03ed96d74
Signed-off-by: Jan Gelety <jgelety@cisco.com>

8312908c 19-Jul-2019 Peter Mikus <pmikus@cisco.com>

FIX: COP ipv6 missing FIB

- From unknown reason VAT was more tolerant

Change-Id: Ia740843c67604a18de40d14cc448138b9f079b41
Signed-off-by: Peter Mikus <pmikus@cisco.com>

bf33e6ad 19-Jul-2019 juraj.linkes <juraj.linkes@pantheon.tech>

Add support for default_nic in mrr tag lists

Change-Id: I1fdc6f3019af6d46b985164c573d44b0e440febd
Signed-off-by: juraj.linkes <juraj.linkes@pantheon.tech>

0041c421 18-Jul-2019 Vratko Polak <vrpolak@cisco.com>

Papi socket: except more errors to insert err_msg

Change-Id: Ided91ee2b47dafb6aad83091126294d79f67aeac
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

63a426bf 01-Jul-2019 Andrej Marcinek <andrej.marcinek@pantheon.tech>

VAT-to-PAPI: LISPUtil

Change-Id: I57328dbc33eaf62935a1a14e23f57ebab21c24f5
Signed-off-by: Andrej Marcinek <andrej.marcinek@pantheon.tech>

14630855 17-Jul-2019 Peter Mikus <pmikus@cisco.com>

Remove obsolete DPDK bonding

- Code not used

Change-Id: I312635f8038c6d4d4db21d93e43df6b3636feb34
Signed-off-by: Peter Mikus <pmikus@cisco.com>

4cb1e342 17-Jul-2019 Peter Mikus <pmikus@cisco.com>

Revert "Avoid ci-management archiving files twice"

This reverts commit ccfe499e2a27f2caf234ecbb2ec948120810eab6.

Change-Id: I076bdaf255f6fa5cc6b0f25926850d62f450fd94
Signed-off-by: Peter Mikus <pmikus@cisco.com>

a1fc500f 14-Jun-2019 Jan Gelety <jgelety@cisco.com>

CSIT-1469: Migrate IPsecUtil library from VAT to PAPI

Change-Id: Iac790bf5755a70697e4c4eff32242b04f8e7f789
Signed-off-by: Jan Gelety <jgelety@cisco.com>

f88a3d91 16-Jul-2019 Vratko Polak <vrpolak@cisco.com>

Use PapiSocketProvider for most PAPI calls

Ticket: CSIT-1541
Ticket: VPP-1722
Ticket: CSIT-1546

+ Increase timeout to hide x520 slownes of show hardware detail.
- Install sshpass and update ssh client in virl bootstrap.
+ Added TODOs to remove when CSIT-1546 is fixed.
+ Enable default socksvr on any startup conf.
+ Improve OptionString init and repr.
- The non-socket executor still kept for stats.
+ Remove everything unrelated to stats from non-socket executor.
- Remove some debug-loooking calls to avoid failures.
TODO: Introduce proper parsing to the affected keywords.
+ Reduce logging from PAPI code to level INFO.
- Needs https://gerrit.fd.io/r/20660 to fully work.
+ Change default values for LocalExecution.run()
+ Return code check enabled by default.
Code is more readable when rc!=0 is allowed explicitly,
and the test code will now detect unexpected failures.
+ Logging disabled by default.
Output XML is large already. Important logging can be enabled explicitly.
+ Restore alphabetical order in common.sh functions.

Change-Id: I05882cb6b620ad14638f7404b5ad38c7a5de9e6c
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

248d1a52 10-Jul-2019 juraj.linkes <juraj.linkes@pantheon.tech>

Refactor VPP Device VM vhost tests

* replace the current VM image with kernel img
* rework keyword usage to make it consistent with performance tests
* remove resources/libraries/robot/shared/qemu.robot as it's not used
anywhere anymore

Change-Id: Ia5bc19e9e6ed9af031e4d9b5c0c89431fb49fd33
Signed-off-by: juraj.linkes <juraj.linkes@pantheon.tech>

5287b530 15-Jul-2019 Peter Mikus <pmikus@cisco.com>

FIX: Move per-patch building mechanics

- Use make pkg-verify

Change-Id: Id0f95c9261f1a1b5fa017b0823f87aeb5d6bb6d1
Signed-off-by: Peter Mikus <pmikus@cisco.com>

1f272317 11-Jul-2019 Peter Mikus <pmikus@cisco.com>

VPPD: Cop, iACL, Policer

- Alignment with PERF

Change-Id: Id7b2cb91c88e44cf9265c3376330f6aa579abf7a
Signed-off-by: Peter Mikus <pmikus@cisco.com>

33fb3466 08-Jul-2019 Vratko Polak <vrpolak@cisco.com>

PapiExecutor always verifies

Do not support returning unverified replies anymore.
Basically, ".get_replies().verify_replies()" is now just ".get_replies()".
This allows fairly large simplifications both at call sites
and in PapiExecutor.py

+ Rename get_dumps to get_details.
+ Introduce get_reply and get_sw_if_index.
+ Rename variables holding get_*() value,
+ e.g. get_stats() value is stored to variable named "stats".
+ Rename "item" of subsequent loop to hint the type instead.
+ Rename "details" function argument to "verbose".
+ Process reply details in place, instead of building new list.
- Except hybrid blocks which can return both list or single item.
- Except human readable text building blocks.
+ Rename most similar names to sw_if_index.
- Except "vpp_sw_index" and some function names.
+ Use single run_cli_cmd from PapiExecutor.
+ Do not chain methods over multiple lines.
+ Small space gain is not worth readability loss.
+ Include minor code and docstrings improvement.
+ Add some TODOs.

Change-Id: Ib2110a3d2101a74d5837baab3a58dc46aafc6ce3
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

ccfe499e 02-Jul-2019 Vratko Polak <vrpolak@cisco.com>

Avoid ci-management archiving files twice

https://gerrit.fd.io/r/20119
has changed the way archival works,
everything should now go to logs.fd.io
(instead of appearing on run page in jenkins.fd.io).

The glob pattern for archiving is quite eager,
doing recursive search. That is good, as it can find
also misplaced useful outputs.
But it also means our usage of copy_archives function
creates two copies of archived directories,
usually archives/ and archives/archive/.

This change simply removes copy_archives,
relying on the new recursive search.

A solution with changing ARCHIVE_DIR and moving if needed
would be better, but looking at amout of jobs
and various func bootstraps, it is not worth the effort.

Change-Id: Iad2bc09455944307e59eecafa64d1db6dc8befe8
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

2228ac2b 02-Jul-2019 Yulong Pei <yulong.pei@intel.com>

Add per arch mrr daily test for denverton platform

Change-Id: Ica7d6bf0dbdfde3de70eabd131c79cadd8af3a16
Signed-off-by: Yulong Pei <yulong.pei@intel.com>

46efda9b 31-Jan-2019 juraj.linkes <juraj.linkes@pantheon.tech>

CSIT-1477: add 1n_tx2 VPP Device

- add 1n_tx2 testbed
- update VF reservation to meet 1n_tx2 testbed needs
- update ansible with 1n_tx2

Change-Id: Ia075a913d4859f537fd0e6bff731ea88aff01dd9
Signed-off-by: juraj.linkes <juraj.linkes@pantheon.tech>

d2a7114d 09-Jul-2019 Peter Mikus <pmikus@cisco.com>

Aligning FUNC/PERF keywords - Data driven

Change-Id: I233c8908c724556db09c60de6efa9237068fb4c3
Signed-off-by: Peter Mikus <pmikus@cisco.com>

7b0e8a9d 10-Jul-2019 Vratko Polak <vrpolak@cisco.com>

Fix few pylint violations

+ Stop attempting to check test/ as module inits are not there.

Change-Id: Ia4e498061be3e3118b07e98c9c2f761f2454653e
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

82094363 10-Jul-2019 Vratko Polak <vrpolak@cisco.com>

Tolerate failures when setting MTU

Because some NICs are known to not allow jumbo frames.

Change-Id: I45fe636e3a880c6640922468c170f50e85dd2ba2
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

c0b3bda5 08-Jul-2019 Jan Gelety <jgelety@cisco.com>

FIX: use correct slicing of classify mask/match string

Change-Id: I11cc8ddc6925b44a596aa03d71318efd76232d6d
Signed-off-by: Jan Gelety <jgelety@cisco.com>

36d56bdb 10-Jul-2019 Vratko Polak <vrpolak@cisco.com>

Bash functions style cleanup

+ Update rst documentation for bash style
+ Command substitution:
+ Clarify when to use backticks.
+ Recommend avoiding nested command substitution.
+ Do not recommend putting command substitution results into quotes.
+ Function definition content:
+ Move "set -exuo pipefail" after comment only blocks.
+ Other set flags allowed for functions with good reasons.
+ Apply the new recommendations.
- Blank lines unified in code but no written recommendation in rst.
+ Add missing references to functions called, variables read or set.
+ Add TODOs to where lists would be long.
+ Minor improvements to function descriptions.
+ Make "if" expressions more python-like.
+ Add missing "|| die" (or "|| true") where spotted.
+ Downgrade DEFAULT_NIC to a local variable.
+ Add TODO to list reasons for blacklisted tags.

Change-Id: I05dce030a8c2cb1b3a242d8b977e8fe150d8ee20
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

d5a0c731 19-Jun-2019 Peter Mikus <pmikus@cisco.com>

Add scale ipsec tunnel tests 20K

Change-Id: Ib52e1735b6b82ea9fea44c06c379f117068e94c1
Signed-off-by: Peter Mikus <pmikus@cisco.com>

533fcfe3 25-Jun-2019 Peter Mikus <pmikus@cisco.com>

CSIT-1539 Aligning FUNC/PERF keywords - Phase III

Change-Id: Ibd3e99390bf004173d3d126946b95ffe9ba8f196
Signed-off-by: Peter Mikus <pmikus@cisco.com>

dbe149c8 18-Jun-2019 Jan Gelety <jgelety@cisco.com>

FIX: VXLAN scale tests

Change-Id: I9287d5ed6d7876b98add3fb3d523e9764094843b
Signed-off-by: Jan Gelety <jgelety@cisco.com>

33ea3179 18-Jun-2019 Jan Gelety <jgelety@cisco.com>

FIX: ip scale needs sw_if_index in VAT command

Change-Id: Icb3e22a84af10b98edf83084991b8f2607c95798
Signed-off-by: Jan Gelety <jgelety@cisco.com>

08e7b875 05-Jul-2019 Peter Mikus <pmikus@cisco.com>

Remove pkt_trace as global variable

- Use explicit parameters

Change-Id: I21cbc8cf13ec5e455b20c685c4427a53a655f71f
Signed-off-by: Peter Mikus <pmikus@cisco.com>

fc4570ee 05-Jul-2019 Peter Mikus <pmikus@cisco.com>

Add Additional Setup action for scapy

Change-Id: I82f70d7c80b921da03553f6c1351a9a2f786ff0e
Signed-off-by: Peter Mikus <pmikus@cisco.com>

758d50dd 17-Jun-2019 Jan Gelety <jgelety@cisco.com>

FIX: use len parameter name in prefix structure in ip_route_add_del

+ new vpp stabel build with fixed ipv6 address incrementation

Change-Id: Id3f4104a48e45b6fd70ccbd47ad9e3c6925220fd
Signed-off-by: Jan Gelety <jgelety@cisco.com>

1bea44db 01-Jul-2019 Vratko Polak <vrpolak@cisco.com>

Replace license checker with global notices

Caring about per-file notices is too distracting.

Change-Id: I3f07a9fd1d3a4350135dd3d14f4944647af39a0b
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

c3f33398 16-Jun-2019 Jan Gelety <jgelety@cisco.com>

FIX: re-introduce VAT for IP scale tests

Change-Id: I864118ee67628ea81f2f89dab5890df8fe15c4bc
Signed-off-by: Jan Gelety <jgelety@cisco.com>

83070f6f 24-Jun-2019 Vratko Polak <vrpolak@cisco.com>

Add copyright checker to tox

+ Only looks at files edited since HEAD~.
+ Only checks files of whitelisted extensions.
+ Distinguishes missing and outdated copyrights.
+ Any line with "Copyright" substring can work.
+ Many copyright lines are tolerated, if at least one has correct year.
+ Voting.

Change-Id: I2cda0459cb191eeec7aada69c508973568039d87
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

25e203b6 28-Jun-2019 Tibor Frank <tifrank@cisco.com>

PAPI-to-VAT: MACSwap

- not used, not needed, deleted

Change-Id: I9b4c78b7ba3fbac3805d06a65f2799ed212770b3
Signed-off-by: Tibor Frank <tifrank@cisco.com>

10e0393f 14-Jun-2019 Tibor Frank <tifrank@cisco.com>

VAT-to-PAPI: Classify

Change-Id: Ic06a0a65429680e6ecdc3f5288d091c2c2630921
Signed-off-by: Tibor Frank <tifrank@cisco.com>

a8b330a2 25-Jun-2019 Tibor Frank <tifrank@cisco.com>

VAT-to-PAPI: IPFIX and SPAN

Change-Id: I34bdc17d6350e5a441dabd9154620627780f4c12
Signed-off-by: Tibor Frank <tifrank@cisco.com>

a5df75f5 26-Jun-2019 Tibor Frank <tifrank@cisco.com>

VAT-to-PAPI: Trace

Change-Id: Id0b6943eec7e8a15cb2db5c89f93a38f21d686c7
Signed-off-by: Tibor Frank <tifrank@cisco.com>

56c1c013 20-Jun-2019 Jan Gelety <jgelety@cisco.com>

FIX: IPUtil after vpp api changes

+ do not log all ip_route_add_del api calls to PAPI history
in case of scale tests

+ fix for SRv6 proxy tests

+ support of more complex structures in api calls/replies
in PapiExecutor

+ update of vpp stable build to version 19.08-rc0~487-gb98dbb1

Change-Id: I9972e126b68ce1cb57f781e3d90ea9b3914de69e
Signed-off-by: Jan Gelety <jgelety@cisco.com>

75584265 26-Jun-2019 Peter Mikus <pmikus@cisco.com>

Introduce EXPECTED_FAILING

Change-Id: I6c578e9126778c584ccb57a4a2c76d96dea8fb35
Signed-off-by: Peter Mikus <pmikus@cisco.com>

1577123a 21-Jun-2019 Peter Mikus <pmikus@cisco.com>

Align suite/test teardown/setup

+ Phase II - aligning FUNC/PERF setup.
+ 2n/3n compatibility of suite setup.
+ Same structure of testcase for DEV/PERF.
+ DEVICE tests are now running VPP startup config in same
way as PERF.
+ DEVICE is using COREKEEPER!
- DEVICE tests are running topology compute twice for backward
compatibility. TODO to remove.
- Still phase III needed to align TAGS, LIBRARIES and remove OLD
setup phase.

Change-Id: Ib6e1b0ebf4abebf3cbe73b4fda5cac953c2a7270
Signed-off-by: Peter Mikus <pmikus@cisco.com>

cac8f76c 24-Jun-2019 Vratko Polak <vrpolak@cisco.com>

Store "tag" and "url" in files in reservation dir

String "Unknown" is used if test run tag or url is not supplied,
so this change should be backward compatible.

+ Used "runtag", as both "test" and "tag" start with taken "-t".
+ Fixed some pylint violations.
+ Docstring explaining the steps taken and reasoning behind two files.
+ Other minor improvements.

Change-Id: If704d02e51374087fe39ad0f69432477d1b310d3
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

06531331 21-Jun-2019 Vratko Polak <vrpolak@cisco.com>

Allow 9000b tests for AVF

See https://gerrit.fd.io/r/20148

Change-Id: I22856b14e3608348f2ccecb1d99d87209db2d776
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

6871d4e7 18-Jun-2019 Peter Mikus <pmikus@cisco.com>

Align suite/test teardown/setup

+ Phase I - aligning FUNC/PERF

Change-Id: I46b1e43687ddb29f5ed3c6335fe1baf21ec02822
Signed-off-by: Peter Mikus <pmikus@cisco.com>

cd635521 13-Jun-2019 Vratko Polak <vrpolak@cisco.com>

SetupFramework: log thread error to console

Because logger.error from a non-main thread is lost.

+ Increase verbosity of virtualenv exception.
+ Introduce LocalExecution.py library.
+ Include multiple other style improvements.
+ Add some ssh.py improvements:
+ Accept also commands of OptionString type.
+ Introduce a limited form of raise_from for exception chaining.
+ Add include_reason argument to exec_cmd_no_error.

Change-Id: I0cd92bcdaa1a5c4cc20cb99067593fc3b40d2c31
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

bf1ea240 19-Jun-2019 Yulong Pei <yulong.pei@intel.com>

Add 2n-dnv and 3n-dnv configuration to bootstrap-verify-perf.sh

Change-Id: I90427de5b611e432e5e46ab8758a31e376215914
Signed-off-by: Yulong Pei <yulong.pei@intel.com>

34b3be9d 19-Jun-2019 Tibor Frank <tifrank@cisco.com>

Add continue/fail option for enable traces

Change-Id: I675f9664391c9f18f312773812f765f345983cc1
Signed-off-by: Tibor Frank <tifrank@cisco.com>

3c863def 02-Jun-2019 Tibor Frank <tifrank@cisco.com>

VAT-to-PAPI: VPPCounters

Change-Id: I5954fdd61ead9b4143f8cc4e20294cf8e199e0af
Signed-off-by: Tibor Frank <tifrank@cisco.com>

287ef8c6 11-Jun-2019 Tibor Frank <tifrank@cisco.com>

VAT-to-PAPI: NATUtil

Change-Id: Id64bbf899e78c7c55410a8ce608393c22fa596ab
Signed-off-by: Tibor Frank <tifrank@cisco.com>

0e28406b 30-May-2019 Jan Gelety <jgelety@cisco.com>

CSIT-1459: Migrate IP libraries from VAT to PAPI

Change-Id: Id84cf9c3afd53260b5bbf658a6a3870aa0c91333
Signed-off-by: Jan Gelety <jgelety@cisco.com>

92fbe3b8 09-Jun-2019 Tibor Frank <tifrank@cisco.com>

VAT-to-PAPI: VPPUtils

Change-Id: If4eb592e2718c4564f1f7929ca6ff91c02f074a6
Signed-off-by: Tibor Frank <tifrank@cisco.com>

2732350f 07-Jun-2019 Peter Mikus <pmikus@cisco.com>

Add scale ipsec tunnel tests

- 5K
- 10K

Change-Id: Iaa2c77d07c3686e09fe327c663d7d7fc42024034
Signed-off-by: Peter Mikus <pmikus@cisco.com>

7c175329 18-Jun-2019 Vratko Polak <vrpolak@cisco.com>

Fix exit from reservation loop

Break from the while loop is on both success and no testbeds.

Change-Id: Iea368034927965c7f99f5502240bd768e3f62eec
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

0b704d1f 18-Jun-2019 Vratko Polak <vrpolak@cisco.com>

Continue reservation when cleanup fails

+ Only on not-failed-yet testbeds.
+ If any, else give up.

Change-Id: I3209507d3d57a77ef6afad3184ca25e098910311
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

72ae46cd 10-Jun-2019 Tibor Frank <tifrank@cisco.com>

PAPI: Reduce the amount of logged information

Change-Id: I5cfd19a9ecca6891232d92d232a159422c0a835e
Signed-off-by: Tibor Frank <tifrank@cisco.com>

4e8fb0f0 13-Jun-2019 Vratko Polak <vrpolak@cisco.com>

Add more tests to daily jobs

+ Add baseline tests for all NICs, only min size.
+ Add scale tests for x710 NIC, only min size and without 4c.

New test counts:
csit-vpp-perf-mrr-daily-master-2n-skx: 96
csit-vpp-perf-mrr-daily-master-3n-skx: 211
csit-vpp-perf-mrr-daily-master: 223

Change-Id: I14c0699dd8277b6e59cdfa3e41585f50ec75dd29
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

8f062925 14-Jun-2019 Peter Mikus <pmikus@cisco.com>

FIX: IPsec TNL mode func

Change-Id: I4fdcf48d8c60d728b0fe1b44baf0d2042185dd42
Signed-off-by: Peter Mikus <pmikus@cisco.com>

6b743ce4 14-Jun-2019 Vratko Polak <vrpolak@cisco.com>

Add hsw drivers to topology and check against AVF

Change-Id: Ifcc1dcdb3a0b4a7c62e4a41e5b3d016b276e93be
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

15bef10b 11-Jun-2019 Vratko Polak <vrpolak@cisco.com>

Add comments for some tag exclusions

Change-Id: I9daa70e433a2942d29c4e64856cb76d31f94a6f3
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

7d9ab80c 14-Jun-2019 Peter Mikus <pmikus@cisco.com>

FIX: IPsec TNL mode

Change-Id: Ide82ae5fa03d3fec8f4db9db7634be0a1e339cd1
Signed-off-by: Peter Mikus <pmikus@cisco.com>

acac11db 14-Jun-2019 Peter Mikus <pmikus@cisco.com>

FIX: IPsec INT mode

Change-Id: I286490280b6e62f9f212831a5bf1d14db1838fa7
Signed-off-by: Peter Mikus <pmikus@cisco.com>

12a51f96 14-Jun-2019 Tibor Frank <tifrank@cisco.com>

PAPI: Fix PyLint errors

Change-Id: Ieaafbb111f4c3aea9b577c2ab31ca5162400ac46
Signed-off-by: Tibor Frank <tifrank@cisco.com>

d5e7718b 09-Jun-2019 Peter Mikus <pmikus@cisco.com>

vpp_device: TAP

Change-Id: Ife31921daaa5a87f64e61d2eebb98bfdded1dc76
Signed-off-by: Peter Mikus <pmikus@cisco.com>

f49a6734 07-Jun-2019 Peter Mikus <pmikus@cisco.com>

vpp_device: IPsec

- Remove VM ipsec tests as they are not interesting
- Remove duplicate (vpp_device/virl) VM tests
- Remove VM tunnel tests and use base tunnel (we do not need tunnel and VM)

Change-Id: I5d7b6d8a037878f81a6bdc0114af481b32141dde
Signed-off-by: Peter Mikus <pmikus@cisco.com>

e74411c3 09-Jun-2019 Peter Mikus <pmikus@cisco.com>

FIX: Disable AVF on 3n-hsw

Change-Id: Id7c81a92dd50db365c219529a687fa37fd05ceb3
Signed-off-by: Peter Mikus <pmikus@cisco.com>

233eeb3e 06-Jun-2019 Peter Mikus <pmikus@cisco.com>

CSIT-1521 Convert NestedVM testcase into KernelVM

Change-Id: Ic493253dc29dad4fc7e6541e4b839ca5898a6a40
Signed-off-by: Peter Mikus <pmikus@cisco.com>

80e06fae 05-Jun-2019 Vratko Polak <vrpolak@cisco.com>

Simplify mrr daily tag expression

The number of tests executed is intentionally smaller,
as recently the runtime has gone up too much.

New numbers:
csit-vpp-perf-mrr-daily-master: 120
csit-vpp-perf-mrr-daily-master-2n-skx: 72
csit-vpp-perf-mrr-daily-master-3n-skx: 126

More details included as diff files.

+ Less per-testbed exceptions.
- Single/double links tags still set at two places.

Change-Id: I1149d3e52edf38c7d9d3e0160c533e35ae944d0d
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

e5c9717d 05-Jun-2019 Peter Mikus <pmikus@cisco.com>

FIX: OS detection

Change-Id: I3ba6c7dc6a72e376419990ce7f5acc8d373f246f
Signed-off-by: Peter Mikus <pmikus@cisco.com>

ea6e8be8 18-May-2019 Thomas F Herbert <therbert@redhat.com>

CSIT changes to support new Centos 7 device testing container image.

CSIT-1505

Parse {os} parameter from job and use it to separate the correct
image for each distro and the correct stable package versions.
Use two vpp device image names, one for Ubuntu and one for Centos.

Centos sut image is in https://hub.docker.com/r/snergster/csit-sut-centos
Source for Centos sut image:
https://github.com/snergfdio/multivppcache/tree/master/csit-sut-centos

Change-Id: I568c82710d730c4ed0ca25bc12cb6074e1cbe27e
Signed-off-by: Thomas F Herbert <therbert@redhat.com>

494c42cf 05-Jun-2019 Peter Mikus <pmikus@cisco.com>

Remove intrusive useless logging

Change-Id: Ib633266daaf67f257867f5ba0b2836f777ecd3bf
Signed-off-by: Peter Mikus <pmikus@cisco.com>

fad4332b 24-May-2019 Peter Mikus <pmikus@cisco.com>

Even more Crypto combinations

Change-Id: I10eeb4ee30a57712824e68176d92d1ecb5f0d1b0
Signed-off-by: Peter Mikus <pmikus@cisco.com>

ff78ad6f 16-May-2019 Tibor Frank <tifrank@cisco.com>

VAT-to-PAPI: memif

Change-Id: I9e3f1a2a2a1c11a355cd66c940beb663ecc7d7a4
Signed-off-by: Tibor Frank <tifrank@cisco.com>

a6f5c70e 04-Jun-2019 Michal Cmarada <mcmarada@cisco.com>

fix Honeycomb failing tests

- due to VAT to PAPI migration some tests
need to be updated
- fixed HC tests: ACL, Interfaces/SubInterfaces, Tap
Vhost, Vxlan, Vxlan-gpe

Change-Id: I9adad041a619b48057bdda388becd53dde484483
Signed-off-by: Michal Cmarada <mcmarada@cisco.com>

13c45925 03-Jun-2019 Tibor Frank <tifrank@cisco.com>

VAT-to-PAPI: ContainerUtils

Change-Id: Id186c3c280a6b876b8212e01b261ad8c65e5f40c
Signed-off-by: Tibor Frank <tifrank@cisco.com>

91237b65 30-May-2019 Tibor Frank <tifrank@cisco.com>

VAT-to-PAPI: VhostUser

Change-Id: I235d4654b04275877b3c5f4cf49ef5755c3f4985
Signed-off-by: Tibor Frank <tifrank@cisco.com>

15688783 30-May-2019 Jan Gelety <jgelety@cisco.com>

Add possibility to use other then default NIC per VPP patch

Change-Id: I25e51022e0ec961fce444bc8f0f4413d0e95d7eb
Signed-off-by: Jan Gelety <jgelety@cisco.com>

459f6b00 31-May-2019 Peter Mikus <pmikus@cisco.com>

Add meltdown spectre to calibration set

+ Fix the version of MMD tool to always latest

Change-Id: Iafd7f40d618b8e4995b5cc12fe06056719f58517
Signed-off-by: Peter Mikus <pmikus@cisco.com>

fe1975eb 18-Mar-2019 Jan Gelety <jgelety@cisco.com>

CSIT-1468: InterfaceUtil migration from VAT to PAPI

Change-Id: I0062710d58996be767a852dc00545fedd60a5c72
Signed-off-by: Jan Gelety <jgelety@cisco.com>

245ea1de 29-May-2019 juraj.linkes <juraj.linkes@pantheon.tech>

Fix args order in setup_node call

Change-Id: I484cda8c8410e2f38d68da82761b1154dda26b1c
Signed-off-by: juraj.linkes <juraj.linkes@pantheon.tech>

cf64b952 24-May-2019 juraj.linkes <juraj.linkes@pantheon.tech>

Use threads for fw setup and cleanup

Using multiprocessing sometimes causes scp to hang when copying files.
Threading is also more lightweight.

Change-Id: I047b4835bbf1584c80469b27af5394d89087e8a9
Signed-off-by: juraj.linkes <juraj.linkes@pantheon.tech>

5cbb3f16 27-May-2019 Michal Cmarada <mcmarada@cisco.com>

HC2VPP-411: migrate interfaces-state to interfaces

- new ietf-interfaces makes interfaces-state obsolete
- updates honeycomb tests to latest ietf-interfaces model

Change-Id: I5502a5ab23661429caca9498407d7121d423a1a3
Signed-off-by: Michal Cmarada <mcmarada@cisco.com>

1fea09e6 23-May-2019 Jan Gelety <jgelety@cisco.com>

FIX: do not generate 9000B perf test in case of vic1385 nic

Change-Id: I7b8e30903a8bc012a3bb43bfb33755e08b56dc1d
Signed-off-by: Jan Gelety <jgelety@cisco.com>

f90655a9 05-Feb-2019 Tibor Frank <tifrank@cisco.com>

CSIT-1425 Upgrade TRex to v2.54

Change-Id: I71010c18210e88828ded0bc679997d76f34886cb
Signed-off-by: Peter Mikus <pmikus@cisco.com>

2ada04e2 17-May-2019 Peter Mikus <pmikus@cisco.com>

CSIT-1506: Rework IPsec base testcases

- Add:
aes-128-gcm aes-128-gcm
aes-256-gcm aes-256-gcm
aes-128-cbc hmac-sha-256
aes-256-cbc hmac-sha-512

- Remove:
hmac-sha1

- Scale will follow in next patch

Change-Id: I789f71cf66cf61b8dbb3c6dbe9b6fdc79866ac33
Signed-off-by: Peter Mikus <pmikus@cisco.com>

922365bc 21-May-2019 Vratko Polak <vrpolak@cisco.com>

Exclude IPSECHW tests on NICs other than xl710

The next version of suite generator will avoid generating them,
for now we just exclude by a tag expression.

Change-Id: I68c80c412ea327c11366f539b10de19df50152c2
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

ac259ea2 14-May-2019 Vratko Polak <vrpolak@cisco.com>

Avoid !r format appending u on unicode

Change-Id: I2c0877f4d8b6cad2694c43a4350998cd2b830680
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

0903fff5 16-May-2019 Peter Mikus <pmikus@cisco.com>

FIX: IPsec selection backend.

Change-Id: Ie4acaecf60e03fc4e843e29d8222fbf2f00bbf44
Signed-off-by: Peter Mikus <pmikus@cisco.com>

3fc13949 14-May-2019 Peter Mikus <pmikus@cisco.com>

Make topology files read dynamically from directory

Change-Id: Id43c7c299d2e112b6caf00a3d340e6051ab337b6
Signed-off-by: Peter Mikus <pmikus@cisco.com>

ce2586f9 15-May-2019 Vratko Polak <vrpolak@cisco.com>

Avoid double link tests for nic_intel-xxv710

Change-Id: Id9beeed270b91a35108adef594f50105198225d6
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

9fdc4201 11-May-2019 Jan Gelety <jgelety@cisco.com>

Update of VPP_STABLE_VER files + quick fix for gre create tunnel

- use new vpp ref build - ubuntu 16.04:
19.08-rc0~212-gf6c7aec~b7060

- use new vpp ref build - ubuntu 18.04:
19.08-rc0~212-gf6c7aec95

- use new vpp ref build - centos7:
19.08-rc0~212_gf6c7aec~b6916

Change-Id: Ifd042fae1a46b07a5f463309f2b9cceb8054412f
Signed-off-by: Jan Gelety <jgelety@cisco.com>

783f364f 15-May-2019 Peter Mikus <pmikus@cisco.com>

FIX: Honeycomb restart sequence

Change-Id: I31acda10c4bd8de6f0094e697ef1219e77c5fbb1
Signed-off-by: Peter Mikus <pmikus@cisco.com>

1469b71f 14-May-2019 Peter Mikus <pmikus@cisco.com>

FIX: Remove old restart sequence - Honeycomb

Change-Id: I12865ea4f48c1902e80e67463fff4cf481a2e24c
Signed-off-by: Peter Mikus <pmikus@cisco.com>

752a4c33 02-Jan-2019 Vratko Polak <vrpolak@cisco.com>

PLRsearch: Use stat trackers to shorten Integrator

+ Extract several tracker classes and use them in Integrator.
+ Apply next_rate workarounds to focus more on critical region.
+ Rewrite stretch function, as the previous implementation was wrong.
+ Rework logging:
++ Use injected trace() function in Integrator.
++ Inject function that skips trace logging on default initialization.
++ Use the same multiprocessing-safe passing, but separate queue.
+ Set duration to 120m in Robot, but keep at 30m in Python.
+ Apply minor changes to make computations more reproducible:
++ Attempt to log everything needed by reproducibility in one line.
++ Log samples used, and make it settable as upper limit.
++ Use repr output in TRex scripts, to avoid rounding when copypasting.
+- Numpy seems to be sharing PRNG between processes.
+-- An edit to disable one thread is needed for full reproducibility.
+-- Such an edit is prepared, but will not be merged anytime soon.

Change-Id: Icf56429b34ab6de2d18a12e6c676e2d242b3ba4c
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

c1f66bb3 10-May-2019 Peter Mikus <pmikus@cisco.com>

FIX: Missing show run data in NDRPDR

Change-Id: If4b013ef4bf4bc8f857913f3847ab3b2e2aa5a5d
Signed-off-by: Peter Mikus <pmikus@cisco.com>

2e250ffd 06-May-2019 Peter Mikus <pmikus@cisco.com>

Remove old VPP Restart sequence

Change-Id: I7f71a9709ad55ce03d73e23cc8a9f5064947ed51
Signed-off-by: Peter Mikus <pmikus@cisco.com>

1ac36a9f 08-May-2019 Peter Mikus <pmikus@cisco.com>

Add new higher density NF tests

Change-Id: Ib2f3f3f8dc3e202dc1db53c739d9309be2ed8a60
Signed-off-by: Peter Mikus <pmikus@cisco.com>

226758f5 05-May-2019 Vratko Polak <vrpolak@cisco.com>

Fix typos in DUTsetup.py

Change-Id: I7fb255c26bfb62a273844b3753aa37b742835045
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

e001fdea 24-Apr-2019 Peter Mikus <pmikus@cisco.com>

CSIT-1493 VPP restart handling code

Change-Id: Ibe52125089f39e0ff17ec607a3ed00c61d52ab8c
Signed-off-by: Peter Mikus <pmikus@cisco.com>

780b65d8 19-Apr-2019 Peter Mikus <pmikus@cisco.com>

NF density tests with dtc=0.5 and dtcr=2

Change-Id: Icff556142280ad0b6261e0a2bfb71672ee6b3807
Signed-off-by: Peter Mikus <pmikus@cisco.com>

0cbb8a2f 26-Apr-2019 Peter Mikus <pmikus@cisco.com>

FIX: Change buffers per numa base on SMT

Change-Id: I4955210e2c723d4b91d8829ac42e47937d17833f
Signed-off-by: Peter Mikus <pmikus@cisco.com>

94fc0517 24-Apr-2019 Peter Mikus <pmikus@cisco.com>

FIX: Crypto tests

- By adding crypto_ipsecmb.so into the list of loaded plugins

Change-Id: I52de9b410441422ad8e337208f40360fbdea264d
Signed-off-by: Peter Mikus <pmikus@cisco.com>

0b0b14fb 08-Apr-2019 Peter Mikus <pmikus@cisco.com>

FIX: Large number of interfaces and worker threads

Add buffers-per-numa (previously num-mbuf)

Change-Id: Iad0863668a65b1595630d49a047d591659c7bba5
Signed-off-by: Peter Mikus <pmikus@cisco.com>

91f2cb2b 24-Apr-2019 Vratko Polak <vrpolak@cisco.com>

Move generate_tests earlier in entry scripts

The idea is to run test generation and archivation
before testbed reservation, as during generation and archivation
the testbed can be used by another job.
The two steps are moved just before (physical or docker) reservation,
as they currently take considerable time,
so simpler steps are kept before to save time if they fail.
Coincidentally, it is also just after activate_virtualenv,
Python is needed for test generation.

Change-Id: I8b41b91dba8118e89301e3fcf89d5cd14ac054a2
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

58e426f4 13-Apr-2019 Jan Gelety <jgelety@cisco.com>

FIX: Create TAP interface after API change

Change-Id: Ib39671dcb808142037c2950b8b02b9aa64d72a3b
Signed-off-by: Jan Gelety <jgelety@cisco.com>
(cherry picked from commit 48b40a6789050e8f40405663cc0e437df26fc56a)

2d3bc6f8 18-Apr-2019 Peter Mikus <pmikus@cisco.com>

FIX: eth_peer parameter after introducing OptionParams

Change-Id: Ief72af680a6252faf749b06b5289b8033af99b2d
Signed-off-by: Peter Mikus <pmikus@cisco.com>

1fa2af77 18-Apr-2019 Vratko Polak <vrpolak@cisco.com>

OptionString: Do not convert None to non-empty string

Change-Id: I2947394a478bde3fe048aef99fd7b5a394764ae2
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

661035ac 10-Apr-2019 Vratko Polak <vrpolak@cisco.com>

Increase reliability of per patch perf job

CSIT-1485

- Measurement results are inconsistent, creating false positives.
- To avoid false positives, sensitivity has to be lowered.
+ Measurements are no more interleaved.
+ Measurement result are no longer filtered.
+ The job now runs faster.
- Ip6base regressions smaller than 4% are tolerated.
+ Ip6base false positives can happen, but less than 10% of the time.
- Part of job parameters is set on ci-management level.
+ Voter script output is improved.

Change-Id: I0ec7d5df8b397daf7ff0277a1137ee9f36d8d866
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

258f2666 16-Apr-2019 Vratko Polak <vrpolak@cisco.com>

Clean up traffic_profile vs osi_layer

The two types were not well distinguished before.

Error introduced in:
https://gerrit.fd.io/r/#/c/17811/84/resources/libraries/robot/performance/performance_setup.robot@255

Error hotfixed in:
https://gerrit.fd.io/r/#/c/18847/4/resources/libraries/robot/shared/default.robot@109

+ Rename some arguments and improve method docstrings.

Newly introduced argument name osi_layer should be dissimilar enough.

Change-Id: Ie0f6f97dc010fc6477f09c54574970f1d15462e2
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

c481185c 15-Apr-2019 Vratko Polak <vrpolak@cisco.com>

Introduce OptionString for handling command line

+ Convert DpdkUtil to use it.
++ Rename args to kwargs where needed.
++ Fix errors in docstrings.
+ Also convert and QemuUtils to use it.
++ Minor formatting edits to save space.
+ Add disconnect parameter to some ssh.py functions.
++ ssh.SSH.disconnect() tries to work without argument.
+ Exec functions in ssh.py accept OptionString commands.

Change-Id: I82da71c568d120c283544c90242993fc76e9e83a
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

f3b78e65 16-Apr-2019 Michal Cmarada <mcmarada@cisco.com>

Remove unused parameter in HoneycombSetup


Change-Id: Ief75fcdc2c3ab77b708d1c7e7aecf312ea852898
Signed-off-by: Michal Cmarada <mcmarada@cisco.com>

8bac3376 12-Apr-2019 Peter Mikus <pmikus@cisco.com>

Add 2n AVF tests

- Side effect of other troubleshooting, but better to
merge then throw away.

Change-Id: Idc1a0ca66b35b61c1ffd11242cd7b7133ae4cbd7
Signed-off-by: Peter Mikus <pmikus@cisco.com>

c4e29c78 13-Apr-2019 Jan Gelety <jgelety@cisco.com>

Use package location for apt-cache show command

Change-Id: I141baa77c78ec467a56fcafb86061efe198dca9d
Signed-off-by: Jan Gelety <jgelety@cisco.com>

0e0cf38f 13-Apr-2019 Peter Mikus <pmikus@cisco.com>

Remove obsolete QEMU installation

+Unify QEMU parameter to Contants.

Change-Id: I95adfc97dd7008c19e60ba3fa8668818b503bee8
Signed-off-by: Peter Mikus <pmikus@cisco.com>

cc0c2870 11-Apr-2019 Peter Mikus <pmikus@cisco.com>

Add output.xml with only INFO logging leve

- Useful for post-processing.

Change-Id: I6f71087f8c6f6d66fd86207d5df9abd10e94f855
Signed-off-by: Peter Mikus <pmikus@cisco.com>

5899ac74 12-Apr-2019 Vratko Polak <vrpolak@cisco.com>

Fix pylint error in PapiExecutor

+ Remove ret_val as it cannot be nonzero outside _execute_papi.
+ Change indentation to save vertical space.
+ Return computed values without storing them to variable.
+ Add TODO to remove duplicated method.
+ Add missing fields to docstring.
+ Minor formatting changes.

Change-Id: I8e8f41d139de8aff3b76a7fe27ee450e89e8d1de
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

96a3c5c7 08-Apr-2019 Peter Mikus <pmikus@cisco.com>

Convert existing nf_density testpmd-mac into KernelVM

Change-Id: I9ec1701d9012de59cc42cc5f9a4744f01695ff9a
Signed-off-by: Peter Mikus <pmikus@cisco.com>

5ce709e1 11-Apr-2019 Vratko Polak <vrpolak@cisco.com>

Add notes for traffic_type argument

To make this gerrit comment permanently visible in code:
https://gerrit.fd.io/r/#/c/17811/50/resources/libraries/python/InterfaceUtil.py@1335

Change-Id: I2b763d88fcc8186c9479a0f0c3336d8eeb8aed95
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

d0dd5b06 09-Apr-2019 Michal Cmarada <mcmarada@cisco.com>

fix auth for newer ODL versions

Since oxygen we need to add also "-p karaf" argument when
starting karaf and because we are not using older versions
anymore we can remove the if condition and use new authentication
by default.

Change-Id: I458fa35b7f26222dd5562349e6859844bfb7d05f
Signed-off-by: Michal Cmarada <mcmarada@cisco.com>

374ea2f4 06-Feb-2019 Ludovit Mikula <ludovit.mikula@pantheon.tech>

Add vagrant setup for testing VPP device locally
Fixed trailing whitespaces
Fixed tabs vs. spaces
Removed dead code
Changed network interface naming
Changed default number of retries for VPP startup to 120
Updated number of hugepages during provisioning
Externalized CSIT related sysctl settings to 90-csit.conf
Removed hardcoded local docker image name.
Added new interface required for honeycomb device testing.

Change-Id: I5eb38c8b1a4d96e4220dbd2e202e94f1d47e804e
Signed-off-by: Ludovit Mikula <ludovit.mikula@pantheon.tech>

40f43968 09-Apr-2019 Michal Cmarada <mcmarada@cisco.com>

update tests after ODL bump to Neon


Change-Id: Ia733ad304c51b28f2a945e570120821254077189
Signed-off-by: Michal Cmarada <mcmarada@cisco.com>

aa25184f 07-Apr-2019 Michal Cmarada <mcmarada@cisco.com>

Fix l2 Honeycomb tests

Change-Id: Ic75a9279fffe3a5d11211f4e57fc635d7d33ee5f
Signed-off-by: Michal Cmarada <mcmarada@cisco.com>

5e6145a4 04-Apr-2019 Vratko Polak <vrpolak@cisco.com>

Upgrade autogen to NICs and search types

+ All perf suites updated, as autogen change is backward incompatible.
+ Only x710 -ndrpdr suites remain in git repository.
+ Removed retry feature of run_tests.
+ Renamed topology_type and traffic_type to traffic_profile.
+ Renamed framesize to frame_size; nic_model to nic_name.
+ Reordered Variables table to start with nic_name and overhead.
+ Fixed wrong overhead value in some cbc-sha1 suites.
+ Fixed some suite tags.
++ Introduced tags to distinguish suites, such as IPSECINT.
+ Bound crypto hardware to NIC name.
+ Implemented NIC limit hiding.
+ Also search and teardown related arguments are now hidden.
+ Main measurement keywords updated to new arg handling.
+ Max rate related keywords moved to performance_limits.robot
+ Teardowns unified.
+ Generated tests are archived.
++ Generated directory is .gitignore-d.
+ Regenerator raises an exception on seeing non-compatible suite.
++ Relatively helpful message should be seen in exception.
+ Suite and template Documentation has generated parts.
+- With short NIC names only.
+ Autogen checker also upgraded.
+ Tag expressions replaced with long files to ensure analogous tests.

Change-Id: I60e9a999187e7da1f60d0eb4fb02afa14682aa46
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

a2738c39 03-Apr-2019 Jan Gelety <jgelety@cisco.com>

Remove obsolete FDS tests

Change-Id: Ie161f7003cb33596ac7856783b332a75b5dbc14e
Signed-off-by: Jan Gelety <jgelety@cisco.com>

dab2c1f6 07-Apr-2019 Peter Mikus <pmikus@cisco.com>

FIX: Qemu set affinity bug

Change-Id: If1df58628b2150b1ea3f2f56b1e3d442176b0750
Signed-off-by: Peter Mikus <pmikus@cisco.com>

85eaed55 05-Apr-2019 Peter Mikus <pmikus@cisco.com>

FIX: Operational issues

- FIX MSR package installation
- FIX VTS
- FIX sockets by removing from TCs

Change-Id: I043c60f9e3e9c39cbeaee5e09b7a8351965efd35
Signed-off-by: Peter Mikus <pmikus@cisco.com>

6e96fee1 07-Mar-2019 juraj.linkes <juraj.linkes@pantheon.tech>

Fixes for Taishan testbed

* rename NICs in Taishan testbed to Intel-X520-DA2
* fix testbed NIC selection
* remove unnecessary 82599es tests
* blacklist unsupported tests on Taishan testbed
* lowercase previously created bash local variables

Change-Id: I3b7f59e2edc00929fab2f5a0fce483f236f83075
Signed-off-by: juraj.linkes <juraj.linkes@pantheon.tech>

81853d46 06-Mar-2019 Jan Gelety <jgelety@cisco.com>

CSIT-1337: Migrate L2Util library from VAT to PAPI

Change-Id: I22879c7bdd100d00216b9528663bf17406169826
Signed-off-by: Jan Gelety <jgelety@cisco.com>

a6451398 26-Mar-2019 Jan Gelety <jgelety@cisco.com>

FIX: change socket location for vhost-user interface

Change-Id: Icce908d274f9fcd92e7eaa731da094b63fd3ee0e
Signed-off-by: Jan Gelety <jgelety@cisco.com>

af05b72e 21-Mar-2019 Yulong Pei <yulong.pei@intel.com>

Add ipsec crypto test for Denverton platform

add ipsec cryto test to support Denverton hardware crypto device C3xxx.
replace HW_cryptodev keyword to HW_DH895xcc or HW_C3xxx, or add more other
hardware crypto device type support in the future.

Change-Id: I181bca4095757fde7ca45ab3856273ac5930d902
Signed-off-by: Yulong Pei <yulong.pei@intel.com>

67f247b4 28-Mar-2019 Michal Cmarada <mcmarada@cisco.com>

Fix Tap failing tests

Due to migration to Tap-v2 the old Tap API was removed.
This fixes failing tests where Tap interface was used.


Change-Id: I2f90177d2d8ee914e3ddcd3e10f212f9d72b9ac2
Signed-off-by: Michal Cmarada <mcmarada@cisco.com>

2dc5924d 20-Mar-2019 Tibor Frank <tifrank@cisco.com>

CSIT-1460: Add VPP-stats to PAPI Provider

Change-Id: I2665700a4948c481585d66c987f94af748f102c3
Signed-off-by: Tibor Frank <tifrank@cisco.com>

c8b5a892 20-Mar-2019 Peter Mikus <pmikus@cisco.com>

Convert functional tests to statefull QemuUtils

Change-Id: Ia1b9120c45733db64dc2dc8b03cff5ef5f167548
Signed-off-by: Peter Mikus <pmikus@cisco.com>

33bd6f24 09-Mar-2019 Peter Mikus <pmikus@cisco.com>

CSIT-1386 KernelVM - Part II

- Implementation of KernelVM (ThinVM)
- nf_density tests for KernelVM with VPP as VNF.

Change-Id: Ife5c2e1ab419c55cbcd442792f940db3a41da471
Signed-off-by: Peter Mikus <pmikus@cisco.com>

6f082130 20-Mar-2019 Vratko Polak <vrpolak@cisco.com>

Add tox checker for lengths of new lines only

- Still non-voting, but useful.

Change-Id: Idd6f345f0f14fdbc237ff66f5e010801ea08dc5b
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

22417d56 08-Mar-2019 Peter Mikus <pmikus@cisco.com>

CSIT-1386 KernelVM - Part I

- Refactor QemuUtils

Full refactor of QemuUtils to prepare for thinner VMs.

Change-Id: I171ba11a9e6e9faec582bd58df6819598b0ed0b5
Signed-off-by: Peter Mikus <pmikus@cisco.com>

6aaecf9f 14-Mar-2019 Tibor Frank <tifrank@cisco.com>

PAPI Executor: Add more desciptive error message

- Add more desciptive error message to the processing of replies.

Change-Id: Ie43651370d5754aedf2515438c02ff4aa21bdc46
Signed-off-by: Tibor Frank <tifrank@cisco.com>

c353d540 07-Mar-2019 Tibor Frank <tifrank@cisco.com>

PAPI: Add verification of the response

Change-Id: I86afcaeae865f0af076b8dd974386a83de07bf44
Signed-off-by: Tibor Frank <tifrank@cisco.com>

81e10cc1 12-Mar-2019 Tibor Frank <tifrank@cisco.com>

PAPI: Use Python3 for PapiProvider

Change-Id: I39e237db5cba8311ae11fd709b10a17297f3a729
Signed-off-by: Tibor Frank <tifrank@cisco.com>

3bca9d88 06-Mar-2019 Peter Mikus <pmikus@cisco.com>

Convert clear [run|interfaces] command to PAPI

Change-Id: I9aa9eed74a75c132f9e34ce50e9895db59f855c7
Signed-off-by: Peter Mikus <pmikus@cisco.com>

2e1697f3 07-Mar-2019 Jan Gelety <jgelety@cisco.com>

FIX: Do not set sriov_numvfs of QAT card to 0 in case of SW crypto tests

- when sriov_numvfs of QAT card is set to 0 for SW crypto tests and then
back to 32 for subsequent HW crypto the dpdk backend is not running

Change-Id: I9bc6b2549823e3318c31bda55a976199266e3535
Signed-off-by: Jan Gelety <jgelety@cisco.com>

1999c2ec 07-Mar-2019 Vratko Polak <vrpolak@cisco.com>

Simplify show_papi_history

Change-Id: Id86f8630ff37e958d90011f421aeb8a75b3e4783
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

0c45de2a 07-Mar-2019 Vratko Polak <vrpolak@cisco.com>

Fix PYTHONPATH in activate_environment

This affects jobs which install the virtual environment
to a directory other than ${CSIT_DIR}.

Change-Id: I1546043112f7504feb0452883b2ff57530dd2c9d
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

86af0b9a 07-Mar-2019 Tibor Frank <tifrank@cisco.com>

Papi: Rename methods argument

The argument name 'csit_papi_command' must be unique enough as it cannot
be repeated in kwargs.
- PapiExecutor.add(self, csit_papi_command, **kwargs)
- PapiHistory.add_to_papi_history(node, csit_papi_command, papi=True, **kwargs)

Change-Id: I243a20d6f03befb149891c37a88e0e6359ea2940
Signed-off-by: Tibor Frank <tifrank@cisco.com>

2251c68e 05-Mar-2019 Tibor Frank <tifrank@cisco.com>

CSIT-1451: PapiHistory

Change-Id: Idb51f377fe0c196fbe24aab21c294dad595adcd2
Signed-off-by: Tibor Frank <tifrank@cisco.com>

935734b0 26-Feb-2019 Vratko Polak <vrpolak@cisco.com>

CSIT-1450: PAPI executor

Change-Id: I4c756cc4b29901184594a728f6184c30cadd9c1a
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

a1e76537 06-Mar-2019 Peter Mikus <pmikus@cisco.com>

FIX: Selecting VPP packages

Change-Id: Id6e093eaf62835606cd6bf7e9157d79c8c33c83a
Signed-off-by: Peter Mikus <pmikus@cisco.com>

fe7c90f5 06-Mar-2019 Peter Mikus <pmikus@cisco.com>

FIX: Selecting VPP packages

There is an issue when multiple VPP versions of same commit
but different build is in repository. Artifacts.sh will find
multiple version and cennot properly download only one.

00:00:46.522 ++ apt-get -y download libvppinfra=19.04-rc0~290-gd4295e61a~b2173 19.04-rc0~290-gd4295e61a~b2172 19.04-rc0~290-gd4295e61a~b2171 libvppinfra-dev=19.04-rc0~290-gd4295e61a~b2173 19.04-rc0~290-gd4295e61a~b2172 19.04-rc0~290-gd4295e61a~b2171 <truncated...//pm>

This patch will select latest as the behavior is result of
re-merge effect.

Change-Id: I8ce21244e2b05e60af0ea51107f9138173844330
Signed-off-by: Peter Mikus <pmikus@cisco.com>

da799981 26-Feb-2019 Vratko Polak <vrpolak@cisco.com>

Rename to Constants.py

Motivation: Make the constants available also for Robot.
Restraint: Robotframework user guide says:
Because variable files are always imported using a file system path,
creating them as classes has some restrictions:
Python classes must have the same name as the module they are located.

Change-Id: I638ef3fe045db132e366de2e2699638b8637e45e
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

89e6be27 17-Jan-2019 Stanislav Chlebec <stanislavv.chlebec@pantheon.tech>

Add ARM Taishan testbed33 perftest

Change-Id: Iaa0e7fbca7de26c7dce8b389cc3494f628a2ecd0
Signed-off-by: Stanislav Chlebec <stanislav.chlebec@pantheon.tech>
Signed-off-by: juraj.linkes <juraj.linkes@pantheon.tech>

83e9b227 18-Feb-2019 Jan Gelety <jgelety@cisco.com>

FIX: ipsec + vpp stable version update

- use exec ipsec sa add
- use exec ipsec spd add
- use exec set ipsec sa

Change-Id: I69d59dd230b99d8efc9bcb5e3fbab79a8b11b18a
Signed-off-by: Jan Gelety <jgelety@cisco.com>

2045a26e 26-Feb-2019 Peter Mikus <pmikus@cisco.com>

CSIT-1449 Ansible: Adding calibration support

- Remove obsolete bootstrap_setup.sh.
- Add calibration support into ansible.
- Inject Ansible run with calibration to every job.

Change-Id: Ib2d6cd0c04d3bce700b205bef34c3c88edb26e28
Signed-off-by: Peter Mikus <pmikus@cisco.com>

97063f15 04-Feb-2019 Peter Mikus <pmikus@cisco.com>

CSIT-1418 Switch performance jobs to VPP-bionic build

Change-Id: Ia38e70a418570d168bf330ce1b3c91351b326181
Signed-off-by: Peter Mikus <pmikus@cisco.com>

694b4182 14-Sep-2018 Vratko Polak <vrpolak@cisco.com>

Add tox.ini and few checker scripts

The plan is to change csit-validate-pylint-master job
to fail if (and only if) tox fails.

This will allow us to easily add checks,
with or without the voting power.

Each check produces log (ignored in .gitignore)
the voting job can archive.

+ Made autogen quiet by default, to avoid spam in autogen checker.
+ Unified the way direct csit subdirectories are git-ignored.

Change-Id: I6477b1ef7da6d3e30f68c5850d04900cc52f431e
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

3a066cb1 25-Feb-2019 Vratko Polak <vrpolak@cisco.com>

De-duplicate unidirection support

- Latency is now reported in both directions.
-- For unidirection that means additional -1/-1/-1.
+ Changed function argument wrapping to save vertical space.
+ Changed trex command synthesys to save vertical space.
+ Fixed handling of command line arguments to avoid superfluous spaces.
+ More care distinguishing (0, 1) from (port_0, port_1).
- Not renaming the original port arguments.

Change-Id: I7b1736b594f6edea52eb07e5bc76ef52d0af92f8
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

b29ed928 24-Feb-2019 Jan Gelety <jgelety@cisco.com>

FIX: VPP PIDs can also be separated by spaces not only by line breaks

Change-Id: I6a5e8732be224927aa965cdf6b93998aa8699639
Signed-off-by: Jan Gelety <jgelety@cisco.com>

53153e11 20-Feb-2019 Peter Mikus <pmikus@cisco.com>

CSIT-1437 Create portable host-setup document

- Ansible simplified and optimalized
- Porting global variables into single file
- Rework the README.md
- Tested outside LF environemnt

Change-Id: I124cffa5c4510edf365e8b558da0c8c498f55d50
Signed-off-by: Peter Mikus <pmikus@cisco.com>

8577b444 20-Feb-2019 Peter Mikus <pmikus@cisco.com>

FIX: Static variables all over the place for per patch

- Incredible why is it so hard to write scripts not hardcoding
anything.

Change-Id: I48cf2cc3d25f9665a9ff7ca26756d3b70cdd2f9c
Signed-off-by: Peter Mikus <pmikus@cisco.com>

fa0fe5c8 04-Feb-2019 Peter Mikus <pmikus@cisco.com>

CSIT-1419 Convert vpp-virl job to vpp-device

Change-Id: I5af6de4b96775a72855e1644ca4d8d9b4b2f9e25
Signed-off-by: Peter Mikus <pmikus@cisco.com>

9e158c1e 18-Feb-2019 Vratko Polak <vrpolak@cisco.com>

Allow more perftest strings in get_test_tag_string

This is needed to support other TBs in perpatch job.

Change-Id: I9de70e818a32fa9990d90cb14498a26570b774a4
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

d1589ad7 18-Feb-2019 Vratko Polak <vrpolak@cisco.com>

Adapt autogen for SFd tests

+ Make the skipping logic in autogen more flexible.
+ Do not emit 4c cases when there is too much VMs/containers.
+ Peter says the second -eth- should be renamed away from suites.
+ Regenerate suites so test case names match (new) suite names.

Change-Id: I95ecc47ca07b8bae6693d5d4330811ff55672fc4
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

b0330dea 19-Feb-2019 Peter Mikus <pmikus@cisco.com>

Expose DPDK version into separate Variable file

Change-Id: If9707297a430285a242c3dae49c216d952a9be12
Signed-off-by: Peter Mikus <pmikus@cisco.com>

15e95017 15-Feb-2019 Vratko Polak <vrpolak@cisco.com>

Remove unused performance util keywords

+ Added some TODOs.
+ Get Frame Size updates:
++ Renamed to Get Average Frame Size.
++ Called by Get Max Rate And Jumbo.
++ Moved to the top.

Change-Id: I149831b630d4c0ae098f7189f2231b72c6fb7668
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

4b84a3d0 13-Feb-2019 Peter Mikus <pmikus@cisco.com>

FIX: Coredump packing combination

- Remove DIR

Change-Id: Iba1b03d407e93d4e60fb49f6b50747de87f82ac7
Signed-off-by: Peter Mikus <pmikus@cisco.com>

a6b865d9 12-Feb-2019 Peter Mikus <pmikus@cisco.com>

FIX: Apply revert routing in case interfaces are reverted

Change-Id: Iecd4606f000aa49a16a07fb02ae1b6f1c52a52d8
Signed-off-by: Peter Mikus <pmikus@cisco.com>

e028b8a8 12-Feb-2019 Peter Mikus <pmikus@cisco.com>

Bump DPDK to 19.02

Change-Id: I9ea7b5104d3124dd6ae36fd91cf056ace9f93e3d
Signed-off-by: Peter Mikus <pmikus@cisco.com>

ca7b37a1 11-Feb-2019 Vratko Polak <vrpolak@cisco.com>

Fix argument order in unidirection related KWs

The original unidirection Chhange [0] has changed the order,
breaking some call sites.

Also, use different indentation to save some vertical space.

[0] https://gerrit.fd.io/r/#/c/16696/3/resources/libraries/python/TrafficGenerator.py@551

Change-Id: Ife9bd994da73f0afcd24fc16794f822a831c4353
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

3f2e2ff6 11-Feb-2019 Peter Mikus <pmikus@cisco.com>

FIX: Comparision for RXQ

Change-Id: I8e8c72ded61a53fe0170cde39c52145ab816f31c
Signed-off-by: Peter Mikus <pmikus@cisco.com>

bdbf84e3 08-Feb-2019 Peter Mikus <pmikus@cisco.com>

FIX: Remove deprecated socket-mem param

Change-Id: I7178dacbd470c29e857b44942a62ccf7df53d0b5
Signed-off-by: Peter Mikus <pmikus@cisco.com>

390cb24b 06-Feb-2019 Peter Mikus <pmikus@cisco.com>

CSIT-845 Capture VPP core-dump from vpp crash on DUTs

Change-Id: I987dcd5092d8527c9aefbe093e1ed7ae144d191b
Signed-off-by: Peter Mikus <pmikus@cisco.com>

7348bd7b 08-Feb-2019 Peter Mikus <pmikus@cisco.com>

FIX: Memif API

Change-Id: If755c06935a525c7a312e63f32f6035f08fdb893
Signed-off-by: Peter Mikus <pmikus@cisco.com>

96146c5d 05-Feb-2019 Jan Gelety <jgelety@cisco.com>

FIX: Set ipsec backend to dpdk backend when aes-gcm cipher used

Change-Id: I008b9e0fd62cdc8e29136930762bd7412bd50181
Signed-off-by: Jan Gelety <jgelety@cisco.com>
(cherry picked from commit 2230a8ab108fa114752decfc69321ec5a47f36a6)

1c108d51 28-Jan-2019 Peter Mikus <pmikus@cisco.com>

Improve 1n-skx vpp_device mapping function

Improve mapping function for 1n-skx vpp_device to pickup
available DUT1 net_dev and replace the name with TG net_dev prefix.
This way we can eliminate situation, when pair with not equal VLANs
are picked.

Change-Id: If78329e730bfb4df34fb8d8924c8715d69a15e0c
Signed-off-by: Peter Mikus <pmikus@cisco.com>

26637ca4 01-Feb-2019 Peter Mikus <pmikus@cisco.com>

CSIT-1416 Remove installation of vpp from containers

Use parent system (Host, Container) installation of VPP. This will save
the internet bandwith by skip installing of prerequisites packages.
It will also skip dpkg install and simplify the process of initializing
VPP inside container.

Previosly initialization of VPP in container takes about 55s. With this
patch it is reduced to 2-3s.

This patch removes the bloated VOLUME creation between container
sidecars (a.k.a nested container) and fixes the hugepage allocation.


Change-Id: Ifa2be532edb77354657e1b84568bdc34993b00d0
Signed-off-by: Peter Mikus <pmikus@cisco.com>

1634e19d 30-Jan-2019 Peter Mikus <pmikus@cisco.com>

CSIT-1411 Implement manual rx-placement override for bug in VPP

Change-Id: Ie3d2b1f40a607ce5190ccfea6a372bc072d0a3b9
Signed-off-by: Peter Mikus <pmikus@cisco.com>

de778ee6 31-Jan-2019 Tibor Frank <tifrank@cisco.com>

Trending: Remove NF_DENSITY tests from trending

- also memif tests removed from graphs where they must not be.

Change-Id: I1cbb02ba2dcdcd3a286c9ac4489c946993ac4790
Signed-off-by: Tibor Frank <tifrank@cisco.com>

65908ee3 31-Jan-2019 Peter Mikus <pmikus@cisco.com>

Add TB23 back into production pool

Change-Id: I69a16b1baa5147f22b7c5742c2ccf6e030474937
Signed-off-by: Peter Mikus <pmikus@cisco.com>

c17a7406 30-Jan-2019 Peter Mikus <pmikus@cisco.com>

FIX: Hardcode nf_density RXQ count to 1

Change-Id: I7ca3b2ce4f4c9d8b452d9de63e7466482d15aa50
Signed-off-by: Peter Mikus <pmikus@cisco.com>

956989a5 28-Jan-2019 Peter Mikus <pmikus@cisco.com>

FIX: Cleanup mechanics for vpp_device

Change-Id: Ice975127f8ecdd4cead418151cf37d61dfb218a0
Signed-off-by: Peter Mikus <pmikus@cisco.com>

509a1092 30-Jan-2019 Peter Mikus <pmikus@cisco.com>

FIX: Put back sleep to wait for container to boot.

Change-Id: Id63fc8670c7816cc71d8d6d8704ff7f1adf3db65
Signed-off-by: Peter Mikus <pmikus@cisco.com>

11bd03f2 25-Jan-2019 Peter Mikus <pmikus@cisco.com>

CSIT-1409 Implement pipeline configuration for l2bd with memif/ip4.

Change-Id: I7463d47a9d65069332eb2a288ff44f4499a8a467
Signed-off-by: Peter Mikus <pmikus@cisco.com>

27a56cad 30-Nov-2018 Vratko Polak <vrpolak@cisco.com>

PLRsearch: Initial implementation and suites

Missing bits:
- Add up-to-date .rst document (in child Change).
- Prepare for releasing to PyPI.org (in child Change):
-- Either copy dependencies from MLRsearch, or list in requirements.
-- Perhaps move common dependencies to separate package
for both search to depend on.
-- All the other metadata stuff.

Jira: CSIT-1276

Change-Id: I277efdb63dbb90b30e11f4e30a82e2130ac8efc3
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

15648d7c 28-Jan-2019 Peter Mikus <pmikus@cisco.com>

FIX: CPU util for NF

- Fix detecting total allocable CPUs for NFs

Change-Id: If3345518befb887655d3e162551c49df3163ed92
Signed-off-by: Peter Mikus <pmikus@cisco.com>

75e2e7bb 16-Jan-2019 Peter Mikus <pmikus@cisco.com>

CSIT-1403 Implement multichain configuration for l2bd with memif/ip4.

Change-Id: Ia87156b2ba826eb0a9a93d756b9765c7373ca6ce
Signed-off-by: Peter Mikus <pmikus@cisco.com>

1bd729a7 28-Jan-2019 Peter Mikus <pmikus@cisco.com>

WORKAROUND: Remove static mbufs

Due to incomming changes in https://gerrit.fd.io/r/#/c/16638/
We need to temporarily disable mbuf static.

Change-Id: I629584ef7bf2a7efcacab6b3d90c0bab92aa9e5b
Signed-off-by: Peter Mikus <pmikus@cisco.com>

35ae14a1 22-Jan-2019 Peter Mikus <pmikus@cisco.com>

CSIT-1407 FIX vpp install after VPP changes

Change-Id: I9148f6de75c3100f827eedec48c4c0ccb343bc54
Signed-off-by: Peter Mikus <pmikus@cisco.com>

552491e8 23-Jan-2019 Jan Gelety <jgelety@cisco.com>

FIX: correct call of vpp_add_route

Change-Id: I63a2b5f484ac627c020e30c9f01a868c57aacf42
Signed-off-by: Jan Gelety <jgelety@cisco.com>

8bac97fb 23-Jan-2019 Tibor Frank <tifrank@cisco.com>

Fix PyLint errors

Change-Id: I5a369f4b9f9b478375fda4a634bf57cc9623e972
Signed-off-by: Tibor Frank <tifrank@cisco.com>

5a53823d 10-Jan-2019 Jan Gelety <jgelety@cisco.com>

VPP_Device - add baseline tests - part IIb)

CSIT-1372

Add following baseline tests to VPP_Device:
- ip4
eth2p-ethip4-ip4base-eth-2memif-1dcr-dev

- ip6
eth2p-ethip6-ip6base-eth-2memif-1dcr-dev

- l2bd
eth2p-eth-l2bdbasemaclrn-eth-2memif-1dcr-dev

- l2xc
eth2p-eth-l2xcbase-eth-2memif-1dcr-dev

Change-Id: Ic4a3a01b62d800c528a9c9371891dcc26b875220
Signed-off-by: Jan Gelety <jgelety@cisco.com>

88e6c1f9 14-Jan-2019 Peter Mikus <pmikus@cisco.com>

CSIT-1390 Implement multichain configuration for l2bd with vhost/l3fwd.

Change-Id: I36ab0bc7c9eada4c3f7bb5cb8f53de7d267ff910
Signed-off-by: Peter Mikus <pmikus@cisco.com>

ae7e4fc1 15-Jan-2019 Michal Cmarada <mcmarada@cisco.com>

fix failing tests after namespace updates in HC


Change-Id: Idf7cbcf285ff130f771eb3878065e6daa869ac71
Signed-off-by: Michal Cmarada <mcmarada@cisco.com>

033d9e1e 10-Jan-2019 Michal Cmarada <mcmarada@cisco.com>

CSIT-1362: migrate to package cloud for HC performance tests


Change-Id: I43f62ea97e432504eb4ece85744d7fd6ff426113
Signed-off-by: Michal Cmarada <mcmarada@cisco.com>

5f809dd2 06-Dec-2018 Jan Gelety <jgelety@cisco.com>

VPP_Device - add baseline tests - part IIa)

CSIT-1372

Add following baseline tests to VPP_Device:
- ip4
eth2p-ethip4-ip4base-eth-2vhost-1vm-dev

- ip6
eth2p-ethip6-ip6base-eth-2vhost-1vm-dev

- l2bd
eth2p-eth-l2bdbasemaclrn-eth-2vhost-1vm-dev

- l2xc
eth2p-eth-l2xcbase-eth-2vhost-1vm-dev

+ fix doc strings in all vpp_device tests

Change-Id: Icc5ed801f3e8f6dedaa611779bd86fc20102fa74
Signed-off-by: Jan Gelety <jgelety@cisco.com>

852b10b6 09-Jan-2019 Peter Mikus <pmikus@cisco.com>

CSIT-1389 Refactor current keywords for multichaining - CNF (II)

Change-Id: Ic6af8ebf59589bea66322fc87a33218c7dc0c132
Signed-off-by: Peter Mikus <pmikus@cisco.com>

11be8edf 08-Jan-2019 Michal Cmarada <mcmarada@cisco.com>

fix permissions for dut_setup.sh


Change-Id: Ia11125e889a981a762c54281375a4e78159d8c69
Signed-off-by: Michal Cmarada <mcmarada@cisco.com>

5075d208 08-Jan-2019 Peter Mikus <pmikus@cisco.com>

CSIT-1389 Refactor current keywords for multichaining - CNF

- Add ability to create matrix of containers (chains x nodeness)
- Change default Docker image to csit-dut
- Use new resource mapping function

Change-Id: Iaac0f2efc99146fbaef0b33dc71b38770610023d
Signed-off-by: Peter Mikus <pmikus@cisco.com>

6abab708 05-Jan-2019 Yulong Pei <yulong.pei@intel.com>

[V4] Add sending unidirectional traffic support for TG in CSIT

Extend TG in CSIT to support to send unidirectional traffic, and then
it can be used by unidirectional test cases e.g. Load balancer.

Change-Id: Ie25bcdf7d4525a6d88d8ecd11a1b6d98275fa4d6
Signed-off-by: Yulong Pei <yulong.pei@intel.com>

d57482c4 04-Jan-2019 Peter Mikus <pmikus@cisco.com>

CSIT-1387 Implement mapping function

Implement universal mapping function for placing the NF
threads to cpu cores/threads.

- Must be SMT aware.
- Must work with N-core NF.
- Must be DUT (vswtich) aware.
- Must be deterministic.
- Must use DTCR and MTCR parameters.

Change-Id: I98b61861f85c5af7ecd856719b4adf2ba95c262f
Signed-off-by: Peter Mikus <pmikus@cisco.com>

cebbe0a2 02-Jan-2019 Peter Mikus <pmikus@cisco.com>

CSIT-1382 Create weekly/semiweekly job for vpp-device

- Update gather function

Change-Id: If130b93fd8c9752bb804a8ecc53c1598e8669031
Signed-off-by: Peter Mikus <pmikus@cisco.com>

ff8ba5fd 09-Oct-2018 Peter Mikus <pmikus@cisco.com>

VHOST vectors.

Change-Id: I5e17c5ab5cb99af0ac3d063ffc911bf95457d3e4
Signed-off-by: Peter Mikus <pmikus@cisco.com>

08fc34b6 19-Dec-2018 Jan Gelety <jgelety@cisco.com>

FIX: Avoid duplicated KW names in perf and func tests

Change-Id: I66c68edf6e26fa7baa7bdc5f5d60d4d4aa3af6b9
Signed-off-by: Jan Gelety <jgelety@cisco.com>

213f4046 18-Dec-2018 Jan Gelety <jgelety@cisco.com>

FIX: do not use dump stats in IPv6 base tests

Change-Id: I9983b4aa1d6575f017bdfd69b6ab3b26206d9605
Signed-off-by: Jan Gelety <jgelety@cisco.com>

f5a1d81c 26-Oct-2018 sharath <sharathkumarboyanapally@gmail.com>

Adding DMM build artifacts

Change-Id: Ia5153d8e716d506c85ec8b723331438efd66ab6a
Signed-off-by: sharath <sharathkumarboyanapally@gmail.com>

4f9509d2 17-Dec-2018 Jan Gelety <jgelety@cisco.com>

FIX: Update PAPI to work with string changes in Python API

Change-Id: I3b5f0568b5928cf12aaf2a555f52dd9809348579
Signed-off-by: Jan Gelety <jgelety@cisco.com>

c59ec1c8 30-Nov-2018 Vratko Polak <vrpolak@cisco.com>

Delete old NDR/PDR keywords

Change-Id: I932d46646408a030ffdeb78b3a3e19c39455750d
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

f9041bcd 03-Dec-2018 Jan Gelety <jgelety@cisco.com>

VPP_Device - add baseline tests - part I

CSIT-1370

Add following baseline tests to VPP_Device:
- ip4
eth2p-ethip4-ip4base-dev
- ip6
eth2p-ethip6-ip6base-dev
- l2bd
eth2p-eth-l2bdbasemaclrn-dev

Change-Id: Ic20000eb38c5511c27d020f3aa76b2620d7f7ef9
Signed-off-by: Jan Gelety <jgelety@cisco.com>

a850b983 28-Nov-2018 Jan Gelety <jgelety@cisco.com>

FIX: VPP_Device - use vpp bionic packages

Because there is already used ubuntu bionic on VPP device testbed
and used download script from pacakgecloud site donwloads packages
based on host OS we need additional file to store vpp bionic stable
version for VPP_Device tests.

Change-Id: If834dc8af7dffa19b8ddeae013c3da9b37a5a81a
Signed-off-by: Jan Gelety <jgelety@cisco.com>

287406e3 25-Sep-2018 Jan Gelety <jgelety@cisco.com>

CSIT python API introduction

Jira: CSIT-1336

Change-Id: I96d2b0221c5a7466484a82339fc132c5921532d1
Signed-off-by: Jan Gelety <jgelety@cisco.com>

ada7009a 19-Nov-2018 Michal Cmarada <mcmarada@cisco.com>

Fix Acl Plugin tests after update of Acl models


Change-Id: I8c4090b508e28ae8f289e9dbbd5c72bbc3af4aca
Signed-off-by: Michal Cmarada <mcmarada@cisco.com>

7db29fd0 07-Nov-2018 Tibor Frank <tifrank@cisco.com>

Add trigger fro DPDK tests

Change-Id: I214026c5df83778e87623770225e0fbb041ccc1c
Signed-off-by: Tibor Frank <tifrank@cisco.com>

2ef9fa5b 07-Nov-2018 Peter Mikus <pmikus@cisco.com>

FIX: Ligato tests

- Freeze stable sfc_controller version
- Remove kafka connection
- Add debug level outputs
- Use mater branch instead of dev

Change-Id: Icde06a741cae6393fe482a493eb214d015f145bf
Signed-off-by: Peter Mikus <pmikus@cisco.com>

c963f611 29-Oct-2018 Jan Gelety <jgelety@cisco.com>

FIX: put base interafce up when creating VLAN sub-interface

Change-Id: I879d1a0f1e901c59c9e3fc061a8accd6f423ee0b
Signed-off-by: Jan Gelety <jgelety@cisco.com>

ca7af34a 25-Oct-2018 Jan Gelety <jgelety@cisco.com>

FIX: show ip table in tear donw only when test failed

Change-Id: Id8fd73e22984d7d0728bf7e136b6b7b91c036066
Signed-off-by: Jan Gelety <jgelety@cisco.com>

3c9040f9 15-Oct-2018 Peter Mikus <pmikus@cisco.com>

CSIT-1339 Create initial l2xc test

- L2XC ping ICMPv4/ICMPv6 test

Change-Id: I1c1708e8c1050f140a02d56012f63b683fc3eec1
Signed-off-by: Peter Mikus <pmikus@cisco.com>

da8fb7d7 09-Oct-2018 sharath <sharathkumarboyanapally@gmail.com>

Migration of DMM-CSIT scripts to DMM repo

Change-Id: Ibaa7652b24385805b5cdd1540ed98b09e68c69bc
Signed-off-by: sharath <sharathkumarboyanapally@gmail.com>

f3e74e6b 24-Oct-2018 Jan Gelety <jgelety@cisco.com>

Remove usage of vpp-ext-deps package

This package is not needed for csit enymore.

Change-Id: Ie32a9c9322873e66554bb69112d4428697c866db
Signed-off-by: Jan Gelety <jgelety@cisco.com>

15c227fd 23-Aug-2018 Peter Mikus <pmikus@cisco.com>

CSIT-1260 Create initial version of bootstrap including VF reservation

Change-Id: I153d378849ea76444915b7fc219237db1b7bca1a
Signed-off-by: Peter Mikus <pmikus@cisco.com>

d465d9fb 18-Oct-2018 Vratko Polak <vrpolak@cisco.com>

Per patch: multiple BMRR calls

This is to reduce sensitivity on testbed unstable performance.
Also add topo_cleanupbefore every pybot run
to avoid issues with VPP uninstall.

TRACE prints are left there to simplify investigation
of false positives if/when they happen.

Change-Id: I9b0cdcfbbe4aa0735a0596746ac32c9e93af0897
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

8e7582ed 18-Oct-2018 Peter Mikus <pmikus@cisco.com>

FIX: Correct the packagecloud.io URL path

Change-Id: I8aae4cb85f9bb1efaa19d75e2fd7c9593f20756d
Signed-off-by: Peter Mikus <pmikus@cisco.com>
(cherry picked from commit e44edcedef4dd2fee1c21b122b4bc6bb8586598e)

2f5317d5 08-Oct-2018 Peter Mikus <pmikus@cisco.com>

Script for PXE host staging

Introducing script for staging server via PXE and controlling
CIMC/IPMI reboot.

Change-Id: I1667e1906e7de73b7bca994d82de75e12c0d382a
Signed-off-by: Peter Mikus <pmikus@cisco.com>

f4984a65 17-Oct-2018 Peter Mikus <pmikus@cisco.com>

FIX: Switch crypto tests to vfio-pci

Instead of igb_uio

Change-Id: Iaf0fc793b35e99f62ac442686ae7047e965086d0
Signed-off-by: Peter Mikus <pmikus@cisco.com>

0490e94a 15-Oct-2018 Peter Mikus <pmikus@cisco.com>

CSIT-1338 FIX: Failed to get VPP version on host

VPP was not initialized (shm), after service restart, quickly enough.
This results into vpp_api_test console timeouts when communicating over
uninitialized socket.

Patch is introducing more stable test to detect service (VPP) is fully
ready and initialized.

Change-Id: I300a763814feba28cb8163dcd4996b53b2994fec
Signed-off-by: Peter Mikus <pmikus@cisco.com>

d53d63c0 10-Oct-2018 Peter Mikus <pmikus@cisco.com>

FIX: Vhost interface UP issue for VTS tests

Change-Id: I2983b295cc8e070f6fe2ff7a5f19fe45d17cee27
Signed-off-by: Peter Mikus <pmikus@cisco.com>

5f922d70 10-Oct-2018 Tibor Frank <tifrank@cisco.com>

CSIT-1297: Modify the bootstrap.sh to run only selected mrr suites

Change-Id: I2f5ac334e09bc35bfaefc112cf0bb7f57290a732
Signed-off-by: Tibor Frank <tifrank@cisco.com>

68a4959b 10-Oct-2018 Michal Cmarada <mcmarada@cisco.com>

Fix authorization for ODL fluorine tests


Change-Id: I2ccca8955949840305350bec1f60bc6d1cddcf82
Signed-off-by: Michal Cmarada <mcmarada@cisco.com>

12eab1e5 07-Sep-2018 Jan Gelety <jgelety@cisco.com>

Add VXLAN scale perf tests

Jira: CSIT-1273

Change-Id: Ic2a41661c158384a5aaa7d4e73f30ffca13ddf82
Signed-off-by: Jan Gelety <jgelety@cisco.com>

e23c6e55 08-Oct-2018 Peter Mikus <pmikus@cisco.com>

FIX: Vhost interface not up issue

Change-Id: Ibfd00c2eafbb11a66ef5989ef3baa735de865ded
Signed-off-by: Peter Mikus <pmikus@cisco.com>

8c581968 03-Oct-2018 Michal Cmarada <mcmarada@cisco.com>

Fix failing tests after Fluorine bump in HC (HONEYCOMB-433)

- this fixes failing tests after bumping ODL dependencies
in Honeycomb and HC2VPP projects.
- increased timeout for installing ODL feautres,
sometimes it takes longer to install them.

Change-Id: Ib3ae8106ae0c1122410e9bd7924d0b49ed6059c7
Signed-off-by: Michal Cmarada <michal.cmarada@pantheon.tech>

401464f7 27-Sep-2018 Tibor Frank <tifrank@cisco.com>

CSIT-1297: Modify the bootstrap.sh to run only selected mrr suites

Change-Id: I7071abd6c4a52a86efea573a4f9bcb54547dc004
Signed-off-by: Tibor Frank <tifrank@cisco.com>

b164d4f8 02-Oct-2018 Peter Mikus <pmikus@cisco.com>

CSIT-1294 FIX: ValueError: CTR mode needs counter parameter, not IV

The issue is caused by python-crypto library in upstream Ubuntu 1804
repo. Unless there is permanent fix there is workaround to always
download fresh version, not preinstalled.

Change-Id: Ic2318eb532a6e7a910e4ffb209556c17e6070d3d
Signed-off-by: Peter Mikus <pmikus@cisco.com>

5729b2d4 02-Oct-2018 Peter Mikus <pmikus@cisco.com>

CSIT-1326 VLIB: barrier sync elog tracing

- API changed.

Change-Id: If70e1a930aa14b129ad38ef544cff32ad5a08cdd
Signed-off-by: Peter Mikus <pmikus@cisco.com>

9db603df 01-Oct-2018 Peter Mikus <pmikus@cisco.com>

CSIT-1325 - FIX: AVF tests failing on unbind

Currently there is and issue when consecutive AVF suites are
trying to initialize AVF and bind VF to vfio-pci driver, there
seems to be race condition if VPP has already VFs allocated.

This patch should introduce safer contstrain to disable VPP prior
AVF init.

Change-Id: Id8839200f19d9e7a18d161b660cfb1e43a8ca379
Signed-off-by: Peter Mikus <pmikus@cisco.com>

424749b0 28-Sep-2018 Peter Mikus <pmikus@cisco.com>

CSIT-1326 Add barrier event traces

Change-Id: I0f734c2f11cc89716371554880f1d7404ea16090
Signed-off-by: Peter Mikus <pmikus@cisco.com>

3bd92c7d 28-Sep-2018 Peter Mikus <pmikus@cisco.com>

CSIT-1327 Migrate from vpp-dkms-dpdk to vpp-ext-deps

Change-Id: I6fad3303c5c331ad36d163ba735907e35931dea0
Signed-off-by: Peter Mikus <pmikus@cisco.com>

b261d69c 28-Sep-2018 Peter Mikus <pmikus@cisco.com>

FIX: Single memif tests failing

This patch suppose to fix the single memif TCs failing on SKX nodes.
By stoping Host VPP during startup of Guest VPP. This way Guest VPP
can take interface on single pass.o

Change-Id: I88e6932bf007ce0f6a367927de5f017ffb8fdaca
Signed-off-by: Peter Mikus <pmikus@cisco.com>

8fa4cadb 26-Sep-2018 Peter Mikus <pmikus@cisco.com>

CSIT-1321 Add IP4base tests using AVF driver

Change-Id: I960c2b4170efa06597851853cfc15bda1c60fe94
Signed-off-by: Peter Mikus <pmikus@cisco.com>

40531303 27-Sep-2018 Vratko Polak <vrpolak@cisco.com>

Exclude dot1q in the default tag array

Mainly useful to reduce test set for per patch.

Change-Id: I55a5f2d268c3105ac32d25ae317e149d3c3b4e14
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

19947738 21-Aug-2018 sharath <sharathkumarboyanapally@gmail.com>

integration of DMM+lwip testscripts

Change-Id: Ifb1a0702353e71c61a694dea5164df41f4e23389
Signed-off-by: sharath <sharathkumarboyanapally@gmail.com>

ebd0c7de 27-Sep-2018 Peter Mikus <pmikus@cisco.com>

FIX: testcode detection in perf jobs

Change-Id: I4c0c5afa8a8dff814382cb0ad6d9df0410179755
Signed-off-by: Peter Mikus <pmikus@cisco.com>

090fc8fd 12-Sep-2018 Tibor Frank <tifrank@cisco.com>

Fix jumbo frames

Change-Id: I8aa557fe75133d20eef9832e314357af71f1d19a
Signed-off-by: Tibor Frank <tifrank@cisco.com>

585bba14 25-Sep-2018 Peter Mikus <pmikus@cisco.com>

CSIT-1316 Fix ligato building mechanics in CSIT bootstraps

Change-Id: Ia8da73cbf7ab213b61a330b757419330667be24b
Signed-off-by: Peter Mikus <pmikus@cisco.com>

638391c3 25-Sep-2018 Peter Mikus <pmikus@cisco.com>

CSIT-1317 ADD: Ability to blacklist tags per topology

- Add option to override some tags per topology.

Change-Id: I4045ebbee1c5d32e29cdb6c5c84e0dcd9217b2cf
Signed-off-by: Peter Mikus <pmikus@cisco.com>

549e949c 25-Sep-2018 Peter Mikus <pmikus@cisco.com>

FIX: Add VatHistory for VATscript files.

Add ability to see Vat history for file sourced commands.

Change-Id: I49b19236bec7253ea412659368cb7ccb5f5e3274
Signed-off-by: Peter Mikus <pmikus@cisco.com>

bb0f69d1 21-Sep-2018 Vratko Polak <vrpolak@cisco.com>

Fix autogen regenerator and few suites

+ "elif" instead of "else if".
+ Some suites had test cases reordered.
+ Some suites contained 9000B cases for avf.

Change-Id: I3bf8241c317f20dbf66b497a2c8be35ef71307f5
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

0f162b40 20-Sep-2018 Peter Mikus <pmikus@cisco.com>

FIX: Do not run double link tests on 3n-hsw

Change-Id: I9dfb4bfba4d0650a42e34d0e1f97b60b031f0750
Signed-off-by: Peter Mikus <pmikus@cisco.com>

cfecb1a9 16-Sep-2018 Jan Gelety <jgelety@cisco.com>

Add dot1q-l2bdbase-2memif-[ndrpdr|mrr] perf tests for 2-node topology

Jira: CSIT-1289

Change-Id: I9e3f1f4a03e3cac9d8831f3a87e0b1bce27a109e
Signed-off-by: Jan Gelety <jgelety@cisco.com>

8bbd6d3b 14-Sep-2018 Jan Gelety <jgelety@cisco.com>

Add dot1q-l2bdbase-2vhost-[ndrpdr|mrr] perf tests for 2-node topology

Jira: CSIT-1286

Change-Id: Id51c7dbf15d846f1286e6efbc5240a2556ec9652
Signed-off-by: Jan Gelety <jgelety@cisco.com>

8de6fce0 06-Sep-2018 Peter Mikus <pmikus@cisco.com>

CSIT-1205 Create AVF driver test - Add Tests L2BD L2XC

Change-Id: Ia74a87346fe2c0a170b881b510f1b0558a538f3c
Signed-off-by: Peter Mikus <pmikus@cisco.com>

5f7c2bc0 19-Sep-2018 Peter Mikus <pmikus@cisco.com>

CSIT-1291 Improve service handling with container detection

Change-Id: Iaeac10676f46e0267041afee927bc6e3201146b2
Signed-off-by: Peter Mikus <pmikus@cisco.com>

9440d0f9 13-Sep-2018 Jan Gelety <jgelety@cisco.com>

Add dot1q-ip6base-[ndrpdr|mrr] perf tests for 2-node topology

Jira: CSIT-1283

Change-Id: I0f6841bafdb47bdbc3efe29801fe66a0d4c388ca
Signed-off-by: Jan Gelety <jgelety@cisco.com>

0c0217c3 14-Sep-2018 Jan Gelety <jgelety@cisco.com>

Add dot1q-l2[bd|xc]base-[ndrpdr|mrr] perf tests for 2-node topology

Jira: CSIT-1284

Change-Id: I8ce4ffc76adf55bf9a8423077b8639601c560c87
Signed-off-by: Jan Gelety <jgelety@cisco.com>

3e8a10ce 11-Sep-2018 Jan Gelety <jgelety@cisco.com>

Add dot1q-ip4base-[ndrpdr|mrr] perf tests for 2-node topology

Jira: CSIT-1278

Change-Id: I3cc929222d7fd58f38e33917e84675e9c0b55bbd
Signed-off-by: Jan Gelety <jgelety@cisco.com>

07eb18d2 12-Sep-2018 Peter Mikus <pmikus@cisco.com>

CSIT-1282 Migrate from Nexus.fd.io to packagecloud.io

Change-Id: Ib4e72dc8e3c0fedfcd702f4f97bc4f26cbc642e9
Signed-off-by: Peter Mikus <pmikus@cisco.com>

89ba5533 12-Sep-2018 Peter Mikus <pmikus@cisco.com>

CSIT-1280 Single memif container test failing

- FIX

Change-Id: I4b62d08b140dc73eb950d21bc85dc41ad638bbd2
Signed-off-by: Peter Mikus <pmikus@cisco.com>

32c205e9 12-Sep-2018 Vratko Polak <vrpolak@cisco.com>

Fix: L2 scale tests are not baseline

This fixes select_tags function in common.sh
to not include scale l2bd tests in default tag list.

This is needed because "L2BDBASE" tag selects also scale tests
(contrary to similar IP4BASE and IP6BASE tags).

(Line length over 80 characters is left there
as an indirect TODO to improve the tags.)

Change-Id: Ic1d4a046f327fdd1b8b08eb20f1cdb4b12f337c9
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

6d105d22 12-Sep-2018 Vratko Polak <vrpolak@cisco.com>

Fix: trap for unreserve before cleanup

Change-Id: I978a056ffdfd6daa00a0a1c587774b4a7204b434
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

62af070d 06-Sep-2018 Jan Gelety <jgelety@cisco.com>

Create l2bdscale tests for 2-node topology

Jira: CSIT-1268

Change-Id: I13bf2e570a7d7231ba19c2c41db2b44c0b8d215a
Signed-off-by: Jan Gelety <jgelety@cisco.com>

cd483d75 06-Sep-2018 Tibor Frank <tifrank@cisco.com>

CSIT-1271: Add VTS tests to MRR jobs

Change-Id: I5c0be60a1819c5c46225b4468ba9c88068231f08
Signed-off-by: Tibor Frank <tifrank@cisco.com>

08429525 05-Sep-2018 Jan Gelety <jgelety@cisco.com>

Create ip6scale tests for 2-node topology

Jira: CSIT-1176

Change-Id: I78f4e9cb24a7de0bde24a78d1ca26607598a62b2
Signed-off-by: Jan Gelety <jgelety@cisco.com>

124009e8 05-Sep-2018 Vratko Polak <vrpolak@cisco.com>

CSIT-1264: Add oper branch wrapper entry script

Change-Id: I569b089b711f89fecca8dd31d6906ef311982877
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

02dde08c 05-Sep-2018 Yulong Pei <yulong.pei@intel.com>

fix CSIT broken issue when numa_node value is -1 on single Socket platform

Single Socket platform e.g. Intel Atom cpu based SOC platform with
Ubuntu 16.04.4(kernel 4.13.0-36-generic) or Centos 7.5 (kernel 3.10.0-862.el7),
value of /sys/bus/pci/devices/<pci_device_id>/numa_node is -1, this will
break CSIT performance test running, but for this kind of SOC platform,
it can consider that is not NUMA based platform, numa_node=-1 is reasonable,
so fix it at CSIT side, when numa_node=1 and the system's NUMA node count
is 1, set numa_node=0. DPDK also did it as this way.

Change-Id: I9ac23d3cece2f1489e38f05b50a462bb2ad9f661
Signed-off-by: Yulong Pei <yulong.pei@intel.com>

f449216a 04-Sep-2018 Jan Gelety <jgelety@cisco.com>

Create ip4scale tests for 2-node topology

Jira: CSIT-1174

Change-Id: I46944a3bc0f508d80c8c944dab0190925ebe21f5
Signed-off-by: Jan Gelety <jgelety@cisco.com>

89620b26 20-Jul-2018 Peter Mikus <pmikus@cisco.com>

CSIT-1205 Create AVF driver test

- Add L1 KWs for SR-IOV handling (init Vfs, remove Vfs, ...)
- Cleanup L1 KWs for SR-IOV bind/unbind/pci_get/...
- Add L2 KWs for Test Setup/Teardown, L2patch, Create AVF interface
- Add sample L2patch test fox x710, xxv710

Change-Id: If17077877455a14043617d8ea0d06cbe47b469e3
Signed-off-by: Peter Mikus <pmikus@cisco.com>

b4e5c717 04-Sep-2018 Vratko Polak <vrpolak@cisco.com>

Fix various pylint violations

+ SchedUtils.py: Do not use `len(SEQUENCE)` to determine if a sequence is empty
+ VatHistory.py: Do not use `len(SEQUENCE)` to determine if a sequence is empty
+ VppCounters.py: Do not use `len(SEQUENCE)` to determine if a sequence is empty
+ Memif.py:
++ Do not use `len(SEQUENCE)` to determine if a sequence is empty
++ Either all return statements in a function should return an expression,
or none of them should.
++ Update :return: on possible None.
+ Classify.py: Unnecessary "else" after "return"
+ ContainerUtils.py: Useless super delegation in method '__init__'
+ CpuUtils.py: Do not use `len(SEQUENCE)` to determine if a sequence is empty
+ DropRateSearch.py: Either all return statements in a function
should return an expression, or none of them should.
+ IPv4NodeAddress.py: Do not use `len(SEQUENCE)` to determine if a sequence is empty
++ Also improve docstrings.
+ IPv4Setup.py: Useless super delegation in method '__init__'
+ IPv6Setup.py: Do not use `len(SEQUENCE)` to determine if a sequence is empty
++ Also improve docstrings.
+ IPv6Setup.py: standard import "from ipaddress import IPv6Network"
should be placed before "from robot.api import logger"
+ MacSwap.py: Trailing newlines
+ NATUtil.py: Do not use `len(SEQUENCE)` to determine if a sequence is empty
+ NodePath.py: Unnecessary "else" after "return"
+ Tap.py: Do not use `len(SEQUENCE)` to determine if a sequence is empty
+ topology.py: Either all return statements in a function
should return an expression, or none of them should.
+ topology.py: Unnecessary "else" after "return"
++ Do not use `len(SEQUENCE)` to determine if a sequence is empty
++ Improve docstrings
+ DUTSetup.py: Do not use `len(SEQUENCE)` to determine if a sequence is empty
++ Also do not compare int(ret_code) just to access zero-ness.
+ ssh.py: Do not use `len(SEQUENCE)` to determine if a sequence is empty
+ InterfaceUtil.py: Unnecessary "else" after "return"

Change-Id: Iba4244aa79661ee7df15fed5c7c6dbf04dfa88b2
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

0ad00a49 31-Aug-2018 Jan Gelety <jgelety@cisco.com>

Add eth-ip4base-2memif[ndrpdr|mrr] perf tests for 2-node topology

- added also 3-node test cases for comparison

Jira: CSIT-1261

Change-Id: I1bfcc184e925e969d4a610920c4e49af23047507
Signed-off-by: Jan Gelety <jgelety@cisco.com>

be430a28 01-Sep-2018 Peter Mikus <pmikus@cisco.com>

Fix pylint part 1

- Decrease pylint errors. Part: easy

Change-Id: I452e5b5a11e9b78c03cd173a3848babe21b93c73
Signed-off-by: Peter Mikus <pmikus@cisco.com>

7db6faf2 10-Aug-2018 Vratko Polak <vrpolak@cisco.com>

CSIT-1135: Scripts for VPP per-patch testing

+ Scripts do not rely on (other) bootstraps.
+ Perf verify bootstrap is also the new style sript now.
+ Scripts are divided to functions for better re-use.
+ Functions are sourced from small number of large "library" files.
- Still using jumpavg from pipy.
- Perpatch has specific simplified parsing (instead of the PAL one).
- Bash style document is in a separate Change.

Change-Id: If88fa528ce155ea86b614e3d77c0550b91bbdf11
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

e105ab72 23-Aug-2018 Jan Gelety <jgelety@cisco.com>

Create ip4-feature perf tests for 2-node topology

- ACL tests
- NAT44 tests
- iPoliceMarker tests

Jira: CSIT-1175, CSIT-1154

Change-Id: Ife7e7df50f7c1c8033bacdb7512e78be6bcdf4eb
Signed-off-by: Jan Gelety <jgelety@cisco.com>

7afd133d 07-Aug-2018 Yulong Pei <yulong.pei@intel.com>

add the expected prompt for ubuntu root user

if ssh use root account to login ubuntu os, its prompt is ":~# ",
so add it to let csit test can run with root account.

Change-Id: I21f5380245324c8e48099433e3d374188e9001d9
Signed-off-by: Yulong Pei <yulong.pei@intel.com>

a6018da3 21-Aug-2018 Jan Gelety <jgelety@cisco.com>

VPP link bonding perf tests with two links between DUTs

Jira: CSIT-1247

Change-Id: Ia6a3f7682eb9a35040682913c0e33a1d61d1e6fa
Signed-off-by: Jan Gelety <jgelety@cisco.com>

68c24572 21-Aug-2018 Peter Mikus <pmikus@cisco.com>

CSIT-1164 Create VM vhost tests for 2-node topology

Change-Id: I955d3170da94cf35a2fda03259bcdc020ac2b652
Signed-off-by: Peter Mikus <pmikus@cisco.com>

56fe9e51 30-Jul-2018 Vratko Polak <vrpolak@cisco.com>

CSIT-1222: Do two doublings in external MLRsearch

Make number of doublings configurable,
keep Python default at 1, set Robot default to 2.

Also make docstring types unique
(pylint was complaining about classes and modules having the same name).

Increase MLRsearch version to 0.2.0.

Change-Id: Ib846032e79ff52994503c0cfef2f86655502c275
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

92d4e47b 07-Aug-2018 Peter Mikus <pmikus@cisco.com>

Refactor VHOST code

CSIT-1164 Create VM vhost tests for 2-node topology
CSIT-1173 Implement VM vhost KWs for 2-node topology

- Cleanup QemuUtils.py Library (PEP8, some TODOs, readability, multi queue,
ring size, qemu version detection)
- Cleanup VHOST KWs perf (Unify running QEMU on N-node topology)
- Add ability to configure Queues, Hyperthreading, automatically compute
number of CPU for VM/Testpmd and RXQ for Testpmd workload.
- Partial cleanup of configuration KWs (l2xc, l2bd) for 2-node
- Create IPv4 2-node KW

Change-Id: I8aae1355bafa651de715cd438fe706c443ea1d88
Signed-off-by: Peter Mikus <pmikus@cisco.com>

81184fdb 03-Aug-2018 Peter Mikus <pmikus@cisco.com>

CSIT-1156 Create container memif tests for 2-node topology
CSIT-1155 Implement container memif KWs for 2-node topology

Change-Id: I4fc7bcab499a0b8a8594114d3f331b0d9610bf9d
Signed-off-by: Peter Mikus <pmikus@cisco.com>

325bf96c 30-Jul-2018 Peter Mikus <pmikus@cisco.com>

CSIT-1193 De-duplicate bootstrap scripts into one

- DPDK and VPP bootstrap merged into one (ligato will follow).
- Added more error detections
- Added topo-cleanup.py to cleanup TB before and after test.
- Remove installation of VPP

Change-Id: I7a86117eb03cbe4ee8fde47baeed58bc86c0dfb2
Signed-off-by: Peter Mikus <pmikus@cisco.com>

76349c39 03-Aug-2018 Vratko Polak <vrpolak@cisco.com>

Add unix full-coredump to VPP default config

Change-Id: Iceea1f25749443d3cf091996026f75d8779e8103
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

00900988 01-Aug-2018 Jan Gelety <jgelety@cisco.com>

FIX: check IF up state after setting MTU, not before

Change-Id: Ic7a78af96a371e49993f6cbac01267e4bbe0dc46
Signed-off-by: Jan Gelety <jgelety@cisco.com>

2799f44d 31-Jul-2018 Vratko Polak <vrpolak@cisco.com>

FIX: Set MTU before configuring l2patch

This should reduce number of "link down" failures dramatically.
The exact mechanism is not clear, but l2xc suites do not fail that much.

Change-Id: Ie102d90a58561121695c9938679ce0d3ee6a874f
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

f83b53b9 30-Jul-2018 Peter Mikus <pmikus@cisco.com>

FIX: Revert l3fwd patching

For now this solution does not work on Haswells, need to find permanent
fix.

Change-Id: Id5323a078db3a8f14c009d6f66ee393c89d851ef
Signed-off-by: Peter Mikus <pmikus@cisco.com>
(cherry picked from commit 5f634b8c486f7a404c9cd33b60cc92a6907e7c64)

2e42562f 28-Jul-2018 Peter Mikus <pmikus@cisco.com>

FIX: LXC container creation on Ubuntu Bionic

Do not mount whole /dev into container as it can steal the PTS (tty).
Currently mounting only /dev/bus for pci devices and /dev/vfio

Change-Id: Ie829d35db81317bcd081257453ede7cbec2a302e
Signed-off-by: Peter Mikus <pmikus@cisco.com>

c05d9722 28-Jul-2018 Peter Mikus <pmikus@cisco.com>

Revert MTU sequence to apply oafter interface UP

Change-Id: I8820350809ab63787a9e4a48b2db2c85320e7b11
Signed-off-by: Peter Mikus <pmikus@cisco.com>

3f074f53 25-Jul-2018 Peter Mikus <pmikus@cisco.com>

FIX: Interface up handling

- Increase timeout when trying to check interface (this is useful if
there are multiple interfaces and dump command take more than
TIMEOUT/NR_IF which is happening quite often).
- Reverse the order of applying MTU and interface UP to try to prevent
API overload during interface initialization phase.

Change-Id: I4e8623963d15b3c0d202172b4c58c43a972bb9cb
Signed-off-by: Peter Mikus <pmikus@cisco.com>
(cherry picked from commit 584345da4f7330f7517e5defd894b4995c2b57b0)

1bb5beef 17-Jul-2018 Peter Mikus <pmikus@cisco.com>

CSIT-1065 High failure rate with K8s/Ligato orchestration

- Update Ligato Bootstrap for latest changes
- Update Ligato Test cases for latest vpp-agent changes
- Convert TC to new format
- Add Hyperthreading support

Change-Id: Id7c8513b01c66ee6c652b6294ddc50bc10be8f7d
Signed-off-by: Peter Mikus <pmikus@cisco.com>

cdf557ef 18-Jul-2018 Peter Mikus <pmikus@cisco.com>

Add MTU handling into perf tests

- Add ability to configure MTU on interfaces. Put the MTU into configuration
keywors for all perf testcases.

Change-Id: I364b4bc26b26f2f66f350949c0aaa2a2aa675682
Signed-off-by: Peter Mikus <pmikus@cisco.com>

5d6479be 20-Jul-2018 Vratko Polak <vrpolak@cisco.com>

CSIT-1097: Migrate L2 to NDRPDR and edit MRR

Change-Id: I738d1794f795e1225bc9709ea2ed2cf9b06d1cf4
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

374b3593 21-Mar-2018 sharath reddy <sharathkumarboyanapally@gmail.com>

initial CSIT-DMM test scripts

Change-Id: I77a965751010b85d21335932baa5345a095dc4f3
Signed-off-by: sharath reddy <sharathkumarboyanapally@gmail.com>
Signed-off-by: sharath <sharathkumarboyanapally@gmail.com>

298d0a61 20-Jul-2018 Vratko Polak <vrpolak@cisco.com>

CSIT-1097: Migrate Vts suite to NDRPDR

Change-Id: Iaac913bb4b15d743a2e9d565e25d31c089cee3e8
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

74771ecb 19-Jul-2018 Vratko Polak <vrpolak@cisco.com>

CSIT-1097: Migrate ip4 to NDRPDR and edit MRR

Change-Id: I9e3b2973c14f818247658a2ae34456c9fc2bae4e
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

11abbc5f 18-Jul-2018 Vratko Polak <vrpolak@cisco.com>

CSIT-1097: Edit dpdk suites for new rate and jumbo

Change-Id: If2fceb47639dc1add32184271c1e911f7920a51a
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

1e2e2be1 18-Jul-2018 Vratko Polak <vrpolak@cisco.com>

CSIT-1097: Migrate vm_vhost to NDRPDR and edit MRR

Change-Id: Id5eb8fe46b219426803d3e7d135319ce5117738c
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

fb7a7ea1 16-Jul-2018 Peter Mikus <pmikus@cisco.com>

FIX: Increase timeout for VAT for longer API calls.

Change-Id: Idab5e8d62a42513ddef97025625962b510c3a625
Signed-off-by: Peter Mikus <pmikus@cisco.com>

f1ec30ef 17-Jul-2018 Vratko Polak <vrpolak@cisco.com>

CSIT-1097: Ip6 NDRPDR and edited MRR suites

Change-Id: I912017c6d1eab5530eecb2326887ffd057916ee8
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

ac6cc229 17-Jul-2018 Peter Mikus <pmikus@cisco.com>

CSIT-1201 Create L2patch perf tests

- XL710, XXV710, X710
- 2n, 3n
- all pkt.size groups
- ndrpdr, mrr

Change-Id: Ibb36d734cd70a0a4d07e3d177fa2477bf9bfaacd
Signed-off-by: Peter Mikus <pmikus@cisco.com>

7dda8f57 15-Jul-2018 Vratko Polak <vrpolak@cisco.com>

CSIT-1186: Add srv6 NDRPDR suites

Delete the corresponding ndrpdrdisc suites.

MRR suites are also edited,
to make them less different from NDRPDR suites.

Now, there is a script to re-generate testcases of selected suites.
For that, resources/libraries/python/autogen is created,
with Regenerator holding the most of script logic.

The script looks at files matching a glob expression,
reuses a "prolog", but overwites test cases with the default template
and hardcoded set of testcase arguments.

Also, handling of overhead size has been simplified,
using new keyword Get Max Rate And Jumbo And Handle Multi Seg.

Default value for search timeout is increased to 12 minutes
to make timeout failures less frequent.

Change-Id: I394ad61f262b3078e5ca719034b15ada48987ee0
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

24f7c6a4 13-Jul-2018 Peter Mikus <pmikus@cisco.com>

Refactor DPDK testcases to new structure

+ RXQ refactor

Change-Id: Ic03a2e208b9fe5d324a5ed75a603af4cff1854a9
Signed-off-by: Peter Mikus <pmikus@cisco.com>

31fde19f 28-Jun-2018 Peter Mikus <pmikus@cisco.com>

Add L2xc/L2bd/Ip4/Ip6 2-node tests for x710

- CSIT-1161 Add 2-node L2XC tests
- CSIT-1160 Add 2-node L2BD tests
- CSIT-1157 Add 2-node IP4 tests
- CSIT-1153 Add 2-node IP6 KW
- CSIT-1158 Add 2-node IP6 tests

Change-Id: I7c8fed7018bb355c0de73f6a8bc3a8ec80366972
Signed-off-by: Peter Mikus <pmikus@cisco.com>

ad71afc5 10-Jul-2018 Peter Mikus <pmikus@cisco.com>

Refactor perf test cases

- Refactor Performance TCs due to changes in Hyperthreading and RXQ allocations.
- Simplify the structure of suite to avoid large refactors in future.

Change-Id: Ifb1b9719391f26745f075a900bd9fb39b6cb809c
Signed-off-by: Peter Mikus <pmikus@cisco.com>

338b195c 12-Jul-2018 Peter Mikus <pmikus@cisco.com>

Add stats segment heapsize to default config

- Scale tests (ip4, ip6) are failing due to low amount of stats segment
heapsize.

Change-Id: Id9b3e84d5a5c63014c17041c08c00ef6188afa5f
Signed-off-by: Peter Mikus <pmikus@cisco.com>

ad27739c 10-Jul-2018 Vratko Polak <vrpolak@cisco.com>

CSIT-1186: Consume MLRsearch in agreed upon way

+ Rename search to MLRsearch in resources/libraries/python/.
+ Make PyPI/MLRsearch/MLRsearch a symlink to the renamed directory.
+ TrafficGenerator.py to import from the renamed directory/module.
- No change to MLRsearch code.
- Version stays at 0.1.1 to point to the latest released code.

Change-Id: I4a38b0b7f8f083fbb1a93b25522560144b4ef556
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

e3bed8e2 10-Jul-2018 Vratko Polak <vrpolak@cisco.com>

CSIT-1178: Prepare for bursty MRR

+ All suites and tests still refer to MRR instead of BMRR (or FRMOBL).
+ API change: Traffic should pass with maximum rate
first argument got a default value,
thus it needs to be moved towards the end of argument list.
+ Consequently, the value for it has been deleted from suites.
+ Test message is now compatible only with BMRR parsing.
- Reporting of transmit rate is left as TODO.
+ Global test __init__ with new way of giving defaults to global variables.
+ The new keyword is put into robot_enhancements.robot resource.
+ Number of trials and trial duration are now configurable.
- Bootstrap scripts have no support for overriding the defaults yet.

Change-Id: I4b108cc9c256730e62c03fbacba0a1c314f8ae88
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

173a910c 09-Jul-2018 Peter Mikus <pmikus@cisco.com>

CSIT-1142 2-node topology - keywords DPDK

Change-Id: Ia2676a7b846bd574aa86703fce6b0e3218f98776
Signed-off-by: Peter Mikus <pmikus@cisco.com>

cc85afad 06-Jul-2018 Peter Mikus <pmikus@cisco.com>

CSIT-1142 2-node topology - keywords

- Clean up of 2-node setup KWs

Change-Id: I59fc901fb57544eceb6a041b56b515cda8babf85
Signed-off-by: Peter Mikus <pmikus@cisco.com>

b0aa215d 11-Apr-2018 Peter Ginchev <pginchev@cisco.com>

VTS VXLAN vhost-user with single DUT, TG sends VXLAN

Change-Id: I63539af2cdbdbd02a67068e48d0fdf2743da3b1e
Signed-off-by: Peter Ginchev <pginchev@cisco.com>

eff8394c 03-Jul-2018 Peter Mikus <pmikus@cisco.com>

CSIT-1046 Make uio driver configurable from topofiles

Currently we are configuring uio_driver from global variable.
This may not be suitable for various topologies where we need
different driver per TB. This patch is suppose to put uio_driver
into topology files.

Change-Id: I56af0697e8b2359ccb126151217976408720c1ba
Signed-off-by: Peter Mikus <pmikus@cisco.com>

a28f1efe 01-Jul-2018 Peter Mikus <pmikus@cisco.com>

Compatibility fixes with Ubuntu 18.04

Currently we are using ip:port socket to for VPP to listen for incoming
connections. There is only one place in code this socket is used for
detection if VPP is responding after restart. This patch is supposed to
change ip:port to sock:file which is default preffered way in VPP. This
way we can start using vppctl. netcat on the other side with ip:port
remains hanged in console for infinite time not returning back.

There is also need to check whether uio_module is loaded and eventually
load it. As uio_pci_generic is not working there, we will fallback to
main igb_uio (uio_pci_generic being only lightweight subset of igb_uio).

This patch also add additional verbose output to console during setup to
better understand if failure happens during copy/extract/setup.

Change-Id: I0b8a3b76dce3316496a3ad928f58718b6e73057d
Signed-off-by: Peter Mikus <pmikus@cisco.com>

8a5ef28c 29-Jun-2018 Marek Gradzki <mgradzki@cisco.com>

HC Tests: use vpp-fib-management module in dhcp tests (HC2VPP-348)

Addaps HC DHCP tests to https://gerrit.fd.io/r/#/c/13299/

Change-Id: I874da5ee76fcfdb5039c1b3ad33aec4af80396d0
Signed-off-by: Marek Gradzki <mgradzki@cisco.com>

b8bf181c 28-Jun-2018 Peter Mikus <pmikus@cisco.com>

SetupFramework to detect failures, part II

- This patch is enforcing evaluation and aligning all __init__.robot
files to use the same logic.

Change-Id: I9e2bf5e904bb6d22f4e6a153c951c3b3c233e2fb
Signed-off-by: Peter Mikus <pmikus@cisco.com>

d68c77c3 26-Jun-2018 Peter Mikus <pmikus@cisco.com>

FIX: SetupFramework to detect failures

- Fix behavior of setup framework to properly detect and raise
exception in case of any issue occurs during framework setup on any node
- General code cleanup

Change-Id: Id4cf36e221817600164b25d5551582838b0f0d5e
Signed-off-by: Peter Mikus <pmikus@cisco.com>

ca163ffc 08-Jun-2018 juraj.linkes <juraj.linkes@pantheon.tech>

CSIT-1043: Execute pci rescan only if needed

Pci rescan is a rather invasive process, which is why it should be
executed only if needed. This patch moves the pci rescan after
pci device driver discovery, rescanning the devices for further attemps
at driver discovery.

Change-Id: I29c939b44c3f67371416a99c711e057f711ba9b4
Signed-off-by: juraj.linkes <juraj.linkes@pantheon.tech>

fe014f97 21-Jun-2018 Michal Cmarada <michal.cmarada@pantheon.tech>

HC2VPP-331: Fix Honeycomb fails to assign VRF to interface

- add configuration for FIB table management to test suite
- fix routing test suite HC2VPP-331 bugs
- fix intip4-intip6 test suite HC2VPP-331 bugs


Change-Id: I0b1e9ed787d9fb68e76a6d61c1eea2519a36a6c4
Signed-off-by: Michal Cmarada <michal.cmarada@pantheon.tech>

39b4a077 20-Jun-2018 Peter Mikus <pmikus@cisco.com>

Revert "CSIT-986: Use MLRsearch from pip"

This reverts commit 0c2c57d9965ab1db0d5404ad103871ac250339cb.

Reason for revert: unless you will fix this broken patch we have to revert this as it breaks several thing in the csit core ci/cd.

1) all tb are pypi offline this means no new pypi is automatically dowloaded. Everytime you change your version you have to update every tb. As this is not automated this will never work and put extreme overhead

2) this code is not pylint checked and not verified by any existing job breaking any kind of verificition mechanics in csit

3)there is no automation in terms of creating pypi (no job) this creates chicken egg problem that you cannot verify change unless new version is installed

Next time please think or consult with more seniored csit core developer
Unless above will be fixed i will revert on monday as now it breaks all jobs. I will set hard verification to framework setup (exception) so this will prevent next time merge.
Possible solution:
1)Move the directory back to resources and reference from csit directly not via pypi, leave the setup crap in dir and let users to create package on their own

Change-Id: Id530a9f19f668e45f73ffc9e7371bb453b59fd1b
Signed-off-by: Peter Mikus <pmikus@cisco.com>

0c2c57d9 18-Jun-2018 Vratko Polak <vrpolak@cisco.com>

CSIT-986: Use MLRsearch from pip

+ Delete resources/libraries/python/search/.
+ Add MLRsearch==0.1.1 to requirements.txt.
+ Bump PyPI/MLRsearch version to 0.1.2.

Change-Id: I1f86d75ac8eb90ee3946dbac8c56280f39302f4d
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

a9f251c6 28-May-2018 Vratko Polak <vrpolak@cisco.com>

CSIT-986: Implement proposed MDR improvements

+ Use first intermediate with goal in initial phase.
+ Measure above MRR if that got zero loss.
+ Always prioritizes NDR in internal search.
+ Rename classes.
+ Copy code for standalone PyPI publishing.
- Original files will be deleted after publish.

Change-Id: I5169d602d1e5e35a1894645cd52e70d791871608
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

28b344a6 14-May-2018 Peter Mikus <pmikus@cisco.com>

CSIT-1081 Container VPP configuration refactor

Adopt code for various topology configurations.

Change-Id: Iaf9d7995ab8cd06da0c56c5e5664d57d19e74d7c
Signed-off-by: Peter Mikus <pmikus@cisco.com>

cb371e36 07-Jun-2018 Tibor Frank <tifrank@cisco.com>

CSIT-1121: Add "Get DPDK version" KW to DPDK tests

Change-Id: I6152b3b7d4895a376914166d03ee9ca15ea9eb32
Signed-off-by: Tibor Frank <tifrank@cisco.com>

44e82a32 17-May-2018 Jan Gelety <jgelety@cisco.com>

VPP link bonding - lacp mode

CSIT-1072
CSIT-1083
CSIT-1084

Change-Id: Icaf0e09af633d301306a84251f47822e95b411a2
Signed-off-by: Jan Gelety <jgelety@cisco.com>

b5782684 11-May-2018 Jan Gelety <jgelety@cisco.com>

DPDK link bonding: xor mode

CSIT-1073
CSIT-1074
CSIT-1077

Change-Id: I248e079021c30988210fd792b32d5afdca71aadb
Signed-off-by: Jan Gelety <jgelety@cisco.com>

a49ab6c4 17-May-2018 Tibor Frank <tifrank@cisco.com>

CSIT-1087: Add SRv6 MRR tests

Change-Id: Ia90a9bff6791518ba08fa81e6167e96aea7714d5
Signed-off-by: Tibor Frank <tifrank@cisco.com>

359e7958 27-Apr-2018 Vratko Polak <vrpolak@cisco.com>

CSIT-986: MDR rst documentation

+ Introduction.
+ Phases description.
+ Comparison tables.
+ Graphs.

Change-Id: Iec5143770677c733070fb0444a1a7d898f1eb04e
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

9a7dde74 17-May-2018 Marek Gradzki <mgradzki@cisco.com>

HC tests: fix 'Archive Honeycomb logs' KW docs

Change-Id: I10851345579ee751b0b79b807fed140e4614685f
Signed-off-by: Marek Gradzki <mgradzki@cisco.com>

acab647f 16-May-2018 Marek Gradzki <mgradzki@cisco.com>

HC Tests: adapt NAT tests to ietf-nat@2018-02-23.yang (CSIT-1086)

Requires: https://gerrit.fd.io/r/#/c/12516/

Change-Id: Ie0a3452f51fb89914a6a0c53aa4136279a3dfb47
Signed-off-by: Marek Gradzki <mgradzki@cisco.com>

0a0b9d81 10-May-2018 Vratko Polak <vrpolak@cisco.com>

CSIT-992: Fix intermediate phases MDR parameter

Also add TODOs and improve comments.

Change-Id: I50bd652c83c272c3f7662dd487ab617be2b7de08
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

72813c36 15-May-2018 Marek Gradzki <mgradzki@cisco.com>

HC tests: archive ODL logs (CSIT-1031)

Change-Id: I444a5d6cd32cb9ee68575dfdb5a208de2c4eb72a
Signed-off-by: Marek Gradzki <mgradzki@cisco.com>

fd6fedc9 12-May-2018 Peter Mikus <pmikus@cisco.com>

CSIT-1036 Expose option to install DKMS in container

Expose DKMS installation as suite variable. This will allow to use DPDK
driver for future tests.

Change-Id: I38fd014c8cf6f4bf42881af2196cadc679fe53e0
Signed-off-by: Peter Mikus <pmikus@cisco.com>

632c598d 11-May-2018 Peter Mikus <pmikus@cisco.com>

CSIT-1079 Add multiple mount dirs into container

Pass the list of mount dirs into container LXC/Docker

Change-Id: Ie80062563955273791ab63e156bf0b369e5be649
Signed-off-by: Peter Mikus <pmikus@cisco.com>

efae5118 09-May-2018 Peter Mikus <pmikus@cisco.com>

CSIT-1076 Improve SSH connection handling

Properly detect dropped connection via predicate is_active() to prevent
using dropped connection.

Change-Id: I9105622f28d2f7949675b8cee1dd4384a12f72a9
Signed-off-by: Peter Mikus <pmikus@cisco.com>

a3d14e7c 10-May-2018 Vratko Polak <vrpolak@cisco.com>

CSIT-992: Give MDR parameters official names

Change-Id: I1da9a64fb06e015f2b2a0aacb46a53d70349b4b6
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

f1bb434e 10-May-2018 Peter Mikus <pmikus@cisco.com>

Cleanup DPDK framework setup

Moving installation of DPDK into KW instead of framework setup. This will
unify the framework setup and allow future optimizations.

Change-Id: I360ba95a2858e73e4bbb12020567d5d174ab69ca
Signed-off-by: Peter Mikus <pmikus@cisco.com>

abd1c00c 09-May-2018 Michal Cmarada <michal.cmarada@pantheon.tech>

HC2VPP-253 - Update routing csit jobs

this fixes test failures caused by HC2VPP routing
models bump (https://gerrit.fd.io/r/#/c/10954)

- updates tests for bgp routing
- updates tests for routing
- updates SLAAC test because of changes in rt-advertisements

Change-Id: Iacc37b42e6523f440d77241c18ca8e61d1d01f23
Signed-off-by: Michal Cmarada <michal.cmarada@pantheon.tech>

6e9d38fb 07-May-2018 Peter Mikus <pmikus@cisco.com>

CSIT-1071 Add traffic evaluation criteria to MRR

- Fail the testcase if there is no traffic pass.

Change-Id: I162187073aafa286793ce488fda9fd065bb55213
Signed-off-by: Peter Mikus <pmikus@cisco.com>

7e20228f 09-May-2018 Peter Mikus <pmikus@cisco.com>

FIX: SSH connect issue

error: [Errno 9] Bad file descriptor

Change-Id: I4c5278d41e979f6af43054e3b5890fb154555494
Signed-off-by: Peter Mikus <pmikus@cisco.com>

fa404e01 04-May-2018 Vratko Polak <vrpolak@cisco.com>

CSIT-992: Shorten MDR search test message

Change-Id: I79c78d4d8ca1611a287bd117e480c4317d27e287
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

35175924 27-Apr-2018 Vratko Polak <vrpolak@cisco.com>

CSIT-992: Add libraries for optimized search

+ Place the libraries into resources/libraries/python/search/.
+ Except OptimizedTrexSearch in TrafficGenerator.py
+ Change traffic generator to support floats for duration and warmup.
+ Remove explicit type conversions where not needed.
+ Add robot keywords to performance_utils.robot
+ for calling the optimized search.
+ for reporting the resulting values.
+ for checking the minimal performance has been reached.
+ for running five second "Traffic should pass with no loss" after the search.
- Add methodology documentation in subsequent Change.
- Add simulator for testing algorithm correctness in a subsequent Change.
- Add tests using the libraries in subsequent Change.

Change-Id: Ia041008382ee4c9a562172099aea794c854d5f2f
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

5e7be479 26-Apr-2018 Vratko Polak <vrpolak@cisco.com>

Fix various pylint 1.5.4 warnings

+ DUTSetup.py:424 Else clause on loop without a break statement
+ InterfaceUtil.py:400 Else clause on loop without a break statement
+ QemuUtils.py:564 Wrong continued indentation
+ SetupDPDKTest.py: Locally enabling broad-except
+ VatExecutor.py: Catching too general exception Exception
+ ssh.py:95 No exception type(s) specified.
+ HTTPRequest.py: Tolerate HTTPCodes.OK
+ multiple: Drop ":returns: None" from docstrings.

There are still several warnings present:
- R0902(too-many-instance-attributes)
- R0912(too-many-branches)
- R0913(too-many-arguments)
- R0914(too-many-locals)
- R0915(too-many-statements)
- R0401(cyclic-import)

And there are multiple blocks of similar lines,
mainly across various Setup*Test.py files:
- R0801(duplicate-code)

Change-Id: I582575cb52b85d69d268e6374852f6e74bb71052
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

2005c286 02-May-2018 Tibor Frank <tifrank@cisco.com>

FIX: TCP perf tests

Change-Id: I59ad8ef70fc2bedce14b52359922a002f960ab7a
Signed-off-by: Tibor Frank <tifrank@cisco.com>

4c6fe560 13-Apr-2018 Vratko Polak <vrpolak@cisco.com>

Fix warnings reported by gen_doc.sh

+ Docstring warnings fixed.
+ Multiline param descriptions indented by 4 spaces.
- Except the PacketVerifier.py one
- I have tried several quote-like blocks, nothing works.
- Rst warnings not fixed.
- How can I fix them? They refer to temporarily created files.
+ Other improvements:
+ Python lines no longer than 80 characters.
+ :return: -> :returns:
+ Notes before params.
+ :raises
+ closing colon after exception class.
+ Description is a sentence.
+ Present tense in conditional sentences.
+ Bumped copyright year in edited files.

Change-Id: I462c194eeecb666dc146e26858486a07c990be9b
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

d1d8f2b3 25-Apr-2018 Peter Mikus <pmikus@cisco.com>

FIX: SSH socket reading error

Currently if the command timeouts due to the nature of script execution
we are trying to again read from socket after timeout on seesion
expired. This patch is supposed to fix the behaviour and eliminate the
second read from channel after it was cloed.

Change-Id: Ib0028e901eb6ff4d10ca77d2ea19f9e770e6cef4
Signed-off-by: Peter Mikus <pmikus@cisco.com>

4bafd0aa 05-Apr-2018 Lucian Banu <lucian.banu@enea.com>

CSIT-1019: Fix PacketVerifier.RxQueue receive timeout issue

Change-Id: I0f7f54e721843b0252ac969ddfabc769a632c1a0
Signed-off-by: Lucian Banu <lucian.banu@enea.com>

73a01b1a 22-Mar-2018 Jan Gelety <jgelety@cisco.com>

CSIT-1009: SRv6 proxy tests

- SRv6 with endpoint to SR-unaware Service Function via static proxy
- SRv6 with endpoint to SR-unaware Service Function via dynamic proxy
- SRv6 with endpoint to SR-unaware Service Function via masquerading proxy

Change-Id: I6a6062cb41d810bf9e27dacfd866181bfde4c693
Signed-off-by: Jan Gelety <jgelety@cisco.com>

f3d66d9c 20-Apr-2018 Peter Mikus <pmikus@cisco.com>

FIX: Restart VPP in container before each test

Change-Id: Iec7045aadc0675e04b8c74cbe28f8b3f193bcf1f
Signed-off-by: Peter Mikus <pmikus@cisco.com>

c8b2f57c 18-Apr-2018 Peter Mikus <pmikus@cisco.com>

FIX: Configure number of memif queus properly

Change-Id: I2dcb0300829bc961c80cc30d972d0563aeba9364
Signed-off-by: Peter Mikus <pmikus@cisco.com>

30c94055 18-Apr-2018 Peter Mikus <pmikus@cisco.com>

FIX: Memif tests failing

- CSIT-1049

Change-Id: I073c1e6d8cdda835fbb955cbf79e982bc2cc6228
Signed-off-by: Peter Mikus <pmikus@cisco.com>

2553b94d 13-Apr-2018 Peter Mikus <pmikus@cisco.com>

Make default driver configurable

- Make UIO driver configurable from global variables.
- Prepare code for uio_pci_generic to vfio-pci change

Change-Id: I2b49201177a92f51673242a30e2fd8d4f7e59694
Signed-off-by: Peter Mikus <pmikus@cisco.com>

1bbd587a 11-Apr-2018 Peter Mikus <pmikus@cisco.com>

Add more verbose DPDK logs

Change-Id: I98a07fa88d4959ab05996e053c5c02ef9bda5039
Signed-off-by: Peter Mikus <pmikus@cisco.com>

b1cbbb6a 10-Apr-2018 Peter Mikus <pmikus@cisco.com>

CSIT-1037 K8s container extensions

- Add new K8S topologies on i40 based nic

Change-Id: Id20f1e15dab347edee128633230aa098b774e43d
Signed-off-by: Peter Mikus <pmikus@cisco.com>

0f585d16 10-Apr-2018 Peter Mikus <pmikus@cisco.com>

Update DPDK to 18.02

- Update DPDK version to 18.02
- Code cleanup.

Change-Id: I33e2aa35cc80092561a4db99d75bdc7e4b62df3a
Signed-off-by: Peter Mikus <pmikus@cisco.com>

36da555e 10-Apr-2018 Peter Mikus <pmikus@cisco.com>

Cleanup perf bootstrap

- Remove the DPDK_TEST variable and replace it by internal global
variable
- Unify all perf boostrap for merge in future.
- Cleanup ligato perf bootstrap.

Change-Id: Id47d6614c8dd18a701493e00056ef17d2e37fc5c
Signed-off-by: Peter Mikus <pmikus@cisco.com>

68dfcca7 09-Apr-2018 Peter Mikus <pmikus@cisco.com>

Create unified service operations

- Add ability to dump the logs from service unit (since last start)
- Cleanup service code to more streamlined way.

Change-Id: I6e332dce3229727dd36fd72a8ecfb9fc9efe4d63
Signed-off-by: Peter Mikus <pmikus@cisco.com>

c5c36999 16-Mar-2018 Peter Mikus <pmikus@cisco.com>

FIX: Crypto execution order

Currently, VAT history looks like this:

sw_interface_set_flags sw_if_index 2 admin-up
sw_interface_set_flags sw_if_index 1 admin-up
sw_interface_dump
sw_interface_set_flags sw_if_index 2 admin-up
sw_interface_set_flags sw_if_index 1 admin-up
sw_interface_add_del_address sw_if_index 2 192.168.10.1/24
sw_interface_add_del_address sw_if_index 1 172.168.1.1/24
ip_neighbor_add_del sw_if_index 2 dst 192.168.10.2 mac 68:05:ca:3a:af:40
ip_neighbor_add_del sw_if_index 1 dst 172.168.1.2 mac 68:05:ca:35:78:e9
ip_add_del_route 10.0.0.0/8 via 192.168.10.2 sw_if_index 2
resolve-attempts 10 count 1
exec exec /tmp/ipsec_create_tunnel_dut1.config

It should be like this:

sw_interface_add_del_address sw_if_index 2 192.168.10.1/24
sw_interface_add_del_address sw_if_index 1 172.168.1.1/24
ip_neighbor_add_del sw_if_index 2 dst 192.168.10.2 mac 68:05:ca:3a:af:40
ip_neighbor_add_del sw_if_index 1 dst 172.168.1.2 mac 68:05:ca:35:78:e9
ip_add_del_route 10.0.0.0/8 via 192.168.10.2 sw_if_index 2
resolve-attempts 10 count 1
exec exec /tmp/ipsec_create_tunnel_dut1.config
sw_interface_set_flags sw_if_index 2 admin-up
sw_interface_set_flags sw_if_index 1 admin-up

Change-Id: I4e943436dee00166966b4f53d9d0a40440bbf1e4
Signed-off-by: Peter Mikus <pmikus@cisco.com>

84e2999a 05-Apr-2018 Peter Mikus <pmikus@cisco.com>

FIX: VAT SSH timeout

Currently when VAT cannot connect to VPP via direct API call, there is
inner timeout of ~100s until it quits and returns RC. In our code we are
setting outer timeout to 10/15s to detect if VAT is not responding. If
VAT does not respond quickly enough due to e.g VPP crash, we are
incorrectly reporting SSHTimout exception.

This fix is suppose to set correct timeout values and also to set some
of the calls like show run|hard|err / clear to detect whether they were
successfull or not.

+ Various small library cleanup.

Change-Id: I787c4baecd7e086705a4076643e255a875ea8438
Signed-off-by: Peter Mikus <pmikus@cisco.com>

1321245b 05-Apr-2018 Peter Mikus <pmikus@cisco.com>

FIX: Change plugin default behavior for Container tests

Looks like disabling all plugins in container leaving
only memif_plugin.so results into issue that could lead
into lost of SSH connectivity to TB or in better case
to not handling any traffic.

This fix is supose to return previous behavior for Container
instance of VPP.
vpp_config.add_plugin('disable', 'dpdk_plugin.so')

Change-Id: I7bca6c73c0f5aaf30d423b90ff7c2d2c38d54700
Signed-off-by: Peter Mikus <pmikus@cisco.com>

20ebb7aa 05-Apr-2018 Peter Mikus <pmikus@cisco.com>

Revert "FIX: Change plugin default behavior for Container tests"

This reverts commit c754789176b1a3ca00a129d3d207aa5a6bad7c27.

Change-Id: Ic1bbe8fac0d98f41aa8b1b57da0c7a147111340b
Signed-off-by: Peter Mikus <pmikus@cisco.com>

c7547891 05-Apr-2018 Peter Mikus <pmikus@cisco.com>

FIX: Change plugin default behavior for Container tests

Looks like disabling all plugins in container leaving
only memif_plugin.so results into issue that could lead
into lost of SSH connectivity to TB or in better case
to not handling any traffic.

This fix is supose to return previous behavior for Container
instance of VPP.

Change-Id: Ie8b3ce2e35a40c8f3498e490abb6967cd4dd912a
Signed-off-by: Peter Mikus <pmikus@cisco.com>

2075758f 05-Apr-2018 Marek Gradzki <mgradzki@cisco.com>

HC Tests: fix authentication for ODL Oxygen jobs

Change-Id: I05dcb5f35ae1bc2abc7ce5c34eaced218e0ebd35
Signed-off-by: Marek Gradzki <mgradzki@cisco.com>

01e72f9d 28-Mar-2018 Peter Mikus <pmikus@cisco.com>

Change the default plugin behavior in perf tests

Currently we are selectively disabling plugins by creating list of
disabled plugins for performance tests. Thanks to the new API in VPP we
can revert the logic to selectivly enable plugins. This is more stable
for future onboarding of new plugins into VPP.

Change-Id: Ibdd56d6097230d095a304bbb6984b565d9428f51
Signed-off-by: Peter Mikus <pmikus@cisco.com>

095b1620 22-Mar-2018 Peter Mikus <pmikus@cisco.com>

Optimize Qemu installation to speed up vhost tests

Currently Qemu is being installed if there is a change of qsz parameter
between tests/suites. Qemu is installed always into the same directory. This
patch changes the default behavior to install qemu over and install
pathced version to separate directory. It also disables force install.

Change-Id: I0d7493a02b026a6ae4a5ea8bacf54656de9db567
Signed-off-by: Peter Mikus <pmikus@cisco.com>

87cfc756 22-Mar-2018 Vratko Polak <vrpolak@cisco.com>

CSIT-1005: Add ipsec MRR tests

+ 40ge2p1xl710-ethip4ipsecbasetnl-ip4base-int-aes-gcm-mrr.robot
+ 40ge2p1xl710-ethip4ipsecbasetnl-ip4base-int-cbc-sha1-mrr.robot
+ 40ge2p1xl710-ethip4ipsecbasetnlsw-ip4base-int-aes-gcm-mrr.robot
+ 40ge2p1xl710-ethip4ipsecbasetnlsw-ip4base-int-cbc-sha1-mrr.robot
+ 40ge2p1xl710-ethip4ipsecscale1000tnl-ip4base-int-aes-gcm-mrr.robot
+ 40ge2p1xl710-ethip4ipsecscale1000tnl-ip4base-int-cbc-sha1-mrr.robot

Do not add test cases for 9000B framesize yet.
Improve other suites to keep the style consistent.

Change-Id: I03a58e8d6745083e267b9d53bb3b85efcb2ea827
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

3818230e 20-Mar-2018 Jan Gelety <jgelety@cisco.com>

FIX: check OS on DUT instead on host

CSIT-1010

Change-Id: I21303c22a50c0fe7914f769aca61ef350287ccb5
Signed-off-by: Jan Gelety <jgelety@cisco.com>

70068307 19-Mar-2018 Jan Gelety <jgelety@cisco.com>

CSIT-998: MRR tests

- CSIT-1001: MRR tests: IP4
- ip4
- 10ge2p1x520-ethip4-ip4base-copwhtlistbase-mrr.robot
- 10ge2p1x520-ethip4-ip4base-iacldstbase-mrr.robot
- 10ge2p1x520-ethip4-ip4base-ipolicemarkbase-mrr.robot
- 10ge2p1x520-ethip4-ip4scale200k-mrr.robot
- 10ge2p1x520-ethip4-ip4scale20k-mrr.robot
- 10ge2p1x520-ethip4-ip4scale2m-mrr.robot
- 10ge2p1x520-ethip4udp-ip4base-iacl1sf-10kflows-mrr.robot
- 10ge2p1x520-ethip4udp-ip4base-iacl1sl-10kflows-mrr.robot
- 10ge2p1x520-ethip4udp-ip4base-iacl50sf-10kflows-mrr.robot
- 10ge2p1x520-ethip4udp-ip4base-iacl50sl-10kflows-mrr.robot
- 10ge2p1x520-ethip4udp-ip4base-nat44-mrr.robot
- 10ge2p1x520-ethip4udp-ip4scale1000-udpsrcscale15-nat44-mrr.robot
- 40ge2p1xl710-ethip4-ip4base-mrr.robot
- ip4_tunnels
- 10ge2p1x520-ethip4vxlan-l2bdbasemaclrn-mrr.robot
- 10ge2p1x520-ethip4vxlan-l2xcbase-mrr.robot
- 10ge2p1x520-ethip4lispip4-ip4base-mrr.robot

Change-Id: Ibfd03aea9b97d29a8fa05e2956f6df54603a2208
Signed-off-by: Jan Gelety <jgelety@cisco.com>

c520b537 21-Mar-2018 Tibor Frank <tifrank@cisco.com>

Fix bug in dpdk-testpmd-mac KW

Change-Id: I6711e186062a72700552418eeee11b031e8c8ce4
Signed-off-by: Tibor Frank <tifrank@cisco.com>

491d7271 20-Mar-2018 Tibor Frank <tifrank@cisco.com>

Add max-pkt-len parameter to dpdk testpmd start

Change-Id: I114c187f007c10223502669c2ba85c63d09cd84a
Signed-off-by: Tibor Frank <tifrank@cisco.com>

501d216b 19-Mar-2018 Jan Gelety <jgelety@cisco.com>

FIX: remove all vpp packages installed

Change-Id: I1a2e51fada2f16fb236499a5cbff735f5e08aae2
Signed-off-by: Jan Gelety <jgelety@cisco.com>

fdf235ec 14-Mar-2018 Peter Mikus <pmikus@cisco.com>

Add vhost and memif MRR suite

Change-Id: Iaded13af82383955c2ff093ddc96e09682d95776
Signed-off-by: Peter Mikus <pmikus@cisco.com>

237ac98a 26-Oct-2017 Andrej Kilvady <andrej.kilvady@pantheon.tech>

VPP install and verify in __init__.robot

Move VPP installation to separate test in test suite setup phase
to clearly indicate any issue with VPP installation.

Added test to check VPP responsiveness after installation.

Change-Id: Idc2c78152e23aa7301bb5dbf9b1b6f4b639c3e84
Signed-off-by: Andrej Kilvady <andrej.kilvady@pantheon.tech>

f491bc6a 13-Mar-2018 Peter Mikus <pmikus@cisco.com>

Robot logs archiving for trending jobs

- Add output.xml auto-archiving to logs.fd.io.
- Cleanup from obsolete code.

Change-Id: Iafa9ef802264d2ad36ca0f556cb14d2b3ca0f179
Signed-off-by: Peter Mikus <pmikus@cisco.com>

07a840aa 12-Mar-2018 Peter Mikus <pmikus@cisco.com>

Optimize VPP restart after startup.conf change

Change-Id: Iabe7de5d598f904bd7e691c3ffed1d07ed0c7f68
Signed-off-by: Peter Mikus <pmikus@cisco.com>

f65b8ddc 07-Mar-2018 Peter Mikus <pmikus@cisco.com>

CSIT-989 Fix: Reflect latest memif API changes

Change-Id: I0c9cb073a42a8b4b7e573023e784ab9e72d0ad55
Signed-off-by: Peter Mikus <pmikus@cisco.com>

9d5fa4f1 06-Mar-2018 Peter Mikus <pmikus@cisco.com>

Fix: Remove api-segment from default startup config

Remove api-segment from default startup.conf for
performance tests.

Change-Id: I8f126faf3d923d36b1be2f2e0e676b07c072f1f3
Signed-off-by: Peter Mikus <pmikus@cisco.com>

4c75804c 28-Feb-2018 Peter Mikus <pmikus@cisco.com>

Performance KW optimizations II

Currently Binary Search is using TRex warmup time for every lookup
trial. This patch is suppose to optimize Binary Search to not use
warmup time for each trial apart from first one.

Change-Id: I9b914cfac3ce558557133c266335c1f550c0b52a
Signed-off-by: Peter Mikus <pmikus@cisco.com>

b883aab8 23-Feb-2018 Peter Mikus <pmikus@cisco.com>

Performance KW optimizations

- Reducing test time by removing redundant KW.

Change-Id: I03eeb0332cb88a11eff06df6f5e79d905df317a2
Signed-off-by: Peter Mikus <pmikus@cisco.com>

dbb2fcce 12-Feb-2018 Peter Mikus <pmikus@cisco.com>

FIX: LXC/DOCKER exclusive CPU

By default the cpuset cgroup is using exclusive CPU/MEM. When Docker
container is initialized a new cgroup /docker or /lxc is created under
cpuset parent tree. This newly created cgroup is inheriting parent
setting for cpu/mem exclusive parameter and thus cannot be overriden
within /docker or /lxc cgroup. This patch is supposed to set cpu/mem
exclusive parameter for both parent and subgroup.

Change-Id: I14b44db3f77c842756ec78aa60df7aca508d9545
Signed-off-by: Peter Mikus <pmikus@cisco.com>

3b5e5e14 20-Feb-2018 Peter Mikus <pmikus@cisco.com>

Raw results chk keywords and initial TC

- Implementation of Display raw results
- Implementation of Traffic should pass with maximum rate
- Code optimizations
- L2BD, L2XC, IP4, IP6 TC

Change-Id: I0b50e995a853ed3c8f88323ccc650e47b8ed2496
Signed-off-by: Peter Mikus <pmikus@cisco.com>

6b6b146d 22-Feb-2018 Peter Mikus <pmikus@cisco.com>

FIX: Qemu path override

Currently there is bug that Qemu path is not correctly composed and
cannot be properly overriden due to race condition in code. This patch
is fixing functions to properly work with path.

Change-Id: I276458d2d23c7a14441a4de4a56eff6431242ab9
Signed-off-by: Peter Mikus <pmikus@cisco.com>

e6bbba64 09-Feb-2018 Jan Gelety <jgelety@cisco.com>

Disable all plugins except DPDK by default

- enable corresponding plugin for ACL, NAT, MEMIF tests

Change-Id: Ie8bfdcbf1734283b6412ef3015215a00ce3ebdf6
Signed-off-by: Jan Gelety <jgelety@cisco.com>

a58e154a 30-Jan-2018 Jan Gelety <jgelety@cisco.com>

Add no-tx-checksum-offload to startup.conf in case of perf tests

Change-Id: I8de8f4f313befec23d6828c3b340c5042928ea1a
Signed-off-by: Jan Gelety <jgelety@cisco.com>
(cherry picked from commit 30f7c94c12a8ccff7bd86c781f491b3fe9d55def)

95998a67 19-Dec-2017 Jan Gelety <jgelety@cisco.com>

CSIT-675: SRv6 performance tests

- update L1 KWs
- update L2 KWs
- tests with one SID (no SRH insertion)
- tests with two SIDs (SRH inserted) and decapsulation
- tests with two SIDs (SRH inserted) without decapsulation

- enabled packet traces and logged packet traces in the test case
tear down if test failed

Change-Id: I3a0f4c350eed3f42509c6d49e832faa78fe64dbb
Signed-off-by: Jan Gelety <jgelety@cisco.com>

54ad6efd 10-Jan-2018 Tibor Frank <tifrank@cisco.com>

CSIT-898: WRK improvments

Change-Id: I92aafaaedce5891727a983b8cf024a0fb0db7524
Signed-off-by: Tibor Frank <tifrank@cisco.com>

c7eb2002 27-Nov-2017 Gabriel Ganne <gabriel.ganne@enea.com>

add new topology parameter: arch

if unset, arch variable will default to "x86_64"

* Note on "arm64" vs "aarch64"
debian-based uses arm64
rhel-based uses aarch64
qemu binaries of both distribs uses aarch64
dpdk uses arm64
vpp uses aarch64
python machine modules uses aarch64
=> prefer aarch64 to use the same nomenclature as vpp

* add ARCH argument to:
init_dpdk.sh, install_dpdk.sh, run_l2fwd.sh, install_tldk.sh, run_tldk.sh.
default to x86_64
converts "aarch64" if needed for dpdk naming convention
* fixed terminal end detection to allow "~]# "
add dut node arch as param to all robot set bin calls
* add --target-list flag to qemu_build.sh
defaults to x86_64-softmmu
* add arch flag to all the topology files
* topologies/available/ (and example file)
* resources/tools/virl/topologies/
* set _qemu_bin path using node['arch'] in qemu_set_node()

Change-Id: If46d88d064d213d3e4c6fc584bb8e0d4b6428cb8
Signed-off-by: Gabriel Ganne <gabriel.ganne@enea.com>

a95c54b7 04-Dec-2017 Tibor Frank <tifrank@cisco.com>

CSIT-866: wrk onboarding in CSIT

- CSIT-867: Low Level Description
- CSIT-868: wrk traffic profile - parsing
- CSIT-869: wrk implementation into CSIT

Change-Id: I65e1037f5ae05b3a5b2020e4a6c54462766ae1b4
Signed-off-by: Tibor Frank <tifrank@cisco.com>

0fbf9170 08-Jan-2018 Peter Mikus <pmikus@cisco.com>

Add static MAC entries to configuration

- Add static MAC entries to sfc_controller configuration of all l2bdbase
tests.

Change-Id: I38ba32246ed20204c5be1f98b0454b71dcff2e00
Signed-off-by: Peter Mikus <pmikus@cisco.com>

6e25bb5e 06-Jan-2018 Peter Mikus <pmikus@cisco.com>

Update vpp-agent version

- Fix small bug in kubectl get pods
- Update vpp-agent release version
- Add ability to recompile vpp-agent from VPP. This could eliminate issue in case of some API mismatch)

Change-Id: Id9e8758017f3e5504e8a19b607b8ac37f26cf945
Signed-off-by: Peter Mikus <pmikus@cisco.com>

b5fe0fd9 05-Jan-2018 Peter Mikus <pmikus@cisco.com>

VatHistory: Add ability to trace file executions

Change-Id: I9f6de8d2b86ddbbdf1524dcc12d8ed5a33b3266e
Signed-off-by: Peter Mikus <pmikus@cisco.com>

45393e98 04-Jan-2018 Peter Mikus <pmikus@cisco.com>

CSIT-885 Updagrade TRex to v2.35

Change-Id: I82681fc9ea52d72323d48ac78507ef1c571ca712
Signed-off-by: Peter Mikus <pmikus@cisco.com>

f4e3171e 04-Jan-2018 Peter Mikus <pmikus@cisco.com>

FIX: Pylint errors

Change-Id: I93eae6d25da6a7cb51465e622ab068f408ab4079
Signed-off-by: Peter Mikus <pmikus@cisco.com>

03f1fa8f 19-Dec-2017 Jan Gelety <jgelety@cisco.com>

CSIT-817: L2 keywords for SRv6

- keywords to configure SRv6 on DUT

Change-Id: Ida3b88dd31c78caa3c4ef317996677838a65a658
Signed-off-by: Jan Gelety <jgelety@cisco.com>

92cbb44a 02-Jan-2018 Peter Mikus <pmikus@cisco.com>

TRex ASTF onboarding Part I

- Preparing initialization of TRex in L7 mode
- Updating Topology files
- Adding sample ASTF profiles

Change-Id: If71f7f8f3db66425a1b543f1d29069a7543f4090
Signed-off-by: Peter Mikus <pmikus@cisco.com>

c293eae5 03-Jan-2018 Peter Mikus <pmikus@cisco.com>

Update DPDK to v17.11

Change-Id: Ib6db506d2691369ac7371a6a678c9dbc04a269d4
Signed-off-by: Peter Mikus <pmikus@cisco.com>

7aa6f992 03-Jan-2018 Peter Mikus <pmikus@cisco.com>

Increase heapsize in default startup configuration

Change-Id: Ie9710d6901ab2d134e82a38f6eee1e9e5f88464c
Signed-off-by: Peter Mikus <pmikus@cisco.com>

0437095f 05-Dec-2017 Peter Mikus <pmikus@cisco.com>

CSIT-870 Kubernetes/Ligato integration

- Update overall Kubernetes/Ligato integration
- CSIT-871 Update infrastructure / images
- CSIT-872 Update of KubernetesUtils.py

Change-Id: I7833f56abd351c694d3d3e1c9c45e649aec892e1
Signed-off-by: Peter Mikus <pmikus@cisco.com>

d7cf0a82 30-Dec-2017 Peter Mikus <pmikus@cisco.com>

FIX: Force kill QEMU in case of failed initialization

Change-Id: Ib9c243b1bd379cf33a2b7747b7f97a8533000d60
Signed-off-by: Peter Mikus <pmikus@cisco.com>

ab94abd6 10-Nov-2017 Tibor Frank <tifrank@cisco.com>

Upgrade to T-rex v2.34

Change-Id: I7e18ba8beaac507af376a859821ef7d571cbff80
Signed-off-by: Tibor Frank <tifrank@cisco.com>

0ba508f0 05-Dec-2017 Jan Gelety <jgelety@cisco.com>

CSIT-861: SW cryptodev perf tests

Change-Id: I687216ca43569542d38be681ca04c898010fc65d
Signed-off-by: Jan Gelety <jgelety@cisco.com>

2291eaac 13-Dec-2017 Jan Gelety <jgelety@cisco.com>

CSIT-816: SRv6 L1 KWs

Current implementation doesn't contain:
* weight
* fib-table for BSID
* policy index identification

These features will be added on demand later.

Change-Id: I1386c0a0e71f7ae3182b84e0ec5bb245366632d1
Signed-off-by: Jan Gelety <jgelety@cisco.com>

7174e36c 17-Nov-2017 Thomas F Herbert <therbert@redhat.com>

More reliable connection with nested qemu image.

Under some circumstances on a busy server, the qga channel
between the host and hte virtual guest has some garbage
characters that cause the communications to fail.
This has been seen on Centos 7.4 on a slow or busy server.

This change sends a flush to qemu guest via the qga socket at 5
second intervals until there is a non empty response from guest
before sending a guest ping.

Change-Id: I6f21c205b289169aee9d6a4072ad4e6bafafa76f
Signed-off-by: Thomas F Herbert <therbert@redhat.com>

e4744a48 01-Dec-2017 Jan Gelety <jgelety@cisco.com>

Exclude RPMs and output xml files from framework packing

Change-Id: Id79c3c54b9bacc10f15c5881492592e69ef3649b
Signed-off-by: Jan Gelety <jgelety@cisco.com>

69bc7317 16-Nov-2017 Jan Gelety <jgelety@cisco.com>

CSIT-859: KW to add crypto SW device to startup.conf

Change-Id: I8441d58a2d7f604b64fff358a3cef8d72289dcdc
Signed-off-by: Jan Gelety <jgelety@cisco.com>

7b704441 27-Nov-2017 Jan Gelety <jgelety@cisco.com>

CSIT-864: Add cleanup framework

- workaround to avoid disc space issue on nodes when running more
test loops

Change-Id: I0be2fe0304c80c717a29d6544502e139e69bcdfa
Signed-off-by: Jan Gelety <jgelety@cisco.com>

60b38270 12-Nov-2017 Jan Gelety <jgelety@cisco.com>

FIX: Tear down FDS functional test

- use standard Tear down functional test as part of tear down for FDS tests

Change-Id: I8540683cd9c817445461cc596821fe797c1636c5
Signed-off-by: Jan Gelety <jgelety@cisco.com>

7bfb36df 17-Oct-2017 Jan Gelety <jgelety@cisco.com>

CSIT-843: Update actual topology in case of new/updated/deleted interface

Change-Id: I6adfe86bd0b9cdf3d194a1b871e52481c333d8e7
Signed-off-by: Jan Gelety <jgelety@cisco.com>

e4260754 08-Nov-2017 selias <samelias@cisco.com>

HC Test: exception handling for restconf GET operation

When response to GET is 404, json loads() may fail with ValueError.

Change-Id: If627574bb7909a105d13381a2b89445f527ccb7b
Signed-off-by: selias <samelias@cisco.com>

56dd61de 09-Oct-2017 selias <samelias@cisco.com>

CSIT-811 HC Test: BGP functional tests

Added traffic tests for Honeycomb's BGP feature.

Change-Id: I5fa99908ab61d8bc9d2975e451917b98571b6aca
Signed-off-by: selias <samelias@cisco.com>

ee9c5163 30-Oct-2017 selias <samelias@cisco.com>

HC Test: Update list of Honeycomb BGP modules

BGP functionality was split into additional modules in
https://gerrit.fd.io/r/8486

Change-Id: I1cf5971fa8cb5f0cde17306bdc06ebe7f3008473
Signed-off-by: selias <samelias@cisco.com>

58e4d622 27-Oct-2017 selias <samelias@cisco.com>

HC Test: Fix missing import in performance job setup

Change-Id: Ib125fbaf38e2a10892d2bbaf4cd68121dd2247ce
Signed-off-by: selias <samelias@cisco.com>

c6a49fe4 26-Oct-2017 Fangyin Hu <fangyinx.hu@intel.com>

Fix the NSH SFC functional test failed issue.

Change-Id: If118254b6479f7ffb3e0b4f81d3585b4b90cc92c
Signed-off-by: Fangyin Hu <fangyinx.hu@intel.com>
(cherry picked from commit 751a5aed2cac6bd7b87028eaf7eab1a8f87fface)

eb9eec20 26-Oct-2017 Fangyin Hu <fangyinx.hu@intel.com>

Update the NSH protocol header fields
Fix the NSH SFC functional test cases failed issues.

Change-Id: I5d49b50a8c0958dc8db4bc10d6852f0cf4e77962
Signed-off-by: Fangyin Hu <fangyinx.hu@intel.com>

04f2c49d 23-Oct-2017 Jan Gelety <jgelety@cisco.com>

FIX: use correct IF name in Vpp Route Add in case of multi-VMs config

Change-Id: Iab5a6db1eac11798e2a3ec56f7d68043f6c8c2ab
Signed-off-by: Jan Gelety <jgelety@cisco.com>

2cc797fa 22-Oct-2017 Jan Gelety <jgelety@cisco.com>

FIX: IPSec tunnel interface

- add following line per interface tunnel:
set int unnum <ipsec> use <interface>

Change-Id: Iff75f27b7cf25f3d24eea92366b1fd4a718c253b
Signed-off-by: Jan Gelety <jgelety@cisco.com>

9ce4ca3b 19-Oct-2017 selias <samelias@cisco.com>

HC Test: Fix expected error when ACL table should be empty

Due to VATExecutor changes in https://gerrit.fd.io/r/8679

Change-Id: Iaecf6ff7b2562ff111a3afbce0ecbb2df00c62a9
Signed-off-by: selias <samelias@cisco.com>

9d62c4fa 18-Oct-2017 Jan Gelety <jgelety@cisco.com>

FIX: apply changes implemented for FIB settings

Change-Id: I00c3407f4324e282c438cb8fcd44470c331089c5
Signed-off-by: Jan Gelety <jgelety@cisco.com>

59eb880b 17-Oct-2017 Peter Mikus <pmikus@cisco.com>

CSIT-748 Add K8S 2memif-2vnf topologies

Change-Id: I23e118bf9fc9cfd638ac3ec0589f2ced14cc240c
Signed-off-by: Peter Mikus <pmikus@cisco.com>

f3e80e15 17-Oct-2017 Jan Gelety <jgelety@cisco.com>

FIX: Log MACIP ACL settings only if test failed

Change-Id: I6d51c662d8b23789adcd9c3d1b1e8736f71d5279
Signed-off-by: Jan Gelety <jgelety@cisco.com>

b015ecf0 17-Oct-2017 Peter Mikus <pmikus@cisco.com>

CSIT-841 Optimize cheking k8s POD state

Change-Id: Ie1725c0017b78945e431f493743f9a01a66e83c2
Signed-off-by: Peter Mikus <pmikus@cisco.com>

4d2e646f 05-Oct-2017 Jan Gelety <jgelety@cisco.com>

CSIT-828: Fix the output of failed VAT execution

Change-Id: Id387bd685142dcfaa17f0236e930e40e6c0bce5a
Signed-off-by: Jan Gelety <jgelety@cisco.com>

fcaf06ab 12-Oct-2017 Peter Mikus <pmikus@cisco.com>

CSIT-841 Optimize creating of vnf-agent docker image Part I

- Optimize building of prod_vpp_agent docker image by using
dev_vpp_agent docker image pulled from dockerhub/ligato instead of
building on slave.
- Add detailed logs from every POD deployed in namespace.
- Hardening condition for considering PODs Running.

Change-Id: I9f771d6365d38fef2ec2e00ab642853e6a44ad03
Signed-off-by: Peter Mikus <pmikus@cisco.com>

9a261ea6 22-Sep-2017 Peter Mikus <pmikus@cisco.com>

CSIT-748 vnf-agent integration

CSIT-773 Implement RF keywords for k8s

- Implementation of Test Suite Setup for Ligato vnf-agent testing
- Implementation of KubernetesUtil for controlling kubectl
- Yaml templates for L2XC topology with 1cswitch and 1cnf
- Yaml templates for L2BD topology with 1cswitch and 1cnf
- ligato bootstrap script for creating vnf-agent image

Change-Id: Iebefde0eb984a27a0afcdf29fe549ca4edf8a61e
Signed-off-by: Peter Mikus <pmikus@cisco.com>

5a02dd13 29-Sep-2017 selias <samelias@cisco.com>

CSIT-811 HC Test: BGP tests - IPv4 CRUD

Tests configure BGP neighbor peers and simple routes for these peers.

Change-Id: I5102986d710551a451e838d934cc9650bcd38a60
Signed-off-by: selias <samelias@cisco.com>

bdfca054 14-Aug-2017 Jan Gelety <jgelety@cisco.com>

CSIT-778: Add mac-ip binding acl l2bd perf test

Change-Id: Iaced68458b0e4070f861be7854ee428ae8ca4e13
Signed-off-by: Jan Gelety <jgelety@cisco.com>

442a2a7b 15-Aug-2017 selias <samelias@cisco.com>

CSIT-775 HC Test: CRUD over IPv6 control-plane interface

Adds new test suite which accesses Honeycomb's Restconf and Netconf northbound
over IPv6. This is done by sending the requests to TG where an IPv4 to IPv6
tunnel is configured to the Honeycomb DUT.

Change-Id: I3b7467d8108b0da9756e632851215c66ed41bb61
Signed-off-by: selias <samelias@cisco.com>

e65ba17d 14-Aug-2017 Neale Ranns <nranns@cisco.com>

FIB table add/delete

Change-Id: Icadb4884a1c08a2230fd4692df69310ce382ec94
Signed-off-by: Neale Ranns <nranns@cisco.com>

df5ed0d9 21-Aug-2017 Peter Mikus <pmikus@cisco.com>

CSIT-768: Refactor Python container libraries
CSIT-769: Implement L2 RF keywords for container orchestration

Change-Id: I7637d1ecc3a45111522b8d6c578b3f88369aff6b
Signed-off-by: Peter Mikus <pmikus@cisco.com>

08e35e37 04-Oct-2017 selias <samelias@cisco.com>

HC Test: remove log check from HC startup

- remove log check from "Check Honeycomb Startup State" keyword
- fix workaround for ODL startup issue
- change log level for HttpRequestError so it doesn't clutter
log.html output
- update EXPECTED_FAILING tags for plugin-acl and routing suites

Change-Id: I7380d24801a6535bdf77505edada39ea2412e833
Signed-off-by: selias <samelias@cisco.com>

fcee621d 03-Oct-2017 selias <samelias@cisco.com>

HC Test: increase timeout for archiving HC log file

- add timeout parameter to ssh.scp method
- increase timeout in "Archive Honeycomb Log" keyword
- increase timeout for copying ODL client in setup

Change-Id: I9e914d5f439fd14471b10b611efdbb6afada4c6e
Signed-off-by: selias <samelias@cisco.com>

0513ce56 20-Sep-2017 selias <samelias@cisco.com>

HC Test: Fix intermittent failures of HC startup

- rework "check Honeycomb startup state" keyword
- increase timeout value for startup
- add separators to Honeycomb log file between test suites
- other minor fixes:
- remove usused import from NAT suite
- fix loop in ICMPv6 ND proxy traffic script
- add teardown to LISP cases
- update prerequisites for sub-interface SPAN test

Change-Id: I2f714ffc1d2e8435d3abe690d8bd15099e071c9a
Signed-off-by: selias <samelias@cisco.com>

9ca5e946 26-Sep-2017 Peter Mikus <pmikus@cisco.com>

FIX: Vhost tests waiting for VirtualEthernet UP

Due to the change in VPP #8472
When changing the admin state of a vhost-user interface, do not put
it in link-up mode if the interface is not actually ready.

We have to remove "All Vpp Interfaces Ready Wait" for VirtualEthernet
interfaces.

Change-Id: I70d60b9f54a75b18b179f3315b636b763962acdd
Signed-off-by: Peter Mikus <pmikus@cisco.com>

f3350420 11-Aug-2017 selias <samelias@cisco.com>

HC Test: update ODL startup in hc2vpp jobs

- mountpoint configuration through controller-config is deprecated. Use the
new method through odl-netconf-topology feature.

Change-Id: I1297622db7ab6a3853b3c97ab7f59c31b4269b6d
Signed-off-by: selias <samelias@cisco.com>

c9e827ea 18-Sep-2017 Jan Gelety <jgelety@cisco.com>

CSIT-796: l2bd-memif perf tests

Change-Id: Ic714fa7baec49dcba1a8eb6a578183c6771e3493
Signed-off-by: Jan Gelety <jgelety@cisco.com>

d40746ab 24-Aug-2017 Dasa Simkova <dspropagacie@gmail.com>

CSIT-665: Re-write L1 robot keywords in python

Change-Id: Iddd823375ddd17b9abd5f02ee3aea3bfcb625149
Signed-off-by: Dasa Simkova <dspropagacie@gmail.com>

28dd384d 27-Aug-2017 selias <samelias@cisco.com>

HC Test: re-enable NSH tests, minor fixes

NSH plugin was fixed in https://gerrit.fd.io/r/8218

- updated lispGPE test data
- added missing teardown to multi-IP traffic test
- marked L2-fib update revert case as failing

Change-Id: I5cf8c718e808d5d8cb69e2f769c829c868bf9924
Signed-off-by: selias <samelias@cisco.com>

fb81da59 03-Sep-2017 Peter Mikus <pmikus@cisco.com>

Update T-rex to v2.29

Change-Id: Id60525182cbe5870f40aebf165e8bd86c101d267
Signed-off-by: Peter Mikus <pmikus@cisco.com>

2bdb1dc5 24-Aug-2017 Peter Mikus <pmikus@cisco.com>

FIX: SNAT -> NAT renaming of API

- Based on https://gerrit.fd.io/r/#/c/8146/

Change-Id: I774483c7e2b419a9b9b6be78812ecf53a5c91eab
Signed-off-by: Peter Mikus <pmikus@cisco.com>

b9ce06b1 28-Aug-2017 Peter Mikus <pmikus@cisco.com>

Fix: Do not validate LXC image

Change-Id: I476f463ad7dd91f1d80a1e4b537a2cb3dd4ddee5
Signed-off-by: Peter Mikus <pmikus@cisco.com>

4efd01a4 24-Aug-2017 Peter Mikus <pmikus@cisco.com>

Update T-rex to v2.28

Change-Id: I506589c3785eec3a2eaa9fdb32bfc3375388d6f4
Signed-off-by: Peter Mikus <pmikus@cisco.com>

a75ddafd 14-Aug-2017 Jan Gelety <jgelety@cisco.com>

CSIT-777: L2 keywords for MACIP ACL tests

Change-Id: I678d87770405105555ccc30ce0003f704d7ca82e
Signed-off-by: Jan Gelety <jgelety@cisco.com>

ee52db86 09-Aug-2017 selias <samelias@cisco.com>

HC Test: cleanup test failures

- have unnumbered interface cases use a real interface instead of local0
- add EXPECTED_FAILING tag and Jira link to known failing test cases

Change-Id: I8bc0f4a74ea1949289a3f12dd54168acdf9edc39
Signed-off-by: selias <samelias@cisco.com>

8cde8711 10-Aug-2017 Jan Gelety <jgelety@cisco.com>

CSIT-777: L1 keywords for MACIP ACL tests

Change-Id: I90eb824cbabaaece6798812268177ad9bd4eff65
Signed-off-by: Jan Gelety <jgelety@cisco.com>

c38cb34d 13-Jul-2017 selias <samelias@cisco.com>

CSIT-611: HC Test: Lisp suite updates + LispGPE

- added LispGPE test suite
- added IPv6 tests to Lisp suite
- added traffic tests to Lisp suite

Change-Id: I3b699149cd73ebf5856072d3f26e98a370dbfc4b
Signed-off-by: selias <samelias@cisco.com>

0cd7a2d0 29-Jun-2017 Jan Gelety <jgelety@cisco.com>

CSIT-699: Add l2bd+dot1q perf tests

Change-Id: I3d8cbb235918331b3c60147f7870a4aa90036748
Signed-off-by: Jan Gelety <jgelety@cisco.com>

172228fe 26-Jul-2017 selias <samelias@cisco.com>

HC Test: add mising sudo to ODL client statup

Change-Id: I5231cb131f09edc0271c99095aacbf68144e7ded
Signed-off-by: selias <samelias@cisco.com>

c70b9cd6 21-Jul-2017 Tibor Frank <tifrank@cisco.com>

Fix pylint errors

Change-Id: I9b8d69978ee35bf7610cdfd372135ce3515eec96
Signed-off-by: Tibor Frank <tifrank@cisco.com>

dc028831 21-Jul-2017 selias <samelias@cisco.com>

HC Test: update HC config file locations

Config location changed in:
https://gerrit.fd.io/r/#/c/7345/
https://gerrit.fd.io/r/#/c/7411/

Change-Id: I6eac14581f5cc4b23885e38753612962f7b807c7
Signed-off-by: selias <samelias@cisco.com>

e4071a51 20-Jul-2017 Jan Gelety <jgelety@cisco.com>

FIX: run build qemu only for the 1st VM on DUT

Change-Id: Ib0fd10e9cb0c6eaeb75ec96e4459d5fb27c656bf
Signed-off-by: Jan Gelety <jgelety@cisco.com>

835cb643 07-Jul-2017 selias <samelias@cisco.com>

HC Test: bugfixes for hc2vpp ODL jobs

- add shutdown check for ODL client in teardown
- stop VPP in teardown

- add delay after HC startup
HC features load asynchronously, no way to check if they're all running.

Change-Id: I9d2c51b68ba51284d2d409a77d6cd9fd478e1725
Signed-off-by: selias <samelias@cisco.com>

59065890 20-Jul-2017 Jan Gelety <jgelety@cisco.com>

FIX: fix of multiple perf test issues

Change-Id: I24c823352b2832eb6da2aad0fd70570beb990f3f
Signed-off-by: Jan Gelety <jgelety@cisco.com>

38d99570 19-Jul-2017 Jan Gelety <jgelety@cisco.com>

FIX: typo issues in teardown for ACL perf tests

Change-Id: I2232b010efb4f4b071a0fe3efaaeb85f2830bf3c
Signed-off-by: Jan Gelety <jgelety@cisco.com>

cb6b9fd6 07-Jul-2017 Jan Gelety <jgelety@cisco.com>

CSIT-704: Add ACL IP4BASE perf tests

Change-Id: I1fada28f2855534faf3b3051a3efe1cbb4dcdd03
Signed-off-by: Jan Gelety <jgelety@cisco.com>

ebf71b8e 19-Jul-2017 Peter Mikus <pmikus@cisco.com>

FIX: Do not download Qemu multiple times per job

- Add caching of Qemu source code to avoid downloading multiple times.

Change-Id: Ie06dd87a08c38ca27fbe9844f25f11b8df1ff2e2
Signed-off-by: Peter Mikus <pmikus@cisco.com>

e40cf5b4 18-Jul-2017 Peter Mikus <pmikus@cisco.com>

FIX: Initialize L2BD keyword

Currently in Performance the "Initialize L2 bridge domain" keyword is adding
interfaces to L2DB per node and at the same time waiting until interfaces
become UP. This may be an issue if physical interfaces interconnecting DUTs
required to be administratively UP on both DUTs to physical link state became
UP.

This fix is supposed to check the link state after all DUTs are
initialized.

Change-Id: I430b4285967f6168e6c74e0089a3e0d037b251d1
Signed-off-by: Peter Mikus <pmikus@cisco.com>

997a1485 17-Jul-2017 Tibor Frank <tifrank@cisco.com>

CSIT-723: Source code auto-generation for 1707

Change-Id: Ia178ac180fd344db620757dcc2b9cbb5010276c7
Signed-off-by: Tibor Frank <tifrank@cisco.com>

c76f8f80 14-Jul-2017 Fangyin Hu <fangyinx.hu@intel.com>

Fix the TLDK test tcpdump not found issue.
Add the PYBOT execute exit status code.

Change-Id: If0fc29c580177f1b187ec751c6708fc138838bed
Signed-off-by: Fangyin Hu <fangyinx.hu@intel.com>

b4157d62 13-Jul-2017 Jan Gelety <jgelety@cisco.com>

FIX: remove previous QEMU build when needed to change qsz

Change-Id: I949f8800b45354c205c5a5d36ab2abeeb93409dc
Signed-off-by: Jan Gelety <jgelety@cisco.com>

71c7b4a4 07-Jul-2017 Fangyin Hu <fangyinx.hu@intel.com>

Fix the TLDK test scripts execute path issue.

Change-Id: I7d0c20443db841516942479a067561c822a03bbd
Signed-off-by: Fangyin Hu <fangyinx.hu@intel.com>

dcf7d0e5 05-Jul-2017 selias <samelias@cisco.com>

HC Test: increase timeout value for ODL setup

Change-Id: I9be9ef6bb6751fbaa61115d2052433e14b4b14fb
Signed-off-by: selias <samelias@cisco.com>

cd288d8e 05-Apr-2017 Jan Gelety <jgelety@cisco.com>

CSIT-622: Stateful Security Groups perf tests

1. add L2BD iACL statefull and stateless tests with 1, 10 and 50 not-hitting
ACEs in combination with 100, 10k and 100k flows per direction

2. add L2BD oACL statefull and stateless tests with 1, 10 and 50 not-hitting
ACEs in combination with 100, 10k and 100k flows per direction

Change-Id: Ia38589aa81b50c5ccdf2813ad6fadd22b46fffeb
Signed-off-by: Jan Gelety <jgelety@cisco.com>

176e4a72 23-Jun-2017 Jan Gelety <jgelety@cisco.com>

CSIT-660: add vring1024 tuned CFS for vpp workers and guest-testpmd

- add vhost tests (L2XBD, L2XC and IP4BASE) with vring set to 1024 and
tuned CFS setting

Change-Id: Ief8b4b86cdecfa39bf8cf0ec90fb844edfc6f396
Signed-off-by: Jan Gelety <jgelety@cisco.com>

be95deb1 06-Jun-2017 Jan Gelety <jgelety@cisco.com>

CSIT-661: re-add vring256 tuned CFS for vpp workers and guest-testpmd

1. add vhost tests (L2XBD, L2XC and IP4BASE) with vring set to 256 and
tuned CFS setting
2. add vhost tests (L2XBD, L2XC and IP4BASE) with vring set to 256 and
default CFS setting

Change-Id: I25aae6839d3e621316d35f5c9525389a6faabd56
Signed-off-by: Jan Gelety <jgelety@cisco.com>

bc26e009 05-Jul-2017 Peter Mikus <pmikus@cisco.com>

Fix: DPDK paths after code refactor

Change-Id: I0cc83c48e0c91cdff13f78c65c521f45e551d7a3
Signed-off-by: Peter Mikus <pmikus@cisco.com>

050ece3a 27-Jun-2017 Fangyin Hu <fangyinx.hu@intel.com>

Change the bootstrap script file and test the CI-management.
Debug the NSH SFC functional test.
Change the test cases and not use the tcpdump.
Delete the unused code.
Change the directory structure.

Change-Id: I52486b9ba4b02e305f702ffc8cdb84e941cb18ff
Signed-off-by: Fangyin Hu <fangyinx.hu@intel.com>

d166ae08 06-Jun-2017 Peter Mikus <pmikus@cisco.com>

CSIT-651 Add keywords and template for memif

Add keywords and template for memif

Change-Id: I8bd5cfe345260750a74930c8ef55690be5f2dd5e
Signed-off-by: Peter Mikus <pmikus@cisco.com>

036e5a85 28-Jun-2017 Peter Mikus <pmikus@cisco.com>

XL710 Configure rxd/txd 2048

Configure RX-desc and TX-desc to 2048 for FVL XL710 cards.

Change-Id: I1876f332bdc6100bf24f2b2317de33c0d1a4c9bf
Signed-off-by: Peter Mikus <pmikus@cisco.com>

d32194f3 26-May-2017 selias <samelias@cisco.com>

CSIT-619 HC Test: Honeycomb performance testing - initial commit

- keywords and scripts for HC performance testing setup
- basic performance suite: operational data read
- traffic script and keywords used in tests

Change-Id: Ic0290be73a7c925ea2561f8cd2524c5cb83fcda2
Signed-off-by: selias <samelias@cisco.com>

4a946c16 29-Jun-2017 selias <samelias@cisco.com>

HC Test: bugfix for SLAAC and ODL tests

Change-Id: I0a09482e8dc9ef2f9e6cd54a26c8d8492409f68c
Signed-off-by: selias <samelias@cisco.com>

6721e7f0 20-Jun-2017 Tibor Frank <tifrank@cisco.com>

CSIT-687: Directory structure reorganization

Change-Id: I772c9e214be2461adf58124998d272e7d795220f
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>

b7f0c133 21-Jun-2017 selias <samelias@cisco.com>

HC Test: improve functional suite setup and teardown

Restart the whole stack (VPP+Honeycomb+-ODL) in between test suites.
Add generic suite setup and suite teardown keywords for all func suites
Re-enable NSH_SFC suite, cleanup test failures

Change-Id: I71025b4ed3a7c4912dcd7b62aedef6082357990c
Signed-off-by: selias <samelias@cisco.com>

41bded22 16-Jun-2017 Tibor Frank <tifrank@cisco.com>

CSIT-683: Re-organize L2 libraries - func

Change-Id: I5444dfba68ea41d8190d6615e23505f3c08c377c
Signed-off-by: Tibor Frank <tifrank@cisco.com>

81d487b1 21-Jun-2017 Tibor Frank <tifrank@cisco.com>

CSIT-614: Create PDRCHK tests

- CSIT-639: 10ge2p1x520-dot1q-l2bdbasemaclrn-eth-2vhost-1vm-pdrchk
- CSIT-640: 10ge2p1x520-dot1q-l2xcbase-eth-2vhost-1vm-pdrchk
- CSIT-641: 10ge2p1x520-ethip4-ip4base-eth-2vhost-1vm-pdrchk
- CSIT-642: 10ge2p1x520-eth-l2xcbase-eth-2vhost-1vm-pdrchk

Change-Id: Id676c69abe34e455ca298f7225fd065fc6cc8218
Signed-off-by: Tibor Frank <tifrank@cisco.com>

45aa8056 22-Jun-2017 Peter Mikus <pmikus@cisco.com>

Update of LXCUtil library

Change-Id: I1a095e45960ca004413c4ecbfd410e41fb621c74
Signed-off-by: Peter Mikus <pmikus@cisco.com>

665b506d 20-Jun-2017 Jan Gelety <jgelety@cisco.com>

VIRL VPP PID fix

- use three tries to get PID of VPP process

Change-Id: If72784dfc2c5600aae703dff9170c4f491a3b685
Signed-off-by: Jan Gelety <jgelety@cisco.com>

086f3a50 14-Jun-2017 Tibor Frank <tifrank@cisco.com>

CSIT-678: Re-organize L2 libraries - performance

Change-Id: Ic4e37df31fbc10f15351e3671b541e6f047405bc
Signed-off-by: Tibor Frank <tifrank@cisco.com>

b47b29bd 15-Jun-2017 qun wan <qun.wan@intel.com>

Patches for the tldk functional test cases.

Change-Id: I0a70339edaff4c0e023c586ff84c8085ae6bc9c0
Signed-off-by: qun wan <qun.wan@intel.com>

1ce01dad 30-May-2017 Peter Mikus <pmikus@cisco.com>

CSIT-649 Add library for creating lxc container

Add RF library for manipulating lxc container
Add python library for manipulating lxc container

Change-Id: I02140aa879c7ebd40360d588ab1438c58cf560a1
Signed-off-by: Peter Mikus <pmikus@cisco.com>

53d69321 08-Jun-2017 Tibor Frank <tifrank@cisco.com>

CSIT-664: Refactor setups and teardowns

- Add suite setup for performance IPSec tests
- Add test teardown for performance SNAT tests
- Add setups and teardowns for functional tests
- Clean up the code

Change-Id: Ia456e9f3ff0f0f2bb9a03f692f27c7f9a2817621
Signed-off-by: Tibor Frank <tifrank@cisco.com>

5f6802ba 09-Jun-2017 Peter Mikus <pmikus@cisco.com>

CSIT-646 Refactor VPPConfigGenerator script

Currently the VPPConfigGenerator script is not modular enough for creating
all combinations of VPP startup configuration. This patch is supposed to
implement unified structured way to create all configuration options.

Change-Id: If3f9cf5dc838fe0a698ea1c601abff6c4c0468b5
Signed-off-by: Peter Mikus <pmikus@cisco.com>

4e565011 07-Jun-2017 Tibor Frank <tifrank@cisco.com>

CSIT-663: Remove unused keywords

Change-Id: Ib3f0edb0c3a48a760040886e5aedce81c9baeac2
Signed-off-by: Tibor Frank <tifrank@cisco.com>

5ce772f3 11-Apr-2017 Fangyin Hu <fangyinx.hu@intel.com>

Add the NSH SFC functional test cases.
1. Proxy Inbound test with 152/256/512/1024/1280/1518 Bytes VxLAN-GPE + NSH packet
2. Proxy Outbound test with 128/256/512/1024/1280/1518 Bytes VxLAN packet
3. SFC SFF test with 152/256/512/1024/1280/1518 Bytes VxLAN-GPE + NSH packet

Separate the functional test bootstrap file to another code review.

Change-Id: I05cf6ab1d01c1b41c1c61044d6d31fd6219b86af
Signed-off-by: Fangyin Hu <fangyinx.hu@intel.com>

430afafb 01-Jun-2017 Tibor Frank <tifrank@cisco.com>

CSIT-662: KWI - KW renaming

- plus: CSIT-656: Script to rename robot keywords.

Change-Id: Ia69917e406a1b346b80e5ea742f6200c1c9e9d21
Signed-off-by: Tibor Frank <tifrank@cisco.com>

7436d8bd 30-Mar-2017 Qun Wan <qun.wan@intel.com>

TLDK udwfwd test case:
- ip fragement for ipv4
- ip reassemble for ipv4
- ip checksum for ipv4
- ip checksum for ipv6
- ip fragment for ipv6

added the genpcap.py script to generate the pcap files and corresponding
test scripts

Change-Id: I01329dbb0ecd3c3a5dd7a63ef1dea01b2e717da5
Signed-off-by: qun wan <qun.wan@intel.com>

d058458c 31-May-2017 Peter Mikus <pmikus@cisco.com>

VIRL lspci fix

Change-Id: I884b56c5cc2e0d5f40c0e9d0b5fb7356dc3b4028
Signed-off-by: pmikus <pmikus@cisco.com>

9339a167 25-May-2017 Tibor Frank <tifrank@cisco.com>

CSIT-614: PDRCHK test for vpp-csit-verify-hw-perf job

Create PDRCHK test:

a. vpp-verify-perf-l2
i. 10Ge2P1X520-Eth-L2Bdbasemaclrn-pdrchk
ii. 10Ge2P1X520-Eth-L2Xcbase-pdrchk

b. vpp-verify-perf-ip4
i. 10Ge2P1X520-Ethip4-Ip4Base-pdrchk

c. vpp-verify-perf-ip6
i. 10Ge2P1X520-Ethip6-Ip6Base-pdrchk
ii. 10Ge2P1X520-Ethip6-Ip6Scale2M-pdrchk

d. vpp-verify-perf-lisp
i. 10Ge2P1X520-Ethip4Lispip4-Ip4Base-pdrchk
ii. 10Ge2P1X520-Ethip4Lispip6-Ip4Base-pdrchk
iii. 10Ge2P1X520-Ethip6Lispip4-Ip6Base-pdrchk
iv. 10Ge2P1X520-Ethip6Lispip6-Ip6Base-pdrchk

e. vpp-verify-perf-vxlan
i. 10ge2p1x520-ethip4vxlan-l2xcbase-pdrchk

Change-Id: If232b0375140b884f1b65c380faf5bd77c5df5c3
Signed-off-by: Tibor Frank <tifrank@cisco.com>

54021405 18-May-2017 selias <samelias@cisco.com>

CSIT-610 HC Test: add test cases for unnumbered interface

- add interface and sub-interface tests with unnumbered config
- modify interface IPv4 address assignment to handle custom interfaces
and sub-interfaces
- pylint and style fixes

Change-Id: Ic39df1655b4d44f0025a2acef9f7f968929aeff5
Signed-off-by: selias <samelias@cisco.com>

b92b5be7 04-Apr-2017 Tibor Frank <tifrank@cisco.com>

CSIT-524: Traffic generator using python profiles

Profile name structure:
[trex|ixia]-[sl|sf]-[topo]-[packet structure]-[scale]

- Traffic generator - T-rex (trex) or Ixia (ixia)
- Stateless (sl) or statefull (sf)
- Topology - 2-node topology (2n) or 3-node topology (3n)
- Packet structure - eth | ip4/6 | udp
- Scale - e.g. ip4dst1, ip6dst10000, 4000u15p

Traffic types changed to stream profiles:

- From: 2-node-bridge
To: trex-sl-2n-ethip4-ip4src253

- From: 3-node-bridge
To: trex-sl-3n-ethip4-ip4src254

- From: 3-node-IPv4-dst-1000000
To: trex-sl-3n-ethip4-ip4dst1000000

- From: 3-node-IPv4-dst-100000
To: trex-sl-3n-ethip4-ip4dst100000

- From: 3-node-IPv4-dst-10000
To: trex-sl-3n-ethip4-ip4dst10000

- From: 3-node-IPv4-dst-1000
To: trex-sl-3n-ethip4-ip4dst1000

- From: 3-node-IPv4-dst-100
To: trex-sl-3n-ethip4-ip4dst100

- From: 3-node-IPv4-dst-1
To: trex-sl-3n-ethip4-ip4dst1

- From: 3-node-IPv4
To: trex-sl-3n-ethip4-ip4src253

- From: 3-node-IPv6-dst-1000000
To: trex-sl-3n-ethip6-ip6dst1000000

- From: 3-node-IPv6-dst-100000
To: trex-sl-3n-ethip6-ip6dst100000

- From: 3-node-IPv6-dst-10000
To: trex-sl-3n-ethip6-ip6dst10000

- From: 3-node-IPv6
To: trex-sl-3n-ethip6-ip6src253

- From: 3-node-xconnect
To: trex-sl-3n-ethip4-ip4src254

- From: 3-node-IPv4-SNAT-1000u-15p
To: trex-sl-3n-ethip4udp-1000u15p

- From: 3-node-IPv4-SNAT-100u-15p
To: trex-sl-3n-ethip4udp-100u15p

- From: 3-node-IPv4-SNAT-10u-15p
To: trex-sl-3n-ethip4udp-10u15p

- From: 3-node-IPv4-SNAT-1u-15p
To: trex-sl-3n-ethip4udp-1u15p

- From: 3-node-IPv4-SNAT-1u-1p
To: trex-sl-3n-ethip4udp-1u1p

- From: 3-node-IPv4-SNAT-2000u-15p
To: trex-sl-3n-ethip4udp-2000u15p

- From: 3-node-IPv4-SNAT-4000u-15p
To: trex-sl-3n-ethip4udp-4000u15p

Change-Id: If6a3cf204c93ff9f2cdccc5fd395e26b05483b58
Signed-off-by: Tibor Frank <tifrank@cisco.com>

43e7440a 28-May-2017 Jan Gelety <jgelety@cisco.com>

Do not fail test case when no vpp pid detected in the tear down

- currently when no pid (or more pids) detected in the test case
tear down of successfully run test case not only the WARN message
is logged but the whole test case is failed

- to change this behaviour but keep test case failure if no vpp pid
(or more vpp pids) detected in test case setup the low level KW
"Get VPP PID" behaviour has been changed to return one or more
pids or None w/o raising an error and check has been moved to
higher level KW "Save VPP PIDs"

- there was added suite name and test case name to WARN message when
no pid or more pids detected in the test case tear down

Change-Id: I04f8d81c1ca48a1e4a45bd0e58f00d36d51c6933
Signed-off-by: Jan Gelety <jgelety@cisco.com>

afa3def2 23-Dec-2016 Fangyin Hu <fangyinx.hu@intel.com>

Add the DPDK l3fwd performance test case.
fix some code style issue and rebase the code.
change the DPDK l3fwd test case name and rebase the code.
fix the pylint errors.
change the DPDK version to 17.05
Rebase the code.
Fix the l3fwd test code like the l2fwd.
Fix the run l3fwd script issues.
Rebase the code and review.
Fix the l3fwd script issues.
verify-perf-dpdk-long

Change-Id: I5c5625ebcd5ff16f47fbee361789be3fece1ddbc
Signed-off-by: Fangyin Hu <fangyinx.hu@intel.com>

0f2542f1 22-May-2017 Peter Mikus <pmikus@cisco.com>

Upgrade T-rex to version 2.25

- Upgrade T-rex to v2.25 with multiple bug fixes.

Change-Id: Idc422172ce98c37ace7bbbf054a2b024c313bbf7
Signed-off-by: Peter Mikus <pmikus@cisco.com>

f2dcf8cc 18-May-2017 selias <samelias@cisco.com>

HC Test: Improve logging of Honeycomb and VPP restart

Change-Id: I69d73ba3f672af88563715d17c94c73d8d5e7ff2
Signed-off-by: selias <samelias@cisco.com>

1a6d584a 16-May-2017 Tibor Frank <tifrank@cisco.com>

CSIT-580: IPSec tests - modifications related to the latest changes

- The startup option 'enable-cryptodev' has been removed and unless
not enough cryptodevs are found, DPDK cryptodev will be enabled by default.

Change-Id: I19a483435256d8cf4101dc9f10a7c95ed5594e75
Signed-off-by: Tibor Frank <tifrank@cisco.com>

5acbc578 17-May-2017 selias <samelias@cisco.com>

CSIT-557 HC Test: Fix ODL setup in Honeycomb-odl jobs

Change-Id: I917f3bfd9cea043e1bc820536db07697e0d41040
Signed-off-by: selias <samelias@cisco.com>

fa14d9f4 11-May-2017 selias <samelias@cisco.com>

CSIT-576 HC Test: Improve SPAN test coverage

- add test for multiple destination interfaces using one source interface
- duplicate all existing cases using a sub-interface as the destination

Change-Id: Ifabf78bca258247a19624b2b2a0474d21d1229d3
Signed-off-by: selias <samelias@cisco.com>

df228e17 10-May-2017 selias <samelias@cisco.com>

CSIT-577 HC Test: Scripts for test jobs using ODL client

ODL client can be used to translate Restconf requests into Netconf. This
way Honeycomb's Netconf interface can be tested using existing test cases.

- add bootstrap scripts for verify and integration job
- update __init__.robot to handle new {HC_ODL} variable

Change-Id: I7e156dab3d5434dff246bfd02090f3c6bea81b86
Signed-off-by: selias <samelias@cisco.com>

a114591e 08-May-2017 selias <samelias@cisco.com>

CSIT-562 HC Test: Persistence suite rework, part1

- rename keywords that check operational data, to distinguish from keywords
that check configuration data
- modify existing persistence cases so that they don't affect each other
- add feature-specific persistence tests for: Interface Management, L2 bridge
- move Interface Management variables to separate file so they can be reused
- add new tag HC_PERSIST to execute persistence tests separately
- update existing Honeycomb tags to comply with CSIT conventions

More feature-specific tests to be added in part2.

Change-Id: I8657da4bb9e9a3d5261c04f5f1999b2572f605ef
Signed-off-by: selias <samelias@cisco.com>

03bb1e56 26-Apr-2017 jan.hradil <jan.hradil@pantheon.tech>

CSIT-563: HC Test: improved Lisp test coverage

added TC09-TC14 with following features:
Map Resolver
Map Server
PETR configuration
RLOC Probing
Map Register
Map Request mode

Change-Id: I0e8a573e9a0f7ef3c688a014ff879e2b3d6b9b1e
Signed-off-by: jan.hradil <jan.hradil@pantheon.tech>
Signed-off-by: selias <samelias@cisco.com>

e7959d92 16-May-2017 Jan Gelety <jgelety@cisco.com>

Fix: use pci/rescan to avoid occasional bind issue on Centos7

- rarelly binding of one of TG interfaces fails with "No such
device" error; usage of rescan should avoid such situations

Change-Id: Icbeb48ea6f8adb863e6517d4a35d6aca4238309a
Signed-off-by: Jan Gelety <jgelety@cisco.com>

07b85d35 12-May-2017 Peter Mikus <pmikus@cisco.com>

Fix: SetupFramework sparse file handling

- Fix the issue during packing of the framework when source
directory contains sparse files. By default tar is throwing
warning resulting in return code other then 0.

Change-Id: I39a9c1956685158e2e0fd9ef9545f90e3ef2a89f
Signed-off-by: Peter Mikus <pmikus@cisco.com>

3d279e4d 05-May-2017 selias <samelias@cisco.com>

HC Test: update routing test keyword due to namespace changes

- changed in https://gerrit.fd.io/r/6303

Change-Id: If5fdfcf21c757f9199f168bfd044c7fefce87bef
Signed-off-by: selias <samelias@cisco.com>

adae22c8 02-May-2017 Jan Gelety <jgelety@cisco.com>

Use 'Qemu Kill All' in perf test teardown

- replace 'Qemu Kill' KW by 'Qemu Kill All'
- use self.qemu_kill_all() in case of qemu_start(self) failure

Change-Id: I19d4c64d5daef4f00548344d45f0d4943ca4f7e8
Signed-off-by: Jan Gelety <jgelety@cisco.com>

919b7cb3 02-May-2017 selias <samelias@cisco.com>

HC Test: Update honeycomb suite setup

- remove workaround for jVPP version mismatch
- increase Java API command timeout

Change-Id: Ic6a61ff029cc7cdfec1f75890e18599e3b05f019
Signed-off-by: selias <samelias@cisco.com>

44cafa8a 27-Apr-2017 jan.hradil <jan.hradil@pantheon.tech>

csit-validate-pylint-master/3731 for build 3731

pylint repairs
deleted duplicated method from HcPersistence.py

Change-Id: I426e6c15957c995ea10bd11ae2deac75b1cab922
Signed-off-by: jan.hradil <jan.hradil@pantheon.tech>

0fc813b1 20-Mar-2017 Matej Klotton <mklotton@cisco.com>

Vhost tests

Change-Id: I03722afe13722941e084bc01161f7c2af30e3cb1
Signed-off-by: Matej Klotton <mklotton@cisco.com>

2659bfa8 11-Apr-2017 jan.hradil <jan.hradil@pantheon.tech>

CSIT-534 HC Test: policer tests

Added empty lines where needed
Repaired Phrasese "Given" --> "And" where necessary in mgmt-cfg-policer-apihc-func.robot
Corrected English in mgmt-cfg-policer-apihc-func.robot - in TC07 Documentation

Change-Id: Id99d7fd04d8f2dcae1820baa208ce338fad3a290
Signed-off-by: jan.hradil <jan.hradil@pantheon.tech>

1cb9b4af 13-Apr-2017 Jan Gelety <jgelety@cisco.com>

Use QEMU virtio queue size 1024 for perf tests

- use Build QEMU KW to apply patch to increase default virtio queue size
- remove Set Scheduler Policy

Change-Id: I04a7febd6366abd324d42f781645a8a0b520b325
Signed-off-by: Jan Gelety <jgelety@cisco.com>

38ac6262 18-Apr-2017 Tibor Frank <tifrank@cisco.com>

CSIT-560: csit src code doc generation for 1704

Change-Id: I9f07f326e12942404d670004bb9463039967f954
Signed-off-by: Tibor Frank <tifrank@cisco.com>

6a4018c9 17-Apr-2017 selias <samelias@cisco.com>

HC Test: update persistence suite

- fix "enable persistence" is suite setup
- update Jira links to persistence bug
- log content of persistence file before each restart

Change-Id: I68ad759ded5d6bee277cf946953c11f19628a9e7
Signed-off-by: selias <samelias@cisco.com>

28bab4e7 13-Mar-2017 Tibor Frank <tifrank@cisco.com>

CSIT-545: Performance tests for SNAT

- High level definition (HLD)
- Low level definition (LLD)
- Add keywords to set SNAT
- Add tests according to HLD, LLD

Change-Id: I7bf0b1870ac9c3adb36bb6590be9a3eb4ea8aa9a
Signed-off-by: Tibor Frank <tifrank@cisco.com>

dd46e093 10-Apr-2017 pmikus <pmikus@cisco.com>

IPsectptLispGpe performance test suite

*[Top] Network Topologies:* TG-DUT1-DUT2-TG 3-node circular topology
with single links between nodes.
*[Enc] Packet Encapsulations:* IPv4-IPSec-LISPGPE-IPv4.
*[Cfg] DUT configuration:* Each DUT is configured with LISP and IPsec.
IPsec is in transport mode. Tests cases are for IPsec configured both on
RLOC interface.

Change-Id: I7a95baf0305caac3d9f0702bbedb3feec27f1668
Signed-off-by: pmikus <pmikus@cisco.com>

0c4d0080 30-Mar-2017 jan.hradil <jan.hradil@pantheon.tech>

CSIT-529 HC Test: SLAAC

Change-Id: I14525a36d614372b7b418f1c10f95c371b7b8545
Signed-off-by: jan.hradil <jan.hradil@pantheon.tech>

2baef5a2 06-Apr-2017 selias <samelias@cisco.com>

HC Test: Fix proxyARP test teardown

- interface assignment is removed automatically with proxyARP settings

Change-Id: Id0c7e8fd9cbb263e547ac5e2534f3e650115cb81
Signed-off-by: selias <samelias@cisco.com>

4e421686 21-Dec-2016 Kirill Rybalchenko <kirill.rybalchenko@intel.com>

IPsec Multi-Tunnel performance test suite

Change-Id: I4b0ba83960e50089f29cab9a30ab760241c6f566
Signed-off-by: Kirill Rybalchenko <kirill.rybalchenko@intel.com>

2e115ad1 29-Mar-2017 pmikus <pmikus@cisco.com>

CSIT-441 vhost - Parametrized qemu install

Update the current QEMU installation script with option to override QEMU
installation and to apply additional patches. Additional patches are
applied from qemu_patches directory and subdir for specific QEMU version by
run-parts. This means that all patches for particular version are
applied.
All keywords for build QEMU are updated.

Change-Id: I0c874a96ac828dff657ee33eb87d88a8854128ad
Signed-off-by: pmikus <pmikus@cisco.com>

ffd596f6 05-Apr-2017 pmikus <pmikus@cisco.com>

CSIT-553 Make QEMU bin configurable

Add option to set path for QEMU binary and make it configurable in perf
testaces as global variable.

Change-Id: I95f4b1ab790b576f1eca02ccdb86f7a6ced80630
Signed-off-by: pmikus <pmikus@cisco.com>

ec059708 10-Feb-2017 Tibor Frank <tifrank@cisco.com>

Add x710 and xl710 tests for testpmd

10ge2p1x710-eth-l2xcbase-ndrdisc
40ge2p1xl710-eth-l2xcbase-ndrdisc

Change-Id: Iea411182fd41e1ae9ed9b5a17f540befc247adb9
Signed-off-by: Tibor Frank <tifrank@cisco.com>

c95798bd 03-Apr-2017 selias <samelias@cisco.com>

HC Test: fix restconf binding configuration

Change-Id: I7f0872cee5b49e64912b97cee99c859d921b68e1
Signed-off-by: selias <samelias@cisco.com>

312793e9 30-Mar-2017 pmikus <pmikus@cisco.com>

Make testpmd txd/rxd/txq/rxq configurable in guest

- Add option to configure vring qsz for testpmd when
running in guest [make 256 as default]
- Add option to configure number of queues for testpmd when
running in guest [make 1 as default]

Change-Id: I4ecd24ba4a24d6d212b10cd6d24f5b016fb63fd9
Signed-off-by: pmikus <pmikus@cisco.com>

c6225273 24-Mar-2017 Jan Gelety <jgelety@cisco.com>

CSIT-550: Add x520 L2 x-connect perf test with 2 VMs per DUT

- 10ge2p1x520-eth-l2xcbase-eth-4vhost-2vm-ndrpdrdisc

Change-Id: I9dc6888d5b94922835fa0fcae2b0763b3a1fa9a3
Signed-off-by: Jan Gelety <jgelety@cisco.com>

fdb65595 31-Mar-2017 selias <samelias@cisco.com>

HC Test: revert to using restconf over http

- use http instead of https for restconf connection
- add missing import to proxyARP robot library
- use VAT interface dump to identify interfaces in VAT ip address dump

Change-Id: Ic381ff3f9b56a6c633382450559134f5389956c2
Signed-off-by: selias <samelias@cisco.com>

b2f75ec0 30-Mar-2017 pmikus <pmikus@cisco.com>

Upgrade T-rex to v2.22

Change-Id: I2029ba77a1c3c9ba6e128f816a353769a2cd5c8e
Signed-off-by: pmikus <pmikus@cisco.com>

c756b657 23-Mar-2017 jan.hradil <jan.hradil@pantheon.tech>

HC Test: SPAN Port Mirroring Suite

Change-Id: Ideaae09aa0d062460f5dfb3e3732dee67d6a5aea
Signed-off-by: jan.hradil <jan.hradil@pantheon.tech>

8c1bb6ac 24-Mar-2017 selias <samelias@cisco.com>

HC Test: address and cleanup test failures

Change-Id: If3c570dbc5036915fdc68ade7a9ccc45ad21299e
Signed-off-by: selias <samelias@cisco.com>

d919da73 16-Mar-2017 selias <samelias@cisco.com>

CSIT-532 HC Test: IPv6 Neighbor Discovery proxy

Change-Id: I6495726a814e116191f7a183be71c661466e7053
Signed-off-by: selias <samelias@cisco.com>

bd680a76 13-Mar-2017 selias <samelias@cisco.com>

HC Test: support testing using ipv6 management interface and https

Change-Id: Ia38388a87171ad3bec7307f9ca74eaa99adc2624
Signed-off-by: selias <samelias@cisco.com>

d30aa3a0 17-Mar-2017 selias <samelias@cisco.com>

CSIT-526 HC test: DHCP relay

Change-Id: I00d841bee1e5139a4530ce97d8bda17780caa0f1
Signed-off-by: selias <samelias@cisco.com>

81fc408c 21-Mar-2017 Jan Gelety <jgelety@cisco.com>

CSIT-548: Add x520 IP4base perf test with 2 VMs per DUT

- 10ge2p1x520-ethip4-ip4base-eth-4vhost-2vm-ndrpdrdisc

Change-Id: I3f978914e11308898f3281183687b1a0f6c74ed2
Signed-off-by: Jan Gelety <jgelety@cisco.com>

16a5302a 31-Jan-2017 Matej Klotton <mklotton@cisco.com>

Virl test: dot1q ip4base

Change-Id: I070bdbb0ea9cb609cb367ad744f7ad569b7115b9
Signed-off-by: Matej Klotton <mklotton@cisco.com>

80a11ac1 28-Mar-2017 Jan Gelety <jgelety@cisco.com>

Use "No VPP PID found on node X" when vpp pid is not returned

Change-Id: Idfe6d674355bf57fdc24219cdaf8664ec23dfce9
Signed-off-by: Jan Gelety <jgelety@cisco.com>

60c84c73 13-Mar-2017 Jan Gelety <jgelety@cisco.com>

CSIT-547: Add x520 L2BD perf test with 2 VMs per DUT

- 10ge2p1x520-eth-l2bdbasemaclrn-eth-4vhost-2vm-ndrpdrdisc

Change-Id: If65a7cf21d1dbff88f39f319877d9ac1fc5d959e
Signed-off-by: Jan Gelety <jgelety@cisco.com>

68509426 14-Mar-2017 selias <samelias@cisco.com>

HC Test: update URL paths

- needed due to model split https://gerrit.fd.io/r/5706

Change-Id: I6179eae7c5cb5d13fbec6510821556c1ed424c3a
Signed-off-by: selias <samelias@cisco.com>

4f4eaa1d 07-Mar-2017 selias <samelias@cisco.com>

CSIT-536 HC Test: support testing with ODL client

Reuses existing restconf test cases to test Honeycomb's netconf interface.
When seding the requests to ODL's Honeycomb mountpoint, ODL translates these
requests to netconf RPCs.

Add new tag "honeycomb_odl" that excludes incompatible test cases.

Change-Id: Ie293449da0129b02db85e30aa4f3266928d7d9f6
Signed-off-by: selias <samelias@cisco.com>

8003aa2c 10-Mar-2017 selias <samelias@cisco.com>

CSIT-528 HC Test: proxyARP test suite

Change-Id: I1f99d38aadee22a7354a1f89e9d7f395a401c96c
Signed-off-by: selias <samelias@cisco.com>

38722703 07-Mar-2017 selias <samelias@cisco.com>

HC Test: update URL paths for vpp-acl

- needed due to v3po model split https://gerrit.fd.io/r/5530

Change-Id: I8a82c22f1999e81e3bb19b287be3cf3c01b50333
Signed-off-by: selias <samelias@cisco.com>

0b4ceb8d 08-Feb-2017 selias <samelias@cisco.com>

CSIT-523 HC Test: routing

- add routing test suite, variables and keywords

Change-Id: I57e180350c30221befe8d1fc4e3b146d394c4f5d
Signed-off-by: selias <samelias@cisco.com>

e3171449 10-Mar-2017 selias <samelias@cisco.com>

HC Test: add test for vlan sub-interface ipv6 address

Change-Id: I93e0e4caf9b8ed1be824c7f75f348c30e567b75f
Signed-off-by: selias <samelias@cisco.com>

86f35c2c 27-Feb-2017 selias <samelias@cisco.com>

HC Test: create Vlan sub-interface using netconf

- add netconf test for specific issue HC2VPP-60

Change-Id: I8fc64bce40f1e43d93e7e92c952e564151bc8232
Signed-off-by: selias <samelias@cisco.com>

3a761053 20-Jan-2017 Jan Gelety <jgelety@cisco.com>

SPAN test - improvement of packet check

Change-Id: Ic95fbe288495ee4cd75178d74c220f6af5d2b11a
Signed-off-by: Jan Gelety <jgelety@cisco.com>

fe29ca4b 22-Feb-2017 Tibor Frank <tifrank@cisco.com>

CSIT-530: Add common setup and teardown to perf tests

Change-Id: I2e76de710b4b758eac1d24d447a9c5938f937385
Signed-off-by: Tibor Frank <tifrank@cisco.com>

933f6fd1 25-Feb-2017 Neale Ranns <nranns@cisco.com>

Remove unused VRF paramter from IP neighbour Add/del

Change-Id: I4a348c696e4cacbf5aa0723f2b8070bbcce7666c
Signed-off-by: Neale Ranns <nranns@cisco.com>

93f31102 21-Feb-2017 selias <samelias@cisco.com>

HC Test: update plugin-ACL tests

- improve packet trace logging after each test
- suppress IPv6RA on VPP because it interfered with ipv6 test cases
- do not use fictional destination MAC address, doesn't work in VIRL
- ignore errors when logging configuration - should not fail the test

Change-Id: I16a3321670d4c2fa8f6434dc4badd243b7e4f9fc
Signed-off-by: selias <samelias@cisco.com>

21702fb0 14-Feb-2017 Tibor Frank <tifrank@cisco.com>

CSIT-339: Add Keywords for SMT

- modify keywords in CpuUtils.py
- add RF keywords

Change-Id: I57230b3948254e8f149b2563a8e24e948bc2ec27
Signed-off-by: Tibor Frank <tifrank@cisco.com>

dc8794cd 30-Jan-2017 Matej Klotton <mklotton@cisco.com>

VIRL test: Dot1Q-L2BD-vhost_user test (CSIT-502)

- Create test cases to test Dot1Q+L2BD+vhost_user IPv4 and IPv6
scenarios

Change-Id: I0823e2d22a36fce236c037cfda27d588ebcd1cc5
Signed-off-by: Matej Klotton <mklotton@cisco.com>

9aab5562 17-Feb-2017 selias <samelias@cisco.com>

CSIT-522 HC Test: tests for secondary IP address

- fix and update ipv4 and ipv6 tests
- add tests for ipv6 neighbor and vrf-id
- add tests for secondary IP address on ipv4, ipv6

Change-Id: I1e422e61108493a63a65ad91f649e69dfff0842f
Signed-off-by: selias <samelias@cisco.com>

66919d66 29-Jan-2017 Matej Klotton <mklotton@cisco.com>

Add pypcap python requirement

Using pypcap's L2listen instead of standard AF_PACKET scapy can
see received Dot1Q tag.

Change-Id: Icb3dcb272a9611158a26a83fede7550bba3f367e
Signed-off-by: Matej Klotton <mklotton@cisco.com>

8c465631 17-Feb-2017 Matej Klotton <mklotton@cisco.com>

QemuUtil lib change to work with ubuntu and centos

- replace nc to socat for comunicating with qemu QGA
- change disk type to use virtio driver
- add check to bind only network interface for testpmd

Change-Id: I19ab16cbd8fec1ec78263ccfb1309a144e5af845
Signed-off-by: Matej Klotton <mklotton@cisco.com>

c5b285ae 17-Feb-2017 Neale Ranns <nranns@cisco.com>

The interface must be assigned to the VRF and then given a prefix

Change-Id: I6a2fc503989576f806413ae98845e3e3676889b8
Signed-off-by: Neale Ranns <nranns@cisco.com>

8ef49833 20-Feb-2017 Jan Gelety <jgelety@cisco.com>

Fix of centos bootstrap and dut_setup.sh

Change-Id: I9fc3a74bf6356bdccee16c977df86567e91b4acf
Signed-off-by: Jan Gelety <jgelety@cisco.com>

bb556a41 16-Feb-2017 Matej Klotton <mklotton@cisco.com>

Fix ssh prompts for centos

Change-Id: I864f97b4559fc1d692bfba80266150a3d06dd6bb
Signed-off-by: Matej Klotton <mklotton@cisco.com>

4d9b95cd 30-Jan-2017 Tibor Frank <tifrank@cisco.com>

CSIT-514: Kill Qemu when it does not respond

Change-Id: Id13c7fd51e693a273637c80cb35a159434be4826
Signed-off-by: Tibor Frank <tifrank@cisco.com>

005e7e00 01-Dec-2016 selias <samelias@cisco.com>

HC Test: ACL updates

- update low level ACL based on yang model changes
- remove ietf-ACL test suite and test data and keywords
- add ACL-plugin test suite, test data and keywords

The ietf model of ACLs is no longer supported in Honeycomb. It has
been replaced by the ACL plugin.

Change-Id: Ic2c2a3e11c9717d1d3885275f6b868a0098343f9
Signed-off-by: selias <samelias@cisco.com>

4e249c36 07-Feb-2017 selias <samelias@cisco.com>

HC Test: Update sNAT tests due to API changes

- add protocol value to expected VAT data
- add protocol value to snat_static_mapping_dump parser
- add temp workaround for returned "error:misc" on Ubuntu14.04

Change-Id: I42776b62b04eac65d03dcae1ec6a386a765b2e52
Signed-off-by: selias <samelias@cisco.com>

fd66ed70 07-Feb-2017 selias <samelias@cisco.com>

HC Test: Add temporary workaround for VAT issues on Ubuntu14.04

Some VAT commands return "error:misc" in addition to their normal
JSON output. This causes the JSON parser to complain about extra data.

Change-Id: I0da9739f371998dd6e2e6d6f70c1e8a3d82b6350
Signed-off-by: selias <samelias@cisco.com>

44dc1d47 07-Feb-2017 Jan Gelety <jgelety@cisco.com>

Introduce simple VAT history per test case

- print list of VAT commands executed per DUT node during the test
case in the func test teardown

Change-Id: I18a750ebfb7560eff9f5c4f0826ef84c3f64b4a8
Signed-off-by: Jan Gelety <jgelety@cisco.com>

6dd47ed6 06-Feb-2017 Tibor Frank <tifrank@cisco.com>

CSIT-518: Add testpmd numa awareness

Change-Id: I982834de1fbe71cf5303808ea58d4b58e530ffcb
Signed-off-by: Tibor Frank <tifrank@cisco.com>

b468094f 02-Feb-2017 Peter Mikus <pmikus@cisco.com>

Upgrade T-rex to newer version

Change-Id: I8b918a3c1d8109fb64bfdeec8e5c9afe45a86d21
Signed-off-by: pmikus <pmikus@cisco.com>

f6cf39c5 03-Feb-2017 Tibor Frank <tifrank@cisco.com>

CSIT-517: DPDK initialization and teardown

Change-Id: Iff42549e3be610c88b7a7d5518ef2cbb88c75ed2
Signed-off-by: Tibor Frank <tifrank@cisco.com>

292e156c 03-Feb-2017 Tibor Frank <tifrank@cisco.com>

CSIT-516: Add keywords for 2-node topology

Change-Id: Ib5a1e207f1dec99747329a755c3c365fef4bd64c
Signed-off-by: Tibor Frank <tifrank@cisco.com>

ffe30437 30-Jan-2017 selias <samelias@cisco.com>

HC Test: Fix jvpp workaround for 17.04

- original commit at https://gerrit.fd.io/r/4683

Change-Id: I0b2d77f66830fbbc2d27e9015ec67ea9cd9a9885
Signed-off-by: selias <samelias@cisco.com>

fc42ade3 17-Jan-2017 selias <samelias@cisco.com>

CSIT-506: HC Test- Update and cleanup all suites

- remove EXPECTED_FAILING tag from IPv4 neighbor, IPv6 address, MTU
- fix bridge domain removal with interfaces assigned, it should fail
- fix teardown of L2 FIB suite (bridge domain removal, see above)
- disable vhost-user "server" test cases (VPP bug)
- fix keyword verifying sub-interface state
- update ACL test data (yang model changes)
- remove EXPECTED_FAILING tag from ACL table removal test
- update Jira IDs and comments in failing Lisp test case
- remove EXPECTED_FAILING tag from Lisp removal test case
- use vhost-user "client" instead of "server" in persistence tests

Change-Id: I32eafb6013b4512090c0d9365e10c61029179d49
Signed-off-by: selias <samelias@cisco.com>

c53c0cba 13-Jan-2017 selias <samelias@cisco.com>

HC Test: Workaround for 17.04 jvpp version mismatch

- add workaround for mismatched jvpp versions in deb packages
- disable NSH_SFC madule and test suite, it depends on outdated jvpp
- cleanup package download script used in hc2vpp-csit-verify job

Change-Id: I98526baa4de08bbbab2339c9e81f49cd189b57ac
Signed-off-by: selias <samelias@cisco.com>

95001e8a 26-Jan-2017 pmikus <pmikus@cisco.com>

Fix: Display of PDR latency

Fix the string in PDR latency output

Change-Id: I7f244e29015da4e71485e88f2988efa73b6f4853
Signed-off-by: pmikus <pmikus@cisco.com>

9d64f8be 26-Jan-2017 Tibor Frank <tifrank@cisco.com>

CSIT-512: Add x710, xl710 l2bd vhost tests

- 10ge2p1x710-eth-l2bdbasemaclrn-eth-2vhost-1vm-ndrdisc
- 40ge2p1xl710-eth-l2bdbasemaclrn-eth-2vhost-1vm-ndrdisc

Change-Id: I99a70c8fcdfc0fffda96606033ba8752d6c07952
Signed-off-by: Tibor Frank <tifrank@cisco.com>

c232d04e 18-Jan-2017 Tibor Frank <tifrank@cisco.com>

CSIT-509: Add perf tests for vlan + l2 + vhost

Change-Id: I65e716b51dd35092c10574ac4580ee4b8bd3b24b
Signed-off-by: Tibor Frank <tifrank@cisco.com>

ac7203cc 17-Jan-2017 pmikus <pmikus@cisco.com>

Add unified latency output for PDRDISC and NDRDISC

Add same latency formatting for PDR as for NDR search results.
This will help us to parse the data in same way.

Change-Id: I3be79cc7623f8c9d39fd44babd252ceec58c114b
Signed-off-by: pmikus <pmikus@cisco.com>

eb451511 16-Jan-2017 Matej Klotton <mklotton@cisco.com>

VIRL test: Replace IP probe for VXLAN test

Change-Id: Ic16f91beabdc2ac2e19ccc65c04790d36c15d477
Signed-off-by: Matej Klotton <mklotton@cisco.com>

083f612d 09-Jan-2017 Jan Gelety <jgelety@cisco.com>

VIRL test: VXLAN-L2BD-vhos_user test (CSIT-500)

- Create test cases to test VXLAN+L2BD+vhost_user IPv4 and IPv6
scenarios

Change-Id: I46d27f22ec2e2e35fd5067ba7eeda9a2ccff9f84
Signed-off-by: Jan Gelety <jgelety@cisco.com>

b633f4eb 25-Nov-2016 Fangyin Hu <fangyinx.hu@intel.com>

Add the DPDK l2fwd performance test cases.

Change-Id: I996847a4871ed994cd9b5edb459fb079ff39c86d
Signed-off-by: Fangyin Hu <fangyinx.hu@intel.com>

954e5161 16-Dec-2016 selias <samelias@cisco.com>

CSIT-482: HC Test - NAT

- add NAT test suite
- add keywords and methods for configuring and reading NAT settings
- add test data used in NAT suite

Change-Id: Iaa2ac1eb156bc9bcff41ec242318f6a973210d38
Signed-off-by: selias <samelias@cisco.com>

2671e261 09-Jan-2017 selias <samelias@cisco.com>

HC Test: Fix log archiving in honeycomb tests

Change-Id: Iad743b3c0e2d1b57e7c6bcae521fe958fbb06ced
Signed-off-by: selias <samelias@cisco.com>

79991f4e 05-Jan-2017 Tibor Frank <tifrank@cisco.com>

CSIT-499: Perf Tests - VXLAN + L2BD + vhost

- Packet throughput L2BD test cases with VXLANoIPv4 and vhost

Change-Id: I6373ef232e5ce7155f8dec80ffa576a6a6b69b81
Signed-off-by: Tibor Frank <tifrank@cisco.com>

45ed57bb 02-Jan-2017 Tibor Frank <tifrank@cisco.com>

CSIT-498: Packet throughput L2BD with VXLANoIPv4

- Add performance tests for packet throughput L2BD with VXLANoIPv4

Change-Id: Id0872e1847f5a0e0eb37ba352bf75f56c51c7a45
Signed-off-by: Tibor Frank <tifrank@cisco.com>

f943725e 21-Dec-2016 pmikus <pmikus@cisco.com>

Fix: Qemu wait_until_vm_boot

There is an issue that booting Nested VM is successful but
QGA guest-ping or flush returns partial response. This fix suppose
to do checking until an error or timeout occurs. In case of QGA
returns correct response it is success. In case of partial
response it will log an error and continue in checking.

Change-Id: Idb2c5e5ea54bfc1e118ff62dd15696a1797dfdd9
Signed-off-by: pmikus <pmikus@cisco.com>

a060d519 17-Dec-2016 Peter Mikus <pmikus@cisco.com>

Pylint fixes

- fix Map.py

Change-Id: I0241e655df12f8135884e48d14c8eea43c501323
Signed-off-by: pmikus <pmikus@cisco.com>

bd8ed882 09-Dec-2016 selias <samelias@cisco.com>

CSIT-484: HC Test: Lisp

- add Lisp test suite
- add Lisp test data
- add keywords and methods used in Lisp tests

Change-Id: Ie7819e20cf48e7dac106d60cce316ce69ab75786
Signed-off-by: selias <samelias@cisco.com>

1813672e 09-Dec-2016 selias <samelias@cisco.com>

CSIT-424: HC Test: JSON comparison function rework

When comparing multi-level JSON trees, the exceptions raised
carry more useful information.

Keys and values not present in reference data are ignored.

No longer puts chunks of honeycomb's log file into robot report. The
entire log file will be archived after https://gerrit.fd.io/r/4171

Change-Id: Ib597080fa3d9b2c43463c76ee0d52f317ea072e7
Signed-off-by: selias <samelias@cisco.com>

cf561a6e 15-Dec-2016 Tibor Frank <tifrank@cisco.com>

Pylint fixes

- Fix PyLint errors
- Fix comments in touched python modules

Change-Id: I26db2d292a41969cf38b9b0bdd49c4fb15349102
Signed-off-by: Tibor Frank <tifrank@cisco.com>

677ae40a 15-Dec-2016 selias <samelias@cisco.com>

HC Test: fix archiving artifacts in csit-hc2vpp jobs

Change-Id: I392eac7404d5e1793a7de9d7a44b9defb89e7b9d
Signed-off-by: selias <samelias@cisco.com>

17e37d73 14-Dec-2016 Peter Mikus <pmikus@cisco.com>

Fix: Qemu wait_until_vm_boot

There is an issue that booting Nested VM is successful but
QGA guest-ping returns partial response. This fix suppose to
do checking until an error or timeout occurs. In case of QGA
returns correct response it is success. In case of partial
response it will log an error and continue in checking.

Change-Id: I8a2469287abaa9398a9206988e579912840f20c4
Signed-off-by: pmikus <pmikus@cisco.com>

2415648f 12-Dec-2016 pmikus <pmikus@cisco.com>

vhost perf testing with Qemu 5t5pc

Currently we were using 3t3pc for Qemu (2t2pc testpmd). This is
not enough anymore as we are testing VPP with 4t4pc. This patch
is supposed to increase the number of core used by testpmd.

Change-Id: Id58634c050b51943679a1f7cb74c624a98d81a27
Signed-off-by: pmikus <pmikus@cisco.com>

d7fed63a 16-Nov-2016 pmikus <pmikus@cisco.com>

CSIT-470 Add option to configure CFS scheduler priority for VPP

Add option to configure CFS scheduler priority for VPP

Change-Id: Id358ebe41d7e868fd412d554d886567f81894b86
Signed-off-by: pmikus <pmikus@cisco.com>

97792bf7 08-Dec-2016 selias <samelias@cisco.com>

CSIT-484: HC Test: Add scripts for new hc2vpp jobs

- add package download script that also installs jvpp .jar
to maven local repo
- add bootstrap scripts for the new jobs

Related ci-management commit: https://gerrit.fd.io/r/4171

Change-Id: I11ec3d93d3b6f6d84c0c1c5e54f166dab96a05ee
Signed-off-by: selias <samelias@cisco.com>

eb38a257 08-Dec-2016 pmikus <pmikus@cisco.com>

CSIT-494 Add multi-queue support for Qemu

Add multi-queue support when starting qemu. Full implementation
will be following in near future.

Change-Id: I743bbde67254b26a4e4e98072bad57dde728845a
Signed-off-by: pmikus <pmikus@cisco.com>

176eda8b 02-Dec-2016 pmikus <pmikus@cisco.com>

Fix: Reading huge pages information during Qemu start

Reading information from sysfs or proc files is randomly failing
returning empty string without any error.
This fix suppose to add the retries to read the hugepages
information multiple times and raise exception if reading failed.

Change-Id: I7c88504765c39b11c81f7a8e77e5b0e32b7225fe
Signed-off-by: pmikus <pmikus@cisco.com>

4f70ebf4 25-Nov-2016 selias <samelias@cisco.com>

CSIT-481: HC Test: Port mirroring (SPAN)

- add port mirroring test suite
- add relevant keywords

Change-Id: I4ff398dd2ab4323e2a53af2812bf07cbb7043252
Signed-off-by: selias <samelias@cisco.com>

fa74b0cd 29-Nov-2016 selias <samelias@cisco.com>

CSIT-454: HC Test: Update module feature names

- outdated due to HC project change - split to honeycomb and hc2vpp

Change-Id: If9e3c9baf7787067eff6a759be1ad9aa386c6e0f
Signed-off-by: selias <samelias@cisco.com>

68d20c90 22-Nov-2016 selias <samelias@cisco.com>

CSIT-460: HC Test: Rework existing PBB tests

Rework PBB tests to account for changes in:
https://gerrit.fd.io/r/2520
https://gerrit.fd.io/r/1833

Change-Id: Id18027c23e57180b76c8478b010a4e3a69a75e43
Signed-off-by: selias <samelias@cisco.com>

4dadc7a0 23-Nov-2016 Tibor Frank <tifrank@cisco.com>

CSIT-474: CSIT doc auto-generation

- See resources/tools/doc_gen/README.rst for details

Change-Id: Ie5704c93a41e456d65fcd6df2d9d8c96987deebb
Signed-off-by: Tibor Frank <tifrank@cisco.com>

4bda4f8b 07-Nov-2016 selias <samelias@cisco.com>

CSIT-425: HC Test: NSH-SFC test suite

- add keyword to enable optional modules in Honeycomb (including NSH)
- update honeycomb __init__.robot with the new keyword
- add python and robot libraries for NSH tests
- add NSH test suite (CRUD operations)

Change-Id: I869069a138a51d56d25522163c3a6deefb316f46
Signed-off-by: selias <samelias@cisco.com>

0d782a56 24-Nov-2016 selias <samelias@cisco.com>

CSIT-457: HC Test: Document expected test failures

- add EXPECTED_FAILING tag to all known test failures
- document every use of EXPECTED_FAILING tag ,include Jira issue ID
- minor fixes to interface, sub-interface and ACL test suites

Change-Id: If6a535bdacc297c03e8cfade8896cdec23498bc2
Signed-off-by: selias <samelias@cisco.com>

f112262b 17-Nov-2016 pmikus <pmikus@cisco.com>

Fix documentation and pylint errors

- Fix documentation to be comliant with sphinx
- Fix pylint errors

Change-Id: I64acaa6c330c5a3b2975efc4120260813a2b3a92
Signed-off-by: pmikus <pmikus@cisco.com>

5e163c52 23-Nov-2016 pmikus <pmikus@cisco.com>

FIX: Increase ip6 heapsize

Change-Id: I6ea568e15e5c5b3ec6d3fd1977fb5d4a5ce17484
Signed-off-by: pmikus <pmikus@cisco.com>

7ef7113b 21-Nov-2016 selias <samelias@cisco.com>

Remove workaround for ip_address_dump

As of change https://gerrit.fd.io/r/3816, ip_address_dump returns
IP addresses properly.

Change-Id: If3b4a32e5166bd517beaa2ddb35262c406b1dcea
Signed-off-by: selias <samelias@cisco.com>

9c1a3dbb 21-Nov-2016 selias <samelias@cisco.com>

CSIT:454 - HC Test: Increase timeout for Honeycomb startup

Change-Id: I44288ecd8664e75b9acfbd2d0e03d9712f4010b1
Signed-off-by: selias <samelias@cisco.com>

b0eaa32d 15-Nov-2016 pmikus <pmikus@cisco.com>

CSIT-470 Add option to configure CFS scheduler priority for QEMU

Add option to configure CFS scheduler priority for QEMU

Change-Id: I76da7f536e70a23a57cf5215ab60002f95532b19
Signed-off-by: pmikus <pmikus@cisco.com>

7a0a0ec3 14-Nov-2016 selias <samelias@cisco.com>

CSIT-454: HC Test: Improve logging on test failure

- set Honeycomb log level to TRACE before running Honeycomb tests
- on a failed restconf request, print the last few lines of the log
- show saved configuration during persistence suite restarts

Change-Id: I07ee37a5403cfca946fd7ef25a42861273248fbe
Signed-off-by: selias <samelias@cisco.com>

306f43ac 14-Nov-2016 pmikus <pmikus@cisco.com>

Switch to nested image 1.5 in perf

Change-Id: I9116eac4a5377258b73b62214ca876161d9ef171
Signed-off-by: pmikus <pmikus@cisco.com>

839c9c1a 04-Oct-2016 selias <samelias@cisco.com>

CSIT-423: HC Test: delete VxLAN interface

Modify VxLAN test cases to account for changes in Honeycomb.

Change-Id: If2db55548b5472350d128bdfbb5bdd5289e1deef
Signed-off-by: selias <samelias@cisco.com>

440370de 27-Oct-2016 Tibor Frank <tifrank@cisco.com>

CSIT-465: Common test setup and teardown

This test setup and teardown is aimed to be used with all functional
tests.
It does not include functionality to manipulate VMs (qemu).

Test setup includes:
- Setup all DUTs before test
- Save VPP PIDs
- Setup all TGs before traffic script
- Update All Interface Data On All Nodes

Test teardown includes:
- Show Packet Trace on All DUTs
- Show vpp trace dump on all DUTs
- Vpp Show Errors On All DUTs
- Check VPP PID in Teardown

Change-Id: Ifee0bd58b7865442c5b510852908fd8363e3c543
Signed-off-by: Tibor Frank <tifrank@cisco.com>

2fa7bbfe 05-Nov-2016 pmikus <pmikus@cisco.com>

CSIT-468 Issue retrieving numa node of NIC

Issue retrieving numa node of NIC

Change-Id: Ia6f826c100a012b23e046e48fe1e505ed0c4c8e8
Signed-off-by: pmikus <pmikus@cisco.com>

8184e307 25-Oct-2016 pmikus <pmikus@cisco.com>

CSIT-458 Use node aware config in all perf TCs

- Use node aware config in all perf TCs

Change-Id: Icbf92bf232efef49d07c1324c64ae55125e90fb2
Signed-off-by: pmikus <pmikus@cisco.com>

6bfae663 24-Oct-2016 selias <samelias@cisco.com>

CSIT-457: Address Honeycomb test failures

- tag all not-implemented features with EXPECTED_FAILING
- add workarounds for known issues with VAT dump commands
- replace hardcoded test data with parametrized
- separate IP neighbor and IP address into two test cases
- support unordered lists with compare_data_structures keyword

Change-Id: I2c683162325cee720ba496489787fa50e9c72b8c
Signed-off-by: selias <samelias@cisco.com>

195c8c11 26-Oct-2016 Zdeno Olsovsky <zolsovsk@cisco.com>

CSIT-245: IPv6 - ip4-lispgpe-ip6

Change-Id: Ie88cadfc2eab31cd1f411b9648b1a3515e4baa89
Signed-off-by: Zdeno Olsovsky <zolsovsk@cisco.com>
Signed-off-by: Matej Klotton <mklotton@cisco.com>

b23edf1a 12-Oct-2016 Patrik Hrnciar <phrnciar@cisco.com>

CSIT-385 CSIT-386 IPv4/IPv6 IPsec tests

- encryption/integrity key update tests

Change-Id: Iddbe35e2f421b5048e60663bff2b0bf1968a9782
Signed-off-by: Patrik Hrnciar <phrnciar@cisco.com>
Signed-off-by: Matej Klotton <mklotton@cisco.com>

eca12f0b 26-Oct-2016 Miroslav Miklus <mmiklus@cisco.com>

Increase timeout for 'vpp restart' operations

Systemd first send SIGTERM and wait 90s (default value)
to send SIGKILL to terminate the vpp service.

Change-Id: Ia582cfdc4bebc5d3530e82692856fe733d0b001e
Signed-off-by: Miroslav Miklus <mmiklus@cisco.com>

87e234be 27-Oct-2016 Dave Wallace <dwallacelf@gmail.com>

Revert "Use 3 tries to prepare DUT for testing"

This reverts commit d551ef4b72448c3ccb493559826b976a2d3d8649.

Change-Id: Icff3a98b96298385a2e4789d40ef60d70f440492
Signed-off-by: Dave Wallace <dwallacelf@gmail.com>

d551ef4b 25-Oct-2016 Jan Gelety <jgelety@cisco.com>

Use 3 tries to prepare DUT for testing

- workaround to deal with occasional vpp restart issue

Change-Id: I74a9148045bf4f80c9ba943e9c74338e08b2a72e
Signed-off-by: Jan Gelety <jgelety@cisco.com>

868380b0 17-Oct-2016 pmikus <pmikus@cisco.com>

CSIT-395 Update TRex version to v2.09

- Update TRex to v2.09

Change-Id: I53221aff346840e0438dd1385cedd1db57ca5f3b
Signed-off-by: pmikus <pmikus@cisco.com>

c86acbd9 20-Oct-2016 pmikus <pmikus@cisco.com>

CSIT-453: Switch Nested VM to 1.4 in perf

Currently in performance testing we are using Nested VM v1.3 with
DPDK16.07. This patch will change the Nested VM to version 1.4
which includes DPDK16.09.

Change-Id: I7cf2edda09f677ad9ddd3cc882000b9537bcc74c
Signed-off-by: pmikus <pmikus@cisco.com>

64b8f55a 24-Oct-2016 Jan Gelety <jgelety@cisco.com>

Use only Qemu Kill on the teardown of double qemu setup

- do not use Qemu System Powerdown or Qemu Quit in the teardown of
double qemu setup
- use just Qemu Kill there

Change-Id: I8dd1e4055e0adb5d306e3a9904090a271d17c3e5
Signed-off-by: Jan Gelety <jgelety@cisco.com>

d0a38862 17-Oct-2016 pmikus <pmikus@cisco.com>

CSIT-452: Switch Qemu binary to Ubuntu default

- Switch Qemu binary to default path and remove building qemu in performance jobs

Change-Id: I5e8bb510beb672d034699192a7c454c56f2d2581
Signed-off-by: pmikus <pmikus@cisco.com>

4a16abbb 19-Oct-2016 selias <samelias@cisco.com>

CSIT-427: Honeycomb ietf-ACL tests - L4 and misc.

- add test cases for:
L4 port range ACLs
multiple classify rules
L2 ACL on egress interface
- add L4 configuration to mixed ACL test
- add test variables for new test cases
- update HTTPRequests to treat code 201 as a positive response

Change-Id: If43007545fec174af12dab594f8a1b15b2e4a536
Signed-off-by: selias <samelias@cisco.com>

811b8dc9 17-Oct-2016 selias <samelias@cisco.com>

CSIT-427: Honeycomb ietf-ACL tests - mixed layers

- add test cases for mixing L2 and L3 rules
- update methods with mixed-acl functionality
- update test variables

Change-Id: I2aaa3033eede609627f751ea896e098548ffae98
Signed-off-by: selias <samelias@cisco.com>

21921596 12-Oct-2016 selias <samelias@cisco.com>

CSIT-427: Honeycomb ietf-ACL tests - L3

- add test cases for layer 3 ACL - IPv4, IPv6, protocol/next-header
- update methods with L3 functionality
- update test variables

Change-Id: Ia7ec03268845191021366621040dc411da0a2a93
Signed-off-by: selias <samelias@cisco.com>

233683de 07-Oct-2016 selias <samelias@cisco.com>

CSIT-427: Honeycomb ietf-ACL tests - L2

- add keywords for accessing Honeycomb's ietf-acl node
- add variable file with ietf-acl test data
- add ietf-acl traffic test suite
- modify bridge domain teardown keyword to unassign interfaces
from the bridge domain before delete

Change-Id: I6df1771f2fb9b42f30b5af8f54a384c6714f5949
Signed-off-by: selias <samelias@cisco.com>

99519a54 11-Oct-2016 selias <samelias@cisco.com>

Add topology method for generic handling of interface references

- add "convert_interface_reference" to topology.py

This is a convenience method, mainly intended for Honeycomb tests
which often require conversions between interface key, name
and sw_if_index.

Change-Id: I427736111f2a1dc07a581c9ccc25e181065bb6fd
Signed-off-by: selias <samelias@cisco.com>

c0aa0dd5 18-Oct-2016 Miroslav Miklus <mmiklus@cisco.com>

T-REX installer preserve env variables

This can be usefull for variables like http_proxy.

Change-Id: I31128d2a57c961c6d888b6693b68fb57bde11436
Signed-off-by: Miroslav Miklus <mmiklus@cisco.com>

359b07cc 17-Oct-2016 pmikus <pmikus@cisco.com>

FIX: LISP performance 6o4 failing

Change-Id: I08cecbe8310fd21356287ffbb33c3be58b721f10
Signed-off-by: pmikus <pmikus@cisco.com>

61b9af12 06-Oct-2016 pmikus <pmikus@cisco.com>

CSIT-351: Testing Ubuntu 16.04.1 changes

- Update the repository to get xenial packages
- Update phy topology files with new pass
- Update bootstrap to use new VIRL image
- Update framework to reflect 16.04 dependencies
- CSIT-116: Modify VIRL username/password

Change-Id: I4de44755170fd0481acef34c7c2d9c299bc300da
Signed-off-by: pmikus <pmikus@cisco.com>

19afb923 10-Oct-2016 Miroslav Miklus <mmiklus@cisco.com>

Ipv6 TEST fixes

- Increase interactive terminal timeout
- ip6 heapsize
- performance lib fix

Change-Id: Iac6beb041200c4b0c5cf29dceb5113df64c6c9b0
Signed-off-by: Miroslav Miklus <mmiklus@cisco.com>

74a35434 26-Sep-2016 Tibor Frank <tifrank@cisco.com>

CSIT-392: ip4-lispgpe-ip4

- ip4-lispgpe-ip4 - main fib, vrf, virt2lisp

Change-Id: I28c81e91689021693ce76352878fa21e953a4ef6
Signed-off-by: Tibor Frank <tifrank@cisco.com>

a8fcf79b 26-Sep-2016 Zdeno Olsovsky <zolsovsk@cisco.com>

CSIT-247: IPv6 - ip6-ipsec-lispgpe-ip6 - main fib, phy2lisp, virt2lisp

Change-Id: I039e14b7c227318c70826068368430978f8f0a51
Signed-off-by: Zdeno Olsovsky <zolsovsk@cisco.com>

d0ed91ff 28-Sep-2016 Zdeno Olsovsky <zolsovsk@cisco.com>

CSIT-257: L2enc - l2-eth-lispgpe-ip4 - L2BD

Change-Id: I0ee68f707c4175940538654f3a4bbd7d1a91bef1
Signed-off-by: Zdeno Olsovsky <zolsovsk@cisco.com>

145e2101 30-Sep-2016 pmikus <pmikus@cisco.com>

CSIT-176 Fix interactive SSH console deadlock

Change-Id: Iba291d6781238c0e880534195ff65a7b3c4bede1
Signed-off-by: pmikus <pmikus@cisco.com>

80e71dac 03-Oct-2016 Miroslav Miklus <mmiklus@cisco.com>

IPv4 2M scale tests - adjust heapsize to 3G

Change-Id: I78e700e2137fd35d79c9b6b5ba27bb21adc3f6fa
Signed-off-by: Miroslav Miklus <mmiklus@cisco.com>

149c67b8 28-Sep-2016 Patrik Hrnciar <phrnciar@cisco.com>

CSIT-227, CSIT-240 IPv4/IPv6 Multipath routing tests

- add IPv4 Equal-cost multipath routing test
- add IPv6 Equal-cost multipath routing test

Change-Id: I62eaf9983b7767e124f80af7d8c8652ffc460cf8
Signed-off-by: Patrik Hrnciar <phrnciar@cisco.com>

a912d105 30-Sep-2016 selias <samelias@cisco.com>

Fix pylint warnings in python libraries

- no functional changes
- fixes 80+ PEP-8 violations

Change-Id: Icf414778ec40d5cb44364fa69a876f9a1870c3c7
Signed-off-by: selias <samelias@cisco.com>

5dc98f39 29-Sep-2016 Miroslav Miklus <mmiklus@cisco.com>

Interactive terminal fixes

- remember if execution timed out and do not try to send "quit" on close
- increase timeout of vat command execution from 10s to 60s

Change-Id: I2b96a6dce1220eff45002276d1fe8a771fca2205
Signed-off-by: Miroslav Miklus <mmiklus@cisco.com>

9c7adfb4 22-Sep-2016 Tibor Frank <tifrank@cisco.com>

CSIT-231: ip4-ipsec-lispgpe-ip4

- main fib,
- vrf,
- phy2lisp

Change-Id: I9fd97462f0b290dab860ac601fbb37b4cecfb909
Signed-off-by: Tibor Frank <tifrank@cisco.com>

ac8b7ce3 21-Sep-2016 selias <samelias@cisco.com>

CSIT-235: Switched Port Analyzer mirroring (SPAN) - IPv4

- add library for SPAN setup
- add telemetry traffic script and a keyword to run it
- add "telemetry" folders for python and robot libraries
- move IPFIX libraries to these new folders
- add first SPAN test case, mirroring IPv4 ICMP packets

Change-Id: Ibca35f724c13662bf80dce2d7e2649d1a0b8676a
Signed-off-by: selias <samelias@cisco.com>

e87a07f0 26-Aug-2016 pmikus <pmikus@cisco.com>

INMARSAT-54 Honeycomb configures PBB

- CRUD tests usinf Honeycomb REST API

Change-Id: I4885cd0feb26f8ef56beb0d8848772ea2d42cb3a
Signed-off-by: Tibor Frank <tifrank@cisco.com>

19c91ada 13-Sep-2016 selias <samelias@cisco.com>

CSIT-405: Honeycomb test update and cleanup

- update suite setup and constants to allow test runs again
- cleanup basic interface keywords
- cleanup L2-fib test data
- add "continue on failure" keyword to some partially failing tests
- add teardown to all suites, restarts honeycomb if suite had test failures
- fix minor PEP-8 violations in Topology.py

Change-Id: Ic5b434af71f77855f81461b280299b8318932c5a
Signed-off-by: selias <samelias@cisco.com>

c75b9804 21-Sep-2016 Tibor Frank <tifrank@cisco.com>

LISP - implement changes done in VPP-376

Change-Id: Ia9f7913522421b6fd9ecba18eb4d68bc0f3b3271
Signed-off-by: Tibor Frank <tifrank@cisco.com>

0305dd1f 25-Sep-2016 pmikus <pmikus@cisco.com>

CSIT-416: Remove performance rate variables

Change-Id: I15ee953990f2ac11be361f3d0954bc12b3a9351d
Signed-off-by: pmikus <pmikus@cisco.com>

14085cfc 21-Sep-2016 Miroslav Miklus <mmiklus@cisco.com>

Enable paramiko ssh keepalive (10s)

Change-Id: I1e46ad76f033d239ad29d3b6fe00011a4444453d
Signed-off-by: Miroslav Miklus <mmiklus@cisco.com>

bff480ce 29-Jun-2016 Tibor Frank <tifrank@cisco.com>

Add automated deployment of Honeycomb on DUTs

JIRA: CSIT-56

- create bootstrap_vpp_honeycomb.sh script which deploys VPP and Honeycomb
on DUTs
- Modify start-testcase script

Change-Id: I88511479cb8681168675c934f4fccbea83fa34bc
Signed-off-by: Tibor Frank <tifrank@cisco.com>

7a7c287a 23-Sep-2016 Stefano Chiesa <ssuryant@cisco.com>

Fix drop rate search for worst of n

Change-Id: Ie98ab1095dedb4c24dbd44f64d3781934f664561
Signed-off-by: Stefano Chiesa <ssuryant@cisco.com>

40d7e3b7 22-Sep-2016 Jan Gelety <jgelety@cisco.com>

Use tmp directory for log files

- store log files in tmp directory and exclude all files in this
directory from archiving when creating tarballs

Change-Id: Ie3e11670c9d466c5fcf41d03ccd0a7bbb04ffeb0
Signed-off-by: Jan Gelety <jgelety@cisco.com>

030f0dff 20-Sep-2016 Miroslav Miklus <mmiklus@cisco.com>

CSIT-412 replace latency (N/A) string by number -1

Change-Id: Id6373d3bbfcc42e315976b59aa86c6cadee411f1
Signed-off-by: Miroslav Miklus <mmiklus@cisco.com>

356fc1c7 19-Sep-2016 pmikus <pmikus@cisco.com>

CSIT-411 Show Vhost User

- Add keyword to show vhost user

Change-Id: Ia844bbcb8507b8c7cbf6b7bb1a7dc8d10148d6f4
Signed-off-by: pmikus <pmikus@cisco.com>

e08e9a7b 20-Sep-2016 Miroslav Miklus <mmiklus@cisco.com>

Measure latency returns -1 if rate<=10kpps

Change-Id: I25dca3e6ce7da1304211d87f1af72fceda6dc23b
Signed-off-by: Miroslav Miklus <mmiklus@cisco.com>

1b7438bf 20-Sep-2016 Matej Klotton <mklotton@cisco.com>

CSIT-360: Fix: Parallel test sets run.

- fix typos

Change-Id: I5292b27ae584c86cb4986df5439bdebd5fa40b67
Signed-off-by: Matej Klotton <mklotton@cisco.com>

85005be5 19-Sep-2016 Miroslav Miklus <mmiklus@cisco.com>

Documentation fix - show stats

Change-Id: Ib5f3dc697d1da6a86b70c5ba7d8ea8711a2fc492
Signed-off-by: Miroslav Miklus <mmiklus@cisco.com>

56a9ea7e 13-Sep-2016 Jan Gelety <jgelety@cisco.com>

CSIT-360: Parallel test sets run

- use parallel test set runs on as many VIRL sessions as needed
for defined test sets

Change-Id: I7640f15894a1451aba963989fab4dc838f2ab6d8
Signed-off-by: Jan Gelety <jgelety@cisco.com>

49025681 14-Sep-2016 Miroslav Miklus <mmiklus@cisco.com>

CSIT-408 sub-NDR latency measurements

- measure latency at 10% and 50% of found NDR.
- fix the accuracy reported by T-REX (round to usec)

Change-Id: I9fe2b5f942cb816db6fd0bb4262b48b8da6dac2f
Signed-off-by: Miroslav Miklus <mmiklus@cisco.com>

e9ce3e7f 10-Sep-2016 pmikus <pmikus@cisco.com>

CSIT-404 Adjust DPDK testpmd startup parameters

Change-Id: If0f58e725e15aa01b61bc43b222c6254af9cd07e
Signed-off-by: pmikus <pmikus@cisco.com>

6d104077 06-Sep-2016 selias <samelias@cisco.com>

CSIT-241: IPv6 Router Advertisement

- add traffic script to verify Router Solicitation response
- add keyword to execute traffic script
- add test case 02: retransmit RA message after set interval
- add test case 03: respond to RS request

Change-Id: I83d742713ae42d0a1baacf460c29c06d32669b9a
Signed-off-by: selias <samelias@cisco.com>

a99abcf3 06-Sep-2016 Jan Gelety <jgelety@cisco.com>

CSIT-384: IPSEC IPv6 negative test cases

- use integrity and/or encryption key(s) different from
integrity and encryption keys stored on VPP node to create
tx packet on TG

Change-Id: I0f02523ec7649b8a1555869bdc4b7090b7585cac
Signed-off-by: Jan Gelety <jgelety@cisco.com>

cdfe6061 29-Aug-2016 Jan Gelety <jgelety@cisco.com>

CSIT-383: IPSEC IPv4 negative test cases

- use integrity and/or encryption key(s) different from
integrity and encryption keys stored on VPP node to create
tx packet on TG

Change-Id: I38bf7e1dd6f488e605bad991c7a7f4d1ff226e8c
Signed-off-by: Jan Gelety <jgelety@cisco.com>

2494b775 12-Sep-2016 Jan Gelety <jgelety@cisco.com>

Fix of Qemu issues

- use path to IPUtil where KWs "Setup Network Namespace" and
"Set Linux Interface IP" are used

Change-Id: I012cb7df4b871353aa68c10ca7069de7a2ab5d3b
Signed-off-by: Jan Gelety <jgelety@cisco.com>

13809a4e 26-Aug-2016 pmikus <pmikus@cisco.com>

CSIT-390 Replace rate calculation I

- Replace static max rate variables by calculation of max rate based on
nic limits

Change-Id: I0f7f7e46c6f46f87dfa5f34b9b9fdb4610513081
Signed-off-by: pmikus <pmikus@cisco.com>

c4dcb150 06-Sep-2016 Matej Klotton <mklotton@cisco.com>

CSIT-353: MAP-T FIX: Add tx src mac to traffic script

Change-Id: I011231c68dc470590323933dbdb3f33c3026559b
Signed-off-by: Matej Klotton <mklotton@cisco.com>

7cc7a7d0 06-Sep-2016 selias <samelias@cisco.com>

Fix pylint warnings in IPFIXUtil.py

- replace "import *" with only the required scapy fields

Change-Id: If29e42fd2f54ca78ae05ddb4e004ee1a7506a3b1
Signed-off-by: selias <samelias@cisco.com>

c3bf9f6a 24-Aug-2016 Tibor Frank <tifrank@cisco.com>

CSIT-229: ip4-lispgpe-ip4

- main fib,
- vrf,
- phy2lisp

Change-Id: Ic9bacef4574dc07b25041c4cd0653825a65c94fb
Signed-off-by: Tibor Frank <tifrank@cisco.com>

5a94f1ee 26-Aug-2016 Matej Klotton <mklotton@cisco.com>

CSIT-124: IPv4 encapsulations - IP4-GRE-IP4

- add gre test with multiple tunnel configured
- configure tunnel source as a loopback
- route from tunnel to tunnel
- check droping unknown tunnel destination

Change-Id: Ib522d158d9de5c66f556c6734ceadc994eea02d4
Signed-off-by: Matej Klotton <mklotton@cisco.com>

2e070f98 18-Aug-2016 selias <samelias@cisco.com>

CSIT-234 IPFIX - ipv4 functional scale

- add traffic script for classify session scale test
- add keyword for classify session scale test
- add packet scale and session scale test to IPFIX IPv4 suite

Change-Id: I3abd07dbf705fe664b723916ce1d82cd9649a2ae
Signed-off-by: selias <samelias@cisco.com>

32b486ea 18-Aug-2016 selias <samelias@cisco.com>

CSIT-251 IPv6 IPFIX - baseline tests

- add support for IPv6 fields to IPFIX data class
- add IPv6 IPFIX test suite

Change-Id: I8a0197c9e7dd91303feea11111c158698252a1eb
Signed-off-by: selias <samelias@cisco.com>

f591e5d8 11-Aug-2016 Matej Klotton <mklotton@cisco.com>

CSIT-353: Add basic map-t tests

Change-Id: I78075e445cdd61e0e3cf9353bddeaf6e6bc978fa
Signed-off-by: Matej Klotton <mklotton@cisco.com>

1942363f 28-Jul-2016 Zdeno Olsovsky <zolsovsk@cisco.com>

CSIT-237: VPN routed forwarding (VRF) - baseline for IPv6

Change-Id: I5c3053c692df29255a1da22a66f7ac282e3d5624
Signed-off-by: Zdeno Olsovsky <zolsovsk@cisco.com>

f2711a84 11-Aug-2016 selias <samelias@cisco.com>

CSIT-233 IPv4 IPFIX - baseline tests

- add scapy classes for parsing IPFIX packets
- add vat scripts and keywords for settings up IPFIX
- add IPv4 IPFIX test suite

Change-Id: I80ab76ca361c7920a01a46ad720b1c04acd0d147
Signed-off-by: selias <samelias@cisco.com>

53ce7d17 28-Jul-2016 Patrik Hrnciar <phrnciar@cisco.com>

CSIT-31 DHCPv6 Proxy test

Change-Id: Ie06980f6e42af3676d8f1ee42c9b9733428365af
Signed-off-by: Patrik Hrnciar <phrnciar@cisco.com>

679e08c0 22-Aug-2016 Jan Gelety <jgelety@cisco.com>

CSIT-28: IPSEC basic conectivity test - IPv4

- use all supported encryption and integrity algorithms in tunnel mode
and in transport mode

Change-Id: I2ae395d88d514b2ca3f62ab9aecbb27d8fb827b0
Signed-off-by: Jan Gelety <jgelety@cisco.com>

cff5ea63 22-Aug-2016 pmikus <pmikus@cisco.com>

CSIT-275 IPv4 DP - QoS - performance

- Add libraries for DUT setup
- Add test cases with various packet size and DUT startup setup

Change-Id: I52a19f8e398f515cc231bb7190cd98299ca989ce
Signed-off-by: pmikus <pmikus@cisco.com>

f5ec27c1 19-Jul-2016 pmikus <pmikus@cisco.com>

CSIT-323 L2dp - Cross-connect - baseline vhost-user

- Add test cases for vhost-user testing with
NIC(X520)-to-VM(testpmd,virtio)

Change-Id: Ie810ea06622ed8a37d3552f7bb8e38ebe9f04c2a
Signed-off-by: pmikus <pmikus@cisco.com>

4f923a09 20-Jul-2016 pmikus <pmikus@cisco.com>

CSIT-218 L2XC VXLANoIPv4 - performance

- Add libraries for DUT setup
- Add test cases with various packet size and DUT startup setup

Change-Id: I4839cdf37481975f9bd7cf22c806c061882066a3
Signed-off-by: pmikus <pmikus@cisco.com>

dc5e3431 22-Aug-2016 Jan Gelety <jgelety@cisco.com>

Small fixies in IPSEC resources

Change-Id: I06e4000d93a86d885200ef1d0dd9b00e520ba77f
Signed-off-by: Jan Gelety <jgelety@cisco.com>

cccb893c 15-Aug-2016 selias <samelias@cisco.com>

CSIT-369 Update Honeycomb persistence data location

- update persistence cleanup method with new file path
- remove unnecessary test case for bvi in multiple bridge domains
- remove unused bridge domain keywords

Change-Id: Ib5378f47af4a03ec5663a79db4c0dc1bf054c557
Signed-off-by: selias <samelias@cisco.com>

a1309d0a 18-Aug-2016 pmikus <pmikus@cisco.com>

CSIT-342 Update T-rex version to v2.07

- Update T-rex version to v2.07

Change-Id: I1709087628f05c3142f4e4b25a68502673e848dc
Signed-off-by: pmikus <pmikus@cisco.com>

b1a54dd8 02-Aug-2016 pmikus <pmikus@cisco.com>

CSIT-324 L2dp - Bridge domain - baseline vhost-user

- Add test cases for vhost-user testing with
NIC(X520)-to-VM(testpmd,virtio)

Change-Id: Id0e508d50288d89b39bc5c321eeab0c908f3e2ba
Signed-off-by: pmikus <pmikus@cisco.com>

bdc400b3 16-Aug-2016 pmikus <pmikus@cisco.com>

CSIT-366 IPv4dp - baseline vhost-user

- Add test cases for vhost-user testing with
NIC(X520)-to-VM(testpmd,virtio)

Change-Id: I598e70221b939b2b08aa324d2c98059eee8b6857
Signed-off-by: pmikus <pmikus@cisco.com>

c9d198a9 01-Jul-2016 Matus Fabian <matfabia@cisco.com>

CSIT-171 CSIT-172 Policer tests initial commit

policer python library, traffic script and IPv4/IPv6 example tests

Change-Id: I6470c86ce1acdcaaff9fdcf81510126836f1135e
Signed-off-by: Matus Fabian <matfabia@cisco.com>

32ffb106 31-May-2016 Andrej Kozemcak <akozemca@cisco.com>

CSIT-200: Lisp performance test

Change-Id: I8a54b79ee03c2f5defc4eeba486086d793484668
Signed-off-by: Andrej Kozemcak <akozemca@cisco.com>
Signed-off-by: pmikus <pmikus@cisco.com>

74afb9bc 02-Aug-2016 pmikus <pmikus@cisco.com>

CSIT-312 VPP vhost-user - VPP vhost-user driver, virtio in VM

- Add libraries and keywords to control Qemu VM and VMapp

Change-Id: Iaaedfe240afe394f507ccaf0cf7a77c8b863acd3
Signed-off-by: pmikus <pmikus@cisco.com>

2d928a03 16-May-2016 Matus Fabian <matfabia@cisco.com>

CSIT-28: IPsec tests initial commit

Change-Id: I525d3c4f47c3f151b55af5bbdd9d2e8c1ce2863f
Signed-off-by: Matus Fabian <matfabia@cisco.com>

517ee7fd 25-Jul-2016 Matej Klotton <mklotton@cisco.com>

CSIT-197: Add basic mapping rule tests for MAP-E

- IPv4 prefix length + ea bits length < 32
- IPv4 prefix length + ea bits length == 32
- IPv4 prefix length + ea bits length > 32
- End user IPv6 prefix is 64
- IPv4 preffix is 0

Change-Id: Ib8d76abfebfb206fbbaa3c1422b2d321a3ed8712
Signed-off-by: Matej Klotton <mklotton@cisco.com>

72be8262 28-Jul-2016 Miroslav Miklus <mmiklus@cisco.com>

CSIT-321 L2 Cross-connect - baseline - NIC-to-NIC(XL710)

Change-Id: I0c78d17242eedbfa573f1e2c20dc491a71b8dd4a
Signed-off-by: Miroslav Miklus <mmiklus@cisco.com>

ab4c093f 10-Aug-2016 Miroslav Miklus <mmiklus@cisco.com>

Revert "CSIT-342 Update T-rex version to v2.07"

"For XL710/X710 there is a need to upgrade the firmware
to 5.04 (or later)”

This reverts commit 147ce6e1ab9e6f557172d05aa0c09d44a34b0fdc.

Change-Id: I4abc19fe04d1b5b9b8def25ad53586fd02f79028
Signed-off-by: Miroslav Miklus <mmiklus@cisco.com>

c307e3df 09-Aug-2016 pmikus <pmikus@cisco.com>

CSIT-345 Increase number of captured syslog messages

Increase number of syslog messages to capture VPP initialization.

Change-Id: I130d4bed750a415e731d534a3640d7ceb08bf60b
Signed-off-by: pmikus <pmikus@cisco.com>

91961994 03-Aug-2016 Patrik Hrnciar <phrnciar@cisco.com>

CSIT-341 Refactor DHCPv4 proxy test

Change-Id: Id44ef8677f8b023c9cb6a3fec7dc8e3fc1d979d4
Signed-off-by: Patrik Hrnciar <phrnciar@cisco.com>

147ce6e1 05-Aug-2016 pmikus <pmikus@cisco.com>

CSIT-342 Update T-rex version to v2.07

Update T-rex version to v2.07

Change-Id: If93c95a3dbd3f2fbbb42d8155d3721f83bff92a2
Signed-off-by: pmikus <pmikus@cisco.com>

e710b521 05-Aug-2016 Miroslav Miklus <mmiklus@cisco.com>

CSIT-338 PCI numa_node discovery

Allow to discover PCI - numa node relationship.

Change-Id: I04a445e42b3cbbf450b990ebbc2c83ac313815f1
Signed-off-by: Miroslav Miklus <mmiklus@cisco.com>

1401010f 08-Aug-2016 selias <samelias@cisco.com>

Update Honeycomb directory location

- update "REMOTE_HC_DIR" constant
- update location of "MTU" setting in interface operational data

Change-Id: Id455ec4f3f03107f628913356801f4c21c5704b3
Signed-off-by: selias <samelias@cisco.com>

76f724a0 04-Aug-2016 Miroslav Miklus <mmiklus@cisco.com>

CSIT-338 CpuUtils - CPU layout

Extends node from topology file with "cpuinfo", this information
can be defined in the topology file, or can be retrieved from the
node.

Change-Id: I913dba93daab3b41b36f3ab07f5c03ad46c659dd
Signed-off-by: Miroslav Miklus <mmiklus@cisco.com>

223017fb 02-Aug-2016 pmikus <pmikus@cisco.com>

CSIT-337 Improve Qemu affinity setting

Improve Qemu affinity setting by getting the list of Qemu thread IDs via
QMP and pin each thread PID to specific host core by taskset.

Change-Id: I1b0ee8d8425cf1f97b16d6761fff0be2fadc44a8
Signed-off-by: pmikus <pmikus@cisco.com>

411b4dfa 29-Jul-2016 pmikus <pmikus@cisco.com>

CSIT-217 Hugepage configuration on physical LF testbeds

If Qemu requires more Hugepages than availbale in system it fails to start.
This patch is aimed to add option to configure more hugepages needed.
Default behavior is to fail to start if amount of hugepages is lower
then required.

Change-Id: I64bd8a5ec5bfa559676035c23001b12d00b026a5
Signed-off-by: pmikus <pmikus@cisco.com>

635c3047 19-Jul-2016 pmikus <pmikus@cisco.com>

CSIT-213 IPv6 iACL - performance

- create topology with Classify iACL white-list applied on interfaces
using IPv6 in 3-node topology
- create ipv6_iacl test cases (78B, 1518B, 9000B)

Change-Id: Idae635e6a45b52086515fea33a38112209975e8a
Signed-off-by: pmikus <pmikus@cisco.com>

ec3512ff 15-Jul-2016 Patrik Hrnciar <phrnciar@cisco.com>

CSIT-25 DHCPv4 proxy tests

Change-Id: I5aa449d7289fe8d015a32b21c0a368e9693ba757
Signed-off-by: Patrik Hrnciar <phrnciar@cisco.com>

8fa8590c 20-Jun-2016 pmikus <pmikus@cisco.com>

CSIT-179 IPv6 Scale - performance

- Add libraries for ipv6 scale setup
- Add test cases for testing 10k/100k/1M fib entries
- Add t-rex profiles for large scale testing

Change-Id: I4260405c960afe659db7e0764a68a87b9e8de0b2
Signed-off-by: pmikus <pmikus@cisco.com>

74761b49 28-Jul-2016 Andrej Kozemcak <akozemca@cisco.com>

CSIT-330: Fix small bug in LISP CSIT test

- format bug
- bad input data

Change-Id: I035d6ed70ca6c73058792c48a0b2c3f93f93122a
Signed-off-by: Andrej Kozemcak <akozemca@cisco.com>

e82373b2 26-Jul-2016 Miroslav Miklus <mmiklus@cisco.com>

CSIT-212 SetupFramework scp result - logging fix

Change-Id: I23a8090a117acd9cd0bef8bd69689751742d63e9
Signed-off-by: Miroslav Miklus <mmiklus@cisco.com>

e3f6b21b 17-Jun-2016 pmikus <pmikus@cisco.com>

CSIT-169 IPv4 Scale - performance

- Add libraries for ipv4 scale setup
- Add test cases for testing 10k/100k/1M fib entries
- Add t-rex profiles for large scale testing

Change-Id: If085e0d834e5ffe5538ba76756e8b9d0e8255cb2
Signed-off-by: pmikus <pmikus@cisco.com>

2eb74f5c 13-Jul-2016 Andrej Kozemcak <akozemca@cisco.com>

CSIT-207: Update LISP Eid API

- rename show_local_lisp_eid_tabl -> show_lisp_eid_table.
- change EID json output data

Change-Id: I4f5f7b5995b61cb0d5034b107c125caba1d73034
Signed-off-by: Andrej Kozemcak <akozemca@cisco.com>

49261a55 12-Jul-2016 Andrej Kozemcak <akozemca@cisco.com>

CSIT-203: Expand LISP test

- Change LISP configuration and test if LISP tunnel still work.

Change-Id: I28426d7cc0ede11aa7e826ab40ed1c95c8606abc
Signed-off-by: Andrej Kozemcak <akozemca@cisco.com>

ccdcc18f 25-Jul-2016 pmikus <pmikus@cisco.com>

CSIT-224 Update T-rex version to v2.06

- Update T-rex to version v2.06 with DPDK1607-rc3

Change-Id: I796b0ddaa9b7cb677a3a2fc6300904fabee4353e
Signed-off-by: pmikus <pmikus@cisco.com>

8825ed22 20-Jul-2016 Miroslav Miklus <mmiklus@cisco.com>

CSIT-136 IMIX T-REX driver

Change-Id: Ife7c543d07bcac4bad82894eea0f4e0e5a8db4bb
Signed-off-by: Miroslav Miklus <mmiklus@cisco.com>

c9152023 27-Jul-2016 Matej Klotton <mklotton@cisco.com>

CSIT-271: FIX Delete bridge after TAP test

Change-Id: Ic28405eb108feb2b24d77e1dd44c1b3320bd2288
Signed-off-by: Matej Klotton <mklotton@cisco.com>

be0db47f 27-Jul-2016 Matej Klotton <mklotton@cisco.com>

CSIT-212: FIX: Weekly job gets stucked in 2nd FUNCT test attempt

- remove mem-prealloc parameter from qemu options

Change-Id: I5a75f53da970c4aa772f29ed49bbf25c07bf2d87
Signed-off-by: Matej Klotton <mklotton@cisco.com>

f45cd0ce 15-Jul-2016 Miroslav Miklus <mmiklus@cisco.com>

CSIT-106 Vpp config - use only test-related interfaces

Current behaviour is to add all interfaces from topology,
we only want to add interfaces from computed path.

Change-Id: I9c5d4e765dbe399ee06dd13f0d25c48d3d8e5127
Signed-off-by: Miroslav Miklus <mmiklus@cisco.com>

721f3974 07-Jul-2016 Florin Coras <fcoras@cisco.com>

CSIT-199: Use static adjacencies in LISP dp tests

Switch to using static adjacencies and remote mappings instead of only the
latter in LISP data plane tests.

Change-Id: Ia2a05165425ac68fa7839f9c8f402033b8274fcf
Signed-off-by: Florin Coras <fcoras@cisco.com>

ef67d0db 18-Jul-2016 Matej Klotton <mklotton@cisco.com>

SSH timeout problem

In case of large output or stderr output the SSH proces got stucked,
because of output buffer fills. Fix with reading from buffers.

- increase traffic script default timeout
- add reconnect to ssh

Change-Id: Ie07107c6ab0fb19c9361d7390467b9b693fe2fdb
Signed-off-by: Matej Klotton <mklotton@cisco.com>

7c3e0cc4 13-Jun-2016 Zdeno Olsovsky <zolsovsk@cisco.com>

CSIT-158: Tap interface tests

Change-Id: I30a4562ea5fca9b839d854118243daa70378b0ae
Signed-off-by: Zdeno Olsovsky <zolsovsk@cisco.com>

dec1188c 22-Jul-2016 Tibor Frank <tifrank@cisco.com>

CSIT-219: Realocate resources for Honeycomb tests

- move the resources to resources/test_data/honeycomb

Change-Id: I77c1bd5707f557799a7a189a9c695c50e5471621
Signed-off-by: Tibor Frank <tifrank@cisco.com>

9c874359 22-Jul-2016 pmikus <pmikus@cisco.com>

PATCH: Fix add ip neigbour in IPV6 libraries

- fix vrf key error for IPv6 performance library

Change-Id: I3b80d350b3a524bcdea76012c717edbecff9c154
Signed-off-by: pmikus <pmikus@cisco.com>

5d2ce55a 12-Jul-2016 selias <samelias@cisco.com>

CSIT-49: HC Test: Policy - security groups

- add test suite for ACLs
- add keywords used in tests
- add resource file with variables used in ACL tests
- add methods and VAT templates for reading VPP ACL data

Change-Id: I98c78bfbce67309ae33ebb05c04640f5029bf4e2
Signed-off-by: selias <samelias@cisco.com>

80532e03 28-Jun-2016 Zdeno Olsovsky <zolsovsk@cisco.com>

CSIT-183: Vpn baseline routed forwarding (VRF)

- Setup 2 VRF tables on each DUT
- Test traffic - each port accessible within one vrf
- Test traffic - ports inaccessible to different vrf

Change-Id: I34256a683039734608509a38857dbdcbdd15bcf9
Signed-off-by: Zdeno Olsovsky <zolsovsk@cisco.com>
Signed-off-by: Matej Klotton <mklotton@cisco.com>

d87b98f6 21-Jun-2016 Patrik Hrnciar <phrnciar@cisco.com>

CSIT-188 IPv4 Reverse Path Forwarding tests

Change-Id: I45ea3316c5a3ef23d08530b256558cba72ccde07
Signed-off-by: Patrik Hrnciar <phrnciar@cisco.com>

c10eda55 06-Jul-2016 selias <samelias@cisco.com>

CSIT-190 Add honeycomb interface management test

- add test for specific issue with interface management through netconf
- add keywords used in test
- update methods that manage Netconf communication
- update notifications tests to reuse more code

Change-Id: I11788e18f05c4965160f247c3811d270d2c91170
Signed-off-by: selias <samelias@cisco.com>

28e17b80 12-Jul-2016 Tibor Frank <tifrank@cisco.com>

CSIT-53: HC Keywords: Policy - security groups

- add keywords to manipulate ACL data using Honeycomb REST API

Change-Id: Ia08faba216c5476113c0b3249de9c434eaa26a17
Signed-off-by: Tibor Frank <tifrank@cisco.com>

227795af 30-Jun-2016 Patrik Hrnciar <phrnciar@cisco.com>

CSIT-187 iacl with MAC classification tests

Add tests for:
- VPP can drop packets based on MAC src-addr
- VPP can drop packets based on MAC dst-addr
- VPP can drop packets based on MAC src-addr and dst-addr
- VPP can drop packets based on Ethertype

Change-Id: I5888c466018e976cd93ecbc8060191622aba90ad
Signed-off-by: Patrik Hrnciar <phrnciar@cisco.com>

0d64eaa4 20-Jul-2016 pmikus <pmikus@cisco.com>

Fix VLAN subinterfaces initialization

- fix bug in VLAN subinterfaces initialized on 3-node topology

Change-Id: I6a040eaaa8bf56afe887ef33f39d3c0207e8310d
Signed-off-by: pmikus <pmikus@cisco.com>

5ad0974e 20-Jul-2016 pmikus <pmikus@cisco.com>

CSIT-215 Improve documentation - performance

- Improve documentation in performance libraries

Change-Id: Idf3d8e5f0107de78776c955259b31f0e41e04585
Signed-off-by: pmikus <pmikus@cisco.com>

666cb858 07-Jul-2016 Jan Gelety <jgelety@cisco.com>

CSIT-34: VLAN tag rewrite translate tests with x-connects - IPv6

- VLAN tag rewrite translate-1-1
- VLAN tag rewrite translate-1-2
- VLAN tag rewrite translate-2-1
- VLAN tag rewrite translate-2-2

REMARK: Negative test cases will be tagged with SKIP_PATCH after merge.

Change-Id: I30176d0d02f32bfea9e48bf0acb257952c3f7c39
Signed-off-by: Jan Gelety <jgelety@cisco.com>
Signed-off-by: Matej Klotton <mklotton@cisco.com>

1ab4252c 20-Jul-2016 pmikus <pmikus@cisco.com>

Fix the VPPConfigGenerator error

Change-Id: I4be995af1ee67a84b1fa951d887f7fa04e958dd1
Signed-off-by: pmikus <pmikus@cisco.com>

b7217761 19-Jul-2016 pmikus <pmikus@cisco.com>

CSIT-215 Improve documentation - performance

- Improve documentation in performance libraries

Change-Id: I66e5b0782497c5759c737556f207cf2fd3383923
Signed-off-by: pmikus <pmikus@cisco.com>

bb69fe7a 20-May-2016 Peter Mikus <pmikus@cisco.com>

CSIT-102: Add latency measurement to performance testing

- Add latency stream as a background stream in both directions
- Latency background stream is not using the VM transformation engine.
Raw stream with single packet is created.
- Latency background stream has 1kpps rate with packet of same size as
traffic stream.
- Display latency values (min/avg/max) in results of TC and reporting
remaining data including histogram and jitter inside of the
search/pass keyword.

Change-Id: I78ce4659b57caab08d5729f51a1e14d518fd3273
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Signed-off-by: pmikus <pmikus@cisco.com>

f7feaf78 28-Jun-2016 Jan Gelety <jgelety@cisco.com>

CSIT-34: VLAN tag rewrite translate tests with x-connects - IPv4

- VLAN tag rewrite translate-1-1
- VLAN tag rewrite translate-1-2
- VLAN tag rewrite translate-2-1
- VLAN tag rewrite translate-2-2

REMARK: Negative test cases will be tagged with SKIP_PATCH after merge.

Change-Id: I76045e1416fe1a72298ccc2090cd373fac09b468
Signed-off-by: Jan Gelety <jgelety@cisco.com>
Signed-off-by: Matej Klotton <mklotton@cisco.com>

380372dd 18-Jul-2016 pmikus <pmikus@cisco.com>

CSIT-209 Add option enable-vhost-user into startup config

- Add option enable-vhost-user into startup config

Change-Id: I2cf7952047ee749bd66e041b57aaee61c2687382
Signed-off-by: pmikus <pmikus@cisco.com>

021f8d10 06-Jul-2016 Andrej Kozemcak <akozemca@cisco.com>

CSIT-195: Update LISP test

- add new input parameters for LISP API
- change LISP json output

Change-Id: I36dbf44dc78f128963c7f665a01d2ecde4598c28
Signed-off-by: Andrej Kozemcak <akozemca@cisco.com>

b037f5f0 12-Jul-2016 pmikus <pmikus@cisco.com>

CSIT-206 Adjust qemu runtime options

- Modify runtime optimization of qemu process in qemu library
- Add ballon=none
- Add option to set affinity
- Add mem-prealloc
- Add vhost extend options

Change-Id: I721557d3e38599d783dfe0773f0593a250f8fae7
Signed-off-by: pmikus <pmikus@cisco.com>

cee99393 12-Jul-2016 pmikus <pmikus@cisco.com>

CSIT-205 Update qemu install script

- Update Qemu install script to only install if not present
- Add option to force reinstall Qemu
- Add Keyword to install Qemu on all DUTs

Change-Id: Ic403c8749067878fe444d4d26ae21fd5d4781d3f
Signed-off-by: pmikus <pmikus@cisco.com>

5aa99254 25-May-2016 Peter Mikus <pmikus@cisco.com>

CSIT-60: Create l2-vlan-dot1ad libraries for perf testing

- create topology with VLAN dot1ad sub-interfaces inter-connected using
L2 cross connect in 3-node topology
- create keywords to be used in test cases
- create l2-vlan-dot1ad test cases (64B, 1514B, 9000B)

Change-Id: Ib25d5e8f09fb83d80596982608e93b1e511e8b8e
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Signed-off-by: pmikus <pmikus@cisco.com>

c6c25b1b 04-Jul-2016 Matej Klotton <mklotton@cisco.com>

CSIT-32: Add lightweight hairpinning test

Change-Id: Ibb62cab0891dfd2bd347c85e89d41bf02f2f96ac
Signed-off-by: Matej Klotton <mklotton@cisco.com>

41868e40 29-Jun-2016 Matej Klotton <mklotton@cisco.com>

CSIT-32: Add decapsulation test

Change-Id: I7c1e3e6aa5c88acf85afdcd01de5817603abbcab
Signed-off-by: Matej Klotton <mklotton@cisco.com>

27684f22 28-Jun-2016 Matej Klotton <mklotton@cisco.com>

CSIT-32: Add Softwire lw4o6 ICMP test

Change-Id: Ie82707b41f63c31e2a04c8300a961bd9c2ea5ad0
Signed-off-by: Matej Klotton <mklotton@cisco.com>

395e7f89 14-Jun-2016 Matej Klotton <mklotton@cisco.com>

CSIT-32: Add Lightweight 4over6 test.

Add keywords for configure MAP domanins and rules.
Add testcase for check encapsulation IPv4 in IPv6.

Change-Id: I52f04a15d982ccba1d35ce9ade9d7f0ce8e7f286
Signed-off-by: Matej Klotton <mklotton@cisco.com>

d5e00c67 30-Jun-2016 selias <samelias@cisco.com>

CSIT-184: Add Honeycomb sub-interface ipv4 tests

- add tests for sub-interface ipv4 support
- add keywords and methods used in tests

Change-Id: I98af193a4c4f0d3822eb9637f01acead37accb8c
Signed-off-by: selias <samelias@cisco.com>

3bb84bee 25-May-2016 Miroslav Miklus <mmiklus@cisco.com>

TB2 XL710 topology files

JIRA: CSIT-106

Change-Id: If3e76d971c7196da3f83a8daacd1308c6374c786
Signed-off-by: Miroslav Miklus <mmiklus@cisco.com>

dc1db8f3 07-Jul-2016 Miroslav Miklus <mmiklus@cisco.com>

CSIT-106 Cleanup of add_pci functions

Change-Id: If53cae5871b41af2a11a420d9f83ab57149a9096
Signed-off-by: Miroslav Miklus <mmiklus@cisco.com>

7dcef449 06-Jul-2016 pmikus <pmikus@cisco.com>

Modify Vpp show stats

- Remove dump_stats_table from Vpp show stats as it duplicates
information

Change-Id: I41757b36e57a7046e5b50106cd3963cb52d80712
Signed-off-by: pmikus <pmikus@cisco.com>

f1c96d9f 04-Jul-2016 pmikus <pmikus@cisco.com>

CSIT-191 Add API count option to ip_add_del_route

Add API count option to ip_add_del_route to be able to add more than 1
route

Change-Id: I3440579f960366a99f68ceeabea540f1a2ed4516
Signed-off-by: pmikus <pmikus@cisco.com>

7d2ae8ca 10-Jun-2016 Patrik Hrnciar <phrnciar@cisco.com>

CSIT-24 Proxy ARP test

Change-Id: Ia41af7e29dcb8c41d58c07134a385428ac1b285c
Signed-off-by: Patrik Hrnciar <phrnciar@cisco.com>

83d5183a 28-Jun-2016 Miroslav Miklus <mmiklus@cisco.com>

2-node topology keywords

JIRA: CSIT-182

Change-Id: I593c2d6b0e7a1ee344b879f7b54bb9443ab8c516
Signed-off-by: Miroslav Miklus <mmiklus@cisco.com>

5aa03bac 24-Jun-2016 pmikus <pmikus@cisco.com>

CSIT-180 Add VPP api trace dump after each TC

- Add VPP api trace dump after each TC

Change-Id: I7c8bc0ffbca620f6fdb48369014a2ca9ffa3b3e4
Signed-off-by: pmikus <pmikus@cisco.com>

d9716ad5 29-Jun-2016 selias <samelias@cisco.com>

Rename Honeycomb test suites

- update test suite numbering to be future-proof
- reorder suite execution:
- persistence suite should always run last
- l2_fib suite follows after l2
- VxLAN gpe suite follows after VxLAN
- fix issue with interface name vs. index introduced in change #1032
- change ${node} variable to global scope, set in _init_.robot

Change-Id: Ib4ca7265586026faab219da9923e7ca312ef2c79
Signed-off-by: selias <samelias@cisco.com>

f58467f6 28-Jun-2016 Miroslav Miklus <mmiklus@cisco.com>

FIX: refactor https://gerrit.fd.io/r/#/c/1032

Change-Id: If4585e9a586696ce583c356c7567dc68750bc08d
Signed-off-by: Miroslav Miklus <mmiklus@cisco.com>

4f5f136f 08-Jun-2016 selias <samelias@cisco.com>

Update Honeycomb tests

- add new negative test for bridged-virtual-interface setting
- modify variables in original bd tests to use bvi=False
- separate interface ipv4 test case into netmask and prefix
- replace per-testcase tag definitions with per-suite forced tags
- add separate tag for persistence suite, due to it's long execution time

Change-Id: I79ae699125d4838ed8b394dc80a028e08b4de684
Signed-off-by: selias <samelias@cisco.com>

e6ff0786 27-Jun-2016 Miroslav Miklus <mmiklus@cisco.com>

TG init changes for n-node topology

JIRA: CSIT-182
For TG node we only need to know the interfaces on TG node
and the adjecent nodes interfaces for any n-node topology.

Change-Id: I0129b9513356df976364b58e6749dfab3ca5e2ae
Signed-off-by: Miroslav Miklus <mmiklus@cisco.com>

400f404a 28-Jun-2016 pmikus <pmikus@cisco.com>

PATCH: Fix MAC address variables in perf libraries

Change-Id: I0f7b51349d2323bd501f6d6ae75474cc225e94bb
Signed-off-by: pmikus <pmikus@cisco.com>

498085ca 14-Jun-2016 selias <samelias@cisco.com>

Add Honeycomb notifications tests

JIRA: CSIT-164

- add test cases for implemented notifications
- add keywords used to receive and read notifications

Change-Id: I3359aa83dca49ca362bf4406520ded1d36b67bda
Signed-off-by: selias <samelias@cisco.com>

cbd47fbe 08-May-2016 Miroslav Miklus <mmiklus@cisco.com>

Use interface key instead of interface name.

JIRA: CSIT-141

Change-Id: I75cef6d570ab45ea9c4af838b6bf68cefc7c1a91
Signed-off-by: Miroslav Miklus <mmiklus@cisco.com>

fb890063 08-Jun-2016 selias <samelias@cisco.com>

Add Vlan tag rewrite to Honeycomb persistence tests

JIRA: CSIT-137

- add Vlan tag rewrite to persisted configuration

Change-Id: I2f98d89c6ada0eec5a7ba0121332201dbe2c01e0
Signed-off-by: selias <samelias@cisco.com>

49b73e48 23-Jun-2016 Tibor Frank <tifrank@cisco.com>

Modify tests and keywords for sub-interfaces.

JIRA: CSIT-175

- modify tests and keywords for sub-interfaces to reflect the last changes
introduced by https://gerrit.fd.io/r/#/c/1700/
- fix typos

Change-Id: I0839fe9f17149fa8c39ac31004bb2096d79c469f
Signed-off-by: Tibor Frank <tifrank@cisco.com>

bcf99a0e 08-Jun-2016 selias <samelias@cisco.com>

Update Honeycomb persistence tests with new Vlan

JIRA: CSIT-140

- add new vlan configuration to persistence

Change-Id: I984f39986f74168b31d82143c353c7ef1bd7d650
Signed-off-by: selias <samelias@cisco.com>

95253bdf 16-Jun-2016 Tibor Frank <tifrank@cisco.com>

Add tests for Honeycomb L2 FIB support

JIRA: CSIT-168

- add tests for Honeycomb L2 FIB support
- add keywords for Honeycomb L2 FIB support
- fix typos

Change-Id: I81292c10e26e7ad05725034c1db1db0a81d29283
Signed-off-by: Tibor Frank <tifrank@cisco.com>

dbef20c9 14-Jun-2016 Tibor Frank <tifrank@cisco.com>

Modify tests for Honeycomb sub-interfaces

JIRA: CSIT-139

- modify tests for Honeycomb sub-interfaces to reflect the last changes
in the model
- modify existing keywords to work with latest changes in Honyecomb and VPP

Change-Id: Idc88fbac7e743e6125d5c865d9d144448657dd20
Signed-off-by: Tibor Frank <tifrank@cisco.com>

628d2d69 26-May-2016 Andrej Kozemcak <akozemca@cisco.com>

Lisp enable/disable test

Test lisp enable/disable API.
Test disable lisp, re-enable it and check if everthing is still working.
Enable lisp before every lisp API test
Reformat source data

Change-Id: I7bace01535562814d85d7b5f6035436d583abf53
Signed-off-by: Andrej Kozemcak <akozemca@cisco.com>

c85a2d27 09-Jun-2016 Matej Klotton <mklotton@cisco.com>

Fix VPP sends ARP requests for unknown destinations TC destination MAC address

-JIRA: CSIT-142
The ICMP packet was send to wrong destination.
Don't use resolve-attemts in add route.
Fix testcase.
Add testcase Sends ARP to GW with EXPECTED_FAILING.
Variable naming fix.
Documentation update.

Change-Id: I71a7a274c154c525b176c87884d089155d7ae61b
Signed-off-by: Matej Klotton <mklotton@cisco.com>

8be64446 01-Jun-2016 Zdeno Olsovsky <zolsovsk@cisco.com>

Router Advertisement Tests

-JIRA: CSIT-30

Change-Id: Iedb403d555284d36a81cc490a79e56b019ebeed0
Signed-off-by: Zdeno Olsovsky <zolsovsk@cisco.com>

8e014c37 02-Jun-2016 Patrik Hrnciar <phrnciar@cisco.com>

IACL MAC filtering tests

- CSIT-133 VPP drops packets based on MAC src addr.
- CSIT-134 VPP can drop packets based on src MAC + IPv6 UDP src+dst port.

Change-Id: I57d041bc5f3311946679128e556ceef8c4d55264
Signed-off-by: Patrik Hrnciar <phrnciar@cisco.com>

244693d4 12-Jun-2016 pmikus <pmikus@cisco.com>

CSIT-163: Add show vpp version verbose

- Add output of vpp version verbose

Change-Id: Ia74b97be4636d55b115246d495a5d6eea0a94bb7
Signed-off-by: pmikus <pmikus@cisco.com>

f54659a3 09-Jun-2016 pmikus <pmikus@cisco.com>

CSIT-152: Detect if the T-rex is responding to API after start

Change-Id: I99c8dcbd210175fa5d1af193371249e525dc0102
Signed-off-by: pmikus <pmikus@cisco.com>

a74531b4 07-Jun-2016 Miroslav Miklus <mmiklus@cisco.com>

VPP startup config change (rss->txqueues)

JIRA: CSIT-153

Change-Id: I6908670003e02e8dc2971c0308c27baffaf19b66
Signed-off-by: Miroslav Miklus <mmiklus@cisco.com>

e8c787b6 06-Jun-2016 Tibor Frank <tifrank@cisco.com>

Add Tests for Honeycomb VxLAN GPE support

JIRA: CSIT-131

- add tests for Honeycomb VxLAN GPE support
- add keywords needed for tests

Change-Id: I460ecd30835bb95140958b20946b1d41ac6d9abc
Signed-off-by: Tibor Frank <tifrank@cisco.com>

3744273d 06-Jun-2016 pmikus <pmikus@cisco.com>

Update T-rex to v2.03 part II

- JIRA: CSIT-132
- Update Trex via autoinstall script

Change-Id: I65753b35287d9322ef230642ea0dd3596f1da5c9
Signed-off-by: pmikus <pmikus@cisco.com>