History log of /csit/resources/
Revision Date Author Comments
(<<< Hide modified files)
(Show modified files >>>)
bd9e6052 25-May-2020 pmikus <pmikus@cisco.com>

Infra: Ansible Nomad IV

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I67ab84c2c2b34ce5ccc3a2de629c41460bb52e8c

9c459a2b 05-May-2020 pmikus <pmikus@cisco.com>

Report: Infra update

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: Ie39585e88460d9a5e3764726d93dc065f5cbacfb

2820c4d8 22-May-2020 pmikus <pmikus@cisco.com>

Infra: Ansible Nomad III

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I6c37287e79e48ba40a5dda497cc3614c367230aa

dd41e6e3 25-May-2020 Tibor Frank <tifrank@cisco.com>

Trending: Sorting in weekly comparison

Change-Id: I4e143a1f108f1c6975b24d2355bdac9f2a74ab46
Signed-off-by: Tibor Frank <tifrank@cisco.com>

216073ac 22-May-2020 pmikus <pmikus@cisco.com>

Infra: Ansible Nomad II

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: Iaa5c02d14223b578c316f48e31a0b3613303eecf

39923ac0 22-May-2020 Tibor Frank <tifrank@cisco.com>

Report 2001: Add data

Change-Id: I163af32bbecafdeed14a8deb32e9ec0c66980d31
Signed-off-by: Tibor Frank <tifrank@cisco.com>

d832848a 22-May-2020 Tibor Frank <tifrank@cisco.com>

CSIT-1703: Trending: Improve sorting in the dashboard

New order:

1. regressions,
2. progressions,
3. short-term diff,
4. long-term diff,
5. test name.

Change-Id: Ie232d6759a088173fd56e2563c293cdfac352a98
Signed-off-by: Tibor Frank <tifrank@cisco.com>

aed00718 22-May-2020 Tibor Frank <tifrank@cisco.com>

Report 2001: Add data

Change-Id: I8609e1d0a7cc4e8a641b947a4382dd4f64d0c981
Signed-off-by: Tibor Frank <tifrank@cisco.com>

f1dfd1c9 22-May-2020 Tibor Frank <tifrank@cisco.com>

PAL: Colors in graphs 2

Change-Id: I69d341de8fde562d4d514954fa6b094ef1204489
Signed-off-by: Tibor Frank <tifrank@cisco.com>

c180acb8 20-May-2020 pmikus <pmikus@cisco.com>

Infra: Ansible Nomad

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: Icc03bf62d8639f603ca90aa6ab849a46dc911d56

a6ed764a 20-May-2020 Tibor Frank <tifrank@cisco.com>

PAL: Colors in graphs

Change-Id: I23b792ab01dc433e31c7d5eb5c48a95e5a2ec210
Signed-off-by: Tibor Frank <tifrank@cisco.com>

b3f573f5 21-May-2020 Tibor Frank <tifrank@cisco.com>

Report 2001: Add data

Change-Id: I34bc36a430f207be0c374540713f70e877b8fcf9
Signed-off-by: Tibor Frank <tifrank@cisco.com>

5c7b32f5 20-May-2020 pmikus <pmikus@cisco.com>

Infra: Ansible maintenance

+ As per last discoveries when running from_scratch vs. append_only

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I8b44314185bbc157a67136730dc6146d133c7cc4

1881e1a4 20-May-2020 Tibor Frank <tifrank@cisco.com>

Report 2001: Add pdf version

Change-Id: I2c46c10dff61633cffae39d2a835d9c29ef2573d
Signed-off-by: Tibor Frank <tifrank@cisco.com>

5145244d 06-May-2020 pmikus <pmikus@cisco.com>

Ansible: Mount /tmp as tmpfs

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I69d9290d42c154f54e71e769a3a5d89a69c2e602

46a4469f 20-May-2020 Tibor Frank <tifrank@cisco.com>

Report: Add data

+ 2n-clx

Change-Id: I291f05a6e2d1f95f18c09efde5549109b0696481
Signed-off-by: Tibor Frank <tifrank@cisco.com>

111fa811 20-May-2020 Tibor Frank <tifrank@cisco.com>

Report: Add data

Change-Id: I6dad9dc40de95e8e878e01a30c4f8a3c7f0c60f2
Signed-off-by: Tibor Frank <tifrank@cisco.com>

5fa2e806 19-May-2020 Tibor Frank <tifrank@cisco.com>

Report: Add data

Change-Id: I2854a38bf7b5d4718cab947b247231c41a8368fd
Signed-off-by: Tibor Frank <tifrank@cisco.com>

dd361535 18-May-2020 Tibor Frank <tifrank@cisco.com>

Trending: CSIT-1717: Add links from dashboard to graphs

+ fix TB names in alerts

Change-Id: Ia10e9b82b57e90f7ae4592bd6ecf8b71dea71cc8
Signed-off-by: Tibor Frank <tifrank@cisco.com>

de08ebfe 07-May-2020 Jan Gelety <jgelety@cisco.com>

Add csit-vpp-perf-report-iterative job

- job will be used to collect vpp performance iterative data
for csit report

Change-Id: I4cff5caa0a97d08b11f3eb9b72963deaf1b04c73
Signed-off-by: Jan Gelety <jgelety@cisco.com>

03aa6d12 18-May-2020 Tibor Frank <tifrank@cisco.com>

Report: Add data

Change-Id: Ie36c6b3ad7763071101912cf354bdd0c0c0bfa1e
Signed-off-by: Tibor Frank <tifrank@cisco.com>

55ff5592 15-May-2020 Tibor Frank <tifrank@cisco.com>

Report: Add data, configure 2001.21

Change-Id: I8eb2b893989fa22282d4d940513a69e0c87bbfdb
Signed-off-by: Tibor Frank <tifrank@cisco.com>

8d79b30d 14-May-2020 Tibor Frank <tifrank@cisco.com>

Trending: Fix typos

Change-Id: If2ca4c859c89ad1fdfb9cf3980a7aaba6966c929
Signed-off-by: Tibor Frank <tifrank@cisco.com>

e244fff2 15-May-2020 Tibor Frank <tifrank@cisco.com>

Trending: Add alerts for NDRPDR weekly tests

Change-Id: I35a806f8dd61e2c6d6dca2cdcfa4f7131e061cea
Signed-off-by: Tibor Frank <tifrank@cisco.com>

936deb75 24-Mar-2020 Peter Mikus <pmikus@cisco.com>

Performance: Tests with virtio driver in VM

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I20e01dfe83a961dc8202d33783a678d38e71cff2

5a0bf468 11-May-2020 Tibor Frank <tifrank@cisco.com>

Trending: Add NDRPDR trending graphs

Change-Id: I57caf62b5084e36d8909330af68f766b50e3b748
Signed-off-by: Tibor Frank <tifrank@cisco.com>

c0a974f0 07-May-2020 Jan Gelety <jgelety@cisco.com>

FIX: Download only vpp packages

Signed-off-by: Jan Gelety <jgelety@cisco.com>
Change-Id: I88682b972947d73ae8433b550bd5e96b0b7c2c76
(cherry picked from commit 36237cf89a092fee57faa6b2b1726d40df493845)

f9f7672f 13-May-2020 pmikus <pmikus@cisco.com>

Ansible: Small maintenance

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I542401d77a777dfc2d930de626e19c1d8083941c

f80a0bee 09-Apr-2020 Vratko Polak <vrpolak@cisco.com>

Execute also show runtime CLI

Example of a test with missing info:
https://logs.fd.io/production/vex-yul-rot-jenkins-1/csit-vpp-perf-mrr-daily-master-2n-clx/287/archives/log.html.gz#s1-s1-s1-s4-s8-t3-k2-k9-k1-k1-k4-k1
- Missing any -outpt and -tx nodes.
- Zeros in vectors in rdma-input node (even though calls are there).

Placing the CLI call after the stats one,
to confirm stats does not "break" the CLI.

+ Using an earlier parent, to dodge some test failures.

Change-Id: I79072b54b6bf964dab4f21428e186394bafda72a
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

49bf7821 13-May-2020 pmikus <pmikus@cisco.com>

Infra: PIP installation freeze

+ Waiting for Docker image to be updated. Then next step
I will disable any update attempt.

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I92d4e27be0537a95473cd723a45e6185b26ce599

42e546fa 03-Mar-2020 Jan Gelety <jgelety@cisco.com>

job-specs: new job test spec files including test count and durations

Change-Id: I4ad87092bff1c072051ca1c7243d8dedb1c4576e
Signed-off-by: Jan Gelety <jgelety@cisco.com>
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>

ae9c086f 13-May-2020 Tibor Frank <tifrank@cisco.com>

Report: Disable pdf version

Change-Id: I1dd0c4289c1318916b5351b378db8a85f136539f
Signed-off-by: Tibor Frank <tifrank@cisco.com>

2e32661e 13-May-2020 Tibor Frank <tifrank@cisco.com>

Report: Add perf-sel set to oper tables

Change-Id: If63bae7ee3dc439633e69e5b507dcaf262fabadf
Signed-off-by: Tibor Frank <tifrank@cisco.com>

8a55a351 07-May-2020 Jan Gelety <jgelety@cisco.com>

FIX: SRv6 encap

Change-Id: I4b75b343fc144489d81f82dbb4917b4a70a9911b
Signed-off-by: Jan Gelety <jgelety@cisco.com>

b8396f2d 13-May-2020 Tibor Frank <tifrank@cisco.com>

Report: Add data, add pdf version

Change-Id: I8c972aa7a1689494adc93d9c3c881e419913f47e
Signed-off-by: Tibor Frank <tifrank@cisco.com>

157a5f2d 12-May-2020 pmikus <pmikus@cisco.com>

FIX: L3fwd properly

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: Ibdfc0350a101c4815f25456176e25bb1d90fd881

2361ed73 11-May-2020 Maciek Konstantynowicz <mkonstan@cisco.com>

Report CSIT-2001: updated CSIT environment ver. 2 date to 2020-03-27 per repo.

Change-Id: Id797295397c7159264ce7f457e6fd60af3d805bf
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>

5df001ac 12-May-2020 Maciek Konstantynowicz <mkonstan@cisco.com>

Report 2001: updated 2n-/3n-skx RCA yaml files with jira tickets.

Change-Id: I79b874ad00b0d8a0be80de0be52df656a2ce36d6
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>

a487639f 12-May-2020 Tibor Frank <tifrank@cisco.com>

Report: Fix header of comp tables, add data

Change-Id: I6d8727a08dce888bfbc620ebe34b6bd35bac488b
Signed-off-by: Tibor Frank <tifrank@cisco.com>

8c90273f 29-Apr-2020 Jan Gelety <jgelety@cisco.com>

CSIT-1597 API cleanup: ipsec

- cover API changes in VPP: https://gerrit.fd.io/r/c/vpp/+/26276
- update vpp stable to version 20.05-rc0~727

Change-Id: I39a0b5e60fac6a74aff2426f6a448c0e117ab647
Signed-off-by: Jan Gelety <jgelety@cisco.com>

0e8f9d1b 11-May-2020 Tibor Frank <tifrank@cisco.com>

Report: Update to version numbering for RCA tables

Change-Id: I7af3ef9ad545fa31477fc8f3403156c6aaea82f6
Signed-off-by: Tibor Frank <tifrank@cisco.com>

66ad46cb 04-May-2020 Vratko Polak <vrpolak@cisco.com>

Update RCA1, RCA2 descriptions for 2n-skx, 3n-skx.

Change-Id: I729229a42a00aa4b93cb3d8331718413ca9e297c
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>

f4c4608a 07-May-2020 Tibor Frank <tifrank@cisco.com>

Report: Configure report 2001.20

Change-Id: Ib0a3190dfd5b216aa9ff93d751fa48cd42cef88f
Signed-off-by: Tibor Frank <tifrank@cisco.com>

424346c5 23-Apr-2020 Dave Wallace <dwallacelf@gmail.com>

perf: refactor 'setup suite topology interfaces'

- and 'setup suite topology interfaces no tg' to
use a common keyword to create suite variables
using the required topology information.

Change-Id: I46894948bc86eb7ce72d036e5b84f09c5c1385db
Signed-off-by: Dave Wallace <dwallacelf@gmail.com>

ad2b8085 07-May-2020 Tibor Frank <tifrank@cisco.com>

Report: Add data

Change-Id: If1d8025104b0cb04eee138d77c5c50c774a52753
Signed-off-by: Tibor Frank <tifrank@cisco.com>

aa138e67 28-Apr-2020 Peter Mikus <pmikus@cisco.com>

Ansible: Pre-check tests

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I745ceb519220c4d08951dff07350f2f4709f3533

48cd54ff 06-May-2020 Tibor Frank <tifrank@cisco.com>

Trending: NDRPDR dashboard

Change-Id: I7f4c84dd47874c484f34f389b93de635c66a77c1
Signed-off-by: Tibor Frank <tifrank@cisco.com>

007b6075 06-May-2020 pmikus <pmikus@cisco.com>

FIX: dot1q-ip6

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: Ied48646bd9de41e5a55e0006440d057c5fddf694

b1305d5d 30-Apr-2020 Peter Mikus <pmikus@cisco.com>

Ansible: Remove cobbler

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I34446125071ee7157e1c0e29027a6d973ee03c7e


tools/testbed-setup/ansible/cobbler.yaml
tools/testbed-setup/ansible/inventories/lf_inventory/host_vars/10.30.51.16.yaml
tools/testbed-setup/ansible/inventories/lf_inventory/host_vars/10.30.51.17.yaml
tools/testbed-setup/ansible/inventories/lf_inventory/host_vars/10.30.51.18.yaml
tools/testbed-setup/ansible/inventories/lf_inventory/host_vars/10.30.51.20.yaml
tools/testbed-setup/ansible/inventories/lf_inventory/host_vars/10.30.51.21.yaml
tools/testbed-setup/ansible/inventories/lf_inventory/host_vars/10.30.51.22.yaml
tools/testbed-setup/ansible/inventories/lf_inventory/host_vars/10.30.51.24.yaml
tools/testbed-setup/ansible/inventories/lf_inventory/host_vars/10.30.51.25.yaml
tools/testbed-setup/ansible/inventories/lf_inventory/host_vars/10.30.51.26.yaml
tools/testbed-setup/ansible/inventories/lf_inventory/host_vars/10.30.51.44.yaml
tools/testbed-setup/ansible/inventories/lf_inventory/host_vars/10.30.51.45.yaml
tools/testbed-setup/ansible/inventories/lf_inventory/host_vars/10.30.51.46.yaml
tools/testbed-setup/ansible/inventories/lf_inventory/host_vars/10.30.51.47.yaml
tools/testbed-setup/ansible/inventories/lf_inventory/host_vars/10.30.51.48.yaml
tools/testbed-setup/ansible/inventories/lf_inventory/host_vars/10.30.51.49.yaml
tools/testbed-setup/ansible/inventories/lf_inventory/host_vars/10.30.51.50.yaml
tools/testbed-setup/ansible/inventories/lf_inventory/host_vars/10.30.51.51.yaml
tools/testbed-setup/ansible/inventories/lf_inventory/host_vars/10.30.51.52.yaml
tools/testbed-setup/ansible/inventories/lf_inventory/host_vars/10.30.51.53.yaml
tools/testbed-setup/ansible/inventories/lf_inventory/host_vars/10.30.51.54.yaml
tools/testbed-setup/ansible/inventories/lf_inventory/host_vars/10.30.51.55.yaml
tools/testbed-setup/ansible/inventories/lf_inventory/host_vars/10.30.51.56.yaml
tools/testbed-setup/ansible/inventories/lf_inventory/host_vars/10.30.51.57.yaml
tools/testbed-setup/ansible/inventories/lf_inventory/host_vars/10.30.51.58.yaml
tools/testbed-setup/ansible/inventories/lf_inventory/host_vars/10.30.51.59.yaml
tools/testbed-setup/ansible/inventories/lf_inventory/host_vars/10.30.51.60.yaml
tools/testbed-setup/ansible/inventories/lf_inventory/host_vars/10.32.8.10.yaml
tools/testbed-setup/ansible/inventories/lf_inventory/host_vars/10.32.8.11.yaml
tools/testbed-setup/ansible/inventories/lf_inventory/host_vars/10.32.8.12.yaml
tools/testbed-setup/ansible/inventories/lf_inventory/host_vars/10.32.8.13.yaml
tools/testbed-setup/ansible/inventories/lf_inventory/host_vars/10.32.8.18.yaml
tools/testbed-setup/ansible/inventories/lf_inventory/host_vars/10.32.8.19.yaml
tools/testbed-setup/ansible/inventories/lf_inventory/host_vars/10.32.8.20.yaml
tools/testbed-setup/ansible/inventories/lf_inventory/host_vars/10.32.8.21.yaml
tools/testbed-setup/ansible/inventories/lf_inventory/host_vars/10.32.8.22.yaml
tools/testbed-setup/ansible/inventories/lf_inventory/host_vars/10.32.8.23.yaml
tools/testbed-setup/ansible/inventories/lf_inventory/hosts
tools/testbed-setup/ansible/inventories/sample_inventory/host_vars/1.1.1.1.yaml
tools/testbed-setup/ansible/roles/cobbler/files/Dockerfile
tools/testbed-setup/ansible/roles/cobbler/files/etc/cobbler/dhcp.template
tools/testbed-setup/ansible/roles/cobbler/files/etc/httpd/conf.d/cobbler_web.conf
tools/testbed-setup/ansible/roles/cobbler/files/supervisord/supervisord.conf
tools/testbed-setup/ansible/roles/cobbler/files/var/lib/cobbler/kickstarts/ubuntu-18.04.2-server-x86_64.seed
tools/testbed-setup/ansible/roles/cobbler/tasks/main.yaml
tools/testbed-setup/ansible/roles/cobbler/tasks/ubuntu-18.04.2-server-x86_64.yaml
tools/testbed-setup/ansible/site.yaml
79f5ba9b 04-May-2020 Vratko Polak <vrpolak@cisco.com>

Separate files needing GPL license

+ Keep apache license for now, until this is completed:
https://wiki.fd.io/view/TSC/Relicensing_Procedure
+ Add utilities for switching license comment blocks.
- They do not preserve attributes, so executable flag is lost.
+ Move the affected files to GPL/.
+ Update paths so files are executed from the new location.
+ Change the way scripts are started to do not require executable flag.
+ Employ OptionString when constructing longer command lines.
+ Move also PacketVerifier.py and TrafficScriptArg.py
as they are linked with traffic scripts.
+ That means the two files are outside "resources" package tree now.
+ Added __init__.py files so relative imports work in new package tree.
+ Start traffic scripts as python modules to allow relative imports.
+ Once again needed because they are outside the default PYTHONPATH.

Change-Id: Ieb135629e890adbaf5b79497570f3be25b746f9f
Signed-off-by: Vratko Polak <vrpolak@cisco.com>


libraries/python/PacketVerifier.py
libraries/python/TrafficGenerator.py
libraries/python/TrafficScriptArg.py
libraries/python/TrafficScriptExecutor.py
tools/block_replacer/apache2gpl.sh
tools/block_replacer/apache_block.txt
tools/block_replacer/gpl2apache.sh
tools/block_replacer/gpl_block.txt
tools/block_replacer/replace.py
tools/trex/trex_server_info.py
tools/trex/trex_stateless_profile.py
tools/trex/trex_stateless_stop.py
traffic_profiles/trex/profile_trex_stateless_base_class.py
traffic_profiles/trex/trex-sl-2n-dot1qip4asym-ip4src254.py
traffic_profiles/trex/trex-sl-2n-dot1qip6asym-ip6src253.py
traffic_profiles/trex/trex-sl-2n-ethip4-ip4dst-rnd10000.py
traffic_profiles/trex/trex-sl-2n-ethip4-ip4dst-rnd100000.py
traffic_profiles/trex/trex-sl-2n-ethip4-ip4dst-rnd1000000.py
traffic_profiles/trex/trex-sl-2n-ethip4-ip4dst10000.py
traffic_profiles/trex/trex-sl-2n-ethip4-ip4dst100000.py
traffic_profiles/trex/trex-sl-2n-ethip4-ip4dst1000000.py
traffic_profiles/trex/trex-sl-2n-ethip4-ip4src253.py
traffic_profiles/trex/trex-sl-2n-ethip4-ip4src254.py
traffic_profiles/trex/trex-sl-2n-ethip4-macsrc500kdst500k.py
traffic_profiles/trex/trex-sl-2n-ethip4-macsrc50kdst50k.py
traffic_profiles/trex/trex-sl-2n-ethip4-macsrc5kdst5k.py
traffic_profiles/trex/trex-sl-2n-ethip4udp-1000u15p.py
traffic_profiles/trex/trex-sl-2n-ethip4udp-10u1000p-conc.py
traffic_profiles/trex/trex-sl-2n-ethip4udp-1u1p.py
traffic_profiles/trex/trex-sl-2n-ethip4udp-lb.py
traffic_profiles/trex/trex-sl-2n-ethip6-ip6dst10000.py
traffic_profiles/trex/trex-sl-2n-ethip6-ip6dst100000.py
traffic_profiles/trex/trex-sl-2n-ethip6-ip6dst1000000.py
traffic_profiles/trex/trex-sl-2n-ethip6-ip6src253.py
traffic_profiles/trex/trex-sl-2n3n-ethip4-ip4src254-10c1n.py
traffic_profiles/trex/trex-sl-2n3n-ethip4-ip4src254-10c2n.py
traffic_profiles/trex/trex-sl-2n3n-ethip4-ip4src254-1c10n.py
traffic_profiles/trex/trex-sl-2n3n-ethip4-ip4src254-1c1n.py
traffic_profiles/trex/trex-sl-2n3n-ethip4-ip4src254-1c2n.py
traffic_profiles/trex/trex-sl-2n3n-ethip4-ip4src254-1c4n.py
traffic_profiles/trex/trex-sl-2n3n-ethip4-ip4src254-1c6n.py
traffic_profiles/trex/trex-sl-2n3n-ethip4-ip4src254-1c8n.py
traffic_profiles/trex/trex-sl-2n3n-ethip4-ip4src254-2c10n.py
traffic_profiles/trex/trex-sl-2n3n-ethip4-ip4src254-2c1n.py
traffic_profiles/trex/trex-sl-2n3n-ethip4-ip4src254-2c2n.py
traffic_profiles/trex/trex-sl-2n3n-ethip4-ip4src254-2c4n.py
traffic_profiles/trex/trex-sl-2n3n-ethip4-ip4src254-2c6n.py
traffic_profiles/trex/trex-sl-2n3n-ethip4-ip4src254-2c8n.py
traffic_profiles/trex/trex-sl-2n3n-ethip4-ip4src254-4c1n.py
traffic_profiles/trex/trex-sl-2n3n-ethip4-ip4src254-4c2n.py
traffic_profiles/trex/trex-sl-2n3n-ethip4-ip4src254-4c4n.py
traffic_profiles/trex/trex-sl-2n3n-ethip4-ip4src254-4c6n.py
traffic_profiles/trex/trex-sl-2n3n-ethip4-ip4src254-6c1n.py
traffic_profiles/trex/trex-sl-2n3n-ethip4-ip4src254-6c2n.py
traffic_profiles/trex/trex-sl-2n3n-ethip4-ip4src254-6c4n.py
traffic_profiles/trex/trex-sl-2n3n-ethip4-ip4src254-8c1n.py
traffic_profiles/trex/trex-sl-2n3n-ethip4-ip4src254-8c2n.py
traffic_profiles/trex/trex-sl-3n-dot1qip4-vlan100ip4src254ip4dst254.py
traffic_profiles/trex/trex-sl-3n-dot1qip4-vlan10ip4src254ip4dst254.py
traffic_profiles/trex/trex-sl-3n-dot1qip4-vlan1ip4src254ip4dst254.py
traffic_profiles/trex/trex-sl-3n-dot1qip4-vlan1kip4src254ip4dst254.py
traffic_profiles/trex/trex-sl-3n-ethip4-ip4dst1.py
traffic_profiles/trex/trex-sl-3n-ethip4-ip4dst100.py
traffic_profiles/trex/trex-sl-3n-ethip4-ip4dst1000-1cnf.py
traffic_profiles/trex/trex-sl-3n-ethip4-ip4dst1000-2cnf.py
traffic_profiles/trex/trex-sl-3n-ethip4-ip4dst1000-4cnf.py
traffic_profiles/trex/trex-sl-3n-ethip4-ip4dst1000-8cnf.py
traffic_profiles/trex/trex-sl-3n-ethip4-ip4dst1000.py
traffic_profiles/trex/trex-sl-3n-ethip4-ip4dst10000-1cnf.py
traffic_profiles/trex/trex-sl-3n-ethip4-ip4dst10000-2cnf.py
traffic_profiles/trex/trex-sl-3n-ethip4-ip4dst10000-4cnf.py
traffic_profiles/trex/trex-sl-3n-ethip4-ip4dst10000-8cnf.py
traffic_profiles/trex/trex-sl-3n-ethip4-ip4dst10000.py
traffic_profiles/trex/trex-sl-3n-ethip4-ip4dst100000.py
traffic_profiles/trex/trex-sl-3n-ethip4-ip4dst1000000.py
traffic_profiles/trex/trex-sl-3n-ethip4-ip4dst20000-1cnf.py
traffic_profiles/trex/trex-sl-3n-ethip4-ip4dst20000-2cnf.py
traffic_profiles/trex/trex-sl-3n-ethip4-ip4dst20000-4cnf.py
traffic_profiles/trex/trex-sl-3n-ethip4-ip4dst20000-8cnf.py
traffic_profiles/trex/trex-sl-3n-ethip4-ip4dst20000.py
traffic_profiles/trex/trex-sl-3n-ethip4-ip4dst253.py
traffic_profiles/trex/trex-sl-3n-ethip4-ip4dst253_l3fwd.py
traffic_profiles/trex/trex-sl-3n-ethip4-ip4dst4-1cnf.py
traffic_profiles/trex/trex-sl-3n-ethip4-ip4dst4-2cnf.py
traffic_profiles/trex/trex-sl-3n-ethip4-ip4dst4-4cnf.py
traffic_profiles/trex/trex-sl-3n-ethip4-ip4dst4.py
traffic_profiles/trex/trex-sl-3n-ethip4-ip4dst40-1cnf.py
traffic_profiles/trex/trex-sl-3n-ethip4-ip4dst40-2cnf.py
traffic_profiles/trex/trex-sl-3n-ethip4-ip4dst40-4cnf.py
traffic_profiles/trex/trex-sl-3n-ethip4-ip4dst40-8cnf.py
traffic_profiles/trex/trex-sl-3n-ethip4-ip4dst40.py
traffic_profiles/trex/trex-sl-3n-ethip4-ip4dst400-1cnf.py
traffic_profiles/trex/trex-sl-3n-ethip4-ip4dst400-2cnf.py
traffic_profiles/trex/trex-sl-3n-ethip4-ip4dst400-4cnf.py
traffic_profiles/trex/trex-sl-3n-ethip4-ip4dst400-8cnf.py
traffic_profiles/trex/trex-sl-3n-ethip4-ip4dst400.py
traffic_profiles/trex/trex-sl-3n-ethip4-ip4dst40000-1cnf.py
traffic_profiles/trex/trex-sl-3n-ethip4-ip4dst40000-2cnf.py
traffic_profiles/trex/trex-sl-3n-ethip4-ip4dst40000-4cnf.py
traffic_profiles/trex/trex-sl-3n-ethip4-ip4dst40000-8cnf.py
traffic_profiles/trex/trex-sl-3n-ethip4-ip4dst40000.py
traffic_profiles/trex/trex-sl-3n-ethip4-ip4dst5000-1cnf.py
traffic_profiles/trex/trex-sl-3n-ethip4-ip4dst5000-2cnf.py
traffic_profiles/trex/trex-sl-3n-ethip4-ip4dst5000-4cnf.py
traffic_profiles/trex/trex-sl-3n-ethip4-ip4dst5000-8cnf.py
traffic_profiles/trex/trex-sl-3n-ethip4-ip4dst5000.py
traffic_profiles/trex/trex-sl-3n-ethip4-ip4dst60000-1cnf.py
traffic_profiles/trex/trex-sl-3n-ethip4-ip4dst60000-2cnf.py
traffic_profiles/trex/trex-sl-3n-ethip4-ip4dst60000-4cnf.py
traffic_profiles/trex/trex-sl-3n-ethip4-ip4dst60000-8cnf.py
traffic_profiles/trex/trex-sl-3n-ethip4-ip4dst60000.py
traffic_profiles/trex/trex-sl-3n-ethip4-ip4src253.py
traffic_profiles/trex/trex-sl-3n-ethip4-ip4src254.py
traffic_profiles/trex/trex-sl-3n-ethip4-macsrc100ip4src100.py
traffic_profiles/trex/trex-sl-3n-ethip4-macsrc100kip4src100k.py
traffic_profiles/trex/trex-sl-3n-ethip4-macsrc10kip4src10k.py
traffic_profiles/trex/trex-sl-3n-ethip4-macsrc500kdst500k.py
traffic_profiles/trex/trex-sl-3n-ethip4-macsrc50kdst50k.py
traffic_profiles/trex/trex-sl-3n-ethip4-macsrc5kdst5k.py
traffic_profiles/trex/trex-sl-3n-ethip4udp-1000u15p.py
traffic_profiles/trex/trex-sl-3n-ethip4udp-100u1000p-conc.py
traffic_profiles/trex/trex-sl-3n-ethip4udp-100u15p.py
traffic_profiles/trex/trex-sl-3n-ethip4udp-10u1000p-conc.py
traffic_profiles/trex/trex-sl-3n-ethip4udp-10u10p-conc.py
traffic_profiles/trex/trex-sl-3n-ethip4udp-10u15p.py
traffic_profiles/trex/trex-sl-3n-ethip4udp-1u15p.py
traffic_profiles/trex/trex-sl-3n-ethip4udp-1u1p.py
traffic_profiles/trex/trex-sl-3n-ethip4udp-2000u15p.py
traffic_profiles/trex/trex-sl-3n-ethip4udp-4000u15p.py
traffic_profiles/trex/trex-sl-3n-ethip6-ip6dst10000.py
traffic_profiles/trex/trex-sl-3n-ethip6-ip6dst100000.py
traffic_profiles/trex/trex-sl-3n-ethip6-ip6dst1000000.py
traffic_profiles/trex/trex-sl-3n-ethip6-ip6src253.py
traffic_profiles/trex/trex-sl-dot1qip4-vlan1ip4src254ip4dst254-bvi.py
traffic_profiles/trex/trex-sl-dot1qip4-vlan1ip4src254ip4dst254.py
traffic_profiles/trex/trex-sl-dot1qip4vxlan-ip4src10udpsrcrnd.py
traffic_profiles/trex/trex-sl-dot1qip4vxlan-ip4src1udpsrcrnd.py
traffic_profiles/trex/trex-sl-dot1qip4vxlan-ip4src2udpsrcrnd.py
traffic_profiles/trex/trex-sl-dot1qip4vxlan-ip4src4udpsrcrnd.py
traffic_profiles/trex/trex-sl-dot1qip4vxlan-ip4src6udpsrcrnd.py
traffic_profiles/trex/trex-sl-dot1qip4vxlan-ip4src8udpsrcrnd.py
traffic_profiles/trex/trex-sl-ethip4vxlan-ip4src1udpsrcrnd.py
traffic_scripts/ipsec_interface.py
traffic_scripts/ipsec_policy.py
traffic_scripts/lisp/lisp_check.py
traffic_scripts/lisp/lispgpe_check.py
traffic_scripts/policer.py
traffic_scripts/send_icmp_wait_for_reply.py
traffic_scripts/send_ip_check_headers.py
traffic_scripts/send_vxlan_check_vxlan.py
traffic_scripts/srv6_encap.py
traffic_scripts/vxlan.py
16ef90a2 06-May-2020 pmikus <pmikus@cisco.com>

Performance: Fix l3fwd in 3node

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I32fd935078fb117bb1570e20a11baa2de46447e8

bebc5773 06-May-2020 Tibor Frank <tifrank@cisco.com>

Report 2001: Add data

Change-Id: I19e2d6a2592fc0f742cde6078eeb726f3703f306
Signed-off-by: Tibor Frank <tifrank@cisco.com>

5684e5c5 06-May-2020 Tibor Frank <tifrank@cisco.com>

Report: Add data

Change-Id: I50c8125dbc1040d8f85790a0065b282905ff64b2
Signed-off-by: Tibor Frank <tifrank@cisco.com>

68079ecf 04-May-2020 Tibor Frank <tifrank@cisco.com>

Trending: CSIT-1301: Display stdev in hover info

+ make possible to use dashboard for ndrpdr tests
+ fixes in ndrpdr weekly comparison

Change-Id: I846dc207ea620fad78424a445b32095160d4431d
Signed-off-by: Tibor Frank <tifrank@cisco.com>

efa0e0bd 04-May-2020 vagrant <vagrant@dieter-lnx.cisco.com>

FIX: IPsec

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Iacd7aa49d9832233033fe18fc228ccd45c12b4db

a54bbbf9 04-May-2020 Vratko Polak <vrpolak@cisco.com>

Print more info when checking out oper branch

Change-Id: Ic8d1080edacea1d27eb80e61f48cd4cd4430c139
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

5c19210b 04-May-2020 Tibor Frank <tifrank@cisco.com>

Report: Add data

Change-Id: I816a65b70f0d85572e398e7e6677a287cf739192
Signed-off-by: Tibor Frank <tifrank@cisco.com>

a6f1a151 31-Mar-2020 Jan Gelety <jgelety@cisco.com>

VPP-DEV API Coverages: SRv6

Jira: CSIT-1698

Change-Id: I6d9154284990df8877850e4014716510016e485b
Signed-off-by: Jan Gelety <jgelety@cisco.com>

fada1fcb 04-May-2020 Tibor Frank <tifrank@cisco.com>

Report: Configure report 2001.19

Change-Id: I42d2723745a119667b8af2165fbd99dc4fe3cc3e
Signed-off-by: Tibor Frank <tifrank@cisco.com>

00d8063d 04-May-2020 Tibor Frank <tifrank@cisco.com>

Report: Fix typo in specification.

Change-Id: Ie61f8c1eef8828ce30f82e33ef0c40b8f77de26b
Signed-off-by: Tibor Frank <tifrank@cisco.com>

4f7ce5c8 29-Apr-2020 Tibor Frank <tifrank@cisco.com>

PAL: Comparison tables

- Add tags to columns in "table_comparison"
- replace "table_perf_comparison" by "table_comparison"
- replace "table_perf_comparison_nic" by "table_comparison"

Change-Id: Ie9d871cb2fe04ab2efbc07737806826161a55ef4
Signed-off-by: Tibor Frank <tifrank@cisco.com>

f6e52303 29-Apr-2020 Peter Mikus <pmikus@cisco.com>

FIX: dot1qip4vxlan-l2bd

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Ia4415090263357d16cfd5f5bc93931ded5688557

cc49d8fc 29-Apr-2020 Jan Gelety <jgelety@cisco.com>

API: Add collection for 26276/7

Change-Id: Ib65e3268e04fd4a7908e3e7c3c4217807f47a38b
Signed-off-by: Jan Gelety <jgelety@cisco.com>

31eec6c8 29-Apr-2020 Tibor Frank <tifrank@cisco.com>

Report: Add data

Signed-off-by: Tibor Frank <tifrank@cisco.com>
Change-Id: I05ca2f6d33049809dd7b71a35923328e7b30a462

99b2e6a8 31-Mar-2020 Jan Gelety <jgelety@cisco.com>

CSIT-1597 API cleanup: lisp

- cover API changes in VPP: https://gerrit.fd.io/r/c/vpp/+/24663
- update vpp stable to version 20.05-rc0~637
- remove unused L1 and L2 lisp KWs

Change-Id: I2672b6a375ad70c82f331dcc991c145e868108b9
Signed-off-by: Jan Gelety <jgelety@cisco.com>

de3a8318 28-Apr-2020 Jan Gelety <jgelety@cisco.com>

FIX: crc for create_vhost_user_if

Change-Id: Ia43679c440da62ba44ad74d4c1eb9003b4ba0a63
Signed-off-by: Jan Gelety <jgelety@cisco.com>

51b4c826 24-Apr-2020 Tibor Frank <tifrank@cisco.com>

Trending: NDRPDR weekly comparison

Change-Id: I6c5166e1fabfe7471af92a1423c0c89ca6b040a4
Signed-off-by: Tibor Frank <tifrank@cisco.com>

2544d457 30-Mar-2020 Jan Gelety <jgelety@cisco.com>

API: Add collection for 24663/6

Change-Id: I009df88e0a315603b5f9d72eb1d1a729d1a8a4cd
Signed-off-by: Jan Gelety <jgelety@cisco.com>

6dc9d3d9 27-Apr-2020 Tibor Frank <tifrank@cisco.com>

Report: Add 1908.2 data

Change-Id: Ieb07e263c3b725dc187b797c86f2040bd09efe3e
Signed-off-by: Tibor Frank <tifrank@cisco.com>

ce25cf6b 31-Mar-2020 Jan Gelety <jgelety@cisco.com>

CSIT-1597 API cleanup: virtio

- cover API changes in VPP: https://gerrit.fd.io/r/c/vpp/+/26086
- update vpp stable to version 20.05-rc0~630

Change-Id: I3e3f00ba81e62f07c5d287300dfaff6cee18a1b4
Signed-off-by: Jan Gelety <jgelety@cisco.com>

1c1d5cbe 23-Apr-2020 Peter Mikus <pmikus@cisco.com>

Performance: MLX best practice

- Part II

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I869a3d7e051dcbae3a230d4646219e70e5de2e87

fcce2ca1 10-Jan-2020 Peter Mikus <pmikus@cisco.com>

Performance: TRex approximatedDuration and approximateRate

- API to provide duration for send and receive traffic

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Id186a200be66b7703348e6fd3099ffd405e915ae

fd70b678 27-Apr-2020 Peter Mikus <pmikus@cisco.com>

FIX: NF_density IPv4 profile

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I471c0cb98c24416d893248b55b376b03a4b8830a

a50057d4 27-Apr-2020 Peter Mikus <pmikus@cisco.com>

FIX: NAT44 3-node tests

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I3d9074175e1aaf5afba4e351790644df4ad33914

dfd4a27d 27-Apr-2020 Tibor Frank <tifrank@cisco.com>

Report: Configure Report 2001.18

Change-Id: I7e3ed2a7ad75617be1ef5a80e345e7e62a6da3df
Signed-off-by: Tibor Frank <tifrank@cisco.com>

32b165c6 24-Apr-2020 Tibor Frank <tifrank@cisco.com>

Report: Add data

Change-Id: Ib451636d46517cd85839d3e3b9aca9b6958b322e
Signed-off-by: Tibor Frank <tifrank@cisco.com>

1945ebc5 23-Apr-2020 Tibor Frank <tifrank@cisco.com>

PAL: Reverse download order for trending

Change-Id: Idd6bf8b89ce0fb5ebf9734b39a8f6058861b8ec5
Signed-off-by: Tibor Frank <tifrank@cisco.com>

0e8a09b2 23-Apr-2020 Vratko Polak <vrpolak@cisco.com>

Fix 3n ip4 scale init

Last argument to Vpp Add Ip Neighbor should be a MAC address.

Change-Id: Ia93ddf68aa2b8647c66b6a72210db3a8a01b81fb
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

01015c90 22-Apr-2020 Peter Mikus <pmikus@cisco.com>

FIX: Mellanox jumbo frames

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I84b3c07e22a313e96ac59fc7818960c502507651

54beb458 17-Apr-2020 Peter Mikus <pmikus@cisco.com>

Performance: DPDK refactor

+ Rework BASH scripts (more code to python).
+ Move BASH into libraries.
+ Allows RDMA usage.
+ Fix 9000B tests.
+ Rename confusing l2fwd -> testpmd.
+ Fix suite setup.
+ Fix PCI whitelist to not accidentally pickup wrong interface.
+ Fix deprecated DPDK cli arguments.

- MLX5 jumbo are disabled on NIC (i will increase separately).
https://jenkins.fd.io/job/csit-dpdk-perf-verify-master-2n-clx/6/console (l3fwd still broken)
- MLX5 IMIX seems to be some TRex issue with IMIX for mlx5 (i will handle separately)

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I31d1b67305fa247cb5e1f57e739d3ef30dc1a04b

5dc176ab 21-Apr-2020 Peter Mikus <pmikus@cisco.com>

FIX: NF_density MAC addresses

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I0e773060c344fda7b06937a81a53863a96a4373a

12d5c9af 22-Apr-2020 Tibor Frank <tifrank@cisco.com>

Trending: Fixes in plots, data

Change-Id: I91677a0f6e1c62633977c80fc8dec8019e580d0c
Signed-off-by: Tibor Frank <tifrank@cisco.com>

51210b3d 20-Apr-2020 Tibor Frank <tifrank@cisco.com>

Trending: Update graphs - dnv

Change-Id: Ib965b768f725a4d4bc09cb1f995a452ed6e64653
Signed-off-by: Tibor Frank <tifrank@cisco.com>

a00151f4 20-Apr-2020 Peter Mikus <pmikus@cisco.com>

FIX: NF_density tests

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Ic305d135b14697332436d6afd76173eff0c3874b

b1af33fb 19-Apr-2020 Tibor Frank <tifrank@cisco.com>

Report: Add 2n-skx Soak and Reconf tests

Change-Id: Ia1e658347051ea0476cbea76361783ab7f6d6d1d
Signed-off-by: Tibor Frank <tifrank@cisco.com>

03e25808 16-Apr-2020 Vratko Polak <vrpolak@cisco.com>

Flag day: requirements for candidates

Change-Id: I0446263333812a57a8d0f7f288044482bee04a14
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

7a9dfe35 31-Mar-2020 Jan Gelety <jgelety@cisco.com>

FIX: ip4

Change-Id: I57fcb06c72caf517231f09478d9d6089d2f46af4
Signed-off-by: Jan Gelety <jgelety@cisco.com>

96732c9c 20-Apr-2020 Tibor Frank <tifrank@cisco.com>

Report: Configure report 2001.17

Change-Id: I809ee89a5798c36d883fd49de75b6f67f1d336f8
Signed-off-by: Tibor Frank <tifrank@cisco.com>

2d1f2d66 20-Apr-2020 Tibor Frank <tifrank@cisco.com>

Report: Comparison tables

Change-Id: I18df883d66932fdafba83fd1b831736c4cb9ffa9
Signed-off-by: Tibor Frank <tifrank@cisco.com>

b778a148 17-Apr-2020 Peter Mikus <pmikus@cisco.com>

FIX: Proper NUMA compute

+ FIX for Vratko's FIX

Change-Id: Ia6ff137120d84bdd2b9e02e3e935c62d1c732b7b
Signed-off-by: Peter Mikus <pmikus@cisco.com>

ffa19fdd 17-Apr-2020 Vratko Polak <vrpolak@cisco.com>

Fix numa detection

On 3n-hsw, xl-710 is numa 1.
The old code returned 0, causing performance regression.

Fixes: 14a71b74b414df7616ccb5ada3d50ecb90d96bae

Change-Id: I81d3f711b6a37438f6411e29baafae9dec1c00a4
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

1834f333 30-Mar-2020 Jan Gelety <jgelety@cisco.com>

API: Add collection for 26086/8

Change-Id: I41867bdb395a72733c1f616b981e952087b017ef
Signed-off-by: Jan Gelety <jgelety@cisco.com>

aada4992 28-Mar-2020 Jan Gelety <jgelety@cisco.com>

VPP-DEV API Coverages: IPSEC interface

+ some pylint fixies

Change-Id: I650ce16282ae953a1a5ee96e810702c01f71efd6
Signed-off-by: Jan Gelety <jgelety@cisco.com>

daa48bd8 09-Apr-2020 Vratko Polak <vrpolak@cisco.com>

Do not set seeds in -rnd profiles

From trending it seems like TRex threads use thread-local PRNGs,
resulting in multiple packets (one from each thread) for the same flow.
Hopefully, without a seed set, each thread will pick a different seed.

We are risking some threads will still pick the same seed occasionally,
but I doubt TRex API has a better way to prevent this issue.

Change-Id: Ie6ed42669d6e2463627760f89d2426d4e6bf0155
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

68ad5eab 15-Apr-2020 Tibor Frank <tifrank@cisco.com>

Report: Current vs. Previous

Change-Id: Ic6cdabf65846a0d7d1e38025a1a7459947aed385
Signed-off-by: Tibor Frank <tifrank@cisco.com>

3f2ecafb 14-Apr-2020 Tibor Frank <tifrank@cisco.com>

PAL: Integrate new comp tables 2

Change-Id: Id7267f5ab13a362894c5fe5a2ae40d51d4b5a36d
Signed-off-by: Tibor Frank <tifrank@cisco.com>

4f4441a7 11-Mar-2020 Dave Wallace <dwallacelf@gmail.com>

rls2001 report: fix hoststack test packet sizes

Signed-off-by: Dave Wallace <dwallacelf@gmail.com>
Change-Id: I4bd56d17b8f28ca40424067068384bae0447db4b

20ff425a 29-Mar-2020 Jan Gelety <jgelety@cisco.com>

Update of VPP_STABLE_VER files

- use new vpp ref build - ubuntu 18.04:
20.05-rc0~532-g4fde4ae03

- use new vpp ref build - centos7:
20.05-rc0~532_g4fde4ae~b9253

Change-Id: If6a5478ca9b89050beae8f2dc4ce4e91b328aa21
Signed-off-by: Jan Gelety <jgelety@cisco.com>

316988e4 14-Apr-2020 Peter Mikus <pmikus@cisco.com>

FIX: RDMA typo

Change-Id: Ie2f11cd5144daf249200fe07430b0809185bccce
Signed-off-by: Peter Mikus <pmikus@cisco.com>

42a491e8 14-Apr-2020 Tibor Frank <tifrank@cisco.com>

Report: Configure report 2001.16

Change-Id: I909845026c0495db74e0ef82f17d7d14db2ac9d5
Signed-off-by: Tibor Frank <tifrank@cisco.com>

eb4ced47 14-Apr-2020 Tibor Frank <tifrank@cisco.com>

PAL: Fix table data model

Change-Id: I276f9bb6aaf03c897ef255d124a3204dee45abf6
Signed-off-by: Tibor Frank <tifrank@cisco.com>

bf31370e 09-Apr-2020 Tibor Frank <tifrank@cisco.com>

PAL: Integrate new comp tables

Change-Id: Ibadf4fabb69bdd9d2412ed8f33c97ab12303800f
Signed-off-by: Tibor Frank <tifrank@cisco.com>

8fcb84c0 03-Apr-2020 Peter Mikus <pmikus@cisco.com>

Ansible: Kernel installation

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Iee65272169339ed0e5561cf3dee11567335b12be

8e3a326c 09-Apr-2020 Peter Mikus <pmikus@cisco.com>

Performance: FIX T-Rex config

- MLX, ENA
- Part I

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I9f4b407770515fe6009ef5dfdba2b27fa2ff654f

0ccec314 09-Apr-2020 Tibor Frank <tifrank@cisco.com>

Report: Add data

- hoststack
- replace old 20001 with new 2001

Change-Id: Id1913527a0878b56fbb3c1372da6251cebd5e30b
Signed-off-by: Tibor Frank <tifrank@cisco.com>

56440df4 06-Apr-2020 Peter Mikus <pmikus@cisco.com>

FIX: Add show log output when test failed.

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I6bdce8156ba214be210c195a9f3effd718301a86

40ba928d 29-Mar-2020 Jan Gelety <jgelety@cisco.com>

API: Add collection for 26256/7

Change-Id: Ib5d8f9f0c8e8920a2d19e89d4d5518f4882ff32d
Signed-off-by: Jan Gelety <jgelety@cisco.com>

dbffa6cf 06-Apr-2020 Peter Mikus <pmikus@cisco.com>

Ansible: Speed up by pipelining

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I3ad5675cda017b3dcf8cba88d56d5d6c11184e20

42fa1f7c 06-Apr-2020 Peter Mikus <pmikus@cisco.com>

FIX: Ansible LTS missing package

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I87020a6a26f54f9a1591a540f77f6469d75df007

14a71b74 21-Feb-2020 Peter Mikus <pmikus@cisco.com>

Improve pf layer

+ Merge single/double link
+ Introduce _pf{n}[0] variables so we can access physical function
same way as virtual function
+ Cleanup code by moving complex logic to python
+ Prepare code for multiple vf functions

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Ic2e74a38bfa146441357de8f0916aeb638941c49

8e601d0f 06-Apr-2020 Tibor Frank <tifrank@cisco.com>

Report: Configure report 2001.15

Change-Id: I4926a15e0b89507aad89845e12385ba34adfd68d
Signed-off-by: Tibor Frank <tifrank@cisco.com>

214f4333 16-Mar-2020 Tibor Frank <tifrank@cisco.com>

Report: Add pdf version

Change-Id: I3aba33e90fd99fd2277358f184a34d071ed4e805
Signed-off-by: Tibor Frank <tifrank@cisco.com>

32b67069 02-Apr-2020 Tibor Frank <tifrank@cisco.com>

Trending: Update graphs - 3n-tsh

Change-Id: I9b8377e336651f850d50d050471ebefd5647993d
Signed-off-by: Tibor Frank <tifrank@cisco.com>

4bfe1bf6 03-Apr-2020 Tibor Frank <tifrank@cisco.com>

Trending: Update graphs - 3n-hsw

Change-Id: Iff28b68e4fb33b304433ada64ea6ef2d751e4c3f
Signed-off-by: Tibor Frank <tifrank@cisco.com>

5bff1207 27-Mar-2020 Jan Gelety <jgelety@cisco.com>

Fix: select correct oper branch checkout_csit_for_vpp

Signed-off-by: Jan Gelety <jgelety@cisco.com>
Change-Id: I2e72b7e136d3907a038cb7729c11d155a12c486f
(cherry picked from commit 9e2e4eaa2c6854eee47f7057d16b75339f453f89)

f3c2a4d8 02-Apr-2020 Tibor Frank <tifrank@cisco.com>

Trending: Update graphs - 2n-clx

Change-Id: I05a61b075c467681f2e05b17f0245a5e77a911b5
Signed-off-by: Tibor Frank <tifrank@cisco.com>

2be78e25 02-Apr-2020 Tibor Frank <tifrank@cisco.com>

Report: HTML comparison tables.

Change-Id: I144d1ee15505a9d08acdacb50f53df02420d60a8
Signed-off-by: Tibor Frank <tifrank@cisco.com>

fafa2a32 02-Apr-2020 Tibor Frank <tifrank@cisco.com>

Report: Comparison tables

Change-Id: Iafff8f88e1d54ede712d8fc3b4afa88172f599ab
Signed-off-by: Tibor Frank <tifrank@cisco.com>

925c5bfc 31-Mar-2020 Vratko Polak <vrpolak@cisco.com>

Tweak TRex cores and RDMA pps limit

The previous values lead to duration stretching,
which affects MRR results (making receive rate bigger than it really is).

+ Move timestamp for starting of traffic,
the previous position was too conservative.

Change-Id: Ie983f0d3eacf56d57caa551d1b7fbb87ece6c158
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

919d9eba 01-Apr-2020 Tibor Frank <tifrank@cisco.com>

Report: Comparison html tables

Change-Id: I901e20ec6bc7214bf3376a57aee3eba4149ec8a1
Signed-off-by: Tibor Frank <tifrank@cisco.com>

1bcf59c1 30-Mar-2020 Tibor Frank <tifrank@cisco.com>

Report: Comparisom tables - Legend

Change-Id: I9bea40d22f9a4aa4f5161f203ba5cc04685a8b19
Signed-off-by: Tibor Frank <tifrank@cisco.com>

10d2a085 27-Mar-2020 Peter Mikus <pmikus@cisco.com>

FIX: irqbalance settings

By default irqbalance should be honoring isolcpu settings but as of
latest finding IRQs are distributed ad-hoc even if irqbalance is:
- enabled: with default settings
- disabled: by configuration
- disabled: as a service
- enabled: with incorrect mask

This patch brings explicit configuration of IRQBALANCE_BANNED_CPUS with
mask large enough to cover all cores and keeps IRQ to be processed by
core 0.

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I0eb36d780feb284a5493e123acbf993a362ea9ec

51b70fc4 31-Mar-2020 juraj.linkes <juraj.linkes@pantheon.tech>

Add disable_ra config to VPP device ansible

Router advertisement from linux interfaces in VPP Device TGs could
result in unsolicited packets arriving in DUT which would produce false
negatives.

Change-Id: I121a92310a8fe47f36e253656e126123704efc0a
Signed-off-by: juraj.linkes <juraj.linkes@pantheon.tech>

423995e9 27-Mar-2020 Vratko Polak <vrpolak@cisco.com>

SRv6: Make show command output visible

Change-Id: Ie8764f1746fa51d8b6e8621db68ffd2966168a07
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

fc97058d 26-Mar-2020 Jan Gelety <jgelety@cisco.com>

API: Add collection for 25923/9

Change-Id: I48da04747ffcbdb0b4452d11ee52204e966eb78b
Signed-off-by: Jan Gelety <jgelety@cisco.com>

e1f4e9e5 30-Mar-2020 Tibor Frank <tifrank@cisco.com>

Trending: Update graphs - 3n-skx

Change-Id: I0698e7fa48b7fa199b886407c2e9c1bc5094e746
Signed-off-by: Tibor Frank <tifrank@cisco.com>

0ed80e39 30-Mar-2020 Tibor Frank <tifrank@cisco.com>

Report: COnfigure reoirt 2001.14

Change-Id: Ic899dbe5875238c36e83778c413c7943169ef8df
Signed-off-by: Tibor Frank <tifrank@cisco.com>

bb7d2f05 21-Mar-2020 Jan Gelety <jgelety@cisco.com>

CSIT-1597 API cleanup: acl

- cover API changes in VPP: https://gerrit.fd.io/r/c/vpp/+/26184
- update vpp stable to version 20.05-rc0~424

Change-Id: Ie621a29db25755151bfee76a045a423fd1267ada
Signed-off-by: Jan Gelety <jgelety@cisco.com>

3d06f64a 27-Mar-2020 Tibor Frank <tifrank@cisco.com>

Report: Add data

Change-Id: I0e11a0ff48b34d9f716da72b9249e0c78c9b04ff
Signed-off-by: Tibor Frank <tifrank@cisco.com>

e891f75d 27-Mar-2020 Tibor Frank <tifrank@cisco.com>

Report: Add data

Change-Id: Ie2a5d09095528526785325ee883c0458435d1f8b
Signed-off-by: Tibor Frank <tifrank@cisco.com>

f6a656f3 26-Mar-2020 Jan Gelety <jgelety@cisco.com>

FIX: use python3 for csit-docs-merge jobs

Change-Id: Ib29201f63fb8bfcc04f879b13407a85bda55827f
Signed-off-by: Jan Gelety <jgelety@cisco.com>

30b3fba0 27-Mar-2020 Tibor Frank <tifrank@cisco.com>

Report: Fix: Header of comparison tables

Change-Id: Ic20ee4ceb79f9c10bcfe95bc20fa044c8e65202d
Signed-off-by: Tibor Frank <tifrank@cisco.com>

c1801539 27-Mar-2020 Tibor Frank <tifrank@cisco.com>

Report: Header of comparison tables

Change-Id: Icbfd4f306cbec2840292cb6a350a8e5b09047fa4
Signed-off-by: Tibor Frank <tifrank@cisco.com>

01597c5d 26-Mar-2020 Tibor Frank <tifrank@cisco.com>

Trending: Update graphs

- 2n-skx

Change-Id: I0b357d8ac4a20acdea14814bbb421b1007f851d3
Signed-off-by: Tibor Frank <tifrank@cisco.com>

3ce6a973 21-Mar-2020 Jan Gelety <jgelety@cisco.com>

API: Add collection for 25787/15

Change-Id: Id33dbc63832848f951fc6478472e9d6dd614bff9
Signed-off-by: Jan Gelety <jgelety@cisco.com>

4504d3ce 26-Mar-2020 Tibor Frank <tifrank@cisco.com>

PAL: Local mode uses xml file name as a build number

Change-Id: Id4a26ac588883d917595ea45fcaabd16d89ded1f
Signed-off-by: Tibor Frank <tifrank@cisco.com>

45f5b2da 25-Mar-2020 Jan Gelety <jgelety@cisco.com>

FIX: vxlan_add_del_tunnel in TestConfig.py

Change-Id: I1e4ab1b40fd4a2f48df1dc33b7b17266382df20b
Signed-off-by: Jan Gelety <jgelety@cisco.com>

8a050f36 25-Mar-2020 Tibor Frank <tifrank@cisco.com>

Report: Add data and RCA

Change-Id: I6fcbf9ea150fd17ef3ae9b879f22442f17246713
Signed-off-by: Tibor Frank <tifrank@cisco.com>

b95d8570 24-Mar-2020 Tibor Frank <tifrank@cisco.com>

Report: Add mrr stdev to comp tables

Change-Id: I94336a7e624b82a5794ff09085c46028f4416a49
Signed-off-by: Tibor Frank <tifrank@cisco.com>

6b353c8a 23-Mar-2020 Tibor Frank <tifrank@cisco.com>

Report: Add RCA to comp tables

For now, only these comaprison tables:
- table_perf_comparison_nic
- table_perf_comparison

Change-Id: I52c5a960eafbe2bbf11f6c371d4a72419373dc76
Signed-off-by: Tibor Frank <tifrank@cisco.com>

baaf9477 24-Mar-2020 Tibor Frank <tifrank@cisco.com>

Report: Add data

Change-Id: I5625ecf351e99c02c7e699d54ae3154a51efbb95
Signed-off-by: Tibor Frank <tifrank@cisco.com>

a0d87052 12-Mar-2020 Jan Gelety <jgelety@cisco.com>

CSIT-1597 API cleanup: srv6

- cover API changes in VPP: https://gerrit.fd.io/r/c/vpp/+/25647
- update vpp stable to version 20.05-rc0~398

Change-Id: I5ebc84a702264b0b37e3886b48ec0713d174f880
Signed-off-by: Jan Gelety <jgelety@cisco.com>

306b1116 24-Mar-2020 Tibor Frank <tifrank@cisco.com>

Report: Add data

Change-Id: I2896b4c5555b2654af5f005fb75b0be7cc3ec2c8
Signed-off-by: Tibor Frank <tifrank@cisco.com>

9253bba4 12-Mar-2020 Jan Gelety <jgelety@cisco.com>

API: Add collection for 25647/3

Change-Id: I01398df1d8d0274ff7aafc4cef0f431f19bef099
Signed-off-by: Jan Gelety <jgelety@cisco.com>

d3467a74 23-Mar-2020 Tibor Frank <tifrank@cisco.com>

Report: Add data

Change-Id: I72cf83bfae9f07691157d2baee436e4021cd87dc
Signed-off-by: Tibor Frank <tifrank@cisco.com>

967cdb11 23-Mar-2020 Tibor Frank <tifrank@cisco.com>

Report: Remove decimals from delta and stdev in tables

Change-Id: Ib8aa70b4bd2519f077bbb76da1f41a74215a9f2e
Signed-off-by: Tibor Frank <tifrank@cisco.com>

2e6f203c 23-Mar-2020 Tibor Frank <tifrank@cisco.com>

Report: Add 3n-skx additions

Change-Id: I059c92235ac46a470044c5b4614a1c3025e76e81
Signed-off-by: Tibor Frank <tifrank@cisco.com>

1a43f1ef 23-Mar-2020 Tibor Frank <tifrank@cisco.com>

Report: Configure Report 2001.13

Change-Id: Id968c7351f995dde31c3832339496495999b5bce
Signed-off-by: Tibor Frank <tifrank@cisco.com>

4903cc72 20-Mar-2020 Tibor Frank <tifrank@cisco.com>

Report: Add data

Change-Id: Ibd37be8155af57e13991b23d417307caa4b2717b
Signed-off-by: Tibor Frank <tifrank@cisco.com>

94fce874 20-Mar-2020 Tibor Frank <tifrank@cisco.com>

Report: Add data

Change-Id: I54fc75cc46f95116a0631fdb67f631f61419e473
Signed-off-by: Tibor Frank <tifrank@cisco.com>

b63b3646 20-Mar-2020 Tibor Frank <tifrank@cisco.com>

PAL: Add stdev of delta to tables

Change-Id: I00fc401d25d78d14a7bb1de4f7445029436c2426
Signed-off-by: Tibor Frank <tifrank@cisco.com>

2a35fc8c 13-Mar-2020 Dave Wallace <dwallacelf@gmail.com>

perf: Fix broken hoststack tests

- Rename NSIM attribute names as changed in b9f4ba11

Change-Id: I6bc232c9954cfd9004d1d0cf22446957e78a641a
Signed-off-by: Dave Wallace <dwallacelf@gmail.com>

012d8ed8 19-Mar-2020 Tibor Frank <tifrank@cisco.com>

Report: Add data

Change-Id: I0ef25059f362c7d7b5c5190164cfdc8bff4ae3f1
Signed-off-by: Tibor Frank <tifrank@cisco.com>

26192706 19-Mar-2020 Tibor Frank <tifrank@cisco.com>

Report: Add data

Change-Id: I6aadb33318ae5df01d502e517b116567633e14ed
Signed-off-by: Tibor Frank <tifrank@cisco.com>

96e0ac2c 17-Mar-2020 Tibor Frank <tifrank@cisco.com>

Report: Clean 3n-hsw, 3n-tsh, 3n-dnv, 2n-dnv graphs

Change-Id: If97186d6b077b13310548839eabe8b3ede1ad528
Signed-off-by: Tibor Frank <tifrank@cisco.com>

7f983d31 18-Mar-2020 Tibor Frank <tifrank@cisco.com>

Report: 2n-clx graphs

Change-Id: Iedd59e41bc946f054987650fb5dcf299289450be
Signed-off-by: Tibor Frank <tifrank@cisco.com>

291eafd5 17-Mar-2020 Maros Mullner <maros.mullner@pantheon.tech>

Fix dpdk-20.02 build to include igb_uio.

Signed-off-by: Maros Mullner <maros.mullner@pantheon.tech>
Change-Id: Ifd0f4d09b7c518feab534186220d618a560f223c

37da7642 18-Mar-2020 Peter Mikus <pmikus@cisco.com>

FIX: qsz typo

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I56e87868de0bb45e863f1d806e2efc3f5ec5df96

b65cedf4 18-Mar-2020 Tibor Frank <tifrank@cisco.com>

Report: Add DPDK 3n-skx

Change-Id: Iee346020a6c8e747fc305117e0492f3fec509359
Signed-off-by: Tibor Frank <tifrank@cisco.com>

61dd2400 17-Mar-2020 Tibor Frank <tifrank@cisco.com>

Report: Add DPDK 2n-skx

Change-Id: I17364f05126d970fdfc0d5079a780e37c4e9f89e
Signed-off-by: Tibor Frank <tifrank@cisco.com>

11e9514a 10-Mar-2020 Vratko Polak <vrpolak@cisco.com>

NodePath: Make path computation deterministic

In Python3, set operations seem to result in indeterministic order.

+ Remove verbose logging from topology.py

Change-Id: I47cc90637a0b2969e1686b4216b7d8fe4fe2aaab
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

54ff8d82 11-Mar-2020 Jan Gelety <jgelety@cisco.com>

CSIT-1597 API cleanup: vpe

- cover API changes in VPP: https://gerrit.fd.io/r/c/vpp/+/25567
- update vpp stable to version 20.05-rc0~352

Change-Id: I205d7d3de48d480e070d3e2d3e3ab83480b69c77
Signed-off-by: Jan Gelety <jgelety@cisco.com>

ec2963ab 17-Mar-2020 Tibor Frank <tifrank@cisco.com>

Report: Add 2n-skx avf and MRR tests

Change-Id: I09542db32bc7cf998b0aac00b109b767d083a34e
Signed-off-by: Tibor Frank <tifrank@cisco.com>

2896038b 12-Mar-2020 Peter Mikus <pmikus@cisco.com>

FIX: VHOST vpp

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Id0d41a2e62ee6cce212fb2c09a0357d794426a00

c5cca312 17-Mar-2020 Tibor Frank <tifrank@cisco.com>

Report: Add 3n-skx MRR

Change-Id: I33503f649773c0cc841e698f1053116d20c47ae9
Signed-off-by: Tibor Frank <tifrank@cisco.com>

10f3d8ae 17-Mar-2020 Tibor Frank <tifrank@cisco.com>

Report: Add 3n-skx avf tests

Change-Id: I74c207d4feb924d7dff22c5bfa5a66b9f7b7c188
Signed-off-by: Tibor Frank <tifrank@cisco.com>

54601fe5 16-Mar-2020 Tibor Frank <tifrank@cisco.com>

Report: Add data

Change-Id: I6a6e3d854699a96eb946d47017e9ad6da3023c0e
Signed-off-by: Tibor Frank <tifrank@cisco.com>

26e60563 11-Mar-2020 Jan Gelety <jgelety@cisco.com>

API: Add collection for 25567/1

Change-Id: I16ca645cf55771a986696e94a9543d4e8aa1c7be
Signed-off-by: Jan Gelety <jgelety@cisco.com>

ac683d23 11-Mar-2020 Jan Gelety <jgelety@cisco.com>

CSIT-1597 API cleanup: vxlan

- cover API changes in VPP: https://gerrit.fd.io/r/c/vpp/+/25569
- update vpp stable to version 20.05-rc0~345

- some pylint fixies in Policer.py

Change-Id: Iba2c877d0e74526c69826c5ec4afd64ed2055d31
Signed-off-by: Jan Gelety <jgelety@cisco.com>

cecee58d 16-Mar-2020 Tibor Frank <tifrank@cisco.com>

Report: Add new tests to graphs and remove old ones

Change-Id: Ia5f174ce859bbec59105decb36e704ae67f78e23
Signed-off-by: Tibor Frank <tifrank@cisco.com>

6cb1e728 16-Mar-2020 Tibor Frank <tifrank@cisco.com>

Report: Fix Xn-skx avf-ethip4 graphs

Change-Id: I11ce9a937e3423d1a547199f10a170980c162399
Signed-off-by: Tibor Frank <tifrank@cisco.com>

6a57407d 10-Mar-2020 Jan Gelety <jgelety@cisco.com>

API: Add collection for 25569/4

Change-Id: If5edd443d281616c1c7a7225b2a606f3a3255bd0
Signed-off-by: Jan Gelety <jgelety@cisco.com>

2766a2f6 16-Mar-2020 Tibor Frank <tifrank@cisco.com>

Report: Add 2n-skx ip4 rnd pdr tests

Change-Id: Ia2f269416bf497b635c6454891f514394a7ae169
Signed-off-by: Tibor Frank <tifrank@cisco.com>

53bf1253 16-Mar-2020 Tibor Frank <tifrank@cisco.com>

Report: Add 2n-skx NFV PDR

Change-Id: Ib95b3acf9b147a8e3641cf9bb377efd0b1f42c68
Signed-off-by: Tibor Frank <tifrank@cisco.com>

cd64c25a 13-Mar-2020 Maros Mullner <maros.mullner@pantheon.tech>

Ansible fixes for AZURE.

Signed-off-by: Maros Mullner <maros.mullner@pantheon.tech>
Change-Id: I071c5184dcbc25a8bc6b53d65d9a3478194c72fc

41b29c01 10-Mar-2020 Maros Mullner <maros.mullner@pantheon.tech>

Final changes for AWS.

Modified cpuutils numa to work with aws 18xlarge instances.
Added dmidecode package to calibration role as is not installed by default.
Added required constants

Signed-off-by: Maros Mullner <maros.mullner@pantheon.tech>
Change-Id: I99608d9df3cff0b085ad26c30e339216b17581eb

acd320f6 15-Mar-2020 Tibor Frank <tifrank@cisco.com>

PAL: Download .gz first

Change-Id: Ic83a63e5043ea1342b40e5b0aab189cfe24ba95c
Signed-off-by: Tibor Frank <tifrank@cisco.com>

e623a04c 15-Mar-2020 Tibor Frank <tifrank@cisco.com>

Report: Add 3n-skx NDR

Change-Id: Ia5eba3f4a5d0c52bce87590881a02276e55c5341
Signed-off-by: Tibor Frank <tifrank@cisco.com>

0c3e94ed 24-Feb-2020 Tibor Frank <tifrank@cisco.com>

PAL: Process local xml file

Change-Id: I2d60b2c6616de6d6b2e1d742407ac392471883aa
Signed-off-by: Tibor Frank <tifrank@cisco.com>

3409f0d8 13-Mar-2020 Tibor Frank <tifrank@cisco.com>

Report: Add latency for 2n-skx

Change-Id: I1d664531c94168f4eb135fc56e497c7c77291605
Signed-off-by: Tibor Frank <tifrank@cisco.com>

d74845df 13-Mar-2020 Tibor Frank <tifrank@cisco.com>

Report: hide 2n-skx NDR data

Change-Id: Iee860b33338cfe60ba04081b9bd6cb6b685adb9b
Signed-off-by: Tibor Frank <tifrank@cisco.com>

ee33baa6 11-Mar-2020 Jan Gelety <jgelety@cisco.com>

Use separate module for ip address object

Reason: with upcomming vpp api changes the ip object will be used
in more csit python libraries, e.g. InterfaceUtil.py, so we need
to avoid circular import issue
(e.g. InterfaceUtil.pyu <-> IPUtil.py)

Change-Id: Ia658b187d4e326f58e33019dd54f8ac7b9137d78
Signed-off-by: Jan Gelety <jgelety@cisco.com>

1c0e2d22 13-Mar-2020 Tibor Frank <tifrank@cisco.com>

Report: Add 2n-skx

- perf sel

Change-Id: I7809f2ba96a3bd1f985300482e87627dd4865c35
Signed-off-by: Tibor Frank <tifrank@cisco.com>

bc288611 11-Mar-2020 Tibor Frank <tifrank@cisco.com>

Report: Remove skx NDR from detailed test results

Change-Id: I47cd491c44bd259c69c758aac600bfe94d59538f
Signed-off-by: Tibor Frank <tifrank@cisco.com>

a765b82b 06-Mar-2020 Dave Wallace <dwallacelf@gmail.com>

rls2001 perf: fix hoststack test packet sizes

- TCP packet size is 1460B not 9000B
- QUIC packet size is 1280B not 9000B

Change-Id: I6604a74fa533db4ac782782c85ea54038688627a
Signed-off-by: Dave Wallace <dwallacelf@gmail.com>

9902cc2a 09-Mar-2020 Jan Gelety <jgelety@cisco.com>

CSIT-1597 API cleanup: policer

- cover API changes in VPP: https://gerrit.fd.io/r/c/vpp/+/25566
- update vpp stable to version 20.05-rc0~327

Change-Id: I6af2e4e21c9190e87a63c5a9c8529bbc7f8adf1a
Signed-off-by: Jan Gelety <jgelety@cisco.com>

442c942d 10-Mar-2020 Jan Gelety <jgelety@cisco.com>

API: Add collection for 25566/5

Change-Id: Id5bbd395304c391493dc46a6c82fe395f14340ae
Signed-off-by: Jan Gelety <jgelety@cisco.com>

7c0f9df9 11-Mar-2020 Tibor Frank <tifrank@cisco.com>

Report: Add 2n-clx IPv4 RND

Change-Id: Ibe7b8ee88de2366beeadb217d6111a25483c23bf
Signed-off-by: Tibor Frank <tifrank@cisco.com>

b06f59a3 10-Mar-2020 Jan Gelety <jgelety@cisco.com>

FIX: typo in VppCounters.py

Change-Id: I4b5955af9732dd3ef185a618ffcf939d0a05ac17
Signed-off-by: Jan Gelety <jgelety@cisco.com>

46ff7172 11-Mar-2020 Tibor Frank <tifrank@cisco.com>

Report: Configure Report 2001.12

Change-Id: I3d19380a12016ee65711d4e92c3cfbc109a2e18f
Signed-off-by: Tibor Frank <tifrank@cisco.com>

8d954d6b 11-Mar-2020 Peter Mikus <pmikus@cisco.com>

FIX: Counters

Change-Id: Ib7eeea5338491b4bd9ecd96b30da95f5dc116937
Signed-off-by: Peter Mikus <pmikus@cisco.com>

7e483fe9 10-Mar-2020 Tibor Frank <tifrank@cisco.com>

Report: Enable pdf version

Change-Id: Icbad3b13088db197fd852b05f90b58fe7f2d8f0a
Signed-off-by: Tibor Frank <tifrank@cisco.com>

dcbf9830 12-Dec-2019 Jan Gelety <jgelety@cisco.com>

CSIT-1597 API cleanup: ipsec

- cover API changes in VPP: https://gerrit.fd.io/r/c/vpp/+/25529
- update vpp stable to version 20.05-rc0~312-g287d5e109

Change-Id: I6c7b3520f4bb306c3b0b59247b4ba2d5f170686c
Signed-off-by: Jan Gelety <jgelety@cisco.com>

70382073 05-Mar-2020 Tibor Frank <tifrank@cisco.com>

Regenerator: Fix pylint errors

Change-Id: I91458b897003f5d8f7f7ac9214aa824c113cecea
Signed-off-by: Tibor Frank <tifrank@cisco.com>

6db8aec1 28-Feb-2020 Peter Mikus <pmikus@cisco.com>

Ansible: LTS support

- There is currently no other way to support multiple version of
playbooks.

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I2ade4a57d726b793e422996e83bf767ac4315488

6daa2d79 28-Feb-2020 Peter Mikus <pmikus@cisco.com>

Make RXQs/TXQs configurable

Change-Id: Ib30bc4697fcba93a6723ee492a59a0523425f623
Signed-off-by: Peter Mikus <pmikus@cisco.com>

dddfcfb9 12-Dec-2019 Jan Gelety <jgelety@cisco.com>

API: Add collection for 25529/2

Change-Id: Iac159cb60d4afbc23fc7edffefd82fc3e2a64940
Signed-off-by: Jan Gelety <jgelety@cisco.com>

b9f4ba11 09-Mar-2020 Dave Wallace <dwallacelf@gmail.com>

Clean up long lines in nsim.robot

Change-Id: Ic9def0376ecb49c12e63aafa747fcc524ebb79c2
Signed-off-by: Dave Wallace <dwallacelf@gmail.com>

5fc9a9c0 12-Dec-2019 Jan Gelety <jgelety@cisco.com>

CSIT-1597 API cleanup: l2

- cover API changes in VPP: https://gerrit.fd.io/r/c/vpp/+/22970
- update vpp stable to version 20.05-rc0~307

Change-Id: I3b4c69ee60b0add12edeb8d5e6ac6006b519593b
Signed-off-by: Jan Gelety <jgelety@cisco.com>

64208973 05-Mar-2020 Tibor Frank <tifrank@cisco.com>

Report: Detailed test results

- 3rd level

Change-Id: Iae8141ff64ae61711ae8e69b67a92cfcb0f3f937
Signed-off-by: Tibor Frank <tifrank@cisco.com>

ef178b53 09-Mar-2020 Jan Gelety <jgelety@cisco.com>

API: Add collection for 22970/10

Change-Id: I8b635b14950ca148969831614fc7f32d52ef79d1
Signed-off-by: Jan Gelety <jgelety@cisco.com>

89f9634a 06-Mar-2020 Tibor Frank <tifrank@cisco.com>

Report: Add data

Change-Id: I2010fbad67a26b3729759c9bad669b268b54041b
Signed-off-by: Tibor Frank <tifrank@cisco.com>

a8c1be15 06-Mar-2020 Tibor Frank <tifrank@cisco.com>

Report: 2n-clx-xxv710 L2 base-scale tests

Change-Id: I64dcef426516e0e1aedfd4b8c91a65c987de70f3
Signed-off-by: Tibor Frank <tifrank@cisco.com>

cafc2c43 03-Mar-2020 Maros Mullner <maros.mullner@pantheon.tech>

Azure topology file MAC fix.

Signed-off-by: Maros Mullner <maros.mullner@pantheon.tech>
Change-Id: I7eefdb5db39a0f5328c7f1a0a0a5d57c762cc21c

267422b7 03-Mar-2020 Maros Mullner <maros.mullner@pantheon.tech>

Add pciutils to trex role, to solve lspci not found.

Signed-off-by: Maros Mullner <maros.mullner@pantheon.tech>
Change-Id: I3b1d5e61fe85b1112d4032f6e2b17b61a812e749

d0d8afac 05-Mar-2020 Tibor Frank <tifrank@cisco.com>

Report: Add 2n-clx-xxv710 L2 base-scale tests

Change-Id: Ib30a60ef2e2c6d9a80d1ff98d1bf606d049ffc41
Signed-off-by: Tibor Frank <tifrank@cisco.com>

f417795b 05-Mar-2020 Tibor Frank <tifrank@cisco.com>

Report: Fix graphs for Soak tests

Change-Id: Ied8b8a8e4f2087c6e53ad3f1a56bcf03346394ef
Signed-off-by: Tibor Frank <tifrank@cisco.com>

85ade6e5 04-Mar-2020 Tibor Frank <tifrank@cisco.com>

Report: Configure Report 2001.11

Change-Id: I5af4ef16464ee372d5ff9a41695870c22a3311bf
Signed-off-by: Tibor Frank <tifrank@cisco.com>

96c041ab 03-Mar-2020 Tibor Frank <tifrank@cisco.com>

Report: Add Soak tests

Change-Id: I8e5ae26209358d676d1beb758d97a3bfe3a22675
Signed-off-by: Tibor Frank <tifrank@cisco.com>

fd64535a 03-Mar-2020 Tibor Frank <tifrank@cisco.com>

Report: Fix title levels in auto generated files

Change-Id: Ia6ffdd69ce249a2143b59e2db40b211469b51e11
Signed-off-by: Tibor Frank <tifrank@cisco.com>

aee375a6 03-Mar-2020 Tibor Frank <tifrank@cisco.com>

Report: Enable pdf version

Change-Id: Ibcf08fe0568f9e12b9ab6cf96ebeeccdfcfa2487
Signed-off-by: Tibor Frank <tifrank@cisco.com>

fd3d18c8 03-Mar-2020 Tibor Frank <tifrank@cisco.com>

Report: Add TCP/IP tests

- 2n-clx

Change-Id: I5c045d539028e5f6b93799b7d59fdc203968730f
Signed-off-by: Tibor Frank <tifrank@cisco.com>

424b8571 03-Mar-2020 Tibor Frank <tifrank@cisco.com>

Report: Add data

- hoststack

Change-Id: I6d62ab7a21d463d4f87365073cd491bc38b4b0af
Signed-off-by: Tibor Frank <tifrank@cisco.com>

d9bcff40 21-Feb-2020 Tibor Frank <tifrank@cisco.com>

PAL: Process Hoststack data

Change-Id: Ib87ad83f3bbb7e71b51b91b9b3e8dc963a76a047
Signed-off-by: Tibor Frank <tifrank@cisco.com>

1629feda 03-Mar-2020 Tibor Frank <tifrank@cisco.com>

Report: Fixes

Change-Id: I1c68ce3380581c28193f8a77294285ee769d23a0
Signed-off-by: Tibor Frank <tifrank@cisco.com>

5570bf3a 11-Feb-2020 Dave Wallace <dwallacelf@gmail.com>

perf: Clean up Hoststack tests

- Update test names with clients/streams
- Convert test results to JSON output
* iperf3 results include bits_per_second
* vpp_echo results include both client
and server output which includes time in seconds
and rx_data/tx_data in bytes which can be used
to calculate the average bits per second.
Tx and Rx data will always be the same:
BPS = (client tx_data * 8) / ((client time + server time) / 2)
- Fix WRK test results data formatting errors

Change-Id: Ie2aeb665e3cc0739b16f97ba2628eebe6e041d22
Signed-off-by: Dave Wallace <dwallacelf@gmail.com>

3fb7e3f7 03-Mar-2020 Tibor Frank <tifrank@cisco.com>

Report: Add reconf tests for 2n-clx

Change-Id: I36ecd741b53f2db837d499ab2a5daf3bfac8c790
Signed-off-by: Tibor Frank <tifrank@cisco.com>

bf91f9fa 03-Mar-2020 Tibor Frank <tifrank@cisco.com>

Report: Add data

- VPP performance tests 2n-clx
- test sets IP4, IP6, L2, Memif, loadbalancer, VHost, VTS
- all sets selected for analysis and graphs

Change-Id: Ie0e86c131927c860b0333d12cac8ef7f3c7bcb27
Signed-off-by: Tibor Frank <tifrank@cisco.com>

2a4a12ac 03-Mar-2020 Tibor Frank <tifrank@cisco.com>

Report: Fix _generate_html_table

Change-Id: I711755fee488fb9ce07cd2d4dc868fc39bd07a54
Signed-off-by: Tibor Frank <tifrank@cisco.com>

691f24ec 28-Feb-2020 Tibor Frank <tifrank@cisco.com>

Report: Detailed test results

- sub-chapters reorg

Change-Id: I0a90bcfde1e8be368e7ddaf9a41abbe52851cd62
Signed-off-by: Tibor Frank <tifrank@cisco.com>

8c85cc69 26-Feb-2020 Vratko Polak <vrpolak@cisco.com>

bash: tolerate -dev as a package name

Misbehaving projects can create it, and apt thinks it is a cli option.

Change-Id: Icc42231e2d498f976281ce725373c6679fe61fa4
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

070500f1 03-Feb-2020 Vratko Polak <vrpolak@cisco.com>

Fix argument order in MLRsearch

Introduced in last refactor.
Luckily, the result were still correct, just with confusing logs
and perhaps longer search time in unstable test cases.

Change-Id: I26dd5714fb588ea07afe85583b3ab3b4bd53d9ec
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

e482650c 28-Feb-2020 Tibor Frank <tifrank@cisco.com>

Report: Detailed test results

- Data alignment

Change-Id: I0b8c15c0c1553888c65cc77e8d954d1341847945
Signed-off-by: Tibor Frank <tifrank@cisco.com>

e1635554 28-Feb-2020 Tibor Frank <tifrank@cisco.com>

Report: Add data

Change-Id: I0332a2afca7a7048e5672dc1db002d1abb55476f
Signed-off-by: Tibor Frank <tifrank@cisco.com>

14ce81d3 28-Feb-2020 Tibor Frank <tifrank@cisco.com>

Report: Add data

Change-Id: Ida58bb38f71680e5d42b292c78e2b4cd01200b0e
Signed-off-by: Tibor Frank <tifrank@cisco.com>

d51e2f7d 28-Feb-2020 Tibor Frank <tifrank@cisco.com>

Report: Configure Report 2001.10

Change-Id: I0d7950b1c32633c0f67589fb9a7504726de6cfad
Signed-off-by: Tibor Frank <tifrank@cisco.com>

a7cb0c84 27-Feb-2020 Tibor Frank <tifrank@cisco.com>

Report: Edit Report history

Change-Id: I9b45e16478e399ed9d4f63d5e161071864ed953e
Signed-off-by: Tibor Frank <tifrank@cisco.com>

d10c8348 27-Feb-2020 Tibor Frank <tifrank@cisco.com>

Report: Do not show failed tests in "Detailed Test Results"

Change-Id: I6019af7f0b2af29c876a39a3243fe29843e3b1da
Signed-off-by: Tibor Frank <tifrank@cisco.com>

50ca8535 25-Feb-2020 Jan Gelety <jgelety@cisco.com>

FIX: check if t-rex is running at test setup of all perf tests

Change-Id: I9af632035a1415666b2470c62a41d1b6acbf33c8
Signed-off-by: Jan Gelety <jgelety@cisco.com>

7bf76acc 26-Feb-2020 Tibor Frank <tifrank@cisco.com>

Report: Add data

Change-Id: I7863ce4b4493265284aed5fb5aa413b93df30fb2
Signed-off-by: Tibor Frank <tifrank@cisco.com>

03ee91b5 03-Feb-2020 Vratko Polak <vrpolak@cisco.com>

CRC comments: SW crypto is enough

Change-Id: I4ec4a56d54850a7654bdc1a6330bd473bd997608
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

2d6410d2 26-Feb-2020 Tibor Frank <tifrank@cisco.com>

Report: Compare 3n-hsw to 2n-clx

Change-Id: I259d8eea5ef0a812ea47a10f2144834f0f5fad65
Signed-off-by: Tibor Frank <tifrank@cisco.com>

6c0a7fc9 26-Feb-2020 Tibor Frank <tifrank@cisco.com>

PAL: Detailed test results

Change-Id: I75ebad7874602dbc136440a3b4c6f94b095728c4
Signed-off-by: Tibor Frank <tifrank@cisco.com>

513d026a 25-Feb-2020 Tibor Frank <tifrank@cisco.com>

Report: Plots

Change-Id: Ic9e771417abb2c7d66a5124d77cd8e0dbe052845
Signed-off-by: Tibor Frank <tifrank@cisco.com>

ece0ed17 26-Feb-2020 Tibor Frank <tifrank@cisco.com>

Report: Add data

Change-Id: I523a92cbb33ccd7d46729cdb0a92b1fcc8272f66
Signed-off-by: Tibor Frank <tifrank@cisco.com>

d30251c4 24-Feb-2020 Tibor Frank <tifrank@cisco.com>

Report: Add dpdk-2n-clx-xv710

Change-Id: I072176298db00cbc148ad635c9179810aa53ddf3
Signed-off-by: Tibor Frank <tifrank@cisco.com>

cc02a78e 24-Feb-2020 Jan Gelety <jgelety@cisco.com>

FIX: avoid t-rex suite tear down action to fail successfull tests

- try to kill t-rex only if it is running
- do not fail the whole test suite when t-rex test suite tear down
action has failed

Change-Id: I3748a08a3da4dd3617cb54e8fdd344d49566fc7d
Signed-off-by: Jan Gelety <jgelety@cisco.com>

bb17ef2e 25-Feb-2020 Tibor Frank <tifrank@cisco.com>

Report: Process test msg

Change-Id: I3b40fb7f6949c098612b5649b56448bca1966155
Signed-off-by: Tibor Frank <tifrank@cisco.com>

84ab8bd6 25-Feb-2020 Tibor Frank <tifrank@cisco.com>

Report: Hoststack methodology

Change-Id: I105e1d4823df42522bff1af50d1bb173cd84d958
Signed-off-by: Tibor Frank <tifrank@cisco.com>

62df2578 24-Feb-2020 Tibor Frank <tifrank@cisco.com>

Report: Add data

Change-Id: I95c3026e69ce0a49073d67232058f902cf3ab2f3
Signed-off-by: Tibor Frank <tifrank@cisco.com>

815cbb45 21-Feb-2020 Vratko Polak <vrpolak@cisco.com>

Tox: Add copyright year tox checker

Only added/edited files already containing copyright notice
are checked for the correct year (and only if in first 3 lines).

Change-Id: I22c057431847fda3a7dfd4577f8346fadfe4c4f6
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

5c395632 21-Feb-2020 Tibor Frank <tifrank@cisco.com>

Report: Add data

Change-Id: Ib4e39f135f74421fd68bf0581255741ebfd26148
Signed-off-by: Tibor Frank <tifrank@cisco.com>

1d95c075 21-Feb-2020 Tibor Frank <tifrank@cisco.com>

Report: Add data

Change-Id: I5e999061f40734a3cd520199ab21d466aa8ca4bf
Signed-off-by: Tibor Frank <tifrank@cisco.com>

8d18be71 21-Feb-2020 Tibor Frank <tifrank@cisco.com>

Report: Add 2n-clx latency 5

Change-Id: Ia3b45ddb61accd637000318e4ea8e60c3a78b143
Signed-off-by: Tibor Frank <tifrank@cisco.com>

5c52ec46 21-Feb-2020 Tibor Frank <tifrank@cisco.com>

Report: Add 2n-clx latency 4

Change-Id: I1660b3289e55e9c3da743291bebc9c95fac40822
Signed-off-by: Tibor Frank <tifrank@cisco.com>

21a0973f 20-Feb-2020 Tibor Frank <tifrank@cisco.com>

Report: Add 2n-clx latency 3

Change-Id: I91a09438347de70f7d610837ffb30b9cd51d8659
Signed-off-by: Tibor Frank <tifrank@cisco.com>

36fca892 20-Feb-2020 Tibor Frank <tifrank@cisco.com>

Report: Add 2n-clx latency 2

Change-Id: Ib46aee4ef005aaf83153643b04b08b35c48aa758
Signed-off-by: Tibor Frank <tifrank@cisco.com>

42a9a5d0 20-Feb-2020 Maros Mullner <maros.mullner@pantheon.tech>

Small AWS terraform cleanup

Signed-off-by: Maros Mullner <maros.mullner@pantheon.tech>
Change-Id: I5acd3dd0b9e2e6beb03c94362ab739601da39443

d63ef8e4 20-Feb-2020 Tibor Frank <tifrank@cisco.com>

Report: Add 2n-clx latency 1

Change-Id: Iadc49e2cff4bfd0e695654aa48aaf8d2cba10f2d
Signed-off-by: Tibor Frank <tifrank@cisco.com>

f9ad510f 20-Feb-2020 Tibor Frank <tifrank@cisco.com>

Report: Disable pdf vervion

Change-Id: Ie7374ec00e834305e978fb10342fa33e92d4234e
Signed-off-by: Tibor Frank <tifrank@cisco.com>

31f3701a 19-Feb-2020 Tibor Frank <tifrank@cisco.com>

Report: Add 2n-clx

- Packet thput
- Speedup
- NFV

Change-Id: I52b840b19dbfc2b7110c64c4421008e698a15852
Signed-off-by: Tibor Frank <tifrank@cisco.com>

55e8c6b3 19-Feb-2020 Tibor Frank <tifrank@cisco.com>

Report: Configure 2001.09

Change-Id: I4fed9ef09f80efaeac8860ced9a46ce9cb8d8629
Signed-off-by: Tibor Frank <tifrank@cisco.com>

ed648e7c 17-Feb-2020 Maros Mullner <maros.mullner@pantheon.tech>

Re-compile vfio-pci and igb_uio for AWS in ansible scripts.

Signed-off-by: Maros Mullner <maros.mullner@pantheon.tech>
Change-Id: I6f0268f510e0c07e45d41f92ae5e2d24d05d407b

b495b6f2 19-Feb-2020 Tibor Frank <tifrank@cisco.com>

Report: Add data

Change-Id: Ie1edeb10f5798367ed0e0c2cdcfb6fe4a25aa4d1
Signed-off-by: Tibor Frank <tifrank@cisco.com>

a4e15f5d 19-Feb-2020 Tibor Frank <tifrank@cisco.com>

Report: Sort tests in tables

Change-Id: I862a35270a72d66d7cc3c0eaf5fb2bff20dcac7d
Signed-off-by: Tibor Frank <tifrank@cisco.com>

b51708f0 18-Feb-2020 Tibor Frank <tifrank@cisco.com>

Trending: Plots

- remove not needed params
- i40e --> dpdk

Change-Id: Ib63a66486b040b01a929f3ee0a4e80468c9d4e28
Signed-off-by: Tibor Frank <tifrank@cisco.com>

e4444934 18-Feb-2020 Vratko Polak <vrpolak@cisco.com>

Perpatch: Fix bash ansible calls

The function ansible_hosts got renamed to ansible_playbook
in https://gerrit.fd.io/r/c/csit/+/24511

Change-Id: Ife4e7b13f634fcdda95f80c18bc86cfded139b5d
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

0f70d751 18-Feb-2020 Tibor Frank <tifrank@cisco.com>

Report: Add data

Change-Id: I25f6a2ad739aade9bf0923767287bf803ecd0ec0
Signed-off-by: Tibor Frank <tifrank@cisco.com>

8ca63f49 18-Feb-2020 Tibor Frank <tifrank@cisco.com>

Report: Detailed test results

Change-Id: I9af4bc9de4f4606449fd257c4321d9cd980d5f01
Signed-off-by: Tibor Frank <tifrank@cisco.com>

eb774c3e 17-Feb-2020 Maros Mullner <maros.mullner@pantheon.tech>

Add option to run Trex with --force parameter to start
regardless of ports state.

Signed-off-by: Maros Mullner <maros.mullner@pantheon.tech>
Change-Id: Iaafb5ff3a53a290ca79506bdb559a32d39570482

c8bc6ec5 17-Feb-2020 juraj.linkes <juraj.linkes@pantheon.tech>

Download latest VPP packages for hourly jobs

1n-tx2 vpp-device tests are supposed to give us a view of how VPP
patches affect VPP device tests, so download the latest packages for
them as well.
Also replace round brackets with curly brackets in the condition to make
it faster according to
https://github.com/koalaman/shellcheck/wiki/SC2235.

Change-Id: I9caafea3590d04af9cb34d6bb536ff786fe08411
Signed-off-by: juraj.linkes <juraj.linkes@pantheon.tech>

a8a9827e 16-Feb-2020 Tibor Frank <tifrank@cisco.com>

PAL: CSIT-1676: Split long files into chapters

Change-Id: Id86c4fad596ce37d89d6600a30f9bbdc4e1edf5f
Signed-off-by: Tibor Frank <tifrank@cisco.com>

711ee276 15-Feb-2020 Jan Gelety <jgelety@cisco.com>

daily: Do not run nf_density chain_ipsec tests on 3n-hsw

Change-Id: I9a1afaf3654b96161c4c1de483c99c1f849b6980
Signed-off-by: Jan Gelety <jgelety@cisco.com>

fbbee8fe 17-Feb-2020 Tibor Frank <tifrank@cisco.com>

Report: Add data

Change-Id: I1fd14763c0e7776d09eb5ac0c6b47263397f92f7
Signed-off-by: Tibor Frank <tifrank@cisco.com>

c8c28c85 17-Feb-2020 Peter Mikus <pmikus@cisco.com>

Fix: Ansible minor bugs

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I804e78c3b8586dc9e9ca8b7cf4bf97d3744aeedc

e8db3444 17-Feb-2020 Tibor Frank <tifrank@cisco.com>

Report: Configure Report 2001.08

Change-Id: Iaddad3362eb2aaf9ced78d3f30fe1f25f40a70ef
Signed-off-by: Tibor Frank <tifrank@cisco.com>

6bc0123c 13-Feb-2020 Maros Mullner <mamullne@cisco.com>

AWS terraform automation scripts

Change-Id: I050fe466dd006d330d1bb29cc6ccba8ae4681f01
Signed-off-by: Maros Mullner <maros.mullner@pantheon.tech>

997a634a 17-Feb-2020 Tibor Frank <tifrank@cisco.com>

PAL: Fix pdf

Change-Id: I8dfb53c8b6231663a600bd0ec81f7915d8db09f0
Signed-off-by: Tibor Frank <tifrank@cisco.com>

35bbc365 13-Feb-2020 juraj.linkes <juraj.linkes@pantheon.tech>

Aarch64 fixes for vfio-pci in kernel VM

- Add enable_unsafe_noiommu_mode for aarch64 architecture to kernel VM
init script
- Add binding of pci device through /sys/bus/pci/drivers/vfio-pci/bind
- Minor refactor to enhance readability of differences between
architectures

Change-Id: Ib0ec35bfae054582d9ffcf7a82f8f8b3e3e24856
Signed-off-by: juraj.linkes <juraj.linkes@pantheon.tech>

dd5cd790 14-Feb-2020 Peter Mikus <pmikus@cisco.com>

Ansible: More telemetry

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: If0c2501d8ae6e019d6873283770c926b0da29095

1ff1a79c 13-Feb-2020 Peter Mikus <pmikus@cisco.com>

Ansible: Update DPDK

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Ia5c1e40b952c14775f2f038d3a8a293335172f47

ffab1c91 14-Feb-2020 Tibor Frank <tifrank@cisco.com>

Report: Fix previous version of dpdk

Change-Id: I5fa6041ff7896c38654ecca5fcdf9d637286d02a
Signed-off-by: Tibor Frank <tifrank@cisco.com>

e3546697 13-Feb-2020 Tibor Frank <tifrank@cisco.com>

Report: Detailed results tables

Change-Id: Ib89fb3135a5a170e666923148e74541f042a2bbd
Signed-off-by: Tibor Frank <tifrank@cisco.com>

f51658bf 13-Feb-2020 Tibor Frank <tifrank@cisco.com>

Report: Disable pdf

Change-Id: I019aadf91962f3118729627da7039847347497b3
Signed-off-by: Tibor Frank <tifrank@cisco.com>

6df11d02 14-Feb-2020 Tibor Frank <tifrank@cisco.com>

Report: Remove NFV

Change-Id: I732bef5c6596739b40198b9ed36737451f998959
Signed-off-by: Tibor Frank <tifrank@cisco.com>

af68f9b3 14-Feb-2020 Tibor Frank <tifrank@cisco.com>

Report: Add data

Change-Id: I90fba71b4744e14492b47ccc700617d7c5c8008d
Signed-off-by: Tibor Frank <tifrank@cisco.com>

ebe8b93e 14-Feb-2020 Tibor Frank <tifrank@cisco.com>

Report: Detailed test results table 2

Change-Id: Ica89d51b5590ba6ceaedb7a4d244abee78f30755
Signed-off-by: Tibor Frank <tifrank@cisco.com>

c81eac1e 14-Feb-2020 Tibor Frank <tifrank@cisco.com>

Report: Detailed test results table

Change-Id: I2fd223ac522d8a88546269db0752995d0c77e4fe
Signed-off-by: Tibor Frank <tifrank@cisco.com>

8d43bb02 13-Feb-2020 Tibor Frank <tifrank@cisco.com>

Report: Tables with detailed results for MRR 2

Change-Id: I62f9a90f222382e4d39c4b2a2aaadc329a907c66
Signed-off-by: Tibor Frank <tifrank@cisco.com>

c5e88fad 13-Feb-2020 Tibor Frank <tifrank@cisco.com>

Report: Tables with detailed results for MRR

Change-Id: I5506bbdc6bc5e5de4f219fa349659ddf9d0e55a8
Signed-off-by: Tibor Frank <tifrank@cisco.com>

09dbdddf 13-Feb-2020 Tibor Frank <tifrank@cisco.com>

Report: Fixes

Change-Id: I00c059d89be00357d5751d851c1d1df073af896f
Signed-off-by: Tibor Frank <tifrank@cisco.com>

b5e2d949 13-Feb-2020 Tibor Frank <tifrank@cisco.com>

Report: Fixes

Change-Id: Iceb9f454b21034c0e7912692eeac402e793fef06
Signed-off-by: Tibor Frank <tifrank@cisco.com>

b47c8f8e 13-Feb-2020 Tibor Frank <tifrank@cisco.com>

Report: Format of tables

Change-Id: I783ad52f7efab0e99d5238c0af0432aa77155193
Signed-off-by: Tibor Frank <tifrank@cisco.com>

84309b22 13-Feb-2020 Tibor Frank <tifrank@cisco.com>

Report: Fix dpdk tsh lat

Change-Id: I73a44e6ea99c93c62bf687a1899f8da80181c515
Signed-off-by: Tibor Frank <tifrank@cisco.com>

280f41f5 13-Feb-2020 Tibor Frank <tifrank@cisco.com>

Reprot: Add dpdk tsh

Change-Id: I577b6957a605f11bc66494273fa37a6345fc117e
Signed-off-by: Tibor Frank <tifrank@cisco.com>

51b7faf4 13-Feb-2020 Tibor Frank <tifrank@cisco.com>

Report: Add data

Change-Id: I2c3543c9790dc14e997b6a5c7a1264acb0f7bb9a
Signed-off-by: Tibor Frank <tifrank@cisco.com>

11b0380f 12-Feb-2020 Tibor Frank <tifrank@cisco.com>

Report: Change the table with test results

Change-Id: I700dea02b03f11910a5646d29bd732252f7a77ef
Signed-off-by: Tibor Frank <tifrank@cisco.com>

1ced14ce 12-Feb-2020 Tibor Frank <tifrank@cisco.com>

PAL: Fix sh run

Change-Id: I55825d6f24788aab67d2121e6fe45808d9a79e59
Signed-off-by: Tibor Frank <tifrank@cisco.com>

bf4e50ab 12-Feb-2020 Tibor Frank <tifrank@cisco.com>

Report: Fix graphs for vhost tests

Change-Id: I63c4289c848626490897d33ef915d4fdf810128c
Signed-off-by: Tibor Frank <tifrank@cisco.com>

ef6ce6f8 12-Feb-2020 Tibor Frank <tifrank@cisco.com>

Report: Fix Oper data

Change-Id: Ie1e399486f12a204e23fdf73774c322eacf1ebe4
Signed-off-by: Tibor Frank <tifrank@cisco.com>

acda5483 12-Feb-2020 Tibor Frank <tifrank@cisco.com>

Report: Add HDRH Lat for DPDK, part 3

Change-Id: I8623ca7439f7c78da1f7d5eb53931f96c547dc15
Signed-off-by: Tibor Frank <tifrank@cisco.com>

033efac5 11-Feb-2020 Tibor Frank <tifrank@cisco.com>

Report: Add HDRH Lat for DPDK, part 2

Change-Id: I4ea884f727853ef21c1247eb07a7f2e3a991d454
Signed-off-by: Tibor Frank <tifrank@cisco.com>

34ec0f34 10-Feb-2020 Peter Mikus <pmikus@cisco.com>

Ansible: Optimizations

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I56fb45fb22b924eec6ee6b6b7ad7874a07f1555c

c3abfc9d 12-Feb-2020 Tibor Frank <tifrank@cisco.com>

Report: Add HDRH Lat for DPDK, part 1

Change-Id: Iedff108d6c470aa1b8d7b3955c65943ba4541695
Signed-off-by: Tibor Frank <tifrank@cisco.com>

89deb5b6 11-Feb-2020 Tibor Frank <tifrank@cisco.com>

Report: Hide HTTP tests

Change-Id: Ia1d1d44cef85791f341db32328ee6fb47b22bd73
Signed-off-by: Tibor Frank <tifrank@cisco.com>

8159edb7 11-Feb-2020 Tibor Frank <tifrank@cisco.com>

Report: Remove build 3n-hsw-26

- It is too large

Change-Id: I25fa8e60799bb88d7a67a043c8ca594a19c4f2d5
Signed-off-by: Tibor Frank <tifrank@cisco.com>

974876b9 11-Feb-2020 Tibor Frank <tifrank@cisco.com>

Report: Hide skx and clx testbeds

Change-Id: I7298e401e0acdc1fec340bed597af50c25dd67f0
Signed-off-by: Tibor Frank <tifrank@cisco.com>

4274f14f 11-Feb-2020 Tibor Frank <tifrank@cisco.com>

Report: Replace i40e by dpdk

Change-Id: Iff350d831d4fe086fe91a9f5a640b5345b49b72f
Signed-off-by: Tibor Frank <tifrank@cisco.com>

3b30ef03 11-Feb-2020 Tibor Frank <tifrank@cisco.com>

Report: Remove not needed Latencies

Change-Id: I4f29d7ec9343ec8758fa686180efe506165b4098
Signed-off-by: Tibor Frank <tifrank@cisco.com>

7b890eb5 11-Feb-2020 Tibor Frank <tifrank@cisco.com>

Report: Add data

Change-Id: I5e36d083d67b9e987d77388fe6c565f521702117
Signed-off-by: Tibor Frank <tifrank@cisco.com>

9e7b9a25 11-Feb-2020 Tibor Frank <tifrank@cisco.com>

PAL: Add HDRH data to detailed test results

Change-Id: Ie80f2f6256ed36e16647057d59e3ef909bbb9f15
Signed-off-by: Tibor Frank <tifrank@cisco.com>

0ba8b76d 11-Feb-2020 Tibor Frank <tifrank@cisco.com>

Report: Filter data for Latency graphs

Change-Id: I7d0354086c7d63bc79f2b2f97345d84842d6a911
Signed-off-by: Tibor Frank <tifrank@cisco.com>

7dc45304 10-Feb-2020 Tibor Frank <tifrank@cisco.com>

Report: Add ucode comparisom

Change-Id: If918806ba5bcda4d87aa2ea2ab4d2c676dc9670a
Signed-off-by: Tibor Frank <tifrank@cisco.com>

d7ef5191 10-Feb-2020 Tibor Frank <tifrank@cisco.com>

Report: Latency only 1C and prim NIC

Change-Id: Ibb9f6ed27047ac2beca25d9462dc321cf73f7546
Signed-off-by: Tibor Frank <tifrank@cisco.com>

256743b5 19-Jan-2020 Jan Gelety <jgelety@cisco.com>

FIX: set host physical interface mac address to rdma interface

Reason is that the traffic generator is initialized with MAC addresses
of physical interfaces in the suite setup while rdma interfaces
are created later.

Change-Id: I2cf182cde20f14778624740a1f0467096c336306
Signed-off-by: Jan Gelety <jgelety@cisco.com>

574397e8 10-Feb-2020 Tibor Frank <tifrank@cisco.com>

Report: Add data

Change-Id: Ieef4cba0077e0ba5076d82ff1bdb6293abe91c3b
Signed-off-by: Tibor Frank <tifrank@cisco.com>

b968e370 22-Jan-2020 Jan Gelety <jgelety@cisco.com>

FIX: Detection if l2fwd/l3fwd is up/down

Change-Id: Ide5de222e8314a0ea0be59f9a478f8d59147f722
Signed-off-by: Jan Gelety <jgelety@cisco.com>

c34b584b 10-Feb-2020 Tibor Frank <tifrank@cisco.com>

Report: Add data

Change-Id: I58831fb795cd300d31306d040e8239c2a1b9a7fa
Signed-off-by: Tibor Frank <tifrank@cisco.com>

704f231f 10-Feb-2020 Tibor Frank <tifrank@cisco.com>

Report: Add data

Change-Id: I57b4f1cdb6d4467f8a93b466a5173e00d493b9a8
Signed-off-by: Tibor Frank <tifrank@cisco.com>

c1335b81 07-Feb-2020 Tibor Frank <tifrank@cisco.com>

PAL: Latency by percentile

Change-Id: I413271f4b1fad801463fb7f8f16112aedc0d058b
Signed-off-by: Tibor Frank <tifrank@cisco.com>

8605f3f4 04-Feb-2020 vagrant <pmikus@cisco.com>

CSIT Azure integration

+ Terraform
+ Ansible

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I353511c5ef39d8c8d43fedc61c8dbb30b4821e1b


tools/terraform/azure/.gitignore
tools/terraform/azure/main.tf
tools/terraform/azure/nic.tf
tools/testbed-setup/ansible/inventories/lf_inventory/group_vars/all.yaml
tools/testbed-setup/ansible/inventories/sample_inventory/group_vars/all.yaml
tools/testbed-setup/ansible/roles/azure/defaults/main.yaml
tools/testbed-setup/ansible/roles/azure/handlers/main.yaml
tools/testbed-setup/ansible/roles/azure/tasks/main.yaml
tools/testbed-setup/ansible/roles/calibration/defaults/main.yaml
tools/testbed-setup/ansible/roles/calibration/tasks/main.yaml
tools/testbed-setup/ansible/roles/calibration/tasks/x86_64.yaml
tools/testbed-setup/ansible/roles/cobbler/tasks/main.yaml
tools/testbed-setup/ansible/roles/cobbler/tasks/ubuntu-18.04.2-server-x86_64.yaml
tools/testbed-setup/ansible/roles/common/defaults/main.yaml
tools/testbed-setup/ansible/roles/common/files/apt-sources_bionic_aarch64.list
tools/testbed-setup/ansible/roles/common/files/apt-sources_bionic_x86_64.list
tools/testbed-setup/ansible/roles/common/files/netplan_config
tools/testbed-setup/ansible/roles/common/handlers/ipmi.yaml
tools/testbed-setup/ansible/roles/common/handlers/main.yaml
tools/testbed-setup/ansible/roles/common/tasks/kernel_install.yaml
tools/testbed-setup/ansible/roles/common/tasks/main.yaml
tools/testbed-setup/ansible/roles/common/tasks/ubuntu_bionic.yaml
tools/testbed-setup/ansible/roles/docker/defaults/main.yaml
tools/testbed-setup/ansible/roles/dpdk/defaults/main.yaml
tools/testbed-setup/ansible/roles/dpdk/tasks/main.yaml
tools/testbed-setup/ansible/roles/iperf/defaults/main.yaml
tools/testbed-setup/ansible/roles/iperf/tasks/main.yaml
tools/testbed-setup/ansible/roles/kernel_vm/files/initramfs_modules
tools/testbed-setup/ansible/roles/kernel_vm/files/initramfs_resume
tools/testbed-setup/ansible/roles/kernel_vm/tasks/main.yaml
tools/testbed-setup/ansible/roles/kubernetes/defaults/main.yaml
tools/testbed-setup/ansible/roles/mellanox/defaults/main.yaml
tools/testbed-setup/ansible/roles/mellanox/tasks/main.yaml
tools/testbed-setup/ansible/roles/performance_tuning/defaults/main.yaml
tools/testbed-setup/ansible/roles/performance_tuning/files/irqbalance
tools/testbed-setup/ansible/roles/performance_tuning/handlers/main.yaml
tools/testbed-setup/ansible/roles/performance_tuning/tasks/aarch64.yaml
tools/testbed-setup/ansible/roles/performance_tuning/tasks/main.yaml
tools/testbed-setup/ansible/roles/performance_tuning/tasks/turbo_boost.yaml
tools/testbed-setup/ansible/roles/performance_tuning/tasks/ubuntu_bionic.yaml
tools/testbed-setup/ansible/roles/performance_tuning/tasks/x86_64.yaml
tools/testbed-setup/ansible/roles/sut/defaults/main.yaml
tools/testbed-setup/ansible/roles/sut/tasks/dpdk.yaml
tools/testbed-setup/ansible/roles/sut/tasks/main.yaml
tools/testbed-setup/ansible/roles/sut/tasks/ubuntu_bionic.yaml
tools/testbed-setup/ansible/roles/tg/files/csit-initialize-docker-tg.sh
tools/testbed-setup/ansible/roles/tg/handlers/main.yaml
tools/testbed-setup/ansible/roles/tg/tasks/main.yaml
tools/testbed-setup/ansible/roles/tg/tasks/trex.yaml
tools/testbed-setup/ansible/roles/tg/tasks/ubuntu_bionic.yaml
tools/testbed-setup/ansible/roles/tg/tasks/wrk.yaml
tools/testbed-setup/ansible/roles/trex/defaults/main.yaml
tools/testbed-setup/ansible/roles/trex/files/t-rex.patch
tools/testbed-setup/ansible/roles/trex/tasks/main.yaml
tools/testbed-setup/ansible/roles/vexx_hosts/defaults/main.yaml
tools/testbed-setup/ansible/roles/vexx_hosts/handlers/cimc.yaml
tools/testbed-setup/ansible/roles/vexx_hosts/handlers/ipmi.yaml
tools/testbed-setup/ansible/roles/vexx_hosts/handlers/main.yaml
tools/testbed-setup/ansible/roles/vexx_hosts/tasks/main.yaml
tools/testbed-setup/ansible/roles/vpp_device/handlers/main.yaml
tools/testbed-setup/ansible/roles/vpp_device/tasks/main.yaml
tools/testbed-setup/ansible/roles/wrk/defaults/main.yaml
tools/testbed-setup/ansible/roles/wrk/tasks/main.yaml
tools/testbed-setup/ansible/site_azure.yaml
tools/testbed-setup/ansible/sut.yaml
tools/testbed-setup/ansible/sut_azure.yaml
tools/testbed-setup/ansible/templates/topology_azure.j2
tools/testbed-setup/ansible/tg.yaml
tools/testbed-setup/ansible/tg_azure.yaml
tools/testbed-setup/ansible/vpp_device.yaml
707562eb 07-Feb-2020 Tibor Frank <tifrank@cisco.com>

PAL: Process NDRPDR test msg

Change-Id: I4098fa52cfa2feb2fca507ffe203c2a325c1d140
Signed-off-by: Tibor Frank <tifrank@cisco.com>

2dd05d1d 07-Feb-2020 Tibor Frank <tifrank@cisco.com>

Report: Configure 2001-07

Change-Id: I6323a3cf86bdebb6f1dc41a10fc840b5c80fab01
Signed-off-by: Tibor Frank <tifrank@cisco.com>

2c06090c 04-Feb-2020 Tibor Frank <tifrank@cisco.com>

PAL: Operational data

Change-Id: I43eb12117ddc9b6df447f0303881bf7ec6153900
Signed-off-by: Tibor Frank <tifrank@cisco.com>

5d8cbe57 05-Feb-2020 Tibor Frank <tifrank@cisco.com>

Report: Remove data from 2n-skx TB23

Change-Id: Ibd8ccb2ebc5d158abb4fe295e8b514ab7a7c5422
Signed-off-by: Tibor Frank <tifrank@cisco.com>

d639b4d3 05-Feb-2020 Tibor Frank <tifrank@cisco.com>

Report: Add data

Change-Id: I58c85e6dccca28d402e6a54cf49ce5eebcdd5b1b
Signed-off-by: Tibor Frank <tifrank@cisco.com>

630dc747 21-Jan-2020 Jan Gelety <jgelety@cisco.com>

FIX: nat44 scale

+ missing ip_min for vm1

Change-Id: I8a30eaa36f6e417a88a6888b70f72d74183c9141
Signed-off-by: Jan Gelety <jgelety@cisco.com>

2cf07559 24-Jan-2020 Peter Mikus <pmikus@cisco.com>

Ansible: Cleanup and speedup

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Ia2ce482798204ad426f93f334c97e28eb51139fd

35024b69 01-Dec-2019 juraj.linkes <juraj.linkes@pantheon.tech>

Revert "Change startup show pci to show ver"

This reverts commit bb33f1d16f1451253f942da0c55cdea72e71c398.

Change-Id: Ida80af970e400460860602db884a943e5599a849
Signed-off-by: juraj.linkes <juraj.linkes@pantheon.tech>

8bf02005 28-Jan-2020 Vratko Polak <vrpolak@cisco.com>

Add more reconf tests, for IPsec

- Not adding nf_density tests.
- Not adding hardware ipsec tests.
- Not adding -policy- tests.
- Using old crypto_ia32_plugin.so plugin name.
+ Suitable for cherry-picking to rls2001.

Change-Id: Ibf44d6d91e2afa2320637ecd9eb69d5d5dc364aa
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

70f49a03 04-Feb-2020 Tibor Frank <tifrank@cisco.com>

Report: Add data

Change-Id: I8377704590e7278d0faab5497b538300e26fd0ba
Signed-off-by: Tibor Frank <tifrank@cisco.com>

c16b1af9 04-Feb-2020 Tibor Frank <tifrank@cisco.com>

Report: Remove cx556a from DPDK

Change-Id: I19f87dc6608dab684663174d541dfcee47e045da
Signed-off-by: Tibor Frank <tifrank@cisco.com>

f4468158 03-Feb-2020 Tibor Frank <tifrank@cisco.com>

Report: Fix spec

Change-Id: Ia86a1542b69aa07d9d26a4aea3c5ccda6dd69862
Signed-off-by: Tibor Frank <tifrank@cisco.com>

8da14b3b 03-Feb-2020 Tibor Frank <tifrank@cisco.com>

Report: Add VPP 2n-clx cx556a

Change-Id: I95e713f1e1d41eb886261b802f711fbb6ad6d27f
Signed-off-by: Tibor Frank <tifrank@cisco.com>

7a035831 03-Feb-2020 Vratko Polak <vrpolak@cisco.com>

Autogen: Fix typo affecting DPDK

With the typo, only the first type+nic combination is generated.
With fix, all combinations are generated.

Change-Id: Ieb2db31cebed4940b063505b70f4d12a30da489c
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

27fbd817 03-Feb-2020 Tibor Frank <tifrank@cisco.com>

Report: Add DPDK 2n-clx

Change-Id: I4cd0fb5169a8ce571cce23bf8c3b9709afe8dc9b
Signed-off-by: Tibor Frank <tifrank@cisco.com>

d6c14f8b 03-Feb-2020 Tibor Frank <tifrank@cisco.com>

Trending: Add cx556a to urls

Change-Id: Ib86e9b1ad340c214fd98c7e736449e5ae3206096
Signed-off-by: Tibor Frank <tifrank@cisco.com>

99991cf3 02-Feb-2020 Tibor Frank <tifrank@cisco.com>

Trending: Input data

Change-Id: I27aa8d5a5934e1c60c6e71f8dc95d25e0217a7a0
Signed-off-by: Tibor Frank <tifrank@cisco.com>

95561a45 31-Jan-2020 Vratko Polak <vrpolak@cisco.com>

Update CRC comments

+ Link to current stable build.
+ Remove policer comment (as it is already a devicetest).
+ Add nsim comment.
+ Include perftest tag pattern to run a drv-avf test.
+ Switch from 2n-skx to 2n-clx to test also rdma-core driver.
+ Add tag for vfio-pci driver for the rest of tag expressions.

Change-Id: Id2f2ee0525e27437166431045a174b3097dff52b
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

7472410f 09-Jul-2019 Vratko Polak <vrpolak@cisco.com>

Remove trailing space from CLI command

Change-Id: I49adff478302da036ecfacb675983923dc3f1ce1
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

6bcf4d40 30-Jan-2020 Peter Mikus <pmikus@cisco.com>

T-Rex: CPU pinning

+ Detect NUMA
+ Pin based on numa location

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Ife350f8c70e5437ac7c1413c7753f2a2f62777d9

47a26ef5 31-Jan-2020 Tibor Frank <tifrank@cisco.com>

Trending: Reduce input data

Change-Id: Ic09061050e0e55e3beb5aaa13a8914ea4959efa2
Signed-off-by: Tibor Frank <tifrank@cisco.com>

e1ee0480 31-Jan-2020 Tibor Frank <tifrank@cisco.com>

Trending: Add mellanox

Change-Id: Id6f621ee4d604da96cf65c7f1cb889ec055df9b1
Signed-off-by: Tibor Frank <tifrank@cisco.com>

d79b753c 15-Jan-2020 Dave Wallace <dwallacelf@gmail.com>

perf: Add hoststack NSIM+LDPRELOAD+IPERF3 test suite

Change-Id: Ia7a876b1aa240676e1f2d23618c1d4e09ead14f0
Signed-off-by: Dave Wallace <dwallacelf@gmail.com>

20e972ce 29-Jan-2020 Tibor Frank <tifrank@cisco.com>

PAL: Latency processing

Very ugly solution for now. It will be replaced by using JSON structure
for test results soon.

Change-Id: If5b63de94bf02e7fc2a518c1f6a94f42dcec9e07
Signed-off-by: Tibor Frank <tifrank@cisco.com>

401c2491 29-Jan-2020 Vratko Polak <vrpolak@cisco.com>

Display target_tr for ndr/pdr results

Small differences in Tx packet counts can cause
the previous way (which used transmit_rate,
computed from packets sent and nominal duration)
to report lower bounds as higher than upper bounds.

Also, reconf tests need the target (not actual) rate.

Change-Id: If5222dabd9762b8d9c2e22d875c12ad355bc6838
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

703d013c 28-Jan-2020 Vratko Polak <vrpolak@cisco.com>

Ndrpdr: Remove unused latency measurements

+ Improve keyword Documentation.
+ Reorder measurements, higher loads first.

Change-Id: I1aeab1c8ada268422e9f421e075aff2ac9eec23f
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

074ae973 08-Jan-2020 Dave Wallace <dwallacelf@gmail.com>

perf: QUIC transport hoststack test suite

Change-Id: I73f4be7ea315c7a5dcce46e1bd3034bcb0a97ee2
Signed-off-by: Dave Wallace <dwallacelf@gmail.com>

3bc72c6e 29-Jan-2020 Tibor Frank <tifrank@cisco.com>

Report: Fix: Add new NFV data

Change-Id: Iae3557db30c5a95cb26d2e9b5acf24df2f64e429
Signed-off-by: Tibor Frank <tifrank@cisco.com>

8f6b774b 29-Jan-2020 Tibor Frank <tifrank@cisco.com>

Report: Add new NFV data

Change-Id: Ic5a20940466545611150cfceaed58cee702636c4
Signed-off-by: Tibor Frank <tifrank@cisco.com>

827c0c01 29-Jan-2020 Peter Mikus <pmikus@cisco.com>

IPSEC: Change plugin naming

https://gerrit.fd.io/r/c/vpp/+/24574

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Ic2b7c925ceba1e16de87c64003ecceeea69c681c

33741e9e 29-Jan-2020 Tibor Frank <tifrank@cisco.com>

Report: Add NFV data for existing elements

Change-Id: Ib76dbf36f6eb0234f6947fc43bd6c31e12a1d8e9
Signed-off-by: Tibor Frank <tifrank@cisco.com>

b340b5c9 21-Jan-2020 Dave Wallace <dwallacelf@gmail.com>

perf: hoststack iperf3 test tuning

Change-Id: I53425f57fe9ecef9cff2c94642cc7cb24537a961
Signed-off-by: Dave Wallace <dwallacelf@gmail.com>

6ac704e7 24-Jan-2020 Vratko Polak <vrpolak@cisco.com>

Check interval validity in reconf tests

Without this, if the search part returns min_rate,
then reconf part reports few seconds with a small loss count.

But min_rate means there is a bug or misconfiguration,
so the tests should fail, instead of returning misleading results.

Change-Id: I566608b40ae11d6aaa3fe022a32da97901e1999c
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

ceaa2959 23-Jan-2020 Vratko Polak <vrpolak@cisco.com>

Perform some cleanup discovered by GPL work

+ Remove one __init__.robot file with no function.
+ Remove executable flags from traffic profiles.
+ Improve indentation in some traffic profiles.

Change-Id: I099e63069003fba788976a9470a909ccff51a88c
Signed-off-by: Vratko Polak <vrpolak@cisco.com>


libraries/robot/__init__.robot
traffic_profiles/trex/profile_trex_stateless_base_class.py
traffic_profiles/trex/trex-sl-2n-dot1qip4asym-ip4src254.py
traffic_profiles/trex/trex-sl-2n-dot1qip6asym-ip6src253.py
traffic_profiles/trex/trex-sl-2n-ethip4-ip4dst10000.py
traffic_profiles/trex/trex-sl-2n-ethip4-ip4dst100000.py
traffic_profiles/trex/trex-sl-2n-ethip4-ip4dst1000000.py
traffic_profiles/trex/trex-sl-2n-ethip4-ip4src253.py
traffic_profiles/trex/trex-sl-2n-ethip4-ip4src254.py
traffic_profiles/trex/trex-sl-2n-ethip4-macsrc500kdst500k.py
traffic_profiles/trex/trex-sl-2n-ethip4-macsrc50kdst50k.py
traffic_profiles/trex/trex-sl-2n-ethip4-macsrc5kdst5k.py
traffic_profiles/trex/trex-sl-2n-ethip4udp-1000u15p.py
traffic_profiles/trex/trex-sl-2n-ethip4udp-10u1000p-conc.py
traffic_profiles/trex/trex-sl-2n-ethip4udp-1u1p.py
traffic_profiles/trex/trex-sl-2n-ethip4udp-lb.py
traffic_profiles/trex/trex-sl-2n-ethip6-ip6dst10000.py
traffic_profiles/trex/trex-sl-2n-ethip6-ip6dst100000.py
traffic_profiles/trex/trex-sl-2n-ethip6-ip6dst1000000.py
traffic_profiles/trex/trex-sl-2n-ethip6-ip6src253.py
traffic_profiles/trex/trex-sl-2n3n-ethip4-ip4src254-10c1n.py
traffic_profiles/trex/trex-sl-2n3n-ethip4-ip4src254-10c2n.py
traffic_profiles/trex/trex-sl-2n3n-ethip4-ip4src254-1c10n.py
traffic_profiles/trex/trex-sl-2n3n-ethip4-ip4src254-1c1n.py
traffic_profiles/trex/trex-sl-2n3n-ethip4-ip4src254-1c2n.py
traffic_profiles/trex/trex-sl-2n3n-ethip4-ip4src254-1c4n.py
traffic_profiles/trex/trex-sl-2n3n-ethip4-ip4src254-1c6n.py
traffic_profiles/trex/trex-sl-2n3n-ethip4-ip4src254-1c8n.py
traffic_profiles/trex/trex-sl-2n3n-ethip4-ip4src254-2c10n.py
traffic_profiles/trex/trex-sl-2n3n-ethip4-ip4src254-2c1n.py
traffic_profiles/trex/trex-sl-2n3n-ethip4-ip4src254-2c2n.py
traffic_profiles/trex/trex-sl-2n3n-ethip4-ip4src254-2c4n.py
traffic_profiles/trex/trex-sl-2n3n-ethip4-ip4src254-2c6n.py
traffic_profiles/trex/trex-sl-2n3n-ethip4-ip4src254-2c8n.py
traffic_profiles/trex/trex-sl-2n3n-ethip4-ip4src254-4c1n.py
traffic_profiles/trex/trex-sl-2n3n-ethip4-ip4src254-4c2n.py
traffic_profiles/trex/trex-sl-2n3n-ethip4-ip4src254-4c4n.py
traffic_profiles/trex/trex-sl-2n3n-ethip4-ip4src254-4c6n.py
traffic_profiles/trex/trex-sl-2n3n-ethip4-ip4src254-6c1n.py
traffic_profiles/trex/trex-sl-2n3n-ethip4-ip4src254-6c2n.py
traffic_profiles/trex/trex-sl-2n3n-ethip4-ip4src254-6c4n.py
traffic_profiles/trex/trex-sl-2n3n-ethip4-ip4src254-8c1n.py
traffic_profiles/trex/trex-sl-2n3n-ethip4-ip4src254-8c2n.py
traffic_profiles/trex/trex-sl-3n-dot1qip4-vlan100ip4src254ip4dst254.py
traffic_profiles/trex/trex-sl-3n-dot1qip4-vlan10ip4src254ip4dst254.py
traffic_profiles/trex/trex-sl-3n-dot1qip4-vlan1ip4src254ip4dst254.py
traffic_profiles/trex/trex-sl-3n-dot1qip4-vlan1kip4src254ip4dst254.py
traffic_profiles/trex/trex-sl-3n-ethip4-ip4dst1.py
traffic_profiles/trex/trex-sl-3n-ethip4-ip4dst100.py
traffic_profiles/trex/trex-sl-3n-ethip4-ip4dst1000.py
traffic_profiles/trex/trex-sl-3n-ethip4-ip4dst10000.py
traffic_profiles/trex/trex-sl-3n-ethip4-ip4dst100000.py
traffic_profiles/trex/trex-sl-3n-ethip4-ip4dst1000000.py
traffic_profiles/trex/trex-sl-3n-ethip4-ip4dst20000.py
traffic_profiles/trex/trex-sl-3n-ethip4-ip4dst253.py
traffic_profiles/trex/trex-sl-3n-ethip4-ip4dst253_l3fwd.py
traffic_profiles/trex/trex-sl-3n-ethip4-ip4dst4.py
traffic_profiles/trex/trex-sl-3n-ethip4-ip4dst40.py
traffic_profiles/trex/trex-sl-3n-ethip4-ip4dst400.py
traffic_profiles/trex/trex-sl-3n-ethip4-ip4src253.py
traffic_profiles/trex/trex-sl-3n-ethip4-ip4src254.py
traffic_profiles/trex/trex-sl-3n-ethip4-macsrc100ip4src100.py
traffic_profiles/trex/trex-sl-3n-ethip4-macsrc100kip4src100k.py
traffic_profiles/trex/trex-sl-3n-ethip4-macsrc10kip4src10k.py
traffic_profiles/trex/trex-sl-3n-ethip4-macsrc500kdst500k.py
traffic_profiles/trex/trex-sl-3n-ethip4-macsrc50kdst50k.py
traffic_profiles/trex/trex-sl-3n-ethip4-macsrc5kdst5k.py
traffic_profiles/trex/trex-sl-3n-ethip4udp-1000u15p.py
traffic_profiles/trex/trex-sl-3n-ethip4udp-100u1000p-conc.py
traffic_profiles/trex/trex-sl-3n-ethip4udp-100u15p.py
traffic_profiles/trex/trex-sl-3n-ethip4udp-10u1000p-conc.py
traffic_profiles/trex/trex-sl-3n-ethip4udp-10u10p-conc.py
traffic_profiles/trex/trex-sl-3n-ethip4udp-10u15p.py
traffic_profiles/trex/trex-sl-3n-ethip4udp-1u15p.py
traffic_profiles/trex/trex-sl-3n-ethip4udp-1u1p.py
traffic_profiles/trex/trex-sl-3n-ethip4udp-2000u15p.py
traffic_profiles/trex/trex-sl-3n-ethip4udp-4000u15p.py
traffic_profiles/trex/trex-sl-3n-ethip6-ip6dst10000.py
traffic_profiles/trex/trex-sl-3n-ethip6-ip6dst100000.py
traffic_profiles/trex/trex-sl-3n-ethip6-ip6dst1000000.py
traffic_profiles/trex/trex-sl-3n-ethip6-ip6src253.py
traffic_profiles/trex/trex-sl-dot1qip4-vlan1ip4src254ip4dst254-bvi.py
traffic_profiles/trex/trex-sl-dot1qip4-vlan1ip4src254ip4dst254.py
traffic_profiles/trex/trex-sl-dot1qip4vxlan-ip4src10udpsrcrnd.py
traffic_profiles/trex/trex-sl-dot1qip4vxlan-ip4src1udpsrcrnd.py
traffic_profiles/trex/trex-sl-dot1qip4vxlan-ip4src2udpsrcrnd.py
traffic_profiles/trex/trex-sl-dot1qip4vxlan-ip4src4udpsrcrnd.py
traffic_profiles/trex/trex-sl-dot1qip4vxlan-ip4src6udpsrcrnd.py
traffic_profiles/trex/trex-sl-dot1qip4vxlan-ip4src8udpsrcrnd.py
traffic_profiles/trex/trex-sl-ethip4vxlan-ip4src1udpsrcrnd.py
97dbe2fe 28-Jan-2020 Peter Mikus <pmikus@cisco.com>

FIX: dot1qip4vxlan tests

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Ieb6e6010108987f99f55730149e3e4b7f1a7fc21

a4882cb1 28-Jan-2020 Tibor Frank <tifrank@cisco.com>

Report: Add RC2 data

Change-Id: I29dc3e34293d8bcc940e2adc3034e32b3806c71c
Signed-off-by: Tibor Frank <tifrank@cisco.com>

6716e51e 27-Jan-2020 Tibor Frank <tifrank@cisco.com>

PAL: Add latency by percentile graph

Change-Id: I38c03e089fd709afc848ecec55474d5c6925a58e
Signed-off-by: Tibor Frank <tifrank@cisco.com>

f7452e82 27-Jan-2020 Vratko Polak <vrpolak@cisco.com>

Increase min_rate for NDRPDR tests

Latency measurements break for loads less than 9 kpps per direction.
Setting min_rate to 90 kpps prevents 10% latency trial from breaking.
90 kpps should be enough for any type of test.

When some test finds a lower value, this patch will make the fail
with a message saying the loss rate at minimal load is too high
(instead of a cryptic error from 10% measurement without this patch).

Change-Id: I97b8428aa5044da23343b86447857b3a101f6baa
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

cdb023e3 27-Jan-2020 Tibor Frank <tifrank@cisco.com>

Report: Add RC1 data

Change-Id: I3d6d9c56456a12435096f7c61f744519279a850b
Signed-off-by: Tibor Frank <tifrank@cisco.com>

9afeffb3 27-Jan-2020 Tibor Frank <tifrank@cisco.com>

Report: Add RC1 data

Change-Id: I7ebbabd1f56b892b6f88a6a183632cb11fc2bc3c
Signed-off-by: Tibor Frank <tifrank@cisco.com>

f7699715 27-Jan-2020 Vratko Polak <vrpolak@cisco.com>

Restore PDR stat run for NDRPDR

Before [0], the NDRPDR test ended with two measurements
that perform runtime stats collection, each 2 seconds long.
[0] then decreased that duration to one second,
and removed the PDR measurement.

This change re-adds the PDR measurement,
while keeping the duration at 1 second.

[0] https://gerrit.fd.io/r/c/csit/+/24427

Change-Id: I76828f11863a9e278cdd0cf60f2792d5b614ce43
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

2221396d 27-Jan-2020 Tibor Frank <tifrank@cisco.com>

Report: Add RC1 data

Change-Id: I7ab49f6a910b9273b78e89096e06761ff7537ec9
Signed-off-by: Tibor Frank <tifrank@cisco.com>

eb2723bb 24-Jan-2020 Peter Mikus <pmikus@cisco.com>

Attempt to fix journalctl

- AWK
- ECHO
- pipe
+ Much simpler

Change-Id: I4876f4eae68c96571dc38fd21e53ba269f5f888e
Signed-off-by: Peter Mikus <pmikus@cisco.com>

f31b70ee 17-Jan-2020 Jan Gelety <jgelety@cisco.com>

FIX: nfv_density

- use correct osi_layer=L2 (so L2 spoofing check is switched off
in case of avf driver)
- add pci address information to eth interface in topology file
- nfv_density chain_ipsec tests work only with DPDK
in current implementation

Change-Id: I233c6e5634a14581960c7459b87f11fcee8365bd
Signed-off-by: Jan Gelety <jgelety@cisco.com>

6ccc6d68 22-Jan-2020 Peter Mikus <pmikus@cisco.com>

FIX: Various issues

- TrafficProfile
- IPsec jumbo
- TDLK leftover
- Trex scapy server

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I0601ea75ed6e7318c46124fb02e9c61066089791

25a8fe0a 22-Jan-2020 Tibor Frank <tifrank@cisco.com>

Report: Add diagrams for testbeds

- Diagrams for testbeds:
- 3n-dnv
- 3n-tsh
- 2n-clx
- Replace s/Cascadelake/Cascade Lake

Change-Id: I77e7659a0aba4766a28577f940b7e44e60cbd82d
Signed-off-by: Tibor Frank <tifrank@cisco.com>

774d8a34 20-Jan-2020 Vratko Polak <vrpolak@cisco.com>

Generate tests in deterministic order

Change-Id: I47e45f395976fd65a8da0e93bc33588cc213c79e
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

8aa83d92 21-Jan-2020 haiyanx1.zhang <haiyanx1.zhang@intel.com>

fix loadbalancer running error(Caused by code upgrades)

Signed-off-by: haiyanx1.zhang <haiyanx1.zhang@intel.com>
Change-Id: I39bd1d9ad59971bb8cba6e664ba5509abba6a527

654bfa4c 21-Jan-2020 Tibor Frank <tifrank@cisco.com>

PAL: Process HDRH Latency

Change-Id: Ifc48869ccb6c05f4b5af6cd97e05f009c7632dc7
Signed-off-by: Tibor Frank <tifrank@cisco.com>

8840972e 20-Jan-2020 Vratko Polak <vrpolak@cisco.com>

Ndrpdr: Add latency trials for smaller loads

Change-Id: I46bd4b58bdd02a3deed38c158214e1e9977dde05
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

b693dede 19-Jan-2020 Yulong Pei <yulong.pei@intel.com>

reduce test cases for 2n-dnv and 3n-dnv mrr daily test

since dnv platform is to use by low end market product, no need care
more about too much flows performance test.

Change-Id: Id7204b0353cbf968e641f14ed980f01af75971b2
Signed-off-by: Yulong Pei <yulong.pei@intel.com>

2b3a18b0 19-Dec-2019 Peter Mikus <pmikus@cisco.com>

FIX: Hugepages should be detected also from overcommit

Change-Id: I36ec9d61f775791ad0632a579c4921889d1f5acf
Signed-off-by: Peter Mikus <pmikus@cisco.com>

87f81f12 20-Jan-2020 Tibor Frank <tifrank@cisco.com>

revert "Report: Remove 'avf' from TC name in plots"

Change-Id: I9b10b8f2f84daad543ac9b84671753785dfb23ad
Signed-off-by: Tibor Frank <tifrank@cisco.com>

6518c73a 08-Jan-2020 Dave Wallace <dwallacelf@gmail.com>

perf: add TCP Iperf3+LDPRELOAD test suite

Change-Id: Icff49fb31cce342a2a4ae799e844ec91f9e5e366
Signed-off-by: Dave Wallace <dwallacelf@gmail.com>

ac33ed37 17-Jan-2020 Vratko Polak <vrpolak@cisco.com>

Fix unreservation

It got broken by the previous reservation fix.

Change-Id: I5d9091b7fa4fcc37148c0223fe8eb83f7e5b6770
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

c26ab619 17-Jan-2020 Tibor Frank <tifrank@cisco.com>

Report: Remove 'avf' from TC name in plots

Change-Id: Ie1d04347de123032a5d424747d216f90022bc813
Signed-off-by: Tibor Frank <tifrank@cisco.com>

8b64d3f9 16-Jan-2020 Jan Gelety <jgelety@cisco.com>

FIX: remove 4drc nfv_density chain ipsec tests from 3n-hsw daily job

- not enough cpu cores reported

Change-Id: If3ddbbf4f5af741f328c45ac6b8c874e61d348ab
Signed-off-by: Jan Gelety <jgelety@cisco.com>

9159c81f 16-Jan-2020 Jan Gelety <jgelety@cisco.com>

FIX: missing write of mac_dst for direction 0 --> 1 in cnf trex profiles

Change-Id: I3acf5220c24f77bc4bfc451919bf9b5345a988ef
Signed-off-by: Jan Gelety <jgelety@cisco.com>


traffic_profiles/trex/trex-sl-3n-ethip4-ip4dst1000-1cnf.py
traffic_profiles/trex/trex-sl-3n-ethip4-ip4dst1000-2cnf.py
traffic_profiles/trex/trex-sl-3n-ethip4-ip4dst1000-4cnf.py
traffic_profiles/trex/trex-sl-3n-ethip4-ip4dst1000-8cnf.py
traffic_profiles/trex/trex-sl-3n-ethip4-ip4dst10000-2cnf.py
traffic_profiles/trex/trex-sl-3n-ethip4-ip4dst10000-4cnf.py
traffic_profiles/trex/trex-sl-3n-ethip4-ip4dst10000-8cnf.py
traffic_profiles/trex/trex-sl-3n-ethip4-ip4dst20000-1cnf.py
traffic_profiles/trex/trex-sl-3n-ethip4-ip4dst20000-2cnf.py
traffic_profiles/trex/trex-sl-3n-ethip4-ip4dst20000-4cnf.py
traffic_profiles/trex/trex-sl-3n-ethip4-ip4dst20000-8cnf.py
traffic_profiles/trex/trex-sl-3n-ethip4-ip4dst4-1cnf.py
traffic_profiles/trex/trex-sl-3n-ethip4-ip4dst4-2cnf.py
traffic_profiles/trex/trex-sl-3n-ethip4-ip4dst4-4cnf.py
traffic_profiles/trex/trex-sl-3n-ethip4-ip4dst40-1cnf.py
traffic_profiles/trex/trex-sl-3n-ethip4-ip4dst40-2cnf.py
traffic_profiles/trex/trex-sl-3n-ethip4-ip4dst40-4cnf.py
traffic_profiles/trex/trex-sl-3n-ethip4-ip4dst40-8cnf.py
traffic_profiles/trex/trex-sl-3n-ethip4-ip4dst400-1cnf.py
traffic_profiles/trex/trex-sl-3n-ethip4-ip4dst400-2cnf.py
traffic_profiles/trex/trex-sl-3n-ethip4-ip4dst400-4cnf.py
traffic_profiles/trex/trex-sl-3n-ethip4-ip4dst400-8cnf.py
traffic_profiles/trex/trex-sl-3n-ethip4-ip4dst40000-1cnf.py
traffic_profiles/trex/trex-sl-3n-ethip4-ip4dst40000-2cnf.py
traffic_profiles/trex/trex-sl-3n-ethip4-ip4dst40000-4cnf.py
traffic_profiles/trex/trex-sl-3n-ethip4-ip4dst40000-8cnf.py
traffic_profiles/trex/trex-sl-3n-ethip4-ip4dst5000-1cnf.py
traffic_profiles/trex/trex-sl-3n-ethip4-ip4dst5000-2cnf.py
traffic_profiles/trex/trex-sl-3n-ethip4-ip4dst5000-4cnf.py
traffic_profiles/trex/trex-sl-3n-ethip4-ip4dst5000-8cnf.py
traffic_profiles/trex/trex-sl-3n-ethip4-ip4dst60000-1cnf.py
traffic_profiles/trex/trex-sl-3n-ethip4-ip4dst60000-2cnf.py
traffic_profiles/trex/trex-sl-3n-ethip4-ip4dst60000-4cnf.py
traffic_profiles/trex/trex-sl-3n-ethip4-ip4dst60000-8cnf.py
1b9d4210 16-Jan-2020 Vratko Polak <vrpolak@cisco.com>

Fix reservation if connect fails

Change-Id: I136cc51cbd5a01451e04a39c5d8e5554d6d39305
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

e864945d 17-Jan-2020 Tibor Frank <tifrank@cisco.com>

Report: Prepare data sets

Change-Id: Ice90ffe8563d6283050f2b229fc5e50ab64ac253
Signed-off-by: Tibor Frank <tifrank@cisco.com>

633e1f40 16-Jan-2020 Jan Gelety <jgelety@cisco.com>

FIX: L2XC with vhost and VLAN

Change-Id: Ia87abadba431099eeacd8b50ce5d116597a1f393
Signed-off-by: Jan Gelety <jgelety@cisco.com>

f7519a18 14-Jan-2020 Balaji Venkatraman <balajiv@cisco.com>

Python3: Migration of files under traffic-profiles/trex

Change-Id: Iae16225d3d3daa4e1e9b177228fb89efe4aa5405
Signed-off-by: Balaji Venkatraman <balajiv@cisco.com>


traffic_profiles/trex/profile_trex_stateless_base_class.py
traffic_profiles/trex/trex-sl-2n-dot1qip4asym-ip4src254.py
traffic_profiles/trex/trex-sl-2n-dot1qip6asym-ip6src253.py
traffic_profiles/trex/trex-sl-2n-ethip4-ip4dst-rnd10000.py
traffic_profiles/trex/trex-sl-2n-ethip4-ip4dst-rnd100000.py
traffic_profiles/trex/trex-sl-2n-ethip4-ip4dst-rnd1000000.py
traffic_profiles/trex/trex-sl-2n-ethip4-ip4dst10000.py
traffic_profiles/trex/trex-sl-2n-ethip4-ip4dst100000.py
traffic_profiles/trex/trex-sl-2n-ethip4-ip4dst1000000.py
traffic_profiles/trex/trex-sl-2n-ethip4-ip4src253.py
traffic_profiles/trex/trex-sl-2n-ethip4-ip4src254.py
traffic_profiles/trex/trex-sl-2n-ethip4-macsrc500kdst500k.py
traffic_profiles/trex/trex-sl-2n-ethip4-macsrc50kdst50k.py
traffic_profiles/trex/trex-sl-2n-ethip4-macsrc5kdst5k.py
traffic_profiles/trex/trex-sl-2n-ethip4udp-1000u15p.py
traffic_profiles/trex/trex-sl-2n-ethip4udp-10u1000p-conc.py
traffic_profiles/trex/trex-sl-2n-ethip4udp-1u1p.py
traffic_profiles/trex/trex-sl-2n-ethip4udp-lb.py
traffic_profiles/trex/trex-sl-2n-ethip6-ip6dst10000.py
traffic_profiles/trex/trex-sl-2n-ethip6-ip6dst100000.py
traffic_profiles/trex/trex-sl-2n-ethip6-ip6dst1000000.py
traffic_profiles/trex/trex-sl-2n-ethip6-ip6src253.py
traffic_profiles/trex/trex-sl-2n3n-ethip4-ip4src254-10c1n.py
traffic_profiles/trex/trex-sl-2n3n-ethip4-ip4src254-10c2n.py
traffic_profiles/trex/trex-sl-2n3n-ethip4-ip4src254-1c10n.py
traffic_profiles/trex/trex-sl-2n3n-ethip4-ip4src254-1c1n.py
traffic_profiles/trex/trex-sl-2n3n-ethip4-ip4src254-1c2n.py
traffic_profiles/trex/trex-sl-2n3n-ethip4-ip4src254-1c4n.py
traffic_profiles/trex/trex-sl-2n3n-ethip4-ip4src254-1c6n.py
traffic_profiles/trex/trex-sl-2n3n-ethip4-ip4src254-1c8n.py
traffic_profiles/trex/trex-sl-2n3n-ethip4-ip4src254-2c10n.py
traffic_profiles/trex/trex-sl-2n3n-ethip4-ip4src254-2c1n.py
traffic_profiles/trex/trex-sl-2n3n-ethip4-ip4src254-2c2n.py
traffic_profiles/trex/trex-sl-2n3n-ethip4-ip4src254-2c4n.py
traffic_profiles/trex/trex-sl-2n3n-ethip4-ip4src254-2c6n.py
traffic_profiles/trex/trex-sl-2n3n-ethip4-ip4src254-2c8n.py
traffic_profiles/trex/trex-sl-2n3n-ethip4-ip4src254-4c1n.py
traffic_profiles/trex/trex-sl-2n3n-ethip4-ip4src254-4c2n.py
traffic_profiles/trex/trex-sl-2n3n-ethip4-ip4src254-4c4n.py
traffic_profiles/trex/trex-sl-2n3n-ethip4-ip4src254-4c6n.py
traffic_profiles/trex/trex-sl-2n3n-ethip4-ip4src254-6c1n.py
traffic_profiles/trex/trex-sl-2n3n-ethip4-ip4src254-6c2n.py
traffic_profiles/trex/trex-sl-2n3n-ethip4-ip4src254-6c4n.py
traffic_profiles/trex/trex-sl-2n3n-ethip4-ip4src254-8c1n.py
traffic_profiles/trex/trex-sl-2n3n-ethip4-ip4src254-8c2n.py
traffic_profiles/trex/trex-sl-3n-dot1qip4-vlan100ip4src254ip4dst254.py
traffic_profiles/trex/trex-sl-3n-dot1qip4-vlan10ip4src254ip4dst254.py
traffic_profiles/trex/trex-sl-3n-dot1qip4-vlan1ip4src254ip4dst254.py
traffic_profiles/trex/trex-sl-3n-dot1qip4-vlan1kip4src254ip4dst254.py
traffic_profiles/trex/trex-sl-3n-ethip4-ip4dst1.py
traffic_profiles/trex/trex-sl-3n-ethip4-ip4dst100.py
traffic_profiles/trex/trex-sl-3n-ethip4-ip4dst1000-1cnf.py
traffic_profiles/trex/trex-sl-3n-ethip4-ip4dst1000-2cnf.py
traffic_profiles/trex/trex-sl-3n-ethip4-ip4dst1000-4cnf.py
traffic_profiles/trex/trex-sl-3n-ethip4-ip4dst1000-8cnf.py
traffic_profiles/trex/trex-sl-3n-ethip4-ip4dst1000.py
traffic_profiles/trex/trex-sl-3n-ethip4-ip4dst10000-1cnf.py
traffic_profiles/trex/trex-sl-3n-ethip4-ip4dst10000-2cnf.py
traffic_profiles/trex/trex-sl-3n-ethip4-ip4dst10000-4cnf.py
traffic_profiles/trex/trex-sl-3n-ethip4-ip4dst10000-8cnf.py
traffic_profiles/trex/trex-sl-3n-ethip4-ip4dst10000.py
traffic_profiles/trex/trex-sl-3n-ethip4-ip4dst100000.py
traffic_profiles/trex/trex-sl-3n-ethip4-ip4dst1000000.py
traffic_profiles/trex/trex-sl-3n-ethip4-ip4dst20000-1cnf.py
traffic_profiles/trex/trex-sl-3n-ethip4-ip4dst20000-2cnf.py
traffic_profiles/trex/trex-sl-3n-ethip4-ip4dst20000-4cnf.py
traffic_profiles/trex/trex-sl-3n-ethip4-ip4dst20000-8cnf.py
traffic_profiles/trex/trex-sl-3n-ethip4-ip4dst20000.py
traffic_profiles/trex/trex-sl-3n-ethip4-ip4dst253.py
traffic_profiles/trex/trex-sl-3n-ethip4-ip4dst253_l3fwd.py
traffic_profiles/trex/trex-sl-3n-ethip4-ip4dst4-1cnf.py
traffic_profiles/trex/trex-sl-3n-ethip4-ip4dst4-2cnf.py
traffic_profiles/trex/trex-sl-3n-ethip4-ip4dst4-4cnf.py
traffic_profiles/trex/trex-sl-3n-ethip4-ip4dst4.py
traffic_profiles/trex/trex-sl-3n-ethip4-ip4dst40-1cnf.py
traffic_profiles/trex/trex-sl-3n-ethip4-ip4dst40-2cnf.py
traffic_profiles/trex/trex-sl-3n-ethip4-ip4dst40-4cnf.py
traffic_profiles/trex/trex-sl-3n-ethip4-ip4dst40-8cnf.py
traffic_profiles/trex/trex-sl-3n-ethip4-ip4dst40.py
traffic_profiles/trex/trex-sl-3n-ethip4-ip4dst400-1cnf.py
traffic_profiles/trex/trex-sl-3n-ethip4-ip4dst400-2cnf.py
traffic_profiles/trex/trex-sl-3n-ethip4-ip4dst400-4cnf.py
traffic_profiles/trex/trex-sl-3n-ethip4-ip4dst400-8cnf.py
traffic_profiles/trex/trex-sl-3n-ethip4-ip4dst400.py
traffic_profiles/trex/trex-sl-3n-ethip4-ip4dst40000-1cnf.py
traffic_profiles/trex/trex-sl-3n-ethip4-ip4dst40000-2cnf.py
traffic_profiles/trex/trex-sl-3n-ethip4-ip4dst40000-4cnf.py
traffic_profiles/trex/trex-sl-3n-ethip4-ip4dst40000-8cnf.py
traffic_profiles/trex/trex-sl-3n-ethip4-ip4dst40000.py
traffic_profiles/trex/trex-sl-3n-ethip4-ip4dst5000-1cnf.py
traffic_profiles/trex/trex-sl-3n-ethip4-ip4dst5000-2cnf.py
traffic_profiles/trex/trex-sl-3n-ethip4-ip4dst5000-4cnf.py
traffic_profiles/trex/trex-sl-3n-ethip4-ip4dst5000-8cnf.py
traffic_profiles/trex/trex-sl-3n-ethip4-ip4dst5000.py
traffic_profiles/trex/trex-sl-3n-ethip4-ip4dst60000-1cnf.py
traffic_profiles/trex/trex-sl-3n-ethip4-ip4dst60000-2cnf.py
traffic_profiles/trex/trex-sl-3n-ethip4-ip4dst60000-4cnf.py
traffic_profiles/trex/trex-sl-3n-ethip4-ip4dst60000-8cnf.py
traffic_profiles/trex/trex-sl-3n-ethip4-ip4dst60000.py
traffic_profiles/trex/trex-sl-3n-ethip4-ip4src253.py
traffic_profiles/trex/trex-sl-3n-ethip4-ip4src254.py
traffic_profiles/trex/trex-sl-3n-ethip4-macsrc100ip4src100.py
traffic_profiles/trex/trex-sl-3n-ethip4-macsrc100kip4src100k.py
traffic_profiles/trex/trex-sl-3n-ethip4-macsrc10kip4src10k.py
traffic_profiles/trex/trex-sl-3n-ethip4-macsrc500kdst500k.py
traffic_profiles/trex/trex-sl-3n-ethip4-macsrc50kdst50k.py
traffic_profiles/trex/trex-sl-3n-ethip4-macsrc5kdst5k.py
traffic_profiles/trex/trex-sl-3n-ethip4udp-1000u15p.py
traffic_profiles/trex/trex-sl-3n-ethip4udp-100u1000p-conc.py
traffic_profiles/trex/trex-sl-3n-ethip4udp-100u15p.py
traffic_profiles/trex/trex-sl-3n-ethip4udp-10u1000p-conc.py
traffic_profiles/trex/trex-sl-3n-ethip4udp-10u10p-conc.py
traffic_profiles/trex/trex-sl-3n-ethip4udp-10u15p.py
traffic_profiles/trex/trex-sl-3n-ethip4udp-1u15p.py
traffic_profiles/trex/trex-sl-3n-ethip4udp-1u1p.py
traffic_profiles/trex/trex-sl-3n-ethip4udp-2000u15p.py
traffic_profiles/trex/trex-sl-3n-ethip4udp-4000u15p.py
traffic_profiles/trex/trex-sl-3n-ethip6-ip6dst10000.py
traffic_profiles/trex/trex-sl-3n-ethip6-ip6dst100000.py
traffic_profiles/trex/trex-sl-3n-ethip6-ip6dst1000000.py
traffic_profiles/trex/trex-sl-3n-ethip6-ip6src253.py
traffic_profiles/trex/trex-sl-dot1qip4-vlan1ip4src254ip4dst254-bvi.py
traffic_profiles/trex/trex-sl-dot1qip4-vlan1ip4src254ip4dst254.py
traffic_profiles/trex/trex-sl-dot1qip4vxlan-ip4src10udpsrcrnd.py
traffic_profiles/trex/trex-sl-dot1qip4vxlan-ip4src1udpsrcrnd.py
traffic_profiles/trex/trex-sl-dot1qip4vxlan-ip4src2udpsrcrnd.py
traffic_profiles/trex/trex-sl-dot1qip4vxlan-ip4src4udpsrcrnd.py
traffic_profiles/trex/trex-sl-dot1qip4vxlan-ip4src6udpsrcrnd.py
traffic_profiles/trex/trex-sl-dot1qip4vxlan-ip4src8udpsrcrnd.py
traffic_profiles/trex/trex-sl-ethip4vxlan-ip4src1udpsrcrnd.py
e8e433bc 16-Jan-2020 Tibor Frank <tifrank@cisco.com>

Report: Latency by Percentile Distribution

- legend

Change-Id: I35477ce5c2cabfdcef68424854a8574bd3655e55
Signed-off-by: Tibor Frank <tifrank@cisco.com>

b4115689 16-Jan-2020 Tibor Frank <tifrank@cisco.com>

Report: Latency by Percentile Distribution

- Set X-axis

Change-Id: Ica300c7b1352c824bf51ac26e7485c9295ac60dc
Signed-off-by: Tibor Frank <tifrank@cisco.com>

290139a6 15-Jan-2020 Tibor Frank <tifrank@cisco.com>

Report: Latency by Percentile Distribution

- Set the position of the Lagend

Change-Id: I1bcea6002bd8beeba3300c9976d1603a234c3c14
Signed-off-by: Tibor Frank <tifrank@cisco.com>

af940b46 15-Jan-2020 Tibor Frank <tifrank@cisco.com>

Report: Add Latency by Percentile Distribution

Change-Id: I5291db8117da611497e910aa7cd2fbb2276bfe65
Signed-off-by: Tibor Frank <tifrank@cisco.com>

39c81e36 15-Jan-2020 Peter Mikus <pmikus@cisco.com>

Ansible: Increase TG hugepages

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Ifa87e372ed45f6dfc883723acbb325e34fb814a8


tools/testbed-setup/ansible/inventories/lf_inventory/host_vars/10.30.51.16.yaml
tools/testbed-setup/ansible/inventories/lf_inventory/host_vars/10.30.51.20.yaml
tools/testbed-setup/ansible/inventories/lf_inventory/host_vars/10.30.51.24.yaml
tools/testbed-setup/ansible/inventories/lf_inventory/host_vars/10.30.51.28.yaml
tools/testbed-setup/ansible/inventories/lf_inventory/host_vars/10.30.51.29.yaml
tools/testbed-setup/ansible/inventories/lf_inventory/host_vars/10.30.51.30.yaml
tools/testbed-setup/ansible/inventories/lf_inventory/host_vars/10.30.51.45.yaml
tools/testbed-setup/ansible/inventories/lf_inventory/host_vars/10.30.51.48.yaml
tools/testbed-setup/ansible/inventories/lf_inventory/host_vars/10.30.51.49.yaml
tools/testbed-setup/ansible/inventories/lf_inventory/host_vars/10.30.51.53.yaml
tools/testbed-setup/ansible/inventories/lf_inventory/host_vars/10.30.51.55.yaml
tools/testbed-setup/ansible/inventories/lf_inventory/host_vars/10.30.51.57.yaml
tools/testbed-setup/ansible/inventories/lf_inventory/host_vars/10.30.51.60.yaml
tools/testbed-setup/ansible/inventories/lf_inventory/host_vars/10.32.8.10.yaml
tools/testbed-setup/ansible/inventories/lf_inventory/host_vars/10.32.8.11.yaml
tools/testbed-setup/ansible/inventories/lf_inventory/host_vars/10.32.8.12.yaml
tools/testbed-setup/ansible/inventories/lf_inventory/host_vars/10.32.8.13.yaml
tools/testbed-setup/ansible/inventories/lf_inventory/host_vars/10.32.8.19.yaml
tools/testbed-setup/ansible/inventories/lf_inventory/host_vars/10.32.8.21.yaml
tools/testbed-setup/ansible/inventories/lf_inventory/host_vars/10.32.8.23.yaml
30be9d16 22-Nov-2019 Vratko Polak <vrpolak@cisco.com>

Remove everything related to TLDK

- Leftovers from kubernetes found, but not removed here.

Change-Id: If8cb9269d0f3e69f642d7fe02c59122e17925a4d
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

cf9fbdf9 13-Dec-2019 Jan Gelety <jgelety@cisco.com>

Trending: new daily set

New daily sets are prepared based on information in
https://gerrit.fd.io/r/c/csit/+/24073/1/docs/job_specs/perf_tests_job_specs.md
and previous test set definitions in
docs/job_specs/test_select_list_[2n|3n]_[clx|skx|hsw|tsh|dnv].md
files.

- mrr-daily-2n-clx: 510 TCs (incl. nfv_density), expected exec. time 8:50h
- mrr-daily-2n-skx: 525 TCs (incl. nfv_density), expected exec. time 7:55h
- mrr-daily-3n-skx: 393 TCs (incl. nfv_density), expected exec. time 11:00h
- mrr-daily-3n-hsw: 177 TCs (incl. nfv_density), expected exec. time 7:10h
- mrr-daily-3n-tsh: 204 TCs, expected exec. time 21:00h
- mrr-daily-2n-dnv: 84 TCs, expected exec. time 2:25h
- mrr-daily-3n-dnv: 144 TCs, expected exec. time 6:35h

+ add some missing test suites
+ add trex-sl-2n-ethip4udp-1000u15p.py T-Rex traffic profile
+ correction of TS and TC names and tags in directory
tests/vpp/perf/nfv_density/chain_ipsec

Change-Id: Icfc86e9af97ed8dd8ccd2a34355c99aad69a28c0
Signed-off-by: Jan Gelety <jgelety@cisco.com>

e916ab4d 02-Jan-2020 Vratko Polak <vrpolak@cisco.com>

Support suite tags in autogen

+ Include a script to add suite tags to many suites at once.
+ Add suite tags also to device tests (not covered by autogen).

Change-Id: I514ee6178e22999b43460028fe2696738b012f04
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

b55e324d 03-Jan-2020 Vratko Polak <vrpolak@cisco.com>

Autogen: Generate also NIC drivers.

+ Disallowed -avf- (or -rdma-) as "template" suites.
+ GBP suite switched to DPDK driver in repo.
+ Each NIC has its own list of supported drivers, in Constants.
+ Updated tag expressions for daily jobs:
+ Feature, ipsec, memif, scale, srv6, tunnels, vhost and vts
are tested only with vfio-pci.
+ Other (base, dot1q, dot1ad) tested with all drivers.
+ Setup actions currently depend on driver, generated.
- The performance_rdma action is trivial for now.
- Several tests fail, to be fixed later, e.g. by performance_rdma.
+ Reconf tests are also supported.
+ Added DRV_VFIO_PCI tags missing, mainly in density tests.
- Vhost suites (density, reconf) are failing, but suites look good.
- TCP suites do not support NIC drivers yet.
- DPDK obviously not supported.
+ Use Python 3 in regenerate scripts.
+ Fix typos binded => bound.
+ File open modes set either u"rt" or u"wt" everywhere.
+ Remove a trailing space in an environment variable name.

Change-Id: I290470675dc5c9e88b2eaa5ab6285ecd9ed7827a
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

5147d3ac 14-Jan-2020 Tibor Frank <tifrank@cisco.com>

Report: Current vs. Previous Release - NFV Tests

Change-Id: I00cbde38b8f900efe3e3123a942de2288381ea3b
Signed-off-by: Tibor Frank <tifrank@cisco.com>

2da2aa12 20-Dec-2019 Dave Wallace <dwallacelf@gmail.com>

Hoststack perf infrastructure refactoring

- DUT only topology (hoststack test
apps are co-located with vpp)
- Make vpp app specific keywords generic
where applicable
- Add IP4 Prefix to topology file
- Support running wrk in linux namespace
- Refactor namespace cleanup
- Remove redundant namespace creation code
- Refactor test/keyword dirs: tcp -> hoststack
- Add hoststack utility keywords
- Refactor wrk suite setup/teardown
- Update tests with recent perf infra changes

Change-Id: Ia1cf07978d579393eef94923819a87c8c1f36f34
Signed-off-by: Dave Wallace <dwallacelf@gmail.com>

6ae8614c 14-Jan-2020 Peter Mikus <pmikus@cisco.com>

FIX: VXLAN scale

+ Another stupid arp -> neighbor rename

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Ia873d6c2a485659033f71cdf546782db74787d13

0f1b43e0 14-Jan-2020 Peter Mikus <pmikus@cisco.com>

FIX: NF_density tests

+ ARP -> Neighbor

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I74044bd7db6cb4b1bd3648a424e9c8f1473be8d1

627079be 13-Jan-2020 Vratko Polak <vrpolak@cisco.com>

Update comments in crc file.

+ L2patch is already covered.
+ RDMA is not device testable yet.

Change-Id: I1dcccfcb340a8fe61c20d3516340e26db293cfaa
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

f59947a3 13-Jan-2020 Tibor Frank <tifrank@cisco.com>

Report: Add VNF Service Chains Tunnels

Change-Id: Iafdcb543f6adc583567a05aa5a882dce17b58f03
Signed-off-by: Tibor Frank <tifrank@cisco.com>

3aae7cbc 13-Jan-2020 Peter Mikus <pmikus@cisco.com>

FIX: NF_density tests

+ Because arp->neigbor was so important to do.

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I552e175b7555ebf5053d7994c0c9173c0c96fc58

acd72ef6 13-Jan-2020 Tibor Frank <tifrank@cisco.com>

Report: Move VTS tests from 3n to 2n

Change-Id: Ie2faa6cb611d372c4a20584f7b40f3281660f2b1
Signed-off-by: Tibor Frank <tifrank@cisco.com>

b313ae41 09-Jan-2020 Jan Gelety <jgelety@cisco.com>

CSIT-1597 API cleanup: rdma

- cover API changes in VPP: https://gerrit.fd.io/r/c/vpp/+/24225
- update vpp stable to version 20.01-rc0~1011

Change-Id: Ibbfdbe867cf89715619efc5c5507859983025ece
Signed-off-by: Jan Gelety <jgelety@cisco.com>

6c913634 10-Jan-2020 Tibor Frank <tifrank@cisco.com>

Report: Add comparison tables

CSIT-1654

Change-Id: I280195b295d4fc717cb355e78c5f1731bb1eabe5
Signed-off-by: Tibor Frank <tifrank@cisco.com>

80e55855 09-Jan-2020 Tibor Frank <tifrank@cisco.com>

Report: Add 2n-clx

Change-Id: I34dc11c28d21f0b9fed87d76942fe8b8cdd86c88
Signed-off-by: Tibor Frank <tifrank@cisco.com>

a08fc340 09-Jan-2020 Peter Mikus <pmikus@cisco.com>

FIX: Container test

+ We should check if container is UP
+ We should adjust privileges.

Change-Id: I3f604b7b9740943b4fd3b0574c18d2729e88b816
Signed-off-by: Peter Mikus <pmikus@cisco.com>

e0ad9640 09-Jan-2020 Tibor Frank <tifrank@cisco.com>

Report: Configure Report 2001

Change-Id: I5ef3c37cf329b76a1a7f94d60c3563872eef3c5d
Signed-off-by: Tibor Frank <tifrank@cisco.com>

164b36d2 14-Nov-2019 Tibor Frank <tifrank@cisco.com>

DMM: Remove

Change-Id: Ibbfbed79e473c804390802ae1ecd737b50c06aa3
Signed-off-by: Tibor Frank <tifrank@cisco.com>

468680a7 08-Jan-2020 Jan Gelety <jgelety@cisco.com>

API: Add collection for 24225/3

Change-Id: I5c4593d05dbcb4d918611dc7520432a446dbf664
Signed-off-by: Jan Gelety <jgelety@cisco.com>

ff7edf01 08-Jan-2020 Tibor Frank <tifrank@cisco.com>

PAL: Set y-axis for HDRHistogram

Change-Id: Ibdee625d6d9215b18771a6348735dc6a07e9ae58
Signed-off-by: Tibor Frank <tifrank@cisco.com>

919fdbd0 08-Jan-2020 Vratko Polak <vrpolak@cisco.com>

Track real(er) duration of traffic

+ Print duration.
- Missing: Parse duration.
- We do not have good formula to compensate, yet.

Change-Id: I1c76ac35ce531b1994480d6aa0638f16992231f5
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

45b4d916 10-Dec-2019 Peter Mikus <pmikus@cisco.com>

T-Rex: Upgrade to 2.73 with DDP profile fix

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Icaa99e0a71a19ba23697c21a4b5aa046813a718a

ae652334 02-Jan-2020 Peter Mikus <pmikus@cisco.com>

Vhost: Add GSO option

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Iba9af71c293645b480203af72fcf940cbe9ccb3a

3a001f6b 07-Jan-2020 Vratko Polak <vrpolak@cisco.com>

Fix Trex start configuration

Since https://gerrit.fd.io/r/c/csit/+/24056
csit-vpp perf tests are failing.

Turns out the reason is too large limit_memory value,
but other improvements applied during investigation
are included as well.

+ Cat trex.log if trex fails to start.
+ Improve trex startup command formatting (remove double spaces).
+ Reorder imports.

Change-Id: I2c1106ea6f88a1a275682e73eba212d08c7947c8
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

aa5f30a2 06-Jan-2020 Vratko Polak <vrpolak@cisco.com>

Remove leftovers related to Xenial

+ File VPP_STABLE_VER_UBUNTU.
+ Subtree docs/report/vpp_functional_tests/.

Change-Id: Ifd9dd922152199de9f1352da709b1533d6c15aba
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

4a315594 07-Jan-2020 Tibor Frank <tifrank@cisco.com>

Remove VIRL Func tests from Report

Change-Id: Ic6edf1f6f6c12d8e76da76617dbf1c4e8e1e2952
Signed-off-by: Tibor Frank <tifrank@cisco.com>

3cf89917 07-Jan-2020 Tibor Frank <tifrank@cisco.com>

Trending: Move VTS tests from 3n to 2n

Change-Id: I420cef699d42973602f1290ccd0cc5e378d42492
Signed-off-by: Tibor Frank <tifrank@cisco.com>

325bc9b1 02-Jan-2020 Peter Mikus <pmikus@cisco.com>

Add new NIC limits

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I2b1a0d1455ae74a2ad4fdb553286aef5942f2a99

efcdd3ea 18-Dec-2019 Peter Mikus <pmikus@cisco.com>

TREX: Ability to configure from outside TrafficGenerator.py

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Ia9832e5e65dbcf2d4f99c52fd0570d456262ab9a

13d39ef2 11-Dec-2019 Peter Mikus <pmikus@cisco.com>

VTS: Unify the tests

- Converting to 2n as they were always 2n (with l2xc on 3rd node)
- Removing KW and converting to layered approach

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Ie349c50f72eb362815e7c5ede076d421ab386e76

14fdc4a1 16-Dec-2019 Dave Wallace <dwallacelf@gmail.com>

Add VPP NSIM Plugin Keywords

Change-Id: I1e080a50a68ded8eebc5e6093c55d06281726684
Signed-off-by: Dave Wallace <dwallacelf@gmail.com>

e0f0c32f 18-Dec-2019 Dave Wallace <dwallacelf@gmail.com>

python3: fix RF 'only continuation marker' warning

Change-Id: I250ffd196045bc623d5d38f30f16a08bcaea137c
Signed-off-by: Dave Wallace <dwallacelf@gmail.com>

27b99c23 18-Dec-2019 Tibor Frank <tifrank@cisco.com>

Trending: Fix input data processing

Change-Id: I79cecd07c933cc46beb09de1ee2b4a0db5dd8a79
Signed-off-by: Tibor Frank <tifrank@cisco.com>

3ff919f8 19-Nov-2019 Peter Mikus <pmikus@cisco.com>

Telemetry: Add more operational data

+ Add both NDR and PDR telemetry capture
+ Speedup sockets
+ Adjust privileges

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Ia6fd5d405e6fb410651d8b705c921653753aea10

20083f2e 13-Dec-2019 Jan Gelety <jgelety@cisco.com>

FIX: eth interfaces need numa_node information in topology file

Change-Id: I9a3c6947da8ab5033e29b39833c97bcdafdc3ca9
Signed-off-by: Jan Gelety <jgelety@cisco.com>

89197627 16-Dec-2019 Vratko Polak <vrpolak@cisco.com>

CTPA: Improve handling pps vs Mpps

+ Jumpavg assumes precision is around 1, so gives wrong classifications
when fed Mpps numbers, and the classification has to be done on pps values.
+ Hover should display Mpps values properly, e.g. as floats.
+ Decided to show 3 digits after decimal point.
+ Better distinguishing between keys and indices.

Change-Id: I99bdad5b401839889463c7cf6f8b0930ec65b457
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

10562990 16-Dec-2019 Dave Wallace <dwallacelf@gmail.com>

python3: fix wrk traffic profile YAML load

Signed-off-by: Dave Wallace <dwallacelf@gmail.com>
Change-Id: I3b7493221f3a0378b7f6cb0b0a21e8f18a0cc937

e8b2b5a9 16-Dec-2019 Peter Mikus <pmikus@cisco.com>

Vagrant: Introduce CentOS8

+ Full ansible compatibility
- Docker currently not working in Centos8 as it was not yet released

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I837091621db6bbebc9fee729496384cabe2f5357

ab5ed16c 16-Dec-2019 Vratko Polak <vrpolak@cisco.com>

Perpatch compare: pylint fixes.

+ Do not execute on import.
+ Replace hack() with sorted().

Change-Id: Ic439a799ab29d42ae21faf70b2aea6dce6e89510
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

0efd50d2 15-Dec-2019 Vratko Polak <vrpolak@cisco.com>

Do not execute crc check on import

Other guilty scripts already have open changes that fix them.

Change-Id: Ife75e999d6d3f3f506b0f5dcdb679ce1f1e6bdbe
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

3111f250 13-Dec-2019 Peter Mikus <pmikus@cisco.com>

FIX PIP requirement packages

+ CSIT will only use packages installed from master
PIP requirement.txt file
+ All CSIT subsequent code must use single function
and PIP list for virtualenv
- Report/PAL/doc/trending will follow in next patch

Change-Id: Ia9150fb05a144182a5a163178d553370ede55cdd
Signed-off-by: Peter Mikus <pmikus@cisco.com>

dee46d5c 13-Dec-2019 Peter Mikus <pmikus@cisco.com>

Remove supervisord dependency from containers

+ Startup config stream-line

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Ia12e48202a5fc88461d3d24ac9b9599e7175b1d8

722aaac1 13-Dec-2019 Vratko Polak <vrpolak@cisco.com>

Reduce spam from device bootstrap

It uses "declare -f" to paste the complete common.sh file. Twice.
The output from ssh remote side still remains visible,
but avoiding the spam should ease scrolling to Robot console output.

Change-Id: I746484ada7650a6dfa6794e76550757af5413a82
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

f9b8be87 12-Dec-2019 Jan Gelety <jgelety@cisco.com>

API: Add collection for 22970/5

Change-Id: If865526d833a267eba85e6ae4107e4d0da0dfd0b
Signed-off-by: Jan Gelety <jgelety@cisco.com>

ab0c87c7 12-Dec-2019 Dave Wallace <dwallacelf@gmail.com>

Python3: refactor ':FOR' statements

Signed-off-by: Dave Wallace <dwallacelf@gmail.com>
Change-Id: I76835e3d3acf6955e328f30427f9dd0098947e41

9d8845d7 12-Dec-2019 Jan Gelety <jgelety@cisco.com>

CSIT-1597, CSIT-1647 API cleanup: gbp

- cover API changes in VPP: https://gerrit.fd.io/r/c/vpp/+/23835
- update vpp stable to version 20.01-rc0~843

Change-Id: Idb1299cbbba578c09542c23858fb1fc55d090f26
Signed-off-by: Jan Gelety <jgelety@cisco.com>

476268f1 12-Dec-2019 Jan Gelety <jgelety@cisco.com>

API: Add collection for 23835/1

- update vpp stable to version 20.01-rc0~841

Change-Id: I05fc3878a606852c8348b61b40d8000411709d33
Signed-off-by: Jan Gelety <jgelety@cisco.com>

5c8fc7fe 01-Dec-2019 Jan Gelety <jgelety@cisco.com>

API: Add collection for 23830/1

- update vpp stable to version 20.01-rc0~839

Change-Id: Ic79bccf7cce384f5058218398bbef16cf1c9d40c
Signed-off-by: Jan Gelety <jgelety@cisco.com>

6f9d853c 01-Dec-2019 Jan Gelety <jgelety@cisco.com>

API: Add collection for 23829/1

Change-Id: I4b2a7bda48fba3050a35966f7a86c8dc7ba62d36
Signed-off-by: Jan Gelety <jgelety@cisco.com>

cef423a9 01-Dec-2019 Jan Gelety <jgelety@cisco.com>

CSIT-1597 API cleanup: vhost

- cover API changes in VPP: https://gerrit.fd.io/r/c/vpp/+/22277
- update vpp stable to version 20.01-rc0~831

Change-Id: Icb3801d6a7bc738cf48bc5ecbb0767f115dde964
Signed-off-by: Jan Gelety <jgelety@cisco.com>

b589630f 01-Dec-2019 Jan Gelety <jgelety@cisco.com>

API: Add collection for 22277/5

Change-Id: Icd82e53ba5836302b036dbe41070d11b2ea4d401
Signed-off-by: Jan Gelety <jgelety@cisco.com>

46224ef4 30-Nov-2019 Jan Gelety <jgelety@cisco.com>

CSIT-1597 API cleanup: tap

- cover API changes in VPP: https://gerrit.fd.io/r/c/vpp/+/21706
- cover API cahnges in VPP: https://gerrit.fd.io/r/c/vpp/+/23887
- update vpp stable to version 20.01-rc0~828

Change-Id: I70d88741a02729421d4b31010910138838811518
Signed-off-by: Jan Gelety <jgelety@cisco.com>

53f3ee86 11-Dec-2019 Peter Mikus <pmikus@cisco.com>

FIX: NF_Density pipeline ip4 profile

- Because they are failing

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I55c51bd3e4673414e5394cc6ba990257574ab002

3d5a75be 17-Jul-2019 Ludovit Mikula <ludovit.mikula@pantheon.tech>

Introduce VPP-IPsec container tests.

Change-Id: Ie64d662e81879bd52785e0188450d998bf056bda
Signed-off-by: Ludovit Mikula <ludovit.mikula@pantheon.tech>


libraries/python/ContainerUtils.py
libraries/python/CoreDumpUtil.py
libraries/python/DUTSetup.py
libraries/python/IPsecUtil.py
libraries/python/Trace.py
libraries/python/VPPUtil.py
libraries/python/VppConfigGenerator.py
libraries/python/VppCounters.py
libraries/python/topology.py
libraries/robot/crypto/ipsec.robot
libraries/robot/shared/container.robot
libraries/robot/shared/default.robot
libraries/robot/shared/interfaces.robot
libraries/robot/shared/test_teardown.robot
templates/container/memif_create_chain_ipsec.exec
templates/container/memif_create_chain_vswitch_ipsec.exec
traffic_profiles/trex/trex-sl-3n-ethip4-ip4dst1000-1cnf.py
traffic_profiles/trex/trex-sl-3n-ethip4-ip4dst1000-2cnf.py
traffic_profiles/trex/trex-sl-3n-ethip4-ip4dst1000-4cnf.py
traffic_profiles/trex/trex-sl-3n-ethip4-ip4dst1000-8cnf.py
traffic_profiles/trex/trex-sl-3n-ethip4-ip4dst10000-1cnf.py
traffic_profiles/trex/trex-sl-3n-ethip4-ip4dst10000-2cnf.py
traffic_profiles/trex/trex-sl-3n-ethip4-ip4dst10000-4cnf.py
traffic_profiles/trex/trex-sl-3n-ethip4-ip4dst10000-8cnf.py
traffic_profiles/trex/trex-sl-3n-ethip4-ip4dst20000-1cnf.py
traffic_profiles/trex/trex-sl-3n-ethip4-ip4dst20000-2cnf.py
traffic_profiles/trex/trex-sl-3n-ethip4-ip4dst20000-4cnf.py
traffic_profiles/trex/trex-sl-3n-ethip4-ip4dst20000-8cnf.py
traffic_profiles/trex/trex-sl-3n-ethip4-ip4dst4-1cnf.py
traffic_profiles/trex/trex-sl-3n-ethip4-ip4dst4-2cnf.py
traffic_profiles/trex/trex-sl-3n-ethip4-ip4dst4-4cnf.py
traffic_profiles/trex/trex-sl-3n-ethip4-ip4dst40-1cnf.py
traffic_profiles/trex/trex-sl-3n-ethip4-ip4dst40-2cnf.py
traffic_profiles/trex/trex-sl-3n-ethip4-ip4dst40-4cnf.py
traffic_profiles/trex/trex-sl-3n-ethip4-ip4dst40-8cnf.py
traffic_profiles/trex/trex-sl-3n-ethip4-ip4dst400-1cnf.py
traffic_profiles/trex/trex-sl-3n-ethip4-ip4dst400-2cnf.py
traffic_profiles/trex/trex-sl-3n-ethip4-ip4dst400-4cnf.py
traffic_profiles/trex/trex-sl-3n-ethip4-ip4dst400-8cnf.py
traffic_profiles/trex/trex-sl-3n-ethip4-ip4dst40000-1cnf.py
traffic_profiles/trex/trex-sl-3n-ethip4-ip4dst40000-2cnf.py
traffic_profiles/trex/trex-sl-3n-ethip4-ip4dst40000-4cnf.py
traffic_profiles/trex/trex-sl-3n-ethip4-ip4dst40000-8cnf.py
traffic_profiles/trex/trex-sl-3n-ethip4-ip4dst5000-1cnf.py
traffic_profiles/trex/trex-sl-3n-ethip4-ip4dst5000-2cnf.py
traffic_profiles/trex/trex-sl-3n-ethip4-ip4dst5000-4cnf.py
traffic_profiles/trex/trex-sl-3n-ethip4-ip4dst5000-8cnf.py
traffic_profiles/trex/trex-sl-3n-ethip4-ip4dst60000-1cnf.py
traffic_profiles/trex/trex-sl-3n-ethip4-ip4dst60000-2cnf.py
traffic_profiles/trex/trex-sl-3n-ethip4-ip4dst60000-4cnf.py
traffic_profiles/trex/trex-sl-3n-ethip4-ip4dst60000-8cnf.py
f99c79a4 30-Nov-2019 Jan Gelety <jgelety@cisco.com>

API: Add collection for 23887/2

Change-Id: I3c2124aebbab8cac12a7fa661e75b68b70286240
Signed-off-by: Jan Gelety <jgelety@cisco.com>

84c5ded9 08-Nov-2019 Peter Mikus <pmikus@cisco.com>

VPPD: Add L2patch

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Iebdc03e56cf9ecf0322ff5c2c8698e9e3daf4407

a3cfee36 30-Nov-2019 Jan Gelety <jgelety@cisco.com>

API: Add collection for 21706/17

Change-Id: Ia4b278a48130426423f33a7cec1e586e8e552a00
Signed-off-by: Jan Gelety <jgelety@cisco.com>

8fc9b28d 11-Sep-2019 Jan Gelety <jgelety@cisco.com>

CSIT-1597 API cleanup: classify

- cover API changes in VPP: https://gerrit.fd.io/r/c/vpp/+/21551
- move vpp stable build to 20.01-rc0~821
- tap tests tagged 'EXPECTED_FAILING' until necessary vpp api change
https://gerrit.fd.io/r/c/vpp/+/21706 and csit code is adapted

Change-Id: If4b9b7b5bc207612d08aa8aa4469a5361e058fc3
Signed-off-by: Jan Gelety <jgelety@cisco.com>

f7e953e0 10-Dec-2019 Tibor Frank <tifrank@cisco.com>

Trending: Add more NFV tests

+ 10R2C, 6R4C
+ Tunnels

Change-Id: I141fbb9cd9e975790af0e3d4dfa5f22da00fbfd9
Signed-off-by: Tibor Frank <tifrank@cisco.com>

870829e0 09-Dec-2019 Vratko Polak <vrpolak@cisco.com>

Perpatch compare: avg_diff is not an int

Change-Id: I1d003cb517ef95c76002862e540497d8c40cb913
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

526d34a0 29-Nov-2019 Jan Gelety <jgelety@cisco.com>

FIX: ip route config for ipsec via VAT

Change-Id: Ibf1979b87aeea0f4c195b97c8e6b59a4a23b1b77
Signed-off-by: Jan Gelety <jgelety@cisco.com>

6b893681 30-Nov-2019 Jan Gelety <jgelety@cisco.com>

FIX: integer divisions

Change-Id: I28caf62f418bf18601cd379603d03c307e3ba9c8
Signed-off-by: Jan Gelety <jgelety@cisco.com>

190462e1 09-Dec-2019 Tibor Frank <tifrank@cisco.com>

Trending: Use Mpps

Change-Id: I63efaa244aa4931a8ab474bc64520e1f501ad57a
Signed-off-by: Tibor Frank <tifrank@cisco.com>

762c67ca 09-Dec-2019 Tibor Frank <tifrank@cisco.com>

Trending: Fix Alerts

Change-Id: I963022c386928b7f29b176bfb4a4e2bfb0a55409
Signed-off-by: Tibor Frank <tifrank@cisco.com>

c0e53d57 09-Dec-2019 Tibor Frank <tifrank@cisco.com>

Fixes: Report

- show run

Change-Id: Ife9e0faae467b39810c7bf6dec706ca0e09d24be
Signed-off-by: Tibor Frank <tifrank@cisco.com>

1ae2fdf1 05-Dec-2019 Vratko Polak <vrpolak@cisco.com>

Improve quoting of asterisks

When quoted, the asterisks are understood as literal characters.
When unquoted, so they act as globs patterns.

When used to match files already present in the filesystem,
the asterisks should be unquoted.
When used to match a package name (not a file),
the asterisks should be quoted to prevent the bash expansion,
as programs such as apt-get and yum do their own expasion afterwards.

Unquoted asterisks for matching package names
may happen to work when there are no files to match the bash expansion,
but quoted asterisks are sure to avoid accidents.

Also, we want an asterisk both before and after "vpp",
due to package names such as libvppinfra-dev and python3-vpp-api.

Change-Id: I657a24c24a71d865915aba201bd0d3276cb33281
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

a78df8f2 05-Dec-2019 Peter Mikus <pmikus@cisco.com>

FIX: Some leftovers + csit_sut image sync

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I9b47f9a31c11f155ba5b4676ccf0fc4c413a3942

1d9a0ce3 29-Nov-2019 Vratko Polak <vrpolak@cisco.com>

Use new gdb commands for core dump examination

Change-Id: I96f40fa816055a656209cbbcae8259a74cc4bd80
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

4bddfe8c 05-Dec-2019 Peter Mikus <pmikus@cisco.com>

FIX: Deal with some "pylint: disable=" comments

Same rules for all

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Iaf6b6313750d19132e2f2886e676100878719690

063abf35 04-Dec-2019 Vratko Polak <vrpolak@cisco.com>

Deal with some "pylint: disable=" comments

+ When possible, fix the violation.
+ Else, add a comment:
+ An explanation (if not already present) and keep disable.
+ A TODO (if not already present) and remove the disable.
- This makes tox job report more pylint violations,
but any such violation is fixable and should be fixed.
- Although some need to be fixed in VPP, such as enum item long names.

Change-Id: I48604b5eda070083d79dff1439620dbd9e798e1f
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

6221f1b9 03-Dec-2019 Balaji Venkatraman <balajiv@cisco.com>

Python3: IPv4 FIB scale tests with random flows

Signed-off-by: Balaji Venkatraman <balajiv@cisco.com>
Change-Id: Iadd9e8da655f3ccbd36167c1bbee37a774c3bc1f
Signed-off-by: Balaji Venkatraman <balajiv@cisco.com>

e63d7aa7 04-Dec-2019 Tibor Frank <tifrank@cisco.com>

Trending: Fix CLX plots

Change-Id: Iea3181fcdf747bd6ca49f245f310a37498fcd801
Signed-off-by: Tibor Frank <tifrank@cisco.com>

36b48d75 04-Dec-2019 Tibor Frank <tifrank@cisco.com>

Trending: Fix CLX data set

Change-Id: I027ded5ce3d36d55a8633c52c82effaf7c6b745a
Signed-off-by: Tibor Frank <tifrank@cisco.com>

ba15109c 27-Sep-2019 Tibor Frank <tifrank@cisco.com>

Trending: Reorganization

+ use selection of tests by their full names
+ finalize trending_test_groups.md
+ modify static content
+ modify anchors
+ specifications:
+ container memif
+ ip4
+ ip4 tunnels
+ ip6
+ ipsec
+ l2
+ srv6
+ vhost
+ vts
+ dpdk
+ add 2n-clx
+ hyperlinks

Change-Id: Ibe073330317539896c6fbfcbd4a7a279b58bdb95
Signed-off-by: Tibor Frank <tifrank@cisco.com>

174ad309 24-Sep-2019 Tibor Frank <tifrank@cisco.com>

PAL: Add HDRHistogram graphs for latency

Change-Id: I4d5cc369c341411a4a035dba47b945b3bf43014f
Signed-off-by: Tibor Frank <tifrank@cisco.com>

bb33f1d1 29-Nov-2019 juraj.linkes <juraj.linkes@pantheon.tech>

Change startup show pci to show ver

When testing whether a socket is listetning, show pci results in a crash
on the Taishan platform. Temporarily work around this by changing it to
show ver.

Change-Id: Id0f995373bc2f429d59de200e51959b2da408052
Signed-off-by: juraj.linkes <juraj.linkes@pantheon.tech>

53fb7dad 03-Dec-2019 Peter Mikus <pmikus@cisco.com>

Remove: VIRL

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I2b1672412e19f15cb46246fffa931351cd3d518b


libraries/robot/shared/default.robot
tools/disk-image-builder/centos/.gitignore
tools/disk-image-builder/centos/CHANGELOG
tools/disk-image-builder/centos/build-listmaker.sh
tools/disk-image-builder/centos/build.sh
tools/disk-image-builder/centos/centos-7-1511.json
tools/disk-image-builder/centos/centos-7.3-1611.json
tools/disk-image-builder/centos/centos-7.4-1711.json
tools/disk-image-builder/centos/centos-7.6-1810.json
tools/disk-image-builder/centos/html/ks.cfg
tools/disk-image-builder/centos/listmaker/centos-7-1511.json
tools/disk-image-builder/centos/listmaker/centos-7.3-1611.json
tools/disk-image-builder/centos/listmaker/centos-7.4-1711.json
tools/disk-image-builder/centos/listmaker/centos-7.6-1810.json
tools/disk-image-builder/centos/listmaker/virl-listmaker-centos-7-1511.yaml
tools/disk-image-builder/centos/listmaker/virl-listmaker-centos-7.3-1611.yaml
tools/disk-image-builder/centos/listmaker/virl-listmaker-centos-7.4-1711.yaml
tools/disk-image-builder/centos/listmaker/virl-listmaker-centos-7.6-1810.yaml
tools/disk-image-builder/centos/lists/centos-7-1511_2016-12-08_1.0/pip-requirements.txt
tools/disk-image-builder/centos/lists/centos-7-1511_2016-12-08_1.0/rpm-packages.txt
tools/disk-image-builder/centos/lists/centos-7.3-1611_2016-12-26_1.1/pip-requirements.txt
tools/disk-image-builder/centos/lists/centos-7.3-1611_2016-12-26_1.1/rpm-packages.txt
tools/disk-image-builder/centos/lists/centos-7.3-1611_2017-01-24_1.2/pip-requirements.txt
tools/disk-image-builder/centos/lists/centos-7.3-1611_2017-01-24_1.2/rpm-packages.txt
tools/disk-image-builder/centos/lists/centos-7.3-1611_2017-02-23_1.4/pip-requirements.txt
tools/disk-image-builder/centos/lists/centos-7.3-1611_2017-02-23_1.4/rpm-packages.txt
tools/disk-image-builder/centos/lists/centos-7.3-1611_2017-08-01_1.5/pip-requirements.txt
tools/disk-image-builder/centos/lists/centos-7.3-1611_2017-08-01_1.5/rpm-packages.txt
tools/disk-image-builder/centos/lists/centos-7.3-1611_2018-03-17_1.8/Centos-Vault.repo
tools/disk-image-builder/centos/lists/centos-7.3-1611_2018-03-17_1.8/pip-requirements.txt
tools/disk-image-builder/centos/lists/centos-7.3-1611_2018-03-17_1.8/rpm-packages.txt
tools/disk-image-builder/centos/lists/centos-7.4-1711_2018-03-20_1.9/pip-requirements.txt
tools/disk-image-builder/centos/lists/centos-7.4-1711_2018-03-20_1.9/rpm-packages.txt
tools/disk-image-builder/centos/lists/centos-7.4-1711_2018-11-19_2.0/pip-requirements.txt
tools/disk-image-builder/centos/lists/centos-7.4-1711_2018-11-19_2.0/rpm-packages.txt
tools/disk-image-builder/centos/lists/centos-7.4-1711_2019-01-04_2.1/pip-requirements.txt
tools/disk-image-builder/centos/lists/centos-7.4-1711_2019-01-04_2.1/rpm-packages.txt
tools/disk-image-builder/centos/lists/centos-7.6-1810_2019-04-15_2.4/pip-requirements.txt
tools/disk-image-builder/centos/lists/centos-7.6-1810_2019-04-15_2.4/rpm-packages.txt
tools/disk-image-builder/centos/lists/centos-7.6-1810_2019-05-20_2.5/pip-requirements.txt
tools/disk-image-builder/centos/lists/centos-7.6-1810_2019-05-20_2.5/rpm-packages.txt
tools/disk-image-builder/centos/nested/NO-NESTED
tools/disk-image-builder/centos/run-listmaker.sh
tools/disk-image-builder/centos/scripts-local/upload-image-to-virl.sh
tools/disk-image-builder/centos/scripts-remote/cleanup.sh
tools/disk-image-builder/centos/scripts-remote/disable_ipv6.sh
tools/disk-image-builder/centos/scripts-remote/post-install.sh
tools/disk-image-builder/centos/scripts-remote/serial-console-centos-7-1511.sh
tools/disk-image-builder/centos/scripts-remote/vagrant-guestadditions.sh
tools/disk-image-builder/centos/scripts-remote/vagrant-user.sh
tools/disk-image-builder/csit-sut-dcr/ubuntu_1804_amd64/supervisord.conf
tools/disk-image-builder/csit-sut/Dockerfile
tools/disk-image-builder/csit-sut/supervisord.conf
tools/disk-image-builder/ubuntu/.gitignore
tools/disk-image-builder/ubuntu/CHANGELOG
tools/disk-image-builder/ubuntu/build-listmaker.sh
tools/disk-image-builder/ubuntu/build.sh
tools/disk-image-builder/ubuntu/clean.sh
tools/disk-image-builder/ubuntu/deepclean.sh
tools/disk-image-builder/ubuntu/html/preseed.cfg
tools/disk-image-builder/ubuntu/listmaker/ubuntu-14.04.4.json
tools/disk-image-builder/ubuntu/listmaker/ubuntu-16.04.1.json
tools/disk-image-builder/ubuntu/listmaker/virl-listmaker-ubuntu-14.04.4.yaml
tools/disk-image-builder/ubuntu/listmaker/virl-listmaker-ubuntu-16.04.1.yaml
tools/disk-image-builder/ubuntu/lists/ubuntu-14.04.4_2016-05-25_1.0/apt-packages.txt
tools/disk-image-builder/ubuntu/lists/ubuntu-14.04.4_2016-05-25_1.0/pip-requirements.txt
tools/disk-image-builder/ubuntu/lists/ubuntu-14.04.4_2016-07-04_1.1/apt-packages.txt
tools/disk-image-builder/ubuntu/lists/ubuntu-14.04.4_2016-07-04_1.1/pip-requirements.txt
tools/disk-image-builder/ubuntu/lists/ubuntu-14.04.4_2016-07-04_1.2/apt-packages.txt
tools/disk-image-builder/ubuntu/lists/ubuntu-14.04.4_2016-07-04_1.2/pip-requirements.txt
tools/disk-image-builder/ubuntu/lists/ubuntu-14.04.4_2016-10-07_1.3/apt-packages.txt
tools/disk-image-builder/ubuntu/lists/ubuntu-14.04.4_2016-10-07_1.3/pip-requirements.txt
tools/disk-image-builder/ubuntu/lists/ubuntu-16.04.1_2016-10-10_1.4/apt-packages.txt
tools/disk-image-builder/ubuntu/lists/ubuntu-16.04.1_2016-10-10_1.4/pip-requirements.txt
tools/disk-image-builder/ubuntu/lists/ubuntu-16.04.1_2016-11-28_1.5/apt-packages.txt
tools/disk-image-builder/ubuntu/lists/ubuntu-16.04.1_2016-11-28_1.5/pip-requirements.txt
tools/disk-image-builder/ubuntu/lists/ubuntu-16.04.1_2016-12-19_1.6/apt-packages.txt
tools/disk-image-builder/ubuntu/lists/ubuntu-16.04.1_2016-12-19_1.6/pip-requirements.txt
tools/disk-image-builder/ubuntu/lists/ubuntu-16.04.1_2017-02-23_1.8/apt-packages.txt
tools/disk-image-builder/ubuntu/lists/ubuntu-16.04.1_2017-02-23_1.8/pip-requirements.txt
tools/disk-image-builder/ubuntu/lists/ubuntu-16.04.1_2017-07-26_1.9/apt-packages.txt
tools/disk-image-builder/ubuntu/lists/ubuntu-16.04.1_2017-07-26_1.9/pip-requirements.txt
tools/disk-image-builder/ubuntu/lists/ubuntu-16.04.1_2017-10-21_2.0/apt-packages.txt
tools/disk-image-builder/ubuntu/lists/ubuntu-16.04.1_2017-10-21_2.0/pip-requirements.txt
tools/disk-image-builder/ubuntu/lists/ubuntu-16.04.1_2018-11-20_2.2/apt-packages.txt
tools/disk-image-builder/ubuntu/lists/ubuntu-16.04.1_2018-11-20_2.2/pip-requirements.txt
tools/disk-image-builder/ubuntu/lists/ubuntu-16.04.1_2019-01-04_2.3/apt-packages.txt
tools/disk-image-builder/ubuntu/lists/ubuntu-16.04.1_2019-01-04_2.3/pip-requirements.txt
tools/disk-image-builder/ubuntu/lists/ubuntu-16.04.1_2019-03-27_2.4/apt-packages.txt
tools/disk-image-builder/ubuntu/lists/ubuntu-16.04.1_2019-03-27_2.4/pip-requirements.txt
tools/disk-image-builder/ubuntu/nested/NO-NESTED
tools/disk-image-builder/ubuntu/run-listmaker.sh
tools/disk-image-builder/ubuntu/scripts-local/upload-image-to-virl.sh
tools/disk-image-builder/ubuntu/scripts-remote/cleanup.sh
tools/disk-image-builder/ubuntu/scripts-remote/disable_ipv6.sh
tools/disk-image-builder/ubuntu/scripts-remote/post-install.sh
tools/disk-image-builder/ubuntu/scripts-remote/serial-console-ubuntu-14.04.4.sh
tools/disk-image-builder/ubuntu/scripts-remote/serial-console-ubuntu-16.04.1.sh
tools/disk-image-builder/ubuntu/scripts-remote/vagrant-guestadditions.sh
tools/disk-image-builder/ubuntu/scripts-remote/vagrant-user.sh
tools/disk-image-builder/ubuntu/ubuntu-14.04.4.json
tools/disk-image-builder/ubuntu/ubuntu-14.04.4.json.WITH-ATLAS
tools/disk-image-builder/ubuntu/ubuntu-16.04.1.json
tools/virl/README.md
tools/virl/bin/kill-idle-testcases
tools/virl/bin/list-testcases
tools/virl/bin/start-testcase
tools/virl/bin/start-testcase-DMM
tools/virl/bin/start-testcase-TLDK
tools/virl/bin/stop-testcase
tools/virl/topologies/double-ring-nested.centos7.virl
tools/virl/topologies/double-ring-nested.centos7.yaml
tools/virl/topologies/double-ring-nested.xenial.virl
tools/virl/topologies/double-ring-nested.xenial.yaml
cbfa26dc 20-Nov-2019 Tibor Frank <tifrank@cisco.com>

Python3: PAL

- files renamed:
- utils.py --> pal_utils.py
- errors.py --> pal_errors.py
- functions/methods renamed:
- plot_service_density_reconf_box_name --> plot_nf_reconf_box_name
- plot_performance_box_name --> plot_perf_box_name
- plot_latency_error_bars_name --> plot_lat_err_bars_name
- plot_throughput_speedup_analysis_name --> plot_tsa_name
- plot_service_density_heatmap --> plot_nf_heatmap
- table_performance_comparison --> table_perf_comparison
- table_performance_comparison_nic --> table_perf_comparison_nic
- table_performance_trending_dashboard_html --> table_perf_trending_dash_html

- functions/methods removed:
- plot_service_density_heatmap_compare
- plot_throughput_speedup_analysis
- plot_latency_error_bars
- plot_soak_boxes
- plot_soak_bars

Change-Id: Icddc01d3ccb451abb92b9e5d912b642d01866033
Signed-off-by: Tibor Frank <tifrank@cisco.com>

375aeaab 29-Nov-2019 Jan Gelety <jgelety@cisco.com>

API: Add collection for 21551/27

Change-Id: Id4b97a28013741d08d2293714e7d1a9034b0ceed
Signed-off-by: Jan Gelety <jgelety@cisco.com>

af7b5938 29-Nov-2019 Jan Gelety <jgelety@cisco.com>

FIX: vxlan+vlan perf tests

Change-Id: I7115456a1ef64a0b92113a77fba2949005208b07
Signed-off-by: Jan Gelety <jgelety@cisco.com>

77afc122 03-Dec-2019 Peter Mikus <pmikus@cisco.com>

Python3: Vagrant update

+ Small styling

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Ica8a4942b460b8534a9fbaf47bdb64dcfc9cbcde

bd799a13 02-Dec-2019 Vratko Polak <vrpolak@cisco.com>

Use Jumpavg 0.2.0 in PAL

+ As a side effect, PAL is now part of "resource" package tree.
- Testable only with 23558 (the rest of PAL Python 3 migration).

Change-Id: Icbd90fd71458c07bced86f4bab9fa4e68282c38c
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

627cddca 02-Dec-2019 Vratko Polak <vrpolak@cisco.com>

Refactor jumpavg to be more readable and usable

This is the python3 change, the python2 is still used for testing bisect.

+ New version is 0.2.0 due to amount o API changes.
+ Jumpavg is now part of CSIT resource package tree.
+ Perpatch migrated to new jumpavg.
- PAL NOT updated (the update moved to a different Change).

Change-Id: I7d7a8bf8a411196c20c2a40a8c64478d6709bc07
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

9a936616 02-Dec-2019 Peter Mikus <pmikus@cisco.com>

FIX: Perpatch PY3

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Iae97cf4490fea38f5f03bdaa120ee7ae48b941ab

f6eacaa9 28-Nov-2019 Jan Gelety <jgelety@cisco.com>

FIX: SRV6 proxy

Change-Id: I4afbb0261c21c800bf24e423e505307f596c0045
Signed-off-by: Jan Gelety <jgelety@cisco.com>

edc17958 28-Nov-2019 Jan Gelety <jgelety@cisco.com>

FIX: acl

Change-Id: Ieb1569a1dce9fd7c00041ba00f72c67142a581ed
Signed-off-by: Jan Gelety <jgelety@cisco.com>

b036f558 01-Dec-2019 Peter Mikus <pmikus@cisco.com>

FIX: VAT terminal

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I98fd62e6b5367b23694017d99a1dae7d893326c9

0c6c9884 30-Nov-2019 Peter Mikus <pmikus@cisco.com>

FIX: IPsec naming creation

Change-Id: I066a8b85649654c1c575eb63722de6c51f3d4f78
Signed-off-by: Peter Mikus <pmikus@cisco.com>

d68951ac 12-Nov-2019 Jan Gelety <jgelety@cisco.com>

Python3: resources and libraries

Change-Id: I1392c06b1d64f62b141d24c0d42a8e36913b15e2
Signed-off-by: Jan Gelety <jgelety@cisco.com>


libraries/python/Classify.py
libraries/python/Constants.py
libraries/python/ContainerUtils.py
libraries/python/Cop.py
libraries/python/CoreDumpUtil.py
libraries/python/CpuUtils.py
libraries/python/DMM/DMMConstants.py
libraries/python/DMM/SetupDMMTest.py
libraries/python/DMM/SingleCliSer.py
libraries/python/DPDK/DPDKTools.py
libraries/python/DPDK/L2fwdTest.py
libraries/python/DPDK/L3fwdTest.py
libraries/python/DUTSetup.py
libraries/python/Dhcp.py
libraries/python/DpdkUtil.py
libraries/python/DropRateSearch.py
libraries/python/FilteredLogger.py
libraries/python/GBP.py
libraries/python/HTTPRequest.py
libraries/python/IPUtil.py
libraries/python/IPsecUtil.py
libraries/python/IPv6Util.py
libraries/python/InterfaceUtil.py
libraries/python/KubernetesUtils.py
libraries/python/L2Util.py
libraries/python/LimitUtil.py
libraries/python/LispSetup.py
libraries/python/LispUtil.py
libraries/python/LoadBalancerUtil.py
libraries/python/LocalExecution.py
libraries/python/MLRsearch/AbstractMeasurer.py
libraries/python/MLRsearch/AbstractSearchAlgorithm.py
libraries/python/MLRsearch/MultipleLossRatioSearch.py
libraries/python/MLRsearch/NdrPdrResult.py
libraries/python/MLRsearch/ReceiveRateInterval.py
libraries/python/MLRsearch/ReceiveRateMeasurement.py
libraries/python/Memif.py
libraries/python/NATUtil.py
libraries/python/Namespaces.py
libraries/python/NodePath.py
libraries/python/OptionString.py
libraries/python/PLRsearch/Integrator.py
libraries/python/PLRsearch/PLRsearch.py
libraries/python/PLRsearch/log_plus.py
libraries/python/PLRsearch/stat_trackers.py
libraries/python/PacketVerifier.py
libraries/python/PapiExecutor.py
libraries/python/PapiHistory.py
libraries/python/Policer.py
libraries/python/PythonThree.py
libraries/python/QemuManager.py
libraries/python/QemuUtils.py
libraries/python/SRv6.py
libraries/python/SchedUtils.py
libraries/python/SetupFramework.py
libraries/python/SysctlUtil.py
libraries/python/TGSetup.py
libraries/python/TLDK/SetupTLDKTest.py
libraries/python/TLDK/TLDKConstants.py
libraries/python/TLDK/UdpTest.py
libraries/python/Tap.py
libraries/python/TestConfig.py
libraries/python/Trace.py
libraries/python/TrafficGenerator.py
libraries/python/TrafficScriptArg.py
libraries/python/TrafficScriptExecutor.py
libraries/python/VPPUtil.py
libraries/python/VatExecutor.py
libraries/python/VatJsonUtil.py
libraries/python/VhostUser.py
libraries/python/VppApiCrc.py
libraries/python/VppConfigGenerator.py
libraries/python/VppCounters.py
libraries/python/autogen/Regenerator.py
libraries/python/autogen/Testcase.py
libraries/python/parsers/JsonParser.py
libraries/python/ssh.py
libraries/python/tcp.py
libraries/python/telemetry/SPAN.py
libraries/python/telemetry/__init__.py
libraries/python/topology.py
libraries/robot/crypto/ipsec.robot
libraries/robot/dpdk/default.robot
libraries/robot/features/acl.robot
libraries/robot/features/gbp.robot
libraries/robot/features/policer.robot
libraries/robot/ip/ip4.robot
libraries/robot/ip/ip6.robot
libraries/robot/ip/nat.robot
libraries/robot/l2/l2_bridge_domain.robot
libraries/robot/l2/l2_patch.robot
libraries/robot/l2/l2_traffic.robot
libraries/robot/l2/l2_xconnect.robot
libraries/robot/l2/tagging.robot
libraries/robot/lb/load_balancer.robot
libraries/robot/overlay/lisp.robot
libraries/robot/overlay/lisp_api.robot
libraries/robot/overlay/lisp_static_adjacency.robot
libraries/robot/overlay/lispgpe.robot
libraries/robot/overlay/srv6.robot
libraries/robot/overlay/vxlan.robot
libraries/robot/performance/performance_configuration.robot
libraries/robot/performance/performance_limits.robot
libraries/robot/performance/performance_utils.robot
libraries/robot/shared/container.robot
libraries/robot/shared/default.robot
libraries/robot/shared/interfaces.robot
libraries/robot/shared/memif.robot
libraries/robot/shared/suite_setup.robot
libraries/robot/shared/suite_teardown.robot
libraries/robot/shared/test_setup.robot
libraries/robot/shared/test_teardown.robot
libraries/robot/shared/testing_path.robot
libraries/robot/shared/traffic.robot
libraries/robot/shared/vm.robot
libraries/robot/tcp/tcp_setup.robot
libraries/robot/wrk/wrk_utils.robot
test_data/lisp/api/lisp_api_resources.py
test_data/lisp/ipv4_ipsec_lispgpe_ipv4/ipv4_ipsec_lispgpe_ipv4.py
test_data/lisp/ipv4_lispgpe_ipv4/ipv4_lispgpe_ipv4.py
test_data/lisp/ipv4_lispgpe_ipv6/ipv4_lispgpe_ipsec_ipv6.py
test_data/lisp/ipv6_lispgpe_ipv4/ipv6_lispgpe_ipsec_ipv4.py
test_data/lisp/ipv6_lispgpe_ipv6/ipv6_lispgpe_ipsec_ipv6.py
test_data/lisp/ipv6_lispgpe_ipv6/ipv6_lispgpe_ipv6.py
test_data/lisp/l2/l2_ipv4.py
test_data/lisp/l2/l2_ipv6.py
test_data/lisp/lisp.py
test_data/lisp/performance/lisp_static_adjacency.py
test_data/lisp/static_adjacency/lisp_static_adjacency.py
tools/doc_gen/gen_rst.py
tools/doc_gen/src/conf.py
tools/integrated/check_crc.py
tools/papi/vpp_papi_provider.py
tools/presentation/environment.py
tools/presentation/generator_alerts.py
tools/presentation/input_data_parser.py
tools/presentation/specification_parser.py
tools/scripts/compare_perpatch.py
tools/scripts/topo_reservation.py
tools/topology/update_topology.py
tools/trex/trex_server_info.py
tools/trex/trex_stateless_profile.py
tools/trex/trex_stateless_stop.py
tools/wrk/wrk.py
tools/wrk/wrk_errors.py
tools/wrk/wrk_traffic_profile_parser.py
traffic_profiles/trex/profile_trex_stateless_base_class.py
traffic_scripts/arp_request.py
traffic_scripts/check_ra_packet.py
traffic_scripts/dhcp/check_dhcp_discover.py
traffic_scripts/dhcp/check_dhcp_request.py
traffic_scripts/dhcp/check_dhcp_request_ack.py
traffic_scripts/dhcp/send_and_check_proxy_discover.py
traffic_scripts/dhcp/send_and_check_proxy_messages.py
traffic_scripts/dhcp/send_dhcp_v6_messages.py
traffic_scripts/icmpv6_echo.py
traffic_scripts/icmpv6_echo_req_resp.py
traffic_scripts/ipsec.py
traffic_scripts/ipv4_ping_ttl_check.py
traffic_scripts/ipv4_sweep_ping.py
traffic_scripts/ipv6_nd_proxy_check.py
traffic_scripts/ipv6_ns.py
traffic_scripts/ipv6_sweep_ping.py
traffic_scripts/lisp/lisp_check.py
traffic_scripts/lisp/lispgpe_check.py
traffic_scripts/policer.py
traffic_scripts/send_gre_check_gre_headers.py
traffic_scripts/send_gre_check_icmp_headers.py
traffic_scripts/send_icmp_check_arp.py
traffic_scripts/send_icmp_check_gre_headers.py
traffic_scripts/send_icmp_check_headers.py
traffic_scripts/send_icmp_check_multipath.py
traffic_scripts/send_icmp_type_code.py
traffic_scripts/send_icmp_wait_for_reply.py
traffic_scripts/send_ip_check_headers.py
traffic_scripts/send_ip_icmp.py
traffic_scripts/send_ipv4_icmp_check_lw_4o6.py
traffic_scripts/send_ipv4_udp_check_lw_4o6.py
traffic_scripts/send_ipv4_udp_check_map_t.py
traffic_scripts/send_ipv6_udp_check_map_t.py
traffic_scripts/send_lw_4o6_check_hairpinning_udp.py
traffic_scripts/send_lw_4o6_check_ipv4_udp.py
traffic_scripts/send_rs_check_ra.py
traffic_scripts/send_tcp_udp.py
traffic_scripts/send_vxlan_check_vxlan.py
traffic_scripts/vxlan.py
ed0258a4 04-Nov-2019 Peter Mikus <pmikus@cisco.com>

Python3: PIP requirement

- Install via PIP3
- Use virtualenv Python3 interpret

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Iad22b344b418a1d91774d23d5ea17bfd48d394b3

497f6069 14-Nov-2019 Tibor Frank <tifrank@cisco.com>

NSH_SFC: Remove

Change-Id: Ib7f9dff7bede4f8ec3148f234109132be920de82
Signed-off-by: Tibor Frank <tifrank@cisco.com>

e7ad66f3 11-Nov-2019 Peter Mikus <pmikus@cisco.com>

HONEYCOMB: Remove

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I60d80564050cb786c7b1e0a08f31f8292f82197e


libraries/bash/function/artifacts_hc.sh
libraries/python/Constants.py
libraries/python/honeycomb/BGP.py
libraries/python/honeycomb/DHCP.py
libraries/python/honeycomb/FIB.py
libraries/python/honeycomb/HcAPIKwACL.py
libraries/python/honeycomb/HcAPIKwBridgeDomain.py
libraries/python/honeycomb/HcAPIKwInterfaces.py
libraries/python/honeycomb/HcAPIKwNSH.py
libraries/python/honeycomb/HcPersistence.py
libraries/python/honeycomb/HoneycombSetup.py
libraries/python/honeycomb/HoneycombUtil.py
libraries/python/honeycomb/IPv6Management.py
libraries/python/honeycomb/Lisp.py
libraries/python/honeycomb/NAT.py
libraries/python/honeycomb/Netconf.py
libraries/python/honeycomb/Notifications.py
libraries/python/honeycomb/Performance.py
libraries/python/honeycomb/ProxyARP.py
libraries/python/honeycomb/Routing.py
libraries/python/honeycomb/__init__.py
libraries/robot/honeycomb/access_control_lists.robot
libraries/robot/honeycomb/bgp.robot
libraries/robot/honeycomb/bridge_domain.robot
libraries/robot/honeycomb/dhcp.robot
libraries/robot/honeycomb/fib.robot
libraries/robot/honeycomb/honeycomb.robot
libraries/robot/honeycomb/interfaces.robot
libraries/robot/honeycomb/ipv6_control.robot
libraries/robot/honeycomb/l2_fib.robot
libraries/robot/honeycomb/lisp.robot
libraries/robot/honeycomb/lisp_gpe.robot
libraries/robot/honeycomb/nat.robot
libraries/robot/honeycomb/netconf.robot
libraries/robot/honeycomb/notifications.robot
libraries/robot/honeycomb/nsh.robot
libraries/robot/honeycomb/papi.robot
libraries/robot/honeycomb/performance.robot
libraries/robot/honeycomb/persistence.robot
libraries/robot/honeycomb/policer.robot
libraries/robot/honeycomb/port_mirroring.robot
libraries/robot/honeycomb/provider_backbone_bridge.robot
libraries/robot/honeycomb/proxyarp.robot
libraries/robot/honeycomb/routing.robot
libraries/robot/honeycomb/slaac.robot
libraries/robot/honeycomb/sub_interface.robot
libraries/robot/honeycomb/tap.robot
libraries/robot/honeycomb/vhost_user.robot
libraries/robot/honeycomb/vxlan.robot
libraries/robot/honeycomb/vxlan_gpe.robot
templates/honeycomb/config_bgp_peer.url
templates/honeycomb/config_bgp_route.url
templates/honeycomb/config_bridge_domain.url
templates/honeycomb/config_classify_table.url
templates/honeycomb/config_dhcp_relay.url
templates/honeycomb/config_fib_table.url
templates/honeycomb/config_lisp.url
templates/honeycomb/config_lisp_gpe.url
templates/honeycomb/config_nat.url
templates/honeycomb/config_network_topology.url
templates/honeycomb/config_nsh.url
templates/honeycomb/config_plugin_acl.url
templates/honeycomb/config_policer.url
templates/honeycomb/config_proxyarp_ranges.url
templates/honeycomb/config_routing_table.url
templates/honeycomb/config_slaac.url
templates/honeycomb/config_vpp_interfaces.url
templates/honeycomb/odl_client/mount_honeycomb.json
templates/honeycomb/odl_client/odl_netconf_connector.url
templates/honeycomb/oper_bgp.url
templates/honeycomb/oper_bridge_domains.url
templates/honeycomb/oper_classify_table.url
templates/honeycomb/oper_disabled_interfaces.url
templates/honeycomb/oper_fib_table.url
templates/honeycomb/oper_lisp.url
templates/honeycomb/oper_lisp_gpe.url
templates/honeycomb/oper_nat.url
templates/honeycomb/oper_network_topology.url
templates/honeycomb/oper_nsh.url
templates/honeycomb/oper_policer.url
templates/honeycomb/oper_routing_table.url
templates/honeycomb/oper_vpp_interfaces.url
templates/honeycomb/oper_vpp_version.url
test_data/honeycomb/acl.py
test_data/honeycomb/bgp.py
test_data/honeycomb/dhcp_relay.py
test_data/honeycomb/interface_ip.py
test_data/honeycomb/l2_fib.py
test_data/honeycomb/lisp/lisp.py
test_data/honeycomb/lisp/lisp_gpe.py
test_data/honeycomb/nat.py
test_data/honeycomb/netconf/hello.py
test_data/honeycomb/netconf/subscription.py
test_data/honeycomb/netconf/triggers.py
test_data/honeycomb/nsh.py
test_data/honeycomb/pbb/pbb.py
test_data/honeycomb/persistence.py
test_data/honeycomb/plugin_acl.py
test_data/honeycomb/policer_variables.py
test_data/honeycomb/routing.py
test_data/honeycomb/slaac_variables.py
test_data/honeycomb/span.py
test_data/honeycomb/sub_interfaces.py
test_data/honeycomb/vxlan.py
test_data/honeycomb/vxlan_gpe.py
tools/doc_gen/gen_rst.py
tools/doc_gen/src/index.rst
tools/doc_gen/src/overview.rst
tools/doc_gen/src/tests.vpp.func.ip4_tunnels.rst
tools/doc_gen/src/tests.vpp.func.ip6_tunnels.rst
tools/doc_gen/src/tests.vpp.func.rst
tools/doc_gen/src/tests.vpp.func.vm_vhost.rst
tools/presentation/conf.py
tools/presentation/doc/pal_lld.rst
tools/presentation/specification.yaml
tools/scripts/download_hc_build_pkgs.sh
tools/scripts/download_hc_pkgs.sh
tools/testbed-setup/ansible/roles/cleanup/tasks/sut.yaml
tools/virl/topologies/double-ring-nested.trusty.virl
tools/virl/topologies/double-ring-nested.trusty.yaml
traffic_scripts/honeycomb/bgp_open.py
traffic_scripts/honeycomb/read_vpp_version.py
20cc67d5 15-Nov-2019 Vratko Polak <vrpolak@cisco.com>

Improve test tag string parsing

Instead of just adding the missing -clx,
the new way aims to be forward compatible.

The new implementation is quite permissive,
ignoring all "word" chars sticking to the trigger word
and returning everything after that and space up to the endline.

+ Unified perftest and devicetest handling.
+ Consequently, triggers like "devicetest-1n-skx GBP" will work now.

Change-Id: I3bda6105195180d35a589a75318f569e36f03461
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

19330cec 18-Nov-2019 Peter Mikus <pmikus@cisco.com>

FIX: Ansible remove vpp

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I054d2b282f67a465bb0f7ceacfe23d6283c88409

080b0394 15-Nov-2019 Peter Mikus <pmikus@cisco.com>

FIX: LXC Container directory initialization

Change-Id: I7d2f81e03316410073b2b3ff7d6d754f5ac90df7
Signed-off-by: Peter Mikus <pmikus@cisco.com>

e3f3628c 13-Nov-2019 Vratko Polak <vrpolak@cisco.com>

CRC: Update comments after lb-nat4 tests

Change-Id: I5530421ab8b4dd6404d9a7d1939a890b408c0df9
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

f23b0e35 13-Nov-2019 Peter Mikus <pmikus@cisco.com>

FIX: Ipsec perf

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I6e3ce086978c383303724d989702b1c1273c50c0

7de465c0 13-Nov-2019 Peter Mikus <pmikus@cisco.com>

LIGATO: Remove

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I0c9b8b07ed3a113e24a38faaddd5ed06fae67768

3a42930d 11-Nov-2019 Jan Gelety <jgelety@cisco.com>

FIX: missing param in gbp_contract_add_del

Change-Id: I5c2354911505a9d7a95bef894eda8bf7b14b8dc8
Signed-off-by: Jan Gelety <jgelety@cisco.com>

cd766184 13-Nov-2019 Peter Mikus <pmikus@cisco.com>

FIX: Ansible container cleanup

Change-Id: I233baca48a3f01d1a206fd004b0503b0f1fad5d9
Signed-off-by: Peter Mikus <pmikus@cisco.com>

fb30f887 13-Nov-2019 Peter Mikus <pmikus@cisco.com>

FIX: Ansible cleanup permission

Change-Id: Ia79558b579e70aa666e8f84230f4bd2cafb33569
Signed-off-by: Peter Mikus <pmikus@cisco.com>

06e6da52 10-Oct-2019 haiyanx1.zhang <haiyanx1.zhang@intel.com>

Add vpp loadbalancer l3dsr/nat4 mode test suites

Change-Id: I03603108fe7128fb4bde4abddb6a0959dd5b5c73
Signed-off-by: haiyanx1.zhang <haiyanx1.zhang@intel.com>

1a499335 13-Nov-2019 Tibor Frank <tifrank@cisco.com>

Trending: Input data

Change-Id: I9b1060cb6162521bfdfe4b875444dc09c109960d
Signed-off-by: Tibor Frank <tifrank@cisco.com>

dfcefbd9 07-Nov-2019 Jan Gelety <jgelety@cisco.com>

New weekly mrr trigger

Change-Id: Iff21ad109e5f0a8ed06bd561e75c8a708e84c036
Signed-off-by: Jan Gelety <jgelety@cisco.com>

a6721ae4 12-Nov-2019 Peter Mikus <pmikus@cisco.com>

FIX: Supervisor initialization

- Next step: remove supervisor entirely

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I7ff5d76168d5d0f77e335975552638efac77cfc8

a31a47b1 11-Nov-2019 Vratko Polak <vrpolak@cisco.com>

Remove the leftovers of the old testbed cleanup

Change-Id: I464db6fb6c220f23f2fe69df2c793175975d7b72
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

a4cad14b 30-Oct-2019 Jan Gelety <jgelety@cisco.com>

FIX: do not use ping in vpp-device tests

Change-Id: Ic11f863e7ffad70d45e6e8dc39c70efc62cecc96
Signed-off-by: Jan Gelety <jgelety@cisco.com>

d5e00a36 11-Nov-2019 Peter Mikus <pmikus@cisco.com>

FIX: Paths for new Docker images

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Ia39ff6445e4029a78d008d5690661610a1e9ed50

b0d6fc97 08-Nov-2019 Vratko Polak <vrpolak@cisco.com>

Prevent many TC triggered by bad tag expressions

Typical example: Use multiple perftest lines in a comment.
Atypical example: Use perftest as an expression (without any ANDs).

Fix: Die if "perftest" is found in the tag expression (before prefixing).

Change-Id: I0230541b30557ce7a4e9d57c8303cd432f86747d
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

e426a0bd 07-Nov-2019 Jan Gelety <jgelety@cisco.com>

FIX: use correct NIC for mr-daily-master job

Change-Id: I57bc8c7eda7ea959d92f7e35b7989d64b20743a0
Signed-off-by: Jan Gelety <jgelety@cisco.com>

89d71f87 08-Nov-2019 Peter Mikus <pmikus@cisco.com>

FIX: Small ansible fixes

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I55e0f8c28ea166464026b61e3fd2b18faf8744f2

0227e20f 07-Nov-2019 Vratko Polak <vrpolak@cisco.com>

Source ansible.sh for entry scripts using cleanup

Change-Id: Iee02577ee0c054feb61edee807182c6808f235b0
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

d01411c3 10-Oct-2019 Peter Mikus <pmikus@cisco.com>

Cleanup via Ansible

+ Remove dependency on topo_ scripts that depends on custom SSH()
that depends on framework itself. This way the cleanup is independent
of failure in our SSH libs.
+ Simple ansible command can do cleanup of a machine:
ansible-playbook --inventory inventories/lf_inventory/hosts site.yaml \
--limit '10.32.8.18' --tags 'cleanup'
+ Add vpp_device reset and cleanup.
+ Remove historical scripts.

- Still in testing beta phase.
- Need to add SRIOV cleanup.

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I68e23304c7ad01041f51263c328c6e8d9b555cb7

50d21f72 04-Nov-2019 Tibor Frank <tifrank@cisco.com>

Trending: Fix alerts

Change-Id: I0f54bbf34493cab927408aa1da7d855ce15db061
Signed-off-by: Tibor Frank <tifrank@cisco.com>

9bdcc0e3 25-Oct-2019 Jan Gelety <jgelety@cisco.com>

New daily triggers

New daily triggers defined based on requirements defined in
https://gerrit.fd.io/r/c/csit/+/22341/34/resources/tools/presentation/doc/trending_test_groups.md

Change-Id: I95bff10d9a2e29c712a33f7c043933244b712fd0
Signed-off-by: Jan Gelety <jgelety@cisco.com>

a2f38e84 31-Oct-2019 Vratko Polak <vrpolak@cisco.com>

Regularize spaces in crc list

Two spaces before hash if after quote, single space otherwise
(or 4 spaces if the hash is commenting out the whole line).

Change-Id: Icee85996a00e4e31ce61ad5030f4cdbedeacd506
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

d2c0ce0d 31-Oct-2019 Vratko Polak <vrpolak@cisco.com>

Copy missing lines to second CRC collection

Change-Id: If8fa609bf0c58ad0cc63a8320f298c026f8b7900
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

3ccfe8cd 30-Oct-2019 Peter Mikus <pmikus@cisco.com>

Framework: Add show log as tear down action

+ We can see what is happening when debug level is increased
+ Big caveat of VPP is that it does not allow to configure
default global level.

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I5ea1a618161cdb3170cab022d7451e52271f83c0

96eaabff 13-Sep-2019 Peter Mikus <pmikus@cisco.com>

Add: Use containers for shared TG

+ Ansible
+ Service for auto load during restart
+ By default created 2 instances of Docker container
+ Small modification of Trex to use prefixes
+ DNV topology to use ssh port to connect to docker

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Ibc2b2f0e509d920fc3e05d012b88abc388f5c3e7

61144d7e 10-Oct-2019 Jan Gelety <jgelety@cisco.com>

API: Add collection for 21551/12

Change-Id: Ia1232a71378f925110741ad9f914d8c5abd6941e
Signed-off-by: Jan Gelety <jgelety@cisco.com>

9fa0aef9 28-Oct-2019 Vratko Polak <vrpolak@cisco.com>

TrafficGenerator: Skip only the first equals

HRDhistogram output contains essential trailing equals.
Edit all fields even though we do not expect equals in others.

Change-Id: I9f4f07fc4d6f4583989a9c0e45f68bc0cd9a65fe
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

465b9ba0 02-Oct-2019 Tibor Frank <tifrank@cisco.com>

PAL: Add sortable html table for comparisons

Change-Id: I2d690685c5728e5f36b09d542e0f6d1a08cd151a
Signed-off-by: Tibor Frank <tifrank@cisco.com>

eaf3cde2 25-Oct-2019 Peter Mikus <pmikus@cisco.com>

FIX: Limitation for NICs

Change-Id: I8e0a14f59e20d61096e069bb80a0e2c00977ac5c
Signed-off-by: Peter Mikus <pmikus@cisco.com>

909a91c2 15-Oct-2019 Peter Mikus <pmikus@cisco.com>

ADD: Mellanox RDMA interface support

+ Add functions for creating rdma interface
+ Fix traffic generator

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I81787b72ff5ee926ed652d350888c4f86da766f1

ac89ba8a 21-Oct-2019 Peter Mikus <pmikus@cisco.com>

Introduce pre-initialize driver layer

+ This will help unify driver base differences between TCs.
+ Decrease amount of logic needed for suite generator.

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I1e84ba361dc1e829f0612c58a61096e2633ce0c5

23b5bfe6 21-Oct-2019 Vratko Polak <vrpolak@cisco.com>

CRCs: Update comments and improve CSIT checks.

+ Restore alphabetic order in yaml.
+ Mark the lisp messages verified to be covered by dev instead of virl.
+ Mark the GBP messages verified by devicetest now.
+ Mark acl_add_replace as dev and create_subif as perf.
+ Mark ip_probe_neighbor as unused L1.
+ Improve loadbalancer comments.
- Nat4 testcase is described, even if not merged yet.
+ Forget reported CRC after initial dir report,
and report them again (once) in test cases (if hit).
With this, single run (with fail on crc off) gives full info.
+ Small improvements to CRC library docstrings and messages.

Change-Id: Ic1cfad45e10d437be827af2a89eac49e25267b59
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

fcc77752 18-Oct-2019 Peter Mikus <pmikus@cisco.com>

Tests: Introduce driver layer

+ Small bugfixes in various suites

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I051af0a6da7340fe3f617400370c3846ca5241ab

510f6d51 18-Oct-2019 Vratko Polak <vrpolak@cisco.com>

Autogen checker: Fix difference reporting branch

Change-Id: I85da5ec38643524fa1af7ed7628025a4a52463f5
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

4e9256f1 17-Oct-2019 Tibor Frank <tifrank@cisco.com>

Trending: reduce input data

Change-Id: I931c4140b3a6ced30030e4573fdd77e80987f972
Signed-off-by: Tibor Frank <tifrank@cisco.com>

d3e0654a 16-Oct-2019 Peter Mikus <pmikus@cisco.com>

Ansible: Role cleanup

+ Separate and reuse role (better naming)
+ Cleanup in naming
+ Introduce defaults that can be overriden

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Iedaf7caba1d05a35a6f61cd21a483cdbc0073d32


tools/testbed-setup/ansible/cobbler.yaml
tools/testbed-setup/ansible/inventories/lf_inventory/group_vars/all.yaml
tools/testbed-setup/ansible/roles/docker/defaults/main.yaml
tools/testbed-setup/ansible/roles/docker/handlers/main.yaml
tools/testbed-setup/ansible/roles/docker/tasks/main.yaml
tools/testbed-setup/ansible/roles/docker/tasks/ubuntu_bionic.yaml
tools/testbed-setup/ansible/roles/docker/templates/docker.service.proxy.http
tools/testbed-setup/ansible/roles/docker/templates/docker.service.proxy.https
tools/testbed-setup/ansible/roles/kubernetes/defaults/main.yaml
tools/testbed-setup/ansible/roles/kubernetes/tasks/main.yaml
tools/testbed-setup/ansible/roles/kubernetes/tasks/ubuntu_bionic.yaml
tools/testbed-setup/ansible/roles/performance_tuning/files/90-csit
tools/testbed-setup/ansible/roles/performance_tuning/files/cpufrequtils
tools/testbed-setup/ansible/roles/performance_tuning/files/disable-turbo-boost.service
tools/testbed-setup/ansible/roles/performance_tuning/files/irqbalance
tools/testbed-setup/ansible/roles/performance_tuning/handlers/main.yaml
tools/testbed-setup/ansible/roles/performance_tuning/tasks/aarch64.yaml
tools/testbed-setup/ansible/roles/performance_tuning/tasks/main.yaml
tools/testbed-setup/ansible/roles/performance_tuning/tasks/turbo_boost.yaml
tools/testbed-setup/ansible/roles/performance_tuning/tasks/ubuntu_bionic.yaml
tools/testbed-setup/ansible/roles/performance_tuning/tasks/x86_64.yaml
tools/testbed-setup/ansible/roles/sut/tasks/ubuntu_bionic.yaml
tools/testbed-setup/ansible/roles/tg_sut/tasks/ubuntu_bionic.yaml
tools/testbed-setup/ansible/sut.yaml
tools/testbed-setup/ansible/tg.yaml
tools/testbed-setup/ansible/vpp_device.yaml
bf0ea7ae 15-Oct-2019 Peter Mikus <pmikus@cisco.com>

Core-keeper: Process files instead transfer

+ Instead of transferring large files, post-process directly
via CSIT. Extract backtrace as a start point.

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I79ad760d310c95d807242ad1997dd657d5142459

61ba4ad0 16-Oct-2019 Peter Mikus <pmikus@cisco.com>

Ansible: Clean Python requirements

+ minor cleanup

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Iff9c643f6e9b52dc6a11b04624452f115f3a834e

fba70865 09-Aug-2019 Peter Mikus <pmikus@cisco.com>

VPPD: GBP test case

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I020cdb6ced70a9c22773dfbe1662aecd2b744d2d

f4604e91 14-Oct-2019 Peter Mikus <pmikus@cisco.com>

Ansible: Mellanox install

+ OFED
+ ibdev2netdev
- aligning few naming conventions

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I0dff28b2cd4bbc4753597366d9b03b497fa336c4

1f2f4562 08-Oct-2019 Peter Mikus <pmikus@cisco.com>

Add: Parsing of show run over PAPI

+ Add parsing of show run over PAPI STATS
+ Add missing outputs vs show run over CLI

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I88555ff4266d41ae1d9436181aad5c324ea9dab4

de3dfa87 08-Oct-2019 Tibor Frank <tifrank@cisco.com>

Trending: Reorganization of tests in graphs

Change-Id: I41ddcb65d099294c5ae510b2a5f237de973e27b7
Signed-off-by: Tibor Frank <tifrank@cisco.com>

5d49bc99 10-Oct-2019 Tibor Frank <tifrank@cisco.com>

Trending: Generate email body for regressions and progressions

Change-Id: Iee652fc48b574b7866d5e7f0b7b927f96de3d25f
Signed-off-by: Tibor Frank <tifrank@cisco.com>

ddf4a203 09-Oct-2019 Jan Gelety <jgelety@cisco.com>

Update of VPP_STABLE_VER files

- use new vpp ref build - ubuntu 16.04:
20.01-rc0~375-g3ae9f5a~b8172

- use new vpp ref build - ubuntu 18.04:
20.01-rc0~375-g3ae9f5a90

- use new vpp ref build - centos7:
20.01-rc0~375_g3ae9f5a~b7986

Change-Id: I16cf7e9db8f5b6c4f94786b089a1686c823cc1bd
Signed-off-by: Jan Gelety <jgelety@cisco.com>

a9a3a18b 09-Oct-2019 Peter Mikus <pmikus@cisco.com>

FIX: Ansible

+ Cover all CSIT devices with netplan to prevent DHCP usage
+ Move netplan to common role

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Ic3790f8ff770edf64b4066f8ddb99454643f5846

18479dee 17-Sep-2019 haiyanX1.zhang <haiyanx1.zhang@intel.com>

Add vpp loadbalancer maglev mode test suite

Change-Id: I61555ba566efef0a2151db9a30bf7f5d9ccad1df
Signed-off-by: haiyanx1.zhang <haiyanx1.zhang@intel.com>

233fc0f5 07-Oct-2019 Peter Mikus <pmikus@cisco.com>

FIX: Add SRIOV cleanup

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I344cbab78e1491b1dc0b64598f1eae23c8d2cdcf

0f496f4c 04-Oct-2019 Tibor Frank <tifrank@cisco.com>

Trending: Send alerts when regression occurs

Change-Id: I45d218ea323245199ad5093bd64c6a9bd862cad9
Signed-off-by: Tibor Frank <tifrank@cisco.com>

f6a8c61f 07-Oct-2019 Peter Mikus <pmikus@cisco.com>

FIX: LXC tmpfs mount

- Should fix the read/write to socket for LXC

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I56a84145cf2fb95742423789681ca2e24ddf0c98

fdd42115 04-Oct-2019 Jan Gelety <jgelety@cisco.com>

FIX: put back the correct value of FAIL_ON_CRC_MISMATCH constant

Change-Id: Ia395cfbc5325d292bf8c32bb24e9a1478c140780
Signed-off-by: Jan Gelety <jgelety@cisco.com>

b38e5bc9 26-Sep-2019 Jan Gelety <jgelety@cisco.com>

Update of VPP_STABLE_VER files

- use new vpp ref build - ubuntu 16.04:
20.01-rc0~324-g66a332c~b8122

- use new vpp ref build - ubuntu 18.04:
20.01-rc0~324-g66a332cf1

- use new vpp ref build - centos7:
20.01-rc0~324_g66a332c~b7936

Change-Id: I82c6032742939417914f5210b1fba4464ab1e70d
Signed-off-by: Jan Gelety <jgelety@cisco.com>

fde4045b 07-Oct-2019 Tibor Frank <tifrank@cisco.com>

Report: Set the backgroud of graphs

Change-Id: Icd5f2ed496128b4cdc5f1113c778f66bbef5def3
Signed-off-by: Tibor Frank <tifrank@cisco.com>

917abf9a 04-Oct-2019 Peter Mikus <pmikus@cisco.com>

FIX: Add SRIOV cleanup

If Jenkins interrupt pybot during AVF tests (that is happening
more frequently as coverage increased) the interfaces remains
in link UP state. Next run VPP cannot grab interfaces as they
are in UP state in and kernel driver. This results in testcase
failing.

Patch is supposed to do put interfaces in topology down so VPP
can bind them back to vfio-pci.

Change-Id: I2aa9e5944d39474965eac3c5f1b472f58e9aa8b5
Signed-off-by: Peter Mikus <pmikus@cisco.com>

3691bd34 03-Oct-2019 Jan Gelety <jgelety@cisco.com>

FIX: use int of sw_if_index in call of sw_interface_set_flags api

- it will avoid situation that corresponding port is not up and
its sw_if_index value in topology file is None that is interpreted
as 0 in vpp api so it set flag for local0 interface

Change-Id: I9145077d787ddde50a29bcd4091035e95077f946
Signed-off-by: Jan Gelety <jgelety@cisco.com>

30c5d0cb 02-Oct-2019 Tibor Frank <tifrank@cisco.com>

Trending: Report also nr of passed tests in email

Change-Id: I7ae188f5f684bd93352255d6b5c491b6d78c822c
Signed-off-by: Tibor Frank <tifrank@cisco.com>

43e969af 27-Sep-2019 Tibor Frank <tifrank@cisco.com>

PAL: Set plot.ly version to 4.1.1

Change-Id: I137ee807a2802fa1f7b5b635e1162bf7fff07a57
Signed-off-by: Tibor Frank <tifrank@cisco.com>

2eb470aa 02-Oct-2019 Vratko Polak <vrpolak@cisco.com>

PAL: Accept reconf time in scientific notation

+ Otherwise "9.58828205237e-05" is understood as "9.58828205237".
+ Replace "[0-9]" with "\d".

Change-Id: I7ecf6d0116fe704ecdba46f3a0e7975aba79aa62
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

22909e95 26-Sep-2019 Jan Gelety <jgelety@cisco.com>

sw_interface_details api updated

- based on pending vpp api change: https://gerrit.fd.io/r/c/vpp/+/21490

Change-Id: I7d7425e8db3bf60ea3d9d7936ed3109c76247457
Signed-off-by: Jan Gelety <jgelety@cisco.com>

7b73d468 24-Jul-2019 premkumarv <preym17@gmail.com>

CSIT-1471: Policer - VAT API to PAPI

Change-Id: I6c7eff8d9cbb196ccb684a45579ac59942351cfe
Signed-off-by: premkumarv <preym17@gmail.com>

60f843d1 27-Sep-2019 Tibor Frank <tifrank@cisco.com>

Report: Fix: Legend in reconf tests

Change-Id: I04806de7bf02af6c9b2119c45e75f8e0bc88bdd7
Signed-off-by: Tibor Frank <tifrank@cisco.com>

c4e3e223 26-Sep-2019 Tibor Frank <tifrank@cisco.com>

Report: Reconf tests: set autorange for y axis

Change-Id: Ie1ba26d3d76a8905698d0be33e9c5e61daff0e48
Signed-off-by: Tibor Frank <tifrank@cisco.com>

1b95782e 13-Sep-2019 Vratko Polak <vrpolak@cisco.com>

Add support for HDRhistogram

+ Enable hdrh in trex server.
+ Append hdrh coded output after min/avg/max/.
+ Read (not show nor decode) hdrh value in PAL.
+ Also, remove old ndrpdrdisc code.

Change-Id: I99d99f10386a621772b5419ca1f36080fa15aca7
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

bab0b570 23-Sep-2019 Vratko Polak <vrpolak@cisco.com>

Reconf tests: Fix async measurements

TRex does not zero the server counters.
It copies the values to use as reference,
and subtracts them when asked for results.

But the reference is stored in the client (not the server).
And CSIT uses different scripts to start and stop async traffic,
which means different clients.

This patch introduces a workaround.
Async start will return xstats objects to use as reference,
and async stop will use the objects to compute the correct results.
The xstats objects are stored in TrafficGenerator instance.
Sync measurement does not export the counters, to shorten logs.

Other improvements:
+ Make stop_traffic_on_tg return measurement results directly.
+ Rename --async to --async_start as "async" is reserved in Python 3.7
+ Minor pylint, docstring and typo fixes.

Change-Id: I5fc56a0763afb7d62cfa7c0651f96b6867de3e15
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

c7c31d5a 18-Sep-2019 Vratko Polak <vrpolak@cisco.com>

PAL: Fix unit for packets lost

+ update the static content

Change-Id: I8c4852195e09d7b00555ebb4a7378743c3df45f2
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

947774b2 19-Sep-2019 Vratko Polak <vrpolak@cisco.com>

Bump stable_vpp and fix CRC list

+ Two API merges happened on VPP side, CSIT list was prepared wrong.
+ Removed the secondary collection, as no open change is supported.

Change-Id: I2e2472c8a2fe50190c11c7441982aa2881e9b8a5
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

aafa2efa 31-Aug-2019 Nidhy <nidhyanandhan.a@hcl.com>

LISP: 3-node (func) to 2-node (dev) converstion

Change-Id: I0fbe4d9ef1b30a1ac1382ea43b5b52aeb8a7d39f
Signed-off-by: Nidhy <nidhyanandhan.a@hcl.com>

a295b175 12-Sep-2019 Jan Gelety <jgelety@cisco.com>

CSIT-1597 API cleanup: cop

cover API changes in VPP: https://gerrit.fd.io/r/c/vpp/+/21458

Change-Id: I596cfcd192bf48b0d0a91b1953746a484e2c9793
Signed-off-by: Jan Gelety <jgelety@cisco.com>

3e0d781e 13-Sep-2019 Vratko Polak <vrpolak@cisco.com>

Fix errors found by pylint

Change-Id: I0c2bee5a1ff8ad29e47c4f947388e7b97dd17fff
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

73cabdc8 17-Sep-2019 Tibor Frank <tifrank@cisco.com>

Report: Enable pdf version

Change-Id: I2c88a8b5939cbe4498d5bc44de3618cb717a9a7f
Signed-off-by: Tibor Frank <tifrank@cisco.com>

8b1bead7 17-Sep-2019 Vratko Polak <vrpolak@cisco.com>

Update CRC list and support 21997/7

- Attempt to repair IPsec LispGpe perf suite.
+ Collection name to reflect the current stable vpp.
+ Add messages found in CSIT L1 keywords.
- Uncommented (instead of deleted) untestable messages. Reasons:
- Honeycomb.
- Messages used by unused keywords.
+ Listed reasons. Honeycomb not mentioned if both reasons apply.
+ Delete CRC items for commands not found in keywords anymore.
+ Add CRCs from .json.api files (as teardown is hard to execute).
+ Define and restore alphabetical order.
+ Add hints to find used API commands (not entirely reliable).
+ Move used commands to "cmd = " form so hints find them.
+ Argument to run_cli_command changed from "cmd" to "cli_cmd".
+ Except also struct.error where IOError is excepted.

Change-Id: I61058dbe1e33296908aabd0c13433bb16cfa6adf
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

dcf25d4a 16-Sep-2019 Tibor Frank <tifrank@cisco.com>

Trending: Fix removing of old input files

Change-Id: I67ff7944a1eb576bd6e739202a94eb12be9e0e1b
Signed-off-by: Tibor Frank <tifrank@cisco.com>

73ec7448 15-Sep-2019 Tibor Frank <tifrank@cisco.com>

Trending: Reduce input data

Change-Id: I6b3bdac6941d85792987e2bc7e75cb8bc0be4f4a
Signed-off-by: Tibor Frank <tifrank@cisco.com>

48b37104 13-Sep-2019 Tibor Frank <tifrank@cisco.com>

Report: Add data

Change-Id: Ibef7599c5438624512d547af25b2026580e2bc92
Signed-off-by: Tibor Frank <tifrank@cisco.com>

9efba1d5 13-Sep-2019 Peter Mikus <pmikus@cisco.com>

FIX: Pylint + Container mount

- Mount is affecting only LXC container

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I84140ea5e48120792fc84182a97eb7d06c954a84

e2d15edc 13-Sep-2019 Tibor Frank <tifrank@cisco.com>

Report: Fixes

Change-Id: Id14704f3c1526655adeaa51f0a4198b6309a64eb
Signed-off-by: Tibor Frank <tifrank@cisco.com>

8be5c348 12-Sep-2019 Vratko Polak <vrpolak@cisco.com>

CRC checker: Sort and indent dict output

Also, use double quotes, so the dict is shown
not only as a valid Python code, but also a valid JSON.
This should make it easier to handle big CRC changes such as:
https://logs.fd.io/production/vex-yul-rot-jenkins-1
/vpp-csit-verify-api-crc-master/646/console.log.gz

+ Log indented message about CRC conflict to console even on failure,
as in the exception, endlines are escaped.

Change-Id: If4fe3003f612d4b0c156004a0aa2dab088e50723
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

17220bfc 13-Sep-2019 Tibor Frank <tifrank@cisco.com>

Report: Add data

Change-Id: I589a236919af913bb37d2db3b4079b16f1e64242
Signed-off-by: Tibor Frank <tifrank@cisco.com>

4fa06bcf 06-Sep-2019 Vratko Polak <vrpolak@cisco.com>

Support unidirection in all searches

+ Rename bool unidirection to int traffic_directions.
+ Rename "untagged" to "initial" for bandwidth calculation.
+ Fix latency measurement for unidirectional traffic.
+ Remove duplicate colon in soak test message.
+ Edit PAL to accept both forms.
+ Fix minor documentation issues.

Change-Id: I6c76f2dc090ae493f2fbd7e9ccd45229d2306dea
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

84bbb1ef 12-Sep-2019 Vratko Polak <vrpolak@cisco.com>

CRC list: Compatible collection for 21997

Change-Id: I749d0164e9397769fc178f20eefe88b952e295d4
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

8f03b515 12-Sep-2019 Tibor Frank <tifrank@cisco.com>

Report: Add nfv reconf

Change-Id: If773f5d05c845b0d15bd8f60a44a36adcbf65b82
Signed-off-by: Tibor Frank <tifrank@cisco.com>

a6d9745a 11-Sep-2019 Vratko Polak <vrpolak@cisco.com>

Skip CRC checking by default

During https://gerrit.fd.io/r/c/ci-management/+/21955
we decided this new default is more convenient for development.

Change-Id: I07f10cbb586e79f6ac714ad635dda35561c07125
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

5979e102 11-Sep-2019 Tibor Frank <tifrank@cisco.com>

PAL: Add NFV reconf tests

Change-Id: I6fe36f05423c3c43081872153adf0f1a899381b6
Signed-off-by: Tibor Frank <tifrank@cisco.com>

c77230ed 12-Sep-2019 Tibor Frank <tifrank@cisco.com>

Report: Temporarily remove pdf version

Change-Id: Iab5909defc86ec31ba726eb2a1a4b6530cf7d63d
Signed-off-by: Tibor Frank <tifrank@cisco.com>

6a80c902 11-Sep-2019 Peter Mikus <pmikus@cisco.com>

TRex: 2.61

- HDRhistogram can be rebased and used in separate patch.

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Ic7ce752344c6e1791af7cf7b7effde65ac2be680

45882a27 11-Sep-2019 Peter Mikus <pmikus@cisco.com>

Topology: Cascadelake

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I1533f00dd4b40f9dda82b1e9b5b15a81bbb9f7fb

e248c3fd 12-Sep-2019 Tibor Frank <tifrank@cisco.com>

Report: Configure 1908.38

Change-Id: I0239e6c567c50c211ddabffa4b1bf22cdcec6462
Signed-off-by: Tibor Frank <tifrank@cisco.com>

f0d7edd5 11-Sep-2019 Vratko Polak <vrpolak@cisco.com>

Revert "API cleanup: tap" and bump stable_vpp

The VPP change got a temporary -1,
as other change has higher priority.

Bumping stable VPP version, so this passes verify right away.

This reverts commit ae62a4348f7de53cfb91a5ae25a10723d5f9b398.

Change-Id: If2813b0e41451a3a9e7f8b1512521cf508ac92c7
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

ae62a434 03-Sep-2019 Jan Gelety <jgelety@cisco.com>

CSIT-1597 API cleanup: tap

cover API changes in VPP: https://gerrit.fd.io/r/c/vpp/+/21706

Change-Id: I16b3e3e29e7e7491cd19c067e8f3d8ced4947852
Signed-off-by: Jan Gelety <jgelety@cisco.com>

e7a8aec5 04-Sep-2019 Jan Gelety <jgelety@cisco.com>

CSIT-1597: API cleanup: bond

Change-Id: I7c2a29cfe48eee521cce5fcc3506cef39d51d37b
Signed-off-by: Jan Gelety <jgelety@cisco.com>

b8247487 10-Sep-2019 Peter Mikus <pmikus@cisco.com>

Ansible: Cascadelake include

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Iecb18e9d94ff715e40152564fb778650d43a48d3

2fe2a2c1 11-Sep-2019 Tibor Frank <tifrank@cisco.com>

Report: Remove NFV full data

Change-Id: I51402892df91cfc5e8f2c18f18ef67bab634bcdf
Signed-off-by: Tibor Frank <tifrank@cisco.com>

891f932d 10-Sep-2019 Peter Mikus <pmikus@cisco.com>

Ansible: Trex installation

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I5ab8fe05074a842301a511bbd3ab5e67f8d1a9f0

27cff254 11-Sep-2019 Tibor Frank <tifrank@cisco.com>

Report: Add data

Change-Id: I2092c6420a40e1c3199183e580f00eaca37706c6
Signed-off-by: Tibor Frank <tifrank@cisco.com>

d44bf1d0 10-Sep-2019 Tibor Frank <tifrank@cisco.com>

Report: Add pdf version

Change-Id: I8897a6ef87b3813db0485fa081fdd44b4e501e41
Signed-off-by: Tibor Frank <tifrank@cisco.com>

4dc7d6cc 06-Sep-2019 Tibor Frank <tifrank@cisco.com>

PAL: Add replacing of data in tables

+ vhost data

Change-Id: I86fc97ba5c3b0feffec2dfb0ac11c5d3c9d53a81
Signed-off-by: Tibor Frank <tifrank@cisco.com>

c4528bcd 30-Aug-2019 Peter Mikus <pmikus@cisco.com>

Refactor getting telemetry

+ Ability to get stats from CNF via SocketPAPI
- Remove obsolete functions

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I4d1b32a7279244592be96644e4f8a530c4f29a15

ccf72b55 04-Sep-2019 Jan Gelety <jgelety@cisco.com>

FIX: correct crc for sw_interface_slave_details

Change-Id: I4baae7da6f8fef8bd65f08e28fa1b55fb81857ce
Signed-off-by: Jan Gelety <jgelety@cisco.com>

2b67e806 03-Sep-2019 Jan Gelety <jgelety@cisco.com>

API cleanup: memif

Change-Id: I4a2d4719dfa7c993c54b278a0093ea833307bb87
Signed-off-by: Jan Gelety <jgelety@cisco.com>

34b6e0c1 04-Sep-2019 Jan Gelety <jgelety@cisco.com>

Update of VPP_STABLE_VER files

- use new vpp ref build - ubuntu 16.04:
20.01-rc0~159-gb736e75~b7951

- use new vpp ref build - ubuntu 18.04:
20.01-rc0~159-gb736e75d5

- use new vpp ref build - centos7:
20.01-rc0~159_gb736e75~b7759

Change-Id: I4def341aad97cb039c11ec45be2846d0fb691435
Signed-off-by: Jan Gelety <jgelety@cisco.com>

80fd7db8 08-Sep-2019 Tibor Frank <tifrank@cisco.com>

Report: Add dnv mrr data

Change-Id: I3dcc813dce7b8938be6b2caaaf1e64ce9abb7fe9
Signed-off-by: Tibor Frank <tifrank@cisco.com>

620774fd 08-Sep-2019 Tibor Frank <tifrank@cisco.com>

Report: Fix tsh and dnv plots

Change-Id: I1d40849bc15f4433117af91f71e951a61924d732
Signed-off-by: Tibor Frank <tifrank@cisco.com>

ba14f2b0 09-Sep-2019 Tibor Frank <tifrank@cisco.com>

Report: Add soak tests

Change-Id: I2161c8d8e54cfa35cd3febdda1cb47d6cec424a0
Signed-off-by: Tibor Frank <tifrank@cisco.com>

a9a5d0de 05-Sep-2019 Vratko Polak <vrpolak@cisco.com>

Support new sw_interface_slave_details CRC

Change-Id: I2f72a741ac7353ad36f6a2dada26eabb1a76cb2e
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

e310a40e 05-Sep-2019 Vratko Polak <vrpolak@cisco.com>

Read environment variables in Constants.py

Instead of using EnsureGlobalVariable,
which is clunky to use from Python.

As a consequence, all caps variables from Constants.py are used directly
and tests/__init__.robot and robot_enhancements.robot are deleted.

+ Rename the CRC global kill switch based on ci-man review.

Change-Id: I10723792475bc83352bf8c3b7f7946ecf885a194
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

1082d79a 06-Sep-2019 Tibor Frank <tifrank@cisco.com>

Report: Add 3n-dnv plots and tables

Change-Id: I6b65231f928b6168e0696f35fc253ce513163e50
Signed-off-by: Tibor Frank <tifrank@cisco.com>

99219815 05-Sep-2019 Tibor Frank <tifrank@cisco.com>

Report: Add 2n-dnv plots and tables

Change-Id: Ibbd1775bec26817a4c193bc67ba03b29b8ddfff7
Signed-off-by: Tibor Frank <tifrank@cisco.com>

3eb09745 05-Sep-2019 Tibor Frank <tifrank@cisco.com>

Report: Add DNV data

Change-Id: I020373b1553300459654ded31d940b0a5562eb8a
Signed-off-by: Tibor Frank <tifrank@cisco.com>

2570a7fa 04-Sep-2019 Vratko Polak <vrpolak@cisco.com>

Allow CRC checking to be controlled via env var

The plan is to override the default in some (but not all) jobs.
The csit-vpp jobs shall do the checking, but vpp-csit jobs shall not
(except api-crc job of course) in order to confirm benign changes.

Change-Id: If59d17991de3fb0e847113a87e0533a8ee62af7f
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

4751baad 05-Sep-2019 Tibor Frank <tifrank@cisco.com>

Report: Fix listing order of new vs. see footnote

Change-Id: I01426c3e4d40af0902e7776088e0489e141a2362
Signed-off-by: Tibor Frank <tifrank@cisco.com>

ac02e01b 05-Sep-2019 Tibor Frank <tifrank@cisco.com>

Report: Fix hsw vs. skx comparison table

Change-Id: Id16b161ad27102891a58d084185d17a2b8fcae6a
Signed-off-by: Tibor Frank <tifrank@cisco.com>

d7813d33 05-Sep-2019 Tibor Frank <tifrank@cisco.com>

Report: Configure Report 1908.37

Change-Id: I1d883dbb299ecef151c7d7a9c5612ae0330e3538
Signed-off-by: Tibor Frank <tifrank@cisco.com>

474034ac 02-Sep-2019 Jan Gelety <jgelety@cisco.com>

FIX: Use vhost macs when testpmd_mac forwarding used in VM

Change-Id: I291c3dc852e7c1bde6fb6102a9168cfec9992682
Signed-off-by: Jan Gelety <jgelety@cisco.com>

a5629ca2 02-Sep-2019 Vratko Polak <vrpolak@cisco.com>

Clarify why 9000B tests are skipped for IPsec

Ticket: VPP-1207

Change-Id: I506b4a24dfa6b10578407b261926f37215a714f4
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

005cef5c 04-Sep-2019 Vratko Polak <vrpolak@cisco.com>

Hotfix: Bump version and CRCs

Naginator caused a false Verified+1,
so a benign API change had been merged prematurely.

Change-Id: I8852ca684cba4876d46049ca34204ebbccf96b2e
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

7d7d7ff6 03-Sep-2019 Maciek Konstantynowicz <mkonstan@cisco.com>

docs: added 3n-tsh testbed tests to report_test_groups.txt

Change-Id: Ib2249ce6c28f4c07878eb5fc2919c56dd8637376
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>

d53a4da7 04-Sep-2019 Tibor Frank <tifrank@cisco.com>

Report: ixgbe for tsh

Change-Id: I707a654b8853926f4cb1b78f3c65b55925e95ac1
Signed-off-by: Tibor Frank <tifrank@cisco.com>

4be26a2f 04-Sep-2019 Tibor Frank <tifrank@cisco.com>

Report: Add data

Change-Id: I6a32e0bdd1a693550214e7bea49b76313449f24d
Signed-off-by: Tibor Frank <tifrank@cisco.com>

6a5bc78e 03-Sep-2019 Tibor Frank <tifrank@cisco.com>

Report: Comparison tables

Change-Id: I108e1292c5de8024060c220b877b668b8843c68f
Signed-off-by: Tibor Frank <tifrank@cisco.com>

92d09115 03-Sep-2019 Tibor Frank <tifrank@cisco.com>

Report: Comparison tables

Change-Id: I90f635f62573154e37a319ca1cbb760401d17c05
Signed-off-by: Tibor Frank <tifrank@cisco.com>

ac688f80 03-Sep-2019 Tibor Frank <tifrank@cisco.com>

Report: Comparison tables

Change-Id: Ib4132c4d25f6a7c936793f403877a5819a6dd55a
Signed-off-by: Tibor Frank <tifrank@cisco.com>

54b25e85 03-Sep-2019 Tibor Frank <tifrank@cisco.com>

Report: add data

Change-Id: I51fd0b9e07d09224452f842689925d1166246f19
Signed-off-by: Tibor Frank <tifrank@cisco.com>

259620ea 03-Sep-2019 Tibor Frank <tifrank@cisco.com>

CSIT-1590: Performance comparison analysis

Change-Id: I802b5b9cbeb486587f395aeca76cbe3df68b40c4
Signed-off-by: Tibor Frank <tifrank@cisco.com>

3e5dbfab 03-Sep-2019 Tibor Frank <tifrank@cisco.com>

CSIT-1590: Performance comparison analysis

Change-Id: I09d502fcd7b286e41b141e43933bcf09262a8749
Signed-off-by: Tibor Frank <tifrank@cisco.com>

ff320177 02-Sep-2019 Tibor Frank <tifrank@cisco.com>

PAL: list all sel tests in table_performance_comparison

Change-Id: I99ccbca3e56a58a662c569d195ecdef20d3ea348
Signed-off-by: Tibor Frank <tifrank@cisco.com>

0a67083b 02-Sep-2019 Tibor Frank <tifrank@cisco.com>

PAL: list all sel tests in table_performance_comparison_nic

Change-Id: I21bb76aab4a1e627a13057f896ea7bfc34c03463
Signed-off-by: Tibor Frank <tifrank@cisco.com>

6d981f51 02-Sep-2019 Tibor Frank <tifrank@cisco.com>

Report: Add data

Change-Id: If799a7a1d1b8f6ea59ebfba3dd4724b09e7680f2
Signed-off-by: Tibor Frank <tifrank@cisco.com>

a7886e48 01-Sep-2019 Tibor Frank <tifrank@cisco.com>

Report: Add 3n-tsh

Change-Id: I6027b635191c7e64397915df8944699bb320daf3
Signed-off-by: Tibor Frank <tifrank@cisco.com>

97881b4e 26-Aug-2019 Jan Gelety <jgelety@cisco.com>

Report: functional tests static content

Change-Id: I17238ff6d1760f6a956459e072ba0303abef3199
Signed-off-by: Jan Gelety <jgelety@cisco.com>

603931f0 30-Aug-2019 Tibor Frank <tifrank@cisco.com>

Report: Add data

Change-Id: Ie9350530879fef7d2ae8c0b58f6fd799fde9fff8
Signed-off-by: Tibor Frank <tifrank@cisco.com>

25827ae5 28-Aug-2019 Maciek Konstantynowicz <mkonstan@cisco.com>

presentation: fixed suite names 10ge>25ge, 10ge>40ge based on nic model.

Change-Id: I90dd569ce42fe6bf29751ca29086fe458d40a095
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>

a907de58 28-Aug-2019 Tibor Frank <tifrank@cisco.com>

Report: Add data

Change-Id: I5ae5fa7cb40ddc31e3fe3fd0d6182bf54c84ad00
Signed-off-by: Tibor Frank <tifrank@cisco.com>

f18bab9d 26-Aug-2019 Jan Gelety <jgelety@cisco.com>

Report: Add data

Change-Id: I66c91e083138b50a575cbbd32d309d0c198e6a71
Signed-off-by: Jan Gelety <jgelety@cisco.com>

e895f7fa 27-Aug-2019 Ludovit Mikula <ludovit.mikula@pantheon.tech>

NEW: Added trex profiles for 60k ip4 destinations.

Signed-off-by: Ludovit Mikula <ludovit.mikula@pantheon.tech>
Change-Id: Ib9e42914ad5ab6bf0febea3edbeea8d09c8918b1

6cdc335b 22-Aug-2019 Vratko Polak <vrpolak@cisco.com>

Delete unused SR keywords

Trim both Python (L1) and Robot (L2) keywords,
as no test performs SR related deletions.

Change-Id: Ic76d870c3f58e927ea222b350e149d0770985072
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

823e79ac 27-Aug-2019 Tibor Frank <tifrank@cisco.com>

Report: Add data

Change-Id: I534cbb4141b60609387f894e51c429e368520a23
Signed-off-by: Tibor Frank <tifrank@cisco.com>

ac37499e 26-Aug-2019 Ludovit Mikula <ludovit.mikula@pantheon.tech>

- Removed 9000B test cases from ipsec test suites.
- Added new traffic profiles.

Signed-off-by: Ludovit Mikula <ludovit.mikula@pantheon.tech>
Change-Id: Ie06b7a1cf4d9df403d098b7a495219fd95e5869e


libraries/python/autogen/Regenerator.py
traffic_profiles/trex/trex-sl-3n-ethip4-ip4dst1000-1cnf.py
traffic_profiles/trex/trex-sl-3n-ethip4-ip4dst1000-2cnf.py
traffic_profiles/trex/trex-sl-3n-ethip4-ip4dst1000-4cnf.py
traffic_profiles/trex/trex-sl-3n-ethip4-ip4dst1000-8cnf.py
traffic_profiles/trex/trex-sl-3n-ethip4-ip4dst10000-1cnf.py
traffic_profiles/trex/trex-sl-3n-ethip4-ip4dst10000-2cnf.py
traffic_profiles/trex/trex-sl-3n-ethip4-ip4dst10000-4cnf.py
traffic_profiles/trex/trex-sl-3n-ethip4-ip4dst10000-8cnf.py
traffic_profiles/trex/trex-sl-3n-ethip4-ip4dst20000-1cnf.py
traffic_profiles/trex/trex-sl-3n-ethip4-ip4dst20000-2cnf.py
traffic_profiles/trex/trex-sl-3n-ethip4-ip4dst20000-4cnf.py
traffic_profiles/trex/trex-sl-3n-ethip4-ip4dst20000-8cnf.py
traffic_profiles/trex/trex-sl-3n-ethip4-ip4dst4-1cnf.py
traffic_profiles/trex/trex-sl-3n-ethip4-ip4dst4-2cnf.py
traffic_profiles/trex/trex-sl-3n-ethip4-ip4dst4-4cnf.py
traffic_profiles/trex/trex-sl-3n-ethip4-ip4dst40-1cnf.py
traffic_profiles/trex/trex-sl-3n-ethip4-ip4dst40-2cnf.py
traffic_profiles/trex/trex-sl-3n-ethip4-ip4dst40-4cnf.py
traffic_profiles/trex/trex-sl-3n-ethip4-ip4dst40-8cnf.py
traffic_profiles/trex/trex-sl-3n-ethip4-ip4dst400-1cnf.py
traffic_profiles/trex/trex-sl-3n-ethip4-ip4dst400-2cnf.py
traffic_profiles/trex/trex-sl-3n-ethip4-ip4dst400-4cnf.py
traffic_profiles/trex/trex-sl-3n-ethip4-ip4dst400-8cnf.py
traffic_profiles/trex/trex-sl-3n-ethip4-ip4dst40000-1cnf.py
traffic_profiles/trex/trex-sl-3n-ethip4-ip4dst40000-2cnf.py
traffic_profiles/trex/trex-sl-3n-ethip4-ip4dst40000-4cnf.py
traffic_profiles/trex/trex-sl-3n-ethip4-ip4dst40000-8cnf.py
traffic_profiles/trex/trex-sl-3n-ethip4-ip4dst5000-1cnf.py
traffic_profiles/trex/trex-sl-3n-ethip4-ip4dst5000-2cnf.py
traffic_profiles/trex/trex-sl-3n-ethip4-ip4dst5000-4cnf.py
traffic_profiles/trex/trex-sl-3n-ethip4-ip4dst5000-8cnf.py
a6d233d8 23-Aug-2019 Vratko Polak <vrpolak@cisco.com>

Stop using SSH() in TrafficGenerator.py

This is a partial fix for:
Ticket: CSIT-1434
and should fix one pylint violation.
Many files to remove SSH() from remain.

+ Use -E (together with previous -S) in ssh.py when sudo=True.
Needed in some cases, no downsides expected.

Change-Id: Ie2ad03b3c656a4d3965a61a1e5435276f99a28c0
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

479b30c1 26-Aug-2019 Tibor Frank <tifrank@cisco.com>

Report: tables

Change-Id: Ideec743ae10909d91625ea5cfc7901624459f455
Signed-off-by: Tibor Frank <tifrank@cisco.com>

320f82cc 26-Aug-2019 Tibor Frank <tifrank@cisco.com>

Report: NFV

Change-Id: Idf369766cb9acf82475b1d86860d72077b88dc35
Signed-off-by: Tibor Frank <tifrank@cisco.com>

af4d3ba0 26-Aug-2019 Tibor Frank <tifrank@cisco.com>

Report: Tables

Change-Id: I5084163758c5f15f482c6c8e08ee70c4a4f50431
Signed-off-by: Tibor Frank <tifrank@cisco.com>

db49a120 26-Aug-2019 Tibor Frank <tifrank@cisco.com>

Report: Modify comparison tables, add data

Change-Id: I6d5e7cc0618a5b1889ab54c020fd98c661d20989
Signed-off-by: Tibor Frank <tifrank@cisco.com>

33cfe121 19-Aug-2019 Tibor Frank <tifrank@cisco.com>

Report: Select tests by name, specifications

Change-Id: Ibcc5e67d49fba9c02b07af462a74d2a062412979
Signed-off-by: Tibor Frank <tifrank@cisco.com>

ff820e3d 23-Aug-2019 Vratko Polak <vrpolak@cisco.com>

Introduce reconfig suites, for dot1q+ip4+vxlan

Ticket: CSIT-1551

+ Config copied from other suites.
+ Layer keywords prepared for additional chains.
+ Renamed "create" argument to "vlan_per_chain".
+ TrafficGenerator result extraction improvements.
+ Also unified TG type and subtype checking.
+ Throughput estimated as PDR for zero PLR.
+ Actual Qemu start is skipped.
+ Parse xstats instead of stats in trex stop scipt.
- Because stats are unconditionally cleared on each script connect.
+ Remember start values to get better ReceiveMeasurementResult at stop.
+ Expose loss count and time as appropriate test message.
+ Autogen support.
+ Multiple chain amounts and core densities.
- Only 1 additional chain.
+ Proper TAGs. Documented.
+ Clarified min framesize tags are for TG-DUT.
+ Added a TODO concerning overhead values.
+ Added 118B tag.
+ Robot performance keywords improvements.
+ Added missing return value documentation.
+ Frame size as required test variable, not an explicit argument.
+ MLRsearch keyword to store result (not into test message).
- TODO: De-duplicate: main keyword to measure, minor to set test message.
- But implementation uses the fact default arguments are different.
+ Keywords for starting and stopping background traffic.
- No checks whether start-stop pair is complete.
+ Multiple minor indentation and logging improvements.
- Missing / TODOs:
- Support also vlan_per_chain=True?
- Support dot1q without vxlan?
- Support also deletion?
- How to package config steps so -reconf can be generated from -ndrpdr?

Change-Id: If0270697f9ffa837c34ef802917220a53f156703
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

fbbc4735 22-Aug-2019 Vratko Polak <vrpolak@cisco.com>

Improve PLRsearch yet again

Logic improvements for rls1908 and post-pylint fixes:

+ Reduce search time to 30 minutes.
+ Use average instead alternating loads.
+ Rework log/exp avg/stdev from two estimates.
+ Introduce and use pessimistic variance of dual trackers.
+ Introduce safe_exp to use when None does not skip code.
+ Use dot relative imports (instead of disabling pylint).
+ Complete docstrings for simpler functions.
+ Append docstrings to named tuples.
+ Somewhat unify docstrings related to the same arguments.
+ Slightly improve intentation.
+ State named tuples as rtype where used.
+ Add returns and rtype to __repr__ where missing.
+ Return what docstring say (or update them).
+ Explicit copying for vector and matrix values.

Change-Id: I884c68b4839c5df5e8bef95e463666599603a0ff
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

44aaf848 22-Aug-2019 Vratko Polak <vrpolak@cisco.com>

Update CRC list comments

+ Add testcases and tag expressions for perf occurrences.
+ Add TNL_1 tag for single tunnel IPsec suites.
- Some CRCs were missing before, but form a pair with a listed CRC.
- Probably the other half of the pair is not used.
- Will be fixed in subsequent Change.

Change-Id: I5754210755c13c41226b71045813714a65a1cdf3
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

719a8466 20-Aug-2019 Tibor Frank <tifrank@cisco.com>

Report: Specify groups of tests for graphs

Groups of tests for graphs:
- Packet Throughput
- Packet Latency
- Speedup Multi-Core

Change-Id: Ib37c1231abb63c234fb1e98d059bb3338133da0c
Signed-off-by: Tibor Frank <tifrank@cisco.com>

91051c28 15-Aug-2019 Miroslav Los <miroslav.los@pantheon.tech>

Framework: simplify CpuUtils

Signed-off-by: Miroslav Los <miroslav.los@pantheon.tech>
Change-Id: I7682d802f405070e34f72bc4a80cbe6a63b03619

a0a1bdba 20-Aug-2019 Peter Mikus <pmikus@cisco.com>

Add: avf-dot1q testcases

+ Few fixes in doc
+ Align testcases

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I5575db8255a74fd46f37d5cc2637b9b4448bcd7f

b6cd8aba 20-Aug-2019 Vratko Polak <vrpolak@cisco.com>

Fix Initialize layer dot1q on node

By using Get Variable Value keyword.

Change-Id: I3a9650b6f802d60422ffa6b6b00d444ebb050d89
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

4ea7fa51 19-Aug-2019 Vratko Polak <vrpolak@cisco.com>

Bump stable vpp version to 20.01-rc0~68

After API change.
CSIT: https://gerrit.fd.io/r/c/csit/+/21245
VPP: https://gerrit.fd.io/r/c/vpp/+/18361

+ Add ip_probe_neighbor_reply CRC, not sure how that got missing.

Change-Id: I790875dab771981af3b9eceac5425d4d2f374984
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

a46ab8cc 07-Aug-2019 Jan Gelety <jgelety@cisco.com>

Interface API cleanup

CSIT code alignment with API changes in VPP introduced
by patch https://gerrit.fd.io/r/c/vpp/+/18361

Change-Id: Ib0357bba79f55d297ef1086fbf3b760caca16cdb
Signed-off-by: Jan Gelety <jgelety@cisco.com>
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

329e0ace 19-Aug-2019 Peter Mikus <pmikus@cisco.com>

Align NF_denisty tests

+ Apply layer approach for interfaces

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I6c1898b9833f9f42b8912f1b521e30093360d7ea

103d029d 19-Aug-2019 Vratko Polak <vrpolak@cisco.com>

VPP perf per patch: Reverse the order of tests

If current VPP is broken, we want to fail early.
If there is API change, we are more interested in current results,
even if parent is likely to fail.

Change-Id: I552485bbb9fe0053bae39de7939f94a5971bb63b
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

ae7dc001 16-Aug-2019 Vratko Polak <vrpolak@cisco.com>

Autogen: Create NICs for TCP suites.

+ Put Regenerator internal functions ourside class.
+ Duplicate into _default_ and _tcp_ functions.
+ Rework Testcase to be a single class with two factories.
+ Improve suite and testcase naming.

Change-Id: I1f835b576c476c1a40c8c52469b1876695f9ae73
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

144ebec2 16-Aug-2019 Tibor Frank <tifrank@cisco.com>

PAL: Select tests by name, functions

- throughput
- latency
- speedup

Change-Id: Ia8b33815f5bbb7b0fb50b23e7655068928733832
Signed-off-by: Tibor Frank <tifrank@cisco.com>

42c64b70 19-Aug-2019 Tibor Frank <tifrank@cisco.com>

Report: Add data

- DPDK

Change-Id: Ibc45c49e34b2b0abe0f0a9f3304ee478c174c01e
Signed-off-by: Tibor Frank <tifrank@cisco.com>

039a71a9 19-Aug-2019 Tibor Frank <tifrank@cisco.com>

PAL: Get DPDK version from output_info.xml

Change-Id: I922c8143df39025cc0a78047f3cef7b9f5673b4b
Signed-off-by: Tibor Frank <tifrank@cisco.com>

b1385ce4 15-Aug-2019 Miroslav Los <miroslav.los@pantheon.tech>

Framework: MLRSearch refactor of ndrpdr

Signed-off-by: Miroslav Los <miroslav.los@pantheon.tech>
Change-Id: I86bc69f8b2f38b58cb3eb030bec7d0ce5c79d040

281b230b 16-Aug-2019 Miroslav Los <miroslav.los@pantheon.tech>

Framework: Refactor complex functions in PLRSearch

Signed-off-by: Miroslav Los <miroslav.los@pantheon.tech>
Change-Id: Ie2f19a2e3b37e8d85656ab31ece59b89c76bea25

00b3327c 19-Aug-2019 Peter Mikus <pmikus@cisco.com>

FIX: Missing ACL library

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I1497a9b031603d09d69a29ed7167686848d4b7c5

f893de60 19-Aug-2019 Tibor Frank <tifrank@cisco.com>

Write DPDK version to log

Change-Id: Ia9ec0d420c8db9e71234f74e4013c21d039931b2
Signed-off-by: Tibor Frank <tifrank@cisco.com>

db24a2e6 16-Aug-2019 Peter Mikus <pmikus@cisco.com>

FIX: Topology reservation

Last attempt [0] is doing more harm then good. If testbed is down
but recovered quickly enough (reboot, temporary ssh connectivity
issue, ...) it never gets back into pool making other testbeds
overloaded and queued.

This patch is suppose to partially revert previous behavior until
proper patch will follow.

[0] https://gerrit.fd.io/r/c/csit/+/21148

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I8203946d10d3e7dd51e97519d679246b5dae59e3

94bcde24 16-Aug-2019 Peter Mikus <pmikus@cisco.com>

FIX: Small errors in ansible

- that prevents installation

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I4fe4694ab7479481481aacc2eb550058bd7618e6

859a3f72 16-Aug-2019 Tibor Frank <tifrank@cisco.com>

PAL: Process show runtime output 3

- format the table

Change-Id: I871251a8329e5d52c527c93afe35d875bddaed0c
Signed-off-by: Tibor Frank <tifrank@cisco.com>

7da9d215 16-Aug-2019 Tibor Frank <tifrank@cisco.com>

PAL: Process show runtime output 2

- format the tables

Change-Id: I31f786d53b79fa14c5d2dc21ff65d0465fde1d4f
Signed-off-by: Tibor Frank <tifrank@cisco.com>

4f449c75 14-Aug-2019 Miroslav Los <miroslav.los@pantheon.tech>

Refactor traffic profile verification

- CSIT-1194

Signed-off-by: Miroslav Los <miroslav.los@pantheon.tech>
Change-Id: I0f4c234fb5f5f6543a5d525301f17f5a111e1053

3e58c2f9 15-Aug-2019 Tibor Frank <tifrank@cisco.com>

PAL: Process show runtime output

Change-Id: If7eac41cd33837eea7291f87129e2c176fbe6aea
Signed-off-by: Tibor Frank <tifrank@cisco.com>

660e18c0 13-Aug-2019 Peter Mikus <pmikus@cisco.com>

TOX: DOC verify

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Ifa4de8e60742f5c4cf4c2f377692313e23f9983b

e6dd7724 13-Aug-2019 Jan Gelety <jgelety@cisco.com>

FIX: Remove eth_avf and portX_vifY interfaces from topo in TC/TS tear down

Change-Id: I90901c4ab14dfa76dc3e1f786a4b986479e0ba47
Signed-off-by: Jan Gelety <jgelety@cisco.com>

16226fd2 15-Aug-2019 Tibor Frank <tifrank@cisco.com>

Add testbed info to output_info.xml

Change-Id: I2ff45926a754647c1be6263cf8e5e0c7cbfedfef
Signed-off-by: Tibor Frank <tifrank@cisco.com>

545216fd 15-Aug-2019 Peter Mikus <pmikus@cisco.com>

Reduce disabled pylint to address them not hide

+ Fixed Qemu
- Broad Exception should be addressed
- Policer is about to be refactored
- Drop search to be refactored

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I97eb992497ff6334057bf82a0f413387706e17fd

6d941885 14-Aug-2019 Peter Mikus <pmikus@cisco.com>

FIX: VM startup after socket move

+ Still workaround for VPP bug not creating dir at startup

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I8b87ac70e5f85d538a25058dcb5453f89e21498f

6da72667 06-Aug-2019 Dave Wallace <dwallacelf@gmail.com>

VAT-to-PAPI: Fix HTTP/TCP tests

Change-Id: Ie728bc73eb7429d246e82dd195fc63191c3ac51d
Signed-off-by: Dave Wallace <dwallacelf@gmail.com>

669d320b 14-Aug-2019 Miroslav Los <miroslav.los@pantheon.tech>

DO_NOT_MERGE CSIT-1194 - Framework easy pylint improvements

- force a python2 environment in tox for pylint
- let pylint load some compiled modules for member checking
- allow locally enabled pylint rules
- ignore bad enum names
- ignore complexity for code to be refactored by other tickets
- broad excepts are acceptable sometimes

Signed-off-by: Miroslav Los <miroslav.los@pantheon.tech>
Change-Id: If4c3a1b85e8609f074e1de8ce91fc9c4fedbeb38

37a94513 14-Aug-2019 Peter Mikus <pmikus@cisco.com>

Move: WRK installation into ansible

- Remove ability to install from framework.
- Control via ansible with other dependencies.

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I5fd0ca18b4f76c30b6c28b4dcd15e538e01cb315

be39339d 14-Aug-2019 Peter Mikus <pmikus@cisco.com>

FIX: Container VPP pid detection

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I47163aa9ee0114f13ab17badde773560243ce319

b0592824 14-Aug-2019 Tibor Frank <tifrank@cisco.com>

Report: Add data

- Dry runs
- fix table 'VPP Soak vs NDR 2n-skx'

Change-Id: I1fb101ab1b7cc40de49e8bb564818a730d3853a4
Signed-off-by: Tibor Frank <tifrank@cisco.com>

72614c32 14-Aug-2019 Tibor Frank <tifrank@cisco.com>

Report: Add data

- Dry runs

Change-Id: Ib6e50853b5b4638dc0f4bc93a98b3818f5079658
Signed-off-by: Tibor Frank <tifrank@cisco.com>

74bdfde7 13-Aug-2019 Vratko Polak <vrpolak@cisco.com>

Revert "Disable CRC checking at runtime"

Needed to verify CSIT expects the correct CRCs.

This reverts commit d541b2b7d99651b53bd21ff75cd5fdacf8472a98.
This reverts commit 2dd27f5a638b5231c0f074ca61e6b67fed9d1faf.

+ Some pylint related improvements since then.
+ Less and better documented caching to class fields.
+ Global kill switch in Constants.

Change-Id: Id459800744cd93c578eab9c2e84cb9528235b064
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

8f41f1d0 07-Aug-2019 Peter Mikus <pmikus@cisco.com>

FIX: Vhost teardown

If test failed before vnf_manager is created then teardown
does fail as well due to missing variable.

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I0b23648bce78738cf4c377979d7a06fb488d990d

ee01931e 13-Aug-2019 Vratko Polak <vrpolak@cisco.com>

Add show memory to show_vpp_statistics

https://lists.fd.io/g/csit-dev/message/2867

Change-Id: I8934218f2ccac9a458cec37e71e403db7d49281c
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

9e476b27 14-Aug-2019 Tibor Frank <tifrank@cisco.com>

PAL: Archiving of input data

Change-Id: I0902613047d7543378a4b7d46811fc67776c6ad9
Signed-off-by: Tibor Frank <tifrank@cisco.com>

cd2a57ab 08-Aug-2019 Tibor Frank <tifrank@cisco.com>

Report: Download first from logs.fd.io

Change-Id: I308d7a7f72e0ea2e23b96be7db1ba35920bae519
Signed-off-by: Tibor Frank <tifrank@cisco.com>

9e1bb284 13-Aug-2019 Tibor Frank <tifrank@cisco.com>

PAL: Get DPDK Version

- Needed for trending

Change-Id: I3d576e39d6e3b91821050fbd4a8a95380275797b
Signed-off-by: Tibor Frank <tifrank@cisco.com>

d7c29749 12-Aug-2019 Peter Mikus <pmikus@cisco.com>

FIX: Vhost tests in latest VPP nightly

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I26ec27b00e5cd48143a2389f2ff41ed876a7a013

b7639016 12-Aug-2019 Tibor Frank <tifrank@cisco.com>

PAL: Get TG IP address from output_info.xml

Change-Id: I566c0e436fbe50e5e72da35be6a2afc81e8a33b6
Signed-off-by: Tibor Frank <tifrank@cisco.com>

5dea7e63 13-Aug-2019 Tibor Frank <tifrank@cisco.com>

Add testbed info to output_info.xml

- Needed for trending

Change-Id: I59fc115ce62d1ad839e7c8a39c74af0497b9012d
Signed-off-by: Tibor Frank <tifrank@cisco.com>

9c75b7bf 09-Aug-2019 Peter Mikus <pmikus@cisco.com>

Clean: Various libraries

- Remove translate TC as they have no perf opposite
- Remove unused keywords
- Merge similar keywords / rename
- Move keywords from perf library to categories

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I6433006136e2497ad8fb17193aa20c578d836999

3e664d4a 07-Aug-2019 Jan Gelety <jgelety@cisco.com>

FIX: if MAC address must be updated after AVF interface creation

Change-Id: I9fc26a7d1bf8d9eed620173a73febe3d874a1351
Signed-off-by: Jan Gelety <jgelety@cisco.com>

f187d0b4 12-Aug-2019 Tibor Frank <tifrank@cisco.com>

Report: data

Change-Id: Id51e073d23d7bb54864eb5fd1c3c320077e6abb8
Signed-off-by: Tibor Frank <tifrank@cisco.com>

f7037acc 09-Aug-2019 Tibor Frank <tifrank@cisco.com>

Report: Data

Change-Id: Ibd1a5dc6e451d992eb85b223973734c876e37fe7
Signed-off-by: Tibor Frank <tifrank@cisco.com>

4929e57e 12-Aug-2019 Peter Mikus <pmikus@cisco.com>

FIX: Remove unwanted Jenkins dependency

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I7a43c3183dc276fa5e4806f31a52cf5844792d4d

42fdef70 09-Aug-2019 Peter Mikus <pmikus@cisco.com>

Clean: L2 bridge domain

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I3721900b91a9c8e9db8766bdcb9771b6bcf95bca

6f1ff57c 08-Aug-2019 Vratko Polak <vrpolak@cisco.com>

Skip bad testbeds in reservation

Previously, ssh-inaccesible testbeds
were handled the same way as reserved,
never ending the wait loop.

With this, if no testbed is accessible,
the job fails early.

Change-Id: I01bc79094fe0232a47d795e53e3daa52e8742bac
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

5b28bc8c 07-Aug-2019 Jan Gelety <jgelety@cisco.com>

FIX: macip_acl_rule needs binary mac data

Change-Id: I0d26b2b31f0ce7497c91b4ae965f9cc45a66ef0c
Signed-off-by: Jan Gelety <jgelety@cisco.com>

a4c6a63b 08-Aug-2019 Vratko Polak <vrpolak@cisco.com>

Bump VPP stable version: socksvr

VPP changed the default socket path in:
https://gerrit.fd.io/r/c/vpp/+/21100

Instead of "default", explicit value is used now.
It coincides with VPP default one,
and is stored in Constants.py (except documentation).

The file name for robot side forwarded socket remains,
as the path leading to is is different anyway.

Change-Id: I0058d16794a3cd04411640c2c8d5fd4ee8cb997d
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

181e882d 08-Aug-2019 Peter Mikus <pmikus@cisco.com>

Clean: L2_xconnect keywords

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Ic15a15c426db04defc15840883a772a0eb8e4885

72880c9e 09-Aug-2019 Tibor Frank <tifrank@cisco.com>

Trending: Fix ipsec

Change-Id: I0f35098047bc1137cbf2a1ae39107698b1e9bf79
Signed-off-by: Tibor Frank <tifrank@cisco.com>

d6c832b0 09-Aug-2019 Tibor Frank <tifrank@cisco.com>

Report: Configuration

Change-Id: I55dc7412e28cc2c5eb9c3f151e75a06be2d36f69
Signed-off-by: Tibor Frank <tifrank@cisco.com>

a71be635 09-Aug-2019 Tibor Frank <tifrank@cisco.com>

Trending: Set 90 days period

Change-Id: I56403c30142876501602fe06c0ad2665fa73cb7b
Signed-off-by: Tibor Frank <tifrank@cisco.com>

9f9dbc5c 09-Aug-2019 Tibor Frank <tifrank@cisco.com>

Trending: TSH ipsec tests

Change-Id: Ib9f867e2b55a61019b487c96b0a05e9fa175dd0f
Signed-off-by: Tibor Frank <tifrank@cisco.com>

016fb598 08-Aug-2019 Peter Mikus <pmikus@cisco.com>

Clean: L2_patch

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Ib3620689acb3641b2ec9a49e2ce552bab3f00eef

484cb0bd 08-Aug-2019 Peter Mikus <pmikus@cisco.com>

Clean: Interface Keywords

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Ideddcea56120cf770aec78ca24813baf7d05ba11

a9711472 07-Aug-2019 Vratko Polak <vrpolak@cisco.com>

Fix: Deep-copy arguments in papi executors

Without this, it is not safe to re-use the original argument dicts
with additional edits for subsequent commands.

Change-Id: Ib4f67d09e6bf7438dfdf7669263957a42c8d4dbe
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

6dc4c630 08-Aug-2019 Peter Mikus <pmikus@cisco.com>

Remove: Obsolete bash code

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Ide17a2e2ae7e1311f00093c14f6c4879406e5868

992ab449 07-Aug-2019 Tibor Frank <tifrank@cisco.com>

Trending: Reduce ipsec tests

Change-Id: Ib164551d09ccf3ab5a95baade6d8b2744bc5ce16
Signed-off-by: Tibor Frank <tifrank@cisco.com>

60ad88e9 08-Aug-2019 Tibor Frank <tifrank@cisco.com>

Trending: ipsec

Change-Id: I2fc623ac152b8559a230b340be2f1cc92c7e934a
Signed-off-by: Tibor Frank <tifrank@cisco.com>

c502f713 08-Aug-2019 Peter Mikus <pmikus@cisco.com>

FIX: Various typos in nf_density + missing KW

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I73878542672ab2dcfa1db046fbca4b7d931e744c

98bfad4c 07-Aug-2019 Tibor Frank <tifrank@cisco.com>

Trending: Add dnv mrr tests

Change-Id: If0c0d6b346e64caf7af4432917a91468a1f0554a
Signed-off-by: Tibor Frank <tifrank@cisco.com>

b8dcaf61 07-Aug-2019 Peter Mikus <pmikus@cisco.com>

Clean: IPv6 keywords

+ Move all base ipv6 related KW to library
+ Remove useless KW to save space in output.xml
+ Remove cross dependency in ip6.robot

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I8c5f72e9852c1017356ab6034c4d271cf7b53265

402633a2 07-Aug-2019 Peter Mikus <pmikus@cisco.com>

Clean: IPv4 keywords

+ Move all base ipv4 related KW to library
+ Remove useless KW to save space in output.xml
+ Remove cross dependency in ip4.robot

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: If1e3a6370d36caf4ce7411fb956a0b7d0f939b6b

6c6b9edc 07-Aug-2019 Peter Mikus <pmikus@cisco.com>

FIX: Pylint

- my bad

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I8c1f57f6b648b99338f3f6a6ff9ec943082e9bc4

c8ea6f1f 06-Aug-2019 Jan Gelety <jgelety@cisco.com>

FIX: IPsecUtil - create IP object separately in ever iteration

- if we are trying to update ip field of already existing IP object
in more iterations of e.g. ip_route_add_del the PapiExecutor uses
value from last iteration for all iterations so it ends up in
creation of ip route only for one IP not for all required IPs

Change-Id: I5ffa622e2a06d0c5c71720d2cf743a4c2104ab79
Signed-off-by: Jan Gelety <jgelety@cisco.com>

fc1ad1d8 06-Aug-2019 Jan Gelety <jgelety@cisco.com>

FIX: Remove PAPI_MAX_API_BULK

- it's not needed anymore as PapiSocketExecutor is used

Change-Id: Ia9fad1d18991821d14e9261d27f7f26fca03c14a
Signed-off-by: Jan Gelety <jgelety@cisco.com>

fb2fb651 12-Jul-2019 Jan Gelety <jgelety@cisco.com>

CSIT-1473: Migrate Tap library from VAT to PAPI

Change-Id: Ibf4a4839c2e8b799b03eebd9dffae891d8f00dd4
Signed-off-by: Jan Gelety <jgelety@cisco.com>

32e24d9b 07-Aug-2019 Vratko Polak <vrpolak@cisco.com>

Expand comment on API covering triggers

GBP tests were added, they are only covered by 2n perf test.
Several tags used in the tag expression to proof against future suites.

Change-Id: I9facd8c72b41284b6b838e99ce9d38047aa68f40
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

97e93cd2 29-Jul-2019 Peter Mikus <pmikus@cisco.com>

Add: Dot1Q + L2BD + GBP

Change-Id: I0050f715011ecfa92b3ee88b301809a56abb7946
Signed-off-by: Peter Mikus <pmikus@cisco.com>

11aa6d6c 06-Aug-2019 juraj.linkes <juraj.linkes@pantheon.tech>

Change show hardware detail to show hardware verbose

After https://gerrit.fd.io/r/#/c/vpp/+/21071/, show hardware verbose
doesn't output slowly processed module info which is not needed for
debugging purposes.

Change-Id: I2f91a0ce1bfc082b46f2fe43df968750bcd1cf3a
Signed-off-by: juraj.linkes <juraj.linkes@pantheon.tech>

7d7259ab 25-Jul-2019 Peter Mikus <pmikus@cisco.com>

VPPD: Dot1Q

Change-Id: I0d3c925ea4a6896a0df98db6ddaf4238e6291bf1
Signed-off-by: Peter Mikus <pmikus@cisco.com>

fb3aba8b 24-Jul-2019 Vratko Polak <vrpolak@cisco.com>

PapiHistory: Use repr strings for argument values

Composite arguments frequently do not have valid __str__ method
so the values were not visible.

Change-Id: If302934cb227f212580bb2f5c277a755ace51bcf
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

916de0c1 05-Aug-2019 Peter Mikus <pmikus@cisco.com>

FIX: Layer dot1q logic

Bug found by vrpolak

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Ibf61f14a838d0b49220ab8079a2d999f860a18e7

38bbf1ef 01-Aug-2019 Vratko Polak <vrpolak@cisco.com>

Fix CRCs, bump stable VPP version

+ Migrate the data to a separate yaml file.
+ Improve some argument names.
+ Unify handling of unicode (to always utf-8 encode to str).

Change-Id: Id0622b24202be796c1cd33ad52c3b8dca81cff50
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

5a20b28f 05-Aug-2019 Tibor Frank <tifrank@cisco.com>

Trending: Reduce input data

Change-Id: Iab9e6686ef163eda04d836e4f355a310058e846e
Signed-off-by: Tibor Frank <tifrank@cisco.com>

6f013f7c 05-Aug-2019 Peter Mikus <pmikus@cisco.com>

FIX: Freeze Vagrant version

- config.vm.box_version = "20190724.1.0"

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I56d70d62f38a10365e447346a619652e33392cbb

da06751a 31-Jul-2019 juraj.linkes <juraj.linkes@pantheon.tech>

Add 3n-tsh mrr data to trending docs

Change-Id: I82f074c0f7261bd1019ade1e01781278b063c0cd
Signed-off-by: juraj.linkes <juraj.linkes@pantheon.tech>

95a6f931 02-Aug-2019 Tibor Frank <tifrank@cisco.com>

Trending: Add 8 big input files

Change-Id: I9891c9589014be04fa69973e092fdf8b9926a56f
Signed-off-by: Tibor Frank <tifrank@cisco.com>

8ac5ba53 02-Aug-2019 Tibor Frank <tifrank@cisco.com>

Trending: Implement retries to requests

Change-Id: Ief9ab61a54cffb529ae3539096121d1f77ee0167
Signed-off-by: Tibor Frank <tifrank@cisco.com>

7b1f19c0 02-Aug-2019 Tibor Frank <tifrank@cisco.com>

Trending: Remove multiprocessing from cpta

Change-Id: If53c5a72abed11fda9b15d043b24027d2eb9d86e
Signed-off-by: Tibor Frank <tifrank@cisco.com>

d541b2b7 02-Aug-2019 Peter Mikus <pmikus@cisco.com>

FIX: Disable API checker during runtime

Change-Id: Id530710aaedc30472d8bcd33d24b7fbcaa7c011b
Signed-off-by: Peter Mikus <pmikus@cisco.com>

130e40a7 02-Aug-2019 Tibor Frank <tifrank@cisco.com>

Trending: Fix ignore list processing

Change-Id: I27c2ae25cc9cf6996f3c22417479b300faa73994
Signed-off-by: Tibor Frank <tifrank@cisco.com>

d036ee32 01-Aug-2019 Tibor Frank <tifrank@cisco.com>

Trending: Improve log output

Change-Id: I37464dc15749d0f59a3ee67651483d6bc1388316
Signed-off-by: Tibor Frank <tifrank@cisco.com>

b5170a2b 01-Aug-2019 Tibor Frank <tifrank@cisco.com>

Trending: remove multitasking

Change-Id: Id331fb5bb1d2e5a4da9665b330b991010e5a11e2
Signed-off-by: Tibor Frank <tifrank@cisco.com>

cee3ad0f 31-Jul-2019 Tibor Frank <tifrank@cisco.com>

Trending: Add multiprocessing, remove archiving

Change-Id: I67cfde7dfc9b81fca3ae102b43f6defafe88f689
Signed-off-by: Tibor Frank <tifrank@cisco.com>

2dd27f5a 31-Jul-2019 Vratko Polak <vrpolak@cisco.com>

Disable CRC checking at runtime

Temporarily, will be re-enabled once VPP and CSIT are in sync again.

Change-Id: I0d3bb5b70ea04155972093102a26a81f86119c37
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

fca2fc9b 01-Aug-2019 Tibor Frank <tifrank@cisco.com>

Trending: Memory consumption

Change-Id: I26a7d9e7ee0b1a64666c3ffbcfc424f04a52d046
Signed-off-by: Tibor Frank <tifrank@cisco.com>

e8e655c1 19-Jul-2019 Peter Mikus <pmikus@cisco.com>

TOX: Coverage check

Change-Id: Ib4585729f7b84bbcf1db62db801a6b2f24337803
Signed-off-by: Peter Mikus <pmikus@cisco.com>

17983da5 31-Jul-2019 Peter Mikus <pmikus@cisco.com>

Add: Prerequisites checker

Change-Id: Ida54722ee5c73a0b3e0a8e22692795daf5bb09f3
Signed-off-by: Peter Mikus <pmikus@cisco.com>

18ddfb23 31-Jul-2019 Tibor Frank <tifrank@cisco.com>

Trending: Reduce input data

Change-Id: I8917e72717c672c44494a34aefce4039ac5efcc9
Signed-off-by: Tibor Frank <tifrank@cisco.com>

e345f4f1 31-Jul-2019 Tibor Frank <tifrank@cisco.com>

Trending: Set packages versions

Change-Id: I272b7c4a5f9d2f446a0f91214d6052196690cdcd
Signed-off-by: Tibor Frank <tifrank@cisco.com>

53e30f45 31-Jul-2019 Tibor Frank <tifrank@cisco.com>

Trending: Set packages versions

Change-Id: I8d9298733652f16dbfa0c183602060eb4f727dfe
Signed-off-by: Tibor Frank <tifrank@cisco.com>

43564923 31-Jul-2019 Tibor Frank <tifrank@cisco.com>

Trending: Reduce input data

Change-Id: I6760f39e9438d1af97217f2fc28b933226b9cb2d
Signed-off-by: Tibor Frank <tifrank@cisco.com>

cafb31a9 31-Jul-2019 Tibor Frank <tifrank@cisco.com>

Trending: Reduce input data

Change-Id: I8dc4fb23c07b1ab9cc0ecad852cc594ec9922055
Signed-off-by: Tibor Frank <tifrank@cisco.com>

20ff879c 30-Jul-2019 Tibor Frank <tifrank@cisco.com>

Trending: Remove multiprocessing, part 1

Change-Id: Idcca9b3b933d5524d2ba5905050480796d8a81aa
Signed-off-by: Tibor Frank <tifrank@cisco.com>

85d2e9e1 30-Jul-2019 Tibor Frank <tifrank@cisco.com>

Trending: Multiprocessing

Change-Id: I6dedd6d201f46f0b996e75a3cba12713d9c32251
Signed-off-by: Tibor Frank <tifrank@cisco.com>

163eb105 31-Jul-2019 Tibor Frank <tifrank@cisco.com>

Trending: Multiprocessing

Change-Id: I41ef5c0de337e1aa13cd44b94c4e8e15413872ce
Signed-off-by: Tibor Frank <tifrank@cisco.com>

29726f92 30-Jul-2019 Vratko Polak <vrpolak@cisco.com>

Add VPP API CRC checking

+ Include both checking at runtime and standalone static quick check.
+ Runtime checking does not look for missing messages,
as messages belonging to disabled plugins are not visible.
+ Standalone check script has nice loud output.

Change-Id: I1dfc3846d1bcdad0b09017d4ce8edd5028e17e0c
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

f966718d 30-Jul-2019 Tibor Frank <tifrank@cisco.com>

Trending: Reduce input data

Change-Id: I25c74c00f95aa2e3c2f7c1780e39e3f6262afc0e
Signed-off-by: Tibor Frank <tifrank@cisco.com>

6f725c52 30-Jul-2019 Tibor Frank <tifrank@cisco.com>

Trending: Reduce input data

Change-Id: Idd87da996f25c7fd94cef828dee6967737b73ba8
Signed-off-by: Tibor Frank <tifrank@cisco.com>

f2af716b 30-Jul-2019 Tibor Frank <tifrank@cisco.com>

Trending: Reduce input data

Change-Id: Ibc2c1f02c80189045a63cf07e89c6a409d785047
Signed-off-by: Tibor Frank <tifrank@cisco.com>

52ebb67e 30-Jul-2019 Tibor Frank <tifrank@cisco.com>

Trending: Reduce input data

Change-Id: Ifddbdc1f357a192af558079a92f4e4d1d2693efd
Signed-off-by: Tibor Frank <tifrank@cisco.com>

82397b41 30-Jul-2019 Tibor Frank <tifrank@cisco.com>

Trending: Reduce input data

Change-Id: I31d4d7ceaf8969e28d86deac2995cd38cbff9fca
Signed-off-by: Tibor Frank <tifrank@cisco.com>

053e3fe3 29-Jul-2019 Tibor Frank <tifrank@cisco.com>

Trending: Reduce input data

Change-Id: Id0569dc7d882ad6b631b41c2e55ee12dc9d4b5ea
Signed-off-by: Tibor Frank <tifrank@cisco.com>

afc8ccc9 30-Jul-2019 Tibor Frank <tifrank@cisco.com>

Trending: Reduce input data

Change-Id: Ice96d11d802dbc3d502b038ee8e328281551bc9d
Signed-off-by: Tibor Frank <tifrank@cisco.com>

0f876f0f 30-Jul-2019 Peter Mikus <pmikus@cisco.com>

Revert "PAL: Skip daily-master-3n-skx/540"

This reverts commit fc7fbe37baaaa82f751757f75491e2a29db5176e.

Change-Id: I2b7710f5d41006cfd2a39a55c86c81c3ae43f90e
Signed-off-by: Peter Mikus <pmikus@cisco.com>

2eef159e 30-Jul-2019 Peter Mikus <pmikus@cisco.com>

Revert "Trending: Reduce the number of input files"

This reverts commit 6e1de92cec9a0687ca82bcefaae3ef7dad5104b0.

Change-Id: I04130c449905f93bdd82da36d2ff4de26005dfe4
Signed-off-by: Peter Mikus <pmikus@cisco.com>

d78e6a68 29-Jul-2019 Vratko Polak <vrpolak@cisco.com>

Fix logic error in AVF compatibility check

Change-Id: I7f1b47725648c8c26e21f42c305395ad620beea6
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

d89a5934 29-Jul-2019 Peter Mikus <pmikus@cisco.com>

Add: Missing Trex profile

- IPv4 400 destinations IPs

Change-Id: I007a588375bfa5be572a183ac6d2372801bea99d
Signed-off-by: Peter Mikus <pmikus@cisco.com>

b5ee1c01 26-Jul-2019 Peter Mikus <pmikus@cisco.com>

Remove obsolete L2 KW

Change-Id: I9a8aa6f5ccf95d632f4e677c8bf14f50b982d930
Signed-off-by: Peter Mikus <pmikus@cisco.com>

0e853acb 28-Jul-2019 Yulong Pei <yulong.pei@intel.com>

make sudo to preserve user existing environment variables

Change-Id: I83470b059b9ca59bb3725f1ebef6718adf8f91ae
Signed-off-by: Yulong Pei <yulong.pei@intel.com>

f7f3d8bc 26-Jul-2019 Peter Mikus <pmikus@cisco.com>

Change: Move few KW

Change-Id: I8c8ae1d7eed8cf28fc63ce42b2dc36dd16a5c0da
Signed-off-by: Peter Mikus <pmikus@cisco.com>

ceb9df53 26-Jul-2019 Peter Mikus <pmikus@cisco.com>

Add: AVF into trace group

Change-Id: I3399d5fb2754eb67734e8f76a5743283fe9c074c
Signed-off-by: Peter Mikus <pmikus@cisco.com>

a426e41f 26-Jul-2019 Peter Mikus <pmikus@cisco.com>

Change: AVF can run also on i40evf

Change-Id: I375b7c9f8fe81428cb16fea35128bddec089da1b
Signed-off-by: Peter Mikus <pmikus@cisco.com>

dd6ca76e 25-Jul-2019 Peter Mikus <pmikus@cisco.com>

FIX: IPsec Util

Because:

>>> for i in xrange(4):
... if i > 0 and i % 250 / 3 == 0:
... i
...
1
2

Change-Id: Ia4eba227ea1e4c6222f32ac598f254428d95adc9
Signed-off-by: Peter Mikus <pmikus@cisco.com>

7ac38855 25-Jul-2019 Peter Mikus <pmikus@cisco.com>

VPPD: VXLAN

Change-Id: Iac518341e6a0fff4a31ad3692ccc5697690db8be
Signed-off-by: Peter Mikus <pmikus@cisco.com>

882c4df8 19-Jul-2019 Andrej Marcinek <andrej.marcinek@pantheon.tech>

VAT-to-PAPI: LISPSetup

Removed CRUD parts from tests

Change-Id: Iaca36e62be5144ea3f2831457113959b65489db8
Signed-off-by: Andrej Marcinek <andrej.marcinek@pantheon.tech>

c58cba70 13-Jun-2019 Peter Mikus <pmikus@cisco.com>

NF_density dot1qip4udpvxlan

+ NF_density compatible
+ Baseline VM tests compatible
+ Scalability NxM
- 3n variant is missing in VXLAN and DOT1Q due to requests to have it
asymmetrical - TODO

Change-Id: Ia817d7be00622b594b451bc07756240d1a379e04
Signed-off-by: Peter Mikus <pmikus@cisco.com>

7da05811 23-Jul-2019 juraj.linkes <juraj.linkes@pantheon.tech>

Update initramfs build

Initram image was being built with remote resume config. Remove the
config while building to avoid possible 30s delays when booting VMs.

Change-Id: I988838290dde3d6fae83676937d86f4f12bdb769
Signed-off-by: juraj.linkes <juraj.linkes@pantheon.tech>

3cd17847 23-Jul-2019 juraj.linkes <juraj.linkes@pantheon.tech>

Fix arm sut docker image name

Change-Id: I548b176baeec39362b9c0a4e02a664d1e95574a3
Signed-off-by: juraj.linkes <juraj.linkes@pantheon.tech>

80d851c9 23-Jul-2019 Dave Wallace <dwallacelf@gmail.com>

vppdevice: fix install-dep failure when component install is required

Change-Id: Ibc4379ef25c1bf536da68eb6d0b035993e907c7a
Signed-off-by: Dave Wallace <dwallacelf@gmail.com>

141d5420 09-Jul-2019 Peter Mikus <pmikus@cisco.com>

Add scale ipsec tunnel tests 40K, 60K

Change-Id: Iecfd7e69a72c8d5893a703fa93439cde0a3edf5f
Signed-off-by: Peter Mikus <pmikus@cisco.com>

01d9a0df 23-Jul-2019 Peter Mikus <pmikus@cisco.com>

FIX: Vhost optimization

- Testpmd 9000B
- Disable fsck
- Remove redundant init mounts

Change-Id: Ia063520d0a206e9eee831a5cc692e32baf5a92c8
Signed-off-by: Peter Mikus <pmikus@cisco.com>

674dc2fb 23-Jul-2019 Vratko Polak <vrpolak@cisco.com>

Update documentation of select_arch_os

Change-Id: I619a18918b0710a59a3b36283aa79da06d640fae
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

c788beae 18-Jul-2019 juraj.linkes <juraj.linkes@pantheon.tech>

3n-tsh timeout, testbed tags and ansible update

* disable AVF tests which don't work with x520
* increase VPPApiClient timeout to 14s, as x520 show hardware is slower
on Taishan
* re-enable vhost and memif tests
* remove tx2 mrr daily tag list; no tx2 is used for perf testing
* remove taishan workaround
* add scipy arm prerequisites and scipy workaround
* rework inventories/lf_inventory/hosts; move cpu_microarchitecture to
host files

Change-Id: I5f10bd07b8146ac3b8be8c54fbb4d924a9373813
Signed-off-by: juraj.linkes <juraj.linkes@pantheon.tech>


libraries/bash/function/common.sh
libraries/bash/function/mrr-daily-tx2.txt
libraries/python/PapiExecutor.py
tools/testbed-setup/ansible/inventories/lf_inventory/group_vars/all.yaml
tools/testbed-setup/ansible/inventories/lf_inventory/host_vars/10.30.51.16.yaml
tools/testbed-setup/ansible/inventories/lf_inventory/host_vars/10.30.51.17.yaml
tools/testbed-setup/ansible/inventories/lf_inventory/host_vars/10.30.51.18.yaml
tools/testbed-setup/ansible/inventories/lf_inventory/host_vars/10.30.51.20.yaml
tools/testbed-setup/ansible/inventories/lf_inventory/host_vars/10.30.51.21.yaml
tools/testbed-setup/ansible/inventories/lf_inventory/host_vars/10.30.51.22.yaml
tools/testbed-setup/ansible/inventories/lf_inventory/host_vars/10.30.51.24.yaml
tools/testbed-setup/ansible/inventories/lf_inventory/host_vars/10.30.51.25.yaml
tools/testbed-setup/ansible/inventories/lf_inventory/host_vars/10.30.51.26.yaml
tools/testbed-setup/ansible/inventories/lf_inventory/host_vars/10.30.51.28.yaml
tools/testbed-setup/ansible/inventories/lf_inventory/host_vars/10.30.51.36.yaml
tools/testbed-setup/ansible/inventories/lf_inventory/host_vars/10.30.51.37.yaml
tools/testbed-setup/ansible/inventories/lf_inventory/host_vars/10.30.51.44.yaml
tools/testbed-setup/ansible/inventories/lf_inventory/host_vars/10.30.51.45.yaml
tools/testbed-setup/ansible/inventories/lf_inventory/host_vars/10.30.51.46.yaml
tools/testbed-setup/ansible/inventories/lf_inventory/host_vars/10.30.51.47.yaml
tools/testbed-setup/ansible/inventories/lf_inventory/host_vars/10.30.51.48.yaml
tools/testbed-setup/ansible/inventories/lf_inventory/host_vars/10.30.51.49.yaml
tools/testbed-setup/ansible/inventories/lf_inventory/host_vars/10.30.51.50.yaml
tools/testbed-setup/ansible/inventories/lf_inventory/host_vars/10.30.51.51.yaml
tools/testbed-setup/ansible/inventories/lf_inventory/host_vars/10.30.51.52.yaml
tools/testbed-setup/ansible/inventories/lf_inventory/host_vars/10.30.51.53.yaml
tools/testbed-setup/ansible/inventories/lf_inventory/host_vars/10.30.51.54.yaml
tools/testbed-setup/ansible/inventories/lf_inventory/host_vars/10.30.51.55.yaml
tools/testbed-setup/ansible/inventories/lf_inventory/host_vars/10.30.51.56.yaml
tools/testbed-setup/ansible/inventories/lf_inventory/host_vars/10.30.51.57.yaml
tools/testbed-setup/ansible/inventories/lf_inventory/host_vars/10.30.51.58.yaml
tools/testbed-setup/ansible/inventories/lf_inventory/host_vars/10.30.51.59.yaml
tools/testbed-setup/ansible/inventories/lf_inventory/host_vars/10.30.51.60.yaml
tools/testbed-setup/ansible/inventories/lf_inventory/host_vars/10.30.51.69.yaml
tools/testbed-setup/ansible/inventories/lf_inventory/host_vars/10.32.8.10.yaml
tools/testbed-setup/ansible/inventories/lf_inventory/host_vars/10.32.8.11.yaml
tools/testbed-setup/ansible/inventories/lf_inventory/host_vars/10.32.8.12.yaml
tools/testbed-setup/ansible/inventories/lf_inventory/host_vars/10.32.8.13.yaml
tools/testbed-setup/ansible/inventories/lf_inventory/hosts
tools/testbed-setup/ansible/roles/sut/files/taishan_workaround.service
tools/testbed-setup/ansible/roles/sut/tasks/dpdk.yaml
tools/testbed-setup/ansible/roles/sut/tasks/main.yaml
tools/testbed-setup/ansible/roles/sut/tasks/taishan_workaround.yaml
tools/testbed-setup/ansible/roles/tg_sut/tasks/aarch64.yaml
tools/testbed-setup/ansible/roles/tg_sut/tasks/main.yaml
tools/testbed-setup/ansible/roles/tg_sut/tasks/x86_64.yaml
c79c7480 17-Jul-2019 juraj.linkes <juraj.linkes@pantheon.tech>

Add support for aarch64 container images

Change-Id: I84f13d7139a6e5f7004426018c2d27425c5fa97e
Signed-off-by: juraj.linkes <juraj.linkes@pantheon.tech>

6e1de92c 22-Jul-2019 Vratko Polak <vrpolak@cisco.com>

Trending: Reduce the number of input files

Another attempt to avoid memory error.
Dailies trimmed to ~2 months.
Not removed last "skip" item to simplify future editing.

Change-Id: Id411eeed109079c4c3f8994d5d6cc296ffe621fc
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

13bc34ab 12-Jul-2019 Jan Gelety <jgelety@cisco.com>

CSIT-1471: Migrate Dhcp library from VAT to PAPI

Change-Id: Ibc9b9b736532cce31994537e632daa4d4e62459c
Signed-off-by: Jan Gelety <jgelety@cisco.com>

385f2246 19-Jul-2019 Peter Mikus <pmikus@cisco.com>

FIX: naming convention fixes for TOX

Change-Id: I0644fbd0e136dee3a91fd9406155f971b3c726eb
Signed-off-by: Peter Mikus <pmikus@cisco.com>

fa6ce30b 04-Jul-2019 premkumarv <preym17@gmail.com>

VAT API to PAPI CONVERSION

Change-Id: I9c87cdfb99780f398da5cd90351b303caa89bda9
Signed-off-by: premkumarv <preym17@gmail.com>

44a12d1a 12-Jul-2019 Peter Mikus <pmikus@cisco.com>

TOX: Naming conventions

Change-Id: I038d90fc481e5f74085d0fe6165b12769d98e8a1
Signed-off-by: Peter Mikus <pmikus@cisco.com>

fc7fbe37 19-Jul-2019 Vratko Polak <vrpolak@cisco.com>

PAL: Skip daily-master-3n-skx/540

Frequently, reconnect is needed to finish the download,
that can lead to IOError.
But, MemoryError has also been seen, so perhaps this is a wrong fix.
Worth a try, though.

Change-Id: Icac17757a1a0ae361faddfa24a818496f14d7340
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

857bd695 11-Jul-2019 Jan Gelety <jgelety@cisco.com>

CSIT-1469: Migrate SRv6 library from VAT to PAPI

Change-Id: Ibbec3d1bbda2af9fcab3230fd1747406a89f0cc5
Signed-off-by: Jan Gelety <jgelety@cisco.com>

87c41b8d 12-Jul-2019 Jan Gelety <jgelety@cisco.com>

Remove un-interested VIRL tests and related resources

Change-Id: I712f5dc238fdf480c7c35250148c12d03ed96d74
Signed-off-by: Jan Gelety <jgelety@cisco.com>

8312908c 19-Jul-2019 Peter Mikus <pmikus@cisco.com>

FIX: COP ipv6 missing FIB

- From unknown reason VAT was more tolerant

Change-Id: Ia740843c67604a18de40d14cc448138b9f079b41
Signed-off-by: Peter Mikus <pmikus@cisco.com>

bf33e6ad 19-Jul-2019 juraj.linkes <juraj.linkes@pantheon.tech>

Add support for default_nic in mrr tag lists

Change-Id: I1fdc6f3019af6d46b985164c573d44b0e440febd
Signed-off-by: juraj.linkes <juraj.linkes@pantheon.tech>

0041c421 18-Jul-2019 Vratko Polak <vrpolak@cisco.com>

Papi socket: except more errors to insert err_msg

Change-Id: Ided91ee2b47dafb6aad83091126294d79f67aeac
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

63a426bf 01-Jul-2019 Andrej Marcinek <andrej.marcinek@pantheon.tech>

VAT-to-PAPI: LISPUtil

Change-Id: I57328dbc33eaf62935a1a14e23f57ebab21c24f5
Signed-off-by: Andrej Marcinek <andrej.marcinek@pantheon.tech>

229ba1d7 17-Jul-2019 Vratko Polak <vrpolak@cisco.com>

Trending: Delete presentation_new

It is outdated an unmaintained.

Change-Id: I9b48391906a233cbdf736a3b2d12da80d3a2d77d
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

7b545012 17-Jul-2019 Vratko Polak <vrpolak@cisco.com>

Trending: Reduce the number of input files

Change-Id: Ie449aa820bc05d9fed285c04445a5cf715b8ebdf
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

14630855 17-Jul-2019 Peter Mikus <pmikus@cisco.com>

Remove obsolete DPDK bonding

- Code not used

Change-Id: I312635f8038c6d4d4db21d93e43df6b3636feb34
Signed-off-by: Peter Mikus <pmikus@cisco.com>

ef2d3082 17-Jul-2019 Peter Mikus <pmikus@cisco.com>

FIX: Tags in ansible

Change-Id: I6772734b68bc2c09ee550f1a6369e3668f613d92
Signed-off-by: Peter Mikus <pmikus@cisco.com>

8109bdd5 17-Jul-2019 Peter Mikus <pmikus@cisco.com>

FIX: Put VM interface pinning back

- Must be there for DPDK NFs

Change-Id: Icda8069beab4ce8ced17a372c84524c4824abd9d
Signed-off-by: Peter Mikus <pmikus@cisco.com>

4cb1e342 17-Jul-2019 Peter Mikus <pmikus@cisco.com>

Revert "Avoid ci-management archiving files twice"

This reverts commit ccfe499e2a27f2caf234ecbb2ec948120810eab6.

Change-Id: I076bdaf255f6fa5cc6b0f25926850d62f450fd94
Signed-off-by: Peter Mikus <pmikus@cisco.com>

a1fc500f 14-Jun-2019 Jan Gelety <jgelety@cisco.com>

CSIT-1469: Migrate IPsecUtil library from VAT to PAPI

Change-Id: Iac790bf5755a70697e4c4eff32242b04f8e7f789
Signed-off-by: Jan Gelety <jgelety@cisco.com>

f88a3d91 16-Jul-2019 Vratko Polak <vrpolak@cisco.com>

Use PapiSocketProvider for most PAPI calls

Ticket: CSIT-1541
Ticket: VPP-1722
Ticket: CSIT-1546

+ Increase timeout to hide x520 slownes of show hardware detail.
- Install sshpass and update ssh client in virl bootstrap.
+ Added TODOs to remove when CSIT-1546 is fixed.
+ Enable default socksvr on any startup conf.
+ Improve OptionString init and repr.
- The non-socket executor still kept for stats.
+ Remove everything unrelated to stats from non-socket executor.
- Remove some debug-loooking calls to avoid failures.
TODO: Introduce proper parsing to the affected keywords.
+ Reduce logging from PAPI code to level INFO.
- Needs https://gerrit.fd.io/r/20660 to fully work.
+ Change default values for LocalExecution.run()
+ Return code check enabled by default.
Code is more readable when rc!=0 is allowed explicitly,
and the test code will now detect unexpected failures.
+ Logging disabled by default.
Output XML is large already. Important logging can be enabled explicitly.
+ Restore alphabetical order in common.sh functions.

Change-Id: I05882cb6b620ad14638f7404b5ad38c7a5de9e6c
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

248d1a52 10-Jul-2019 juraj.linkes <juraj.linkes@pantheon.tech>

Refactor VPP Device VM vhost tests

* replace the current VM image with kernel img
* rework keyword usage to make it consistent with performance tests
* remove resources/libraries/robot/shared/qemu.robot as it's not used
anywhere anymore

Change-Id: Ia5bc19e9e6ed9af031e4d9b5c0c89431fb49fd33
Signed-off-by: juraj.linkes <juraj.linkes@pantheon.tech>

5287b530 15-Jul-2019 Peter Mikus <pmikus@cisco.com>

FIX: Move per-patch building mechanics

- Use make pkg-verify

Change-Id: Id0f95c9261f1a1b5fa017b0823f87aeb5d6bb6d1
Signed-off-by: Peter Mikus <pmikus@cisco.com>

1f272317 11-Jul-2019 Peter Mikus <pmikus@cisco.com>

VPPD: Cop, iACL, Policer

- Alignment with PERF

Change-Id: Id7b2cb91c88e44cf9265c3376330f6aa579abf7a
Signed-off-by: Peter Mikus <pmikus@cisco.com>

33fb3466 08-Jul-2019 Vratko Polak <vrpolak@cisco.com>

PapiExecutor always verifies

Do not support returning unverified replies anymore.
Basically, ".get_replies().verify_replies()" is now just ".get_replies()".
This allows fairly large simplifications both at call sites
and in PapiExecutor.py

+ Rename get_dumps to get_details.
+ Introduce get_reply and get_sw_if_index.
+ Rename variables holding get_*() value,
+ e.g. get_stats() value is stored to variable named "stats".
+ Rename "item" of subsequent loop to hint the type instead.
+ Rename "details" function argument to "verbose".
+ Process reply details in place, instead of building new list.
- Except hybrid blocks which can return both list or single item.
- Except human readable text building blocks.
+ Rename most similar names to sw_if_index.
- Except "vpp_sw_index" and some function names.
+ Use single run_cli_cmd from PapiExecutor.
+ Do not chain methods over multiple lines.
+ Small space gain is not worth readability loss.
+ Include minor code and docstrings improvement.
+ Add some TODOs.

Change-Id: Ib2110a3d2101a74d5837baab3a58dc46aafc6ce3
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

ccfe499e 02-Jul-2019 Vratko Polak <vrpolak@cisco.com>

Avoid ci-management archiving files twice

https://gerrit.fd.io/r/20119
has changed the way archival works,
everything should now go to logs.fd.io
(instead of appearing on run page in jenkins.fd.io).

The glob pattern for archiving is quite eager,
doing recursive search. That is good, as it can find
also misplaced useful outputs.
But it also means our usage of copy_archives function
creates two copies of archived directories,
usually archives/ and archives/archive/.

This change simply removes copy_archives,
relying on the new recursive search.

A solution with changing ARCHIVE_DIR and moving if needed
would be better, but looking at amout of jobs
and various func bootstraps, it is not worth the effort.

Change-Id: Iad2bc09455944307e59eecafa64d1db6dc8befe8
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

2228ac2b 02-Jul-2019 Yulong Pei <yulong.pei@intel.com>

Add per arch mrr daily test for denverton platform

Change-Id: Ica7d6bf0dbdfde3de70eabd131c79cadd8af3a16
Signed-off-by: Yulong Pei <yulong.pei@intel.com>

46efda9b 31-Jan-2019 juraj.linkes <juraj.linkes@pantheon.tech>

CSIT-1477: add 1n_tx2 VPP Device

- add 1n_tx2 testbed
- update VF reservation to meet 1n_tx2 testbed needs
- update ansible with 1n_tx2

Change-Id: Ia075a913d4859f537fd0e6bff731ea88aff01dd9
Signed-off-by: juraj.linkes <juraj.linkes@pantheon.tech>

d2a7114d 09-Jul-2019 Peter Mikus <pmikus@cisco.com>

Aligning FUNC/PERF keywords - Data driven

Change-Id: I233c8908c724556db09c60de6efa9237068fb4c3
Signed-off-by: Peter Mikus <pmikus@cisco.com>

7b0e8a9d 10-Jul-2019 Vratko Polak <vrpolak@cisco.com>

Fix few pylint violations

+ Stop attempting to check test/ as module inits are not there.

Change-Id: Ia4e498061be3e3118b07e98c9c2f761f2454653e
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

82094363 10-Jul-2019 Vratko Polak <vrpolak@cisco.com>

Tolerate failures when setting MTU

Because some NICs are known to not allow jumbo frames.

Change-Id: I45fe636e3a880c6640922468c170f50e85dd2ba2
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

c0b3bda5 08-Jul-2019 Jan Gelety <jgelety@cisco.com>

FIX: use correct slicing of classify mask/match string

Change-Id: I11cc8ddc6925b44a596aa03d71318efd76232d6d
Signed-off-by: Jan Gelety <jgelety@cisco.com>

36d56bdb 10-Jul-2019 Vratko Polak <vrpolak@cisco.com>

Bash functions style cleanup

+ Update rst documentation for bash style
+ Command substitution:
+ Clarify when to use backticks.
+ Recommend avoiding nested command substitution.
+ Do not recommend putting command substitution results into quotes.
+ Function definition content:
+ Move "set -exuo pipefail" after comment only blocks.
+ Other set flags allowed for functions with good reasons.
+ Apply the new recommendations.
- Blank lines unified in code but no written recommendation in rst.
+ Add missing references to functions called, variables read or set.
+ Add TODOs to where lists would be long.
+ Minor improvements to function descriptions.
+ Make "if" expressions more python-like.
+ Add missing "|| die" (or "|| true") where spotted.
+ Downgrade DEFAULT_NIC to a local variable.
+ Add TODO to list reasons for blacklisted tags.

Change-Id: I05dce030a8c2cb1b3a242d8b977e8fe150d8ee20
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

e45404bf 10-Jul-2019 juraj.linkes <juraj.linkes@pantheon.tech>

Modify kernel VM download to custom build

Instead of downloading linux-image-kvm, build custom initrd from
currently used kernel on perf sut or vpp device host.

Change-Id: I836f9c5264695c44566b7d52f3ec03e26a474524
Signed-off-by: juraj.linkes <juraj.linkes@pantheon.tech>

d5a0c731 19-Jun-2019 Peter Mikus <pmikus@cisco.com>

Add scale ipsec tunnel tests 20K

Change-Id: Ib52e1735b6b82ea9fea44c06c379f117068e94c1
Signed-off-by: Peter Mikus <pmikus@cisco.com>

533fcfe3 25-Jun-2019 Peter Mikus <pmikus@cisco.com>

CSIT-1539 Aligning FUNC/PERF keywords - Phase III

Change-Id: Ibd3e99390bf004173d3d126946b95ffe9ba8f196
Signed-off-by: Peter Mikus <pmikus@cisco.com>

dbe149c8 18-Jun-2019 Jan Gelety <jgelety@cisco.com>

FIX: VXLAN scale tests

Change-Id: I9287d5ed6d7876b98add3fb3d523e9764094843b
Signed-off-by: Jan Gelety <jgelety@cisco.com>

33ea3179 18-Jun-2019 Jan Gelety <jgelety@cisco.com>

FIX: ip scale needs sw_if_index in VAT command

Change-Id: Icb3e22a84af10b98edf83084991b8f2607c95798
Signed-off-by: Jan Gelety <jgelety@cisco.com>

08e7b875 05-Jul-2019 Peter Mikus <pmikus@cisco.com>

Remove pkt_trace as global variable

- Use explicit parameters

Change-Id: I21cbc8cf13ec5e455b20c685c4427a53a655f71f
Signed-off-by: Peter Mikus <pmikus@cisco.com>

fc4570ee 05-Jul-2019 Peter Mikus <pmikus@cisco.com>

Add Additional Setup action for scapy

Change-Id: I82f70d7c80b921da03553f6c1351a9a2f786ff0e
Signed-off-by: Peter Mikus <pmikus@cisco.com>

758d50dd 17-Jun-2019 Jan Gelety <jgelety@cisco.com>

FIX: use len parameter name in prefix structure in ip_route_add_del

+ new vpp stabel build with fixed ipv6 address incrementation

Change-Id: Id3f4104a48e45b6fd70ccbd47ad9e3c6925220fd
Signed-off-by: Jan Gelety <jgelety@cisco.com>

1bea44db 01-Jul-2019 Vratko Polak <vrpolak@cisco.com>

Replace license checker with global notices

Caring about per-file notices is too distracting.

Change-Id: I3f07a9fd1d3a4350135dd3d14f4944647af39a0b
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

c3f33398 16-Jun-2019 Jan Gelety <jgelety@cisco.com>

FIX: re-introduce VAT for IP scale tests

Change-Id: I864118ee67628ea81f2f89dab5890df8fe15c4bc
Signed-off-by: Jan Gelety <jgelety@cisco.com>

83070f6f 24-Jun-2019 Vratko Polak <vrpolak@cisco.com>

Add copyright checker to tox

+ Only looks at files edited since HEAD~.
+ Only checks files of whitelisted extensions.
+ Distinguishes missing and outdated copyrights.
+ Any line with "Copyright" substring can work.
+ Many copyright lines are tolerated, if at least one has correct year.
+ Voting.

Change-Id: I2cda0459cb191eeec7aada69c508973568039d87
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

25e203b6 28-Jun-2019 Tibor Frank <tifrank@cisco.com>

PAPI-to-VAT: MACSwap

- not used, not needed, deleted

Change-Id: I9b4c78b7ba3fbac3805d06a65f2799ed212770b3
Signed-off-by: Tibor Frank <tifrank@cisco.com>

10e0393f 14-Jun-2019 Tibor Frank <tifrank@cisco.com>

VAT-to-PAPI: Classify

Change-Id: Ic06a0a65429680e6ecdc3f5288d091c2c2630921
Signed-off-by: Tibor Frank <tifrank@cisco.com>

a8b330a2 25-Jun-2019 Tibor Frank <tifrank@cisco.com>

VAT-to-PAPI: IPFIX and SPAN

Change-Id: I34bdc17d6350e5a441dabd9154620627780f4c12
Signed-off-by: Tibor Frank <tifrank@cisco.com>

a5df75f5 26-Jun-2019 Tibor Frank <tifrank@cisco.com>

VAT-to-PAPI: Trace

Change-Id: Id0b6943eec7e8a15cb2db5c89f93a38f21d686c7
Signed-off-by: Tibor Frank <tifrank@cisco.com>

a8dd76fd 26-Jun-2019 Tibor Frank <tifrank@cisco.com>

VAT-to-PAPI: Remove unused VAT files.

Change-Id: I1563db488e9dd690aa7e732691e306a9e51ececa
Signed-off-by: Tibor Frank <tifrank@cisco.com>

56c1c013 20-Jun-2019 Jan Gelety <jgelety@cisco.com>

FIX: IPUtil after vpp api changes

+ do not log all ip_route_add_del api calls to PAPI history
in case of scale tests

+ fix for SRv6 proxy tests

+ support of more complex structures in api calls/replies
in PapiExecutor

+ update of vpp stable build to version 19.08-rc0~487-gb98dbb1

Change-Id: I9972e126b68ce1cb57f781e3d90ea9b3914de69e
Signed-off-by: Jan Gelety <jgelety@cisco.com>

75584265 26-Jun-2019 Peter Mikus <pmikus@cisco.com>

Introduce EXPECTED_FAILING

Change-Id: I6c578e9126778c584ccb57a4a2c76d96dea8fb35
Signed-off-by: Peter Mikus <pmikus@cisco.com>

7cac9ce6 16-Jun-2019 Jan Gelety <jgelety@cisco.com>

Add support for more complex structures in PAPI calls/replies

Change-Id: I3f83d1209a08dcf342cc2031191bb82cebc53e4a
Signed-off-by: Jan Gelety <jgelety@cisco.com>

1577123a 21-Jun-2019 Peter Mikus <pmikus@cisco.com>

Align suite/test teardown/setup

+ Phase II - aligning FUNC/PERF setup.
+ 2n/3n compatibility of suite setup.
+ Same structure of testcase for DEV/PERF.
+ DEVICE tests are now running VPP startup config in same
way as PERF.
+ DEVICE is using COREKEEPER!
- DEVICE tests are running topology compute twice for backward
compatibility. TODO to remove.
- Still phase III needed to align TAGS, LIBRARIES and remove OLD
setup phase.

Change-Id: Ib6e1b0ebf4abebf3cbe73b4fda5cac953c2a7270
Signed-off-by: Peter Mikus <pmikus@cisco.com>

cac8f76c 24-Jun-2019 Vratko Polak <vrpolak@cisco.com>

Store "tag" and "url" in files in reservation dir

String "Unknown" is used if test run tag or url is not supplied,
so this change should be backward compatible.

+ Used "runtag", as both "test" and "tag" start with taken "-t".
+ Fixed some pylint violations.
+ Docstring explaining the steps taken and reasoning behind two files.
+ Other minor improvements.

Change-Id: If704d02e51374087fe39ad0f69432477d1b310d3
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

06531331 21-Jun-2019 Vratko Polak <vrpolak@cisco.com>

Allow 9000b tests for AVF

See https://gerrit.fd.io/r/20148

Change-Id: I22856b14e3608348f2ccecb1d99d87209db2d776
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

6871d4e7 18-Jun-2019 Peter Mikus <pmikus@cisco.com>

Align suite/test teardown/setup

+ Phase I - aligning FUNC/PERF

Change-Id: I46b1e43687ddb29f5ed3c6335fe1baf21ec02822
Signed-off-by: Peter Mikus <pmikus@cisco.com>

cd635521 13-Jun-2019 Vratko Polak <vrpolak@cisco.com>

SetupFramework: log thread error to console

Because logger.error from a non-main thread is lost.

+ Increase verbosity of virtualenv exception.
+ Introduce LocalExecution.py library.
+ Include multiple other style improvements.
+ Add some ssh.py improvements:
+ Accept also commands of OptionString type.
+ Introduce a limited form of raise_from for exception chaining.
+ Add include_reason argument to exec_cmd_no_error.

Change-Id: I0cd92bcdaa1a5c4cc20cb99067593fc3b40d2c31
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

bf1ea240 19-Jun-2019 Yulong Pei <yulong.pei@intel.com>

Add 2n-dnv and 3n-dnv configuration to bootstrap-verify-perf.sh

Change-Id: I90427de5b611e432e5e46ab8758a31e376215914
Signed-off-by: Yulong Pei <yulong.pei@intel.com>

34b3be9d 19-Jun-2019 Tibor Frank <tifrank@cisco.com>

Add continue/fail option for enable traces

Change-Id: I675f9664391c9f18f312773812f765f345983cc1
Signed-off-by: Tibor Frank <tifrank@cisco.com>

b7b863ad 19-Jun-2019 Tibor Frank <tifrank@cisco.com>

Trending: Reduce the number of input files

Change-Id: I37fdd6c01a8e25ecc0353118db3c8e18d848c890
Signed-off-by: Tibor Frank <tifrank@cisco.com>

3c863def 02-Jun-2019 Tibor Frank <tifrank@cisco.com>

VAT-to-PAPI: VPPCounters

Change-Id: I5954fdd61ead9b4143f8cc4e20294cf8e199e0af
Signed-off-by: Tibor Frank <tifrank@cisco.com>

287ef8c6 11-Jun-2019 Tibor Frank <tifrank@cisco.com>

VAT-to-PAPI: NATUtil

Change-Id: Id64bbf899e78c7c55410a8ce608393c22fa596ab
Signed-off-by: Tibor Frank <tifrank@cisco.com>

0e28406b 30-May-2019 Jan Gelety <jgelety@cisco.com>

CSIT-1459: Migrate IP libraries from VAT to PAPI

Change-Id: Id84cf9c3afd53260b5bbf658a6a3870aa0c91333
Signed-off-by: Jan Gelety <jgelety@cisco.com>


libraries/python/IPUtil.py
libraries/python/IPv4NodeAddress.py
libraries/python/IPv4Setup.py
libraries/python/IPv4Util.py
libraries/python/IPv6NodesAddr.py
libraries/python/IPv6Setup.py
libraries/python/IPv6Util.py
libraries/python/InterfaceUtil.py
libraries/python/Routing.py
libraries/python/ssh.py
libraries/robot/crypto/ipsec.robot
libraries/robot/features/policer.robot
libraries/robot/honeycomb/interfaces.robot
libraries/robot/honeycomb/persistence.robot
libraries/robot/honeycomb/port_mirroring.robot
libraries/robot/honeycomb/sub_interface.robot
libraries/robot/ip/ip4.robot
libraries/robot/ip/ip6.robot
libraries/robot/overlay/lisp_static_adjacency.robot
libraries/robot/overlay/vxlan.robot
libraries/robot/performance/performance_configuration.robot
libraries/robot/shared/traffic.robot
libraries/robot/tcp/tcp_setup.robot
templates/vat/add_fib_table.vat
templates/vat/add_ip_address.vat
templates/vat/add_ip_neighbor.vat
templates/vat/add_l2_fib_entry.vat
templates/vat/add_route.vat
templates/vat/api_trace_dump.vat
templates/vat/api_trace_save.vat
templates/vat/create_avf_interface.vat
templates/vat/create_bond_interface.vat
templates/vat/create_gre.vat
templates/vat/create_loopback.vat
templates/vat/create_sub_interface.vat
templates/vat/create_vhost_user_if.vat
templates/vat/create_vlan_subif.vat
templates/vat/del_fib_table.vat
templates/vat/del_ip_address.vat
templates/vat/del_route.vat
templates/vat/enslave_physical_interface.vat
templates/vat/flush_ip_addresses.vat
templates/vat/hw_interface_set_mtu.vat
templates/vat/input_acl_int.vat
templates/vat/interface_dump.vat
templates/vat/interface_vrf_dump.vat
templates/vat/ip_address_dump.vat
templates/vat/ip_source_check.vat
templates/vat/l2_bd_add_sw_if_index.vat
templates/vat/l2_bd_create.vat
templates/vat/l2_bd_dump.vat
templates/vat/l2_bridge_domain.vat
templates/vat/l2_bridge_domain_delete.vat
templates/vat/l2_fib_entry_delete.vat
templates/vat/l2_fib_table_dump.vat
templates/vat/l2_patch.vat
templates/vat/l2_vlan_tag_rewrite.vat
templates/vat/l2_xconnect.vat
templates/vat/memif_create.vat
templates/vat/memif_dump.vat
templates/vat/memif_socket_filename_add_del.vat
templates/vat/proxy_arp_intfc_enable.vat
templates/vat/set_fib_to_interface.vat
templates/vat/set_if_state.vat
templates/vat/show_interface.vat
templates/vat/show_ip_fib.vat
templates/vat/show_memif.vat
templates/vat/show_vhost.vat
templates/vat/sw_interface_ip6nd_ra_config.vat
templates/vat/tap_dump.vat
templates/vat/vhost_user_dump.vat
templates/vat/vxlan_create.vat
templates/vat/vxlan_dump.vat
templates/vat/vxlan_gpe_dump.vat
test_data/honeycomb/interface_ip.py
test_data/honeycomb/plugin_acl.py
92fbe3b8 09-Jun-2019 Tibor Frank <tifrank@cisco.com>

VAT-to-PAPI: VPPUtils

Change-Id: If4eb592e2718c4564f1f7929ca6ff91c02f074a6
Signed-off-by: Tibor Frank <tifrank@cisco.com>

2732350f 07-Jun-2019 Peter Mikus <pmikus@cisco.com>

Add scale ipsec tunnel tests

- 5K
- 10K

Change-Id: Iaa2c77d07c3686e09fe327c663d7d7fc42024034
Signed-off-by: Peter Mikus <pmikus@cisco.com>

03d32950 19-Jun-2019 Yulong Pei <yulong.pei@intel.com>

Add denverton servers to ansible lf_inventory hosts

Change-Id: Iac3ed425caa8f7c28546f04a6c4adc1f834bffd6
Signed-off-by: Yulong Pei <yulong.pei@intel.com>

7c175329 18-Jun-2019 Vratko Polak <vrpolak@cisco.com>

Fix exit from reservation loop

Break from the while loop is on both success and no testbeds.

Change-Id: Iea368034927965c7f99f5502240bd768e3f62eec
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

0b704d1f 18-Jun-2019 Vratko Polak <vrpolak@cisco.com>

Continue reservation when cleanup fails

+ Only on not-failed-yet testbeds.
+ If any, else give up.

Change-Id: I3209507d3d57a77ef6afad3184ca25e098910311
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

72ae46cd 10-Jun-2019 Tibor Frank <tifrank@cisco.com>

PAPI: Reduce the amount of logged information

Change-Id: I5cfd19a9ecca6891232d92d232a159422c0a835e
Signed-off-by: Tibor Frank <tifrank@cisco.com>

4e8fb0f0 13-Jun-2019 Vratko Polak <vrpolak@cisco.com>

Add more tests to daily jobs

+ Add baseline tests for all NICs, only min size.
+ Add scale tests for x710 NIC, only min size and without 4c.

New test counts:
csit-vpp-perf-mrr-daily-master-2n-skx: 96
csit-vpp-perf-mrr-daily-master-3n-skx: 211
csit-vpp-perf-mrr-daily-master: 223

Change-Id: I14c0699dd8277b6e59cdfa3e41585f50ec75dd29
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

b5e271f3 17-Jun-2019 Tibor Frank <tifrank@cisco.com>

CSIT-1488: Add data to the Report 1904

Change-Id: Ieb6537c1e1c1b7e0ca4f7ec490a9f0bd379030e9
Signed-off-by: Tibor Frank <tifrank@cisco.com>

f5d73589 17-Jun-2019 Tibor Frank <tifrank@cisco.com>

Report 1904: Configure rls 1904.25

Change-Id: I44bfc2247d4d2def131d89e1d97d8cad7522ccd1
Signed-off-by: Tibor Frank <tifrank@cisco.com>

8f062925 14-Jun-2019 Peter Mikus <pmikus@cisco.com>

FIX: IPsec TNL mode func

Change-Id: I4fdcf48d8c60d728b0fe1b44baf0d2042185dd42
Signed-off-by: Peter Mikus <pmikus@cisco.com>

6b743ce4 14-Jun-2019 Vratko Polak <vrpolak@cisco.com>

Add hsw drivers to topology and check against AVF

Change-Id: Ifcc1dcdb3a0b4a7c62e4a41e5b3d016b276e93be
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

15bef10b 11-Jun-2019 Vratko Polak <vrpolak@cisco.com>

Add comments for some tag exclusions

Change-Id: I9daa70e433a2942d29c4e64856cb76d31f94a6f3
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

7d9ab80c 14-Jun-2019 Peter Mikus <pmikus@cisco.com>

FIX: IPsec TNL mode

Change-Id: Ide82ae5fa03d3fec8f4db9db7634be0a1e339cd1
Signed-off-by: Peter Mikus <pmikus@cisco.com>

acac11db 14-Jun-2019 Peter Mikus <pmikus@cisco.com>

FIX: IPsec INT mode

Change-Id: I286490280b6e62f9f212831a5bf1d14db1838fa7
Signed-off-by: Peter Mikus <pmikus@cisco.com>

12a51f96 14-Jun-2019 Tibor Frank <tifrank@cisco.com>

PAPI: Fix PyLint errors

Change-Id: Ieaafbb111f4c3aea9b577c2ab31ca5162400ac46
Signed-off-by: Tibor Frank <tifrank@cisco.com>

79cd3212 12-Jun-2019 Tibor Frank <tifrank@cisco.com>

CSIT-1488: Add data to the Report 1904

Change-Id: If0e75e4bb4623eea913d433affa42a6bb03454b8
Signed-off-by: Tibor Frank <tifrank@cisco.com>

d5e7718b 09-Jun-2019 Peter Mikus <pmikus@cisco.com>

vpp_device: TAP

Change-Id: Ife31921daaa5a87f64e61d2eebb98bfdded1dc76
Signed-off-by: Peter Mikus <pmikus@cisco.com>

f49a6734 07-Jun-2019 Peter Mikus <pmikus@cisco.com>

vpp_device: IPsec

- Remove VM ipsec tests as they are not interesting
- Remove duplicate (vpp_device/virl) VM tests
- Remove VM tunnel tests and use base tunnel (we do not need tunnel and VM)

Change-Id: I5d7b6d8a037878f81a6bdc0114af481b32141dde
Signed-off-by: Peter Mikus <pmikus@cisco.com>

2c6e0991 09-Jun-2019 Tibor Frank <tifrank@cisco.com>

CSIT-1488: Add data to the Report 1904

Change-Id: Ia75675d6e89902c3370feaa2e8eb468cdd0fdba1
Signed-off-by: Tibor Frank <tifrank@cisco.com>

4e1c9f0b 09-Jun-2019 Tibor Frank <tifrank@cisco.com>

Report: Configure report 1904.24

Change-Id: I4d6d913f0139fe0fab00668ec16081c04cc6bc0e
Signed-off-by: Tibor Frank <tifrank@cisco.com>

dc3efb44 06-Jun-2019 Peter Mikus <pmikus@cisco.com>

Python3: TRex driver

Change-Id: I25f7598b52c87ec1a2d4c6f22680d5200b583e2c
Signed-off-by: Peter Mikus <pmikus@cisco.com>

e74411c3 09-Jun-2019 Peter Mikus <pmikus@cisco.com>

FIX: Disable AVF on 3n-hsw

Change-Id: Id7c81a92dd50db365c219529a687fa37fd05ceb3
Signed-off-by: Peter Mikus <pmikus@cisco.com>

233eeb3e 06-Jun-2019 Peter Mikus <pmikus@cisco.com>

CSIT-1521 Convert NestedVM testcase into KernelVM

Change-Id: Ic493253dc29dad4fc7e6541e4b839ca5898a6a40
Signed-off-by: Peter Mikus <pmikus@cisco.com>

80e06fae 05-Jun-2019 Vratko Polak <vrpolak@cisco.com>

Simplify mrr daily tag expression

The number of tests executed is intentionally smaller,
as recently the runtime has gone up too much.

New numbers:
csit-vpp-perf-mrr-daily-master: 120
csit-vpp-perf-mrr-daily-master-2n-skx: 72
csit-vpp-perf-mrr-daily-master-3n-skx: 126

More details included as diff files.

+ Less per-testbed exceptions.
- Single/double links tags still set at two places.

Change-Id: I1149d3e52edf38c7d9d3e0160c533e35ae944d0d
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

060fbf18 05-Jun-2019 Tibor Frank <tifrank@cisco.com>

CSIT-1488: Add data to the Report 1904

Change-Id: I54b2f02745497ea4cd90d485834b1aa42389f57d
Signed-off-by: Tibor Frank <tifrank@cisco.com>

e5c9717d 05-Jun-2019 Peter Mikus <pmikus@cisco.com>

FIX: OS detection

Change-Id: I3ba6c7dc6a72e376419990ce7f5acc8d373f246f
Signed-off-by: Peter Mikus <pmikus@cisco.com>

ea6e8be8 18-May-2019 Thomas F Herbert <therbert@redhat.com>

CSIT changes to support new Centos 7 device testing container image.

CSIT-1505

Parse {os} parameter from job and use it to separate the correct
image for each distro and the correct stable package versions.
Use two vpp device image names, one for Ubuntu and one for Centos.

Centos sut image is in https://hub.docker.com/r/snergster/csit-sut-centos
Source for Centos sut image:
https://github.com/snergfdio/multivppcache/tree/master/csit-sut-centos

Change-Id: I568c82710d730c4ed0ca25bc12cb6074e1cbe27e
Signed-off-by: Thomas F Herbert <therbert@redhat.com>

494c42cf 05-Jun-2019 Peter Mikus <pmikus@cisco.com>

Remove intrusive useless logging

Change-Id: Ib633266daaf67f257867f5ba0b2836f777ecd3bf
Signed-off-by: Peter Mikus <pmikus@cisco.com>

fad4332b 24-May-2019 Peter Mikus <pmikus@cisco.com>

Even more Crypto combinations

Change-Id: I10eeb4ee30a57712824e68176d92d1ecb5f0d1b0
Signed-off-by: Peter Mikus <pmikus@cisco.com>

ee7c9ed2 04-Jun-2019 Tibor Frank <tifrank@cisco.com>

CSIT-1488: Add data to the Report 1904

Change-Id: I8609ecd45a634fccf3e721beac5a0ec640f704db
Signed-off-by: Tibor Frank <tifrank@cisco.com>

ff78ad6f 16-May-2019 Tibor Frank <tifrank@cisco.com>

VAT-to-PAPI: memif

Change-Id: I9e3f1a2a2a1c11a355cd66c940beb663ecc7d7a4
Signed-off-by: Tibor Frank <tifrank@cisco.com>

a6f5c70e 04-Jun-2019 Michal Cmarada <mcmarada@cisco.com>

fix Honeycomb failing tests

- due to VAT to PAPI migration some tests
need to be updated
- fixed HC tests: ACL, Interfaces/SubInterfaces, Tap
Vhost, Vxlan, Vxlan-gpe

Change-Id: I9adad041a619b48057bdda388becd53dde484483
Signed-off-by: Michal Cmarada <mcmarada@cisco.com>

13c45925 03-Jun-2019 Tibor Frank <tifrank@cisco.com>

VAT-to-PAPI: ContainerUtils

Change-Id: Id186c3c280a6b876b8212e01b261ad8c65e5f40c
Signed-off-by: Tibor Frank <tifrank@cisco.com>

91237b65 30-May-2019 Tibor Frank <tifrank@cisco.com>

VAT-to-PAPI: VhostUser

Change-Id: I235d4654b04275877b3c5f4cf49ef5755c3f4985
Signed-off-by: Tibor Frank <tifrank@cisco.com>

15688783 30-May-2019 Jan Gelety <jgelety@cisco.com>

Add possibility to use other then default NIC per VPP patch

Change-Id: I25e51022e0ec961fce444bc8f0f4413d0e95d7eb
Signed-off-by: Jan Gelety <jgelety@cisco.com>

1c0948c3 02-Jun-2019 Tibor Frank <tifrank@cisco.com>

CSIT-1488: Add data to the Report 1904

Change-Id: I514dbd61dc22736fb3925d6d3cec767d0f4f84a8
Signed-off-by: Tibor Frank <tifrank@cisco.com>

c87a7507 02-Jun-2019 Tibor Frank <tifrank@cisco.com>

Report: Configure Report 1904.23

Change-Id: I0f19d4e3bdafbdf1a435436a2f25945c2b45e06e
Signed-off-by: Tibor Frank <tifrank@cisco.com>

459f6b00 31-May-2019 Peter Mikus <pmikus@cisco.com>

Add meltdown spectre to calibration set

+ Fix the version of MMD tool to always latest

Change-Id: Iafd7f40d618b8e4995b5cc12fe06056719f58517
Signed-off-by: Peter Mikus <pmikus@cisco.com>

fe1975eb 18-Mar-2019 Jan Gelety <jgelety@cisco.com>

CSIT-1468: InterfaceUtil migration from VAT to PAPI

Change-Id: I0062710d58996be767a852dc00545fedd60a5c72
Signed-off-by: Jan Gelety <jgelety@cisco.com>

245ea1de 29-May-2019 juraj.linkes <juraj.linkes@pantheon.tech>

Fix args order in setup_node call

Change-Id: I484cda8c8410e2f38d68da82761b1154dda26b1c
Signed-off-by: juraj.linkes <juraj.linkes@pantheon.tech>

cf64b952 24-May-2019 juraj.linkes <juraj.linkes@pantheon.tech>

Use threads for fw setup and cleanup

Using multiprocessing sometimes causes scp to hang when copying files.
Threading is also more lightweight.

Change-Id: I047b4835bbf1584c80469b27af5394d89087e8a9
Signed-off-by: juraj.linkes <juraj.linkes@pantheon.tech>

66d62a70 28-May-2019 Peter Mikus <pmikus@cisco.com>

FIX: Trex 2.54 resolve issue.

Change-Id: I8ffb360411fe5a0304ba7568828588dc7cfad267
Signed-off-by: Peter Mikus <pmikus@cisco.com>

09877682 28-May-2019 Tibor Frank <tifrank@cisco.com>

CSIT-1488: Add data to the Report 1904

- remove 'NIC_Cisco-VIC-1385' and '9000B' from vpp perf full

Change-Id: Ic3d6a035945eddf6a5f5c73a62ca872a59c18b46
Signed-off-by: Tibor Frank <tifrank@cisco.com>

5cbb3f16 27-May-2019 Michal Cmarada <mcmarada@cisco.com>

HC2VPP-411: migrate interfaces-state to interfaces

- new ietf-interfaces makes interfaces-state obsolete
- updates honeycomb tests to latest ietf-interfaces model

Change-Id: I5502a5ab23661429caca9498407d7121d423a1a3
Signed-off-by: Michal Cmarada <mcmarada@cisco.com>

1fea09e6 23-May-2019 Jan Gelety <jgelety@cisco.com>

FIX: do not generate 9000B perf test in case of vic1385 nic

Change-Id: I7b8e30903a8bc012a3bb43bfb33755e08b56dc1d
Signed-off-by: Jan Gelety <jgelety@cisco.com>

0a244598 27-May-2019 Tibor Frank <tifrank@cisco.com>

CSIT-1488: Add data to the Report 1904

Change-Id: If23ed1d2a8b716a2c145a8b13ebc91c9925284d8
Signed-off-by: Tibor Frank <tifrank@cisco.com>

f90655a9 05-Feb-2019 Tibor Frank <tifrank@cisco.com>

CSIT-1425 Upgrade TRex to v2.54

Change-Id: I71010c18210e88828ded0bc679997d76f34886cb
Signed-off-by: Peter Mikus <pmikus@cisco.com>


libraries/python/Constants.py
libraries/python/TrafficGenerator.py
tools/presentation/conf.py
tools/trex/trex_server_info.py
tools/trex/trex_stateless_profile.py
tools/trex/trex_stateless_stop.py
traffic_profiles/trex/profile_trex_stateless_base_class.py
traffic_profiles/trex/trex-sf-2n-ethip4tcphttp-1u1s-nginx-cps.py
traffic_profiles/trex/trex-sf-2n-ethip4tcphttp-1u1s-vpp-cps.py
traffic_profiles/trex/trex-sl-2n-dot1qip4asym-ip4src254.py
traffic_profiles/trex/trex-sl-2n-dot1qip6asym-ip6src253.py
traffic_profiles/trex/trex-sl-2n-ethip4-ip4dst10000.py
traffic_profiles/trex/trex-sl-2n-ethip4-ip4dst100000.py
traffic_profiles/trex/trex-sl-2n-ethip4-ip4dst1000000.py
traffic_profiles/trex/trex-sl-2n-ethip4-ip4src253.py
traffic_profiles/trex/trex-sl-2n-ethip4-ip4src254.py
traffic_profiles/trex/trex-sl-2n-ethip4-macsrc500kdst500k.py
traffic_profiles/trex/trex-sl-2n-ethip4-macsrc50kdst50k.py
traffic_profiles/trex/trex-sl-2n-ethip4-macsrc5kdst5k.py
traffic_profiles/trex/trex-sl-2n-ethip4udp-10u1000p-conc.py
traffic_profiles/trex/trex-sl-2n-ethip4udp-1u1p.py
traffic_profiles/trex/trex-sl-2n-ethip6-ip6dst10000.py
traffic_profiles/trex/trex-sl-2n-ethip6-ip6dst100000.py
traffic_profiles/trex/trex-sl-2n-ethip6-ip6dst1000000.py
traffic_profiles/trex/trex-sl-2n-ethip6-ip6src253.py
traffic_profiles/trex/trex-sl-2n3n-ethip4-ip4src254-10c1n.py
traffic_profiles/trex/trex-sl-2n3n-ethip4-ip4src254-10c2n.py
traffic_profiles/trex/trex-sl-2n3n-ethip4-ip4src254-1c10n.py
traffic_profiles/trex/trex-sl-2n3n-ethip4-ip4src254-1c1n.py
traffic_profiles/trex/trex-sl-2n3n-ethip4-ip4src254-1c2n.py
traffic_profiles/trex/trex-sl-2n3n-ethip4-ip4src254-1c4n.py
traffic_profiles/trex/trex-sl-2n3n-ethip4-ip4src254-1c6n.py
traffic_profiles/trex/trex-sl-2n3n-ethip4-ip4src254-1c8n.py
traffic_profiles/trex/trex-sl-2n3n-ethip4-ip4src254-2c10n.py
traffic_profiles/trex/trex-sl-2n3n-ethip4-ip4src254-2c1n.py
traffic_profiles/trex/trex-sl-2n3n-ethip4-ip4src254-2c2n.py
traffic_profiles/trex/trex-sl-2n3n-ethip4-ip4src254-2c4n.py
traffic_profiles/trex/trex-sl-2n3n-ethip4-ip4src254-2c6n.py
traffic_profiles/trex/trex-sl-2n3n-ethip4-ip4src254-2c8n.py
traffic_profiles/trex/trex-sl-2n3n-ethip4-ip4src254-4c1n.py
traffic_profiles/trex/trex-sl-2n3n-ethip4-ip4src254-4c2n.py
traffic_profiles/trex/trex-sl-2n3n-ethip4-ip4src254-4c4n.py
traffic_profiles/trex/trex-sl-2n3n-ethip4-ip4src254-4c6n.py
traffic_profiles/trex/trex-sl-2n3n-ethip4-ip4src254-6c1n.py
traffic_profiles/trex/trex-sl-2n3n-ethip4-ip4src254-6c2n.py
traffic_profiles/trex/trex-sl-2n3n-ethip4-ip4src254-6c4n.py
traffic_profiles/trex/trex-sl-2n3n-ethip4-ip4src254-8c1n.py
traffic_profiles/trex/trex-sl-2n3n-ethip4-ip4src254-8c2n.py
traffic_profiles/trex/trex-sl-3n-dot1qip4-vlan100ip4src254ip4dst254.py
traffic_profiles/trex/trex-sl-3n-dot1qip4-vlan10ip4src254ip4dst254.py
traffic_profiles/trex/trex-sl-3n-dot1qip4-vlan1ip4src254ip4dst254.py
traffic_profiles/trex/trex-sl-3n-dot1qip4-vlan1kip4src254ip4dst254.py
traffic_profiles/trex/trex-sl-3n-ethip4-ip4dst1.py
traffic_profiles/trex/trex-sl-3n-ethip4-ip4dst100.py
traffic_profiles/trex/trex-sl-3n-ethip4-ip4dst1000.py
traffic_profiles/trex/trex-sl-3n-ethip4-ip4dst10000.py
traffic_profiles/trex/trex-sl-3n-ethip4-ip4dst100000.py
traffic_profiles/trex/trex-sl-3n-ethip4-ip4dst1000000.py
traffic_profiles/trex/trex-sl-3n-ethip4-ip4dst253.py
traffic_profiles/trex/trex-sl-3n-ethip4-ip4dst253_l3fwd.py
traffic_profiles/trex/trex-sl-3n-ethip4-ip4src253.py
traffic_profiles/trex/trex-sl-3n-ethip4-ip4src254.py
traffic_profiles/trex/trex-sl-3n-ethip4-macsrc100ip4src100.py
traffic_profiles/trex/trex-sl-3n-ethip4-macsrc100kip4src100k.py
traffic_profiles/trex/trex-sl-3n-ethip4-macsrc10kip4src10k.py
traffic_profiles/trex/trex-sl-3n-ethip4-macsrc500kdst500k.py
traffic_profiles/trex/trex-sl-3n-ethip4-macsrc50kdst50k.py
traffic_profiles/trex/trex-sl-3n-ethip4-macsrc5kdst5k.py
traffic_profiles/trex/trex-sl-3n-ethip4udp-1000u15p.py
traffic_profiles/trex/trex-sl-3n-ethip4udp-100u1000p-conc.py
traffic_profiles/trex/trex-sl-3n-ethip4udp-100u15p.py
traffic_profiles/trex/trex-sl-3n-ethip4udp-10u1000p-conc.py
traffic_profiles/trex/trex-sl-3n-ethip4udp-10u10p-conc.py
traffic_profiles/trex/trex-sl-3n-ethip4udp-10u15p.py
traffic_profiles/trex/trex-sl-3n-ethip4udp-1u15p.py
traffic_profiles/trex/trex-sl-3n-ethip4udp-1u1p.py
traffic_profiles/trex/trex-sl-3n-ethip4udp-2000u15p.py
traffic_profiles/trex/trex-sl-3n-ethip4udp-4000u15p.py
traffic_profiles/trex/trex-sl-3n-ethip6-ip6dst10000.py
traffic_profiles/trex/trex-sl-3n-ethip6-ip6dst100000.py
traffic_profiles/trex/trex-sl-3n-ethip6-ip6dst1000000.py
traffic_profiles/trex/trex-sl-3n-ethip6-ip6src253.py
traffic_profiles/trex/trex-sl-ethip4-vxlansrc253.py
26023885 24-May-2019 Tibor Frank <tifrank@cisco.com>

Report: Configure Report 1904.22

Change-Id: Ic8d5a9a856658a2a2661cae8abd8d3b1127b4ff8
Signed-off-by: Tibor Frank <tifrank@cisco.com>

66aba4cf 24-May-2019 Tibor Frank <tifrank@cisco.com>

CSIT-1488: Add data to the Report 1904

Change-Id: I23224cba405ad905b65799682f59de126d88bc2b
Signed-off-by: Tibor Frank <tifrank@cisco.com>

2f2bc8e9 17-May-2019 Tibor Frank <tifrank@cisco.com>

PAL: Add IPSEC to mapping table

- waiting for https://gerrit.fd.io/r/19677
- waiting for https://gerrit.fd.io/r/19710

Change-Id: I1c4a09ded8402d9ce60e021414ce7f46781526b8
Signed-off-by: Tibor Frank <tifrank@cisco.com>

2ada04e2 17-May-2019 Peter Mikus <pmikus@cisco.com>

CSIT-1506: Rework IPsec base testcases

- Add:
aes-128-gcm aes-128-gcm
aes-256-gcm aes-256-gcm
aes-128-cbc hmac-sha-256
aes-256-cbc hmac-sha-512

- Remove:
hmac-sha1

- Scale will follow in next patch

Change-Id: I789f71cf66cf61b8dbb3c6dbe9b6fdc79866ac33
Signed-off-by: Peter Mikus <pmikus@cisco.com>

24b2f2f2 21-May-2019 Tibor Frank <tifrank@cisco.com>

Report: Fix missing func and vpp_device data

Change-Id: Id21e52262904baa9a940e5680a413a1f5ae06b8b
Signed-off-by: Tibor Frank <tifrank@cisco.com>

04ea580e 23-Feb-2019 Peter Mikus <pmikus@cisco.com>