mbox series

[v2,0/5] cleanup: rename base classes

Message ID 20220526131135.1643352-1-juraj.linkes@pantheon.tech (mailing list archive)
Headers
Series cleanup: rename base classes |

Message

Juraj Linkeš May 26, 2022, 1:11 p.m. UTC
  The current naming of the base elements DTS works with is a bit
confusing, which this patch attemps to ameliorate. The basic elements
could be divided into and described in short as follows:
* A node: a broad term encompassing a host where any of the DTS elements
are present. This could be a physical or virtualized server or a
container.
* The control node: the host where DTS runs
* An SUT (system under test) node: This is where DPDK along with the
tested hardware resides. The system comprises DPDK and the hardware.
* A traffic generator node: The node where the traffic generator is
present, such as Trex, Scapy or a hardware traffic generator (e.g. IXIA)

All references to DUT were removed. This is because it was used to mean
both the server where DPDK/NIC are present and the DUT (device under
test, i.e. the NIC) in different contexts. Where applicable, DUT was
replaced with NIC and the rest was replaced with SUT. With this change,
it's clear what's meant and the abbreviations are very different, which
removes that layer of confusion.

Also rename the classes pertaining to traffic generation to Traffic
Generators.

With that, rename the following classes:
Crb -> Node
Dut -> SutNode
Tester -> TrafficGeneratorNode
DPDKdut -> DpdkSut
DPDKtester -> DpdkTrafficGenerator
VirtDut -> VirtSut
CrbsConf -> TopologyConf
PktgenConf -> TrafficGeneratorConf
PacketGenerator -> TrafficGenerator
PacketGeneratorHelper -> TrafficGeneratorStream (moved from deleted
                                                (framework/pktgen.py)
DpdkPacketGenerator -> DpdkTrafficGenerator
IxiaPacketGenerator -> IxExplorerTrafficGenerator
IxNetworkPacketGenerator -> IxNetworkTrafficGenerator
TrexPacketGenerator -> TrexTrafficGenerator
scapy -> ScapyPacketUtil
Packet -> ScapyPacketBuilder

Along with the classes, also rename variables and doc/comment
references.

Rename the files where these classes are defined as well:
crb.py -> node.py
dut.py -> sut_node.py
pktgen_ixia.py -> tg_ixexplorer.py
pktgen_ixia_network.py -> tg_ixnetwork.py
pktgen_base.py -> tg_perf.py
packet.py -> scapy_packet_builder.py
pktgen_trex.py -> tg_trex.py
tester.py -> tg_node.py
virt_dut.py -> virt_sut.py

Delete one file, the contents of which were moved elsewhere:
framework/pktgen.py

And also rename related config files:
crbs.cfg -> topology.cfg
pktgen.cfg -> traffic_generator.cfg

And one of the doc files:
setup_dut.rst -> setup_sut.rst

Also add .gitignore with some basic rules.

Also remove the output directory, as it doesn't really serve a purpose.

Also replace some whitespaces as a result of automatic IDE cleanup.

branch: future-dts

Juraj Linkeš (5):
  rename base classes 1
  rename base classes 2
  rename base classes 3
  rename base classes 4
  rename base classes 5

 conf/crbs.cfg                                 |   42 -
 conf/l3fwd.cfg                                |    2 +-
 conf/performance_thread.cfg                   |    2 +-
 conf/ports.cfg                                |   18 +-
 conf/power_bidirection_channel.cfg            |    2 +-
 conf/power_branch_ratio.cfg                   |    2 +-
 conf/power_negative.cfg                       |    2 +-
 conf/scene/dpdk_vf_passthrough.cfg            |   16 +-
 conf/scene/pf_passthrough.cfg                 |   14 +-
 conf/scene/vf_passthrough.cfg                 |   14 +-
 conf/scene/vf_passthrough_1.cfg               |   14 +-
 conf/testpmd_perf.cfg                         |    2 +-
 conf/topology.cfg                             |   42 +
 conf/{pktgen.cfg => traffic_generator.cfg}    |   24 +-
 conf/vhost_peer_conf.cfg                      |    2 +-
 conf/vm_power_manager.cfg                     |    2 +-
 conf/vm_pw_mgmt_policy.cfg                    |    2 +-
 doc/dts_gsg/image/virt_flow.svg               |   28 +-
 doc/dts_gsg/quick_start.rst                   |  122 +-
 doc/dts_gsg/usr_guide/igb_uio.rst             |    2 +-
 doc/dts_gsg/usr_guide/index.rst               |    2 +-
 doc/dts_gsg/usr_guide/intro.rst               |   18 +-
 doc/dts_gsg/usr_guide/ixia.rst                |  144 +--
 doc/dts_gsg/usr_guide/results.rst             |   12 +-
 .../{setup_dut.rst => setup_sut.rst}          |    8 +-
 doc/dts_gsg/usr_guide/sys_reqs.rst            |   18 +-
 doc/dts_gsg/usr_guide/trex.rst                |  104 +-
 doc/dts_gsg/usr_guide/usage.rst               |  110 +-
 execution.cfg                                 |    2 +-
 executions/execution.cfg                      |    4 +-
 executions/execution_FVL.cfg                  |    4 +-
 executions/execution_fm10k.cfg                |    4 +-
 executions/execution_rxmode.cfg               |    6 +-
 executions/execution_smoke.cfg                |    2 +-
 framework/asan_test.py                        |   18 +-
 framework/checkCase.py                        |   44 +-
 framework/config.py                           |  192 ++-
 framework/crbs.py                             |   37 -
 framework/debugger.py                         |    8 +-
 framework/dts.py                              |  296 ++---
 framework/excel_reporter.py                   |   74 +-
 framework/exception.py                        |    8 +-
 framework/ixia_network/ixnet.py               |    2 +-
 framework/json_reporter.py                    |   40 +-
 framework/logger.py                           |  188 +--
 framework/multiple_vm.py                      |   78 +-
 framework/{crb.py => node.py}                 |  120 +-
 framework/pktgen.py                           |  207 ----
 framework/plotting.py                         |    6 +-
 framework/pmd_output.py                       |   26 +-
 framework/project_dpdk.py                     |   72 +-
 framework/qemu_kvm.py                         |   88 +-
 framework/qemu_libvirt.py                     |   30 +-
 framework/rst.py                              |    8 +-
 .../{packet.py => scapy_packet_builder.py}    |  233 ++--
 framework/settings.py                         |   30 +-
 framework/ssh_connection.py                   |   12 +-
 framework/ssh_pexpect.py                      |   42 +-
 framework/stats_reporter.py                   |   22 +-
 framework/{dut.py => sut_node.py}             |  247 ++--
 framework/test_case.py                        |   88 +-
 framework/test_result.py                      |  210 ++--
 .../{pktgen_ixia.py => tg_ixexplorer.py}      |  115 +-
 ...pktgen_ixia_network.py => tg_ixnetwork.py} |   40 +-
 framework/{tester.py => tg_node.py}           |  275 +++--
 framework/{pktgen_base.py => tg_perf.py}      |  266 +++-
 framework/{pktgen_trex.py => tg_trex.py}      |   54 +-
 framework/utils.py                            |   40 +-
 framework/virt_base.py                        |  126 +-
 framework/virt_common.py                      |    6 +-
 framework/virt_resource.py                    |   36 +-
 framework/virt_scene.py                       |  108 +-
 framework/{virt_dut.py => virt_sut.py}        |  102 +-
 main.py                                       |   12 +-
 nics/net_device.py                            |   46 +-
 nics/system_info.py                           |    6 +-
 output/Readme.txt                             |    2 -
 test_plans/NICStatistics_test_plan.rst        |    2 +-
 test_plans/af_xdp_2_test_plan.rst             |   12 +-
 test_plans/basic_4k_pages_cbdma_test_plan.rst |   20 +-
 test_plans/basic_4k_pages_dsa_test_plan.rst   |   62 +-
 test_plans/checksum_offload_test_plan.rst     |    8 +-
 test_plans/dcf_lifecycle_test_plan.rst        |  276 ++---
 test_plans/dpdk_gro_lib_cbdma_test_plan.rst   |    2 +-
 .../dpdk_hugetlbfs_mount_size_test_plan.rst   |   12 +-
 test_plans/efd_test_plan.rst                  |   10 +-
 ...ckage_download_in_ice_driver_test_plan.rst |   16 +-
 test_plans/ethtool_stats_test_plan.rst        |    4 +-
 test_plans/eventdev_perf_test_plan.rst        |    2 +-
 .../eventdev_pipeline_perf_test_plan.rst      |    2 +-
 .../external_mempool_handler_test_plan.rst    |   10 +-
 test_plans/flexible_rxd_test_plan.rst         |    4 +-
 test_plans/floating_veb_test_plan.rst         |   26 +-
 .../flow_classify_softnic_test_plan.rst       |   22 +-
 test_plans/flow_classify_test_plan.rst        |   18 +-
 test_plans/flow_filtering_test_plan.rst       |   14 +-
 test_plans/generic_flow_api_test_plan.rst     |   42 +-
 .../iavf_flexible_descriptor_test_plan.rst    |    2 +-
 ..._package_driver_error_handle_test_plan.rst |   16 +-
 test_plans/iavf_test_plan.rst                 |    4 +-
 test_plans/ice_1pps_signal_test_plan.rst      |   10 +-
 ...ce_advanced_iavf_rss_gtpogre_test_plan.rst |    4 +-
 .../ice_advanced_iavf_rss_gtpu_test_plan.rst  |  172 +--
 ...vanced_iavf_rss_pppol2tpoudp_test_plan.rst |    6 +-
 .../ice_advanced_iavf_rss_test_plan.rst       |   10 +-
 ...vf_rss_vlan_esp_ah_l2tp_pfcp_test_plan.rst |    8 +-
 .../ice_advanced_rss_gtpogre_test_plan.rst    |    6 +-
 .../ice_advanced_rss_gtpu_test_plan.rst       |   28 +-
 .../ice_advanced_rss_pppoe_test_plan.rst      |    4 +-
 test_plans/ice_advanced_rss_test_plan.rst     |   10 +-
 ...ed_rss_vlan_esp_ah_l2tp_pfcp_test_plan.rst |    4 +-
 test_plans/ice_dcf_acl_filter_test_plan.rst   |   14 +-
 test_plans/ice_dcf_date_path_test_plan.rst    |   12 +-
 .../ice_dcf_flow_priority_test_plan.rst       |    2 +-
 test_plans/ice_dcf_qos_test_plan.rst          |  390 +++---
 .../ice_dcf_switch_filter_gtpu_test_plan.rst  |    2 +-
 .../ice_dcf_switch_filter_pppoe_test_plan.rst |    4 +-
 .../ice_dcf_switch_filter_test_plan.rst       |   20 +-
 test_plans/ice_flow_priority_test_plan.rst    |  229 ++--
 .../ice_iavf_fdir_gtpogre_test_plan.rst       |    4 +-
 .../ice_iavf_fdir_pppol2tpoudp_test_plan.rst  |  978 +++++++--------
 test_plans/ice_iavf_fdir_test_plan.rst        |   78 +-
 ...ce_iavf_ip_fragment_rte_flow_test_plan.rst |   16 +-
 .../ice_iavf_rss_configure_test_plan.rst      |    2 +-
 .../ice_ip_fragment_rte_flow_test_plan.rst    |   16 +-
 test_plans/ice_limit_value_test_test_plan.rst |    6 +-
 test_plans/ice_qinq_test_plan.rst             |  234 ++--
 test_plans/ice_rss_configure_test_plan.rst    |   20 +-
 test_plans/ice_switch_filter_test_plan.rst    |  180 +--
 test_plans/inline_ipsec_test_plan.rst         |   72 +-
 test_plans/interrupt_pmd_test_plan.rst        |    2 +-
 test_plans/ip_pipeline_test_plan.rst          |  144 +--
 test_plans/ipgre_test_plan.rst                |    2 +-
 test_plans/ipsec_gw_and_library_test_plan.rst |   18 +-
 .../ipsec_gw_cryptodev_func_test_plan.rst     |    6 +-
 test_plans/ipv4_reassembly_test_plan.rst      |   48 +-
 ..._get_extra_queue_information_test_plan.rst |    6 +-
 test_plans/kernelpf_iavf_test_plan.rst        |   28 +-
 test_plans/kni_test_plan.rst                  |   18 +-
 test_plans/l2fwd_cryptodev_func_test_plan.rst |    8 +-
 test_plans/l2fwd_test_plan.rst                |   12 +-
 test_plans/l2tp_esp_coverage_test_plan.rst    |  404 +++----
 test_plans/l3fwd_func_test_plan.rst           |   42 +-
 test_plans/l3fwdacl_test_plan.rst             |    4 +-
 test_plans/link_flowctrl_test_plan.rst        |   16 +-
 .../link_status_interrupt_test_plan.rst       |    4 +-
 test_plans/linux_modules_test_plan.rst        |   20 +-
 ...irtio_user_server_mode_cbdma_test_plan.rst |   14 +-
 ..._virtio_user_server_mode_dsa_test_plan.rst |    6 +-
 test_plans/mdd_test_plan.rst                  |   16 +-
 .../metering_and_policing_test_plan.rst       |   22 +-
 test_plans/metrics_test_plan.rst              |   22 +-
 test_plans/multiple_pthread_test_plan.rst     |   24 +-
 test_plans/nic_single_core_perf_test_plan.rst |   24 +-
 test_plans/nvgre_test_plan.rst                |   30 +-
 test_plans/packet_capture_test_plan.rst       |   84 +-
 test_plans/pf_smoke_test_plan.rst             |    4 +-
 test_plans/pipeline_test_plan.rst             |   30 +-
 test_plans/pmd_bonded_8023ad_test_plan.rst    |   12 +-
 test_plans/pmd_bonded_test_plan.rst           |   22 +-
 test_plans/pmd_stacked_bonded_test_plan.rst   |   18 +-
 test_plans/pmd_test_plan.rst                  |   22 +-
 test_plans/pmdpcap_test_plan.rst              |    2 +-
 test_plans/pmdrss_hash_test_plan.rst          |    4 +-
 test_plans/pmdrssreta_test_plan.rst           |    6 +-
 test_plans/port_control_test_plan.rst         |    6 +-
 test_plans/port_representor_test_plan.rst     |    4 +-
 test_plans/power_branch_ratio_test_plan.rst   |    6 +-
 ...power_managerment_throughput_test_plan.rst |    4 +-
 test_plans/power_pbf_test_plan.rst            |    4 +-
 test_plans/ptpclient_test_plan.rst            |   28 +-
 .../pvp_diff_qemu_version_test_plan.rst       |    8 +-
 .../pvp_multi_paths_performance_test_plan.rst |   20 +-
 ...host_single_core_performance_test_plan.rst |   20 +-
 ...rtio_single_core_performance_test_plan.rst |   20 +-
 ...emu_multi_paths_port_restart_test_plan.rst |   12 +-
 test_plans/pvp_share_lib_test_plan.rst        |    2 +-
 test_plans/pvp_vhost_dsa_test_plan.rst        |   84 +-
 .../pvp_vhost_user_reconnect_test_plan.rst    |   32 +-
 test_plans/pvp_virtio_bonding_test_plan.rst   |    2 +-
 ...pvp_virtio_user_2M_hugepages_test_plan.rst |    4 +-
 .../pvp_virtio_user_4k_pages_test_plan.rst    |    4 +-
 ...er_multi_queues_port_restart_test_plan.rst |   20 +-
 test_plans/qinq_filter_test_plan.rst          |   78 +-
 test_plans/qos_api_test_plan.rst              |   12 +-
 test_plans/qos_meter_test_plan.rst            |    8 +-
 test_plans/qos_sched_test_plan.rst            |   14 +-
 test_plans/queue_start_stop_test_plan.rst     |   10 +-
 test_plans/rte_flow_test_plan.rst             |   20 +-
 test_plans/rteflow_priority_test_plan.rst     |   28 +-
 ...ntime_vf_queue_number_kernel_test_plan.rst |    8 +-
 .../runtime_vf_queue_number_test_plan.rst     |    8 +-
 test_plans/rxtx_offload_test_plan.rst         |   16 +-
 test_plans/shutdown_api_test_plan.rst         |   38 +-
 test_plans/softnic_test_plan.rst              |   10 +-
 test_plans/tso_test_plan.rst                  |   30 +-
 test_plans/tx_preparation_test_plan.rst       |   10 +-
 test_plans/uni_pkt_test_plan.rst              |    6 +-
 test_plans/unit_tests_loopback_test_plan.rst  |    2 +-
 test_plans/unit_tests_pmd_perf_test_plan.rst  |    2 +-
 test_plans/userspace_ethtool_test_plan.rst    |   10 +-
 test_plans/veb_switch_test_plan.rst           |    8 +-
 test_plans/vf_daemon_test_plan.rst            |   64 +-
 test_plans/vf_interrupt_pmd_test_plan.rst     |   26 +-
 test_plans/vf_kernel_test_plan.rst            |  142 +--
 test_plans/vf_l3fwd_test_plan.rst             |    6 +-
 test_plans/vf_macfilter_test_plan.rst         |    8 +-
 test_plans/vf_offload_test_plan.rst           |   22 +-
 test_plans/vf_packet_rxtx_test_plan.rst       |   20 +-
 test_plans/vf_pf_reset_test_plan.rst          |   56 +-
 test_plans/vf_port_start_stop_test_plan.rst   |    4 +-
 test_plans/vf_rss_test_plan.rst               |    4 +-
 test_plans/vf_single_core_perf_test_plan.rst  |   20 +-
 test_plans/vf_smoke_test_plan.rst             |    4 +-
 test_plans/vf_vlan_test_plan.rst              |   14 +-
 test_plans/vhost_cbdma_test_plan.rst          |   30 +-
 .../vhost_user_live_migration_test_plan.rst   |   66 +-
 ...t_virtio_pmd_interrupt_cbdma_test_plan.rst |   10 +-
 .../vhost_virtio_pmd_interrupt_test_plan.rst  |   14 +-
 ..._virtio_user_interrupt_cbdma_test_plan.rst |   14 +-
 .../vhost_virtio_user_interrupt_test_plan.rst |   24 +-
 ...io_event_idx_interrupt_cbdma_test_plan.rst |   12 +-
 .../virtio_event_idx_interrupt_test_plan.rst  |   20 +-
 .../virtio_ipsec_cryptodev_func_test_plan.rst |    6 +-
 .../virtio_pvp_regression_test_plan.rst       |   32 +-
 test_plans/virtio_smoke_test_plan.rst         |    2 +-
 ...ser_for_container_networking_test_plan.rst |    4 +-
 .../vlan_ethertype_config_test_plan.rst       |    2 +-
 test_plans/vm2vm_virtio_net_dsa_test_plan.rst |   30 +-
 .../vm2vm_virtio_net_perf_cbdma_test_plan.rst |   14 +-
 .../vm2vm_virtio_net_perf_test_plan.rst       |    4 +-
 .../vm2vm_virtio_pmd_cbdma_test_plan.rst      |    8 +-
 .../vm2vm_virtio_user_cbdma_test_plan.rst     |   18 +-
 .../vm2vm_virtio_user_dsa_test_plan.rst       |   28 +-
 test_plans/vm_hotplug_test_plan.rst           |    8 +-
 test_plans/vm_pw_mgmt_policy_test_plan.rst    |   30 +-
 ...paths_performance_with_cbdma_test_plan.rst |   58 +-
 test_plans/vswitch_sample_cbdma_test_plan.rst |    8 +-
 test_plans/vswitch_sample_dsa_test_plan.rst   |   44 +-
 .../vxlan_gpe_support_in_i40e_test_plan.rst   |    4 +-
 test_plans/vxlan_test_plan.rst                |    2 +-
 tests/TestSuite_acl.py                        |   16 +-
 tests/TestSuite_af_xdp_2.py                   |   72 +-
 tests/TestSuite_asan_smoke.py                 |   34 +-
 tests/TestSuite_basic_4k_pages_cbdma.py       |  138 +--
 tests/TestSuite_blocklist.py                  |   18 +-
 tests/TestSuite_cbdma.py                      |   82 +-
 tests/TestSuite_checksum_offload.py           |  286 ++---
 tests/TestSuite_cloud_filter_with_l4_port.py  |   86 +-
 tests/TestSuite_cmdline.py                    |   28 +-
 tests/TestSuite_compressdev_isal_pmd.py       |    2 +-
 tests/TestSuite_compressdev_qat_pmd.py        |    2 +-
 tests/TestSuite_compressdev_zlib_pmd.py       |    2 +-
 tests/TestSuite_coremask.py                   |   26 +-
 tests/TestSuite_crypto_perf_cryptodev_perf.py |   42 +-
 tests/TestSuite_dcf_lifecycle.py              |  190 +--
 tests/TestSuite_ddp_gtp.py                    |  108 +-
 tests/TestSuite_ddp_gtp_qregion.py            |  110 +-
 tests/TestSuite_ddp_l2tpv3.py                 |  144 +--
 tests/TestSuite_ddp_mpls.py                   |   90 +-
 tests/TestSuite_ddp_ppp_l2tp.py               |   86 +-
 tests/TestSuite_distributor.py                |   96 +-
 tests/TestSuite_dpdk_gro_lib.py               |  260 ++--
 tests/TestSuite_dpdk_gro_lib_cbdma.py         |  128 +-
 tests/TestSuite_dpdk_gso_lib.py               |  296 ++---
 tests/TestSuite_dpdk_hugetlbfs_mount_size.py  |  126 +-
 tests/TestSuite_dual_vlan.py                  |  192 +--
 tests/TestSuite_dynamic_config.py             |  130 +-
 tests/TestSuite_dynamic_flowtype.py           |   72 +-
 tests/TestSuite_dynamic_queue.py              |   92 +-
 tests/TestSuite_eeprom_dump.py                |   36 +-
 tests/TestSuite_efd.py                        |   76 +-
 ...e_enable_package_download_in_ice_driver.py |  188 +--
 tests/TestSuite_ethtool_stats.py              |   36 +-
 tests/TestSuite_eventdev_perf.py              |  512 ++++----
 tests/TestSuite_eventdev_pipeline.py          |   58 +-
 tests/TestSuite_eventdev_pipeline_perf.py     |  278 ++---
 tests/TestSuite_example_build.py              |    6 +-
 tests/TestSuite_external_memory.py            |   82 +-
 tests/TestSuite_external_mempool_handler.py   |   32 +-
 tests/TestSuite_fips_cryptodev.py             |   10 +-
 tests/TestSuite_firmware_version.py           |   10 +-
 tests/TestSuite_flexible_rxd.py               |   26 +-
 tests/TestSuite_floating_veb.py               |  194 +--
 tests/TestSuite_flow_classify.py              |   74 +-
 tests/TestSuite_flow_classify_softnic.py      |  537 ++++-----
 tests/TestSuite_flow_filtering.py             |   40 +-
 tests/TestSuite_generic_flow_api.py           |  682 +++++------
 tests/TestSuite_hello_world.py                |   16 +-
 tests/TestSuite_hotplug.py                    |  126 +-
 tests/TestSuite_hotplug_mp.py                 |   46 +-
 tests/TestSuite_i40e_rss_input.py             | 1074 ++++++++---------
 tests/TestSuite_iavf.py                       |  343 +++---
 tests/TestSuite_iavf_flexible_descriptor.py   |   48 +-
 ...tSuite_iavf_package_driver_error_handle.py |  172 +--
 tests/TestSuite_ice_1pps_signal.py            |   14 +-
 tests/TestSuite_ice_advanced_iavf_rss.py      |   74 +-
 ...TestSuite_ice_advanced_iavf_rss_gtpogre.py |   44 +-
 tests/TestSuite_ice_advanced_iavf_rss_gtpu.py |   52 +-
 ...uite_ice_advanced_iavf_rss_pppol2tpoudp.py |   52 +-
 ...advanced_iavf_rss_vlan_esp_ah_l2tp_pfcp.py |   72 +-
 tests/TestSuite_ice_advanced_rss.py           |   54 +-
 tests/TestSuite_ice_advanced_rss_gtpogre.py   |   36 +-
 tests/TestSuite_ice_advanced_rss_gtpu.py      |   36 +-
 tests/TestSuite_ice_advanced_rss_pppoe.py     |   38 +-
 ..._ice_advanced_rss_vlan_esp_ah_l2tp_pfcp.py |   44 +-
 tests/TestSuite_ice_dcf_acl_filter.py         |  160 +--
 tests/TestSuite_ice_dcf_date_path.py          |   62 +-
 tests/TestSuite_ice_dcf_flow_priority.py      |  110 +-
 tests/TestSuite_ice_dcf_qos.py                |   69 +-
 tests/TestSuite_ice_dcf_switch_filter.py      |  202 ++--
 tests/TestSuite_ice_dcf_switch_filter_gtpu.py |   74 +-
 .../TestSuite_ice_dcf_switch_filter_pppoe.py  |  104 +-
 tests/TestSuite_ice_ecpri.py                  |  100 +-
 tests/TestSuite_ice_fdir.py                   |   88 +-
 tests/TestSuite_ice_flow_priority.py          |   32 +-
 tests/TestSuite_ice_iavf_fdir.py              |  442 +++----
 tests/TestSuite_ice_iavf_fdir_gtpogre.py      |   64 +-
 tests/TestSuite_ice_iavf_fdir_pppol2tpoudp.py |   52 +-
 ...TestSuite_ice_iavf_ip_fragment_rte_flow.py |   58 +-
 tests/TestSuite_ice_iavf_rss_configure.py     |   42 +-
 tests/TestSuite_ice_ip_fragment_rte_flow.py   |   46 +-
 tests/TestSuite_ice_limit_value_test.py       |  250 ++--
 tests/TestSuite_ice_qinq.py                   |  134 +-
 tests/TestSuite_ice_rss_configure.py          |   22 +-
 tests/TestSuite_ice_switch_filter.py          |  196 +--
 tests/TestSuite_ice_switch_filter_pppoe.py    |  174 +--
 ...tSuite_ice_vf_support_multicast_address.py |  120 +-
 tests/TestSuite_ieee1588.py                   |   76 +-
 tests/TestSuite_inline_ipsec.py               |   94 +-
 tests/TestSuite_interrupt_pmd.py              |   54 +-
 tests/TestSuite_ip_pipeline.py                |  339 +++---
 tests/TestSuite_ipfrag.py                     |  106 +-
 tests/TestSuite_ipgre.py                      |   94 +-
 tests/TestSuite_ipsec_gw_cryptodev_func.py    |   62 +-
 tests/TestSuite_ipv4_reassembly.py            |  108 +-
 ...te_ixgbe_vf_get_extra_queue_information.py |  104 +-
 tests/TestSuite_jumboframes.py                |   74 +-
 tests/TestSuite_keep_alive.py                 |   32 +-
 tests/TestSuite_kernelpf_iavf.py              |  350 +++---
 tests/TestSuite_kni.py                        |  464 +++----
 tests/TestSuite_l2fwd.py                      |  108 +-
 tests/TestSuite_l2fwd_cryptodev_func.py       |   68 +-
 tests/TestSuite_l2fwd_jobstats.py             |   36 +-
 tests/TestSuite_l2tp_esp_coverage.py          |  224 ++--
 tests/TestSuite_l3fwd.py                      |   10 +-
 tests/TestSuite_l3fwd_func.py                 |   86 +-
 tests/TestSuite_l3fwd_lpm_ipv4.py             |   10 +-
 tests/TestSuite_l3fwd_lpm_ipv4_rfc2544.py     |   10 +-
 tests/TestSuite_l3fwd_lpm_ipv6.py             |   10 +-
 tests/TestSuite_l3fwdacl.py                   |  216 ++--
 tests/TestSuite_large_vf.py                   |   74 +-
 tests/TestSuite_link_flowctrl.py              |  130 +-
 tests/TestSuite_link_status_interrupt.py      |  122 +-
 tests/TestSuite_linux_modules.py              |   84 +-
 ...Suite_loopback_multi_paths_port_restart.py |   34 +-
 tests/TestSuite_loopback_multi_queues.py      |   28 +-
 ...tSuite_loopback_virtio_user_server_mode.py |   60 +-
 ..._loopback_virtio_user_server_mode_cbdma.py |   50 +-
 tests/TestSuite_mac_filter.py                 |   88 +-
 tests/TestSuite_macsec_for_ixgbe.py           |  148 +--
 ...Suite_malicious_driver_event_indication.py |   54 +-
 tests/TestSuite_mdd.py                        |   90 +-
 tests/TestSuite_metering_and_policing.py      |  190 +--
 tests/TestSuite_metrics.py                    |   93 +-
 tests/TestSuite_mtu_update.py                 |   63 +-
 tests/TestSuite_multicast.py                  |   48 +-
 tests/TestSuite_multiple_pthread.py           |   44 +-
 tests/TestSuite_multiprocess.py               |  188 +--
 tests/TestSuite_nic_single_core_perf.py       |   64 +-
 tests/TestSuite_ntb.py                        |   97 +-
 tests/TestSuite_nvgre.py                      |  190 +--
 tests/TestSuite_packet_capture.py             |  248 ++--
 tests/TestSuite_packet_ordering.py            |   50 +-
 tests/TestSuite_perf_virtio_user_loopback.py  |   24 +-
 tests/TestSuite_pf_smoke.py                   |   82 +-
 tests/TestSuite_pipeline.py                   |  815 +++++++------
 tests/TestSuite_pmd.py                        |  168 +--
 tests/TestSuite_pmd_bonded.py                 |  640 +++++-----
 tests/TestSuite_pmd_bonded_8023ad.py          |   28 +-
 tests/TestSuite_pmd_stacked_bonded.py         |   38 +-
 tests/TestSuite_pmdpcap.py                    |   80 +-
 tests/TestSuite_pmdrss_hash.py                |  266 ++--
 tests/TestSuite_pmdrssreta.py                 |   88 +-
 tests/TestSuite_port_control.py               |   64 +-
 tests/TestSuite_port_representor.py           |  100 +-
 tests/TestSuite_power_bidirection_channel.py  |   82 +-
 tests/TestSuite_power_branch_ratio.py         |  109 +-
 tests/TestSuite_power_empty_poll.py           |   69 +-
 tests/TestSuite_power_negative.py             |   76 +-
 tests/TestSuite_power_pbf.py                  |   56 +-
 tests/TestSuite_power_pstate.py               |   48 +-
 tests/TestSuite_power_telemetry.py            |   59 +-
 tests/TestSuite_ptpclient.py                  |   70 +-
 tests/TestSuite_ptype_mapping.py              |   64 +-
 tests/TestSuite_pvp_diff_qemu_version.py      |   92 +-
 .../TestSuite_pvp_multi_paths_performance.py  |   66 +-
 ...lti_paths_vhost_single_core_performance.py |   62 +-
 ...ti_paths_virtio_single_core_performance.py |   64 +-
 ...Suite_pvp_qemu_multi_paths_port_restart.py |   74 +-
 tests/TestSuite_pvp_share_lib.py              |   70 +-
 tests/TestSuite_pvp_vhost_user_reconnect.py   |  148 +--
 tests/TestSuite_pvp_virtio_bonding.py         |   64 +-
 .../TestSuite_pvp_virtio_user_2M_hugepages.py |   58 +-
 tests/TestSuite_pvp_virtio_user_4k_pages.py   |   74 +-
 ...p_virtio_user_multi_queues_port_restart.py |   60 +-
 tests/TestSuite_qinq_filter.py                |  176 +--
 tests/TestSuite_qos_api.py                    |  102 +-
 tests/TestSuite_qos_meter.py                  |   75 +-
 tests/TestSuite_queue_region.py               |  270 ++---
 tests/TestSuite_queue_start_stop.py           |   74 +-
 tests/TestSuite_rss_key_update.py             |   92 +-
 tests/TestSuite_rss_to_rte_flow.py            |  426 +++----
 tests/TestSuite_rte_flow.py                   |   38 +-
 tests/TestSuite_rteflow_priority.py           |  192 +--
 tests/TestSuite_runtime_vf_queue_number.py    |  110 +-
 ...estSuite_runtime_vf_queue_number_kernel.py |   96 +-
 ...stSuite_runtime_vf_queue_number_maxinum.py |   58 +-
 tests/TestSuite_rxtx_callbacks.py             |   34 +-
 tests/TestSuite_rxtx_offload.py               |  413 ++++---
 tests/TestSuite_scatter.py                    |   38 +-
 tests/TestSuite_short_live.py                 |  100 +-
 tests/TestSuite_shutdown_api.py               |  420 +++----
 tests/TestSuite_skeleton.py                   |   34 +-
 tests/TestSuite_softnic.py                    |  104 +-
 tests/TestSuite_speed_capabilities.py         |   22 +-
 tests/TestSuite_sriov_kvm.py                  |  190 +--
 tests/TestSuite_stats_checks.py               |   60 +-
 tests/TestSuite_telemetry.py                  |   72 +-
 tests/TestSuite_testpmd_perf.py               |    8 +-
 tests/TestSuite_timer.py                      |   14 +-
 tests/TestSuite_tso.py                        |  340 +++---
 tests/TestSuite_tx_preparation.py             |   81 +-
 tests/TestSuite_uni_pkt.py                    |   64 +-
 tests/TestSuite_unit_tests_cmdline.py         |   12 +-
 tests/TestSuite_unit_tests_crc.py             |   12 +-
 tests/TestSuite_unit_tests_cryptodev_func.py  |   14 +-
 tests/TestSuite_unit_tests_dump.py            |  134 +-
 tests/TestSuite_unit_tests_eal.py             |  236 ++--
 tests/TestSuite_unit_tests_event_timer.py     |   26 +-
 tests/TestSuite_unit_tests_kni.py             |   20 +-
 tests/TestSuite_unit_tests_loopback.py        |   84 +-
 tests/TestSuite_unit_tests_lpm.py             |   42 +-
 tests/TestSuite_unit_tests_mbuf.py            |   12 +-
 tests/TestSuite_unit_tests_mempool.py         |   22 +-
 tests/TestSuite_unit_tests_pmd_perf.py        |   38 +-
 tests/TestSuite_unit_tests_power.py           |   32 +-
 tests/TestSuite_unit_tests_qos.py             |   32 +-
 tests/TestSuite_unit_tests_ring.py            |   20 +-
 tests/TestSuite_unit_tests_ringpmd.py         |   22 +-
 tests/TestSuite_unit_tests_timer.py           |   22 +-
 tests/TestSuite_userspace_ethtool.py          |  224 ++--
 tests/TestSuite_vdev_primary_secondary.py     |   66 +-
 tests/TestSuite_veb_switch.py                 |  184 +--
 tests/TestSuite_vf_daemon.py                  |  190 +--
 tests/TestSuite_vf_interrupt_pmd.py           |  176 +--
 tests/TestSuite_vf_jumboframe.py              |   88 +-
 tests/TestSuite_vf_kernel.py                  |  598 ++++-----
 tests/TestSuite_vf_l3fwd.py                   |   92 +-
 tests/TestSuite_vf_l3fwd_em_kernelpf.py       |   10 +-
 tests/TestSuite_vf_l3fwd_kernelpf.py          |   10 +-
 tests/TestSuite_vf_l3fwd_lpm_ipv4_kernelpf.py |   10 +-
 ...uite_vf_l3fwd_lpm_ipv4_rfc2544_kernelpf.py |   10 +-
 tests/TestSuite_vf_l3fwd_lpm_ipv6_kernelpf.py |   10 +-
 tests/TestSuite_vf_macfilter.py               |   94 +-
 tests/TestSuite_vf_offload.py                 |  220 ++--
 tests/TestSuite_vf_packet_rxtx.py             |  142 +--
 tests/TestSuite_vf_port_start_stop.py         |   64 +-
 tests/TestSuite_vf_rss.py                     |  144 +--
 tests/TestSuite_vf_single_core_perf.py        |   88 +-
 tests/TestSuite_vf_smoke.py                   |  104 +-
 tests/TestSuite_vf_to_vf_nic_bridge.py        |   86 +-
 tests/TestSuite_vf_vlan.py                    |  148 +--
 tests/TestSuite_vhost_1024_ethports.py        |   34 +-
 tests/TestSuite_vhost_cbdma.py                |  100 +-
 tests/TestSuite_vhost_event_idx_interrupt.py  |   94 +-
 tests/TestSuite_vhost_multi_queue_qemu.py     |  190 +--
 tests/TestSuite_vhost_pmd_xstats.py           |   54 +-
 tests/TestSuite_vhost_user_interrupt.py       |   56 +-
 tests/TestSuite_vhost_user_live_migration.py  |  292 ++---
 tests/TestSuite_vhost_virtio_pmd_interrupt.py |  124 +-
 ...tSuite_vhost_virtio_pmd_interrupt_cbdma.py |  126 +-
 .../TestSuite_vhost_virtio_user_interrupt.py  |  116 +-
 ...Suite_vhost_virtio_user_interrupt_cbdma.py |   78 +-
 tests/TestSuite_virtio_event_idx_interrupt.py |   98 +-
 ...tSuite_virtio_event_idx_interrupt_cbdma.py |  108 +-
 .../TestSuite_virtio_ipsec_cryptodev_func.py  |  168 +--
 tests/TestSuite_virtio_perf_cryptodev_func.py |   96 +-
 tests/TestSuite_virtio_pvp_regression.py      |   98 +-
 tests/TestSuite_virtio_smoke.py               |   46 +-
 tests/TestSuite_virtio_unit_cryptodev_func.py |   94 +-
 ...stSuite_virtio_user_as_exceptional_path.py |  164 +--
 ...te_virtio_user_for_container_networking.py |   58 +-
 tests/TestSuite_vlan.py                       |  116 +-
 tests/TestSuite_vlan_ethertype_config.py      |  198 +--
 tests/TestSuite_vm2vm_virtio_net_perf.py      |  104 +-
 .../TestSuite_vm2vm_virtio_net_perf_cbdma.py  |   94 +-
 tests/TestSuite_vm2vm_virtio_pmd.py           |  306 ++---
 tests/TestSuite_vm2vm_virtio_pmd_cbdma.py     |   66 +-
 tests/TestSuite_vm2vm_virtio_user.py          |  104 +-
 tests/TestSuite_vm2vm_virtio_user_cbdma.py    |   66 +-
 tests/TestSuite_vm_hotplug.py                 |  136 +--
 tests/TestSuite_vm_power_manager.py           |   78 +-
 tests/TestSuite_vm_pw_mgmt_policy.py          |  162 +--
 tests/TestSuite_vmdq.py                       |   82 +-
 tests/TestSuite_vmdq_dcb.py                   |   54 +-
 ..._pvp_multi_paths_performance_with_cbdma.py |  102 +-
 tests/TestSuite_vswitch_sample_cbdma.py       |  202 ++--
 tests/TestSuite_vxlan.py                      |  323 +++--
 tests/TestSuite_vxlan_gpe_support_in_i40e.py  |   70 +-
 tests/bonding.py                              |   88 +-
 tests/compress_common.py                      |   32 +-
 tests/cryptodev_common.py                     |   18 +-
 tests/flexible_common.py                      |   48 +-
 tests/perf_test_base.py                       |  136 +--
 tests/rte_flow_common.py                      |   64 +-
 tests/smoke_base.py                           |   34 +-
 tools/dump_case.py                            |    6 +-
 tools/setup.py                                |  134 +-
 519 files changed, 20989 insertions(+), 21075 deletions(-)
 delete mode 100644 conf/crbs.cfg
 create mode 100644 conf/topology.cfg
 rename conf/{pktgen.cfg => traffic_generator.cfg} (81%)
 rename doc/dts_gsg/usr_guide/{setup_dut.rst => setup_sut.rst} (97%)
 delete mode 100644 framework/crbs.py
 rename framework/{crb.py => node.py} (91%)
 delete mode 100644 framework/pktgen.py
 rename framework/{packet.py => scapy_packet_builder.py} (85%)
 rename framework/{dut.py => sut_node.py} (89%)
 rename framework/{pktgen_ixia.py => tg_ixexplorer.py} (95%)
 rename framework/{pktgen_ixia_network.py => tg_ixnetwork.py} (83%)
 rename framework/{tester.py => tg_node.py} (76%)
 rename framework/{pktgen_base.py => tg_perf.py} (70%)
 rename framework/{pktgen_trex.py => tg_trex.py} (95%)
 rename framework/{virt_dut.py => virt_sut.py} (83%)
 delete mode 100644 output/Readme.txt