mbox

[RFC,v1,00/10] dts: add hello world testcase

Message ID 20220824162454.394285-1-juraj.linkes@pantheon.tech (mailing list archive)
Headers

Message

Juraj Linkeš Aug. 24, 2022, 4:24 p.m. UTC
  The patch is built on top of the existing SSH connection patch submitted
earlier and contains the rest of the code to run the most basic
testcase, hello world, which just runs the hello world application and
verifies the output.

The code added is mostly about setting up the testbed, building DPDK on
the system under test and then running the testcases defined in one
testsuite.

There are three areas which I'm planning on improving:
1. Revisit how the methods in Node, SutNode and TrafficGeneratorNode can
be redistributed so that we have a clean split of code that common to
both node types and that's specific to both.
2. Add abstraction that handle OS differences.
3. Better split of code into commits.

A new version with the above changes will be submitted in around
two-three weeks time.

Juraj Linkeš (10):
  dts: hello world config options
  dts: hello world cli parameters and env vars
  dts: ssh connection additions for hello world
  dts: add basic node management methods
  dts: add system under test node
  dts: add traffic generator node
  dts: add testcase and basic test results
  dts: add test runner and statistics collector
  dts: add hello world testplan
  dts: add hello world testsuite

 dts/conf.yaml                              |  20 +-
 dts/framework/config/__init__.py           | 141 ++++-
 dts/framework/config/conf_yaml_schema.json | 139 ++++-
 dts/framework/dts.py                       | 174 +++++-
 dts/framework/exception.py                 |  15 +
 dts/framework/logger.py                    |   9 +-
 dts/framework/node.py                      | 395 +++++++++++++-
 dts/framework/settings.py                  |  96 +++-
 dts/framework/ssh_connection.py            |  19 +
 dts/framework/ssh_pexpect.py               |  61 ++-
 dts/framework/stats_reporter.py            |  70 +++
 dts/framework/sut_node.py                  | 603 +++++++++++++++++++++
 dts/framework/test_case.py                 | 274 ++++++++++
 dts/framework/test_result.py               | 218 ++++++++
 dts/framework/tg_node.py                   |  78 +++
 dts/framework/utils.py                     |  14 +
 dts/test_plans/hello_world_test_plan.rst   |  68 +++
 dts/tests/TestSuite_hello_world.py         |  80 +++
 18 files changed, 2432 insertions(+), 42 deletions(-)
 create mode 100644 dts/framework/stats_reporter.py
 create mode 100644 dts/framework/sut_node.py
 create mode 100644 dts/framework/test_case.py
 create mode 100644 dts/framework/test_result.py
 create mode 100644 dts/framework/tg_node.py
 create mode 100644 dts/test_plans/hello_world_test_plan.rst
 create mode 100644 dts/tests/TestSuite_hello_world.py