Cover Detail
Show a cover letter.
GET /api/covers/129589/?format=api
{ "id": 129589, "url": "http://patchwork.dpdk.org/api/covers/129589/?format=api", "web_url": "http://patchwork.dpdk.org/project/dts/cover/20230718012629.2471811-1-ke1.xu@intel.com/", "project": { "id": 3, "url": "http://patchwork.dpdk.org/api/projects/3/?format=api", "name": "DTS", "link_name": "dts", "list_id": "dts.dpdk.org", "list_email": "dts@dpdk.org", "web_url": "", "scm_url": "git://dpdk.org/tools/dts", "webscm_url": "http://git.dpdk.org/tools/dts/", "list_archive_url": "https://inbox.dpdk.org/dts", "list_archive_url_format": "https://inbox.dpdk.org/dts/{}", "commit_url_format": "" }, "msgid": "<20230718012629.2471811-1-ke1.xu@intel.com>", "list_archive_url": "https://inbox.dpdk.org/dts/20230718012629.2471811-1-ke1.xu@intel.com", "date": "2023-07-18T01:26:23", "name": "[V2,0/6] Rewrite test suite for checksum_offload, tso and vf_offload", "submitter": { "id": 2810, "url": "http://patchwork.dpdk.org/api/people/2810/?format=api", "name": "Ke Xu", "email": "ke1.xu@intel.com" }, "mbox": "http://patchwork.dpdk.org/project/dts/cover/20230718012629.2471811-1-ke1.xu@intel.com/mbox/", "series": [ { "id": 28958, "url": "http://patchwork.dpdk.org/api/series/28958/?format=api", "web_url": "http://patchwork.dpdk.org/project/dts/list/?series=28958", "date": "2023-07-18T01:26:23", "name": "Rewrite test suite for checksum_offload, tso and vf_offload", "version": 2, "mbox": "http://patchwork.dpdk.org/series/28958/mbox/" } ], "comments": "http://patchwork.dpdk.org/api/covers/129589/comments/", "headers": { "Return-Path": "<dts-bounces@dpdk.org>", "X-Original-To": "patchwork@inbox.dpdk.org", "Delivered-To": "patchwork@inbox.dpdk.org", "Received": [ "from mails.dpdk.org (mails.dpdk.org [217.70.189.124])\n\tby inbox.dpdk.org (Postfix) with ESMTP id 6A29842E9F;\n\tTue, 18 Jul 2023 03:26:32 +0200 (CEST)", "from mails.dpdk.org (localhost [127.0.0.1])\n\tby mails.dpdk.org (Postfix) with ESMTP id 3CF25406B3;\n\tTue, 18 Jul 2023 03:26:32 +0200 (CEST)", "from mga14.intel.com (mga14.intel.com [192.55.52.115])\n by mails.dpdk.org (Postfix) with ESMTP id C0DC040223\n for <dts@dpdk.org>; Tue, 18 Jul 2023 03:26:30 +0200 (CEST)", "from fmsmga002.fm.intel.com ([10.253.24.26])\n by fmsmga103.fm.intel.com with ESMTP/TLS/ECDHE-RSA-AES256-GCM-SHA384;\n 17 Jul 2023 18:26:29 -0700", "from dpdk-xuke-host.sh.intel.com ([10.67.114.220])\n by fmsmga002.fm.intel.com with ESMTP; 17 Jul 2023 18:26:28 -0700" ], "DKIM-Signature": "v=1; a=rsa-sha256; c=relaxed/simple;\n d=intel.com; i=@intel.com; q=dns/txt; s=Intel;\n t=1689643590; x=1721179590;\n h=from:to:cc:subject:date:message-id:in-reply-to:\n references:mime-version:content-transfer-encoding;\n bh=opzSLH9IdGmQqycBab6R05aEbNmgkrLXTSaQ/4mm8CM=;\n b=HxxC0w0Ux1ISTsul4Koqyxpl+Z4+auykb+pVL0uYZv+JKTJdw0A3rqfN\n 7L331PQLQjNqDlV83+lFSUvU+qCe+8OmwGgj4BxcacQf10eg1nByWt8UX\n N9lKi59M2CKXEICThJMm2EMbqM+mH8s/tHtJYCx4hAgVjVzb6QWTXwR4H\n /nwHY3hGzJXZwQRJjSHrG3j4n8J1Rh4EaE2W9MVjBnoxVggUyneYgbsv6\n gJ6aUalmlXXwdJWOS+ZdoLQkNnQ53EHF70D4mD+2UMHrhvnjh6GXL+qF/\n V0lNtmQaKUriF1oJMu+9VHD7vNVIC7YoV4I6YwbK6jvOuCmWGNvZZ+tp4 Q==;", "X-IronPort-AV": [ "E=McAfee;i=\"6600,9927,10774\"; a=\"366119508\"", "E=Sophos;i=\"6.01,211,1684825200\"; d=\"scan'208\";a=\"366119508\"", "E=McAfee;i=\"6600,9927,10774\"; a=\"837089786\"", "E=Sophos;i=\"6.01,211,1684825200\"; d=\"scan'208\";a=\"837089786\"" ], "X-ExtLoop1": "1", "From": "Ke Xu <ke1.xu@intel.com>", "To": "dts@dpdk.org", "Cc": "ke1.xu@intel.com,\n\ttarcadia@qq.com", "Subject": "[DTS][Patch V2 0/6] Rewrite test suite for checksum_offload,\n tso and vf_offload", "Date": "Tue, 18 Jul 2023 01:26:23 +0000", "Message-Id": "<20230718012629.2471811-1-ke1.xu@intel.com>", "X-Mailer": "git-send-email 2.34.1", "In-Reply-To": "<20230712203334.2032445-3-ke1.xu@intel.com>", "References": "<20230712203334.2032445-3-ke1.xu@intel.com>", "MIME-Version": "1.0", "Content-Transfer-Encoding": "8bit", "X-BeenThere": "dts@dpdk.org", "X-Mailman-Version": "2.1.29", "Precedence": "list", "List-Id": "test suite reviews and discussions <dts.dpdk.org>", "List-Unsubscribe": "<https://mails.dpdk.org/options/dts>,\n <mailto:dts-request@dpdk.org?subject=unsubscribe>", "List-Archive": "<http://mails.dpdk.org/archives/dts/>", "List-Post": "<mailto:dts@dpdk.org>", "List-Help": "<mailto:dts-request@dpdk.org?subject=help>", "List-Subscribe": "<https://mails.dpdk.org/listinfo/dts>,\n <mailto:dts-request@dpdk.org?subject=subscribe>", "Errors-To": "dts-bounces@dpdk.org" }, "content": "Checksum offload cases were in bad situation. Cases are not well organized\n in structure. Cases were added one by one along with the development of\n features.\n\nThe very beginning cases are designed to verifying RX Checksum Offload\n enabling / disabling. The followed cases are to verify the TX Offload, and\n found a gap when TX introduces differences to IP and L4. Then IP and L4 RX\n cases are added again. There were also a gap found on the flag verifying\n and a seperate ol_flag case was added.\n\nTo better organizing the checksum offload cases. I introduced the scenario\n based common cases and specific cases named with sufix to cover specific\n scenarios of special requirements. And we placed all available test scopes\n introduced in any existing cases to each of our common test execution to\n ensure no leakage to our test scopes.\n\nFor scenarios, we introduce the very commonly used configurations for\n checksum as our test scenarios. These scenarios cover combined usage of HW\n checksum Offload, SW checksum and differently configured tunneling scenario,\n w/wo VLAN. These cases formed a organized web for future cases that if a new\n configuration is introduced, cases of new configuration combinations are to\n be added but existing configurations for different scopes are not to be added.\n\nFor test scopes, we introduce verifying ol_flag, fwd stats, other verbose lines,\n and forwarded packet capturing and analyzing. All these scopes are recorder for\n verifying in each common checksum offload execution. This ensures no scope would\n be missed in this rewrite and in future case updating.\n\nThe newly organized cases also helps better covering our existing test\n requirements. A common packet sending and recording helps cut down the repeating\n time cost of different executions for scope based redundant cases.\n\nThis rewrite also helps formating a data-process-seperated suite structure. The\n test parameters and required packets are listed in front and cases are referring\n to the configured parameters. This helps better reading the suite code.\n\nIn the test plan, new cases are added and old ones are merged with the new cases.\n Packets, ol_flags, stats and related test scopes are listed in table to show where\n the expected result is from.\n\nSimilar modifications are also made to TSO cases. Common TSO executions are introduced\n and scenarios are designed based on configurations with test scopes covering all\n cases. Common packets are introduced.\n\nIn vf_offload, checksum_offload and tso cases are synced with those in checksum_offload\n and tso suites. During the release DPDK 22.11 and 23.03, several main features are\n synced from PF to VF. This means the cases and scopes in checksum_offload and tso are\n available in vf_offload now. This patch also helped introducing these common test execution\n and scopes to vf_offload suite.\n\nGenerally speaking, this case rewrite helps formating the cases structure and helps\n better maintaining the cases in future.\n\nKe Xu (6):\n test_plans/checksum_offload: Refactor checksum_offload case.\n tests/checksum_offload: Refactor checksum_offload case.\n test_plans/tso: Refactor TSO case.\n tests/tso: Refactor TSO cases.\n test_plans/vf_offload: Refactor checksum_offload case.\n tests/vf_offload: Refactor vf_offload cases.\n\n test_plans/checksum_offload_test_plan.rst | 1478 ++++------\n test_plans/tso_test_plan.rst | 489 +++-\n test_plans/vf_offload_test_plan.rst | 1356 +++++----\n tests/TestSuite_checksum_offload.py | 1788 ++++++------\n tests/TestSuite_tso.py | 1100 +++++---\n tests/TestSuite_vf_offload.py | 3053 +++++++++++++--------\n 6 files changed, 5369 insertions(+), 3895 deletions(-)" }