From patchwork Thu Feb 2 09:13:28 2023 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Michael Baum X-Patchwork-Id: 122887 Return-Path: X-Original-To: patchwork@inbox.dpdk.org Delivered-To: patchwork@inbox.dpdk.org Received: from mails.dpdk.org (mails.dpdk.org [217.70.189.124]) by inbox.dpdk.org (Postfix) with ESMTP id 5AA4041BAB; Thu, 2 Feb 2023 10:13:57 +0100 (CET) Received: from mails.dpdk.org (localhost [127.0.0.1]) by mails.dpdk.org (Postfix) with ESMTP id 475D642D35; Thu, 2 Feb 2023 10:13:57 +0100 (CET) Received: from NAM12-BN8-obe.outbound.protection.outlook.com (mail-bn8nam12on2040.outbound.protection.outlook.com [40.107.237.40]) by mails.dpdk.org (Postfix) with ESMTP id A14B540689 for ; Thu, 2 Feb 2023 10:13:55 +0100 (CET) ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=g2uec6J6I75WBfOoQRKQAVN6dc9EKTiJIvWAlSAzOFDt4ilA92/fq5oV7KLD0T3SpZQRDeYceRJLaQap9ZyyclBexHtI3c78QeqeHPrEn7nzSVwx95TdFR0CWL5EOLeoOUt67Anab46soYjEzfDmVp/46CZ1Xi8H51u+wYkKqbZHP0kbZI9uZ+7LkPGscQCMMEwSgJp8hyraenmtJX/DMz2Ptc0IpvuA1xZ8urAEqMDEberlNG6WXUvP9X1rWswtgOeqlGilB30jiix/lUlMo9xd9UKernjN8X4quArZGtDXBTjFkynLYLCpgbTfDjpMSgx7p/LpLNqQwqeacLDBpQ== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=BHezuxuLF8dWWmntnb+okv63I6uOCiEOu8SlvWc+yuo=; b=eb2wkE0krhJ8y50Tg7FRH/Ek0dDoHbd/CH2p2xwQ/+ylhFNCL4QXZiTwI79OkQU/T/23jCfTOpMqhi93vQUdfa3JZ4TJ9Ud5DItU8w3WIy7z3z4pJIgaHnriD8C/TfhzCXEqS/NuU7Cxkl0oI92eIho3n9AzkYDOAZE7USNYc2+XNb85W10vwxzylluMK3bByoa6fRLzd/CybnM3Rbx5vyPtl5/yGDRf7V8xnCNtY+jPjxQt/I5yWRA4X2AJ31WVAjVcgFQ/AkfqWosYr2jDTfANQvF9lTTRt23+d0pNxapW1LTPIcoBtBoT9WoqyH4HePGXWb14T2vr3VN67Xf5qg== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass (sender ip is 216.228.117.161) smtp.rcpttodomain=dpdk.org smtp.mailfrom=nvidia.com; dmarc=pass (p=reject sp=reject pct=100) action=none header.from=nvidia.com; dkim=none (message not signed); arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=Nvidia.com; s=selector2; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=BHezuxuLF8dWWmntnb+okv63I6uOCiEOu8SlvWc+yuo=; b=tYMP0VKM66q1qgR1yUC4nAE1PDy5flIMbTZuhE4mMwVI7+g4sX2Pq0OXKD3oRZrSbU09CKc9UHZisKHjdsHp8dAAboGPKz8c/1LKpXaAcFsnvztKcj0vKI4T3rhVXRf3q3Os3UhaYnCRlEViqvoWclXEpvXqBnRBPw/ZK84/QooqTwOSytuKLcDdkaKISPEYYNZwXUaJ/TgMWTsEHJALR8Uz1XGtIVXJiyxn+F5//jwPjB5zWxddLbppw5w2SCgB2CwDMeCdWWEhHkVYeezp5xjoGovo3TfOzIzHItSOO4FCLTbQkOcEv5Zie6cjQ8IzJ2AWQE1Lv6/LaovrGqH3oQ== Received: from BN0PR08CA0002.namprd08.prod.outlook.com (2603:10b6:408:142::18) by SA1PR12MB6752.namprd12.prod.outlook.com (2603:10b6:806:259::11) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.6064.25; Thu, 2 Feb 2023 09:13:54 +0000 Received: from BN8NAM11FT110.eop-nam11.prod.protection.outlook.com (2603:10b6:408:142:cafe::ca) by BN0PR08CA0002.outlook.office365.com (2603:10b6:408:142::18) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.6064.25 via Frontend Transport; Thu, 2 Feb 2023 09:13:54 +0000 X-MS-Exchange-Authentication-Results: spf=pass (sender IP is 216.228.117.161) smtp.mailfrom=nvidia.com; dkim=none (message not signed) header.d=none;dmarc=pass action=none header.from=nvidia.com; Received-SPF: Pass (protection.outlook.com: domain of nvidia.com designates 216.228.117.161 as permitted sender) receiver=protection.outlook.com; client-ip=216.228.117.161; helo=mail.nvidia.com; pr=C Received: from mail.nvidia.com (216.228.117.161) by BN8NAM11FT110.mail.protection.outlook.com (10.13.176.156) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.6064.27 via Frontend Transport; Thu, 2 Feb 2023 09:13:53 +0000 Received: from rnnvmail203.nvidia.com (10.129.68.9) by mail.nvidia.com (10.129.200.67) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.2.986.36; Thu, 2 Feb 2023 01:13:38 -0800 Received: from rnnvmail203.nvidia.com (10.129.68.9) by rnnvmail203.nvidia.com (10.129.68.9) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.2.986.36; Thu, 2 Feb 2023 01:13:37 -0800 Received: from nvidia.com (10.127.8.13) by mail.nvidia.com (10.129.68.9) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.2.986.36 via Frontend Transport; Thu, 2 Feb 2023 01:13:36 -0800 From: Michael Baum To: CC: Matan Azrad , Akhil Goyal , "Ashish Gupta" , Fiona Trahe , "Thomas Monjalon" Subject: [PATCH v2 0/4] compressdev: add LZ4 support Date: Thu, 2 Feb 2023 11:13:28 +0200 Message-ID: <20230202091332.1037078-1-michaelba@nvidia.com> X-Mailer: git-send-email 2.25.1 In-Reply-To: <20230109074526.2507344-1-michaelba@nvidia.com> References: <20230109074526.2507344-1-michaelba@nvidia.com> MIME-Version: 1.0 X-EOPAttributedMessage: 0 X-MS-PublicTrafficType: Email X-MS-TrafficTypeDiagnostic: BN8NAM11FT110:EE_|SA1PR12MB6752:EE_ X-MS-Office365-Filtering-Correlation-Id: bddc6b0d-5025-4101-6323-08db04fdce50 X-LD-Processed: 43083d15-7273-40c1-b7db-39efd9ccc17a,ExtAddr X-MS-Exchange-SenderADCheck: 1 X-MS-Exchange-AntiSpam-Relay: 0 X-Microsoft-Antispam: BCL:0; X-Microsoft-Antispam-Message-Info: da3dlGNpW/us+qjjjaCgO6n/pA9wiagvgJlI6wEAhZobSW5KqOFLBH4/fnev2L07zNefAu0JAXwK7B8/BMcsD62KOrIp0Pa281zBGbSPzZB/uDTiQRWKkvG+fcqrpZNN5o45oUhiUXh6BAqib3Nv08vrrrOciNTbHKgoUfDLtFUjn8XeJsWrxbVuOiVprH/8Ii95cMpLOsFkldsYupzdEKZ2l6VqeTFrOZkQAOdUh8elLXsEXwjEeBdsDSQcPncrQePYAPi1hESHc4Is6JsnP/0N08aG61MQTalCJvJvSVcXAD7ZnwaSbYo07OQn0poGdA9zO63ZN6FkNtss0o8+SLbKjze2f7zrHGHdb3x/C9CcYZYIuKUJQUQ2hAW8xGZKuwB+i3Wv8pQHMKIKHi2ZTOL8ux7KNy77r86z+ntgo2bCx6vz/1dLQqwtAOuwwBMisLM/Dy4sXd8R40UnY8ml7eA6xhfJA9XP8kgvQzlYnR8ccEI3iI2lNTUYyVQPdlpDWuckujaEl7u5pJEopnI/ku4ascQXkh/alfZ28KJQ/eKtliRNTm6J3wmpUQkYK2JMHXXAGe+vL2pBI77UgWJV6A9//INI0Q9AiCcH44niGqzlxc75R1zHg/HKnvM/uCBbU5WB7Q26nufTfi3I0/Zf6ErgxNFHYqcNun7Ovg5jyODcOTczx3kpFkBaHxpshnTzeqSVdAgGdLjvBwfHyA26wChcHurCK6waOtAFD+jC3yN3Kf/8tX1lnWs804y24cq/CUFbqvMINUlRxeAzHY4YCsiwfvkxN4+rbHcsV86ZJvf/fw7UJ7Pkk0QxbWhs7YIX X-Forefront-Antispam-Report: CIP:216.228.117.161; CTRY:US; LANG:en; SCL:1; SRV:; IPV:NLI; SFV:NSPM; H:mail.nvidia.com; PTR:dc6edge2.nvidia.com; CAT:NONE; SFS:(13230025)(4636009)(346002)(396003)(376002)(136003)(39860400002)(451199018)(46966006)(40470700004)(36840700001)(8676002)(4326008)(6916009)(478600001)(36860700001)(70206006)(70586007)(47076005)(40460700003)(356005)(86362001)(55016003)(7636003)(82740400003)(426003)(82310400005)(40480700001)(316002)(7696005)(54906003)(186003)(6286002)(336012)(2616005)(83380400001)(966005)(36756003)(1076003)(6666004)(26005)(2906002)(5660300002)(41300700001)(8936002); DIR:OUT; SFP:1101; X-OriginatorOrg: Nvidia.com X-MS-Exchange-CrossTenant-OriginalArrivalTime: 02 Feb 2023 09:13:53.5637 (UTC) X-MS-Exchange-CrossTenant-Network-Message-Id: bddc6b0d-5025-4101-6323-08db04fdce50 X-MS-Exchange-CrossTenant-Id: 43083d15-7273-40c1-b7db-39efd9ccc17a X-MS-Exchange-CrossTenant-OriginalAttributedTenantConnectingIp: TenantId=43083d15-7273-40c1-b7db-39efd9ccc17a; Ip=[216.228.117.161]; Helo=[mail.nvidia.com] X-MS-Exchange-CrossTenant-AuthSource: BN8NAM11FT110.eop-nam11.prod.protection.outlook.com X-MS-Exchange-CrossTenant-AuthAs: Anonymous X-MS-Exchange-CrossTenant-FromEntityHeader: HybridOnPrem X-MS-Exchange-Transport-CrossTenantHeadersStamped: SA1PR12MB6752 X-BeenThere: dev@dpdk.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: DPDK patches and discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: dev-bounces@dpdk.org Add support for LZ4 compression algorithm for both API and app. In addition, enable app to test de/comp only. This option already exists in both app doc and arguments but isn't implemented inside the application. LZ4: https://github.com/lz4/lz4 RFC: https://patchwork.dpdk.org/project/dpdk/patch/20220410182622.8828-1-rzidane@nvidia.com/ v2: - Add macros for all LZ4 flags in the standard. - Rebase. Depends-on: series-26738 ("compressdev: fix end of list enums conflict") Michael Baum (4): compressdev: add LZ4 algorithm support app/test-compress-perf: allow test single compress operation app/test-compress-perf: add algo option app/test-compress-perf: add LZ4 support app/test-compress-perf/comp_perf_options.h | 9 +- .../comp_perf_options_parse.c | 83 +++++++++++- .../comp_perf_test_common.c | 126 +++++++++++++----- .../comp_perf_test_cyclecount.c | 82 +++++++----- .../comp_perf_test_throughput.c | 75 +++++++---- .../comp_perf_test_verify.c | 75 +++++++---- app/test-compress-perf/main.c | 63 +++++++-- doc/guides/compressdevs/features/default.ini | 7 + doc/guides/rel_notes/release_23_03.rst | 16 +++ doc/guides/tools/comp_perf.rst | 5 + lib/compressdev/rte_comp.c | 12 ++ lib/compressdev/rte_comp.h | 79 ++++++++++- 12 files changed, 488 insertions(+), 144 deletions(-)