Message ID | 20240910083139.699291-1-mattias.ronnblom@ericsson.com (mailing list archive) |
---|---|
Headers |
Return-Path: <dev-bounces@dpdk.org> X-Original-To: patchwork@inbox.dpdk.org Delivered-To: patchwork@inbox.dpdk.org Received: from mails.dpdk.org (mails.dpdk.org [217.70.189.124]) by inbox.dpdk.org (Postfix) with ESMTP id E6D7845954; Tue, 10 Sep 2024 10:41:13 +0200 (CEST) Received: from mails.dpdk.org (localhost [127.0.0.1]) by mails.dpdk.org (Postfix) with ESMTP id 6A7AF427A7; Tue, 10 Sep 2024 10:41:13 +0200 (CEST) Received: from EUR05-AM6-obe.outbound.protection.outlook.com (mail-am6eur05on2089.outbound.protection.outlook.com [40.107.22.89]) by mails.dpdk.org (Postfix) with ESMTP id 486084021F for <dev@dpdk.org>; Tue, 10 Sep 2024 10:41:12 +0200 (CEST) ARC-Seal: i=1; a=rsa-sha256; s=arcselector10001; d=microsoft.com; cv=none; b=bKeD0+ejjFyJAhTVClDUNTIOOQ0uuMY5/x2EOj3UUxav4MZ34q6dwQ88jTXGjINwkRkREqkGiJyT3HFbHJPHYeVDLNk2Np3peIr0bhW+2KVobZ/KhLf/FyOuxIXesgb0clsDViAMvuHEMuwke08eZcfQmmGiQq/yek64xAgC9QHL+ZTz2Zr2Tz04YLH4UnjzqgItG/zvlVFybxi4gYZwVODCqog1vM3VzeIXvjRLxtL/y1DhUq3kvo+kQ9FmrBXkFWW3Q+RRWlMABH/TJwDx1ozjKhL9iflno0XFyE3UXdwEqHPykVJKyyRfaTrEz6n8vvpSoZv7YkxmVom5d8afjg== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector10001; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=Lm6VaCuQtdVVSvg14DZkMCdBrRDMliCR2ELU+MjYEhI=; b=qb7PKDFpTUAGRg0Z4TG65ahSEDYcJOF6PPPKesbw0m0LT3L1N+g345JBImLfVWTfcJ2ooZyiDPkcNDjl3UMUfTG0pqapvAdexrAeMA4BkW7T43/b60EXXocHgBv8EAbkhhA0FpeU7QzApIYAsasWnKB3NqHIPkcj5d6Wz6Ss4j97YSwENYjxFMw/erKXjjeSKUy9/gJ8Wiaj/6AZoPEAgSlwKiw2mlrqqfdnmE8R5m89Ex97Pf8sByC79j1ElZsF8GAtH3/V/QMr/Ho/bpvhdK+LYDIL+07izvXUDwuvNqQ7BwjvZdNPov/eY5EqyLDIMuvPZN3e+wMT3UbRzm9WbQ== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass (sender ip is 192.176.1.74) smtp.rcpttodomain=dpdk.org smtp.mailfrom=ericsson.com; dmarc=pass (p=reject sp=reject pct=100) action=none header.from=ericsson.com; dkim=none (message not signed); arc=none (0) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=ericsson.com; s=selector1; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=Lm6VaCuQtdVVSvg14DZkMCdBrRDMliCR2ELU+MjYEhI=; b=MGRxAxDQJ/c9ZNuz/jt/uX4gEjSBO8LxhG7+Pw6LyJuu6uNwXAC3X8i10FlGk/eueRMYMOHj3TYYMIRC58l9kRuU4H98z6bpReqX7tD+yS8yMgkeUnCg7DSB7y8XhK7J9AW6Q3/dr40prqcd9s07XiCoHVLAcoQLrch/ygsCwh+E7RhmpasBZ1lf0EJyej/c1QzV6R5YA4TUBc6y8yfITKqquOyIejI2+mh6WInBTiNj5TCb7HbB4Q4F2VMJ25KwQIJO472+eayPHhQcd0M48C4R+ylneLqnz3B5+Q/yu8uGp2K/264DT8GEsslAITr4Lt00kkxrVl239H53P4ESWw== Received: from DU7P190CA0006.EURP190.PROD.OUTLOOK.COM (2603:10a6:10:550::18) by DB9PR07MB7785.eurprd07.prod.outlook.com (2603:10a6:10:2ab::7) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.7939.23; Tue, 10 Sep 2024 08:41:09 +0000 Received: from DB1PEPF000509E5.eurprd03.prod.outlook.com (2603:10a6:10:550:cafe::aa) by DU7P190CA0006.outlook.office365.com (2603:10a6:10:550::18) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.7939.25 via Frontend Transport; Tue, 10 Sep 2024 08:41:09 +0000 X-MS-Exchange-Authentication-Results: spf=pass (sender IP is 192.176.1.74) smtp.mailfrom=ericsson.com; dkim=none (message not signed) header.d=none;dmarc=pass action=none header.from=ericsson.com; Received-SPF: Pass (protection.outlook.com: domain of ericsson.com designates 192.176.1.74 as permitted sender) receiver=protection.outlook.com; client-ip=192.176.1.74; helo=oa.msg.ericsson.com; pr=C Received: from oa.msg.ericsson.com (192.176.1.74) by DB1PEPF000509E5.mail.protection.outlook.com (10.167.242.55) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.7918.13 via Frontend Transport; Tue, 10 Sep 2024 08:41:09 +0000 Received: from seliicinfr00049.seli.gic.ericsson.se (153.88.142.248) by smtp-central.internal.ericsson.com (100.87.178.60) with Microsoft SMTP Server id 15.2.1544.11; Tue, 10 Sep 2024 10:41:08 +0200 Received: from breslau.. (seliicwb00002.seli.gic.ericsson.se [10.156.25.100]) by seliicinfr00049.seli.gic.ericsson.se (Postfix) with ESMTP id 4D478380061; Tue, 10 Sep 2024 10:41:08 +0200 (CEST) From: =?utf-8?q?Mattias_R=C3=B6nnblom?= <mattias.ronnblom@ericsson.com> To: <dev@dpdk.org> CC: <hofors@lysator.liu.se>, Heng Wang <heng.wang@ericsson.com>, "Stephen Hemminger" <stephen@networkplumber.org>, Tyler Retzlaff <roretzla@linux.microsoft.com>, =?utf-8?q?Morten_Br=C3=B8rup?= <mb@smartsharesystems.com>, Jack Bond-Preston <jack.bond-preston@foss.arm.com>, David Marchand <david.marchand@redhat.com>, Chengwen Feng <fengchengwen@huawei.com>, =?utf-8?q?Mattias_R=C3=B6nnblom?= <mattias.ronnblom@ericsson.com> Subject: [PATCH v6 0/6] Improve EAL bit operations API Date: Tue, 10 Sep 2024 10:31:33 +0200 Message-ID: <20240910083139.699291-1-mattias.ronnblom@ericsson.com> X-Mailer: git-send-email 2.34.1 In-Reply-To: <20240910062051.699096-2-mattias.ronnblom@ericsson.com> References: <20240910062051.699096-2-mattias.ronnblom@ericsson.com> MIME-Version: 1.0 Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: 8bit X-EOPAttributedMessage: 0 X-MS-PublicTrafficType: Email X-MS-TrafficTypeDiagnostic: DB1PEPF000509E5:EE_|DB9PR07MB7785:EE_ X-MS-Office365-Filtering-Correlation-Id: 3a37fdaf-e19d-4a70-3a3a-08dcd1745168 X-MS-Exchange-SenderADCheck: 1 X-MS-Exchange-AntiSpam-Relay: 0 X-Microsoft-Antispam: BCL:0; ARA:13230040|36860700013|1800799024|82310400026|376014; X-Microsoft-Antispam-Message-Info: =?utf-8?q?XPR8SyqkCPRkzM1jW5aMPdvBSIL4JxU?= =?utf-8?q?qUyjU3xKfRTtIzVHvpkxQWTvt5ewJgP0tCUbOrBnCqJX6MnDXL2c+tvjFrpDSOYcX?= =?utf-8?q?HvOHb17qVa7YTBO8od4Ocvv0N7U7V0qCpgpd960ccz/ApJ60JgxREtREYNwCN8YgS?= =?utf-8?q?Dst8XahLHOaRtoDjy093Dqb+5NoHzzwzvoqtGOltIqKKU6RLCQoRIphKz9BFT4bbv?= =?utf-8?q?5g/Q1PbGjUXhLuT3+7bpHH+WKnPNhTw3doo1qScY8Vpco+nR0gdezkArLBpo2cDJs?= =?utf-8?q?YR4mcgcXdU9iq+VVEVH2nTk8M5FoCY5cGz3VdRAZCMNap5ly9oAOqp8i1e6DEyWrV?= =?utf-8?q?ndnydLtVctb9KzhObxatcxqSG6er1nuUfUNcW37kUt8PJQXoJRlwM/xW048RDH8CK?= =?utf-8?q?zmUmfrj9z6i3aaHAOXbX1jwvcZw/8ypGfxT/J36IBPy0JW6UfA8Onacp9QAXJx7fS?= =?utf-8?q?NTLyriDS6lQWF7JrEmS1fuDgEQgAe6EWvEmTohwayodCQv4pwZH+MYyQbekteT++1?= =?utf-8?q?v5Hpj3QWs7W1PIdaSc9omcu1n9K6YigK+hy/Hk3v6luEfAE8wXbfZwDp9ePKJ55f5?= =?utf-8?q?4+ZoxnKqyNFWnejnyBIHoyONR29iyG0Nnbr8/wPhIWebjMrFE7laZ9xhyDnz5cxtL?= =?utf-8?q?ZvOJI4Mc+H1F2QS3CYIUtQICJnTqo3vqlKXA0WSuweUE3iFpaXndSxyh28ibLN70L?= =?utf-8?q?qEGHEbHyJyDQxRx3/AmwpZdAStAOSwstpjrisXZ+KfwWSXoevq8WWM+FQFHou6NWr?= =?utf-8?q?Xv41yJ5AAdtS/ytbSPtdOTj2I3H0aO8LEFie0JaZVn8fwcX/xRcqlWc+jQZ6sY1KN?= =?utf-8?q?Mp75x8Btm3+gA74Aw7Opfvderum4uuNjm9wlpt8G9QCstDGrPYlrUywRjMSnC4nSB?= =?utf-8?q?yHEJQv8smn+zMwVd0iZl3mcaWifjyaImVn56aEyp5FCApDGJoHWiEuRAJdtCSW0EC?= =?utf-8?q?5w1lYm+PEsBISclX3cgJwU19idCB4vNrqxuw6z+HkFDwkn+VX1uWsZLukn1CEjGDX?= =?utf-8?q?L6rrpm1WdOziIFQBN8T+7EPEfw2ixEXDGttnaRfjOeinO5Ml9GvvODhrTreOO4txL?= =?utf-8?q?gs8+Hos/t3WGgpaMPDF+0+aWjBEJmr3oStJq/xYqkDLyeg9d9gewiuU5XUfIhXS1X?= =?utf-8?q?tCOMagpNSeRGxfulkqIgEYgcV9OU99MdoGdd6kL4gbg4pqv1UnTSRC+JkdOO5qXTF?= =?utf-8?q?c4LwQafh2puJ+MkvVZAFtcPeazIoprH2/1jCp37zQyeOU3ZCg1T8eHdqBOhPyUlT4?= =?utf-8?q?tebSJwF0i3W6DV4Ia3aPfgTNwV9Tl+I2LjQ1SJ5GqqO32xA6GlWPa/31jli7Lb3t2?= =?utf-8?q?i/ln19HU1PBvw8wsq8dZryf57tOpP2PmWQbwOyTdOjweMwpE+elVPAHe/RnbjjlBB?= =?utf-8?q?WXY1VoC38vM?= X-Forefront-Antispam-Report: CIP:192.176.1.74; CTRY:SE; LANG:en; SCL:1; SRV:; IPV:NLI; SFV:NSPM; H:oa.msg.ericsson.com; PTR:office365.se.ericsson.net; CAT:NONE; SFS:(13230040)(36860700013)(1800799024)(82310400026)(376014); DIR:OUT; SFP:1101; X-OriginatorOrg: ericsson.com X-MS-Exchange-CrossTenant-OriginalArrivalTime: 10 Sep 2024 08:41:09.1181 (UTC) X-MS-Exchange-CrossTenant-Network-Message-Id: 3a37fdaf-e19d-4a70-3a3a-08dcd1745168 X-MS-Exchange-CrossTenant-Id: 92e84ceb-fbfd-47ab-be52-080c6b87953f X-MS-Exchange-CrossTenant-OriginalAttributedTenantConnectingIp: TenantId=92e84ceb-fbfd-47ab-be52-080c6b87953f; Ip=[192.176.1.74]; Helo=[oa.msg.ericsson.com] X-MS-Exchange-CrossTenant-AuthSource: DB1PEPF000509E5.eurprd03.prod.outlook.com X-MS-Exchange-CrossTenant-AuthAs: Anonymous X-MS-Exchange-CrossTenant-FromEntityHeader: HybridOnPrem X-MS-Exchange-Transport-CrossTenantHeadersStamped: DB9PR07MB7785 X-BeenThere: dev@dpdk.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: DPDK patches and discussions <dev.dpdk.org> List-Unsubscribe: <https://mails.dpdk.org/options/dev>, <mailto:dev-request@dpdk.org?subject=unsubscribe> List-Archive: <http://mails.dpdk.org/archives/dev/> List-Post: <mailto:dev@dpdk.org> List-Help: <mailto:dev-request@dpdk.org?subject=help> List-Subscribe: <https://mails.dpdk.org/listinfo/dev>, <mailto:dev-request@dpdk.org?subject=subscribe> Errors-To: dev-bounces@dpdk.org |
Series |
Improve EAL bit operations API
|
|
Message
Mattias Rönnblom
Sept. 10, 2024, 8:31 a.m. UTC
This patch set represent an attempt to improve and extend the RTE bitops API, in particular for functions that operate on individual bits. All new functionality is exposed to the user as generic selection macros, delegating the actual work to private (__-marked) static inline functions. Public functions (e.g., rte_bit_set32()) would just be bloating the API. Such generic selection macros will here be referred to as "functions", although technically they are not. The legacy <rte_bitops.h> rte_bit_relaxed_*() functions is replaced with two new families: rte_bit_[test|set|clear|assign|flip]() which provides no memory ordering or atomicity guarantees, but does provide the best performance. The performance degradation resulting from the use of volatile (e.g., forcing loads and stores to actually occur and in the number specified) and atomic (e.g., LOCK-prefixed instructions on x86) may be significant. rte_bit_[test|set|clear|assign|flip]() may be used with volatile word pointers, in which case they guarantee that the program-level accesses actually occur. rte_bit_atomic_*() which provides atomic bit-level operations, including the possibility to specifying memory ordering constraints (or the lack thereof). The atomic functions take non-_Atomic pointers, to be flexible, just like the GCC builtins and default <rte_stdatomic.h>. The issue with _Atomic APIs is that it may well be the case that the user wants to perform both non-atomic and atomic operations on the same word. Having _Atomic-marked addresses would complicate supporting atomic bit-level operations in the bitset API (proposed in a different RFC patchset), and potentially other APIs depending on RTE bitops for atomic bit-level ops). Either one needs two bitset variants, one _Atomic bitset and one non-atomic one, or the bitset code needs to cast the non-_Atomic pointer to an _Atomic one. Having a separate _Atomic bitset would be bloat and also prevent the user from both, in some situations, doing atomic operations against a bit set, while in other situations (e.g., at times when MT safety is not a concern) operating on the same objects in a non-atomic manner. Unlike rte_bit_relaxed_*(), individual bits are represented by bool, not uint32_t or uint64_t. The author found the use of such large types confusing, and also failed to see any performance benefits. A set of functions rte_bit_*_assign() are added, to assign a particular boolean value to a particular bit. All new functions have properly documented semantics. All new functions operate on both 32 and 64-bit words, with type checking. _Generic allow the user code to be a little more impact. Have a type-generic atomic test/set/clear/assign bit API also seems consistent with the "core" (word-size) atomics API, which is generic (both GCC builtins and <rte_stdatomic.h> are). The _Generic versions avoids having explicit unsigned long versions of all functions. If you have an unsigned long, it's safe to use the generic version (e.g., rte_set_bit()) and _Generic will pick the right function, provided long is either 32 or 64 bit on your platform (which it is on all DPDK-supported ABIs). The generic rte_bit_set() is a macro, and not a function, but nevertheless has been given a lower-case name. That's how C11 does it (for atomics, and other _Generic), and <rte_stdatomic.h>. Its address can't be taken, but it does not evaluate its parameters more than once. C++ doesn't support generic selection. In C++ translation units the _Generic macros are replaced with overloaded functions, implemented by means of a huge, complicated C macro mess. Mattias Rönnblom (6): dpdk: do not force C linkage on include file dependencies eal: extend bit manipulation functionality eal: add unit tests for bit operations eal: add atomic bit operations eal: add unit tests for atomic bit access functions eal: extend bitops to handle volatile pointers app/test/packet_burst_generator.h | 8 +- app/test/test_bitops.c | 416 +++++++++- app/test/virtual_pmd.h | 4 +- doc/guides/rel_notes/release_24_11.rst | 17 + drivers/bus/auxiliary/bus_auxiliary_driver.h | 8 +- drivers/bus/cdx/bus_cdx_driver.h | 8 +- drivers/bus/dpaa/include/fsl_qman.h | 8 +- drivers/bus/fslmc/bus_fslmc_driver.h | 8 +- drivers/bus/pci/bus_pci_driver.h | 8 +- drivers/bus/pci/rte_bus_pci.h | 8 +- drivers/bus/platform/bus_platform_driver.h | 8 +- drivers/bus/vdev/bus_vdev_driver.h | 8 +- drivers/bus/vmbus/bus_vmbus_driver.h | 8 +- drivers/bus/vmbus/rte_bus_vmbus.h | 8 +- drivers/dma/cnxk/cnxk_dma_event_dp.h | 8 +- drivers/dma/ioat/ioat_hw_defs.h | 4 +- drivers/event/dlb2/rte_pmd_dlb2.h | 8 +- drivers/mempool/dpaa2/rte_dpaa2_mempool.h | 6 +- drivers/net/avp/rte_avp_fifo.h | 8 +- drivers/net/bonding/rte_eth_bond.h | 4 +- drivers/net/i40e/rte_pmd_i40e.h | 8 +- drivers/net/mlx5/mlx5_trace.h | 8 +- drivers/net/ring/rte_eth_ring.h | 4 +- drivers/net/vhost/rte_eth_vhost.h | 8 +- drivers/raw/ifpga/afu_pmd_core.h | 8 +- drivers/raw/ifpga/afu_pmd_he_hssi.h | 6 +- drivers/raw/ifpga/afu_pmd_he_lpbk.h | 6 +- drivers/raw/ifpga/afu_pmd_he_mem.h | 6 +- drivers/raw/ifpga/afu_pmd_n3000.h | 6 +- drivers/raw/ifpga/rte_pmd_afu.h | 4 +- drivers/raw/ifpga/rte_pmd_ifpga.h | 4 +- examples/ethtool/lib/rte_ethtool.h | 8 +- examples/qos_sched/main.h | 4 +- examples/vm_power_manager/channel_manager.h | 8 +- lib/acl/rte_acl_osdep.h | 8 +- lib/bbdev/rte_bbdev.h | 8 +- lib/bbdev/rte_bbdev_op.h | 8 +- lib/bbdev/rte_bbdev_pmd.h | 8 +- lib/bpf/bpf_def.h | 8 +- lib/compressdev/rte_comp.h | 4 +- lib/compressdev/rte_compressdev.h | 6 +- lib/compressdev/rte_compressdev_internal.h | 8 +- lib/compressdev/rte_compressdev_pmd.h | 8 +- lib/cryptodev/cryptodev_pmd.h | 8 +- lib/cryptodev/cryptodev_trace.h | 8 +- lib/cryptodev/rte_crypto.h | 8 +- lib/cryptodev/rte_crypto_asym.h | 8 +- lib/cryptodev/rte_crypto_sym.h | 8 +- lib/cryptodev/rte_cryptodev.h | 8 +- lib/cryptodev/rte_cryptodev_trace_fp.h | 4 +- lib/dispatcher/rte_dispatcher.h | 8 +- lib/dmadev/rte_dmadev.h | 8 + lib/eal/arm/include/rte_atomic_32.h | 4 +- lib/eal/arm/include/rte_atomic_64.h | 8 +- lib/eal/arm/include/rte_byteorder.h | 8 +- lib/eal/arm/include/rte_cpuflags_32.h | 8 +- lib/eal/arm/include/rte_cpuflags_64.h | 8 +- lib/eal/arm/include/rte_cycles_32.h | 4 +- lib/eal/arm/include/rte_cycles_64.h | 4 +- lib/eal/arm/include/rte_io.h | 8 +- lib/eal/arm/include/rte_io_64.h | 8 +- lib/eal/arm/include/rte_memcpy_32.h | 8 +- lib/eal/arm/include/rte_memcpy_64.h | 8 +- lib/eal/arm/include/rte_pause.h | 8 +- lib/eal/arm/include/rte_pause_32.h | 6 +- lib/eal/arm/include/rte_pause_64.h | 8 +- lib/eal/arm/include/rte_power_intrinsics.h | 8 +- lib/eal/arm/include/rte_prefetch_32.h | 8 +- lib/eal/arm/include/rte_prefetch_64.h | 8 +- lib/eal/arm/include/rte_rwlock.h | 4 +- lib/eal/arm/include/rte_spinlock.h | 6 +- lib/eal/freebsd/include/rte_os.h | 8 +- lib/eal/include/bus_driver.h | 8 +- lib/eal/include/dev_driver.h | 6 +- lib/eal/include/eal_trace_internal.h | 8 +- lib/eal/include/generic/rte_atomic.h | 8 + lib/eal/include/generic/rte_byteorder.h | 8 + lib/eal/include/generic/rte_cpuflags.h | 8 + lib/eal/include/generic/rte_cycles.h | 8 + lib/eal/include/generic/rte_io.h | 8 + lib/eal/include/generic/rte_memcpy.h | 8 + lib/eal/include/generic/rte_pause.h | 8 + .../include/generic/rte_power_intrinsics.h | 8 + lib/eal/include/generic/rte_prefetch.h | 8 + lib/eal/include/generic/rte_rwlock.h | 8 +- lib/eal/include/generic/rte_spinlock.h | 8 + lib/eal/include/generic/rte_vect.h | 8 + lib/eal/include/rte_alarm.h | 4 +- lib/eal/include/rte_bitmap.h | 8 +- lib/eal/include/rte_bitops.h | 768 +++++++++++++++++- lib/eal/include/rte_bus.h | 8 +- lib/eal/include/rte_class.h | 4 +- lib/eal/include/rte_common.h | 8 +- lib/eal/include/rte_dev.h | 8 +- lib/eal/include/rte_devargs.h | 8 +- lib/eal/include/rte_eal_trace.h | 4 +- lib/eal/include/rte_errno.h | 4 +- lib/eal/include/rte_fbarray.h | 8 +- lib/eal/include/rte_keepalive.h | 6 +- lib/eal/include/rte_mcslock.h | 8 +- lib/eal/include/rte_memory.h | 8 +- lib/eal/include/rte_pci_dev_features.h | 4 +- lib/eal/include/rte_pflock.h | 8 +- lib/eal/include/rte_random.h | 4 +- lib/eal/include/rte_seqcount.h | 8 +- lib/eal/include/rte_seqlock.h | 8 +- lib/eal/include/rte_service.h | 8 +- lib/eal/include/rte_service_component.h | 4 +- lib/eal/include/rte_stdatomic.h | 5 +- lib/eal/include/rte_string_fns.h | 17 +- lib/eal/include/rte_tailq.h | 6 +- lib/eal/include/rte_ticketlock.h | 8 +- lib/eal/include/rte_time.h | 6 +- lib/eal/include/rte_trace.h | 8 +- lib/eal/include/rte_trace_point.h | 8 +- lib/eal/include/rte_trace_point_register.h | 8 +- lib/eal/include/rte_uuid.h | 8 +- lib/eal/include/rte_version.h | 6 +- lib/eal/include/rte_vfio.h | 8 +- lib/eal/linux/include/rte_os.h | 8 +- lib/eal/loongarch/include/rte_atomic.h | 6 +- lib/eal/loongarch/include/rte_byteorder.h | 4 +- lib/eal/loongarch/include/rte_cpuflags.h | 8 +- lib/eal/loongarch/include/rte_cycles.h | 4 +- lib/eal/loongarch/include/rte_io.h | 4 +- lib/eal/loongarch/include/rte_memcpy.h | 4 +- lib/eal/loongarch/include/rte_pause.h | 8 +- .../loongarch/include/rte_power_intrinsics.h | 8 +- lib/eal/loongarch/include/rte_prefetch.h | 8 +- lib/eal/loongarch/include/rte_rwlock.h | 4 +- lib/eal/loongarch/include/rte_spinlock.h | 6 +- lib/eal/ppc/include/rte_atomic.h | 6 +- lib/eal/ppc/include/rte_byteorder.h | 6 +- lib/eal/ppc/include/rte_cpuflags.h | 8 +- lib/eal/ppc/include/rte_cycles.h | 8 +- lib/eal/ppc/include/rte_io.h | 4 +- lib/eal/ppc/include/rte_memcpy.h | 4 +- lib/eal/ppc/include/rte_pause.h | 8 +- lib/eal/ppc/include/rte_power_intrinsics.h | 8 +- lib/eal/ppc/include/rte_prefetch.h | 8 +- lib/eal/ppc/include/rte_rwlock.h | 4 +- lib/eal/ppc/include/rte_spinlock.h | 8 +- lib/eal/riscv/include/rte_atomic.h | 8 +- lib/eal/riscv/include/rte_byteorder.h | 8 +- lib/eal/riscv/include/rte_cpuflags.h | 8 +- lib/eal/riscv/include/rte_cycles.h | 4 +- lib/eal/riscv/include/rte_io.h | 4 +- lib/eal/riscv/include/rte_memcpy.h | 4 +- lib/eal/riscv/include/rte_pause.h | 8 +- lib/eal/riscv/include/rte_power_intrinsics.h | 8 +- lib/eal/riscv/include/rte_prefetch.h | 8 +- lib/eal/riscv/include/rte_rwlock.h | 4 +- lib/eal/riscv/include/rte_spinlock.h | 6 +- lib/eal/windows/include/pthread.h | 6 +- lib/eal/windows/include/regex.h | 8 +- lib/eal/windows/include/rte_windows.h | 8 +- lib/eal/x86/include/rte_atomic.h | 25 +- lib/eal/x86/include/rte_byteorder.h | 16 +- lib/eal/x86/include/rte_cpuflags.h | 8 +- lib/eal/x86/include/rte_cycles.h | 8 +- lib/eal/x86/include/rte_io.h | 8 +- lib/eal/x86/include/rte_pause.h | 7 +- lib/eal/x86/include/rte_power_intrinsics.h | 8 +- lib/eal/x86/include/rte_prefetch.h | 8 +- lib/eal/x86/include/rte_rwlock.h | 6 +- lib/eal/x86/include/rte_spinlock.h | 9 +- lib/ethdev/ethdev_driver.h | 8 +- lib/ethdev/ethdev_pci.h | 8 +- lib/ethdev/ethdev_trace.h | 8 +- lib/ethdev/ethdev_vdev.h | 8 +- lib/ethdev/rte_cman.h | 4 +- lib/ethdev/rte_dev_info.h | 4 +- lib/ethdev/rte_ethdev.h | 8 +- lib/ethdev/rte_ethdev_trace_fp.h | 4 +- lib/eventdev/event_timer_adapter_pmd.h | 4 +- lib/eventdev/eventdev_pmd.h | 8 +- lib/eventdev/eventdev_pmd_pci.h | 8 +- lib/eventdev/eventdev_pmd_vdev.h | 8 +- lib/eventdev/eventdev_trace.h | 8 +- lib/eventdev/rte_event_crypto_adapter.h | 8 +- lib/eventdev/rte_event_eth_rx_adapter.h | 8 +- lib/eventdev/rte_event_eth_tx_adapter.h | 8 +- lib/eventdev/rte_event_ring.h | 8 +- lib/eventdev/rte_event_timer_adapter.h | 8 +- lib/eventdev/rte_eventdev.h | 8 +- lib/eventdev/rte_eventdev_trace_fp.h | 4 +- lib/graph/rte_graph_model_mcore_dispatch.h | 8 +- lib/graph/rte_graph_worker.h | 6 +- lib/gso/rte_gso.h | 6 +- lib/hash/rte_fbk_hash.h | 8 +- lib/hash/rte_hash_crc.h | 8 +- lib/hash/rte_jhash.h | 8 +- lib/hash/rte_thash.h | 8 +- lib/hash/rte_thash_gfni.h | 8 +- lib/ip_frag/rte_ip_frag.h | 8 +- lib/ipsec/rte_ipsec.h | 8 +- lib/log/rte_log.h | 8 +- lib/lpm/rte_lpm.h | 8 +- lib/member/rte_member.h | 8 +- lib/member/rte_member_sketch.h | 6 +- lib/member/rte_member_sketch_avx512.h | 8 +- lib/member/rte_member_x86.h | 4 +- lib/member/rte_xxh64_avx512.h | 6 +- lib/mempool/mempool_trace.h | 8 +- lib/mempool/rte_mempool_trace_fp.h | 4 +- lib/meter/rte_meter.h | 8 +- lib/mldev/mldev_utils.h | 8 +- lib/mldev/rte_mldev_core.h | 8 +- lib/mldev/rte_mldev_pmd.h | 8 +- lib/net/rte_ether.h | 8 +- lib/net/rte_net.h | 8 +- lib/net/rte_sctp.h | 8 +- lib/node/rte_node_eth_api.h | 8 +- lib/node/rte_node_ip4_api.h | 8 +- lib/node/rte_node_ip6_api.h | 6 +- lib/node/rte_node_udp4_input_api.h | 8 +- lib/pci/rte_pci.h | 8 +- lib/pdcp/rte_pdcp.h | 8 +- lib/pipeline/rte_pipeline.h | 8 +- lib/pipeline/rte_port_in_action.h | 8 +- lib/pipeline/rte_swx_ctl.h | 8 +- lib/pipeline/rte_swx_extern.h | 8 +- lib/pipeline/rte_swx_ipsec.h | 8 +- lib/pipeline/rte_swx_pipeline.h | 8 +- lib/pipeline/rte_swx_pipeline_spec.h | 8 +- lib/pipeline/rte_table_action.h | 8 +- lib/port/rte_port.h | 8 +- lib/port/rte_port_ethdev.h | 8 +- lib/port/rte_port_eventdev.h | 8 +- lib/port/rte_port_fd.h | 8 +- lib/port/rte_port_frag.h | 8 +- lib/port/rte_port_ras.h | 8 +- lib/port/rte_port_ring.h | 8 +- lib/port/rte_port_sched.h | 8 +- lib/port/rte_port_source_sink.h | 8 +- lib/port/rte_port_sym_crypto.h | 8 +- lib/port/rte_swx_port.h | 8 +- lib/port/rte_swx_port_ethdev.h | 8 +- lib/port/rte_swx_port_fd.h | 8 +- lib/port/rte_swx_port_ring.h | 8 +- lib/port/rte_swx_port_source_sink.h | 8 +- lib/rawdev/rte_rawdev.h | 6 +- lib/rawdev/rte_rawdev_pmd.h | 8 +- lib/rcu/rte_rcu_qsbr.h | 8 +- lib/regexdev/rte_regexdev.h | 8 +- lib/ring/rte_ring.h | 6 +- lib/ring/rte_ring_core.h | 8 +- lib/ring/rte_ring_elem.h | 8 +- lib/ring/rte_ring_hts.h | 4 +- lib/ring/rte_ring_peek.h | 4 +- lib/ring/rte_ring_peek_zc.h | 4 +- lib/ring/rte_ring_rts.h | 4 +- lib/sched/rte_approx.h | 8 +- lib/sched/rte_pie.h | 8 +- lib/sched/rte_red.h | 8 +- lib/sched/rte_sched.h | 8 +- lib/sched/rte_sched_common.h | 6 +- lib/security/rte_security.h | 8 +- lib/security/rte_security_driver.h | 6 +- lib/stack/rte_stack.h | 8 +- lib/table/rte_lru.h | 12 +- lib/table/rte_lru_arm64.h | 8 +- lib/table/rte_lru_x86.h | 8 - lib/table/rte_swx_hash_func.h | 8 +- lib/table/rte_swx_keycmp.h | 8 +- lib/table/rte_swx_table.h | 8 +- lib/table/rte_swx_table_em.h | 8 +- lib/table/rte_swx_table_learner.h | 8 +- lib/table/rte_swx_table_selector.h | 8 +- lib/table/rte_swx_table_wm.h | 8 +- lib/table/rte_table.h | 8 +- lib/table/rte_table_acl.h | 8 +- lib/table/rte_table_array.h | 8 +- lib/table/rte_table_hash.h | 8 +- lib/table/rte_table_hash_cuckoo.h | 8 +- lib/table/rte_table_hash_func.h | 12 +- lib/table/rte_table_lpm.h | 8 +- lib/table/rte_table_lpm_ipv6.h | 8 +- lib/table/rte_table_stub.h | 8 +- lib/telemetry/rte_telemetry.h | 8 +- lib/vhost/rte_vdpa.h | 8 +- lib/vhost/rte_vhost.h | 8 +- lib/vhost/rte_vhost_async.h | 8 +- lib/vhost/rte_vhost_crypto.h | 4 +- lib/vhost/vdpa_driver.h | 8 +- 285 files changed, 2264 insertions(+), 998 deletions(-)