From patchwork Fri Oct 23 18:30:03 2020 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 8bit X-Patchwork-Submitter: Timothy McDaniel X-Patchwork-Id: 81962 Return-Path: X-Original-To: patchwork@inbox.dpdk.org Delivered-To: patchwork@inbox.dpdk.org Received: from dpdk.org (dpdk.org [92.243.14.124]) by inbox.dpdk.org (Postfix) with ESMTP id 6F270A04DD; Fri, 23 Oct 2020 20:28:39 +0200 (CEST) Received: from [92.243.14.124] (localhost [127.0.0.1]) by dpdk.org (Postfix) with ESMTP id 475DD5A95; Fri, 23 Oct 2020 20:28:37 +0200 (CEST) Received: from mga03.intel.com (mga03.intel.com [134.134.136.65]) by dpdk.org (Postfix) with ESMTP id 4472C5A8C for ; Fri, 23 Oct 2020 20:28:34 +0200 (CEST) IronPort-SDR: pE/2vL74crafdGdVOYcqMDZ6aoH1cJJSM9wBLUYN08kVmPBIMIr21EGL0U9eJkVHscVQnWeb4A BncDAYIO72fA== X-IronPort-AV: E=McAfee;i="6000,8403,9783"; a="167809521" X-IronPort-AV: E=Sophos;i="5.77,409,1596524400"; d="scan'208";a="167809521" X-Amp-Result: SKIPPED(no attachment in message) X-Amp-File-Uploaded: False Received: from fmsmga005.fm.intel.com ([10.253.24.32]) by orsmga103.jf.intel.com with ESMTP/TLS/ECDHE-RSA-AES256-GCM-SHA384; 23 Oct 2020 11:28:32 -0700 IronPort-SDR: LwJ/sdeUm1WbvTKNNMNZz4hXZC7FbNa9u1hu8XFffqCbM7gRu1kQjooG7rKobXl09yQDgbQl0I eL1A2ynHUHow== X-ExtLoop1: 1 X-IronPort-AV: E=Sophos;i="5.77,409,1596524400"; d="scan'208";a="524763953" Received: from txasoft-yocto.an.intel.com ([10.123.72.192]) by fmsmga005.fm.intel.com with ESMTP; 23 Oct 2020 11:28:31 -0700 From: Timothy McDaniel To: Cc: dev@dpdk.org, erik.g.carrillo@intel.com, gage.eads@intel.com, harry.van.haaren@intel.com, jerinj@marvell.com Date: Fri, 23 Oct 2020 13:30:03 -0500 Message-Id: <1603477826-31374-1-git-send-email-timothy.mcdaniel@intel.com> X-Mailer: git-send-email 1.7.10 In-Reply-To: <1599855987-25976-2-git-send-email-timothy.mcdaniel@intel.com> References: <1599855987-25976-2-git-send-email-timothy.mcdaniel@intel.com> MIME-Version: 1.0 Subject: [dpdk-dev] =?utf-8?q?=5BPATCH_v3_00/23=5D_Add_DLB2_PMD?= X-BeenThere: dev@dpdk.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: DPDK patches and discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: dev-bounces@dpdk.org Sender: "dev" The following patch series adds support for a new eventdev PMD. The DLB2 PMD adds support for the Intel Dynamic Load Balancer 2.0 (DLB2) hardware. The DLB2 is a PCIe device that provides load-balanced, prioritized scheduling of core-to-core communication. The device consists of queues and arbiters that connect producer and consumer cores, and implements load-balanced queueing features including: - Lock-free multi-producer/multi-consumer operation. - Multiple priority levels for varying traffic types. - 'Direct' traffic (i.e. multi-producer/single-consumer) - Simple unordered load-balanced distribution. - Atomic lock-free load balancing across multiple consumers. - Queue element reordering feature allowing ordered load-balanced distribution. The DLB2 hardware supports both load balanced and directed ports and queues. Unlike other eventdev devices already in the repo, not all DLB2 ports and queues are equally capable. In particular, directed ports are limited to a single link, and must be connected to a directed queue. Additionally, even though LDB ports may link multiple queues, the number of queues that may be linked is limited by hardware. While reviewing the code, please be aware that this PMD has full control over the DLB2 hardware. Intel will be extending the DLB2 PMD in the future (not as part of this first series) with a mode that we refer to as the bifurcated PMD. The bifurcated PMD communicates with a kernel driver to configure the device, ports, and queues, and memory maps device MMIO so datapath operations occur purely in user-space. Note that the DLB2 hardware is a successor of the DLB hardware, and as such is structured similarly, both in terms of code layout and implementation. The framework to support both the PF PMD and bifurcated PMD exists in this patchset, and is why the iface.[ch] layer is present. Changes since V2: ================ - fixed meson conditional build. Moved test into driver’s meson.build file instead of event/meson.build - documentation is populated as associated code is introduced - add log_register in add dynamic logging patch - rename RTE_xxx symbol(s) as DLB2_xxx - replaced function ptr enqueue_four with direct call to movdir64b - remove unused port_pages - broke up probe patch into 3 smaller patches for easier review - changed param order of movdir64b/movntdq to match intrinsics - added self to MAINTAINERS files - squashed announcement of availability into last patch in series - correct spelling errors and delete repeated words - DPDK_21.0 -> DPDK 21 in map file - add experimental banner to public structs and APIs Changes since V1: ================= - implement changes requested in code reviews by Gage Eads and Mike Chen - fix a memzone leak - convert to use eal rte-cpuflags patch from Liang Ma Known Issues: - the documentation contained in dlb2.rst is not complete, and should be updated to include command line parameters (class of service, etc ...). Depends-on: patch-79539 ("eal: add new x86 cpuid support for WAITPKG") Timothy McDaniel (23): event/dlb2: add documentation and meson build infrastructure event/dlb2: add dynamic logging event/dlb2: add private data structures and constants event/dlb2: add definitions shared with LKM or shared code event/dlb2: add inline functions event/dlb2: add eventdev probe event/dlb2: add flexible interface event/dlb2: add probe-time hardware init event/dlb2: add xstats event/dlb2: add infos get and configure event/dlb2: add queue and port default conf event/dlb2: add queue setup event/dlb2: add port setup event/dlb2: add port link event/dlb2: add port unlink and port unlinks in progress event/dlb2: add eventdev start event/dlb2: add enqueue and its burst variants event/dlb2: add dequeue and its burst variants event/dlb2: add eventdev stop and close event/dlb2: add PMD's token pop public interface event/dlb2: add PMD self-tests event/dlb2: add queue and port release event/dlb2: add timeout ticks entry point MAINTAINERS | 5 + app/test/test_eventdev.c | 7 + config/rte_config.h | 7 + doc/api/doxy-api-index.md | 1 + doc/guides/eventdevs/dlb2.rst | 330 ++ doc/guides/eventdevs/index.rst | 1 + doc/guides/rel_notes/release_20_11.rst | 5 + drivers/event/dlb2/dlb2.c | 3951 ++++++++++++++ drivers/event/dlb2/dlb2_iface.c | 74 + drivers/event/dlb2/dlb2_iface.h | 74 + drivers/event/dlb2/dlb2_inline_fns.h | 61 + drivers/event/dlb2/dlb2_log.h | 25 + drivers/event/dlb2/dlb2_priv.h | 578 ++ drivers/event/dlb2/dlb2_selftest.c | 1570 ++++++ drivers/event/dlb2/dlb2_user.h | 679 +++ drivers/event/dlb2/dlb2_xstats.c | 1240 +++++ drivers/event/dlb2/meson.build | 22 + drivers/event/dlb2/pf/base/dlb2_hw_types.h | 367 ++ drivers/event/dlb2/pf/base/dlb2_mbox.h | 596 ++ drivers/event/dlb2/pf/base/dlb2_osdep.h | 230 + drivers/event/dlb2/pf/base/dlb2_osdep_bitmap.h | 440 ++ drivers/event/dlb2/pf/base/dlb2_osdep_list.h | 131 + drivers/event/dlb2/pf/base/dlb2_osdep_types.h | 31 + drivers/event/dlb2/pf/base/dlb2_regs.h | 2527 +++++++++ drivers/event/dlb2/pf/base/dlb2_resource.c | 6027 +++++++++++++++++++++ drivers/event/dlb2/pf/base/dlb2_resource.h | 1913 +++++++ drivers/event/dlb2/pf/dlb2_main.c | 673 +++ drivers/event/dlb2/pf/dlb2_main.h | 97 + drivers/event/dlb2/pf/dlb2_pf.c | 728 +++ drivers/event/dlb2/rte_pmd_dlb2.c | 39 + drivers/event/dlb2/rte_pmd_dlb2.h | 72 + drivers/event/dlb2/rte_pmd_dlb2_event_version.map | 9 + drivers/event/meson.build | 3 +- 33 files changed, 22512 insertions(+), 1 deletion(-) create mode 100644 doc/guides/eventdevs/dlb2.rst create mode 100644 drivers/event/dlb2/dlb2.c create mode 100644 drivers/event/dlb2/dlb2_iface.c create mode 100644 drivers/event/dlb2/dlb2_iface.h create mode 100644 drivers/event/dlb2/dlb2_inline_fns.h create mode 100644 drivers/event/dlb2/dlb2_log.h create mode 100644 drivers/event/dlb2/dlb2_priv.h create mode 100644 drivers/event/dlb2/dlb2_selftest.c create mode 100644 drivers/event/dlb2/dlb2_user.h create mode 100644 drivers/event/dlb2/dlb2_xstats.c create mode 100644 drivers/event/dlb2/meson.build create mode 100644 drivers/event/dlb2/pf/base/dlb2_hw_types.h create mode 100644 drivers/event/dlb2/pf/base/dlb2_mbox.h create mode 100644 drivers/event/dlb2/pf/base/dlb2_osdep.h create mode 100644 drivers/event/dlb2/pf/base/dlb2_osdep_bitmap.h create mode 100644 drivers/event/dlb2/pf/base/dlb2_osdep_list.h create mode 100644 drivers/event/dlb2/pf/base/dlb2_osdep_types.h create mode 100644 drivers/event/dlb2/pf/base/dlb2_regs.h create mode 100644 drivers/event/dlb2/pf/base/dlb2_resource.c create mode 100644 drivers/event/dlb2/pf/base/dlb2_resource.h create mode 100644 drivers/event/dlb2/pf/dlb2_main.c create mode 100644 drivers/event/dlb2/pf/dlb2_main.h create mode 100644 drivers/event/dlb2/pf/dlb2_pf.c create mode 100644 drivers/event/dlb2/rte_pmd_dlb2.c create mode 100644 drivers/event/dlb2/rte_pmd_dlb2.h create mode 100644 drivers/event/dlb2/rte_pmd_dlb2_event_version.map