From patchwork Mon Jan 3 16:01:46 2022 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Akhil Goyal X-Patchwork-Id: 105586 X-Patchwork-Delegate: jerinj@marvell.com Return-Path: X-Original-To: patchwork@inbox.dpdk.org Delivered-To: patchwork@inbox.dpdk.org Received: from mails.dpdk.org (mails.dpdk.org [217.70.189.124]) by inbox.dpdk.org (Postfix) with ESMTP id 918A4A04A3; Mon, 3 Jan 2022 17:02:30 +0100 (CET) Received: from [217.70.189.124] (localhost [127.0.0.1]) by mails.dpdk.org (Postfix) with ESMTP id 982A841140; Mon, 3 Jan 2022 17:02:22 +0100 (CET) Received: from mx0b-0016f401.pphosted.com (mx0a-0016f401.pphosted.com [67.231.148.174]) by mails.dpdk.org (Postfix) with ESMTP id 8C22A41140 for ; Mon, 3 Jan 2022 17:02:20 +0100 (CET) Received: from pps.filterd (m0045849.ppops.net [127.0.0.1]) by mx0a-0016f401.pphosted.com (8.16.1.2/8.16.1.2) with ESMTP id 203CCe6d013971; Mon, 3 Jan 2022 08:02:18 -0800 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=marvell.com; h=from : to : cc : subject : date : message-id : in-reply-to : references : mime-version : content-transfer-encoding : content-type; s=pfpt0220; bh=Agdj2slaYhBXSyZ4piYBwkNosW8Cx51cvzHhlwIr2cw=; b=a00S7sqAWhAtdWFfwPin5lM8RmGLyWdAjXGBlES8ztST0tB5WAOcc2A4ArUi8WEFfWE9 tmKW18gkC/uT9bOEIa7dYyb0/ua000TnyuMH8l1+EQEG+o1nAh2Zm+uW9gWdDvfhI54Z D786e6Uf64iNkagkStSQ0bM/jTEXVxeCw/ZKKOeHMGJMW3gd4AGKnRGxKbytEAesJY4w aQ2rEj8WTnFhghrN/ymFk7STmmXDrVJkkD2G+gDf2lYOT9FJwbpJxGPv5ASA2kp3rXGJ JCRn+oRJ7CHp0wHiGiRvWzWEexpM6Uxu0GPSCaOJCDB7vPPAsijo7N4bhY4Og0Bpkuhb wQ== Received: from dc5-exch01.marvell.com ([199.233.59.181]) by mx0a-0016f401.pphosted.com (PPS) with ESMTPS id 3dbmvswuvp-1 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-SHA384 bits=256 verify=NOT); Mon, 03 Jan 2022 08:02:17 -0800 Received: from DC5-EXCH02.marvell.com (10.69.176.39) by DC5-EXCH01.marvell.com (10.69.176.38) with Microsoft SMTP Server (TLS) id 15.0.1497.2; Mon, 3 Jan 2022 08:02:15 -0800 Received: from maili.marvell.com (10.69.176.80) by DC5-EXCH02.marvell.com (10.69.176.39) with Microsoft SMTP Server id 15.0.1497.18 via Frontend Transport; Mon, 3 Jan 2022 08:02:15 -0800 Received: from localhost.localdomain (unknown [10.28.48.55]) by maili.marvell.com (Postfix) with ESMTP id 16BE13F705F; Mon, 3 Jan 2022 08:02:11 -0800 (PST) From: Akhil Goyal To: CC: , , , , , , , , Subject: [PATCH 2/5] net/cnxk: reassembly support Date: Mon, 3 Jan 2022 21:31:46 +0530 Message-ID: <20220103160149.1715058-3-gakhil@marvell.com> X-Mailer: git-send-email 2.25.1 In-Reply-To: <20220103160149.1715058-1-gakhil@marvell.com> References: <20220103160149.1715058-1-gakhil@marvell.com> MIME-Version: 1.0 X-Proofpoint-ORIG-GUID: krj2wJlLmQHMGQEHfzhA8_IZxAJVxBPD X-Proofpoint-GUID: krj2wJlLmQHMGQEHfzhA8_IZxAJVxBPD X-Proofpoint-Virus-Version: vendor=baseguard engine=ICAP:2.0.205,Aquarius:18.0.790,Hydra:6.0.425,FMLib:17.11.62.513 definitions=2022-01-03_06,2022-01-01_01,2021-12-02_01 X-BeenThere: dev@dpdk.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: DPDK patches and discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: dev-bounces@dpdk.org From: Vidya Sagar Velumuri Add capability and support for inbound reassembly in cnxk driver. Signed-off-by: Vidya Sagar Velumuri --- drivers/common/cnxk/roc_nix_inl.c | 15 +- drivers/event/cnxk/cn10k_eventdev.c | 1 - drivers/event/cnxk/cn10k_worker.h | 12 +- drivers/event/cnxk/deq/cn10k/deq_128_143.c | 12 + .../event/cnxk/deq/cn10k/deq_128_143_burst.c | 14 + drivers/event/cnxk/deq/cn10k/deq_128_143_ca.c | 12 + .../cnxk/deq/cn10k/deq_128_143_ca_burst.c | 14 + .../event/cnxk/deq/cn10k/deq_128_143_ca_seg.c | 12 + .../cnxk/deq/cn10k/deq_128_143_ca_seg_burst.c | 14 + .../event/cnxk/deq/cn10k/deq_128_143_ca_tmo.c | 12 + .../cnxk/deq/cn10k/deq_128_143_ca_tmo_burst.c | 14 + .../cnxk/deq/cn10k/deq_128_143_ca_tmo_seg.c | 13 + .../deq/cn10k/deq_128_143_ca_tmo_seg_burst.c | 14 + .../event/cnxk/deq/cn10k/deq_128_143_dual.c | 12 + .../event/cnxk/deq/cn10k/deq_128_143_seg.c | 12 + .../cnxk/deq/cn10k/deq_128_143_seg_burst.c | 14 + .../event/cnxk/deq/cn10k/deq_128_143_tmo.c | 12 + .../cnxk/deq/cn10k/deq_128_143_tmo_burst.c | 14 + .../cnxk/deq/cn10k/deq_128_143_tmo_seg.c | 12 + .../deq/cn10k/deq_128_143_tmo_seg_burst.c | 14 + drivers/event/cnxk/deq/cn10k/deq_144_159.c | 12 + .../event/cnxk/deq/cn10k/deq_144_159_burst.c | 14 + drivers/event/cnxk/deq/cn10k/deq_144_159_ca.c | 12 + .../cnxk/deq/cn10k/deq_144_159_ca_burst.c | 14 + .../event/cnxk/deq/cn10k/deq_144_159_ca_seg.c | 12 + .../cnxk/deq/cn10k/deq_144_159_ca_seg_burst.c | 14 + .../event/cnxk/deq/cn10k/deq_144_159_ca_tmo.c | 12 + .../cnxk/deq/cn10k/deq_144_159_ca_tmo_burst.c | 14 + .../cnxk/deq/cn10k/deq_144_159_ca_tmo_seg.c | 13 + .../deq/cn10k/deq_144_159_ca_tmo_seg_burst.c | 14 + .../event/cnxk/deq/cn10k/deq_144_159_dual.c | 12 + .../event/cnxk/deq/cn10k/deq_144_159_seg.c | 12 + .../cnxk/deq/cn10k/deq_144_159_seg_burst.c | 14 + .../event/cnxk/deq/cn10k/deq_144_159_tmo.c | 12 + .../cnxk/deq/cn10k/deq_144_159_tmo_burst.c | 14 + .../cnxk/deq/cn10k/deq_144_159_tmo_seg.c | 12 + .../deq/cn10k/deq_144_159_tmo_seg_burst.c | 14 + drivers/event/cnxk/deq/cn10k/deq_160_175.c | 12 + .../event/cnxk/deq/cn10k/deq_160_175_burst.c | 14 + drivers/event/cnxk/deq/cn10k/deq_160_175_ca.c | 12 + .../cnxk/deq/cn10k/deq_160_175_ca_burst.c | 14 + .../event/cnxk/deq/cn10k/deq_160_175_ca_seg.c | 12 + .../cnxk/deq/cn10k/deq_160_175_ca_seg_burst.c | 14 + .../event/cnxk/deq/cn10k/deq_160_175_ca_tmo.c | 12 + .../cnxk/deq/cn10k/deq_160_175_ca_tmo_burst.c | 14 + .../cnxk/deq/cn10k/deq_160_175_ca_tmo_seg.c | 13 + .../deq/cn10k/deq_160_175_ca_tmo_seg_burst.c | 14 + .../event/cnxk/deq/cn10k/deq_160_175_dual.c | 12 + .../event/cnxk/deq/cn10k/deq_160_175_seg.c | 12 + .../cnxk/deq/cn10k/deq_160_175_seg_burst.c | 14 + .../event/cnxk/deq/cn10k/deq_160_175_tmo.c | 12 + .../cnxk/deq/cn10k/deq_160_175_tmo_burst.c | 14 + .../cnxk/deq/cn10k/deq_160_175_tmo_seg.c | 12 + .../deq/cn10k/deq_160_175_tmo_seg_burst.c | 14 + drivers/event/cnxk/deq/cn10k/deq_176_191.c | 12 + .../event/cnxk/deq/cn10k/deq_176_191_burst.c | 14 + drivers/event/cnxk/deq/cn10k/deq_176_191_ca.c | 12 + .../cnxk/deq/cn10k/deq_176_191_ca_burst.c | 14 + .../event/cnxk/deq/cn10k/deq_176_191_ca_seg.c | 12 + .../cnxk/deq/cn10k/deq_176_191_ca_seg_burst.c | 14 + .../event/cnxk/deq/cn10k/deq_176_191_ca_tmo.c | 12 + .../cnxk/deq/cn10k/deq_176_191_ca_tmo_burst.c | 14 + .../cnxk/deq/cn10k/deq_176_191_ca_tmo_seg.c | 13 + .../deq/cn10k/deq_176_191_ca_tmo_seg_burst.c | 14 + .../event/cnxk/deq/cn10k/deq_176_191_dual.c | 12 + .../event/cnxk/deq/cn10k/deq_176_191_seg.c | 12 + .../cnxk/deq/cn10k/deq_176_191_seg_burst.c | 14 + .../event/cnxk/deq/cn10k/deq_176_191_tmo.c | 12 + .../cnxk/deq/cn10k/deq_176_191_tmo_burst.c | 14 + .../cnxk/deq/cn10k/deq_176_191_tmo_seg.c | 12 + .../deq/cn10k/deq_176_191_tmo_seg_burst.c | 14 + drivers/event/cnxk/deq/cn10k/deq_192_207.c | 12 + .../event/cnxk/deq/cn10k/deq_192_207_burst.c | 14 + drivers/event/cnxk/deq/cn10k/deq_192_207_ca.c | 12 + .../cnxk/deq/cn10k/deq_192_207_ca_burst.c | 14 + .../event/cnxk/deq/cn10k/deq_192_207_ca_seg.c | 12 + .../cnxk/deq/cn10k/deq_192_207_ca_seg_burst.c | 14 + .../event/cnxk/deq/cn10k/deq_192_207_ca_tmo.c | 12 + .../cnxk/deq/cn10k/deq_192_207_ca_tmo_burst.c | 14 + .../cnxk/deq/cn10k/deq_192_207_ca_tmo_seg.c | 13 + .../deq/cn10k/deq_192_207_ca_tmo_seg_burst.c | 14 + .../event/cnxk/deq/cn10k/deq_192_207_dual.c | 12 + .../event/cnxk/deq/cn10k/deq_192_207_seg.c | 12 + .../cnxk/deq/cn10k/deq_192_207_seg_burst.c | 14 + .../event/cnxk/deq/cn10k/deq_192_207_tmo.c | 12 + .../cnxk/deq/cn10k/deq_192_207_tmo_burst.c | 14 + .../cnxk/deq/cn10k/deq_192_207_tmo_seg.c | 12 + .../deq/cn10k/deq_192_207_tmo_seg_burst.c | 14 + drivers/event/cnxk/deq/cn10k/deq_208_223.c | 12 + .../event/cnxk/deq/cn10k/deq_208_223_burst.c | 14 + drivers/event/cnxk/deq/cn10k/deq_208_223_ca.c | 12 + .../cnxk/deq/cn10k/deq_208_223_ca_burst.c | 14 + .../event/cnxk/deq/cn10k/deq_208_223_ca_seg.c | 12 + .../cnxk/deq/cn10k/deq_208_223_ca_seg_burst.c | 14 + .../event/cnxk/deq/cn10k/deq_208_223_ca_tmo.c | 12 + .../cnxk/deq/cn10k/deq_208_223_ca_tmo_burst.c | 14 + .../cnxk/deq/cn10k/deq_208_223_ca_tmo_seg.c | 13 + .../deq/cn10k/deq_208_223_ca_tmo_seg_burst.c | 14 + .../event/cnxk/deq/cn10k/deq_208_223_dual.c | 12 + .../event/cnxk/deq/cn10k/deq_208_223_seg.c | 12 + .../cnxk/deq/cn10k/deq_208_223_seg_burst.c | 14 + .../event/cnxk/deq/cn10k/deq_208_223_tmo.c | 12 + .../cnxk/deq/cn10k/deq_208_223_tmo_burst.c | 14 + .../cnxk/deq/cn10k/deq_208_223_tmo_seg.c | 12 + .../deq/cn10k/deq_208_223_tmo_seg_burst.c | 14 + drivers/event/cnxk/deq/cn10k/deq_224_239.c | 12 + .../event/cnxk/deq/cn10k/deq_224_239_burst.c | 14 + drivers/event/cnxk/deq/cn10k/deq_224_239_ca.c | 12 + .../cnxk/deq/cn10k/deq_224_239_ca_burst.c | 14 + .../event/cnxk/deq/cn10k/deq_224_239_ca_seg.c | 12 + .../cnxk/deq/cn10k/deq_224_239_ca_seg_burst.c | 14 + .../event/cnxk/deq/cn10k/deq_224_239_ca_tmo.c | 12 + .../cnxk/deq/cn10k/deq_224_239_ca_tmo_burst.c | 14 + .../cnxk/deq/cn10k/deq_224_239_ca_tmo_seg.c | 13 + .../deq/cn10k/deq_224_239_ca_tmo_seg_burst.c | 14 + .../event/cnxk/deq/cn10k/deq_224_239_dual.c | 12 + .../event/cnxk/deq/cn10k/deq_224_239_seg.c | 12 + .../cnxk/deq/cn10k/deq_224_239_seg_burst.c | 14 + .../event/cnxk/deq/cn10k/deq_224_239_tmo.c | 12 + .../cnxk/deq/cn10k/deq_224_239_tmo_burst.c | 14 + .../cnxk/deq/cn10k/deq_224_239_tmo_seg.c | 12 + .../deq/cn10k/deq_224_239_tmo_seg_burst.c | 14 + drivers/event/cnxk/deq/cn10k/deq_240_255.c | 12 + .../event/cnxk/deq/cn10k/deq_240_255_burst.c | 14 + drivers/event/cnxk/deq/cn10k/deq_240_255_ca.c | 12 + .../cnxk/deq/cn10k/deq_240_255_ca_burst.c | 14 + .../event/cnxk/deq/cn10k/deq_240_255_ca_seg.c | 12 + .../cnxk/deq/cn10k/deq_240_255_ca_seg_burst.c | 14 + .../event/cnxk/deq/cn10k/deq_240_255_ca_tmo.c | 12 + .../cnxk/deq/cn10k/deq_240_255_ca_tmo_burst.c | 14 + .../cnxk/deq/cn10k/deq_240_255_ca_tmo_seg.c | 13 + .../deq/cn10k/deq_240_255_ca_tmo_seg_burst.c | 14 + .../event/cnxk/deq/cn10k/deq_240_255_dual.c | 12 + .../event/cnxk/deq/cn10k/deq_240_255_seg.c | 12 + .../cnxk/deq/cn10k/deq_240_255_seg_burst.c | 14 + .../event/cnxk/deq/cn10k/deq_240_255_tmo.c | 12 + .../cnxk/deq/cn10k/deq_240_255_tmo_burst.c | 14 + .../cnxk/deq/cn10k/deq_240_255_tmo_seg.c | 12 + .../deq/cn10k/deq_240_255_tmo_seg_burst.c | 14 + drivers/event/cnxk/meson.build | 128 ++++ drivers/net/cnxk/cn10k_ethdev.c | 16 + drivers/net/cnxk/cn10k_rx.c | 35 +- drivers/net/cnxk/cn10k_rx.h | 664 +++++++++++++++++- drivers/net/cnxk/cnxk_ethdev.c | 3 + drivers/net/cnxk/cnxk_ethdev_ops.c | 5 + drivers/net/cnxk/meson.build | 32 + drivers/net/cnxk/rx/cn10k/rx_128_143.c | 11 + drivers/net/cnxk/rx/cn10k/rx_128_143_mseg.c | 11 + drivers/net/cnxk/rx/cn10k/rx_128_143_vec.c | 11 + .../net/cnxk/rx/cn10k/rx_128_143_vec_mseg.c | 12 + drivers/net/cnxk/rx/cn10k/rx_144_159.c | 11 + drivers/net/cnxk/rx/cn10k/rx_144_159_mseg.c | 11 + drivers/net/cnxk/rx/cn10k/rx_144_159_vec.c | 11 + .../net/cnxk/rx/cn10k/rx_144_159_vec_mseg.c | 12 + drivers/net/cnxk/rx/cn10k/rx_160_175.c | 11 + drivers/net/cnxk/rx/cn10k/rx_160_175_mseg.c | 11 + drivers/net/cnxk/rx/cn10k/rx_160_175_vec.c | 11 + .../net/cnxk/rx/cn10k/rx_160_175_vec_mseg.c | 12 + drivers/net/cnxk/rx/cn10k/rx_176_191.c | 11 + drivers/net/cnxk/rx/cn10k/rx_176_191_mseg.c | 11 + drivers/net/cnxk/rx/cn10k/rx_176_191_vec.c | 11 + .../net/cnxk/rx/cn10k/rx_176_191_vec_mseg.c | 12 + drivers/net/cnxk/rx/cn10k/rx_192_207.c | 11 + drivers/net/cnxk/rx/cn10k/rx_192_207_mseg.c | 11 + drivers/net/cnxk/rx/cn10k/rx_192_207_vec.c | 11 + .../net/cnxk/rx/cn10k/rx_192_207_vec_mseg.c | 12 + drivers/net/cnxk/rx/cn10k/rx_208_223.c | 11 + drivers/net/cnxk/rx/cn10k/rx_208_223_mseg.c | 11 + drivers/net/cnxk/rx/cn10k/rx_208_223_vec.c | 11 + .../net/cnxk/rx/cn10k/rx_208_223_vec_mseg.c | 12 + drivers/net/cnxk/rx/cn10k/rx_224_239.c | 11 + drivers/net/cnxk/rx/cn10k/rx_224_239_mseg.c | 11 + drivers/net/cnxk/rx/cn10k/rx_224_239_vec.c | 11 + .../net/cnxk/rx/cn10k/rx_224_239_vec_mseg.c | 12 + drivers/net/cnxk/rx/cn10k/rx_240_255.c | 11 + drivers/net/cnxk/rx/cn10k/rx_240_255_mseg.c | 11 + drivers/net/cnxk/rx/cn10k/rx_240_255_vec.c | 11 + .../net/cnxk/rx/cn10k/rx_240_255_vec_mseg.c | 12 + 178 files changed, 2987 insertions(+), 52 deletions(-) create mode 100644 drivers/event/cnxk/deq/cn10k/deq_128_143.c create mode 100644 drivers/event/cnxk/deq/cn10k/deq_128_143_burst.c create mode 100644 drivers/event/cnxk/deq/cn10k/deq_128_143_ca.c create mode 100644 drivers/event/cnxk/deq/cn10k/deq_128_143_ca_burst.c create mode 100644 drivers/event/cnxk/deq/cn10k/deq_128_143_ca_seg.c create mode 100644 drivers/event/cnxk/deq/cn10k/deq_128_143_ca_seg_burst.c create mode 100644 drivers/event/cnxk/deq/cn10k/deq_128_143_ca_tmo.c create mode 100644 drivers/event/cnxk/deq/cn10k/deq_128_143_ca_tmo_burst.c create mode 100644 drivers/event/cnxk/deq/cn10k/deq_128_143_ca_tmo_seg.c create mode 100644 drivers/event/cnxk/deq/cn10k/deq_128_143_ca_tmo_seg_burst.c create mode 100644 drivers/event/cnxk/deq/cn10k/deq_128_143_dual.c create mode 100644 drivers/event/cnxk/deq/cn10k/deq_128_143_seg.c create mode 100644 drivers/event/cnxk/deq/cn10k/deq_128_143_seg_burst.c create mode 100644 drivers/event/cnxk/deq/cn10k/deq_128_143_tmo.c create mode 100644 drivers/event/cnxk/deq/cn10k/deq_128_143_tmo_burst.c create mode 100644 drivers/event/cnxk/deq/cn10k/deq_128_143_tmo_seg.c create mode 100644 drivers/event/cnxk/deq/cn10k/deq_128_143_tmo_seg_burst.c create mode 100644 drivers/event/cnxk/deq/cn10k/deq_144_159.c create mode 100644 drivers/event/cnxk/deq/cn10k/deq_144_159_burst.c create mode 100644 drivers/event/cnxk/deq/cn10k/deq_144_159_ca.c create mode 100644 drivers/event/cnxk/deq/cn10k/deq_144_159_ca_burst.c create mode 100644 drivers/event/cnxk/deq/cn10k/deq_144_159_ca_seg.c create mode 100644 drivers/event/cnxk/deq/cn10k/deq_144_159_ca_seg_burst.c create mode 100644 drivers/event/cnxk/deq/cn10k/deq_144_159_ca_tmo.c create mode 100644 drivers/event/cnxk/deq/cn10k/deq_144_159_ca_tmo_burst.c create mode 100644 drivers/event/cnxk/deq/cn10k/deq_144_159_ca_tmo_seg.c create mode 100644 drivers/event/cnxk/deq/cn10k/deq_144_159_ca_tmo_seg_burst.c create mode 100644 drivers/event/cnxk/deq/cn10k/deq_144_159_dual.c create mode 100644 drivers/event/cnxk/deq/cn10k/deq_144_159_seg.c create mode 100644 drivers/event/cnxk/deq/cn10k/deq_144_159_seg_burst.c create mode 100644 drivers/event/cnxk/deq/cn10k/deq_144_159_tmo.c create mode 100644 drivers/event/cnxk/deq/cn10k/deq_144_159_tmo_burst.c create mode 100644 drivers/event/cnxk/deq/cn10k/deq_144_159_tmo_seg.c create mode 100644 drivers/event/cnxk/deq/cn10k/deq_144_159_tmo_seg_burst.c create mode 100644 drivers/event/cnxk/deq/cn10k/deq_160_175.c create mode 100644 drivers/event/cnxk/deq/cn10k/deq_160_175_burst.c create mode 100644 drivers/event/cnxk/deq/cn10k/deq_160_175_ca.c create mode 100644 drivers/event/cnxk/deq/cn10k/deq_160_175_ca_burst.c create mode 100644 drivers/event/cnxk/deq/cn10k/deq_160_175_ca_seg.c create mode 100644 drivers/event/cnxk/deq/cn10k/deq_160_175_ca_seg_burst.c create mode 100644 drivers/event/cnxk/deq/cn10k/deq_160_175_ca_tmo.c create mode 100644 drivers/event/cnxk/deq/cn10k/deq_160_175_ca_tmo_burst.c create mode 100644 drivers/event/cnxk/deq/cn10k/deq_160_175_ca_tmo_seg.c create mode 100644 drivers/event/cnxk/deq/cn10k/deq_160_175_ca_tmo_seg_burst.c create mode 100644 drivers/event/cnxk/deq/cn10k/deq_160_175_dual.c create mode 100644 drivers/event/cnxk/deq/cn10k/deq_160_175_seg.c create mode 100644 drivers/event/cnxk/deq/cn10k/deq_160_175_seg_burst.c create mode 100644 drivers/event/cnxk/deq/cn10k/deq_160_175_tmo.c create mode 100644 drivers/event/cnxk/deq/cn10k/deq_160_175_tmo_burst.c create mode 100644 drivers/event/cnxk/deq/cn10k/deq_160_175_tmo_seg.c create mode 100644 drivers/event/cnxk/deq/cn10k/deq_160_175_tmo_seg_burst.c create mode 100644 drivers/event/cnxk/deq/cn10k/deq_176_191.c create mode 100644 drivers/event/cnxk/deq/cn10k/deq_176_191_burst.c create mode 100644 drivers/event/cnxk/deq/cn10k/deq_176_191_ca.c create mode 100644 drivers/event/cnxk/deq/cn10k/deq_176_191_ca_burst.c create mode 100644 drivers/event/cnxk/deq/cn10k/deq_176_191_ca_seg.c create mode 100644 drivers/event/cnxk/deq/cn10k/deq_176_191_ca_seg_burst.c create mode 100644 drivers/event/cnxk/deq/cn10k/deq_176_191_ca_tmo.c create mode 100644 drivers/event/cnxk/deq/cn10k/deq_176_191_ca_tmo_burst.c create mode 100644 drivers/event/cnxk/deq/cn10k/deq_176_191_ca_tmo_seg.c create mode 100644 drivers/event/cnxk/deq/cn10k/deq_176_191_ca_tmo_seg_burst.c create mode 100644 drivers/event/cnxk/deq/cn10k/deq_176_191_dual.c create mode 100644 drivers/event/cnxk/deq/cn10k/deq_176_191_seg.c create mode 100644 drivers/event/cnxk/deq/cn10k/deq_176_191_seg_burst.c create mode 100644 drivers/event/cnxk/deq/cn10k/deq_176_191_tmo.c create mode 100644 drivers/event/cnxk/deq/cn10k/deq_176_191_tmo_burst.c create mode 100644 drivers/event/cnxk/deq/cn10k/deq_176_191_tmo_seg.c create mode 100644 drivers/event/cnxk/deq/cn10k/deq_176_191_tmo_seg_burst.c create mode 100644 drivers/event/cnxk/deq/cn10k/deq_192_207.c create mode 100644 drivers/event/cnxk/deq/cn10k/deq_192_207_burst.c create mode 100644 drivers/event/cnxk/deq/cn10k/deq_192_207_ca.c create mode 100644 drivers/event/cnxk/deq/cn10k/deq_192_207_ca_burst.c create mode 100644 drivers/event/cnxk/deq/cn10k/deq_192_207_ca_seg.c create mode 100644 drivers/event/cnxk/deq/cn10k/deq_192_207_ca_seg_burst.c create mode 100644 drivers/event/cnxk/deq/cn10k/deq_192_207_ca_tmo.c create mode 100644 drivers/event/cnxk/deq/cn10k/deq_192_207_ca_tmo_burst.c create mode 100644 drivers/event/cnxk/deq/cn10k/deq_192_207_ca_tmo_seg.c create mode 100644 drivers/event/cnxk/deq/cn10k/deq_192_207_ca_tmo_seg_burst.c create mode 100644 drivers/event/cnxk/deq/cn10k/deq_192_207_dual.c create mode 100644 drivers/event/cnxk/deq/cn10k/deq_192_207_seg.c create mode 100644 drivers/event/cnxk/deq/cn10k/deq_192_207_seg_burst.c create mode 100644 drivers/event/cnxk/deq/cn10k/deq_192_207_tmo.c create mode 100644 drivers/event/cnxk/deq/cn10k/deq_192_207_tmo_burst.c create mode 100644 drivers/event/cnxk/deq/cn10k/deq_192_207_tmo_seg.c create mode 100644 drivers/event/cnxk/deq/cn10k/deq_192_207_tmo_seg_burst.c create mode 100644 drivers/event/cnxk/deq/cn10k/deq_208_223.c create mode 100644 drivers/event/cnxk/deq/cn10k/deq_208_223_burst.c create mode 100644 drivers/event/cnxk/deq/cn10k/deq_208_223_ca.c create mode 100644 drivers/event/cnxk/deq/cn10k/deq_208_223_ca_burst.c create mode 100644 drivers/event/cnxk/deq/cn10k/deq_208_223_ca_seg.c create mode 100644 drivers/event/cnxk/deq/cn10k/deq_208_223_ca_seg_burst.c create mode 100644 drivers/event/cnxk/deq/cn10k/deq_208_223_ca_tmo.c create mode 100644 drivers/event/cnxk/deq/cn10k/deq_208_223_ca_tmo_burst.c create mode 100644 drivers/event/cnxk/deq/cn10k/deq_208_223_ca_tmo_seg.c create mode 100644 drivers/event/cnxk/deq/cn10k/deq_208_223_ca_tmo_seg_burst.c create mode 100644 drivers/event/cnxk/deq/cn10k/deq_208_223_dual.c create mode 100644 drivers/event/cnxk/deq/cn10k/deq_208_223_seg.c create mode 100644 drivers/event/cnxk/deq/cn10k/deq_208_223_seg_burst.c create mode 100644 drivers/event/cnxk/deq/cn10k/deq_208_223_tmo.c create mode 100644 drivers/event/cnxk/deq/cn10k/deq_208_223_tmo_burst.c create mode 100644 drivers/event/cnxk/deq/cn10k/deq_208_223_tmo_seg.c create mode 100644 drivers/event/cnxk/deq/cn10k/deq_208_223_tmo_seg_burst.c create mode 100644 drivers/event/cnxk/deq/cn10k/deq_224_239.c create mode 100644 drivers/event/cnxk/deq/cn10k/deq_224_239_burst.c create mode 100644 drivers/event/cnxk/deq/cn10k/deq_224_239_ca.c create mode 100644 drivers/event/cnxk/deq/cn10k/deq_224_239_ca_burst.c create mode 100644 drivers/event/cnxk/deq/cn10k/deq_224_239_ca_seg.c create mode 100644 drivers/event/cnxk/deq/cn10k/deq_224_239_ca_seg_burst.c create mode 100644 drivers/event/cnxk/deq/cn10k/deq_224_239_ca_tmo.c create mode 100644 drivers/event/cnxk/deq/cn10k/deq_224_239_ca_tmo_burst.c create mode 100644 drivers/event/cnxk/deq/cn10k/deq_224_239_ca_tmo_seg.c create mode 100644 drivers/event/cnxk/deq/cn10k/deq_224_239_ca_tmo_seg_burst.c create mode 100644 drivers/event/cnxk/deq/cn10k/deq_224_239_dual.c create mode 100644 drivers/event/cnxk/deq/cn10k/deq_224_239_seg.c create mode 100644 drivers/event/cnxk/deq/cn10k/deq_224_239_seg_burst.c create mode 100644 drivers/event/cnxk/deq/cn10k/deq_224_239_tmo.c create mode 100644 drivers/event/cnxk/deq/cn10k/deq_224_239_tmo_burst.c create mode 100644 drivers/event/cnxk/deq/cn10k/deq_224_239_tmo_seg.c create mode 100644 drivers/event/cnxk/deq/cn10k/deq_224_239_tmo_seg_burst.c create mode 100644 drivers/event/cnxk/deq/cn10k/deq_240_255.c create mode 100644 drivers/event/cnxk/deq/cn10k/deq_240_255_burst.c create mode 100644 drivers/event/cnxk/deq/cn10k/deq_240_255_ca.c create mode 100644 drivers/event/cnxk/deq/cn10k/deq_240_255_ca_burst.c create mode 100644 drivers/event/cnxk/deq/cn10k/deq_240_255_ca_seg.c create mode 100644 drivers/event/cnxk/deq/cn10k/deq_240_255_ca_seg_burst.c create mode 100644 drivers/event/cnxk/deq/cn10k/deq_240_255_ca_tmo.c create mode 100644 drivers/event/cnxk/deq/cn10k/deq_240_255_ca_tmo_burst.c create mode 100644 drivers/event/cnxk/deq/cn10k/deq_240_255_ca_tmo_seg.c create mode 100644 drivers/event/cnxk/deq/cn10k/deq_240_255_ca_tmo_seg_burst.c create mode 100644 drivers/event/cnxk/deq/cn10k/deq_240_255_dual.c create mode 100644 drivers/event/cnxk/deq/cn10k/deq_240_255_seg.c create mode 100644 drivers/event/cnxk/deq/cn10k/deq_240_255_seg_burst.c create mode 100644 drivers/event/cnxk/deq/cn10k/deq_240_255_tmo.c create mode 100644 drivers/event/cnxk/deq/cn10k/deq_240_255_tmo_burst.c create mode 100644 drivers/event/cnxk/deq/cn10k/deq_240_255_tmo_seg.c create mode 100644 drivers/event/cnxk/deq/cn10k/deq_240_255_tmo_seg_burst.c create mode 100644 drivers/net/cnxk/rx/cn10k/rx_128_143.c create mode 100644 drivers/net/cnxk/rx/cn10k/rx_128_143_mseg.c create mode 100644 drivers/net/cnxk/rx/cn10k/rx_128_143_vec.c create mode 100644 drivers/net/cnxk/rx/cn10k/rx_128_143_vec_mseg.c create mode 100644 drivers/net/cnxk/rx/cn10k/rx_144_159.c create mode 100644 drivers/net/cnxk/rx/cn10k/rx_144_159_mseg.c create mode 100644 drivers/net/cnxk/rx/cn10k/rx_144_159_vec.c create mode 100644 drivers/net/cnxk/rx/cn10k/rx_144_159_vec_mseg.c create mode 100644 drivers/net/cnxk/rx/cn10k/rx_160_175.c create mode 100644 drivers/net/cnxk/rx/cn10k/rx_160_175_mseg.c create mode 100644 drivers/net/cnxk/rx/cn10k/rx_160_175_vec.c create mode 100644 drivers/net/cnxk/rx/cn10k/rx_160_175_vec_mseg.c create mode 100644 drivers/net/cnxk/rx/cn10k/rx_176_191.c create mode 100644 drivers/net/cnxk/rx/cn10k/rx_176_191_mseg.c create mode 100644 drivers/net/cnxk/rx/cn10k/rx_176_191_vec.c create mode 100644 drivers/net/cnxk/rx/cn10k/rx_176_191_vec_mseg.c create mode 100644 drivers/net/cnxk/rx/cn10k/rx_192_207.c create mode 100644 drivers/net/cnxk/rx/cn10k/rx_192_207_mseg.c create mode 100644 drivers/net/cnxk/rx/cn10k/rx_192_207_vec.c create mode 100644 drivers/net/cnxk/rx/cn10k/rx_192_207_vec_mseg.c create mode 100644 drivers/net/cnxk/rx/cn10k/rx_208_223.c create mode 100644 drivers/net/cnxk/rx/cn10k/rx_208_223_mseg.c create mode 100644 drivers/net/cnxk/rx/cn10k/rx_208_223_vec.c create mode 100644 drivers/net/cnxk/rx/cn10k/rx_208_223_vec_mseg.c create mode 100644 drivers/net/cnxk/rx/cn10k/rx_224_239.c create mode 100644 drivers/net/cnxk/rx/cn10k/rx_224_239_mseg.c create mode 100644 drivers/net/cnxk/rx/cn10k/rx_224_239_vec.c create mode 100644 drivers/net/cnxk/rx/cn10k/rx_224_239_vec_mseg.c create mode 100644 drivers/net/cnxk/rx/cn10k/rx_240_255.c create mode 100644 drivers/net/cnxk/rx/cn10k/rx_240_255_mseg.c create mode 100644 drivers/net/cnxk/rx/cn10k/rx_240_255_vec.c create mode 100644 drivers/net/cnxk/rx/cn10k/rx_240_255_vec_mseg.c diff --git a/drivers/common/cnxk/roc_nix_inl.c b/drivers/common/cnxk/roc_nix_inl.c index 6bfd10adde..a06872f6f3 100644 --- a/drivers/common/cnxk/roc_nix_inl.c +++ b/drivers/common/cnxk/roc_nix_inl.c @@ -205,21 +205,22 @@ roc_nix_reass_configure(uint32_t max_wait_time, uint16_t max_frags) { struct idev_cfg *idev = idev_get_cfg(); struct roc_cpt *roc_cpt; - struct roc_cpt_rxc_time_cfg *cfg; + struct roc_cpt_rxc_time_cfg cfg; + (void)max_frags; roc_cpt = idev->cpt; if (!roc_cpt) { plt_err("Cannot support inline inbound, cryptodev not probed"); return -ENOTSUP; } - cfg->step = (max_wait_time / ROC_NIX_INL_REAS_ACTIVE_LIMIT) * 1000; - cfg->zombie_limit = ROC_NIX_INL_REAS_ZOMBIE_LIMIT; - cfg->zombie_thres = ROC_NIX_INL_REAS_ZOMBIE_THRESHOLD; - cfg->active_limit = ROC_NIX_INL_REAS_ACTIVE_LIMIT; - cfg->active_thres = ROC_NIX_INL_REAS_ACTIVE_THRESHOLD; + cfg.step = (max_wait_time / ROC_NIX_INL_REAS_ACTIVE_LIMIT) * 1000; + cfg.zombie_limit = ROC_NIX_INL_REAS_ZOMBIE_LIMIT; + cfg.zombie_thres = ROC_NIX_INL_REAS_ZOMBIE_THRESHOLD; + cfg.active_limit = ROC_NIX_INL_REAS_ACTIVE_LIMIT; + cfg.active_thres = ROC_NIX_INL_REAS_ACTIVE_THRESHOLD; - roc_cpt_rxc_time_cfg(roc_cpt, cfg); + roc_cpt_rxc_time_cfg(roc_cpt, &cfg); return 0; } diff --git a/drivers/event/cnxk/cn10k_eventdev.c b/drivers/event/cnxk/cn10k_eventdev.c index b56426960a..fa5fa518c5 100644 --- a/drivers/event/cnxk/cn10k_eventdev.c +++ b/drivers/event/cnxk/cn10k_eventdev.c @@ -330,7 +330,6 @@ cn10k_sso_fp_fns_set(struct rte_eventdev *event_dev) const event_dequeue_t sso_hws_deq_seg[NIX_RX_OFFLOAD_MAX] = { #define R(name, flags) [flags] = cn10k_sso_hws_deq_seg_##name, - NIX_RX_FASTPATH_MODES #undef R }; diff --git a/drivers/event/cnxk/cn10k_worker.h b/drivers/event/cnxk/cn10k_worker.h index 78d029baaa..41ec238ecf 100644 --- a/drivers/event/cnxk/cn10k_worker.h +++ b/drivers/event/cnxk/cn10k_worker.h @@ -157,9 +157,11 @@ cn10k_process_vwqe(uintptr_t vwqe, uint16_t port_id, const uint32_t flags, /* Translate meta to mbuf */ if (flags & NIX_RX_OFFLOAD_SECURITY_F) { const uint64_t cq_w1 = *((const uint64_t *)cqe + 1); + const uint64_t cq_w5 = *((const uint64_t *)cqe + 5); - mbuf = nix_sec_meta_to_mbuf_sc(cq_w1, sa_base, laddr, - &loff, mbuf, d_off); + mbuf = nix_sec_meta_to_mbuf_sc(cq_w1, cq_w5, sa_base, laddr, + &loff, mbuf, d_off, + flags); } cn10k_nix_cqe_to_mbuf(cqe, cqe->tag, mbuf, lookup_mem, @@ -231,20 +233,22 @@ cn10k_sso_hws_get_work(struct cn10k_sso_hws *ws, struct rte_event *ev, uint8_t loff = 0; uint16_t d_off; uint64_t cq_w1; + uint64_t cq_w5; m = (struct rte_mbuf *)mbuf; d_off = (uintptr_t)(m->buf_addr) - (uintptr_t)m; d_off += RTE_PKTMBUF_HEADROOM; cq_w1 = *(uint64_t *)(gw.u64[1] + 8); + cq_w5 = *(uint64_t *)(gw.u64[1] + 40); sa_base = cnxk_nix_sa_base_get(port, lookup_mem); sa_base &= ~(ROC_NIX_INL_SA_BASE_ALIGN - 1); mbuf = (uint64_t)nix_sec_meta_to_mbuf_sc( - cq_w1, sa_base, (uintptr_t)&iova, &loff, - (struct rte_mbuf *)mbuf, d_off); + cq_w1, cq_w5, sa_base, (uintptr_t)&iova, &loff, + (struct rte_mbuf *)mbuf, d_off, flags); if (loff) roc_npa_aura_op_free(m->pool->pool_id, 0, iova); diff --git a/drivers/event/cnxk/deq/cn10k/deq_128_143.c b/drivers/event/cnxk/deq/cn10k/deq_128_143.c new file mode 100644 index 0000000000..b3bc4f195d --- /dev/null +++ b/drivers/event/cnxk/deq/cn10k/deq_128_143.c @@ -0,0 +1,12 @@ +/* SPDX-License-Identifier: BSD-3-Clause + * Copyright(C) 2021 Marvell. + */ + +#include "cn10k_worker.h" +#include "cnxk_eventdev.h" +#include "cnxk_worker.h" + +#define R(name, flags) SSO_DEQ(cn10k_sso_hws_deq_##name, flags) + +NIX_RX_FASTPATH_MODES_128_143 +#undef R diff --git a/drivers/event/cnxk/deq/cn10k/deq_128_143_burst.c b/drivers/event/cnxk/deq/cn10k/deq_128_143_burst.c new file mode 100644 index 0000000000..ebc1e20eec --- /dev/null +++ b/drivers/event/cnxk/deq/cn10k/deq_128_143_burst.c @@ -0,0 +1,14 @@ +/* SPDX-License-Identifier: BSD-3-Clause + * Copyright(C) 2021 Marvell. + */ + +#include "cn10k_worker.h" +#include "cnxk_eventdev.h" +#include "cnxk_worker.h" + +#define R(name, flags) \ + SSO_CMN_DEQ_BURST(cn10k_sso_hws_deq_burst_##name, \ + cn10k_sso_hws_deq_##name, flags) + +NIX_RX_FASTPATH_MODES_128_143 +#undef R diff --git a/drivers/event/cnxk/deq/cn10k/deq_128_143_ca.c b/drivers/event/cnxk/deq/cn10k/deq_128_143_ca.c new file mode 100644 index 0000000000..f13499f490 --- /dev/null +++ b/drivers/event/cnxk/deq/cn10k/deq_128_143_ca.c @@ -0,0 +1,12 @@ +/* SPDX-License-Identifier: BSD-3-Clause + * Copyright(C) 2021 Marvell. + */ + +#include "cn10k_worker.h" +#include "cnxk_eventdev.h" +#include "cnxk_worker.h" + +#define R(name, flags) SSO_DEQ_CA(cn10k_sso_hws_deq_ca_##name, flags) + +NIX_RX_FASTPATH_MODES_128_143 +#undef R diff --git a/drivers/event/cnxk/deq/cn10k/deq_128_143_ca_burst.c b/drivers/event/cnxk/deq/cn10k/deq_128_143_ca_burst.c new file mode 100644 index 0000000000..a0fad1ad9b --- /dev/null +++ b/drivers/event/cnxk/deq/cn10k/deq_128_143_ca_burst.c @@ -0,0 +1,14 @@ +/* SPDX-License-Identifier: BSD-3-Clause + * Copyright(C) 2021 Marvell. + */ + +#include "cn10k_worker.h" +#include "cnxk_eventdev.h" +#include "cnxk_worker.h" + +#define R(name, flags) \ + SSO_CMN_DEQ_BURST(cn10k_sso_hws_deq_ca_burst_##name, \ + cn10k_sso_hws_deq_ca_##name, flags) + +NIX_RX_FASTPATH_MODES_128_143 +#undef R diff --git a/drivers/event/cnxk/deq/cn10k/deq_128_143_ca_seg.c b/drivers/event/cnxk/deq/cn10k/deq_128_143_ca_seg.c new file mode 100644 index 0000000000..4cec0c7db5 --- /dev/null +++ b/drivers/event/cnxk/deq/cn10k/deq_128_143_ca_seg.c @@ -0,0 +1,12 @@ +/* SPDX-License-Identifier: BSD-3-Clause + * Copyright(C) 2021 Marvell. + */ + +#include "cn10k_worker.h" +#include "cnxk_eventdev.h" +#include "cnxk_worker.h" + +#define R(name, flags) SSO_DEQ_CA_SEG(cn10k_sso_hws_deq_ca_seg_##name, flags) + +NIX_RX_FASTPATH_MODES_128_143 +#undef R diff --git a/drivers/event/cnxk/deq/cn10k/deq_128_143_ca_seg_burst.c b/drivers/event/cnxk/deq/cn10k/deq_128_143_ca_seg_burst.c new file mode 100644 index 0000000000..728a48cd75 --- /dev/null +++ b/drivers/event/cnxk/deq/cn10k/deq_128_143_ca_seg_burst.c @@ -0,0 +1,14 @@ +/* SPDX-License-Identifier: BSD-3-Clause + * Copyright(C) 2021 Marvell. + */ + +#include "cn10k_worker.h" +#include "cnxk_eventdev.h" +#include "cnxk_worker.h" + +#define R(name, flags) \ + SSO_CMN_DEQ_BURST(cn10k_sso_hws_deq_ca_seg_burst_##name, \ + cn10k_sso_hws_deq_ca_seg_##name, flags) + +NIX_RX_FASTPATH_MODES_128_143 +#undef R diff --git a/drivers/event/cnxk/deq/cn10k/deq_128_143_ca_tmo.c b/drivers/event/cnxk/deq/cn10k/deq_128_143_ca_tmo.c new file mode 100644 index 0000000000..cc98821998 --- /dev/null +++ b/drivers/event/cnxk/deq/cn10k/deq_128_143_ca_tmo.c @@ -0,0 +1,12 @@ +/* SPDX-License-Identifier: BSD-3-Clause + * Copyright(C) 2021 Marvell. + */ + +#include "cn10k_worker.h" +#include "cnxk_eventdev.h" +#include "cnxk_worker.h" + +#define R(name, flags) SSO_DEQ_TMO_CA(cn10k_sso_hws_deq_tmo_ca_##name, flags) + +NIX_RX_FASTPATH_MODES_128_143 +#undef R diff --git a/drivers/event/cnxk/deq/cn10k/deq_128_143_ca_tmo_burst.c b/drivers/event/cnxk/deq/cn10k/deq_128_143_ca_tmo_burst.c new file mode 100644 index 0000000000..3d03c71ea2 --- /dev/null +++ b/drivers/event/cnxk/deq/cn10k/deq_128_143_ca_tmo_burst.c @@ -0,0 +1,14 @@ +/* SPDX-License-Identifier: BSD-3-Clause + * Copyright(C) 2021 Marvell. + */ + +#include "cn10k_worker.h" +#include "cnxk_eventdev.h" +#include "cnxk_worker.h" + +#define R(name, flags) \ + SSO_CMN_DEQ_BURST(cn10k_sso_hws_deq_tmo_ca_burst_##name, \ + cn10k_sso_hws_deq_tmo_ca_##name, flags) + +NIX_RX_FASTPATH_MODES_128_143 +#undef R diff --git a/drivers/event/cnxk/deq/cn10k/deq_128_143_ca_tmo_seg.c b/drivers/event/cnxk/deq/cn10k/deq_128_143_ca_tmo_seg.c new file mode 100644 index 0000000000..e2788d2d82 --- /dev/null +++ b/drivers/event/cnxk/deq/cn10k/deq_128_143_ca_tmo_seg.c @@ -0,0 +1,13 @@ +/* SPDX-License-Identifier: BSD-3-Clause + * Copyright(C) 2021 Marvell. + */ + +#include "cn10k_worker.h" +#include "cnxk_eventdev.h" +#include "cnxk_worker.h" + +#define R(name, flags) \ + SSO_DEQ_TMO_CA_SEG(cn10k_sso_hws_deq_tmo_ca_seg_##name, flags) + +NIX_RX_FASTPATH_MODES_128_143 +#undef R diff --git a/drivers/event/cnxk/deq/cn10k/deq_128_143_ca_tmo_seg_burst.c b/drivers/event/cnxk/deq/cn10k/deq_128_143_ca_tmo_seg_burst.c new file mode 100644 index 0000000000..3c11c33879 --- /dev/null +++ b/drivers/event/cnxk/deq/cn10k/deq_128_143_ca_tmo_seg_burst.c @@ -0,0 +1,14 @@ +/* SPDX-License-Identifier: BSD-3-Clause + * Copyright(C) 2021 Marvell. + */ + +#include "cn10k_worker.h" +#include "cnxk_eventdev.h" +#include "cnxk_worker.h" + +#define R(name, flags) \ + SSO_CMN_DEQ_BURST(cn10k_sso_hws_deq_tmo_ca_seg_burst_##name, \ + cn10k_sso_hws_deq_tmo_ca_seg_##name, flags) + +NIX_RX_FASTPATH_MODES_128_143 +#undef R diff --git a/drivers/event/cnxk/deq/cn10k/deq_128_143_dual.c b/drivers/event/cnxk/deq/cn10k/deq_128_143_dual.c new file mode 100644 index 0000000000..f495bbb02c --- /dev/null +++ b/drivers/event/cnxk/deq/cn10k/deq_128_143_dual.c @@ -0,0 +1,12 @@ +/* SPDX-License-Identifier: BSD-3-Clause + * Copyright(C) 2021 Marvell. + */ + +#include "cn10k_worker.h" +#include "cnxk_eventdev.h" +#include "cnxk_worker.h" + +#define R(name, flags) SSO_DUAL_DEQ(cn10k_sso_hws_dual_deq_##name, flags) + +NIX_RX_FASTPATH_MODES_128_143 +#undef R diff --git a/drivers/event/cnxk/deq/cn10k/deq_128_143_seg.c b/drivers/event/cnxk/deq/cn10k/deq_128_143_seg.c new file mode 100644 index 0000000000..9e8226c7af --- /dev/null +++ b/drivers/event/cnxk/deq/cn10k/deq_128_143_seg.c @@ -0,0 +1,12 @@ +/* SPDX-License-Identifier: BSD-3-Clause + * Copyright(C) 2021 Marvell. + */ + +#include "cn10k_worker.h" +#include "cnxk_eventdev.h" +#include "cnxk_worker.h" + +#define R(name, flags) SSO_DEQ_SEG(cn10k_sso_hws_deq_seg_##name, flags) + +NIX_RX_FASTPATH_MODES_128_143 +#undef R diff --git a/drivers/event/cnxk/deq/cn10k/deq_128_143_seg_burst.c b/drivers/event/cnxk/deq/cn10k/deq_128_143_seg_burst.c new file mode 100644 index 0000000000..c150a758c4 --- /dev/null +++ b/drivers/event/cnxk/deq/cn10k/deq_128_143_seg_burst.c @@ -0,0 +1,14 @@ +/* SPDX-License-Identifier: BSD-3-Clause + * Copyright(C) 2021 Marvell. + */ + +#include "cn10k_worker.h" +#include "cnxk_eventdev.h" +#include "cnxk_worker.h" + +#define R(name, flags) \ + SSO_CMN_DEQ_SEG_BURST(cn10k_sso_hws_deq_seg_burst_##name, \ + cn10k_sso_hws_deq_seg_##name, flags) + +NIX_RX_FASTPATH_MODES_128_143 +#undef R diff --git a/drivers/event/cnxk/deq/cn10k/deq_128_143_tmo.c b/drivers/event/cnxk/deq/cn10k/deq_128_143_tmo.c new file mode 100644 index 0000000000..611bd35f84 --- /dev/null +++ b/drivers/event/cnxk/deq/cn10k/deq_128_143_tmo.c @@ -0,0 +1,12 @@ +/* SPDX-License-Identifier: BSD-3-Clause + * Copyright(C) 2021 Marvell. + */ + +#include "cn10k_worker.h" +#include "cnxk_eventdev.h" +#include "cnxk_worker.h" + +#define R(name, flags) SSO_DEQ_TMO(cn10k_sso_hws_deq_tmo_##name, flags) + +NIX_RX_FASTPATH_MODES_128_143 +#undef R diff --git a/drivers/event/cnxk/deq/cn10k/deq_128_143_tmo_burst.c b/drivers/event/cnxk/deq/cn10k/deq_128_143_tmo_burst.c new file mode 100644 index 0000000000..7c91e0c842 --- /dev/null +++ b/drivers/event/cnxk/deq/cn10k/deq_128_143_tmo_burst.c @@ -0,0 +1,14 @@ +/* SPDX-License-Identifier: BSD-3-Clause + * Copyright(C) 2021 Marvell. + */ + +#include "cn10k_worker.h" +#include "cnxk_eventdev.h" +#include "cnxk_worker.h" + +#define R(name, flags) \ + SSO_CMN_DEQ_BURST(cn10k_sso_hws_deq_tmo_burst_##name, \ + cn10k_sso_hws_deq_tmo_##name, flags) + +NIX_RX_FASTPATH_MODES_128_143 +#undef R diff --git a/drivers/event/cnxk/deq/cn10k/deq_128_143_tmo_seg.c b/drivers/event/cnxk/deq/cn10k/deq_128_143_tmo_seg.c new file mode 100644 index 0000000000..7f2d789efc --- /dev/null +++ b/drivers/event/cnxk/deq/cn10k/deq_128_143_tmo_seg.c @@ -0,0 +1,12 @@ +/* SPDX-License-Identifier: BSD-3-Clause + * Copyright(C) 2021 Marvell. + */ + +#include "cn10k_worker.h" +#include "cnxk_eventdev.h" +#include "cnxk_worker.h" + +#define R(name, flags) SSO_DEQ_TMO_SEG(cn10k_sso_hws_deq_tmo_seg_##name, flags) + +NIX_RX_FASTPATH_MODES_128_143 +#undef R diff --git a/drivers/event/cnxk/deq/cn10k/deq_128_143_tmo_seg_burst.c b/drivers/event/cnxk/deq/cn10k/deq_128_143_tmo_seg_burst.c new file mode 100644 index 0000000000..994fbc17a7 --- /dev/null +++ b/drivers/event/cnxk/deq/cn10k/deq_128_143_tmo_seg_burst.c @@ -0,0 +1,14 @@ +/* SPDX-License-Identifier: BSD-3-Clause + * Copyright(C) 2021 Marvell. + */ + +#include "cn10k_worker.h" +#include "cnxk_eventdev.h" +#include "cnxk_worker.h" + +#define R(name, flags) \ + SSO_CMN_DEQ_BURST(cn10k_sso_hws_deq_tmo_seg_burst_##name, \ + cn10k_sso_hws_deq_tmo_seg_##name, flags) + +NIX_RX_FASTPATH_MODES_128_143 +#undef R diff --git a/drivers/event/cnxk/deq/cn10k/deq_144_159.c b/drivers/event/cnxk/deq/cn10k/deq_144_159.c new file mode 100644 index 0000000000..483fa7c372 --- /dev/null +++ b/drivers/event/cnxk/deq/cn10k/deq_144_159.c @@ -0,0 +1,12 @@ +/* SPDX-License-Identifier: BSD-3-Clause + * Copyright(C) 2021 Marvell. + */ + +#include "cn10k_worker.h" +#include "cnxk_eventdev.h" +#include "cnxk_worker.h" + +#define R(name, flags) SSO_DEQ(cn10k_sso_hws_deq_##name, flags) + +NIX_RX_FASTPATH_MODES_144_159 +#undef R diff --git a/drivers/event/cnxk/deq/cn10k/deq_144_159_burst.c b/drivers/event/cnxk/deq/cn10k/deq_144_159_burst.c new file mode 100644 index 0000000000..e9c2eae8fa --- /dev/null +++ b/drivers/event/cnxk/deq/cn10k/deq_144_159_burst.c @@ -0,0 +1,14 @@ +/* SPDX-License-Identifier: BSD-3-Clause + * Copyright(C) 2021 Marvell. + */ + +#include "cn10k_worker.h" +#include "cnxk_eventdev.h" +#include "cnxk_worker.h" + +#define R(name, flags) \ + SSO_CMN_DEQ_BURST(cn10k_sso_hws_deq_burst_##name, \ + cn10k_sso_hws_deq_##name, flags) + +NIX_RX_FASTPATH_MODES_144_159 +#undef R diff --git a/drivers/event/cnxk/deq/cn10k/deq_144_159_ca.c b/drivers/event/cnxk/deq/cn10k/deq_144_159_ca.c new file mode 100644 index 0000000000..eaae80b696 --- /dev/null +++ b/drivers/event/cnxk/deq/cn10k/deq_144_159_ca.c @@ -0,0 +1,12 @@ +/* SPDX-License-Identifier: BSD-3-Clause + * Copyright(C) 2021 Marvell. + */ + +#include "cn10k_worker.h" +#include "cnxk_eventdev.h" +#include "cnxk_worker.h" + +#define R(name, flags) SSO_DEQ_CA(cn10k_sso_hws_deq_ca_##name, flags) + +NIX_RX_FASTPATH_MODES_144_159 +#undef R diff --git a/drivers/event/cnxk/deq/cn10k/deq_144_159_ca_burst.c b/drivers/event/cnxk/deq/cn10k/deq_144_159_ca_burst.c new file mode 100644 index 0000000000..203a8cbb92 --- /dev/null +++ b/drivers/event/cnxk/deq/cn10k/deq_144_159_ca_burst.c @@ -0,0 +1,14 @@ +/* SPDX-License-Identifier: BSD-3-Clause + * Copyright(C) 2021 Marvell. + */ + +#include "cn10k_worker.h" +#include "cnxk_eventdev.h" +#include "cnxk_worker.h" + +#define R(name, flags) \ + SSO_CMN_DEQ_BURST(cn10k_sso_hws_deq_ca_burst_##name, \ + cn10k_sso_hws_deq_ca_##name, flags) + +NIX_RX_FASTPATH_MODES_144_159 +#undef R diff --git a/drivers/event/cnxk/deq/cn10k/deq_144_159_ca_seg.c b/drivers/event/cnxk/deq/cn10k/deq_144_159_ca_seg.c new file mode 100644 index 0000000000..b341368d85 --- /dev/null +++ b/drivers/event/cnxk/deq/cn10k/deq_144_159_ca_seg.c @@ -0,0 +1,12 @@ +/* SPDX-License-Identifier: BSD-3-Clause + * Copyright(C) 2021 Marvell. + */ + +#include "cn10k_worker.h" +#include "cnxk_eventdev.h" +#include "cnxk_worker.h" + +#define R(name, flags) SSO_DEQ_CA_SEG(cn10k_sso_hws_deq_ca_seg_##name, flags) + +NIX_RX_FASTPATH_MODES_144_159 +#undef R diff --git a/drivers/event/cnxk/deq/cn10k/deq_144_159_ca_seg_burst.c b/drivers/event/cnxk/deq/cn10k/deq_144_159_ca_seg_burst.c new file mode 100644 index 0000000000..251b13199b --- /dev/null +++ b/drivers/event/cnxk/deq/cn10k/deq_144_159_ca_seg_burst.c @@ -0,0 +1,14 @@ +/* SPDX-License-Identifier: BSD-3-Clause + * Copyright(C) 2021 Marvell. + */ + +#include "cn10k_worker.h" +#include "cnxk_eventdev.h" +#include "cnxk_worker.h" + +#define R(name, flags) \ + SSO_CMN_DEQ_BURST(cn10k_sso_hws_deq_ca_seg_burst_##name, \ + cn10k_sso_hws_deq_ca_seg_##name, flags) + +NIX_RX_FASTPATH_MODES_144_159 +#undef R diff --git a/drivers/event/cnxk/deq/cn10k/deq_144_159_ca_tmo.c b/drivers/event/cnxk/deq/cn10k/deq_144_159_ca_tmo.c new file mode 100644 index 0000000000..16fde955cd --- /dev/null +++ b/drivers/event/cnxk/deq/cn10k/deq_144_159_ca_tmo.c @@ -0,0 +1,12 @@ +/* SPDX-License-Identifier: BSD-3-Clause + * Copyright(C) 2021 Marvell. + */ + +#include "cn10k_worker.h" +#include "cnxk_eventdev.h" +#include "cnxk_worker.h" + +#define R(name, flags) SSO_DEQ_TMO_CA(cn10k_sso_hws_deq_tmo_ca_##name, flags) + +NIX_RX_FASTPATH_MODES_144_159 +#undef R diff --git a/drivers/event/cnxk/deq/cn10k/deq_144_159_ca_tmo_burst.c b/drivers/event/cnxk/deq/cn10k/deq_144_159_ca_tmo_burst.c new file mode 100644 index 0000000000..f7615615c9 --- /dev/null +++ b/drivers/event/cnxk/deq/cn10k/deq_144_159_ca_tmo_burst.c @@ -0,0 +1,14 @@ +/* SPDX-License-Identifier: BSD-3-Clause + * Copyright(C) 2021 Marvell. + */ + +#include "cn10k_worker.h" +#include "cnxk_eventdev.h" +#include "cnxk_worker.h" + +#define R(name, flags) \ + SSO_CMN_DEQ_BURST(cn10k_sso_hws_deq_tmo_ca_burst_##name, \ + cn10k_sso_hws_deq_tmo_ca_##name, flags) + +NIX_RX_FASTPATH_MODES_144_159 +#undef R diff --git a/drivers/event/cnxk/deq/cn10k/deq_144_159_ca_tmo_seg.c b/drivers/event/cnxk/deq/cn10k/deq_144_159_ca_tmo_seg.c new file mode 100644 index 0000000000..d191b1f44f --- /dev/null +++ b/drivers/event/cnxk/deq/cn10k/deq_144_159_ca_tmo_seg.c @@ -0,0 +1,13 @@ +/* SPDX-License-Identifier: BSD-3-Clause + * Copyright(C) 2021 Marvell. + */ + +#include "cn10k_worker.h" +#include "cnxk_eventdev.h" +#include "cnxk_worker.h" + +#define R(name, flags) \ + SSO_DEQ_TMO_CA_SEG(cn10k_sso_hws_deq_tmo_ca_seg_##name, flags) + +NIX_RX_FASTPATH_MODES_144_159 +#undef R diff --git a/drivers/event/cnxk/deq/cn10k/deq_144_159_ca_tmo_seg_burst.c b/drivers/event/cnxk/deq/cn10k/deq_144_159_ca_tmo_seg_burst.c new file mode 100644 index 0000000000..802e0dbb74 --- /dev/null +++ b/drivers/event/cnxk/deq/cn10k/deq_144_159_ca_tmo_seg_burst.c @@ -0,0 +1,14 @@ +/* SPDX-License-Identifier: BSD-3-Clause + * Copyright(C) 2021 Marvell. + */ + +#include "cn10k_worker.h" +#include "cnxk_eventdev.h" +#include "cnxk_worker.h" + +#define R(name, flags) \ + SSO_CMN_DEQ_BURST(cn10k_sso_hws_deq_tmo_ca_seg_burst_##name, \ + cn10k_sso_hws_deq_tmo_ca_seg_##name, flags) + +NIX_RX_FASTPATH_MODES_144_159 +#undef R diff --git a/drivers/event/cnxk/deq/cn10k/deq_144_159_dual.c b/drivers/event/cnxk/deq/cn10k/deq_144_159_dual.c new file mode 100644 index 0000000000..81e6e57717 --- /dev/null +++ b/drivers/event/cnxk/deq/cn10k/deq_144_159_dual.c @@ -0,0 +1,12 @@ +/* SPDX-License-Identifier: BSD-3-Clause + * Copyright(C) 2021 Marvell. + */ + +#include "cn10k_worker.h" +#include "cnxk_eventdev.h" +#include "cnxk_worker.h" + +#define R(name, flags) SSO_DUAL_DEQ(cn10k_sso_hws_dual_deq_##name, flags) + +NIX_RX_FASTPATH_MODES_144_159 +#undef R diff --git a/drivers/event/cnxk/deq/cn10k/deq_144_159_seg.c b/drivers/event/cnxk/deq/cn10k/deq_144_159_seg.c new file mode 100644 index 0000000000..fbeef19451 --- /dev/null +++ b/drivers/event/cnxk/deq/cn10k/deq_144_159_seg.c @@ -0,0 +1,12 @@ +/* SPDX-License-Identifier: BSD-3-Clause + * Copyright(C) 2021 Marvell. + */ + +#include "cn10k_worker.h" +#include "cnxk_eventdev.h" +#include "cnxk_worker.h" + +#define R(name, flags) SSO_DEQ_SEG(cn10k_sso_hws_deq_seg_##name, flags) + +NIX_RX_FASTPATH_MODES_144_159 +#undef R diff --git a/drivers/event/cnxk/deq/cn10k/deq_144_159_seg_burst.c b/drivers/event/cnxk/deq/cn10k/deq_144_159_seg_burst.c new file mode 100644 index 0000000000..450ccd018c --- /dev/null +++ b/drivers/event/cnxk/deq/cn10k/deq_144_159_seg_burst.c @@ -0,0 +1,14 @@ +/* SPDX-License-Identifier: BSD-3-Clause + * Copyright(C) 2021 Marvell. + */ + +#include "cn10k_worker.h" +#include "cnxk_eventdev.h" +#include "cnxk_worker.h" + +#define R(name, flags) \ + SSO_CMN_DEQ_SEG_BURST(cn10k_sso_hws_deq_seg_burst_##name, \ + cn10k_sso_hws_deq_seg_##name, flags) + +NIX_RX_FASTPATH_MODES_144_159 +#undef R diff --git a/drivers/event/cnxk/deq/cn10k/deq_144_159_tmo.c b/drivers/event/cnxk/deq/cn10k/deq_144_159_tmo.c new file mode 100644 index 0000000000..ecd8a62195 --- /dev/null +++ b/drivers/event/cnxk/deq/cn10k/deq_144_159_tmo.c @@ -0,0 +1,12 @@ +/* SPDX-License-Identifier: BSD-3-Clause + * Copyright(C) 2021 Marvell. + */ + +#include "cn10k_worker.h" +#include "cnxk_eventdev.h" +#include "cnxk_worker.h" + +#define R(name, flags) SSO_DEQ_TMO(cn10k_sso_hws_deq_tmo_##name, flags) + +NIX_RX_FASTPATH_MODES_144_159 +#undef R diff --git a/drivers/event/cnxk/deq/cn10k/deq_144_159_tmo_burst.c b/drivers/event/cnxk/deq/cn10k/deq_144_159_tmo_burst.c new file mode 100644 index 0000000000..52de6b545e --- /dev/null +++ b/drivers/event/cnxk/deq/cn10k/deq_144_159_tmo_burst.c @@ -0,0 +1,14 @@ +/* SPDX-License-Identifier: BSD-3-Clause + * Copyright(C) 2021 Marvell. + */ + +#include "cn10k_worker.h" +#include "cnxk_eventdev.h" +#include "cnxk_worker.h" + +#define R(name, flags) \ + SSO_CMN_DEQ_BURST(cn10k_sso_hws_deq_tmo_burst_##name, \ + cn10k_sso_hws_deq_tmo_##name, flags) + +NIX_RX_FASTPATH_MODES_144_159 +#undef R diff --git a/drivers/event/cnxk/deq/cn10k/deq_144_159_tmo_seg.c b/drivers/event/cnxk/deq/cn10k/deq_144_159_tmo_seg.c new file mode 100644 index 0000000000..e1ce1e00bf --- /dev/null +++ b/drivers/event/cnxk/deq/cn10k/deq_144_159_tmo_seg.c @@ -0,0 +1,12 @@ +/* SPDX-License-Identifier: BSD-3-Clause + * Copyright(C) 2021 Marvell. + */ + +#include "cn10k_worker.h" +#include "cnxk_eventdev.h" +#include "cnxk_worker.h" + +#define R(name, flags) SSO_DEQ_TMO_SEG(cn10k_sso_hws_deq_tmo_seg_##name, flags) + +NIX_RX_FASTPATH_MODES_144_159 +#undef R diff --git a/drivers/event/cnxk/deq/cn10k/deq_144_159_tmo_seg_burst.c b/drivers/event/cnxk/deq/cn10k/deq_144_159_tmo_seg_burst.c new file mode 100644 index 0000000000..22ec66cf7f --- /dev/null +++ b/drivers/event/cnxk/deq/cn10k/deq_144_159_tmo_seg_burst.c @@ -0,0 +1,14 @@ +/* SPDX-License-Identifier: BSD-3-Clause + * Copyright(C) 2021 Marvell. + */ + +#include "cn10k_worker.h" +#include "cnxk_eventdev.h" +#include "cnxk_worker.h" + +#define R(name, flags) \ + SSO_CMN_DEQ_BURST(cn10k_sso_hws_deq_tmo_seg_burst_##name, \ + cn10k_sso_hws_deq_tmo_seg_##name, flags) + +NIX_RX_FASTPATH_MODES_144_159 +#undef R diff --git a/drivers/event/cnxk/deq/cn10k/deq_160_175.c b/drivers/event/cnxk/deq/cn10k/deq_160_175.c new file mode 100644 index 0000000000..225d234ebe --- /dev/null +++ b/drivers/event/cnxk/deq/cn10k/deq_160_175.c @@ -0,0 +1,12 @@ +/* SPDX-License-Identifier: BSD-3-Clause + * Copyright(C) 2021 Marvell. + */ + +#include "cn10k_worker.h" +#include "cnxk_eventdev.h" +#include "cnxk_worker.h" + +#define R(name, flags) SSO_DEQ(cn10k_sso_hws_deq_##name, flags) + +NIX_RX_FASTPATH_MODES_160_175 +#undef R diff --git a/drivers/event/cnxk/deq/cn10k/deq_160_175_burst.c b/drivers/event/cnxk/deq/cn10k/deq_160_175_burst.c new file mode 100644 index 0000000000..c8ef1a144e --- /dev/null +++ b/drivers/event/cnxk/deq/cn10k/deq_160_175_burst.c @@ -0,0 +1,14 @@ +/* SPDX-License-Identifier: BSD-3-Clause + * Copyright(C) 2021 Marvell. + */ + +#include "cn10k_worker.h" +#include "cnxk_eventdev.h" +#include "cnxk_worker.h" + +#define R(name, flags) \ + SSO_CMN_DEQ_BURST(cn10k_sso_hws_deq_burst_##name, \ + cn10k_sso_hws_deq_##name, flags) + +NIX_RX_FASTPATH_MODES_160_175 +#undef R diff --git a/drivers/event/cnxk/deq/cn10k/deq_160_175_ca.c b/drivers/event/cnxk/deq/cn10k/deq_160_175_ca.c new file mode 100644 index 0000000000..b304de6e5c --- /dev/null +++ b/drivers/event/cnxk/deq/cn10k/deq_160_175_ca.c @@ -0,0 +1,12 @@ +/* SPDX-License-Identifier: BSD-3-Clause + * Copyright(C) 2021 Marvell. + */ + +#include "cn10k_worker.h" +#include "cnxk_eventdev.h" +#include "cnxk_worker.h" + +#define R(name, flags) SSO_DEQ_CA(cn10k_sso_hws_deq_ca_##name, flags) + +NIX_RX_FASTPATH_MODES_160_175 +#undef R diff --git a/drivers/event/cnxk/deq/cn10k/deq_160_175_ca_burst.c b/drivers/event/cnxk/deq/cn10k/deq_160_175_ca_burst.c new file mode 100644 index 0000000000..ef8442af7d --- /dev/null +++ b/drivers/event/cnxk/deq/cn10k/deq_160_175_ca_burst.c @@ -0,0 +1,14 @@ +/* SPDX-License-Identifier: BSD-3-Clause + * Copyright(C) 2021 Marvell. + */ + +#include "cn10k_worker.h" +#include "cnxk_eventdev.h" +#include "cnxk_worker.h" + +#define R(name, flags) \ + SSO_CMN_DEQ_BURST(cn10k_sso_hws_deq_ca_burst_##name, \ + cn10k_sso_hws_deq_ca_##name, flags) + +NIX_RX_FASTPATH_MODES_160_175 +#undef R diff --git a/drivers/event/cnxk/deq/cn10k/deq_160_175_ca_seg.c b/drivers/event/cnxk/deq/cn10k/deq_160_175_ca_seg.c new file mode 100644 index 0000000000..272d9a6126 --- /dev/null +++ b/drivers/event/cnxk/deq/cn10k/deq_160_175_ca_seg.c @@ -0,0 +1,12 @@ +/* SPDX-License-Identifier: BSD-3-Clause + * Copyright(C) 2021 Marvell. + */ + +#include "cn10k_worker.h" +#include "cnxk_eventdev.h" +#include "cnxk_worker.h" + +#define R(name, flags) SSO_DEQ_CA_SEG(cn10k_sso_hws_deq_ca_seg_##name, flags) + +NIX_RX_FASTPATH_MODES_160_175 +#undef R diff --git a/drivers/event/cnxk/deq/cn10k/deq_160_175_ca_seg_burst.c b/drivers/event/cnxk/deq/cn10k/deq_160_175_ca_seg_burst.c new file mode 100644 index 0000000000..452476e478 --- /dev/null +++ b/drivers/event/cnxk/deq/cn10k/deq_160_175_ca_seg_burst.c @@ -0,0 +1,14 @@ +/* SPDX-License-Identifier: BSD-3-Clause + * Copyright(C) 2021 Marvell. + */ + +#include "cn10k_worker.h" +#include "cnxk_eventdev.h" +#include "cnxk_worker.h" + +#define R(name, flags) \ + SSO_CMN_DEQ_BURST(cn10k_sso_hws_deq_ca_seg_burst_##name, \ + cn10k_sso_hws_deq_ca_seg_##name, flags) + +NIX_RX_FASTPATH_MODES_160_175 +#undef R diff --git a/drivers/event/cnxk/deq/cn10k/deq_160_175_ca_tmo.c b/drivers/event/cnxk/deq/cn10k/deq_160_175_ca_tmo.c new file mode 100644 index 0000000000..e481565fc9 --- /dev/null +++ b/drivers/event/cnxk/deq/cn10k/deq_160_175_ca_tmo.c @@ -0,0 +1,12 @@ +/* SPDX-License-Identifier: BSD-3-Clause + * Copyright(C) 2021 Marvell. + */ + +#include "cn10k_worker.h" +#include "cnxk_eventdev.h" +#include "cnxk_worker.h" + +#define R(name, flags) SSO_DEQ_TMO_CA(cn10k_sso_hws_deq_tmo_ca_##name, flags) + +NIX_RX_FASTPATH_MODES_160_175 +#undef R diff --git a/drivers/event/cnxk/deq/cn10k/deq_160_175_ca_tmo_burst.c b/drivers/event/cnxk/deq/cn10k/deq_160_175_ca_tmo_burst.c new file mode 100644 index 0000000000..4bc5e54487 --- /dev/null +++ b/drivers/event/cnxk/deq/cn10k/deq_160_175_ca_tmo_burst.c @@ -0,0 +1,14 @@ +/* SPDX-License-Identifier: BSD-3-Clause + * Copyright(C) 2021 Marvell. + */ + +#include "cn10k_worker.h" +#include "cnxk_eventdev.h" +#include "cnxk_worker.h" + +#define R(name, flags) \ + SSO_CMN_DEQ_BURST(cn10k_sso_hws_deq_tmo_ca_burst_##name, \ + cn10k_sso_hws_deq_tmo_ca_##name, flags) + +NIX_RX_FASTPATH_MODES_160_175 +#undef R diff --git a/drivers/event/cnxk/deq/cn10k/deq_160_175_ca_tmo_seg.c b/drivers/event/cnxk/deq/cn10k/deq_160_175_ca_tmo_seg.c new file mode 100644 index 0000000000..cb63891568 --- /dev/null +++ b/drivers/event/cnxk/deq/cn10k/deq_160_175_ca_tmo_seg.c @@ -0,0 +1,13 @@ +/* SPDX-License-Identifier: BSD-3-Clause + * Copyright(C) 2021 Marvell. + */ + +#include "cn10k_worker.h" +#include "cnxk_eventdev.h" +#include "cnxk_worker.h" + +#define R(name, flags) \ + SSO_DEQ_TMO_CA_SEG(cn10k_sso_hws_deq_tmo_ca_seg_##name, flags) + +NIX_RX_FASTPATH_MODES_160_175 +#undef R diff --git a/drivers/event/cnxk/deq/cn10k/deq_160_175_ca_tmo_seg_burst.c b/drivers/event/cnxk/deq/cn10k/deq_160_175_ca_tmo_seg_burst.c new file mode 100644 index 0000000000..effca85b06 --- /dev/null +++ b/drivers/event/cnxk/deq/cn10k/deq_160_175_ca_tmo_seg_burst.c @@ -0,0 +1,14 @@ +/* SPDX-License-Identifier: BSD-3-Clause + * Copyright(C) 2021 Marvell. + */ + +#include "cn10k_worker.h" +#include "cnxk_eventdev.h" +#include "cnxk_worker.h" + +#define R(name, flags) \ + SSO_CMN_DEQ_BURST(cn10k_sso_hws_deq_tmo_ca_seg_burst_##name, \ + cn10k_sso_hws_deq_tmo_ca_seg_##name, flags) + +NIX_RX_FASTPATH_MODES_160_175 +#undef R diff --git a/drivers/event/cnxk/deq/cn10k/deq_160_175_dual.c b/drivers/event/cnxk/deq/cn10k/deq_160_175_dual.c new file mode 100644 index 0000000000..f8de8810bd --- /dev/null +++ b/drivers/event/cnxk/deq/cn10k/deq_160_175_dual.c @@ -0,0 +1,12 @@ +/* SPDX-License-Identifier: BSD-3-Clause + * Copyright(C) 2021 Marvell. + */ + +#include "cn10k_worker.h" +#include "cnxk_eventdev.h" +#include "cnxk_worker.h" + +#define R(name, flags) SSO_DUAL_DEQ(cn10k_sso_hws_dual_deq_##name, flags) + +NIX_RX_FASTPATH_MODES_160_175 +#undef R diff --git a/drivers/event/cnxk/deq/cn10k/deq_160_175_seg.c b/drivers/event/cnxk/deq/cn10k/deq_160_175_seg.c new file mode 100644 index 0000000000..3afd3a4117 --- /dev/null +++ b/drivers/event/cnxk/deq/cn10k/deq_160_175_seg.c @@ -0,0 +1,12 @@ +/* SPDX-License-Identifier: BSD-3-Clause + * Copyright(C) 2021 Marvell. + */ + +#include "cn10k_worker.h" +#include "cnxk_eventdev.h" +#include "cnxk_worker.h" + +#define R(name, flags) SSO_DEQ_SEG(cn10k_sso_hws_deq_seg_##name, flags) + +NIX_RX_FASTPATH_MODES_160_175 +#undef R diff --git a/drivers/event/cnxk/deq/cn10k/deq_160_175_seg_burst.c b/drivers/event/cnxk/deq/cn10k/deq_160_175_seg_burst.c new file mode 100644 index 0000000000..a60e59df8e --- /dev/null +++ b/drivers/event/cnxk/deq/cn10k/deq_160_175_seg_burst.c @@ -0,0 +1,14 @@ +/* SPDX-License-Identifier: BSD-3-Clause + * Copyright(C) 2021 Marvell. + */ + +#include "cn10k_worker.h" +#include "cnxk_eventdev.h" +#include "cnxk_worker.h" + +#define R(name, flags) \ + SSO_CMN_DEQ_SEG_BURST(cn10k_sso_hws_deq_seg_burst_##name, \ + cn10k_sso_hws_deq_seg_##name, flags) + +NIX_RX_FASTPATH_MODES_160_175 +#undef R diff --git a/drivers/event/cnxk/deq/cn10k/deq_160_175_tmo.c b/drivers/event/cnxk/deq/cn10k/deq_160_175_tmo.c new file mode 100644 index 0000000000..91179a1eca --- /dev/null +++ b/drivers/event/cnxk/deq/cn10k/deq_160_175_tmo.c @@ -0,0 +1,12 @@ +/* SPDX-License-Identifier: BSD-3-Clause + * Copyright(C) 2021 Marvell. + */ + +#include "cn10k_worker.h" +#include "cnxk_eventdev.h" +#include "cnxk_worker.h" + +#define R(name, flags) SSO_DEQ_TMO(cn10k_sso_hws_deq_tmo_##name, flags) + +NIX_RX_FASTPATH_MODES_160_175 +#undef R diff --git a/drivers/event/cnxk/deq/cn10k/deq_160_175_tmo_burst.c b/drivers/event/cnxk/deq/cn10k/deq_160_175_tmo_burst.c new file mode 100644 index 0000000000..9a62c88942 --- /dev/null +++ b/drivers/event/cnxk/deq/cn10k/deq_160_175_tmo_burst.c @@ -0,0 +1,14 @@ +/* SPDX-License-Identifier: BSD-3-Clause + * Copyright(C) 2021 Marvell. + */ + +#include "cn10k_worker.h" +#include "cnxk_eventdev.h" +#include "cnxk_worker.h" + +#define R(name, flags) \ + SSO_CMN_DEQ_BURST(cn10k_sso_hws_deq_tmo_burst_##name, \ + cn10k_sso_hws_deq_tmo_##name, flags) + +NIX_RX_FASTPATH_MODES_160_175 +#undef R diff --git a/drivers/event/cnxk/deq/cn10k/deq_160_175_tmo_seg.c b/drivers/event/cnxk/deq/cn10k/deq_160_175_tmo_seg.c new file mode 100644 index 0000000000..30218295b9 --- /dev/null +++ b/drivers/event/cnxk/deq/cn10k/deq_160_175_tmo_seg.c @@ -0,0 +1,12 @@ +/* SPDX-License-Identifier: BSD-3-Clause + * Copyright(C) 2021 Marvell. + */ + +#include "cn10k_worker.h" +#include "cnxk_eventdev.h" +#include "cnxk_worker.h" + +#define R(name, flags) SSO_DEQ_TMO_SEG(cn10k_sso_hws_deq_tmo_seg_##name, flags) + +NIX_RX_FASTPATH_MODES_160_175 +#undef R diff --git a/drivers/event/cnxk/deq/cn10k/deq_160_175_tmo_seg_burst.c b/drivers/event/cnxk/deq/cn10k/deq_160_175_tmo_seg_burst.c new file mode 100644 index 0000000000..7cb9f955a5 --- /dev/null +++ b/drivers/event/cnxk/deq/cn10k/deq_160_175_tmo_seg_burst.c @@ -0,0 +1,14 @@ +/* SPDX-License-Identifier: BSD-3-Clause + * Copyright(C) 2021 Marvell. + */ + +#include "cn10k_worker.h" +#include "cnxk_eventdev.h" +#include "cnxk_worker.h" + +#define R(name, flags) \ + SSO_CMN_DEQ_BURST(cn10k_sso_hws_deq_tmo_seg_burst_##name, \ + cn10k_sso_hws_deq_tmo_seg_##name, flags) + +NIX_RX_FASTPATH_MODES_160_175 +#undef R diff --git a/drivers/event/cnxk/deq/cn10k/deq_176_191.c b/drivers/event/cnxk/deq/cn10k/deq_176_191.c new file mode 100644 index 0000000000..8e686199f4 --- /dev/null +++ b/drivers/event/cnxk/deq/cn10k/deq_176_191.c @@ -0,0 +1,12 @@ +/* SPDX-License-Identifier: BSD-3-Clause + * Copyright(C) 2021 Marvell. + */ + +#include "cn10k_worker.h" +#include "cnxk_eventdev.h" +#include "cnxk_worker.h" + +#define R(name, flags) SSO_DEQ(cn10k_sso_hws_deq_##name, flags) + +NIX_RX_FASTPATH_MODES_176_191 +#undef R diff --git a/drivers/event/cnxk/deq/cn10k/deq_176_191_burst.c b/drivers/event/cnxk/deq/cn10k/deq_176_191_burst.c new file mode 100644 index 0000000000..a5494ddb72 --- /dev/null +++ b/drivers/event/cnxk/deq/cn10k/deq_176_191_burst.c @@ -0,0 +1,14 @@ +/* SPDX-License-Identifier: BSD-3-Clause + * Copyright(C) 2021 Marvell. + */ + +#include "cn10k_worker.h" +#include "cnxk_eventdev.h" +#include "cnxk_worker.h" + +#define R(name, flags) \ + SSO_CMN_DEQ_BURST(cn10k_sso_hws_deq_burst_##name, \ + cn10k_sso_hws_deq_##name, flags) + +NIX_RX_FASTPATH_MODES_176_191 +#undef R diff --git a/drivers/event/cnxk/deq/cn10k/deq_176_191_ca.c b/drivers/event/cnxk/deq/cn10k/deq_176_191_ca.c new file mode 100644 index 0000000000..6ef5e6c281 --- /dev/null +++ b/drivers/event/cnxk/deq/cn10k/deq_176_191_ca.c @@ -0,0 +1,12 @@ +/* SPDX-License-Identifier: BSD-3-Clause + * Copyright(C) 2021 Marvell. + */ + +#include "cn10k_worker.h" +#include "cnxk_eventdev.h" +#include "cnxk_worker.h" + +#define R(name, flags) SSO_DEQ_CA(cn10k_sso_hws_deq_ca_##name, flags) + +NIX_RX_FASTPATH_MODES_176_191 +#undef R diff --git a/drivers/event/cnxk/deq/cn10k/deq_176_191_ca_burst.c b/drivers/event/cnxk/deq/cn10k/deq_176_191_ca_burst.c new file mode 100644 index 0000000000..faebf51a51 --- /dev/null +++ b/drivers/event/cnxk/deq/cn10k/deq_176_191_ca_burst.c @@ -0,0 +1,14 @@ +/* SPDX-License-Identifier: BSD-3-Clause + * Copyright(C) 2021 Marvell. + */ + +#include "cn10k_worker.h" +#include "cnxk_eventdev.h" +#include "cnxk_worker.h" + +#define R(name, flags) \ + SSO_CMN_DEQ_BURST(cn10k_sso_hws_deq_ca_burst_##name, \ + cn10k_sso_hws_deq_ca_##name, flags) + +NIX_RX_FASTPATH_MODES_176_191 +#undef R diff --git a/drivers/event/cnxk/deq/cn10k/deq_176_191_ca_seg.c b/drivers/event/cnxk/deq/cn10k/deq_176_191_ca_seg.c new file mode 100644 index 0000000000..0cc6ea32ee --- /dev/null +++ b/drivers/event/cnxk/deq/cn10k/deq_176_191_ca_seg.c @@ -0,0 +1,12 @@ +/* SPDX-License-Identifier: BSD-3-Clause + * Copyright(C) 2021 Marvell. + */ + +#include "cn10k_worker.h" +#include "cnxk_eventdev.h" +#include "cnxk_worker.h" + +#define R(name, flags) SSO_DEQ_CA_SEG(cn10k_sso_hws_deq_ca_seg_##name, flags) + +NIX_RX_FASTPATH_MODES_176_191 +#undef R diff --git a/drivers/event/cnxk/deq/cn10k/deq_176_191_ca_seg_burst.c b/drivers/event/cnxk/deq/cn10k/deq_176_191_ca_seg_burst.c new file mode 100644 index 0000000000..2bcd802e6a --- /dev/null +++ b/drivers/event/cnxk/deq/cn10k/deq_176_191_ca_seg_burst.c @@ -0,0 +1,14 @@ +/* SPDX-License-Identifier: BSD-3-Clause + * Copyright(C) 2021 Marvell. + */ + +#include "cn10k_worker.h" +#include "cnxk_eventdev.h" +#include "cnxk_worker.h" + +#define R(name, flags) \ + SSO_CMN_DEQ_BURST(cn10k_sso_hws_deq_ca_seg_burst_##name, \ + cn10k_sso_hws_deq_ca_seg_##name, flags) + +NIX_RX_FASTPATH_MODES_176_191 +#undef R diff --git a/drivers/event/cnxk/deq/cn10k/deq_176_191_ca_tmo.c b/drivers/event/cnxk/deq/cn10k/deq_176_191_ca_tmo.c new file mode 100644 index 0000000000..63cbe16bff --- /dev/null +++ b/drivers/event/cnxk/deq/cn10k/deq_176_191_ca_tmo.c @@ -0,0 +1,12 @@ +/* SPDX-License-Identifier: BSD-3-Clause + * Copyright(C) 2021 Marvell. + */ + +#include "cn10k_worker.h" +#include "cnxk_eventdev.h" +#include "cnxk_worker.h" + +#define R(name, flags) SSO_DEQ_TMO_CA(cn10k_sso_hws_deq_tmo_ca_##name, flags) + +NIX_RX_FASTPATH_MODES_176_191 +#undef R diff --git a/drivers/event/cnxk/deq/cn10k/deq_176_191_ca_tmo_burst.c b/drivers/event/cnxk/deq/cn10k/deq_176_191_ca_tmo_burst.c new file mode 100644 index 0000000000..49400d80af --- /dev/null +++ b/drivers/event/cnxk/deq/cn10k/deq_176_191_ca_tmo_burst.c @@ -0,0 +1,14 @@ +/* SPDX-License-Identifier: BSD-3-Clause + * Copyright(C) 2021 Marvell. + */ + +#include "cn10k_worker.h" +#include "cnxk_eventdev.h" +#include "cnxk_worker.h" + +#define R(name, flags) \ + SSO_CMN_DEQ_BURST(cn10k_sso_hws_deq_tmo_ca_burst_##name, \ + cn10k_sso_hws_deq_tmo_ca_##name, flags) + +NIX_RX_FASTPATH_MODES_176_191 +#undef R diff --git a/drivers/event/cnxk/deq/cn10k/deq_176_191_ca_tmo_seg.c b/drivers/event/cnxk/deq/cn10k/deq_176_191_ca_tmo_seg.c new file mode 100644 index 0000000000..505864a280 --- /dev/null +++ b/drivers/event/cnxk/deq/cn10k/deq_176_191_ca_tmo_seg.c @@ -0,0 +1,13 @@ +/* SPDX-License-Identifier: BSD-3-Clause + * Copyright(C) 2021 Marvell. + */ + +#include "cn10k_worker.h" +#include "cnxk_eventdev.h" +#include "cnxk_worker.h" + +#define R(name, flags) \ + SSO_DEQ_TMO_CA_SEG(cn10k_sso_hws_deq_tmo_ca_seg_##name, flags) + +NIX_RX_FASTPATH_MODES_176_191 +#undef R diff --git a/drivers/event/cnxk/deq/cn10k/deq_176_191_ca_tmo_seg_burst.c b/drivers/event/cnxk/deq/cn10k/deq_176_191_ca_tmo_seg_burst.c new file mode 100644 index 0000000000..561f907815 --- /dev/null +++ b/drivers/event/cnxk/deq/cn10k/deq_176_191_ca_tmo_seg_burst.c @@ -0,0 +1,14 @@ +/* SPDX-License-Identifier: BSD-3-Clause + * Copyright(C) 2021 Marvell. + */ + +#include "cn10k_worker.h" +#include "cnxk_eventdev.h" +#include "cnxk_worker.h" + +#define R(name, flags) \ + SSO_CMN_DEQ_BURST(cn10k_sso_hws_deq_tmo_ca_seg_burst_##name, \ + cn10k_sso_hws_deq_tmo_ca_seg_##name, flags) + +NIX_RX_FASTPATH_MODES_176_191 +#undef R diff --git a/drivers/event/cnxk/deq/cn10k/deq_176_191_dual.c b/drivers/event/cnxk/deq/cn10k/deq_176_191_dual.c new file mode 100644 index 0000000000..539b19dacb --- /dev/null +++ b/drivers/event/cnxk/deq/cn10k/deq_176_191_dual.c @@ -0,0 +1,12 @@ +/* SPDX-License-Identifier: BSD-3-Clause + * Copyright(C) 2021 Marvell. + */ + +#include "cn10k_worker.h" +#include "cnxk_eventdev.h" +#include "cnxk_worker.h" + +#define R(name, flags) SSO_DUAL_DEQ(cn10k_sso_hws_dual_deq_##name, flags) + +NIX_RX_FASTPATH_MODES_176_191 +#undef R diff --git a/drivers/event/cnxk/deq/cn10k/deq_176_191_seg.c b/drivers/event/cnxk/deq/cn10k/deq_176_191_seg.c new file mode 100644 index 0000000000..b0d134d4df --- /dev/null +++ b/drivers/event/cnxk/deq/cn10k/deq_176_191_seg.c @@ -0,0 +1,12 @@ +/* SPDX-License-Identifier: BSD-3-Clause + * Copyright(C) 2021 Marvell. + */ + +#include "cn10k_worker.h" +#include "cnxk_eventdev.h" +#include "cnxk_worker.h" + +#define R(name, flags) SSO_DEQ_SEG(cn10k_sso_hws_deq_seg_##name, flags) + +NIX_RX_FASTPATH_MODES_176_191 +#undef R diff --git a/drivers/event/cnxk/deq/cn10k/deq_176_191_seg_burst.c b/drivers/event/cnxk/deq/cn10k/deq_176_191_seg_burst.c new file mode 100644 index 0000000000..1e346a0772 --- /dev/null +++ b/drivers/event/cnxk/deq/cn10k/deq_176_191_seg_burst.c @@ -0,0 +1,14 @@ +/* SPDX-License-Identifier: BSD-3-Clause + * Copyright(C) 2021 Marvell. + */ + +#include "cn10k_worker.h" +#include "cnxk_eventdev.h" +#include "cnxk_worker.h" + +#define R(name, flags) \ + SSO_CMN_DEQ_SEG_BURST(cn10k_sso_hws_deq_seg_burst_##name, \ + cn10k_sso_hws_deq_seg_##name, flags) + +NIX_RX_FASTPATH_MODES_176_191 +#undef R diff --git a/drivers/event/cnxk/deq/cn10k/deq_176_191_tmo.c b/drivers/event/cnxk/deq/cn10k/deq_176_191_tmo.c new file mode 100644 index 0000000000..38d1fbbefe --- /dev/null +++ b/drivers/event/cnxk/deq/cn10k/deq_176_191_tmo.c @@ -0,0 +1,12 @@ +/* SPDX-License-Identifier: BSD-3-Clause + * Copyright(C) 2021 Marvell. + */ + +#include "cn10k_worker.h" +#include "cnxk_eventdev.h" +#include "cnxk_worker.h" + +#define R(name, flags) SSO_DEQ_TMO(cn10k_sso_hws_deq_tmo_##name, flags) + +NIX_RX_FASTPATH_MODES_176_191 +#undef R diff --git a/drivers/event/cnxk/deq/cn10k/deq_176_191_tmo_burst.c b/drivers/event/cnxk/deq/cn10k/deq_176_191_tmo_burst.c new file mode 100644 index 0000000000..b53bc86377 --- /dev/null +++ b/drivers/event/cnxk/deq/cn10k/deq_176_191_tmo_burst.c @@ -0,0 +1,14 @@ +/* SPDX-License-Identifier: BSD-3-Clause + * Copyright(C) 2021 Marvell. + */ + +#include "cn10k_worker.h" +#include "cnxk_eventdev.h" +#include "cnxk_worker.h" + +#define R(name, flags) \ + SSO_CMN_DEQ_BURST(cn10k_sso_hws_deq_tmo_burst_##name, \ + cn10k_sso_hws_deq_tmo_##name, flags) + +NIX_RX_FASTPATH_MODES_176_191 +#undef R diff --git a/drivers/event/cnxk/deq/cn10k/deq_176_191_tmo_seg.c b/drivers/event/cnxk/deq/cn10k/deq_176_191_tmo_seg.c new file mode 100644 index 0000000000..5f2eaaad46 --- /dev/null +++ b/drivers/event/cnxk/deq/cn10k/deq_176_191_tmo_seg.c @@ -0,0 +1,12 @@ +/* SPDX-License-Identifier: BSD-3-Clause + * Copyright(C) 2021 Marvell. + */ + +#include "cn10k_worker.h" +#include "cnxk_eventdev.h" +#include "cnxk_worker.h" + +#define R(name, flags) SSO_DEQ_TMO_SEG(cn10k_sso_hws_deq_tmo_seg_##name, flags) + +NIX_RX_FASTPATH_MODES_176_191 +#undef R diff --git a/drivers/event/cnxk/deq/cn10k/deq_176_191_tmo_seg_burst.c b/drivers/event/cnxk/deq/cn10k/deq_176_191_tmo_seg_burst.c new file mode 100644 index 0000000000..5eb9e2bf0e --- /dev/null +++ b/drivers/event/cnxk/deq/cn10k/deq_176_191_tmo_seg_burst.c @@ -0,0 +1,14 @@ +/* SPDX-License-Identifier: BSD-3-Clause + * Copyright(C) 2021 Marvell. + */ + +#include "cn10k_worker.h" +#include "cnxk_eventdev.h" +#include "cnxk_worker.h" + +#define R(name, flags) \ + SSO_CMN_DEQ_BURST(cn10k_sso_hws_deq_tmo_seg_burst_##name, \ + cn10k_sso_hws_deq_tmo_seg_##name, flags) + +NIX_RX_FASTPATH_MODES_176_191 +#undef R diff --git a/drivers/event/cnxk/deq/cn10k/deq_192_207.c b/drivers/event/cnxk/deq/cn10k/deq_192_207.c new file mode 100644 index 0000000000..6f53dbce2a --- /dev/null +++ b/drivers/event/cnxk/deq/cn10k/deq_192_207.c @@ -0,0 +1,12 @@ +/* SPDX-License-Identifier: BSD-3-Clause + * Copyright(C) 2021 Marvell. + */ + +#include "cn10k_worker.h" +#include "cnxk_eventdev.h" +#include "cnxk_worker.h" + +#define R(name, flags) SSO_DEQ(cn10k_sso_hws_deq_##name, flags) + +NIX_RX_FASTPATH_MODES_192_207 +#undef R diff --git a/drivers/event/cnxk/deq/cn10k/deq_192_207_burst.c b/drivers/event/cnxk/deq/cn10k/deq_192_207_burst.c new file mode 100644 index 0000000000..f9789efbb2 --- /dev/null +++ b/drivers/event/cnxk/deq/cn10k/deq_192_207_burst.c @@ -0,0 +1,14 @@ +/* SPDX-License-Identifier: BSD-3-Clause + * Copyright(C) 2021 Marvell. + */ + +#include "cn10k_worker.h" +#include "cnxk_eventdev.h" +#include "cnxk_worker.h" + +#define R(name, flags) \ + SSO_CMN_DEQ_BURST(cn10k_sso_hws_deq_burst_##name, \ + cn10k_sso_hws_deq_##name, flags) + +NIX_RX_FASTPATH_MODES_192_207 +#undef R diff --git a/drivers/event/cnxk/deq/cn10k/deq_192_207_ca.c b/drivers/event/cnxk/deq/cn10k/deq_192_207_ca.c new file mode 100644 index 0000000000..56ed0cae38 --- /dev/null +++ b/drivers/event/cnxk/deq/cn10k/deq_192_207_ca.c @@ -0,0 +1,12 @@ +/* SPDX-License-Identifier: BSD-3-Clause + * Copyright(C) 2021 Marvell. + */ + +#include "cn10k_worker.h" +#include "cnxk_eventdev.h" +#include "cnxk_worker.h" + +#define R(name, flags) SSO_DEQ_CA(cn10k_sso_hws_deq_ca_##name, flags) + +NIX_RX_FASTPATH_MODES_192_207 +#undef R diff --git a/drivers/event/cnxk/deq/cn10k/deq_192_207_ca_burst.c b/drivers/event/cnxk/deq/cn10k/deq_192_207_ca_burst.c new file mode 100644 index 0000000000..70ed05e6e9 --- /dev/null +++ b/drivers/event/cnxk/deq/cn10k/deq_192_207_ca_burst.c @@ -0,0 +1,14 @@ +/* SPDX-License-Identifier: BSD-3-Clause + * Copyright(C) 2021 Marvell. + */ + +#include "cn10k_worker.h" +#include "cnxk_eventdev.h" +#include "cnxk_worker.h" + +#define R(name, flags) \ + SSO_CMN_DEQ_BURST(cn10k_sso_hws_deq_ca_burst_##name, \ + cn10k_sso_hws_deq_ca_##name, flags) + +NIX_RX_FASTPATH_MODES_192_207 +#undef R diff --git a/drivers/event/cnxk/deq/cn10k/deq_192_207_ca_seg.c b/drivers/event/cnxk/deq/cn10k/deq_192_207_ca_seg.c new file mode 100644 index 0000000000..806b9e4ef0 --- /dev/null +++ b/drivers/event/cnxk/deq/cn10k/deq_192_207_ca_seg.c @@ -0,0 +1,12 @@ +/* SPDX-License-Identifier: BSD-3-Clause + * Copyright(C) 2021 Marvell. + */ + +#include "cn10k_worker.h" +#include "cnxk_eventdev.h" +#include "cnxk_worker.h" + +#define R(name, flags) SSO_DEQ_CA_SEG(cn10k_sso_hws_deq_ca_seg_##name, flags) + +NIX_RX_FASTPATH_MODES_192_207 +#undef R diff --git a/drivers/event/cnxk/deq/cn10k/deq_192_207_ca_seg_burst.c b/drivers/event/cnxk/deq/cn10k/deq_192_207_ca_seg_burst.c new file mode 100644 index 0000000000..93360814e1 --- /dev/null +++ b/drivers/event/cnxk/deq/cn10k/deq_192_207_ca_seg_burst.c @@ -0,0 +1,14 @@ +/* SPDX-License-Identifier: BSD-3-Clause + * Copyright(C) 2021 Marvell. + */ + +#include "cn10k_worker.h" +#include "cnxk_eventdev.h" +#include "cnxk_worker.h" + +#define R(name, flags) \ + SSO_CMN_DEQ_BURST(cn10k_sso_hws_deq_ca_seg_burst_##name, \ + cn10k_sso_hws_deq_ca_seg_##name, flags) + +NIX_RX_FASTPATH_MODES_192_207 +#undef R diff --git a/drivers/event/cnxk/deq/cn10k/deq_192_207_ca_tmo.c b/drivers/event/cnxk/deq/cn10k/deq_192_207_ca_tmo.c new file mode 100644 index 0000000000..43c735d123 --- /dev/null +++ b/drivers/event/cnxk/deq/cn10k/deq_192_207_ca_tmo.c @@ -0,0 +1,12 @@ +/* SPDX-License-Identifier: BSD-3-Clause + * Copyright(C) 2021 Marvell. + */ + +#include "cn10k_worker.h" +#include "cnxk_eventdev.h" +#include "cnxk_worker.h" + +#define R(name, flags) SSO_DEQ_TMO_CA(cn10k_sso_hws_deq_tmo_ca_##name, flags) + +NIX_RX_FASTPATH_MODES_192_207 +#undef R diff --git a/drivers/event/cnxk/deq/cn10k/deq_192_207_ca_tmo_burst.c b/drivers/event/cnxk/deq/cn10k/deq_192_207_ca_tmo_burst.c new file mode 100644 index 0000000000..5f7da5500d --- /dev/null +++ b/drivers/event/cnxk/deq/cn10k/deq_192_207_ca_tmo_burst.c @@ -0,0 +1,14 @@ +/* SPDX-License-Identifier: BSD-3-Clause + * Copyright(C) 2021 Marvell. + */ + +#include "cn10k_worker.h" +#include "cnxk_eventdev.h" +#include "cnxk_worker.h" + +#define R(name, flags) \ + SSO_CMN_DEQ_BURST(cn10k_sso_hws_deq_tmo_ca_burst_##name, \ + cn10k_sso_hws_deq_tmo_ca_##name, flags) + +NIX_RX_FASTPATH_MODES_192_207 +#undef R diff --git a/drivers/event/cnxk/deq/cn10k/deq_192_207_ca_tmo_seg.c b/drivers/event/cnxk/deq/cn10k/deq_192_207_ca_tmo_seg.c new file mode 100644 index 0000000000..4c6126f13a --- /dev/null +++ b/drivers/event/cnxk/deq/cn10k/deq_192_207_ca_tmo_seg.c @@ -0,0 +1,13 @@ +/* SPDX-License-Identifier: BSD-3-Clause + * Copyright(C) 2021 Marvell. + */ + +#include "cn10k_worker.h" +#include "cnxk_eventdev.h" +#include "cnxk_worker.h" + +#define R(name, flags) \ + SSO_DEQ_TMO_CA_SEG(cn10k_sso_hws_deq_tmo_ca_seg_##name, flags) + +NIX_RX_FASTPATH_MODES_192_207 +#undef R diff --git a/drivers/event/cnxk/deq/cn10k/deq_192_207_ca_tmo_seg_burst.c b/drivers/event/cnxk/deq/cn10k/deq_192_207_ca_tmo_seg_burst.c new file mode 100644 index 0000000000..81ae021b51 --- /dev/null +++ b/drivers/event/cnxk/deq/cn10k/deq_192_207_ca_tmo_seg_burst.c @@ -0,0 +1,14 @@ +/* SPDX-License-Identifier: BSD-3-Clause + * Copyright(C) 2021 Marvell. + */ + +#include "cn10k_worker.h" +#include "cnxk_eventdev.h" +#include "cnxk_worker.h" + +#define R(name, flags) \ + SSO_CMN_DEQ_BURST(cn10k_sso_hws_deq_tmo_ca_seg_burst_##name, \ + cn10k_sso_hws_deq_tmo_ca_seg_##name, flags) + +NIX_RX_FASTPATH_MODES_192_207 +#undef R diff --git a/drivers/event/cnxk/deq/cn10k/deq_192_207_dual.c b/drivers/event/cnxk/deq/cn10k/deq_192_207_dual.c new file mode 100644 index 0000000000..2adcdaf59c --- /dev/null +++ b/drivers/event/cnxk/deq/cn10k/deq_192_207_dual.c @@ -0,0 +1,12 @@ +/* SPDX-License-Identifier: BSD-3-Clause + * Copyright(C) 2021 Marvell. + */ + +#include "cn10k_worker.h" +#include "cnxk_eventdev.h" +#include "cnxk_worker.h" + +#define R(name, flags) SSO_DUAL_DEQ(cn10k_sso_hws_dual_deq_##name, flags) + +NIX_RX_FASTPATH_MODES_192_207 +#undef R diff --git a/drivers/event/cnxk/deq/cn10k/deq_192_207_seg.c b/drivers/event/cnxk/deq/cn10k/deq_192_207_seg.c new file mode 100644 index 0000000000..5d59f7fe23 --- /dev/null +++ b/drivers/event/cnxk/deq/cn10k/deq_192_207_seg.c @@ -0,0 +1,12 @@ +/* SPDX-License-Identifier: BSD-3-Clause + * Copyright(C) 2021 Marvell. + */ + +#include "cn10k_worker.h" +#include "cnxk_eventdev.h" +#include "cnxk_worker.h" + +#define R(name, flags) SSO_DEQ_SEG(cn10k_sso_hws_deq_seg_##name, flags) + +NIX_RX_FASTPATH_MODES_192_207 +#undef R diff --git a/drivers/event/cnxk/deq/cn10k/deq_192_207_seg_burst.c b/drivers/event/cnxk/deq/cn10k/deq_192_207_seg_burst.c new file mode 100644 index 0000000000..ddebe2aa40 --- /dev/null +++ b/drivers/event/cnxk/deq/cn10k/deq_192_207_seg_burst.c @@ -0,0 +1,14 @@ +/* SPDX-License-Identifier: BSD-3-Clause + * Copyright(C) 2021 Marvell. + */ + +#include "cn10k_worker.h" +#include "cnxk_eventdev.h" +#include "cnxk_worker.h" + +#define R(name, flags) \ + SSO_CMN_DEQ_SEG_BURST(cn10k_sso_hws_deq_seg_burst_##name, \ + cn10k_sso_hws_deq_seg_##name, flags) + +NIX_RX_FASTPATH_MODES_192_207 +#undef R diff --git a/drivers/event/cnxk/deq/cn10k/deq_192_207_tmo.c b/drivers/event/cnxk/deq/cn10k/deq_192_207_tmo.c new file mode 100644 index 0000000000..e1c5beb41d --- /dev/null +++ b/drivers/event/cnxk/deq/cn10k/deq_192_207_tmo.c @@ -0,0 +1,12 @@ +/* SPDX-License-Identifier: BSD-3-Clause + * Copyright(C) 2021 Marvell. + */ + +#include "cn10k_worker.h" +#include "cnxk_eventdev.h" +#include "cnxk_worker.h" + +#define R(name, flags) SSO_DEQ_TMO(cn10k_sso_hws_deq_tmo_##name, flags) + +NIX_RX_FASTPATH_MODES_192_207 +#undef R diff --git a/drivers/event/cnxk/deq/cn10k/deq_192_207_tmo_burst.c b/drivers/event/cnxk/deq/cn10k/deq_192_207_tmo_burst.c new file mode 100644 index 0000000000..5d733766ee --- /dev/null +++ b/drivers/event/cnxk/deq/cn10k/deq_192_207_tmo_burst.c @@ -0,0 +1,14 @@ +/* SPDX-License-Identifier: BSD-3-Clause + * Copyright(C) 2021 Marvell. + */ + +#include "cn10k_worker.h" +#include "cnxk_eventdev.h" +#include "cnxk_worker.h" + +#define R(name, flags) \ + SSO_CMN_DEQ_BURST(cn10k_sso_hws_deq_tmo_burst_##name, \ + cn10k_sso_hws_deq_tmo_##name, flags) + +NIX_RX_FASTPATH_MODES_192_207 +#undef R diff --git a/drivers/event/cnxk/deq/cn10k/deq_192_207_tmo_seg.c b/drivers/event/cnxk/deq/cn10k/deq_192_207_tmo_seg.c new file mode 100644 index 0000000000..12bff5902c --- /dev/null +++ b/drivers/event/cnxk/deq/cn10k/deq_192_207_tmo_seg.c @@ -0,0 +1,12 @@ +/* SPDX-License-Identifier: BSD-3-Clause + * Copyright(C) 2021 Marvell. + */ + +#include "cn10k_worker.h" +#include "cnxk_eventdev.h" +#include "cnxk_worker.h" + +#define R(name, flags) SSO_DEQ_TMO_SEG(cn10k_sso_hws_deq_tmo_seg_##name, flags) + +NIX_RX_FASTPATH_MODES_192_207 +#undef R diff --git a/drivers/event/cnxk/deq/cn10k/deq_192_207_tmo_seg_burst.c b/drivers/event/cnxk/deq/cn10k/deq_192_207_tmo_seg_burst.c new file mode 100644 index 0000000000..2d10cc6e68 --- /dev/null +++ b/drivers/event/cnxk/deq/cn10k/deq_192_207_tmo_seg_burst.c @@ -0,0 +1,14 @@ +/* SPDX-License-Identifier: BSD-3-Clause + * Copyright(C) 2021 Marvell. + */ + +#include "cn10k_worker.h" +#include "cnxk_eventdev.h" +#include "cnxk_worker.h" + +#define R(name, flags) \ + SSO_CMN_DEQ_BURST(cn10k_sso_hws_deq_tmo_seg_burst_##name, \ + cn10k_sso_hws_deq_tmo_seg_##name, flags) + +NIX_RX_FASTPATH_MODES_192_207 +#undef R diff --git a/drivers/event/cnxk/deq/cn10k/deq_208_223.c b/drivers/event/cnxk/deq/cn10k/deq_208_223.c new file mode 100644 index 0000000000..965a9405f0 --- /dev/null +++ b/drivers/event/cnxk/deq/cn10k/deq_208_223.c @@ -0,0 +1,12 @@ +/* SPDX-License-Identifier: BSD-3-Clause + * Copyright(C) 2021 Marvell. + */ + +#include "cn10k_worker.h" +#include "cnxk_eventdev.h" +#include "cnxk_worker.h" + +#define R(name, flags) SSO_DEQ(cn10k_sso_hws_deq_##name, flags) + +NIX_RX_FASTPATH_MODES_208_223 +#undef R diff --git a/drivers/event/cnxk/deq/cn10k/deq_208_223_burst.c b/drivers/event/cnxk/deq/cn10k/deq_208_223_burst.c new file mode 100644 index 0000000000..de9a048a0e --- /dev/null +++ b/drivers/event/cnxk/deq/cn10k/deq_208_223_burst.c @@ -0,0 +1,14 @@ +/* SPDX-License-Identifier: BSD-3-Clause + * Copyright(C) 2021 Marvell. + */ + +#include "cn10k_worker.h" +#include "cnxk_eventdev.h" +#include "cnxk_worker.h" + +#define R(name, flags) \ + SSO_CMN_DEQ_BURST(cn10k_sso_hws_deq_burst_##name, \ + cn10k_sso_hws_deq_##name, flags) + +NIX_RX_FASTPATH_MODES_208_223 +#undef R diff --git a/drivers/event/cnxk/deq/cn10k/deq_208_223_ca.c b/drivers/event/cnxk/deq/cn10k/deq_208_223_ca.c new file mode 100644 index 0000000000..f9148acef3 --- /dev/null +++ b/drivers/event/cnxk/deq/cn10k/deq_208_223_ca.c @@ -0,0 +1,12 @@ +/* SPDX-License-Identifier: BSD-3-Clause + * Copyright(C) 2021 Marvell. + */ + +#include "cn10k_worker.h" +#include "cnxk_eventdev.h" +#include "cnxk_worker.h" + +#define R(name, flags) SSO_DEQ_CA(cn10k_sso_hws_deq_ca_##name, flags) + +NIX_RX_FASTPATH_MODES_208_223 +#undef R diff --git a/drivers/event/cnxk/deq/cn10k/deq_208_223_ca_burst.c b/drivers/event/cnxk/deq/cn10k/deq_208_223_ca_burst.c new file mode 100644 index 0000000000..12a927a872 --- /dev/null +++ b/drivers/event/cnxk/deq/cn10k/deq_208_223_ca_burst.c @@ -0,0 +1,14 @@ +/* SPDX-License-Identifier: BSD-3-Clause + * Copyright(C) 2021 Marvell. + */ + +#include "cn10k_worker.h" +#include "cnxk_eventdev.h" +#include "cnxk_worker.h" + +#define R(name, flags) \ + SSO_CMN_DEQ_BURST(cn10k_sso_hws_deq_ca_burst_##name, \ + cn10k_sso_hws_deq_ca_##name, flags) + +NIX_RX_FASTPATH_MODES_208_223 +#undef R diff --git a/drivers/event/cnxk/deq/cn10k/deq_208_223_ca_seg.c b/drivers/event/cnxk/deq/cn10k/deq_208_223_ca_seg.c new file mode 100644 index 0000000000..1b020fbf98 --- /dev/null +++ b/drivers/event/cnxk/deq/cn10k/deq_208_223_ca_seg.c @@ -0,0 +1,12 @@ +/* SPDX-License-Identifier: BSD-3-Clause + * Copyright(C) 2021 Marvell. + */ + +#include "cn10k_worker.h" +#include "cnxk_eventdev.h" +#include "cnxk_worker.h" + +#define R(name, flags) SSO_DEQ_CA_SEG(cn10k_sso_hws_deq_ca_seg_##name, flags) + +NIX_RX_FASTPATH_MODES_208_223 +#undef R diff --git a/drivers/event/cnxk/deq/cn10k/deq_208_223_ca_seg_burst.c b/drivers/event/cnxk/deq/cn10k/deq_208_223_ca_seg_burst.c new file mode 100644 index 0000000000..2c826f2284 --- /dev/null +++ b/drivers/event/cnxk/deq/cn10k/deq_208_223_ca_seg_burst.c @@ -0,0 +1,14 @@ +/* SPDX-License-Identifier: BSD-3-Clause + * Copyright(C) 2021 Marvell. + */ + +#include "cn10k_worker.h" +#include "cnxk_eventdev.h" +#include "cnxk_worker.h" + +#define R(name, flags) \ + SSO_CMN_DEQ_BURST(cn10k_sso_hws_deq_ca_seg_burst_##name, \ + cn10k_sso_hws_deq_ca_seg_##name, flags) + +NIX_RX_FASTPATH_MODES_208_223 +#undef R diff --git a/drivers/event/cnxk/deq/cn10k/deq_208_223_ca_tmo.c b/drivers/event/cnxk/deq/cn10k/deq_208_223_ca_tmo.c new file mode 100644 index 0000000000..48c23b910d --- /dev/null +++ b/drivers/event/cnxk/deq/cn10k/deq_208_223_ca_tmo.c @@ -0,0 +1,12 @@ +/* SPDX-License-Identifier: BSD-3-Clause + * Copyright(C) 2021 Marvell. + */ + +#include "cn10k_worker.h" +#include "cnxk_eventdev.h" +#include "cnxk_worker.h" + +#define R(name, flags) SSO_DEQ_TMO_CA(cn10k_sso_hws_deq_tmo_ca_##name, flags) + +NIX_RX_FASTPATH_MODES_208_223 +#undef R diff --git a/drivers/event/cnxk/deq/cn10k/deq_208_223_ca_tmo_burst.c b/drivers/event/cnxk/deq/cn10k/deq_208_223_ca_tmo_burst.c new file mode 100644 index 0000000000..5381f1ce17 --- /dev/null +++ b/drivers/event/cnxk/deq/cn10k/deq_208_223_ca_tmo_burst.c @@ -0,0 +1,14 @@ +/* SPDX-License-Identifier: BSD-3-Clause + * Copyright(C) 2021 Marvell. + */ + +#include "cn10k_worker.h" +#include "cnxk_eventdev.h" +#include "cnxk_worker.h" + +#define R(name, flags) \ + SSO_CMN_DEQ_BURST(cn10k_sso_hws_deq_tmo_ca_burst_##name, \ + cn10k_sso_hws_deq_tmo_ca_##name, flags) + +NIX_RX_FASTPATH_MODES_208_223 +#undef R diff --git a/drivers/event/cnxk/deq/cn10k/deq_208_223_ca_tmo_seg.c b/drivers/event/cnxk/deq/cn10k/deq_208_223_ca_tmo_seg.c new file mode 100644 index 0000000000..116d9efc2d --- /dev/null +++ b/drivers/event/cnxk/deq/cn10k/deq_208_223_ca_tmo_seg.c @@ -0,0 +1,13 @@ +/* SPDX-License-Identifier: BSD-3-Clause + * Copyright(C) 2021 Marvell. + */ + +#include "cn10k_worker.h" +#include "cnxk_eventdev.h" +#include "cnxk_worker.h" + +#define R(name, flags) \ + SSO_DEQ_TMO_CA_SEG(cn10k_sso_hws_deq_tmo_ca_seg_##name, flags) + +NIX_RX_FASTPATH_MODES_208_223 +#undef R diff --git a/drivers/event/cnxk/deq/cn10k/deq_208_223_ca_tmo_seg_burst.c b/drivers/event/cnxk/deq/cn10k/deq_208_223_ca_tmo_seg_burst.c new file mode 100644 index 0000000000..86571c7027 --- /dev/null +++ b/drivers/event/cnxk/deq/cn10k/deq_208_223_ca_tmo_seg_burst.c @@ -0,0 +1,14 @@ +/* SPDX-License-Identifier: BSD-3-Clause + * Copyright(C) 2021 Marvell. + */ + +#include "cn10k_worker.h" +#include "cnxk_eventdev.h" +#include "cnxk_worker.h" + +#define R(name, flags) \ + SSO_CMN_DEQ_BURST(cn10k_sso_hws_deq_tmo_ca_seg_burst_##name, \ + cn10k_sso_hws_deq_tmo_ca_seg_##name, flags) + +NIX_RX_FASTPATH_MODES_208_223 +#undef R diff --git a/drivers/event/cnxk/deq/cn10k/deq_208_223_dual.c b/drivers/event/cnxk/deq/cn10k/deq_208_223_dual.c new file mode 100644 index 0000000000..0fb35b9c83 --- /dev/null +++ b/drivers/event/cnxk/deq/cn10k/deq_208_223_dual.c @@ -0,0 +1,12 @@ +/* SPDX-License-Identifier: BSD-3-Clause + * Copyright(C) 2021 Marvell. + */ + +#include "cn10k_worker.h" +#include "cnxk_eventdev.h" +#include "cnxk_worker.h" + +#define R(name, flags) SSO_DUAL_DEQ(cn10k_sso_hws_dual_deq_##name, flags) + +NIX_RX_FASTPATH_MODES_208_223 +#undef R diff --git a/drivers/event/cnxk/deq/cn10k/deq_208_223_seg.c b/drivers/event/cnxk/deq/cn10k/deq_208_223_seg.c new file mode 100644 index 0000000000..df48426ff1 --- /dev/null +++ b/drivers/event/cnxk/deq/cn10k/deq_208_223_seg.c @@ -0,0 +1,12 @@ +/* SPDX-License-Identifier: BSD-3-Clause + * Copyright(C) 2021 Marvell. + */ + +#include "cn10k_worker.h" +#include "cnxk_eventdev.h" +#include "cnxk_worker.h" + +#define R(name, flags) SSO_DEQ_SEG(cn10k_sso_hws_deq_seg_##name, flags) + +NIX_RX_FASTPATH_MODES_208_223 +#undef R diff --git a/drivers/event/cnxk/deq/cn10k/deq_208_223_seg_burst.c b/drivers/event/cnxk/deq/cn10k/deq_208_223_seg_burst.c new file mode 100644 index 0000000000..f1342e3232 --- /dev/null +++ b/drivers/event/cnxk/deq/cn10k/deq_208_223_seg_burst.c @@ -0,0 +1,14 @@ +/* SPDX-License-Identifier: BSD-3-Clause + * Copyright(C) 2021 Marvell. + */ + +#include "cn10k_worker.h" +#include "cnxk_eventdev.h" +#include "cnxk_worker.h" + +#define R(name, flags) \ + SSO_CMN_DEQ_SEG_BURST(cn10k_sso_hws_deq_seg_burst_##name, \ + cn10k_sso_hws_deq_seg_##name, flags) + +NIX_RX_FASTPATH_MODES_208_223 +#undef R diff --git a/drivers/event/cnxk/deq/cn10k/deq_208_223_tmo.c b/drivers/event/cnxk/deq/cn10k/deq_208_223_tmo.c new file mode 100644 index 0000000000..6f2d909806 --- /dev/null +++ b/drivers/event/cnxk/deq/cn10k/deq_208_223_tmo.c @@ -0,0 +1,12 @@ +/* SPDX-License-Identifier: BSD-3-Clause + * Copyright(C) 2021 Marvell. + */ + +#include "cn10k_worker.h" +#include "cnxk_eventdev.h" +#include "cnxk_worker.h" + +#define R(name, flags) SSO_DEQ_TMO(cn10k_sso_hws_deq_tmo_##name, flags) + +NIX_RX_FASTPATH_MODES_208_223 +#undef R diff --git a/drivers/event/cnxk/deq/cn10k/deq_208_223_tmo_burst.c b/drivers/event/cnxk/deq/cn10k/deq_208_223_tmo_burst.c new file mode 100644 index 0000000000..3c6f226c4b --- /dev/null +++ b/drivers/event/cnxk/deq/cn10k/deq_208_223_tmo_burst.c @@ -0,0 +1,14 @@ +/* SPDX-License-Identifier: BSD-3-Clause + * Copyright(C) 2021 Marvell. + */ + +#include "cn10k_worker.h" +#include "cnxk_eventdev.h" +#include "cnxk_worker.h" + +#define R(name, flags) \ + SSO_CMN_DEQ_BURST(cn10k_sso_hws_deq_tmo_burst_##name, \ + cn10k_sso_hws_deq_tmo_##name, flags) + +NIX_RX_FASTPATH_MODES_208_223 +#undef R diff --git a/drivers/event/cnxk/deq/cn10k/deq_208_223_tmo_seg.c b/drivers/event/cnxk/deq/cn10k/deq_208_223_tmo_seg.c new file mode 100644 index 0000000000..44a794233f --- /dev/null +++ b/drivers/event/cnxk/deq/cn10k/deq_208_223_tmo_seg.c @@ -0,0 +1,12 @@ +/* SPDX-License-Identifier: BSD-3-Clause + * Copyright(C) 2021 Marvell. + */ + +#include "cn10k_worker.h" +#include "cnxk_eventdev.h" +#include "cnxk_worker.h" + +#define R(name, flags) SSO_DEQ_TMO_SEG(cn10k_sso_hws_deq_tmo_seg_##name, flags) + +NIX_RX_FASTPATH_MODES_208_223 +#undef R diff --git a/drivers/event/cnxk/deq/cn10k/deq_208_223_tmo_seg_burst.c b/drivers/event/cnxk/deq/cn10k/deq_208_223_tmo_seg_burst.c new file mode 100644 index 0000000000..aa89930d3e --- /dev/null +++ b/drivers/event/cnxk/deq/cn10k/deq_208_223_tmo_seg_burst.c @@ -0,0 +1,14 @@ +/* SPDX-License-Identifier: BSD-3-Clause + * Copyright(C) 2021 Marvell. + */ + +#include "cn10k_worker.h" +#include "cnxk_eventdev.h" +#include "cnxk_worker.h" + +#define R(name, flags) \ + SSO_CMN_DEQ_BURST(cn10k_sso_hws_deq_tmo_seg_burst_##name, \ + cn10k_sso_hws_deq_tmo_seg_##name, flags) + +NIX_RX_FASTPATH_MODES_208_223 +#undef R diff --git a/drivers/event/cnxk/deq/cn10k/deq_224_239.c b/drivers/event/cnxk/deq/cn10k/deq_224_239.c new file mode 100644 index 0000000000..03f5bd3588 --- /dev/null +++ b/drivers/event/cnxk/deq/cn10k/deq_224_239.c @@ -0,0 +1,12 @@ +/* SPDX-License-Identifier: BSD-3-Clause + * Copyright(C) 2021 Marvell. + */ + +#include "cn10k_worker.h" +#include "cnxk_eventdev.h" +#include "cnxk_worker.h" + +#define R(name, flags) SSO_DEQ(cn10k_sso_hws_deq_##name, flags) + +NIX_RX_FASTPATH_MODES_224_239 +#undef R diff --git a/drivers/event/cnxk/deq/cn10k/deq_224_239_burst.c b/drivers/event/cnxk/deq/cn10k/deq_224_239_burst.c new file mode 100644 index 0000000000..091419eb9b --- /dev/null +++ b/drivers/event/cnxk/deq/cn10k/deq_224_239_burst.c @@ -0,0 +1,14 @@ +/* SPDX-License-Identifier: BSD-3-Clause + * Copyright(C) 2021 Marvell. + */ + +#include "cn10k_worker.h" +#include "cnxk_eventdev.h" +#include "cnxk_worker.h" + +#define R(name, flags) \ + SSO_CMN_DEQ_BURST(cn10k_sso_hws_deq_burst_##name, \ + cn10k_sso_hws_deq_##name, flags) + +NIX_RX_FASTPATH_MODES_224_239 +#undef R diff --git a/drivers/event/cnxk/deq/cn10k/deq_224_239_ca.c b/drivers/event/cnxk/deq/cn10k/deq_224_239_ca.c new file mode 100644 index 0000000000..8f4693e057 --- /dev/null +++ b/drivers/event/cnxk/deq/cn10k/deq_224_239_ca.c @@ -0,0 +1,12 @@ +/* SPDX-License-Identifier: BSD-3-Clause + * Copyright(C) 2021 Marvell. + */ + +#include "cn10k_worker.h" +#include "cnxk_eventdev.h" +#include "cnxk_worker.h" + +#define R(name, flags) SSO_DEQ_CA(cn10k_sso_hws_deq_ca_##name, flags) + +NIX_RX_FASTPATH_MODES_224_239 +#undef R diff --git a/drivers/event/cnxk/deq/cn10k/deq_224_239_ca_burst.c b/drivers/event/cnxk/deq/cn10k/deq_224_239_ca_burst.c new file mode 100644 index 0000000000..474c9b1eee --- /dev/null +++ b/drivers/event/cnxk/deq/cn10k/deq_224_239_ca_burst.c @@ -0,0 +1,14 @@ +/* SPDX-License-Identifier: BSD-3-Clause + * Copyright(C) 2021 Marvell. + */ + +#include "cn10k_worker.h" +#include "cnxk_eventdev.h" +#include "cnxk_worker.h" + +#define R(name, flags) \ + SSO_CMN_DEQ_BURST(cn10k_sso_hws_deq_ca_burst_##name, \ + cn10k_sso_hws_deq_ca_##name, flags) + +NIX_RX_FASTPATH_MODES_224_239 +#undef R diff --git a/drivers/event/cnxk/deq/cn10k/deq_224_239_ca_seg.c b/drivers/event/cnxk/deq/cn10k/deq_224_239_ca_seg.c new file mode 100644 index 0000000000..478df24934 --- /dev/null +++ b/drivers/event/cnxk/deq/cn10k/deq_224_239_ca_seg.c @@ -0,0 +1,12 @@ +/* SPDX-License-Identifier: BSD-3-Clause + * Copyright(C) 2021 Marvell. + */ + +#include "cn10k_worker.h" +#include "cnxk_eventdev.h" +#include "cnxk_worker.h" + +#define R(name, flags) SSO_DEQ_CA_SEG(cn10k_sso_hws_deq_ca_seg_##name, flags) + +NIX_RX_FASTPATH_MODES_224_239 +#undef R diff --git a/drivers/event/cnxk/deq/cn10k/deq_224_239_ca_seg_burst.c b/drivers/event/cnxk/deq/cn10k/deq_224_239_ca_seg_burst.c new file mode 100644 index 0000000000..3b78a0f91e --- /dev/null +++ b/drivers/event/cnxk/deq/cn10k/deq_224_239_ca_seg_burst.c @@ -0,0 +1,14 @@ +/* SPDX-License-Identifier: BSD-3-Clause + * Copyright(C) 2021 Marvell. + */ + +#include "cn10k_worker.h" +#include "cnxk_eventdev.h" +#include "cnxk_worker.h" + +#define R(name, flags) \ + SSO_CMN_DEQ_BURST(cn10k_sso_hws_deq_ca_seg_burst_##name, \ + cn10k_sso_hws_deq_ca_seg_##name, flags) + +NIX_RX_FASTPATH_MODES_224_239 +#undef R diff --git a/drivers/event/cnxk/deq/cn10k/deq_224_239_ca_tmo.c b/drivers/event/cnxk/deq/cn10k/deq_224_239_ca_tmo.c new file mode 100644 index 0000000000..366ae27814 --- /dev/null +++ b/drivers/event/cnxk/deq/cn10k/deq_224_239_ca_tmo.c @@ -0,0 +1,12 @@ +/* SPDX-License-Identifier: BSD-3-Clause + * Copyright(C) 2021 Marvell. + */ + +#include "cn10k_worker.h" +#include "cnxk_eventdev.h" +#include "cnxk_worker.h" + +#define R(name, flags) SSO_DEQ_TMO_CA(cn10k_sso_hws_deq_tmo_ca_##name, flags) + +NIX_RX_FASTPATH_MODES_224_239 +#undef R diff --git a/drivers/event/cnxk/deq/cn10k/deq_224_239_ca_tmo_burst.c b/drivers/event/cnxk/deq/cn10k/deq_224_239_ca_tmo_burst.c new file mode 100644 index 0000000000..db0751fece --- /dev/null +++ b/drivers/event/cnxk/deq/cn10k/deq_224_239_ca_tmo_burst.c @@ -0,0 +1,14 @@ +/* SPDX-License-Identifier: BSD-3-Clause + * Copyright(C) 2021 Marvell. + */ + +#include "cn10k_worker.h" +#include "cnxk_eventdev.h" +#include "cnxk_worker.h" + +#define R(name, flags) \ + SSO_CMN_DEQ_BURST(cn10k_sso_hws_deq_tmo_ca_burst_##name, \ + cn10k_sso_hws_deq_tmo_ca_##name, flags) + +NIX_RX_FASTPATH_MODES_224_239 +#undef R diff --git a/drivers/event/cnxk/deq/cn10k/deq_224_239_ca_tmo_seg.c b/drivers/event/cnxk/deq/cn10k/deq_224_239_ca_tmo_seg.c new file mode 100644 index 0000000000..6dc3d2f870 --- /dev/null +++ b/drivers/event/cnxk/deq/cn10k/deq_224_239_ca_tmo_seg.c @@ -0,0 +1,13 @@ +/* SPDX-License-Identifier: BSD-3-Clause + * Copyright(C) 2021 Marvell. + */ + +#include "cn10k_worker.h" +#include "cnxk_eventdev.h" +#include "cnxk_worker.h" + +#define R(name, flags) \ + SSO_DEQ_TMO_CA_SEG(cn10k_sso_hws_deq_tmo_ca_seg_##name, flags) + +NIX_RX_FASTPATH_MODES_224_239 +#undef R diff --git a/drivers/event/cnxk/deq/cn10k/deq_224_239_ca_tmo_seg_burst.c b/drivers/event/cnxk/deq/cn10k/deq_224_239_ca_tmo_seg_burst.c new file mode 100644 index 0000000000..11b1784868 --- /dev/null +++ b/drivers/event/cnxk/deq/cn10k/deq_224_239_ca_tmo_seg_burst.c @@ -0,0 +1,14 @@ +/* SPDX-License-Identifier: BSD-3-Clause + * Copyright(C) 2021 Marvell. + */ + +#include "cn10k_worker.h" +#include "cnxk_eventdev.h" +#include "cnxk_worker.h" + +#define R(name, flags) \ + SSO_CMN_DEQ_BURST(cn10k_sso_hws_deq_tmo_ca_seg_burst_##name, \ + cn10k_sso_hws_deq_tmo_ca_seg_##name, flags) + +NIX_RX_FASTPATH_MODES_224_239 +#undef R diff --git a/drivers/event/cnxk/deq/cn10k/deq_224_239_dual.c b/drivers/event/cnxk/deq/cn10k/deq_224_239_dual.c new file mode 100644 index 0000000000..35429014da --- /dev/null +++ b/drivers/event/cnxk/deq/cn10k/deq_224_239_dual.c @@ -0,0 +1,12 @@ +/* SPDX-License-Identifier: BSD-3-Clause + * Copyright(C) 2021 Marvell. + */ + +#include "cn10k_worker.h" +#include "cnxk_eventdev.h" +#include "cnxk_worker.h" + +#define R(name, flags) SSO_DUAL_DEQ(cn10k_sso_hws_dual_deq_##name, flags) + +NIX_RX_FASTPATH_MODES_224_239 +#undef R diff --git a/drivers/event/cnxk/deq/cn10k/deq_224_239_seg.c b/drivers/event/cnxk/deq/cn10k/deq_224_239_seg.c new file mode 100644 index 0000000000..19b5d2eedd --- /dev/null +++ b/drivers/event/cnxk/deq/cn10k/deq_224_239_seg.c @@ -0,0 +1,12 @@ +/* SPDX-License-Identifier: BSD-3-Clause + * Copyright(C) 2021 Marvell. + */ + +#include "cn10k_worker.h" +#include "cnxk_eventdev.h" +#include "cnxk_worker.h" + +#define R(name, flags) SSO_DEQ_SEG(cn10k_sso_hws_deq_seg_##name, flags) + +NIX_RX_FASTPATH_MODES_224_239 +#undef R diff --git a/drivers/event/cnxk/deq/cn10k/deq_224_239_seg_burst.c b/drivers/event/cnxk/deq/cn10k/deq_224_239_seg_burst.c new file mode 100644 index 0000000000..fe8f8099b0 --- /dev/null +++ b/drivers/event/cnxk/deq/cn10k/deq_224_239_seg_burst.c @@ -0,0 +1,14 @@ +/* SPDX-License-Identifier: BSD-3-Clause + * Copyright(C) 2021 Marvell. + */ + +#include "cn10k_worker.h" +#include "cnxk_eventdev.h" +#include "cnxk_worker.h" + +#define R(name, flags) \ + SSO_CMN_DEQ_SEG_BURST(cn10k_sso_hws_deq_seg_burst_##name, \ + cn10k_sso_hws_deq_seg_##name, flags) + +NIX_RX_FASTPATH_MODES_224_239 +#undef R diff --git a/drivers/event/cnxk/deq/cn10k/deq_224_239_tmo.c b/drivers/event/cnxk/deq/cn10k/deq_224_239_tmo.c new file mode 100644 index 0000000000..4f196ddaaf --- /dev/null +++ b/drivers/event/cnxk/deq/cn10k/deq_224_239_tmo.c @@ -0,0 +1,12 @@ +/* SPDX-License-Identifier: BSD-3-Clause + * Copyright(C) 2021 Marvell. + */ + +#include "cn10k_worker.h" +#include "cnxk_eventdev.h" +#include "cnxk_worker.h" + +#define R(name, flags) SSO_DEQ_TMO(cn10k_sso_hws_deq_tmo_##name, flags) + +NIX_RX_FASTPATH_MODES_224_239 +#undef R diff --git a/drivers/event/cnxk/deq/cn10k/deq_224_239_tmo_burst.c b/drivers/event/cnxk/deq/cn10k/deq_224_239_tmo_burst.c new file mode 100644 index 0000000000..252cf4f44d --- /dev/null +++ b/drivers/event/cnxk/deq/cn10k/deq_224_239_tmo_burst.c @@ -0,0 +1,14 @@ +/* SPDX-License-Identifier: BSD-3-Clause + * Copyright(C) 2021 Marvell. + */ + +#include "cn10k_worker.h" +#include "cnxk_eventdev.h" +#include "cnxk_worker.h" + +#define R(name, flags) \ + SSO_CMN_DEQ_BURST(cn10k_sso_hws_deq_tmo_burst_##name, \ + cn10k_sso_hws_deq_tmo_##name, flags) + +NIX_RX_FASTPATH_MODES_224_239 +#undef R diff --git a/drivers/event/cnxk/deq/cn10k/deq_224_239_tmo_seg.c b/drivers/event/cnxk/deq/cn10k/deq_224_239_tmo_seg.c new file mode 100644 index 0000000000..675149ec3a --- /dev/null +++ b/drivers/event/cnxk/deq/cn10k/deq_224_239_tmo_seg.c @@ -0,0 +1,12 @@ +/* SPDX-License-Identifier: BSD-3-Clause + * Copyright(C) 2021 Marvell. + */ + +#include "cn10k_worker.h" +#include "cnxk_eventdev.h" +#include "cnxk_worker.h" + +#define R(name, flags) SSO_DEQ_TMO_SEG(cn10k_sso_hws_deq_tmo_seg_##name, flags) + +NIX_RX_FASTPATH_MODES_224_239 +#undef R diff --git a/drivers/event/cnxk/deq/cn10k/deq_224_239_tmo_seg_burst.c b/drivers/event/cnxk/deq/cn10k/deq_224_239_tmo_seg_burst.c new file mode 100644 index 0000000000..9347485e05 --- /dev/null +++ b/drivers/event/cnxk/deq/cn10k/deq_224_239_tmo_seg_burst.c @@ -0,0 +1,14 @@ +/* SPDX-License-Identifier: BSD-3-Clause + * Copyright(C) 2021 Marvell. + */ + +#include "cn10k_worker.h" +#include "cnxk_eventdev.h" +#include "cnxk_worker.h" + +#define R(name, flags) \ + SSO_CMN_DEQ_BURST(cn10k_sso_hws_deq_tmo_seg_burst_##name, \ + cn10k_sso_hws_deq_tmo_seg_##name, flags) + +NIX_RX_FASTPATH_MODES_224_239 +#undef R diff --git a/drivers/event/cnxk/deq/cn10k/deq_240_255.c b/drivers/event/cnxk/deq/cn10k/deq_240_255.c new file mode 100644 index 0000000000..7890137548 --- /dev/null +++ b/drivers/event/cnxk/deq/cn10k/deq_240_255.c @@ -0,0 +1,12 @@ +/* SPDX-License-Identifier: BSD-3-Clause + * Copyright(C) 2021 Marvell. + */ + +#include "cn10k_worker.h" +#include "cnxk_eventdev.h" +#include "cnxk_worker.h" + +#define R(name, flags) SSO_DEQ(cn10k_sso_hws_deq_##name, flags) + +NIX_RX_FASTPATH_MODES_240_255 +#undef R diff --git a/drivers/event/cnxk/deq/cn10k/deq_240_255_burst.c b/drivers/event/cnxk/deq/cn10k/deq_240_255_burst.c new file mode 100644 index 0000000000..b1241915c8 --- /dev/null +++ b/drivers/event/cnxk/deq/cn10k/deq_240_255_burst.c @@ -0,0 +1,14 @@ +/* SPDX-License-Identifier: BSD-3-Clause + * Copyright(C) 2021 Marvell. + */ + +#include "cn10k_worker.h" +#include "cnxk_eventdev.h" +#include "cnxk_worker.h" + +#define R(name, flags) \ + SSO_CMN_DEQ_BURST(cn10k_sso_hws_deq_burst_##name, \ + cn10k_sso_hws_deq_##name, flags) + +NIX_RX_FASTPATH_MODES_240_255 +#undef R diff --git a/drivers/event/cnxk/deq/cn10k/deq_240_255_ca.c b/drivers/event/cnxk/deq/cn10k/deq_240_255_ca.c new file mode 100644 index 0000000000..1f9abae4bc --- /dev/null +++ b/drivers/event/cnxk/deq/cn10k/deq_240_255_ca.c @@ -0,0 +1,12 @@ +/* SPDX-License-Identifier: BSD-3-Clause + * Copyright(C) 2021 Marvell. + */ + +#include "cn10k_worker.h" +#include "cnxk_eventdev.h" +#include "cnxk_worker.h" + +#define R(name, flags) SSO_DEQ_CA(cn10k_sso_hws_deq_ca_##name, flags) + +NIX_RX_FASTPATH_MODES_240_255 +#undef R diff --git a/drivers/event/cnxk/deq/cn10k/deq_240_255_ca_burst.c b/drivers/event/cnxk/deq/cn10k/deq_240_255_ca_burst.c new file mode 100644 index 0000000000..a518f5e285 --- /dev/null +++ b/drivers/event/cnxk/deq/cn10k/deq_240_255_ca_burst.c @@ -0,0 +1,14 @@ +/* SPDX-License-Identifier: BSD-3-Clause + * Copyright(C) 2021 Marvell. + */ + +#include "cn10k_worker.h" +#include "cnxk_eventdev.h" +#include "cnxk_worker.h" + +#define R(name, flags) \ + SSO_CMN_DEQ_BURST(cn10k_sso_hws_deq_ca_burst_##name, \ + cn10k_sso_hws_deq_ca_##name, flags) + +NIX_RX_FASTPATH_MODES_240_255 +#undef R diff --git a/drivers/event/cnxk/deq/cn10k/deq_240_255_ca_seg.c b/drivers/event/cnxk/deq/cn10k/deq_240_255_ca_seg.c new file mode 100644 index 0000000000..f6408fbdd3 --- /dev/null +++ b/drivers/event/cnxk/deq/cn10k/deq_240_255_ca_seg.c @@ -0,0 +1,12 @@ +/* SPDX-License-Identifier: BSD-3-Clause + * Copyright(C) 2021 Marvell. + */ + +#include "cn10k_worker.h" +#include "cnxk_eventdev.h" +#include "cnxk_worker.h" + +#define R(name, flags) SSO_DEQ_CA_SEG(cn10k_sso_hws_deq_ca_seg_##name, flags) + +NIX_RX_FASTPATH_MODES_240_255 +#undef R diff --git a/drivers/event/cnxk/deq/cn10k/deq_240_255_ca_seg_burst.c b/drivers/event/cnxk/deq/cn10k/deq_240_255_ca_seg_burst.c new file mode 100644 index 0000000000..76bfa4ac08 --- /dev/null +++ b/drivers/event/cnxk/deq/cn10k/deq_240_255_ca_seg_burst.c @@ -0,0 +1,14 @@ +/* SPDX-License-Identifier: BSD-3-Clause + * Copyright(C) 2021 Marvell. + */ + +#include "cn10k_worker.h" +#include "cnxk_eventdev.h" +#include "cnxk_worker.h" + +#define R(name, flags) \ + SSO_CMN_DEQ_BURST(cn10k_sso_hws_deq_ca_seg_burst_##name, \ + cn10k_sso_hws_deq_ca_seg_##name, flags) + +NIX_RX_FASTPATH_MODES_240_255 +#undef R diff --git a/drivers/event/cnxk/deq/cn10k/deq_240_255_ca_tmo.c b/drivers/event/cnxk/deq/cn10k/deq_240_255_ca_tmo.c new file mode 100644 index 0000000000..f28b909b66 --- /dev/null +++ b/drivers/event/cnxk/deq/cn10k/deq_240_255_ca_tmo.c @@ -0,0 +1,12 @@ +/* SPDX-License-Identifier: BSD-3-Clause + * Copyright(C) 2021 Marvell. + */ + +#include "cn10k_worker.h" +#include "cnxk_eventdev.h" +#include "cnxk_worker.h" + +#define R(name, flags) SSO_DEQ_TMO_CA(cn10k_sso_hws_deq_tmo_ca_##name, flags) + +NIX_RX_FASTPATH_MODES_240_255 +#undef R diff --git a/drivers/event/cnxk/deq/cn10k/deq_240_255_ca_tmo_burst.c b/drivers/event/cnxk/deq/cn10k/deq_240_255_ca_tmo_burst.c new file mode 100644 index 0000000000..5c76f78dca --- /dev/null +++ b/drivers/event/cnxk/deq/cn10k/deq_240_255_ca_tmo_burst.c @@ -0,0 +1,14 @@ +/* SPDX-License-Identifier: BSD-3-Clause + * Copyright(C) 2021 Marvell. + */ + +#include "cn10k_worker.h" +#include "cnxk_eventdev.h" +#include "cnxk_worker.h" + +#define R(name, flags) \ + SSO_CMN_DEQ_BURST(cn10k_sso_hws_deq_tmo_ca_burst_##name, \ + cn10k_sso_hws_deq_tmo_ca_##name, flags) + +NIX_RX_FASTPATH_MODES_240_255 +#undef R diff --git a/drivers/event/cnxk/deq/cn10k/deq_240_255_ca_tmo_seg.c b/drivers/event/cnxk/deq/cn10k/deq_240_255_ca_tmo_seg.c new file mode 100644 index 0000000000..35af75874b --- /dev/null +++ b/drivers/event/cnxk/deq/cn10k/deq_240_255_ca_tmo_seg.c @@ -0,0 +1,13 @@ +/* SPDX-License-Identifier: BSD-3-Clause + * Copyright(C) 2021 Marvell. + */ + +#include "cn10k_worker.h" +#include "cnxk_eventdev.h" +#include "cnxk_worker.h" + +#define R(name, flags) \ + SSO_DEQ_TMO_CA_SEG(cn10k_sso_hws_deq_tmo_ca_seg_##name, flags) + +NIX_RX_FASTPATH_MODES_240_255 +#undef R diff --git a/drivers/event/cnxk/deq/cn10k/deq_240_255_ca_tmo_seg_burst.c b/drivers/event/cnxk/deq/cn10k/deq_240_255_ca_tmo_seg_burst.c new file mode 100644 index 0000000000..f8c6deb8ef --- /dev/null +++ b/drivers/event/cnxk/deq/cn10k/deq_240_255_ca_tmo_seg_burst.c @@ -0,0 +1,14 @@ +/* SPDX-License-Identifier: BSD-3-Clause + * Copyright(C) 2021 Marvell. + */ + +#include "cn10k_worker.h" +#include "cnxk_eventdev.h" +#include "cnxk_worker.h" + +#define R(name, flags) \ + SSO_CMN_DEQ_BURST(cn10k_sso_hws_deq_tmo_ca_seg_burst_##name, \ + cn10k_sso_hws_deq_tmo_ca_seg_##name, flags) + +NIX_RX_FASTPATH_MODES_240_255 +#undef R diff --git a/drivers/event/cnxk/deq/cn10k/deq_240_255_dual.c b/drivers/event/cnxk/deq/cn10k/deq_240_255_dual.c new file mode 100644 index 0000000000..0b227c2f99 --- /dev/null +++ b/drivers/event/cnxk/deq/cn10k/deq_240_255_dual.c @@ -0,0 +1,12 @@ +/* SPDX-License-Identifier: BSD-3-Clause + * Copyright(C) 2021 Marvell. + */ + +#include "cn10k_worker.h" +#include "cnxk_eventdev.h" +#include "cnxk_worker.h" + +#define R(name, flags) SSO_DUAL_DEQ(cn10k_sso_hws_dual_deq_##name, flags) + +NIX_RX_FASTPATH_MODES_240_255 +#undef R diff --git a/drivers/event/cnxk/deq/cn10k/deq_240_255_seg.c b/drivers/event/cnxk/deq/cn10k/deq_240_255_seg.c new file mode 100644 index 0000000000..6af63491da --- /dev/null +++ b/drivers/event/cnxk/deq/cn10k/deq_240_255_seg.c @@ -0,0 +1,12 @@ +/* SPDX-License-Identifier: BSD-3-Clause + * Copyright(C) 2021 Marvell. + */ + +#include "cn10k_worker.h" +#include "cnxk_eventdev.h" +#include "cnxk_worker.h" + +#define R(name, flags) SSO_DEQ_SEG(cn10k_sso_hws_deq_seg_##name, flags) + +NIX_RX_FASTPATH_MODES_240_255 +#undef R diff --git a/drivers/event/cnxk/deq/cn10k/deq_240_255_seg_burst.c b/drivers/event/cnxk/deq/cn10k/deq_240_255_seg_burst.c new file mode 100644 index 0000000000..6b20efd787 --- /dev/null +++ b/drivers/event/cnxk/deq/cn10k/deq_240_255_seg_burst.c @@ -0,0 +1,14 @@ +/* SPDX-License-Identifier: BSD-3-Clause + * Copyright(C) 2021 Marvell. + */ + +#include "cn10k_worker.h" +#include "cnxk_eventdev.h" +#include "cnxk_worker.h" + +#define R(name, flags) \ + SSO_CMN_DEQ_SEG_BURST(cn10k_sso_hws_deq_seg_burst_##name, \ + cn10k_sso_hws_deq_seg_##name, flags) + +NIX_RX_FASTPATH_MODES_240_255 +#undef R diff --git a/drivers/event/cnxk/deq/cn10k/deq_240_255_tmo.c b/drivers/event/cnxk/deq/cn10k/deq_240_255_tmo.c new file mode 100644 index 0000000000..c074e55d02 --- /dev/null +++ b/drivers/event/cnxk/deq/cn10k/deq_240_255_tmo.c @@ -0,0 +1,12 @@ +/* SPDX-License-Identifier: BSD-3-Clause + * Copyright(C) 2021 Marvell. + */ + +#include "cn10k_worker.h" +#include "cnxk_eventdev.h" +#include "cnxk_worker.h" + +#define R(name, flags) SSO_DEQ_TMO(cn10k_sso_hws_deq_tmo_##name, flags) + +NIX_RX_FASTPATH_MODES_240_255 +#undef R diff --git a/drivers/event/cnxk/deq/cn10k/deq_240_255_tmo_burst.c b/drivers/event/cnxk/deq/cn10k/deq_240_255_tmo_burst.c new file mode 100644 index 0000000000..88bf1541cb --- /dev/null +++ b/drivers/event/cnxk/deq/cn10k/deq_240_255_tmo_burst.c @@ -0,0 +1,14 @@ +/* SPDX-License-Identifier: BSD-3-Clause + * Copyright(C) 2021 Marvell. + */ + +#include "cn10k_worker.h" +#include "cnxk_eventdev.h" +#include "cnxk_worker.h" + +#define R(name, flags) \ + SSO_CMN_DEQ_BURST(cn10k_sso_hws_deq_tmo_burst_##name, \ + cn10k_sso_hws_deq_tmo_##name, flags) + +NIX_RX_FASTPATH_MODES_240_255 +#undef R diff --git a/drivers/event/cnxk/deq/cn10k/deq_240_255_tmo_seg.c b/drivers/event/cnxk/deq/cn10k/deq_240_255_tmo_seg.c new file mode 100644 index 0000000000..560fc74f64 --- /dev/null +++ b/drivers/event/cnxk/deq/cn10k/deq_240_255_tmo_seg.c @@ -0,0 +1,12 @@ +/* SPDX-License-Identifier: BSD-3-Clause + * Copyright(C) 2021 Marvell. + */ + +#include "cn10k_worker.h" +#include "cnxk_eventdev.h" +#include "cnxk_worker.h" + +#define R(name, flags) SSO_DEQ_TMO_SEG(cn10k_sso_hws_deq_tmo_seg_##name, flags) + +NIX_RX_FASTPATH_MODES_240_255 +#undef R diff --git a/drivers/event/cnxk/deq/cn10k/deq_240_255_tmo_seg_burst.c b/drivers/event/cnxk/deq/cn10k/deq_240_255_tmo_seg_burst.c new file mode 100644 index 0000000000..92017de4e2 --- /dev/null +++ b/drivers/event/cnxk/deq/cn10k/deq_240_255_tmo_seg_burst.c @@ -0,0 +1,14 @@ +/* SPDX-License-Identifier: BSD-3-Clause + * Copyright(C) 2021 Marvell. + */ + +#include "cn10k_worker.h" +#include "cnxk_eventdev.h" +#include "cnxk_worker.h" + +#define R(name, flags) \ + SSO_CMN_DEQ_BURST(cn10k_sso_hws_deq_tmo_seg_burst_##name, \ + cn10k_sso_hws_deq_tmo_seg_##name, flags) + +NIX_RX_FASTPATH_MODES_240_255 +#undef R diff --git a/drivers/event/cnxk/meson.build b/drivers/event/cnxk/meson.build index b27bae7b12..26081faf0c 100644 --- a/drivers/event/cnxk/meson.build +++ b/drivers/event/cnxk/meson.build @@ -330,6 +330,14 @@ sources += files( 'deq/cn10k/deq_80_95_burst.c', 'deq/cn10k/deq_96_111_burst.c', 'deq/cn10k/deq_112_127_burst.c', + 'deq/cn10k/deq_128_143_burst.c', + 'deq/cn10k/deq_144_159_burst.c', + 'deq/cn10k/deq_160_175_burst.c', + 'deq/cn10k/deq_176_191_burst.c', + 'deq/cn10k/deq_192_207_burst.c', + 'deq/cn10k/deq_208_223_burst.c', + 'deq/cn10k/deq_224_239_burst.c', + 'deq/cn10k/deq_240_255_burst.c', 'deq/cn10k/deq_0_15_seg_burst.c', 'deq/cn10k/deq_16_31_seg_burst.c', 'deq/cn10k/deq_32_47_seg_burst.c', @@ -338,6 +346,14 @@ sources += files( 'deq/cn10k/deq_80_95_seg_burst.c', 'deq/cn10k/deq_96_111_seg_burst.c', 'deq/cn10k/deq_112_127_seg_burst.c', + 'deq/cn10k/deq_128_143_seg_burst.c', + 'deq/cn10k/deq_144_159_seg_burst.c', + 'deq/cn10k/deq_160_175_seg_burst.c', + 'deq/cn10k/deq_176_191_seg_burst.c', + 'deq/cn10k/deq_192_207_seg_burst.c', + 'deq/cn10k/deq_208_223_seg_burst.c', + 'deq/cn10k/deq_224_239_seg_burst.c', + 'deq/cn10k/deq_240_255_seg_burst.c', 'deq/cn10k/deq_0_15.c', 'deq/cn10k/deq_16_31.c', 'deq/cn10k/deq_32_47.c', @@ -346,6 +362,14 @@ sources += files( 'deq/cn10k/deq_80_95.c', 'deq/cn10k/deq_96_111.c', 'deq/cn10k/deq_112_127.c', + 'deq/cn10k/deq_128_143.c', + 'deq/cn10k/deq_144_159.c', + 'deq/cn10k/deq_160_175.c', + 'deq/cn10k/deq_176_191.c', + 'deq/cn10k/deq_192_207.c', + 'deq/cn10k/deq_208_223.c', + 'deq/cn10k/deq_224_239.c', + 'deq/cn10k/deq_240_255.c', 'deq/cn10k/deq_0_15_seg.c', 'deq/cn10k/deq_16_31_seg.c', 'deq/cn10k/deq_32_47_seg.c', @@ -354,6 +378,14 @@ sources += files( 'deq/cn10k/deq_80_95_seg.c', 'deq/cn10k/deq_96_111_seg.c', 'deq/cn10k/deq_112_127_seg.c', + 'deq/cn10k/deq_128_143_seg.c', + 'deq/cn10k/deq_144_159_seg.c', + 'deq/cn10k/deq_160_175_seg.c', + 'deq/cn10k/deq_176_191_seg.c', + 'deq/cn10k/deq_192_207_seg.c', + 'deq/cn10k/deq_208_223_seg.c', + 'deq/cn10k/deq_224_239_seg.c', + 'deq/cn10k/deq_240_255_seg.c', 'deq/cn10k/deq_0_15_tmo.c', 'deq/cn10k/deq_16_31_tmo.c', 'deq/cn10k/deq_32_47_tmo.c', @@ -362,6 +394,14 @@ sources += files( 'deq/cn10k/deq_80_95_tmo.c', 'deq/cn10k/deq_96_111_tmo.c', 'deq/cn10k/deq_112_127_tmo.c', + 'deq/cn10k/deq_128_143_tmo.c', + 'deq/cn10k/deq_144_159_tmo.c', + 'deq/cn10k/deq_160_175_tmo.c', + 'deq/cn10k/deq_176_191_tmo.c', + 'deq/cn10k/deq_192_207_tmo.c', + 'deq/cn10k/deq_208_223_tmo.c', + 'deq/cn10k/deq_224_239_tmo.c', + 'deq/cn10k/deq_240_255_tmo.c', 'deq/cn10k/deq_0_15_tmo_burst.c', 'deq/cn10k/deq_16_31_tmo_burst.c', 'deq/cn10k/deq_32_47_tmo_burst.c', @@ -370,6 +410,14 @@ sources += files( 'deq/cn10k/deq_80_95_tmo_burst.c', 'deq/cn10k/deq_96_111_tmo_burst.c', 'deq/cn10k/deq_112_127_tmo_burst.c', + 'deq/cn10k/deq_128_143_tmo_burst.c', + 'deq/cn10k/deq_144_159_tmo_burst.c', + 'deq/cn10k/deq_160_175_tmo_burst.c', + 'deq/cn10k/deq_176_191_tmo_burst.c', + 'deq/cn10k/deq_192_207_tmo_burst.c', + 'deq/cn10k/deq_208_223_tmo_burst.c', + 'deq/cn10k/deq_224_239_tmo_burst.c', + 'deq/cn10k/deq_240_255_tmo_burst.c', 'deq/cn10k/deq_0_15_tmo_seg.c', 'deq/cn10k/deq_16_31_tmo_seg.c', 'deq/cn10k/deq_32_47_tmo_seg.c', @@ -378,6 +426,14 @@ sources += files( 'deq/cn10k/deq_80_95_tmo_seg.c', 'deq/cn10k/deq_96_111_tmo_seg.c', 'deq/cn10k/deq_112_127_tmo_seg.c', + 'deq/cn10k/deq_128_143_tmo_seg.c', + 'deq/cn10k/deq_144_159_tmo_seg.c', + 'deq/cn10k/deq_160_175_tmo_seg.c', + 'deq/cn10k/deq_176_191_tmo_seg.c', + 'deq/cn10k/deq_192_207_tmo_seg.c', + 'deq/cn10k/deq_208_223_tmo_seg.c', + 'deq/cn10k/deq_224_239_tmo_seg.c', + 'deq/cn10k/deq_240_255_tmo_seg.c', 'deq/cn10k/deq_0_15_tmo_seg_burst.c', 'deq/cn10k/deq_16_31_tmo_seg_burst.c', 'deq/cn10k/deq_32_47_tmo_seg_burst.c', @@ -386,6 +442,14 @@ sources += files( 'deq/cn10k/deq_80_95_tmo_seg_burst.c', 'deq/cn10k/deq_96_111_tmo_seg_burst.c', 'deq/cn10k/deq_112_127_tmo_seg_burst.c', + 'deq/cn10k/deq_128_143_tmo_seg_burst.c', + 'deq/cn10k/deq_144_159_tmo_seg_burst.c', + 'deq/cn10k/deq_160_175_tmo_seg_burst.c', + 'deq/cn10k/deq_176_191_tmo_seg_burst.c', + 'deq/cn10k/deq_192_207_tmo_seg_burst.c', + 'deq/cn10k/deq_208_223_tmo_seg_burst.c', + 'deq/cn10k/deq_224_239_tmo_seg_burst.c', + 'deq/cn10k/deq_240_255_tmo_seg_burst.c', 'deq/cn10k/deq_0_15_ca.c', 'deq/cn10k/deq_16_31_ca.c', 'deq/cn10k/deq_32_47_ca.c', @@ -394,6 +458,14 @@ sources += files( 'deq/cn10k/deq_80_95_ca.c', 'deq/cn10k/deq_96_111_ca.c', 'deq/cn10k/deq_112_127_ca.c', + 'deq/cn10k/deq_128_143_ca.c', + 'deq/cn10k/deq_144_159_ca.c', + 'deq/cn10k/deq_160_175_ca.c', + 'deq/cn10k/deq_176_191_ca.c', + 'deq/cn10k/deq_192_207_ca.c', + 'deq/cn10k/deq_208_223_ca.c', + 'deq/cn10k/deq_224_239_ca.c', + 'deq/cn10k/deq_240_255_ca.c', 'deq/cn10k/deq_0_15_ca_burst.c', 'deq/cn10k/deq_16_31_ca_burst.c', 'deq/cn10k/deq_32_47_ca_burst.c', @@ -402,6 +474,14 @@ sources += files( 'deq/cn10k/deq_80_95_ca_burst.c', 'deq/cn10k/deq_96_111_ca_burst.c', 'deq/cn10k/deq_112_127_ca_burst.c', + 'deq/cn10k/deq_128_143_ca_burst.c', + 'deq/cn10k/deq_144_159_ca_burst.c', + 'deq/cn10k/deq_160_175_ca_burst.c', + 'deq/cn10k/deq_176_191_ca_burst.c', + 'deq/cn10k/deq_192_207_ca_burst.c', + 'deq/cn10k/deq_208_223_ca_burst.c', + 'deq/cn10k/deq_224_239_ca_burst.c', + 'deq/cn10k/deq_240_255_ca_burst.c', 'deq/cn10k/deq_0_15_ca_seg.c', 'deq/cn10k/deq_16_31_ca_seg.c', 'deq/cn10k/deq_32_47_ca_seg.c', @@ -410,6 +490,14 @@ sources += files( 'deq/cn10k/deq_80_95_ca_seg.c', 'deq/cn10k/deq_96_111_ca_seg.c', 'deq/cn10k/deq_112_127_ca_seg.c', + 'deq/cn10k/deq_128_143_ca_seg.c', + 'deq/cn10k/deq_144_159_ca_seg.c', + 'deq/cn10k/deq_160_175_ca_seg.c', + 'deq/cn10k/deq_176_191_ca_seg.c', + 'deq/cn10k/deq_192_207_ca_seg.c', + 'deq/cn10k/deq_208_223_ca_seg.c', + 'deq/cn10k/deq_224_239_ca_seg.c', + 'deq/cn10k/deq_240_255_ca_seg.c', 'deq/cn10k/deq_0_15_ca_seg_burst.c', 'deq/cn10k/deq_16_31_ca_seg_burst.c', 'deq/cn10k/deq_32_47_ca_seg_burst.c', @@ -418,6 +506,14 @@ sources += files( 'deq/cn10k/deq_80_95_ca_seg_burst.c', 'deq/cn10k/deq_96_111_ca_seg_burst.c', 'deq/cn10k/deq_112_127_ca_seg_burst.c', + 'deq/cn10k/deq_128_143_ca_seg_burst.c', + 'deq/cn10k/deq_144_159_ca_seg_burst.c', + 'deq/cn10k/deq_160_175_ca_seg_burst.c', + 'deq/cn10k/deq_176_191_ca_seg_burst.c', + 'deq/cn10k/deq_192_207_ca_seg_burst.c', + 'deq/cn10k/deq_208_223_ca_seg_burst.c', + 'deq/cn10k/deq_224_239_ca_seg_burst.c', + 'deq/cn10k/deq_240_255_ca_seg_burst.c', 'deq/cn10k/deq_0_15_ca_tmo.c', 'deq/cn10k/deq_16_31_ca_tmo.c', 'deq/cn10k/deq_32_47_ca_tmo.c', @@ -426,6 +522,14 @@ sources += files( 'deq/cn10k/deq_80_95_ca_tmo.c', 'deq/cn10k/deq_96_111_ca_tmo.c', 'deq/cn10k/deq_112_127_ca_tmo.c', + 'deq/cn10k/deq_128_143_ca_tmo.c', + 'deq/cn10k/deq_144_159_ca_tmo.c', + 'deq/cn10k/deq_160_175_ca_tmo.c', + 'deq/cn10k/deq_176_191_ca_tmo.c', + 'deq/cn10k/deq_192_207_ca_tmo.c', + 'deq/cn10k/deq_208_223_ca_tmo.c', + 'deq/cn10k/deq_224_239_ca_tmo.c', + 'deq/cn10k/deq_240_255_ca_tmo.c', 'deq/cn10k/deq_0_15_ca_tmo_burst.c', 'deq/cn10k/deq_16_31_ca_tmo_burst.c', 'deq/cn10k/deq_32_47_ca_tmo_burst.c', @@ -434,6 +538,14 @@ sources += files( 'deq/cn10k/deq_80_95_ca_tmo_burst.c', 'deq/cn10k/deq_96_111_ca_tmo_burst.c', 'deq/cn10k/deq_112_127_ca_tmo_burst.c', + 'deq/cn10k/deq_128_143_ca_tmo_burst.c', + 'deq/cn10k/deq_144_159_ca_tmo_burst.c', + 'deq/cn10k/deq_160_175_ca_tmo_burst.c', + 'deq/cn10k/deq_176_191_ca_tmo_burst.c', + 'deq/cn10k/deq_192_207_ca_tmo_burst.c', + 'deq/cn10k/deq_208_223_ca_tmo_burst.c', + 'deq/cn10k/deq_224_239_ca_tmo_burst.c', + 'deq/cn10k/deq_240_255_ca_tmo_burst.c', 'deq/cn10k/deq_0_15_ca_tmo_seg.c', 'deq/cn10k/deq_16_31_ca_tmo_seg.c', 'deq/cn10k/deq_32_47_ca_tmo_seg.c', @@ -442,6 +554,14 @@ sources += files( 'deq/cn10k/deq_80_95_ca_tmo_seg.c', 'deq/cn10k/deq_96_111_ca_tmo_seg.c', 'deq/cn10k/deq_112_127_ca_tmo_seg.c', + 'deq/cn10k/deq_128_143_ca_tmo_seg.c', + 'deq/cn10k/deq_144_159_ca_tmo_seg.c', + 'deq/cn10k/deq_160_175_ca_tmo_seg.c', + 'deq/cn10k/deq_176_191_ca_tmo_seg.c', + 'deq/cn10k/deq_192_207_ca_tmo_seg.c', + 'deq/cn10k/deq_208_223_ca_tmo_seg.c', + 'deq/cn10k/deq_224_239_ca_tmo_seg.c', + 'deq/cn10k/deq_240_255_ca_tmo_seg.c', 'deq/cn10k/deq_0_15_ca_tmo_seg_burst.c', 'deq/cn10k/deq_16_31_ca_tmo_seg_burst.c', 'deq/cn10k/deq_32_47_ca_tmo_seg_burst.c', @@ -450,6 +570,14 @@ sources += files( 'deq/cn10k/deq_80_95_ca_tmo_seg_burst.c', 'deq/cn10k/deq_96_111_ca_tmo_seg_burst.c', 'deq/cn10k/deq_112_127_ca_tmo_seg_burst.c', + 'deq/cn10k/deq_128_143_ca_tmo_seg_burst.c', + 'deq/cn10k/deq_144_159_ca_tmo_seg_burst.c', + 'deq/cn10k/deq_160_175_ca_tmo_seg_burst.c', + 'deq/cn10k/deq_176_191_ca_tmo_seg_burst.c', + 'deq/cn10k/deq_192_207_ca_tmo_seg_burst.c', + 'deq/cn10k/deq_208_223_ca_tmo_seg_burst.c', + 'deq/cn10k/deq_224_239_ca_tmo_seg_burst.c', + 'deq/cn10k/deq_240_255_ca_tmo_seg_burst.c', ) sources += files( diff --git a/drivers/net/cnxk/cn10k_ethdev.c b/drivers/net/cnxk/cn10k_ethdev.c index 8378cbffc2..d065abb465 100644 --- a/drivers/net/cnxk/cn10k_ethdev.c +++ b/drivers/net/cnxk/cn10k_ethdev.c @@ -39,6 +39,10 @@ nix_rx_offload_flags(struct rte_eth_dev *eth_dev) if (dev->rx_offloads & RTE_ETH_RX_OFFLOAD_SECURITY) flags |= NIX_RX_OFFLOAD_SECURITY_F; + if (dev->rx_offloads & + (DEV_RX_OFFLOAD_SECURITY | RTE_ETH_RX_OFFLOAD_IP_REASSEMBLY)) + flags |= NIX_RX_OFFLOAD_REASSEMBLY_F; + return flags; } @@ -470,6 +474,17 @@ cn10k_nix_dev_start(struct rte_eth_dev *eth_dev) return 0; } +static int +cn10k_nix_reass_conf_set(struct rte_eth_dev *dev, + struct rte_eth_ip_reass_params *conf) +{ + RTE_SET_USED(dev); + int rc = 0; + + rc = roc_nix_reass_configure(conf->reass_timeout, conf->max_frags); + return rc; +} + /* Update platform specific eth dev ops */ static void nix_eth_dev_ops_override(void) @@ -489,6 +504,7 @@ nix_eth_dev_ops_override(void) cnxk_eth_dev_ops.dev_ptypes_set = cn10k_nix_ptypes_set; cnxk_eth_dev_ops.timesync_enable = cn10k_nix_timesync_enable; cnxk_eth_dev_ops.timesync_disable = cn10k_nix_timesync_disable; + cnxk_eth_dev_ops.ip_reassembly_conf_set = cn10k_nix_reass_conf_set; } static void diff --git a/drivers/net/cnxk/cn10k_rx.c b/drivers/net/cnxk/cn10k_rx.c index 5d603514c0..028abe8f39 100644 --- a/drivers/net/cnxk/cn10k_rx.c +++ b/drivers/net/cnxk/cn10k_rx.c @@ -5,7 +5,7 @@ #include "cn10k_ethdev.h" #include "cn10k_rx.h" -#define R(name, f6, f5, f4, f3, f2, f1, f0, flags) \ +#define R(name, f7, f6, f5, f4, f3, f2, f1, f0, flags) \ uint16_t __rte_noinline __rte_hot cn10k_nix_recv_pkts_##name( \ void *rx_queue, struct rte_mbuf **rx_pkts, uint16_t pkts) \ { \ @@ -17,12 +17,13 @@ NIX_RX_FASTPATH_MODES static inline void pick_rx_func(struct rte_eth_dev *eth_dev, - const eth_rx_burst_t rx_burst[2][2][2][2][2][2][2]) + const eth_rx_burst_t rx_burst[2][2][2][2][2][2][2][2]) { struct cnxk_eth_dev *dev = cnxk_eth_pmd_priv(eth_dev); /* [VLAN] [TSP] [MARK] [CKSUM] [PTYPE] [RSS] */ eth_dev->rx_pkt_burst = rx_burst + [!!(dev->rx_offload_flags & NIX_RX_OFFLOAD_REASSEMBLY_F)] [!!(dev->rx_offload_flags & NIX_RX_OFFLOAD_SECURITY_F)] [!!(dev->rx_offload_flags & NIX_RX_OFFLOAD_VLAN_STRIP_F)] [!!(dev->rx_offload_flags & NIX_RX_OFFLOAD_TSTAMP_F)] @@ -39,42 +40,42 @@ cn10k_eth_set_rx_function(struct rte_eth_dev *eth_dev) { struct cnxk_eth_dev *dev = cnxk_eth_pmd_priv(eth_dev); - const eth_rx_burst_t nix_eth_rx_burst[2][2][2][2][2][2][2] = { -#define R(name, f6, f5, f4, f3, f2, f1, f0, flags) \ - [f6][f5][f4][f3][f2][f1][f0] = cn10k_nix_recv_pkts_##name, + const eth_rx_burst_t nix_eth_rx_burst[2][2][2][2][2][2][2][2] = { +#define R(name, f7, f6, f5, f4, f3, f2, f1, f0, flags) \ + [f7][f6][f5][f4][f3][f2][f1][f0] = cn10k_nix_recv_pkts_##name, NIX_RX_FASTPATH_MODES #undef R }; - const eth_rx_burst_t nix_eth_rx_burst_mseg[2][2][2][2][2][2][2] = { -#define R(name, f6, f5, f4, f3, f2, f1, f0, flags) \ - [f6][f5][f4][f3][f2][f1][f0] = cn10k_nix_recv_pkts_mseg_##name, + const eth_rx_burst_t nix_eth_rx_burst_mseg[2][2][2][2][2][2][2][2] = { +#define R(name, f7, f6, f5, f4, f3, f2, f1, f0, flags) \ + [f7][f6][f5][f4][f3][f2][f1][f0] = cn10k_nix_recv_pkts_mseg_##name, NIX_RX_FASTPATH_MODES #undef R }; - const eth_rx_burst_t nix_eth_rx_vec_burst[2][2][2][2][2][2][2] = { -#define R(name, f6, f5, f4, f3, f2, f1, f0, flags) \ - [f6][f5][f4][f3][f2][f1][f0] = cn10k_nix_recv_pkts_vec_##name, + const eth_rx_burst_t nix_eth_rx_vec_burst[2][2][2][2][2][2][2][2] = { +#define R(name, f7, f6, f5, f4, f3, f2, f1, f0, flags) \ + [f7][f6][f5][f4][f3][f2][f1][f0] = cn10k_nix_recv_pkts_vec_##name, NIX_RX_FASTPATH_MODES #undef R }; - const eth_rx_burst_t nix_eth_rx_vec_burst_mseg[2][2][2][2][2][2][2] = { -#define R(name, f6, f5, f4, f3, f2, f1, f0, flags) \ - [f6][f5][f4][f3][f2][f1][f0] = cn10k_nix_recv_pkts_vec_mseg_##name, + const eth_rx_burst_t nix_eth_rx_vec_burst_mseg[2][2][2][2][2][2][2][2] = { +#define R(name, f7, f6, f5, f4, f3, f2, f1, f0, flags) \ + [f7][f6][f5][f4][f3][f2][f1][f0] = cn10k_nix_recv_pkts_vec_mseg_##name, - NIX_RX_FASTPATH_MODES + NIX_RX_FASTPATH_MODES #undef R - }; + }; /* Copy multi seg version with no offload for tear down sequence */ if (rte_eal_process_type() == RTE_PROC_PRIMARY) dev->rx_pkt_burst_no_offload = - nix_eth_rx_burst_mseg[0][0][0][0][0][0][0]; + nix_eth_rx_burst_mseg[0][0][0][0][0][0][0][0]; if (dev->scalar_ena) { if (dev->rx_offloads & RTE_ETH_RX_OFFLOAD_SCATTER) diff --git a/drivers/net/cnxk/cn10k_rx.h b/drivers/net/cnxk/cn10k_rx.h index a2442d3726..5c415634a9 100644 --- a/drivers/net/cnxk/cn10k_rx.h +++ b/drivers/net/cnxk/cn10k_rx.h @@ -17,7 +17,8 @@ #define NIX_RX_OFFLOAD_TSTAMP_F BIT(4) #define NIX_RX_OFFLOAD_VLAN_STRIP_F BIT(5) #define NIX_RX_OFFLOAD_SECURITY_F BIT(6) -#define NIX_RX_OFFLOAD_MAX (NIX_RX_OFFLOAD_SECURITY_F << 1) +#define NIX_RX_OFFLOAD_REASSEMBLY_F BIT(7) +#define NIX_RX_OFFLOAD_MAX (NIX_RX_OFFLOAD_REASSEMBLY_F << 1) /* Flags to control cqe_to_mbuf conversion function. * Defining it from backwards to denote its been @@ -86,9 +87,232 @@ nix_sec_flush_meta(uintptr_t laddr, uint16_t lmt_id, uint8_t loff, roc_lmt_submit_steorl(lmt_id, pa); } +static struct rte_mbuf * +nix_sec_attach_frags(const struct cpt_parse_hdr_s *hdr, + struct cn10k_inb_priv_data *inb_priv) +{ + uint32_t offset = hdr->w2.fi_offset; + union nix_rx_parse_u *frag_rx; + struct cpt_frag_info_s *finfo; + struct rte_mbuf *head, *mbuf; + uint64_t *frag_ptr; + uint16_t frag_size; + uint16_t rlen; + uint64_t *wqe; + + /* offset of 0 implies 256B, otherwise it implies offset*8B */ + offset = (((offset - 1) & 0x1f) + 1) * 8; + finfo = RTE_PTR_ADD(hdr, offset + hdr->w2.fi_pad); + + /* Frag-0: */ + wqe = (uint64_t *)(rte_be_to_cpu_64(hdr->wqe_ptr)); + rlen = ((*(wqe + 10)) >> 16) & 0xFFFF; + + frag_rx = (union nix_rx_parse_u *)(wqe + 1); + frag_size = rlen + frag_rx->lcptr - frag_rx->laptr; + frag_rx->pkt_lenm1 = frag_size - 1; + + mbuf = (struct rte_mbuf *)(wqe - sizeof(struct rte_mbuf)); + mbuf->data_len = frag_size; + mbuf->pkt_len = frag_size; + head = mbuf; + /* Update dynamic field with userdata */ + *rte_security_dynfield(mbuf) = (uint64_t)inb_priv->userdata; + + /* Frag-1: */ + if (hdr->w0.num_frags > 1) { + wqe = (uint64_t *)(rte_be_to_cpu_64(hdr->frag1_wqe_ptr)); + rlen = ((*(wqe + 10)) >> 16) & 0xFFFF; + + frag_rx = (union nix_rx_parse_u *)(wqe + 1); + frag_size = rlen + frag_rx->lcptr - frag_rx->laptr; + frag_rx->pkt_lenm1 = frag_size - 1; + + mbuf->next = (struct rte_mbuf *)(wqe - sizeof(struct rte_mbuf)); + mbuf = mbuf->next; + mbuf->data_len = frag_size; + mbuf->pkt_len = frag_size; + + /* Update dynamic field with userdata */ + *rte_security_dynfield(mbuf) = (uint64_t)inb_priv->userdata; + } + + /* Frag-2: */ + if (hdr->w0.num_frags > 2) { + frag_ptr = (uint64_t *)(finfo + 1); + wqe = (uint64_t *)(rte_be_to_cpu_64(*frag_ptr)); + rlen = ((*(wqe + 10)) >> 16) & 0xFFFF; + + frag_rx = (union nix_rx_parse_u *)(wqe + 1); + frag_size = rlen + frag_rx->lcptr - frag_rx->laptr; + frag_rx->pkt_lenm1 = frag_size - 1; + + mbuf->next = (struct rte_mbuf *)(wqe - sizeof(struct rte_mbuf)); + mbuf = mbuf->next; + mbuf->data_len = frag_size; + mbuf->pkt_len = frag_size; + + /* Update dynamic field with userdata */ + *rte_security_dynfield(mbuf) = (uint64_t)inb_priv->userdata; + } + + /* Frag-3: */ + if (hdr->w0.num_frags > 3) { + wqe = (uint64_t *)(rte_be_to_cpu_64(*(frag_ptr + 1))); + rlen = ((*(wqe + 10)) >> 16) & 0xFFFF; + + frag_rx = (union nix_rx_parse_u *)(wqe + 1); + frag_size = rlen + frag_rx->lcptr - frag_rx->laptr; + frag_rx->pkt_lenm1 = frag_size - 1; + + mbuf->next = (struct rte_mbuf *)(wqe - sizeof(struct rte_mbuf)); + mbuf = mbuf->next; + mbuf->data_len = frag_size; + mbuf->pkt_len = frag_size; + + /* Update dynamic field with userdata */ + *rte_security_dynfield(mbuf) = (uint64_t)inb_priv->userdata; + } + + mbuf->next = NULL; + return head; +} + +static struct rte_mbuf * +nix_sec_reassemble_frags(const struct cpt_parse_hdr_s *hdr, uint64_t cq_w1, uint64_t cq_w5) +{ + uint32_t fragx_sum, pkt_hdr_len, l3_hdr_size; + uint32_t offset = hdr->w2.fi_offset; + union nix_rx_parse_u *inner_rx; + union nix_rx_parse_u *frag_rx; + struct cpt_frag_info_s *finfo; + struct rte_mbuf *head, *mbuf; + rte_iova_t *inner_iova; + uint64_t *frag_ptr; + uint16_t frag_size; + uint16_t rlen; + uint64_t *wqe; + + /* offset of 0 implies 256B, otherwise it implies offset*8B */ + offset = (((offset - 1) & 0x1f) + 1) * 8; + finfo = RTE_PTR_ADD(hdr, offset + hdr->w2.fi_pad); + + /* Frag-0: */ + wqe = (uint64_t *)rte_be_to_cpu_64(hdr->wqe_ptr); + inner_rx = (union nix_rx_parse_u *)(wqe + 1); + inner_iova = (rte_iova_t *)*(wqe + 9); + + /* Update only the the upper 28-bits from meta pkt parse info */ + *((uint64_t *)inner_rx) = ((*((uint64_t *)inner_rx) & ((1ULL << 36) - 1)) | + (cq_w1 & ~((1ULL << 36) - 1))); + + rlen = ((*(wqe + 10)) >> 16) & 0xFFFF; + frag_size = rlen + ((cq_w5 >> 16) & 0xFF) - (cq_w5 & 0xFF); + fragx_sum = rte_be_to_cpu_16(finfo->w1.frag_size0); + pkt_hdr_len = frag_size - fragx_sum; + + mbuf = (struct rte_mbuf *)((uintptr_t)wqe - sizeof(struct rte_mbuf)); + mbuf->data_len = frag_size; + head = mbuf; + + if (inner_rx->lctype == NPC_LT_LC_IP) { + struct rte_ipv4_hdr *hdr = (struct rte_ipv4_hdr *)RTE_PTR_ADD( + inner_iova, inner_rx->lcptr); + + l3_hdr_size = (hdr->version_ihl & 0xf) << 2; + } else { + struct rte_ipv6_hdr *hdr = (struct rte_ipv6_hdr *)RTE_PTR_ADD( + inner_iova, inner_rx->lcptr); + size_t ext_len = sizeof(struct rte_ipv6_hdr); + uint8_t *nxt_hdr = (uint8_t *)hdr; + int nh = hdr->proto; + + l3_hdr_size = 0; + while (nh != -EINVAL) { + nxt_hdr += ext_len; + l3_hdr_size += ext_len; + nh = rte_ipv6_get_next_ext(nxt_hdr, nh, &ext_len); + } + } + + /* Frag-1: */ + wqe = (uint64_t *)(rte_be_to_cpu_64(hdr->frag1_wqe_ptr)); + frag_size = rte_be_to_cpu_16(finfo->w1.frag_size1); + frag_rx = (union nix_rx_parse_u *)(wqe + 1); + + mbuf->next = (struct rte_mbuf *)((uintptr_t)wqe - sizeof(struct rte_mbuf)); + mbuf = mbuf->next; + mbuf->data_len = frag_size; + mbuf->data_off = + (*(wqe + 9) - (uint64_t)wqe) + frag_rx->lcptr + l3_hdr_size; + fragx_sum += frag_size; + + /* Frag-2: */ + if (hdr->w0.num_frags > 2) { + frag_ptr = (uint64_t *)(finfo + 1); + wqe = (uint64_t *)(rte_be_to_cpu_64(*frag_ptr)); + frag_size = rte_be_to_cpu_16(finfo->w1.frag_size2); + frag_rx = (union nix_rx_parse_u *)(wqe + 1); + + mbuf->next = (struct rte_mbuf *)((uintptr_t)wqe - sizeof(struct rte_mbuf)); + mbuf = mbuf->next; + mbuf->data_len = frag_size; + mbuf->data_off = (*(wqe + 9) - (uint64_t)wqe) + frag_rx->lcptr + + l3_hdr_size; + fragx_sum += frag_size; + } + + /* Frag-3: */ + if (hdr->w0.num_frags > 3) { + wqe = (uint64_t *)(rte_be_to_cpu_64(*(frag_ptr + 1))); + frag_size = rte_be_to_cpu_16(finfo->w1.frag_size3); + frag_rx = (union nix_rx_parse_u *)(wqe + 1); + + mbuf->next = (struct rte_mbuf *)((uintptr_t)wqe - sizeof(struct rte_mbuf)); + mbuf = mbuf->next; + mbuf->data_len = frag_size; + mbuf->data_off = (*(wqe + 9) - (uint64_t)wqe) + frag_rx->lcptr + + l3_hdr_size; + fragx_sum += frag_size; + } + + if (inner_rx->lctype == NPC_LT_LC_IP) { + struct rte_ipv4_hdr *hdr = (struct rte_ipv4_hdr *)RTE_PTR_ADD( + inner_iova, inner_rx->lcptr); + + hdr->fragment_offset = 0; + hdr->total_length = rte_cpu_to_be_16(fragx_sum + l3_hdr_size); + hdr->hdr_checksum = 0; + hdr->hdr_checksum = rte_ipv4_cksum(hdr); + + inner_rx->pkt_lenm1 = pkt_hdr_len + fragx_sum - 1; + } else { + /* Remove the frag header by moving header 8 bytes forward */ + struct rte_ipv6_hdr *hdr = (struct rte_ipv6_hdr *)RTE_PTR_ADD( + inner_iova, inner_rx->lcptr); + + hdr->payload_len = rte_cpu_to_be_16( + fragx_sum + l3_hdr_size - 8 - sizeof(struct rte_ipv6_hdr)); + + rte_memcpy(rte_pktmbuf_mtod_offset(head, void *, 8), + rte_pktmbuf_mtod(head, void *), + inner_rx->lcptr + sizeof(struct rte_ipv6_hdr)); + + inner_rx->pkt_lenm1 = pkt_hdr_len + fragx_sum -8 - 1; + head->data_len -= 8; + head->data_off += 8; + } + mbuf->next = NULL; + head->pkt_len = inner_rx->pkt_lenm1 + 1; + + return head; +} + static __rte_always_inline struct rte_mbuf * -nix_sec_meta_to_mbuf_sc(uint64_t cq_w1, const uint64_t sa_base, uintptr_t laddr, - uint8_t *loff, struct rte_mbuf *mbuf, uint16_t data_off) +nix_sec_meta_to_mbuf_sc(uint64_t cq_w1, uint64_t cq_w5, const uint64_t sa_base, + uintptr_t laddr, + uint8_t *loff, struct rte_mbuf *mbuf, uint16_t data_off, + const uint16_t flags) { const void *__p = (void *)((uintptr_t)mbuf + (uint16_t)data_off); const struct cpt_parse_hdr_s *hdr = (const struct cpt_parse_hdr_s *)__p; @@ -98,7 +322,82 @@ nix_sec_meta_to_mbuf_sc(uint64_t cq_w1, const uint64_t sa_base, uintptr_t laddr, void *inb_sa; uint64_t w0; - if (cq_w1 & BIT(11)) { + if ((flags & NIX_RX_OFFLOAD_REASSEMBLY_F) && (cq_w1 & BIT(11))) { + /* Get SPI from CPT_PARSE_S's cookie(already swapped) */ + w0 = hdr->w0.u64; + sa_idx = w0 >> 32; + + inb_sa = roc_nix_inl_ot_ipsec_inb_sa(sa_base, sa_idx); + inb_priv = roc_nix_inl_ot_ipsec_inb_sa_sw_rsvd(inb_sa); + + if (!(hdr->w0.err_sum) && !(hdr->w0.reas_sts)) { + if (hdr->w0.num_frags) { + /* Reassembly success */ + inner = nix_sec_reassemble_frags(hdr, cq_w1, cq_w5); + + /* Update dynamic field with userdata */ + *rte_security_dynfield(inner) = + (uint64_t)inb_priv->userdata; + } else { + const uint64_t *sg; + uint16_t len; + + /* No Reassembly */ + inner = (struct rte_mbuf + *)(rte_be_to_cpu_64( + hdr->wqe_ptr) - + sizeof(struct rte_mbuf)); + + /* Update dynamic field with userdata */ + *rte_security_dynfield(inner) = + (uint64_t)inb_priv->userdata; + + sg = (const uint64_t *)(inner + 1); + len = (((uint64_t)sg[10] >> 16) & 0xFFFF); + inner->pkt_len = + (hdr->w2.il3_off - + sizeof(struct cpt_parse_hdr_s) - + (w0 & 0x7)) + + len; + inner->data_len = inner->pkt_len; + } + } else { + if (hdr->w0.err_sum) { + /* ucode error */ + const uint64_t *sg; + uint16_t len; + + inner = (struct rte_mbuf + *)(rte_be_to_cpu_64( + hdr->wqe_ptr) - + sizeof(struct rte_mbuf)); + + /* Update dynamic field with userdata */ + *rte_security_dynfield(inner) = + (uint64_t)inb_priv->userdata; + + sg = (const uint64_t *)(inner + 1); + len = (((uint64_t)sg[10] >> 16) & 0xFFFF); + inner->pkt_len = + (hdr->w2.il3_off - + sizeof(struct cpt_parse_hdr_s) - + (w0 & 0x7)) + + len; + inner->data_len = inner->pkt_len; + } else if (!(hdr->w0.err_sum)) { + /* reassembly failure */ + inner = nix_sec_attach_frags(hdr, inb_priv); + } + } + + /* Store meta in lmtline to free + * Assume all meta's from same aura. + */ + *(uint64_t *)(laddr + (*loff << 3)) = (uint64_t)mbuf; + *loff = *loff + 1; + + return inner; + } else if (cq_w1 & BIT(11)) { inner = (struct rte_mbuf *)(rte_be_to_cpu_64(hdr->wqe_ptr) - sizeof(struct rte_mbuf)); @@ -130,9 +429,10 @@ nix_sec_meta_to_mbuf_sc(uint64_t cq_w1, const uint64_t sa_base, uintptr_t laddr, #if defined(RTE_ARCH_ARM64) static __rte_always_inline struct rte_mbuf * -nix_sec_meta_to_mbuf(uint64_t cq_w1, uintptr_t sa_base, uintptr_t laddr, +nix_sec_meta_to_mbuf(uint64_t cq_w1, uint64_t cq_w5, uintptr_t sa_base, uintptr_t laddr, uint8_t *loff, struct rte_mbuf *mbuf, uint16_t data_off, - uint8x16_t *rx_desc_field1, uint64_t *ol_flags) + uint8x16_t *rx_desc_field1, uint64_t *ol_flags, + const uint16_t flags) { const void *__p = (void *)((uintptr_t)mbuf + (uint16_t)data_off); const struct cpt_parse_hdr_s *hdr = (const struct cpt_parse_hdr_s *)__p; @@ -144,7 +444,112 @@ nix_sec_meta_to_mbuf(uint64_t cq_w1, uintptr_t sa_base, uintptr_t laddr, uint16_t len; uint64_t w0; - if (cq_w1 & BIT(11)) { + if ((flags & NIX_RX_OFFLOAD_REASSEMBLY_F) && (cq_w1 & BIT(11))) { + + w0 = hdr->w0.u64; + sa_idx = w0 >> 32; + + /* Get SPI from CPT_PARSE_S's cookie(already swapped) */ + w0 = hdr->w0.u64; + sa_idx = w0 >> 32; + + inb_sa = roc_nix_inl_ot_ipsec_inb_sa(sa_base, sa_idx); + inb_priv = roc_nix_inl_ot_ipsec_inb_sa_sw_rsvd(inb_sa); + + if (!(hdr->w0.err_sum) && !(hdr->w0.reas_sts)) { + if (hdr->w0.num_frags) { + /* Reassembly success */ + inner = nix_sec_reassemble_frags(hdr, cq_w1, cq_w5); + + /* Update dynamic field with userdata */ + *rte_security_dynfield(inner) = + (uint64_t)inb_priv->userdata; + } else { + + inner = (struct rte_mbuf + *)(rte_be_to_cpu_64( + hdr->wqe_ptr) - + sizeof(struct rte_mbuf)); + /* Update dynamic field with userdata */ + *rte_security_dynfield(inner) = + (uint64_t)inb_priv->userdata; + + /* CPT result(struct cpt_cn10k_res_s) is at + * after first IOVA in meta + */ + sg = (uint64_t *)(inner + 1); + res_w1 = sg[10]; + + /* Clear checksum flags and update security flag + */ + *ol_flags &= ~(RTE_MBUF_F_RX_L4_CKSUM_MASK | + RTE_MBUF_F_RX_IP_CKSUM_MASK); + *ol_flags |= + (((res_w1 & 0xFF) == CPT_COMP_WARN) ? + RTE_MBUF_F_RX_SEC_OFFLOAD : + (RTE_MBUF_F_RX_SEC_OFFLOAD | + RTE_MBUF_F_RX_SEC_OFFLOAD_FAILED)); + /* Calculate inner packet length */ + len = ((res_w1 >> 16) & 0xFFFF) + + hdr->w2.il3_off - + sizeof(struct cpt_parse_hdr_s) - + (w0 & 0x7); + /* Update pkt_len and data_len */ + *rx_desc_field1 = + vsetq_lane_u16(len, *rx_desc_field1, 2); + *rx_desc_field1 = + vsetq_lane_u16(len, *rx_desc_field1, 4); + } + } else { + if (hdr->w0.err_sum) { + inner = (struct rte_mbuf + *)(rte_be_to_cpu_64( + hdr->wqe_ptr) - + sizeof(struct rte_mbuf)); + /* Update dynamic field with userdata */ + *rte_security_dynfield(inner) = + (uint64_t)inb_priv->userdata; + + /* CPT result(struct cpt_cn10k_res_s) is at + * after first IOVA in meta + */ + sg = (uint64_t *)(inner + 1); + res_w1 = sg[10]; + + /* Clear checksum flags and update security flag + */ + *ol_flags &= ~(RTE_MBUF_F_RX_L4_CKSUM_MASK | + RTE_MBUF_F_RX_IP_CKSUM_MASK); + *ol_flags |= + (((res_w1 & 0xFF) == CPT_COMP_WARN) ? + RTE_MBUF_F_RX_SEC_OFFLOAD : + (RTE_MBUF_F_RX_SEC_OFFLOAD | + RTE_MBUF_F_RX_SEC_OFFLOAD_FAILED)); + /* Calculate inner packet length */ + len = ((res_w1 >> 16) & 0xFFFF) + + hdr->w2.il3_off - + sizeof(struct cpt_parse_hdr_s) - + (w0 & 0x7); + /* Update pkt_len and data_len */ + *rx_desc_field1 = + vsetq_lane_u16(len, *rx_desc_field1, 2); + *rx_desc_field1 = + vsetq_lane_u16(len, *rx_desc_field1, 4); + } else if (!(hdr->w0.err_sum)) { + /* reassembly failure */ + inner = nix_sec_attach_frags(hdr, inb_priv); + } + } + /* Store meta in lmtline to free + * Assume all meta's from same aura. + */ + *(uint64_t *)(laddr + (*loff << 3)) = (uint64_t)mbuf; + *loff = *loff + 1; + + /* Return inner mbuf */ + return inner; + + } else if (cq_w1 & BIT(11)) { inner = (struct rte_mbuf *)(rte_be_to_cpu_64(hdr->wqe_ptr) - sizeof(struct rte_mbuf)); /* Get SPI from CPT_PARSE_S's cookie(already swapped) */ @@ -320,7 +725,21 @@ cn10k_nix_cqe_to_mbuf(const struct nix_cqe_hdr_s *cq, const uint32_t tag, } /* Process Security packets */ - if (flag & NIX_RX_OFFLOAD_SECURITY_F) { + if (flag & NIX_RX_OFFLOAD_REASSEMBLY_F) { + if (w1 & BIT(11)) { + /* CPT result(struct cpt_cn10k_res_s) is at + * after first IOVA in meta + */ + const uint64_t *sg = (const uint64_t *)(mbuf + 1); + const uint64_t res_w1 = sg[10]; + const uint16_t uc_cc = res_w1 & 0xFF; + + ol_flags |= ((uc_cc == CPT_COMP_WARN) ? + RTE_MBUF_F_RX_SEC_OFFLOAD : + (RTE_MBUF_F_RX_SEC_OFFLOAD | + RTE_MBUF_F_RX_SEC_OFFLOAD_FAILED)); + } + } else if (flag & NIX_RX_OFFLOAD_SECURITY_F) { if (w1 & BIT(11)) { /* CPT result(struct cpt_cn10k_res_s) is at * after first IOVA in meta @@ -359,13 +778,20 @@ cn10k_nix_cqe_to_mbuf(const struct nix_cqe_hdr_s *cq, const uint32_t tag, ol_flags = nix_update_match_id(rx->match_id, ol_flags, mbuf); mbuf->ol_flags = ol_flags; - mbuf->pkt_len = len; - mbuf->data_len = len; - *(uint64_t *)(&mbuf->rearm_data) = val; + if (!(flag & NIX_RX_OFFLOAD_REASSEMBLY_F)) { + mbuf->data_len = len; + mbuf->pkt_len = len; + *(uint64_t *)(&mbuf->rearm_data) = val; + } else { + uint16_t data_off = mbuf->data_off; + + *(uint64_t *)(&mbuf->rearm_data) = val; + mbuf->data_off = data_off; + } if (flag & NIX_RX_MULTI_SEG_F) nix_cqe_xtract_mseg(rx, mbuf, val, flag); - else + else if (!(flag & NIX_RX_OFFLOAD_REASSEMBLY_F)) mbuf->next = NULL; } @@ -443,9 +869,11 @@ cn10k_nix_recv_pkts(void *rx_queue, struct rte_mbuf **rx_pkts, uint16_t pkts, /* Translate meta to mbuf */ if (flags & NIX_RX_OFFLOAD_SECURITY_F) { const uint64_t cq_w1 = *((const uint64_t *)cq + 1); + const uint64_t cq_w5 = *((const uint64_t *)cq + 5); - mbuf = nix_sec_meta_to_mbuf_sc(cq_w1, sa_base, laddr, - &loff, mbuf, data_off); + mbuf = nix_sec_meta_to_mbuf_sc(cq_w1, cq_w5, sa_base, laddr, + &loff, mbuf, data_off, + flags); } cn10k_nix_cqe_to_mbuf(cq, cq->tag, mbuf, lookup_mem, mbuf_init, @@ -711,25 +1139,29 @@ cn10k_nix_recv_pkts_vector(void *args, struct rte_mbuf **mbufs, uint16_t pkts, /* Translate meta to mbuf */ if (flags & NIX_RX_OFFLOAD_SECURITY_F) { + uint64_t cq0_w5 = *(uint64_t *)(cq0 + CQE_SZ(0) + 40); + uint64_t cq1_w5 = *(uint64_t *)(cq0 + CQE_SZ(1) + 40); + uint64_t cq2_w5 = *(uint64_t *)(cq0 + CQE_SZ(2) + 40); + uint64_t cq3_w5 = *(uint64_t *)(cq0 + CQE_SZ(3) + 40); /* Checksum ol_flags will be cleared if mbuf is meta */ - mbuf0 = nix_sec_meta_to_mbuf(cq0_w1, sa_base, laddr, + mbuf0 = nix_sec_meta_to_mbuf(cq0_w1, cq0_w5, sa_base, laddr, &loff, mbuf0, d_off, &f0, - &ol_flags0); + &ol_flags0, flags); mbuf01 = vsetq_lane_u64((uint64_t)mbuf0, mbuf01, 0); - mbuf1 = nix_sec_meta_to_mbuf(cq1_w1, sa_base, laddr, + mbuf1 = nix_sec_meta_to_mbuf(cq1_w1, cq1_w5, sa_base, laddr, &loff, mbuf1, d_off, &f1, - &ol_flags1); + &ol_flags1, flags); mbuf01 = vsetq_lane_u64((uint64_t)mbuf1, mbuf01, 1); - mbuf2 = nix_sec_meta_to_mbuf(cq2_w1, sa_base, laddr, + mbuf2 = nix_sec_meta_to_mbuf(cq2_w1, cq2_w5, sa_base, laddr, &loff, mbuf2, d_off, &f2, - &ol_flags2); + &ol_flags2, flags); mbuf23 = vsetq_lane_u64((uint64_t)mbuf2, mbuf23, 0); - mbuf3 = nix_sec_meta_to_mbuf(cq3_w1, sa_base, laddr, + mbuf3 = nix_sec_meta_to_mbuf(cq3_w1, cq3_w5, sa_base, laddr, &loff, mbuf3, d_off, &f3, - &ol_flags3); + &ol_flags3, flags); mbuf23 = vsetq_lane_u64((uint64_t)mbuf3, mbuf23, 1); } @@ -986,6 +1418,7 @@ cn10k_nix_recv_pkts_vector(void *args, struct rte_mbuf **mbufs, uint16_t pkts, #define TS_F NIX_RX_OFFLOAD_TSTAMP_F #define RX_VLAN_F NIX_RX_OFFLOAD_VLAN_STRIP_F #define R_SEC_F NIX_RX_OFFLOAD_SECURITY_F +#define R_REAS_F NIX_RX_OFFLOAD_REASSEMBLY_F /* [R_SEC_F] [RX_VLAN_F] [TS] [MARK] [CKSUM] [PTYPE] [RSS] */ #define NIX_RX_FASTPATH_MODES_0_15 \ @@ -1152,6 +1585,183 @@ cn10k_nix_recv_pkts_vector(void *args, struct rte_mbuf **mbufs, uint16_t pkts, R(sec_vlan_ts_mark_cksum_ptype_rss, \ R_SEC_F | RX_VLAN_F | TS_F | MARK_F | CKSUM_F | PTYPE_F | RSS_F) +#define NIX_RX_FASTPATH_MODES_128_143 \ + R(reas, R_REAS_F) \ + R(reas_rss, R_REAS_F | RSS_F) \ + R(reas_ptype, R_REAS_F | PTYPE_F) \ + R(reas_ptype_rss, R_REAS_F | PTYPE_F | RSS_F) \ + R(reas_cksum, R_REAS_F | CKSUM_F) \ + R(reas_cksum_rss, R_REAS_F | CKSUM_F | RSS_F) \ + R(reas_cksum_ptype, R_REAS_F | CKSUM_F | PTYPE_F) \ + R(reas_cksum_ptype_rss, R_REAS_F | CKSUM_F | PTYPE_F | RSS_F) \ + R(reas_mark, R_REAS_F | MARK_F) \ + R(reas_mark_rss, R_REAS_F | MARK_F | RSS_F) \ + R(reas_mark_ptype, R_REAS_F | MARK_F | PTYPE_F) \ + R(reas_mark_ptype_rss, R_REAS_F | MARK_F | PTYPE_F | RSS_F) \ + R(reas_mark_cksum, R_REAS_F | MARK_F | CKSUM_F) \ + R(reas_mark_cksum_rss, R_REAS_F | MARK_F | CKSUM_F | RSS_F) \ + R(reas_mark_cksum_ptype, R_REAS_F | MARK_F | CKSUM_F | PTYPE_F) \ + R(reas_mark_cksum_ptype_rss, \ + R_REAS_F | MARK_F | CKSUM_F | PTYPE_F | RSS_F) + +#define NIX_RX_FASTPATH_MODES_144_159 \ + R(reas_ts, R_REAS_F | TS_F) \ + R(reas_ts_rss, R_REAS_F | TS_F | RSS_F) \ + R(reas_ts_ptype, R_REAS_F | TS_F | PTYPE_F) \ + R(reas_ts_ptype_rss, R_REAS_F | TS_F | PTYPE_F | RSS_F) \ + R(reas_ts_cksum, R_REAS_F | TS_F | CKSUM_F) \ + R(reas_ts_cksum_rss, R_REAS_F | TS_F | CKSUM_F | RSS_F) \ + R(reas_ts_cksum_ptype, R_REAS_F | TS_F | CKSUM_F | PTYPE_F) \ + R(reas_ts_cksum_ptype_rss, R_REAS_F | TS_F | CKSUM_F | PTYPE_F | RSS_F) \ + R(reas_ts_mark, R_REAS_F | TS_F | MARK_F) \ + R(reas_ts_mark_rss, R_REAS_F | TS_F | MARK_F | RSS_F) \ + R(reas_ts_mark_ptype, R_REAS_F | TS_F | MARK_F | PTYPE_F) \ + R(reas_ts_mark_ptype_rss, R_REAS_F | TS_F | MARK_F | PTYPE_F | RSS_F) \ + R(reas_ts_mark_cksum, R_REAS_F | TS_F | MARK_F | CKSUM_F) \ + R(reas_ts_mark_cksum_rss, R_REAS_F | TS_F | MARK_F | CKSUM_F | RSS_F) \ + R(reas_ts_mark_cksum_ptype, \ + R_REAS_F | TS_F | MARK_F | CKSUM_F | PTYPE_F) \ + R(reas_ts_mark_cksum_ptype_rss, \ + R_REAS_F | TS_F | MARK_F | CKSUM_F | PTYPE_F | RSS_F) + +#define NIX_RX_FASTPATH_MODES_160_175 \ + R(reas_vlan, R_REAS_F | RX_VLAN_F) \ + R(reas_vlan_rss, R_REAS_F | RX_VLAN_F | RSS_F) \ + R(reas_vlan_ptype, R_REAS_F | RX_VLAN_F | PTYPE_F) \ + R(reas_vlan_ptype_rss, R_REAS_F | RX_VLAN_F | PTYPE_F | RSS_F) \ + R(reas_vlan_cksum, R_REAS_F | RX_VLAN_F | CKSUM_F) \ + R(reas_vlan_cksum_rss, R_REAS_F | RX_VLAN_F | CKSUM_F | RSS_F) \ + R(reas_vlan_cksum_ptype, R_REAS_F | RX_VLAN_F | CKSUM_F | PTYPE_F) \ + R(reas_vlan_cksum_ptype_rss, \ + R_REAS_F | RX_VLAN_F | CKSUM_F | PTYPE_F | RSS_F) \ + R(reas_vlan_mark, R_REAS_F | RX_VLAN_F | MARK_F) \ + R(reas_vlan_mark_rss, R_REAS_F | RX_VLAN_F | MARK_F | RSS_F) \ + R(reas_vlan_mark_ptype, R_REAS_F | RX_VLAN_F | MARK_F | PTYPE_F) \ + R(reas_vlan_mark_ptype_rss, \ + R_REAS_F | RX_VLAN_F | MARK_F | PTYPE_F | RSS_F) \ + R(reas_vlan_mark_cksum, R_REAS_F | RX_VLAN_F | MARK_F | CKSUM_F) \ + R(reas_vlan_mark_cksum_rss, \ + R_REAS_F | RX_VLAN_F | MARK_F | CKSUM_F | RSS_F) \ + R(reas_vlan_mark_cksum_ptype, \ + R_REAS_F | RX_VLAN_F | MARK_F | CKSUM_F | PTYPE_F) \ + R(reas_vlan_mark_cksum_ptype_rss, \ + R_REAS_F | RX_VLAN_F | MARK_F | CKSUM_F | PTYPE_F | RSS_F) + +#define NIX_RX_FASTPATH_MODES_176_191 \ + R(reas_vlan_ts, R_REAS_F | RX_VLAN_F | TS_F) \ + R(reas_vlan_ts_rss, R_REAS_F | RX_VLAN_F | TS_F | RSS_F) \ + R(reas_vlan_ts_ptype, R_REAS_F | RX_VLAN_F | TS_F | PTYPE_F) \ + R(reas_vlan_ts_ptype_rss, R_REAS_F | RX_VLAN_F | TS_F | PTYPE_F | RSS_F) \ + R(reas_vlan_ts_cksum, R_REAS_F | RX_VLAN_F | TS_F | CKSUM_F) \ + R(reas_vlan_ts_cksum_rss, R_REAS_F | RX_VLAN_F | TS_F | CKSUM_F | RSS_F) \ + R(reas_vlan_ts_cksum_ptype, \ + R_REAS_F | RX_VLAN_F | TS_F | CKSUM_F | PTYPE_F) \ + R(reas_vlan_ts_cksum_ptype_rss, \ + R_REAS_F | RX_VLAN_F | TS_F | CKSUM_F | PTYPE_F | RSS_F) \ + R(reas_vlan_ts_mark, R_REAS_F | RX_VLAN_F | TS_F | MARK_F) \ + R(reas_vlan_ts_mark_rss, R_REAS_F | RX_VLAN_F | TS_F | MARK_F | RSS_F) \ + R(reas_vlan_ts_mark_ptype, \ + R_REAS_F | RX_VLAN_F | TS_F | MARK_F | PTYPE_F) \ + R(reas_vlan_ts_mark_ptype_rss, \ + R_REAS_F | RX_VLAN_F | TS_F | MARK_F | PTYPE_F | RSS_F) \ + R(reas_vlan_ts_mark_cksum, \ + R_REAS_F | RX_VLAN_F | TS_F | MARK_F | CKSUM_F) \ + R(reas_vlan_ts_mark_cksum_rss, \ + R_REAS_F | RX_VLAN_F | TS_F | MARK_F | CKSUM_F | RSS_F) \ + R(reas_vlan_ts_mark_cksum_ptype, \ + R_REAS_F | RX_VLAN_F | TS_F | MARK_F | CKSUM_F | PTYPE_F) \ + R(reas_vlan_ts_mark_cksum_ptype_rss, \ + R_REAS_F | RX_VLAN_F | TS_F | MARK_F | CKSUM_F | PTYPE_F | RSS_F) + +#define NIX_RX_FASTPATH_MODES_192_207 \ + R(reas_sec, R_REAS_F | R_SEC_F) \ + R(reas_sec_rss, R_REAS_F | R_SEC_F | RSS_F) \ + R(reas_sec_ptype, R_REAS_F | R_SEC_F | PTYPE_F) \ + R(reas_sec_ptype_rss, R_REAS_F | R_SEC_F | PTYPE_F | RSS_F) \ + R(reas_sec_cksum, R_REAS_F | R_SEC_F | CKSUM_F) \ + R(reas_sec_cksum_rss, R_REAS_F | R_SEC_F | CKSUM_F | RSS_F) \ + R(reas_sec_cksum_ptype, R_REAS_F | R_SEC_F | CKSUM_F | PTYPE_F) \ + R(reas_sec_cksum_ptype_rss, R_REAS_F | R_SEC_F | CKSUM_F | PTYPE_F | RSS_F) \ + R(reas_sec_mark, R_REAS_F | R_SEC_F | MARK_F) \ + R(reas_sec_mark_rss, R_REAS_F | R_SEC_F | MARK_F | RSS_F) \ + R(reas_sec_mark_ptype, R_REAS_F | R_SEC_F | MARK_F | PTYPE_F) \ + R(reas_sec_mark_ptype_rss, R_REAS_F | R_SEC_F | MARK_F | PTYPE_F | RSS_F) \ + R(reas_sec_mark_cksum, R_REAS_F | R_SEC_F | MARK_F | CKSUM_F) \ + R(reas_sec_mark_cksum_rss, R_REAS_F | R_SEC_F | MARK_F | CKSUM_F | RSS_F) \ + R(reas_sec_mark_cksum_ptype, R_REAS_F | R_SEC_F | MARK_F | CKSUM_F | PTYPE_F) \ + R(reas_sec_mark_cksum_ptype_rss, \ + R_REAS_F | R_SEC_F | MARK_F | CKSUM_F | PTYPE_F | RSS_F) + +#define NIX_RX_FASTPATH_MODES_208_223 \ + R(reas_sec_ts, R_REAS_F | R_SEC_F | TS_F) \ + R(reas_sec_ts_rss, R_REAS_F | R_SEC_F | TS_F | RSS_F) \ + R(reas_sec_ts_ptype, R_REAS_F | R_SEC_F | TS_F | PTYPE_F) \ + R(reas_sec_ts_ptype_rss, R_REAS_F | R_SEC_F | TS_F | PTYPE_F | RSS_F) \ + R(reas_sec_ts_cksum, R_REAS_F | R_SEC_F | TS_F | CKSUM_F) \ + R(reas_sec_ts_cksum_rss, R_REAS_F | R_SEC_F | TS_F | CKSUM_F | RSS_F) \ + R(reas_sec_ts_cksum_ptype, R_REAS_F | R_SEC_F | TS_F | CKSUM_F | PTYPE_F) \ + R(reas_sec_ts_cksum_ptype_rss, R_REAS_F | R_SEC_F | TS_F | CKSUM_F | PTYPE_F | RSS_F) \ + R(reas_sec_ts_mark, R_REAS_F | R_SEC_F | TS_F | MARK_F) \ + R(reas_sec_ts_mark_rss, R_REAS_F | R_SEC_F | TS_F | MARK_F | RSS_F) \ + R(reas_sec_ts_mark_ptype, R_REAS_F | R_SEC_F | TS_F | MARK_F | PTYPE_F) \ + R(reas_sec_ts_mark_ptype_rss, R_REAS_F | R_SEC_F | TS_F | MARK_F | PTYPE_F | RSS_F) \ + R(reas_sec_ts_mark_cksum, R_REAS_F | R_SEC_F | TS_F | MARK_F | CKSUM_F) \ + R(reas_sec_ts_mark_cksum_rss, R_REAS_F | R_SEC_F | TS_F | MARK_F | CKSUM_F | RSS_F) \ + R(reas_sec_ts_mark_cksum_ptype, \ + R_REAS_F | R_SEC_F | TS_F | MARK_F | CKSUM_F | PTYPE_F) \ + R(reas_sec_ts_mark_cksum_ptype_rss, \ + R_REAS_F | R_SEC_F | TS_F | MARK_F | CKSUM_F | PTYPE_F | RSS_F) + +#define NIX_RX_FASTPATH_MODES_224_239 \ + R(reas_sec_vlan, R_REAS_F | R_SEC_F | RX_VLAN_F) \ + R(reas_sec_vlan_rss, R_REAS_F | R_SEC_F | RX_VLAN_F | RSS_F) \ + R(reas_sec_vlan_ptype, R_REAS_F | R_SEC_F | RX_VLAN_F | PTYPE_F) \ + R(reas_sec_vlan_ptype_rss, R_REAS_F | R_SEC_F | RX_VLAN_F | PTYPE_F | RSS_F) \ + R(reas_sec_vlan_cksum, R_REAS_F | R_SEC_F | RX_VLAN_F | CKSUM_F) \ + R(reas_sec_vlan_cksum_rss, R_REAS_F | R_SEC_F | RX_VLAN_F | CKSUM_F | RSS_F) \ + R(reas_sec_vlan_cksum_ptype, R_REAS_F | R_SEC_F | RX_VLAN_F | CKSUM_F | PTYPE_F) \ + R(reas_sec_vlan_cksum_ptype_rss, \ + R_REAS_F | R_SEC_F | RX_VLAN_F | CKSUM_F | PTYPE_F | RSS_F) \ + R(reas_sec_vlan_mark, R_REAS_F | R_SEC_F | RX_VLAN_F | MARK_F) \ + R(reas_sec_vlan_mark_rss, R_REAS_F | R_SEC_F | RX_VLAN_F | MARK_F | RSS_F) \ + R(reas_sec_vlan_mark_ptype, R_REAS_F | R_SEC_F | RX_VLAN_F | MARK_F | PTYPE_F) \ + R(reas_sec_vlan_mark_ptype_rss, \ + R_REAS_F | R_SEC_F | RX_VLAN_F | MARK_F | PTYPE_F | RSS_F) \ + R(reas_sec_vlan_mark_cksum, R_REAS_F | R_SEC_F | RX_VLAN_F | MARK_F | CKSUM_F) \ + R(reas_sec_vlan_mark_cksum_rss, \ + R_REAS_F | R_SEC_F | RX_VLAN_F | MARK_F | CKSUM_F | RSS_F) \ + R(reas_sec_vlan_mark_cksum_ptype, \ + R_REAS_F | R_SEC_F | RX_VLAN_F | MARK_F | CKSUM_F | PTYPE_F) \ + R(reas_sec_vlan_mark_cksum_ptype_rss, \ + R_REAS_F | R_SEC_F | RX_VLAN_F | MARK_F | CKSUM_F | PTYPE_F | RSS_F) + +#define NIX_RX_FASTPATH_MODES_240_255 \ + R(reas_sec_vlan_ts, R_REAS_F | R_SEC_F | RX_VLAN_F | TS_F) \ + R(reas_sec_vlan_ts_rss, R_REAS_F | R_SEC_F | RX_VLAN_F | TS_F | RSS_F) \ + R(reas_sec_vlan_ts_ptype, R_REAS_F | R_SEC_F | RX_VLAN_F | TS_F | PTYPE_F) \ + R(reas_sec_vlan_ts_ptype_rss, R_REAS_F | R_SEC_F | RX_VLAN_F | TS_F | PTYPE_F | RSS_F) \ + R(reas_sec_vlan_ts_cksum, R_REAS_F | R_SEC_F | RX_VLAN_F | TS_F | CKSUM_F) \ + R(reas_sec_vlan_ts_cksum_rss, R_REAS_F | R_SEC_F | RX_VLAN_F | TS_F | CKSUM_F | RSS_F) \ + R(reas_sec_vlan_ts_cksum_ptype, \ + R_REAS_F | R_SEC_F | RX_VLAN_F | TS_F | CKSUM_F | PTYPE_F) \ + R(reas_sec_vlan_ts_cksum_ptype_rss, \ + R_REAS_F | R_SEC_F | RX_VLAN_F | TS_F | CKSUM_F | PTYPE_F | RSS_F) \ + R(reas_sec_vlan_ts_mark, R_REAS_F | R_SEC_F | RX_VLAN_F | TS_F | MARK_F) \ + R(reas_sec_vlan_ts_mark_rss, R_REAS_F | R_SEC_F | RX_VLAN_F | TS_F | MARK_F | RSS_F) \ + R(reas_sec_vlan_ts_mark_ptype, \ + R_REAS_F | R_SEC_F | RX_VLAN_F | TS_F | MARK_F | PTYPE_F) \ + R(reas_sec_vlan_ts_mark_ptype_rss, \ + R_REAS_F | R_SEC_F | RX_VLAN_F | TS_F | MARK_F | PTYPE_F | RSS_F) \ + R(reas_sec_vlan_ts_mark_cksum, \ + R_REAS_F | R_SEC_F | RX_VLAN_F | TS_F | MARK_F | CKSUM_F) \ + R(reas_sec_vlan_ts_mark_cksum_rss, \ + R_REAS_F | R_SEC_F | RX_VLAN_F | TS_F | MARK_F | CKSUM_F | RSS_F) \ + R(reas_sec_vlan_ts_mark_cksum_ptype, \ + R_REAS_F | R_SEC_F | RX_VLAN_F | TS_F | MARK_F | CKSUM_F | PTYPE_F) \ + R(reas_sec_vlan_ts_mark_cksum_ptype_rss, \ + R_REAS_F | R_SEC_F | RX_VLAN_F | TS_F | MARK_F | CKSUM_F | PTYPE_F | RSS_F) + + #define NIX_RX_FASTPATH_MODES \ NIX_RX_FASTPATH_MODES_0_15 \ NIX_RX_FASTPATH_MODES_16_31 \ @@ -1160,7 +1770,15 @@ cn10k_nix_recv_pkts_vector(void *args, struct rte_mbuf **mbufs, uint16_t pkts, NIX_RX_FASTPATH_MODES_64_79 \ NIX_RX_FASTPATH_MODES_80_95 \ NIX_RX_FASTPATH_MODES_96_111 \ - NIX_RX_FASTPATH_MODES_112_127 + NIX_RX_FASTPATH_MODES_112_127 \ + NIX_RX_FASTPATH_MODES_128_143 \ + NIX_RX_FASTPATH_MODES_144_159 \ + NIX_RX_FASTPATH_MODES_160_175 \ + NIX_RX_FASTPATH_MODES_176_191 \ + NIX_RX_FASTPATH_MODES_192_207 \ + NIX_RX_FASTPATH_MODES_208_223 \ + NIX_RX_FASTPATH_MODES_224_239 \ + NIX_RX_FASTPATH_MODES_240_255 #define R(name, flags) \ uint16_t __rte_noinline __rte_hot cn10k_nix_recv_pkts_##name( \ diff --git a/drivers/net/cnxk/cnxk_ethdev.c b/drivers/net/cnxk/cnxk_ethdev.c index 74f625553d..47810a2c64 100644 --- a/drivers/net/cnxk/cnxk_ethdev.c +++ b/drivers/net/cnxk/cnxk_ethdev.c @@ -12,6 +12,9 @@ nix_get_rx_offload_capa(struct cnxk_eth_dev *dev) dev->npc.switch_header_type == ROC_PRIV_FLAGS_HIGIG) capa &= ~RTE_ETH_RX_OFFLOAD_TIMESTAMP; + if (roc_model_is_cn10ka() && !roc_nix_is_sdp(&dev->nix)) + capa |= RTE_ETH_RX_OFFLOAD_IP_REASSEMBLY; + return capa; } diff --git a/drivers/net/cnxk/cnxk_ethdev_ops.c b/drivers/net/cnxk/cnxk_ethdev_ops.c index ce5f1f7240..6ae9c706d9 100644 --- a/drivers/net/cnxk/cnxk_ethdev_ops.c +++ b/drivers/net/cnxk/cnxk_ethdev_ops.c @@ -65,6 +65,11 @@ cnxk_nix_info_get(struct rte_eth_dev *eth_dev, struct rte_eth_dev_info *devinfo) .nb_mtu_seg_max = CNXK_NIX_TX_NB_SEG_MAX, }; + if (roc_model_is_cn10ka()) { + devinfo->reass_capa.reass_timeout = 60 * 1000; + devinfo->reass_capa.max_frags = 4; + } + devinfo->speed_capa = dev->speed_capa; devinfo->dev_capa = RTE_ETH_DEV_CAPA_RUNTIME_RX_QUEUE_SETUP | RTE_ETH_DEV_CAPA_RUNTIME_TX_QUEUE_SETUP; diff --git a/drivers/net/cnxk/meson.build b/drivers/net/cnxk/meson.build index 375c75d1c7..35b9b4fbdb 100644 --- a/drivers/net/cnxk/meson.build +++ b/drivers/net/cnxk/meson.build @@ -120,6 +120,14 @@ sources += files( 'rx/cn10k/rx_80_95.c', 'rx/cn10k/rx_96_111.c', 'rx/cn10k/rx_112_127.c', + 'rx/cn10k/rx_128_143.c', + 'rx/cn10k/rx_144_159.c', + 'rx/cn10k/rx_160_175.c', + 'rx/cn10k/rx_176_191.c', + 'rx/cn10k/rx_192_207.c', + 'rx/cn10k/rx_208_223.c', + 'rx/cn10k/rx_224_239.c', + 'rx/cn10k/rx_240_255.c', 'rx/cn10k/rx_0_15_mseg.c', 'rx/cn10k/rx_16_31_mseg.c', 'rx/cn10k/rx_32_47_mseg.c', @@ -128,6 +136,14 @@ sources += files( 'rx/cn10k/rx_80_95_mseg.c', 'rx/cn10k/rx_96_111_mseg.c', 'rx/cn10k/rx_112_127_mseg.c', + 'rx/cn10k/rx_128_143_mseg.c', + 'rx/cn10k/rx_144_159_mseg.c', + 'rx/cn10k/rx_160_175_mseg.c', + 'rx/cn10k/rx_176_191_mseg.c', + 'rx/cn10k/rx_192_207_mseg.c', + 'rx/cn10k/rx_208_223_mseg.c', + 'rx/cn10k/rx_224_239_mseg.c', + 'rx/cn10k/rx_240_255_mseg.c', 'rx/cn10k/rx_0_15_vec.c', 'rx/cn10k/rx_16_31_vec.c', 'rx/cn10k/rx_32_47_vec.c', @@ -136,6 +152,14 @@ sources += files( 'rx/cn10k/rx_80_95_vec.c', 'rx/cn10k/rx_96_111_vec.c', 'rx/cn10k/rx_112_127_vec.c', + 'rx/cn10k/rx_128_143_vec.c', + 'rx/cn10k/rx_144_159_vec.c', + 'rx/cn10k/rx_160_175_vec.c', + 'rx/cn10k/rx_176_191_vec.c', + 'rx/cn10k/rx_192_207_vec.c', + 'rx/cn10k/rx_208_223_vec.c', + 'rx/cn10k/rx_224_239_vec.c', + 'rx/cn10k/rx_240_255_vec.c', 'rx/cn10k/rx_0_15_vec_mseg.c', 'rx/cn10k/rx_16_31_vec_mseg.c', 'rx/cn10k/rx_32_47_vec_mseg.c', @@ -144,6 +168,14 @@ sources += files( 'rx/cn10k/rx_80_95_vec_mseg.c', 'rx/cn10k/rx_96_111_vec_mseg.c', 'rx/cn10k/rx_112_127_vec_mseg.c', + 'rx/cn10k/rx_128_143_vec_mseg.c', + 'rx/cn10k/rx_144_159_vec_mseg.c', + 'rx/cn10k/rx_160_175_vec_mseg.c', + 'rx/cn10k/rx_176_191_vec_mseg.c', + 'rx/cn10k/rx_192_207_vec_mseg.c', + 'rx/cn10k/rx_208_223_vec_mseg.c', + 'rx/cn10k/rx_224_239_vec_mseg.c', + 'rx/cn10k/rx_240_255_vec_mseg.c', ) sources += files( diff --git a/drivers/net/cnxk/rx/cn10k/rx_128_143.c b/drivers/net/cnxk/rx/cn10k/rx_128_143.c new file mode 100644 index 0000000000..8c33b5b383 --- /dev/null +++ b/drivers/net/cnxk/rx/cn10k/rx_128_143.c @@ -0,0 +1,11 @@ +/* SPDX-License-Identifier: BSD-3-Clause + * Copyright(C) 2021 Marvell. + */ + +#include "cn10k_ethdev.h" +#include "cn10k_rx.h" + +#define R(name, flags) NIX_RX_RECV(cn10k_nix_recv_pkts_##name, flags) + +NIX_RX_FASTPATH_MODES_128_143 +#undef R diff --git a/drivers/net/cnxk/rx/cn10k/rx_128_143_mseg.c b/drivers/net/cnxk/rx/cn10k/rx_128_143_mseg.c new file mode 100644 index 0000000000..172fa190dd --- /dev/null +++ b/drivers/net/cnxk/rx/cn10k/rx_128_143_mseg.c @@ -0,0 +1,11 @@ +/* SPDX-License-Identifier: BSD-3-Clause + * Copyright(C) 2021 Marvell. + */ + +#include "cn10k_ethdev.h" +#include "cn10k_rx.h" + +#define R(name, flags) NIX_RX_RECV_MSEG(cn10k_nix_recv_pkts_mseg_##name, flags) + +NIX_RX_FASTPATH_MODES_128_143 +#undef R diff --git a/drivers/net/cnxk/rx/cn10k/rx_128_143_vec.c b/drivers/net/cnxk/rx/cn10k/rx_128_143_vec.c new file mode 100644 index 0000000000..fa0182ee3c --- /dev/null +++ b/drivers/net/cnxk/rx/cn10k/rx_128_143_vec.c @@ -0,0 +1,11 @@ +/* SPDX-License-Identifier: BSD-3-Clause + * Copyright(C) 2021 Marvell. + */ + +#include "cn10k_ethdev.h" +#include "cn10k_rx.h" + +#define R(name, flags) NIX_RX_RECV_VEC(cn10k_nix_recv_pkts_vec_##name, flags) + +NIX_RX_FASTPATH_MODES_128_143 +#undef R diff --git a/drivers/net/cnxk/rx/cn10k/rx_128_143_vec_mseg.c b/drivers/net/cnxk/rx/cn10k/rx_128_143_vec_mseg.c new file mode 100644 index 0000000000..620d6817ed --- /dev/null +++ b/drivers/net/cnxk/rx/cn10k/rx_128_143_vec_mseg.c @@ -0,0 +1,12 @@ +/* SPDX-License-Identifier: BSD-3-Clause + * Copyright(C) 2021 Marvell. + */ + +#include "cn10k_ethdev.h" +#include "cn10k_rx.h" + +#define R(name, flags) \ + NIX_RX_RECV_VEC_MSEG(cn10k_nix_recv_pkts_vec_mseg_##name, flags) + +NIX_RX_FASTPATH_MODES_128_143 +#undef R diff --git a/drivers/net/cnxk/rx/cn10k/rx_144_159.c b/drivers/net/cnxk/rx/cn10k/rx_144_159.c new file mode 100644 index 0000000000..4f5bf2be77 --- /dev/null +++ b/drivers/net/cnxk/rx/cn10k/rx_144_159.c @@ -0,0 +1,11 @@ +/* SPDX-License-Identifier: BSD-3-Clause + * Copyright(C) 2021 Marvell. + */ + +#include "cn10k_ethdev.h" +#include "cn10k_rx.h" + +#define R(name, flags) NIX_RX_RECV(cn10k_nix_recv_pkts_##name, flags) + +NIX_RX_FASTPATH_MODES_144_159 +#undef R diff --git a/drivers/net/cnxk/rx/cn10k/rx_144_159_mseg.c b/drivers/net/cnxk/rx/cn10k/rx_144_159_mseg.c new file mode 100644 index 0000000000..acc2adbd2a --- /dev/null +++ b/drivers/net/cnxk/rx/cn10k/rx_144_159_mseg.c @@ -0,0 +1,11 @@ +/* SPDX-License-Identifier: BSD-3-Clause + * Copyright(C) 2021 Marvell. + */ + +#include "cn10k_ethdev.h" +#include "cn10k_rx.h" + +#define R(name, flags) NIX_RX_RECV_MSEG(cn10k_nix_recv_pkts_mseg_##name, flags) + +NIX_RX_FASTPATH_MODES_144_159 +#undef R diff --git a/drivers/net/cnxk/rx/cn10k/rx_144_159_vec.c b/drivers/net/cnxk/rx/cn10k/rx_144_159_vec.c new file mode 100644 index 0000000000..cfb8ca424e --- /dev/null +++ b/drivers/net/cnxk/rx/cn10k/rx_144_159_vec.c @@ -0,0 +1,11 @@ +/* SPDX-License-Identifier: BSD-3-Clause + * Copyright(C) 2021 Marvell. + */ + +#include "cn10k_ethdev.h" +#include "cn10k_rx.h" + +#define R(name, flags) NIX_RX_RECV_VEC(cn10k_nix_recv_pkts_vec_##name, flags) + +NIX_RX_FASTPATH_MODES_144_159 +#undef R diff --git a/drivers/net/cnxk/rx/cn10k/rx_144_159_vec_mseg.c b/drivers/net/cnxk/rx/cn10k/rx_144_159_vec_mseg.c new file mode 100644 index 0000000000..68acf2f169 --- /dev/null +++ b/drivers/net/cnxk/rx/cn10k/rx_144_159_vec_mseg.c @@ -0,0 +1,12 @@ +/* SPDX-License-Identifier: BSD-3-Clause + * Copyright(C) 2021 Marvell. + */ + +#include "cn10k_ethdev.h" +#include "cn10k_rx.h" + +#define R(name, flags) \ + NIX_RX_RECV_VEC_MSEG(cn10k_nix_recv_pkts_vec_mseg_##name, flags) + +NIX_RX_FASTPATH_MODES_144_159 +#undef R diff --git a/drivers/net/cnxk/rx/cn10k/rx_160_175.c b/drivers/net/cnxk/rx/cn10k/rx_160_175.c new file mode 100644 index 0000000000..e14e730453 --- /dev/null +++ b/drivers/net/cnxk/rx/cn10k/rx_160_175.c @@ -0,0 +1,11 @@ +/* SPDX-License-Identifier: BSD-3-Clause + * Copyright(C) 2021 Marvell. + */ + +#include "cn10k_ethdev.h" +#include "cn10k_rx.h" + +#define R(name, flags) NIX_RX_RECV(cn10k_nix_recv_pkts_##name, flags) + +NIX_RX_FASTPATH_MODES_160_175 +#undef R diff --git a/drivers/net/cnxk/rx/cn10k/rx_160_175_mseg.c b/drivers/net/cnxk/rx/cn10k/rx_160_175_mseg.c new file mode 100644 index 0000000000..fb0a551278 --- /dev/null +++ b/drivers/net/cnxk/rx/cn10k/rx_160_175_mseg.c @@ -0,0 +1,11 @@ +/* SPDX-License-Identifier: BSD-3-Clause + * Copyright(C) 2021 Marvell. + */ + +#include "cn10k_ethdev.h" +#include "cn10k_rx.h" + +#define R(name, flags) NIX_RX_RECV_MSEG(cn10k_nix_recv_pkts_mseg_##name, flags) + +NIX_RX_FASTPATH_MODES_160_175 +#undef R diff --git a/drivers/net/cnxk/rx/cn10k/rx_160_175_vec.c b/drivers/net/cnxk/rx/cn10k/rx_160_175_vec.c new file mode 100644 index 0000000000..eae8fb977a --- /dev/null +++ b/drivers/net/cnxk/rx/cn10k/rx_160_175_vec.c @@ -0,0 +1,11 @@ +/* SPDX-License-Identifier: BSD-3-Clause + * Copyright(C) 2021 Marvell. + */ + +#include "cn10k_ethdev.h" +#include "cn10k_rx.h" + +#define R(name, flags) NIX_RX_RECV_VEC(cn10k_nix_recv_pkts_vec_##name, flags) + +NIX_RX_FASTPATH_MODES_160_175 +#undef R diff --git a/drivers/net/cnxk/rx/cn10k/rx_160_175_vec_mseg.c b/drivers/net/cnxk/rx/cn10k/rx_160_175_vec_mseg.c new file mode 100644 index 0000000000..89faf62fdc --- /dev/null +++ b/drivers/net/cnxk/rx/cn10k/rx_160_175_vec_mseg.c @@ -0,0 +1,12 @@ +/* SPDX-License-Identifier: BSD-3-Clause + * Copyright(C) 2021 Marvell. + */ + +#include "cn10k_ethdev.h" +#include "cn10k_rx.h" + +#define R(name, flags) \ + NIX_RX_RECV_VEC_MSEG(cn10k_nix_recv_pkts_vec_mseg_##name, flags) + +NIX_RX_FASTPATH_MODES_160_175 +#undef R diff --git a/drivers/net/cnxk/rx/cn10k/rx_176_191.c b/drivers/net/cnxk/rx/cn10k/rx_176_191.c new file mode 100644 index 0000000000..0d25f35913 --- /dev/null +++ b/drivers/net/cnxk/rx/cn10k/rx_176_191.c @@ -0,0 +1,11 @@ +/* SPDX-License-Identifier: BSD-3-Clause + * Copyright(C) 2021 Marvell. + */ + +#include "cn10k_ethdev.h" +#include "cn10k_rx.h" + +#define R(name, flags) NIX_RX_RECV(cn10k_nix_recv_pkts_##name, flags) + +NIX_RX_FASTPATH_MODES_176_191 +#undef R diff --git a/drivers/net/cnxk/rx/cn10k/rx_176_191_mseg.c b/drivers/net/cnxk/rx/cn10k/rx_176_191_mseg.c new file mode 100644 index 0000000000..dd67fefcbb --- /dev/null +++ b/drivers/net/cnxk/rx/cn10k/rx_176_191_mseg.c @@ -0,0 +1,11 @@ +/* SPDX-License-Identifier: BSD-3-Clause + * Copyright(C) 2021 Marvell. + */ + +#include "cn10k_ethdev.h" +#include "cn10k_rx.h" + +#define R(name, flags) NIX_RX_RECV_MSEG(cn10k_nix_recv_pkts_mseg_##name, flags) + +NIX_RX_FASTPATH_MODES_176_191 +#undef R diff --git a/drivers/net/cnxk/rx/cn10k/rx_176_191_vec.c b/drivers/net/cnxk/rx/cn10k/rx_176_191_vec.c new file mode 100644 index 0000000000..a86ef5d24c --- /dev/null +++ b/drivers/net/cnxk/rx/cn10k/rx_176_191_vec.c @@ -0,0 +1,11 @@ +/* SPDX-License-Identifier: BSD-3-Clause + * Copyright(C) 2021 Marvell. + */ + +#include "cn10k_ethdev.h" +#include "cn10k_rx.h" + +#define R(name, flags) NIX_RX_RECV_VEC(cn10k_nix_recv_pkts_vec_##name, flags) + +NIX_RX_FASTPATH_MODES_176_191 +#undef R diff --git a/drivers/net/cnxk/rx/cn10k/rx_176_191_vec_mseg.c b/drivers/net/cnxk/rx/cn10k/rx_176_191_vec_mseg.c new file mode 100644 index 0000000000..c07a2ba7ce --- /dev/null +++ b/drivers/net/cnxk/rx/cn10k/rx_176_191_vec_mseg.c @@ -0,0 +1,12 @@ +/* SPDX-License-Identifier: BSD-3-Clause + * Copyright(C) 2021 Marvell. + */ + +#include "cn10k_ethdev.h" +#include "cn10k_rx.h" + +#define R(name, flags) \ + NIX_RX_RECV_VEC_MSEG(cn10k_nix_recv_pkts_vec_mseg_##name, flags) + +NIX_RX_FASTPATH_MODES_176_191 +#undef R diff --git a/drivers/net/cnxk/rx/cn10k/rx_192_207.c b/drivers/net/cnxk/rx/cn10k/rx_192_207.c new file mode 100644 index 0000000000..45da8e9997 --- /dev/null +++ b/drivers/net/cnxk/rx/cn10k/rx_192_207.c @@ -0,0 +1,11 @@ +/* SPDX-License-Identifier: BSD-3-Clause + * Copyright(C) 2021 Marvell. + */ + +#include "cn10k_ethdev.h" +#include "cn10k_rx.h" + +#define R(name, flags) NIX_RX_RECV(cn10k_nix_recv_pkts_##name, flags) + +NIX_RX_FASTPATH_MODES_192_207 +#undef R diff --git a/drivers/net/cnxk/rx/cn10k/rx_192_207_mseg.c b/drivers/net/cnxk/rx/cn10k/rx_192_207_mseg.c new file mode 100644 index 0000000000..869be355f9 --- /dev/null +++ b/drivers/net/cnxk/rx/cn10k/rx_192_207_mseg.c @@ -0,0 +1,11 @@ +/* SPDX-License-Identifier: BSD-3-Clause + * Copyright(C) 2021 Marvell. + */ + +#include "cn10k_ethdev.h" +#include "cn10k_rx.h" + +#define R(name, flags) NIX_RX_RECV_MSEG(cn10k_nix_recv_pkts_mseg_##name, flags) + +NIX_RX_FASTPATH_MODES_192_207 +#undef R diff --git a/drivers/net/cnxk/rx/cn10k/rx_192_207_vec.c b/drivers/net/cnxk/rx/cn10k/rx_192_207_vec.c new file mode 100644 index 0000000000..3d214158ec --- /dev/null +++ b/drivers/net/cnxk/rx/cn10k/rx_192_207_vec.c @@ -0,0 +1,11 @@ +/* SPDX-License-Identifier: BSD-3-Clause + * Copyright(C) 2021 Marvell. + */ + +#include "cn10k_ethdev.h" +#include "cn10k_rx.h" + +#define R(name, flags) NIX_RX_RECV_VEC(cn10k_nix_recv_pkts_vec_##name, flags) + +NIX_RX_FASTPATH_MODES_192_207 +#undef R diff --git a/drivers/net/cnxk/rx/cn10k/rx_192_207_vec_mseg.c b/drivers/net/cnxk/rx/cn10k/rx_192_207_vec_mseg.c new file mode 100644 index 0000000000..762e9f5512 --- /dev/null +++ b/drivers/net/cnxk/rx/cn10k/rx_192_207_vec_mseg.c @@ -0,0 +1,12 @@ +/* SPDX-License-Identifier: BSD-3-Clause + * Copyright(C) 2021 Marvell. + */ + +#include "cn10k_ethdev.h" +#include "cn10k_rx.h" + +#define R(name, flags) \ + NIX_RX_RECV_VEC_MSEG(cn10k_nix_recv_pkts_vec_mseg_##name, flags) + +NIX_RX_FASTPATH_MODES_192_207 +#undef R diff --git a/drivers/net/cnxk/rx/cn10k/rx_208_223.c b/drivers/net/cnxk/rx/cn10k/rx_208_223.c new file mode 100644 index 0000000000..ca64ab5fde --- /dev/null +++ b/drivers/net/cnxk/rx/cn10k/rx_208_223.c @@ -0,0 +1,11 @@ +/* SPDX-License-Identifier: BSD-3-Clause + * Copyright(C) 2021 Marvell. + */ + +#include "cn10k_ethdev.h" +#include "cn10k_rx.h" + +#define R(name, flags) NIX_RX_RECV(cn10k_nix_recv_pkts_##name, flags) + +NIX_RX_FASTPATH_MODES_208_223 +#undef R diff --git a/drivers/net/cnxk/rx/cn10k/rx_208_223_mseg.c b/drivers/net/cnxk/rx/cn10k/rx_208_223_mseg.c new file mode 100644 index 0000000000..35e443a06e --- /dev/null +++ b/drivers/net/cnxk/rx/cn10k/rx_208_223_mseg.c @@ -0,0 +1,11 @@ +/* SPDX-License-Identifier: BSD-3-Clause + * Copyright(C) 2021 Marvell. + */ + +#include "cn10k_ethdev.h" +#include "cn10k_rx.h" + +#define R(name, flags) NIX_RX_RECV_MSEG(cn10k_nix_recv_pkts_mseg_##name, flags) + +NIX_RX_FASTPATH_MODES_208_223 +#undef R diff --git a/drivers/net/cnxk/rx/cn10k/rx_208_223_vec.c b/drivers/net/cnxk/rx/cn10k/rx_208_223_vec.c new file mode 100644 index 0000000000..b7f9feece2 --- /dev/null +++ b/drivers/net/cnxk/rx/cn10k/rx_208_223_vec.c @@ -0,0 +1,11 @@ +/* SPDX-License-Identifier: BSD-3-Clause + * Copyright(C) 2021 Marvell. + */ + +#include "cn10k_ethdev.h" +#include "cn10k_rx.h" + +#define R(name, flags) NIX_RX_RECV_VEC(cn10k_nix_recv_pkts_vec_##name, flags) + +NIX_RX_FASTPATH_MODES_208_223 +#undef R diff --git a/drivers/net/cnxk/rx/cn10k/rx_208_223_vec_mseg.c b/drivers/net/cnxk/rx/cn10k/rx_208_223_vec_mseg.c new file mode 100644 index 0000000000..b3da6ec11e --- /dev/null +++ b/drivers/net/cnxk/rx/cn10k/rx_208_223_vec_mseg.c @@ -0,0 +1,12 @@ +/* SPDX-License-Identifier: BSD-3-Clause + * Copyright(C) 2021 Marvell. + */ + +#include "cn10k_ethdev.h" +#include "cn10k_rx.h" + +#define R(name, flags) \ + NIX_RX_RECV_VEC_MSEG(cn10k_nix_recv_pkts_vec_mseg_##name, flags) + +NIX_RX_FASTPATH_MODES_208_223 +#undef R diff --git a/drivers/net/cnxk/rx/cn10k/rx_224_239.c b/drivers/net/cnxk/rx/cn10k/rx_224_239.c new file mode 100644 index 0000000000..bd288f3330 --- /dev/null +++ b/drivers/net/cnxk/rx/cn10k/rx_224_239.c @@ -0,0 +1,11 @@ +/* SPDX-License-Identifier: BSD-3-Clause + * Copyright(C) 2021 Marvell. + */ + +#include "cn10k_ethdev.h" +#include "cn10k_rx.h" + +#define R(name, flags) NIX_RX_RECV(cn10k_nix_recv_pkts_##name, flags) + +NIX_RX_FASTPATH_MODES_224_239 +#undef R diff --git a/drivers/net/cnxk/rx/cn10k/rx_224_239_mseg.c b/drivers/net/cnxk/rx/cn10k/rx_224_239_mseg.c new file mode 100644 index 0000000000..bf5af065df --- /dev/null +++ b/drivers/net/cnxk/rx/cn10k/rx_224_239_mseg.c @@ -0,0 +1,11 @@ +/* SPDX-License-Identifier: BSD-3-Clause + * Copyright(C) 2021 Marvell. + */ + +#include "cn10k_ethdev.h" +#include "cn10k_rx.h" + +#define R(name, flags) NIX_RX_RECV_MSEG(cn10k_nix_recv_pkts_mseg_##name, flags) + +NIX_RX_FASTPATH_MODES_224_239 +#undef R diff --git a/drivers/net/cnxk/rx/cn10k/rx_224_239_vec.c b/drivers/net/cnxk/rx/cn10k/rx_224_239_vec.c new file mode 100644 index 0000000000..c05bb99414 --- /dev/null +++ b/drivers/net/cnxk/rx/cn10k/rx_224_239_vec.c @@ -0,0 +1,11 @@ +/* SPDX-License-Identifier: BSD-3-Clause + * Copyright(C) 2021 Marvell. + */ + +#include "cn10k_ethdev.h" +#include "cn10k_rx.h" + +#define R(name, flags) NIX_RX_RECV_VEC(cn10k_nix_recv_pkts_vec_##name, flags) + +NIX_RX_FASTPATH_MODES_224_239 +#undef R diff --git a/drivers/net/cnxk/rx/cn10k/rx_224_239_vec_mseg.c b/drivers/net/cnxk/rx/cn10k/rx_224_239_vec_mseg.c new file mode 100644 index 0000000000..5f7f8efdae --- /dev/null +++ b/drivers/net/cnxk/rx/cn10k/rx_224_239_vec_mseg.c @@ -0,0 +1,12 @@ +/* SPDX-License-Identifier: BSD-3-Clause + * Copyright(C) 2021 Marvell. + */ + +#include "cn10k_ethdev.h" +#include "cn10k_rx.h" + +#define R(name, flags) \ + NIX_RX_RECV_VEC_MSEG(cn10k_nix_recv_pkts_vec_mseg_##name, flags) + +NIX_RX_FASTPATH_MODES_224_239 +#undef R diff --git a/drivers/net/cnxk/rx/cn10k/rx_240_255.c b/drivers/net/cnxk/rx/cn10k/rx_240_255.c new file mode 100644 index 0000000000..d72b2eec1c --- /dev/null +++ b/drivers/net/cnxk/rx/cn10k/rx_240_255.c @@ -0,0 +1,11 @@ +/* SPDX-License-Identifier: BSD-3-Clause + * Copyright(C) 2021 Marvell. + */ + +#include "cn10k_ethdev.h" +#include "cn10k_rx.h" + +#define R(name, flags) NIX_RX_RECV(cn10k_nix_recv_pkts_##name, flags) + +NIX_RX_FASTPATH_MODES_240_255 +#undef R diff --git a/drivers/net/cnxk/rx/cn10k/rx_240_255_mseg.c b/drivers/net/cnxk/rx/cn10k/rx_240_255_mseg.c new file mode 100644 index 0000000000..f248ad8c77 --- /dev/null +++ b/drivers/net/cnxk/rx/cn10k/rx_240_255_mseg.c @@ -0,0 +1,11 @@ +/* SPDX-License-Identifier: BSD-3-Clause + * Copyright(C) 2021 Marvell. + */ + +#include "cn10k_ethdev.h" +#include "cn10k_rx.h" + +#define R(name, flags) NIX_RX_RECV_MSEG(cn10k_nix_recv_pkts_mseg_##name, flags) + +NIX_RX_FASTPATH_MODES_240_255 +#undef R diff --git a/drivers/net/cnxk/rx/cn10k/rx_240_255_vec.c b/drivers/net/cnxk/rx/cn10k/rx_240_255_vec.c new file mode 100644 index 0000000000..7e81ed1883 --- /dev/null +++ b/drivers/net/cnxk/rx/cn10k/rx_240_255_vec.c @@ -0,0 +1,11 @@ +/* SPDX-License-Identifier: BSD-3-Clause + * Copyright(C) 2021 Marvell. + */ + +#include "cn10k_ethdev.h" +#include "cn10k_rx.h" + +#define R(name, flags) NIX_RX_RECV_VEC(cn10k_nix_recv_pkts_vec_##name, flags) + +NIX_RX_FASTPATH_MODES_240_255 +#undef R diff --git a/drivers/net/cnxk/rx/cn10k/rx_240_255_vec_mseg.c b/drivers/net/cnxk/rx/cn10k/rx_240_255_vec_mseg.c new file mode 100644 index 0000000000..db8aeca013 --- /dev/null +++ b/drivers/net/cnxk/rx/cn10k/rx_240_255_vec_mseg.c @@ -0,0 +1,12 @@ +/* SPDX-License-Identifier: BSD-3-Clause + * Copyright(C) 2021 Marvell. + */ + +#include "cn10k_ethdev.h" +#include "cn10k_rx.h" + +#define R(name, flags) \ + NIX_RX_RECV_VEC_MSEG(cn10k_nix_recv_pkts_vec_mseg_##name, flags) + +NIX_RX_FASTPATH_MODES_240_255 +#undef R