From patchwork Fri Jan 14 03:10:34 2022 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: "John Daley (johndale)" X-Patchwork-Id: 105798 X-Patchwork-Delegate: ferruh.yigit@amd.com Return-Path: X-Original-To: patchwork@inbox.dpdk.org Delivered-To: patchwork@inbox.dpdk.org Received: from mails.dpdk.org (mails.dpdk.org [217.70.189.124]) by inbox.dpdk.org (Postfix) with ESMTP id 8A6C6A00C3; Fri, 14 Jan 2022 04:11:14 +0100 (CET) Received: from [217.70.189.124] (localhost [127.0.0.1]) by mails.dpdk.org (Postfix) with ESMTP id A24474275C; Fri, 14 Jan 2022 04:11:13 +0100 (CET) Received: from alln-iport-7.cisco.com (alln-iport-7.cisco.com [173.37.142.94]) by mails.dpdk.org (Postfix) with ESMTP id AF5B342757 for ; Fri, 14 Jan 2022 04:11:11 +0100 (CET) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=cisco.com; i=@cisco.com; l=4048; q=dns/txt; s=iport; t=1642129871; x=1643339471; h=from:to:cc:subject:date:message-id:in-reply-to: references:mime-version:content-transfer-encoding; bh=hIPI9Vt6FLoFK1/oe+ObUwKP1b2dUtTVJJd3LM7TgIo=; b=PcLSo++OMoiknqLgqXRmIsiYtORd/mlZW4naySU2LsuYYuYgzKCwPIov 0Tiue70eq38j9Y+ehlsGLi069QTF9LTNmRfnDVvxRXTZekhAZ8eSdQlPY s5z/lwsG7FzJZ3Hpz/4y0Q773f66GJqIP9uPNC3WNcmW/vGJNmPUgrFdY I=; X-IronPort-AV: E=Sophos;i="5.88,287,1635206400"; d="scan'208";a="800683483" Received: from alln-core-6.cisco.com ([173.36.13.139]) by alln-iport-7.cisco.com with ESMTP/TLS/DHE-RSA-SEED-SHA; 14 Jan 2022 03:11:10 +0000 Received: from cisco.com (savbu-usnic-a.cisco.com [10.193.184.48]) by alln-core-6.cisco.com (8.15.2/8.15.2) with ESMTP id 20E3BAux023681; Fri, 14 Jan 2022 03:11:10 GMT Received: by cisco.com (Postfix, from userid 392789) id 7AB8B20F2003; Thu, 13 Jan 2022 19:11:10 -0800 (PST) From: John Daley To: ferruh.yigit@intel.com, arybchenko@solarflare.com Cc: dev@dpdk.org, John Daley , Hyong Youb Kim Subject: [PATCH 1/3] net/enic: add support for eCPRI matching Date: Thu, 13 Jan 2022 19:10:34 -0800 Message-Id: <20220114031036.19052-2-johndale@cisco.com> X-Mailer: git-send-email 2.33.1 In-Reply-To: <20220114031036.19052-1-johndale@cisco.com> References: <20220114031036.19052-1-johndale@cisco.com> MIME-Version: 1.0 X-Outbound-SMTP-Client: 10.193.184.48, savbu-usnic-a.cisco.com X-Outbound-Node: alln-core-6.cisco.com X-BeenThere: dev@dpdk.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: DPDK patches and discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: dev-bounces@dpdk.org eCPRI message can be over Ethernet layer (.1Q supported also) or over UDP layer. Message header formats are the same in these two variants. Only up though the first packet header in the PDU can be matched. RSS on the eCPRI header fields is not supported. Signed-off-by: John Daley Reviewed-by: Hyong Youb Kim --- doc/guides/rel_notes/release_22_03.rst | 1 + drivers/net/enic/enic_fm_flow.c | 65 ++++++++++++++++++++++++++ 2 files changed, 66 insertions(+) diff --git a/doc/guides/rel_notes/release_22_03.rst b/doc/guides/rel_notes/release_22_03.rst index b38dc54e62..52d1e32cf6 100644 --- a/doc/guides/rel_notes/release_22_03.rst +++ b/doc/guides/rel_notes/release_22_03.rst @@ -58,6 +58,7 @@ New Features * **Updated Cisco enic driver.** * Added rte_flow support for matching GENEVE packets. + * Added rte_flow support for matching eCPRI packets. Removed Items ------------- diff --git a/drivers/net/enic/enic_fm_flow.c b/drivers/net/enic/enic_fm_flow.c index 752ffeb5c5..589c9253e1 100644 --- a/drivers/net/enic/enic_fm_flow.c +++ b/drivers/net/enic/enic_fm_flow.c @@ -237,6 +237,7 @@ static enic_copy_item_fn enic_fm_copy_item_vxlan; static enic_copy_item_fn enic_fm_copy_item_gtp; static enic_copy_item_fn enic_fm_copy_item_geneve; static enic_copy_item_fn enic_fm_copy_item_geneve_opt; +static enic_copy_item_fn enic_fm_copy_item_ecpri; /* Ingress actions */ static const enum rte_flow_action_type enic_fm_supported_ig_actions[] = { @@ -392,6 +393,15 @@ static const struct enic_fm_items enic_fm_items[] = { RTE_FLOW_ITEM_TYPE_END, }, }, + [RTE_FLOW_ITEM_TYPE_ECPRI] = { + .copy_item = enic_fm_copy_item_ecpri, + .valid_start_item = 1, + .prev_items = (const enum rte_flow_item_type[]) { + RTE_FLOW_ITEM_TYPE_ETH, + RTE_FLOW_ITEM_TYPE_UDP, + RTE_FLOW_ITEM_TYPE_END, + }, + }, }; static int @@ -877,6 +887,61 @@ enic_fm_copy_item_geneve_opt(struct copy_item_args *arg) return 0; } +/* Match eCPRI combined message header */ +static int +enic_fm_copy_item_ecpri(struct copy_item_args *arg) +{ + const struct rte_flow_item *item = arg->item; + const struct rte_flow_item_ecpri *spec = item->spec; + const struct rte_flow_item_ecpri *mask = item->mask; + struct fm_tcam_match_entry *entry = arg->fm_tcam_entry; + struct fm_header_set *fm_data, *fm_mask; + uint8_t *fm_data_to, *fm_mask_to; + + ENICPMD_FUNC_TRACE(); + + /* Tunneling not supported- only matching on inner eCPRI fields. */ + if (arg->header_level > 0) + return -EINVAL; + + /* Need both spec and mask */ + if (!spec || !mask) + return -EINVAL; + + fm_data = &entry->ftm_data.fk_hdrset[0]; + fm_mask = &entry->ftm_mask.fk_hdrset[0]; + + /* eCPRI can only follow L2/VLAN layer if ethernet type is 0xAEFE. */ + if (!(fm_data->fk_metadata & FKM_UDP) && + (fm_mask->l2.eth.fk_ethtype != UINT16_MAX || + rte_cpu_to_be_16(fm_data->l2.eth.fk_ethtype) != + RTE_ETHER_TYPE_ECPRI)) + return -EINVAL; + + if (fm_data->fk_metadata & FKM_UDP) { + /* eCPRI on UDP */ + fm_data->fk_header_select |= FKH_L4RAW; + fm_mask->fk_header_select |= FKH_L4RAW; + fm_data_to = &fm_data->l4.rawdata[sizeof(fm_data->l4.udp)]; + fm_mask_to = &fm_mask->l4.rawdata[sizeof(fm_data->l4.udp)]; + } else { + /* eCPRI directly after Etherent header */ + fm_data->fk_header_select |= FKH_L3RAW; + fm_mask->fk_header_select |= FKH_L3RAW; + fm_data_to = &fm_data->l3.rawdata[0]; + fm_mask_to = &fm_mask->l3.rawdata[0]; + } + + /* + * Use the raw L3 or L4 buffer to match eCPRI since fm_header_set does + * not have eCPRI header. Only 1st message header of PDU can be matched. + * "C" * bit ignored. + */ + memcpy(fm_data_to, spec, sizeof(*spec)); + memcpy(fm_mask_to, mask, sizeof(*mask)); + return 0; +} + /* * Currently, raw pattern match is very limited. It is intended for matching * UDP tunnel header (e.g. vxlan or geneve). From patchwork Fri Jan 14 03:10:35 2022 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: "John Daley (johndale)" X-Patchwork-Id: 105799 X-Patchwork-Delegate: ferruh.yigit@amd.com Return-Path: X-Original-To: patchwork@inbox.dpdk.org Delivered-To: patchwork@inbox.dpdk.org Received: from mails.dpdk.org (mails.dpdk.org [217.70.189.124]) by inbox.dpdk.org (Postfix) with ESMTP id B09DCA00C3; Fri, 14 Jan 2022 04:11:24 +0100 (CET) Received: from [217.70.189.124] (localhost [127.0.0.1]) by mails.dpdk.org (Postfix) with ESMTP id A32BD42757; Fri, 14 Jan 2022 04:11:24 +0100 (CET) Received: from alln-iport-3.cisco.com (alln-iport-3.cisco.com [173.37.142.90]) by mails.dpdk.org (Postfix) with ESMTP id E8F3840DDD for ; Fri, 14 Jan 2022 04:11:22 +0100 (CET) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=cisco.com; i=@cisco.com; l=1492; q=dns/txt; s=iport; t=1642129883; x=1643339483; h=from:to:cc:subject:date:message-id:in-reply-to: references:mime-version:content-transfer-encoding; bh=RwefjWnUJWKF1xSBViPB97nEYjfiwRjSJCVdTL6aAkI=; b=i0LBvRm81cQ6sFJerjXwhwHCyoVvpmXfKkNARaMRyRhYZ7Ay+PviUr3G mClqudHkU0cAMbstK0M3yXS7MG4WPbdEzmhQiCnDSQXgYPwAB1VkJDJK0 8AcwFglj2jql/j5dP0vHtJsdwRrLq4MUchdvXh5/JfLY+j3lxYZ21+us1 w=; X-IronPort-AV: E=Sophos;i="5.88,287,1635206400"; d="scan'208";a="816888856" Received: from alln-core-9.cisco.com ([173.36.13.129]) by alln-iport-3.cisco.com with ESMTP/TLS/DHE-RSA-SEED-SHA; 14 Jan 2022 03:11:22 +0000 Received: from cisco.com (savbu-usnic-a.cisco.com [10.193.184.48]) by alln-core-9.cisco.com (8.15.2/8.15.2) with ESMTP id 20E3BLFU010459; Fri, 14 Jan 2022 03:11:22 GMT Received: by cisco.com (Postfix, from userid 392789) id C59CD20F2003; Thu, 13 Jan 2022 19:11:21 -0800 (PST) From: John Daley To: ferruh.yigit@intel.com, arybchenko@solarflare.com Cc: dev@dpdk.org, John Daley , Hyong Youb Kim Subject: [PATCH 2/3] net/enic: update VIC firmware API Date: Thu, 13 Jan 2022 19:10:35 -0800 Message-Id: <20220114031036.19052-3-johndale@cisco.com> X-Mailer: git-send-email 2.33.1 In-Reply-To: <20220114031036.19052-1-johndale@cisco.com> References: <20220114031036.19052-1-johndale@cisco.com> MIME-Version: 1.0 X-Outbound-SMTP-Client: 10.193.184.48, savbu-usnic-a.cisco.com X-Outbound-Node: alln-core-9.cisco.com X-BeenThere: dev@dpdk.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: DPDK patches and discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: dev-bounces@dpdk.org Update the configuration structure used between the adapter and driver. The structure is compatible with all Cisco VIC adapters. Signed-off-by: John Daley Reviewed-by: Hyong Youb Kim --- drivers/net/enic/base/vnic_enet.h | 22 ++++++++++++++++++++++ 1 file changed, 22 insertions(+) diff --git a/drivers/net/enic/base/vnic_enet.h b/drivers/net/enic/base/vnic_enet.h index 2a97a33044..66261d9127 100644 --- a/drivers/net/enic/base/vnic_enet.h +++ b/drivers/net/enic/base/vnic_enet.h @@ -31,6 +31,28 @@ struct vnic_enet_config { uint32_t rdma_mr_id; uint32_t rdma_mr_count; uint32_t max_pkt_size; + uint16_t vf_subvnic_count; + uint16_t mq_subvnic_count; + uint32_t mq_flags; + + /* the following 3 fields are per-MQ-vnic counts */ + uint32_t mq_rdma_mr_count; + uint16_t mq_rdma_qp_count; + uint16_t mq_rdma_resgrp; + + uint16_t rdma_max_sq_ring_sz; + uint16_t rdma_max_rq_ring_sz; + uint32_t rdma_max_cq_ring_sz; + uint16_t rdma_max_wr_sge; + uint16_t rdma_max_mr_sge; + uint8_t rdma_max_rd_per_qp; + uint8_t unused; /* available */ + uint16_t mq_rdma_engine_count; + uint32_t intr_coal_tick_ns; /* coalescing timer tick in nsec */ + uint32_t max_rq_ring; /* MAX RQ ring size */ + uint32_t max_wq_ring; /* MAX WQ ring size */ + uint32_t max_cq_ring; /* MAX CQ ring size */ + uint32_t rdma_rsvd_lkey; /* Reserved (privileged) LKey */ }; #define VENETF_TSO 0x1 /* TSO enabled */ From patchwork Fri Jan 14 03:10:36 2022 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: "John Daley (johndale)" X-Patchwork-Id: 105800 X-Patchwork-Delegate: ferruh.yigit@amd.com Return-Path: X-Original-To: patchwork@inbox.dpdk.org Delivered-To: patchwork@inbox.dpdk.org Received: from mails.dpdk.org (mails.dpdk.org [217.70.189.124]) by inbox.dpdk.org (Postfix) with ESMTP id B4B25A00C3; Fri, 14 Jan 2022 04:11:32 +0100 (CET) Received: from [217.70.189.124] (localhost [127.0.0.1]) by mails.dpdk.org (Postfix) with ESMTP id A640D42758; Fri, 14 Jan 2022 04:11:32 +0100 (CET) Received: from alln-iport-1.cisco.com (alln-iport-1.cisco.com [173.37.142.88]) by mails.dpdk.org (Postfix) with ESMTP id 47B0B40DDD for ; Fri, 14 Jan 2022 04:11:31 +0100 (CET) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=cisco.com; i=@cisco.com; l=7001; q=dns/txt; s=iport; t=1642129891; x=1643339491; h=from:to:cc:subject:date:message-id:in-reply-to: references:mime-version:content-transfer-encoding; bh=JEPfsyqXvchHQpF7g4QCUYN+LQk8HwGMeizV2GZWcFs=; b=CzN0r5rHXuRqCmQDFX+0CO/latv/ymL3tv5hPCIpUZJ1nDYBK0CMFaO7 TcnSGPnyYbrKkoHo9/BkLug6As4gg7HkpysdBl0jKeBFcXQdnYz0D/4Jf qWxb3DoUpiBd/LJLEDnXNnpwWhOiWPahyVgr3a35BZRgbq3kecV9fGZFE k=; X-IronPort-AV: E=Sophos;i="5.88,287,1635206400"; d="scan'208";a="798076125" Received: from alln-core-9.cisco.com ([173.36.13.129]) by alln-iport-1.cisco.com with ESMTP/TLS/DHE-RSA-SEED-SHA; 14 Jan 2022 03:11:30 +0000 Received: from cisco.com (savbu-usnic-a.cisco.com [10.193.184.48]) by alln-core-9.cisco.com (8.15.2/8.15.2) with ESMTP id 20E3BUTa010646; Fri, 14 Jan 2022 03:11:30 GMT Received: by cisco.com (Postfix, from userid 392789) id 10FDE20F2003; Thu, 13 Jan 2022 19:11:30 -0800 (PST) From: John Daley To: ferruh.yigit@intel.com, arybchenko@solarflare.com Cc: dev@dpdk.org, John Daley , Hyong Youb Kim Subject: [PATCH 3/3] net/enic: support max descriptors allowed by adapter Date: Thu, 13 Jan 2022 19:10:36 -0800 Message-Id: <20220114031036.19052-4-johndale@cisco.com> X-Mailer: git-send-email 2.33.1 In-Reply-To: <20220114031036.19052-1-johndale@cisco.com> References: <20220114031036.19052-1-johndale@cisco.com> MIME-Version: 1.0 X-Outbound-SMTP-Client: 10.193.184.48, savbu-usnic-a.cisco.com X-Outbound-Node: alln-core-9.cisco.com X-BeenThere: dev@dpdk.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: DPDK patches and discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: dev-bounces@dpdk.org Newer VIC adapters have the max number of supported RX and TX descriptors in their configuration. Use these values as the maximums. Signed-off-by: John Daley Reviewed-by: Hyong Youb Kim --- drivers/net/enic/base/cq_enet_desc.h | 6 ++++- drivers/net/enic/enic_res.c | 20 +++++++++++++---- drivers/net/enic/enic_res.h | 6 +++-- drivers/net/enic/enic_rxtx.c | 33 +++++++++++++++++++--------- 4 files changed, 48 insertions(+), 17 deletions(-) diff --git a/drivers/net/enic/base/cq_enet_desc.h b/drivers/net/enic/base/cq_enet_desc.h index a34a4f5400..02db85b9a0 100644 --- a/drivers/net/enic/base/cq_enet_desc.h +++ b/drivers/net/enic/base/cq_enet_desc.h @@ -67,7 +67,8 @@ struct cq_enet_rq_desc_64 { uint16_t vlan; uint16_t checksum_fcoe; uint8_t flags; - uint8_t unused[48]; + uint8_t fetch_idx_flags; + uint8_t unused[47]; uint8_t type_color; }; @@ -92,6 +93,9 @@ struct cq_enet_rq_desc_64 { #define CQ_ENET_RQ_DESC_BYTES_WRITTEN_BITS 14 #define CQ_ENET_RQ_DESC_BYTES_WRITTEN_MASK \ ((1 << CQ_ENET_RQ_DESC_BYTES_WRITTEN_BITS) - 1) +#define CQ_ENET_RQ_DESC_FETCH_IDX_BITS 2 +#define CQ_ENET_RQ_DESC_FETCH_IDX_MASK \ + ((1 << CQ_ENET_RQ_DESC_FETCH_IDX_BITS) - 1) #define CQ_ENET_RQ_DESC_FLAGS_TRUNCATED (0x1 << 14) #define CQ_ENET_RQ_DESC_FLAGS_VLAN_STRIPPED (0x1 << 15) diff --git a/drivers/net/enic/enic_res.c b/drivers/net/enic/enic_res.c index 9cfb857939..caf773bab2 100644 --- a/drivers/net/enic/enic_res.c +++ b/drivers/net/enic/enic_res.c @@ -26,6 +26,7 @@ int enic_get_vnic_config(struct enic *enic) struct vnic_enet_config *c = &enic->config; int err; uint64_t sizes; + uint32_t max_rq_descs, max_wq_descs; err = vnic_dev_get_mac_addr(enic->vdev, enic->mac_addr); if (err) { @@ -57,6 +58,8 @@ int enic_get_vnic_config(struct enic *enic) GET_CONFIG(loop_tag); GET_CONFIG(num_arfs); GET_CONFIG(max_pkt_size); + GET_CONFIG(max_rq_ring); + GET_CONFIG(max_wq_ring); /* max packet size is only defined in newer VIC firmware * and will be 0 for legacy firmware and VICs @@ -101,20 +104,29 @@ int enic_get_vnic_config(struct enic *enic) ((enic->filter_actions & FILTER_ACTION_COUNTER_FLAG) ? "count " : "")); - c->wq_desc_count = RTE_MIN((uint32_t)ENIC_MAX_WQ_DESCS, + /* The max size of RQ and WQ rings are specified in 1500 series VICs and + * beyond. If they are not specified by the VIC or if 64B CQ descriptors + * are not being used, the max number of descriptors is 4096. + */ + max_wq_descs = (enic->cq64_request && c->max_wq_ring) ? c->max_wq_ring : + ENIC_LEGACY_MAX_WQ_DESCS; + c->wq_desc_count = RTE_MIN(max_wq_descs, RTE_MAX((uint32_t)ENIC_MIN_WQ_DESCS, c->wq_desc_count)); c->wq_desc_count &= 0xffffffe0; /* must be aligned to groups of 32 */ - - c->rq_desc_count = RTE_MIN((uint32_t)ENIC_MAX_RQ_DESCS, + max_rq_descs = (enic->cq64_request && c->max_rq_ring) ? c->max_rq_ring + : ENIC_LEGACY_MAX_WQ_DESCS; + c->rq_desc_count = RTE_MIN(max_rq_descs, RTE_MAX((uint32_t)ENIC_MIN_RQ_DESCS, c->rq_desc_count)); c->rq_desc_count &= 0xffffffe0; /* must be aligned to groups of 32 */ + dev_debug(NULL, "Max supported VIC descriptors: WQ:%u, RQ:%u\n", + max_wq_descs, max_rq_descs); c->intr_timer_usec = RTE_MIN(c->intr_timer_usec, vnic_dev_get_intr_coal_timer_max(enic->vdev)); dev_info(enic_get_dev(enic), "vNIC MAC addr " RTE_ETHER_ADDR_PRT_FMT - "wq/rq %d/%d mtu %d, max mtu:%d\n", + " wq/rq %d/%d mtu %d, max mtu:%d\n", enic->mac_addr[0], enic->mac_addr[1], enic->mac_addr[2], enic->mac_addr[3], enic->mac_addr[4], enic->mac_addr[5], c->wq_desc_count, c->rq_desc_count, diff --git a/drivers/net/enic/enic_res.h b/drivers/net/enic/enic_res.h index 34f15d5a42..ae979d52be 100644 --- a/drivers/net/enic/enic_res.h +++ b/drivers/net/enic/enic_res.h @@ -12,9 +12,11 @@ #include "vnic_rq.h" #define ENIC_MIN_WQ_DESCS 64 -#define ENIC_MAX_WQ_DESCS 4096 #define ENIC_MIN_RQ_DESCS 64 -#define ENIC_MAX_RQ_DESCS 4096 + +/* 1400 series VICs and prior all have 4K max, after that it's in the config */ +#define ENIC_LEGACY_MAX_WQ_DESCS 4096 +#define ENIC_LEGACY_MAX_RQ_DESCS 4096 /* A descriptor ring has a multiple of 32 descriptors */ #define ENIC_ALIGN_DESCS 32 diff --git a/drivers/net/enic/enic_rxtx.c b/drivers/net/enic/enic_rxtx.c index c44715bfd0..4681ef6eca 100644 --- a/drivers/net/enic/enic_rxtx.c +++ b/drivers/net/enic/enic_rxtx.c @@ -84,6 +84,7 @@ enic_recv_pkts_common(void *rx_queue, struct rte_mbuf **rx_pkts, uint8_t packet_error; uint16_t ciflags; uint8_t tc; + uint16_t rq_idx_msbs = 0; max_rx--; @@ -94,17 +95,24 @@ enic_recv_pkts_common(void *rx_queue, struct rte_mbuf **rx_pkts, /* Get the cq descriptor and extract rq info from it */ cqd = *cqd_ptr; + /* - * The first 16B of 64B descriptor is identical to the - * 16B descriptor, except type_color. Copy type_color - * from the 64B descriptor into the 16B descriptor's - * field, so the code below can assume the 16B - * descriptor format. + * The first 16B of a 64B descriptor is identical to a 16B + * descriptor except for the type_color and fetch index. Extract + * fetch index and copy the type_color from the 64B to where it + * would be in a 16B descriptor so sebwequent code can run + * without further conditionals. */ - if (use_64b_desc) + if (use_64b_desc) { + rq_idx_msbs = (((volatile struct cq_enet_rq_desc_64 *) + cqd_ptr)->fetch_idx_flags + & CQ_ENET_RQ_DESC_FETCH_IDX_MASK) + << CQ_DESC_COMP_NDX_BITS; cqd.type_color = tc; + } rq_num = cqd.q_number & CQ_DESC_Q_NUM_MASK; - rq_idx = cqd.completed_index & CQ_DESC_COMP_NDX_MASK; + rq_idx = rq_idx_msbs + + (cqd.completed_index & CQ_DESC_COMP_NDX_MASK); rq = &enic->rq[rq_num]; rqd_ptr = ((struct rq_enet_desc *)rq->ring.descs) + rq_idx; @@ -362,14 +370,19 @@ static inline void enic_free_wq_bufs(struct vnic_wq *wq, uint16_t completed_index) { struct rte_mbuf *buf; - struct rte_mbuf *m, *free[ENIC_MAX_WQ_DESCS]; + struct rte_mbuf *m, *free[ENIC_LEGACY_MAX_WQ_DESCS]; unsigned int nb_to_free, nb_free = 0, i; struct rte_mempool *pool; unsigned int tail_idx; unsigned int desc_count = wq->ring.desc_count; - nb_to_free = enic_ring_sub(desc_count, wq->tail_idx, completed_index) - + 1; + /* + * On 1500 Series VIC and beyond, greater than ENIC_LEGACY_MAX_WQ_DESCS + * may be attempted to be freed. Cap it at ENIC_LEGACY_MAX_WQ_DESCS. + */ + nb_to_free = RTE_MIN(enic_ring_sub(desc_count, wq->tail_idx, + completed_index) + 1, + (uint32_t)ENIC_LEGACY_MAX_WQ_DESCS); tail_idx = wq->tail_idx; pool = wq->bufs[tail_idx]->pool; for (i = 0; i < nb_to_free; i++) {