From patchwork Tue Apr 12 14:59:58 2022 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Tal Shnaiderman X-Patchwork-Id: 109615 X-Patchwork-Delegate: rasland@nvidia.com Return-Path: X-Original-To: patchwork@inbox.dpdk.org Delivered-To: patchwork@inbox.dpdk.org Received: from mails.dpdk.org (mails.dpdk.org [217.70.189.124]) by inbox.dpdk.org (Postfix) with ESMTP id 62803A050A; Tue, 12 Apr 2022 17:01:45 +0200 (CEST) Received: from [217.70.189.124] (localhost [127.0.0.1]) by mails.dpdk.org (Postfix) with ESMTP id 0796B42806; Tue, 12 Apr 2022 17:01:27 +0200 (CEST) Received: from NAM10-BN7-obe.outbound.protection.outlook.com (mail-bn7nam10on2053.outbound.protection.outlook.com [40.107.92.53]) by mails.dpdk.org (Postfix) with ESMTP id 44553427ED for ; Tue, 12 Apr 2022 17:01:25 +0200 (CEST) ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=eoxziAMTPWCL7X32vXO2gkpbJEZdh28Phc/qyAEA8u3ng/sKMLyYigo0KnWTqNoHZWbDEYy0hw9uXGHJhc3+x7wyXCwV9dJRHi40MEAZMRE8jcLNjrdjh4TMhaj94GI7/qfnc4FOn9RZVmJT2ADzeoU0KeDQgdyuZIhRgXPqrh1PBlsGtynZVwO2aPINKSTKx7tCTCuK8Zud7TU9U6P5CGK/EiGmn/dxV9+BKmBQfsWqIJbbkdWH82i/yrTSwFT3r2FqBKigDXhHDLaHifRtOrOhjzsso1+Kpgec5n/cMYsjr8aXT6NEWQmdgZPryAqLPK4bEW7dSviXM41FFERhnA== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=nncNWP1rzhPAfiJ5aJKz8ItLkAbvKzjSpXo0IHEh74w=; b=fEUsuG4LBEyo4hsMTz6NH/kTdAJFHiASGlsKl6kvzOlsAIWTds2VOpl4exK1Idi5S71oleh6TkF81rPgHU64+bYs8ILj+hHBS+sbOEbsoAeYvCXV4WfZEyn3gQANKf9/khXx/QFG5gwBopxn9AvkWoXV7vVO1jFBYC1BNMVy96cwVMwCyZaYuzABOu8OiEKKP4eE5pGiJjgUsh/MjQr0WsnFTIbjexT0nQjvtVar8DQNpGF9D68TVtChAs/SVQLS+zSk+vGINnMaAvnVE6Ly1XFh4AkoycNwXM5/b8cCoOm27rGqubbpEaKWeA9pFzmAZuh8t3TAjooK+ZhBX6Fq4Q== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=temperror (sender ip is 12.22.5.236) smtp.rcpttodomain=monjalon.net smtp.mailfrom=nvidia.com; dmarc=temperror action=none header.from=nvidia.com; dkim=none (message not signed); arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=Nvidia.com; s=selector2; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=nncNWP1rzhPAfiJ5aJKz8ItLkAbvKzjSpXo0IHEh74w=; b=iKAS0dRnEuKuAHdTBMbiCotq69jI6lsODQM/y0mp70/nH/irIPnI/GOnfeRq2vxpNW+nWL4JggbptxDWT6algWIkT8Eu/FCNxpDIZN5Ayya6EtqIxG4N83iAUcwnNTpDJPsBAQrRvGhDCZ0YPXmXdi2++Rxn6V4skYqI3O5wyyMA/Sm9UCksDE7R4nWtEN/yw9+j/2M5A+BJVBSq78NJWsJbwKDDPmeLpTjgwMnVAemse0QhgkRFoqj5WKDSiiNnwntTwJAatc3U3VgMnADYMLrJ2sobxsa6qIMrRckDW4LaZvLf2ZAss2HQTLTNu/Jbr8Vky0SJaJGRseLpIS5icA== Received: from DS7PR03CA0107.namprd03.prod.outlook.com (2603:10b6:5:3b7::22) by BN6PR12MB1444.namprd12.prod.outlook.com (2603:10b6:405:10::21) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.5144.29; Tue, 12 Apr 2022 15:01:22 +0000 Received: from DM6NAM11FT063.eop-nam11.prod.protection.outlook.com (2603:10b6:5:3b7:cafe::21) by DS7PR03CA0107.outlook.office365.com (2603:10b6:5:3b7::22) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.5144.23 via Frontend Transport; Tue, 12 Apr 2022 15:01:22 +0000 X-MS-Exchange-Authentication-Results: spf=temperror (sender IP is 12.22.5.236) smtp.mailfrom=nvidia.com; dkim=none (message not signed) header.d=none;dmarc=temperror action=none header.from=nvidia.com; Received-SPF: TempError (protection.outlook.com: error in processing during lookup of nvidia.com: DNS Timeout) Received: from mail.nvidia.com (12.22.5.236) by DM6NAM11FT063.mail.protection.outlook.com (10.13.172.219) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384) id 15.20.5144.20 via Frontend Transport; Tue, 12 Apr 2022 15:01:20 +0000 Received: from rnnvmail201.nvidia.com (10.129.68.8) by DRHQMAIL109.nvidia.com (10.27.9.19) with Microsoft SMTP Server (TLS) id 15.0.1497.32; Tue, 12 Apr 2022 15:01:09 +0000 Received: from nvidia.com (10.126.230.35) by rnnvmail201.nvidia.com (10.129.68.8) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.2.986.22; Tue, 12 Apr 2022 08:01:07 -0700 From: Tal Shnaiderman To: CC: , Subject: [RFC PATCH 1/3] net/mlx5: support multi-packet RQ on Windows Date: Tue, 12 Apr 2022 17:59:58 +0300 Message-ID: <20220412150000.3412-2-talshn@nvidia.com> X-Mailer: git-send-email 2.16.1.windows.4 In-Reply-To: <20220412150000.3412-1-talshn@nvidia.com> References: <20220412150000.3412-1-talshn@nvidia.com> MIME-Version: 1.0 X-Originating-IP: [10.126.230.35] X-ClientProxiedBy: rnnvmail203.nvidia.com (10.129.68.9) To rnnvmail201.nvidia.com (10.129.68.8) X-EOPAttributedMessage: 0 X-MS-PublicTrafficType: Email X-MS-Office365-Filtering-Correlation-Id: 31166148-ca94-4d0e-3b49-08da1c954dd7 X-MS-TrafficTypeDiagnostic: BN6PR12MB1444:EE_ X-LD-Processed: 43083d15-7273-40c1-b7db-39efd9ccc17a,ExtAddr X-Microsoft-Antispam-PRVS: X-MS-Exchange-SenderADCheck: 1 X-MS-Exchange-AntiSpam-Relay: 0 X-Microsoft-Antispam: BCL:0; X-Microsoft-Antispam-Message-Info: A2+PLvCd+QwO5PHrWn4Ftz14k5sDIUdvO4/4oWHF/E5MFeb0QziNLiw6gCuBzeTCwc47NHG3MPAoXkmKu93e6RsIth4gBXwLOaIgyk6xkY+uMwWsSprZvI12+uvSqNCnLPXT6esOcrJeTI+ur683VggPx+y8RbpSnE0YBW5JbIHYzoXNQF6QKU5mpWPLVSDLr1QEymsjBj5CJ9dXaJ3XwZNmJUOUqQ5s3PIfT08iwpQ8/dIr/1YbPx7dJfVwX+HUTTxyhBaM9lAWM++mKhIxNoiQwTyTGfwh+kpjnjxkKmtyALaABxLla8FREShDJnCS1iveEqxv3dmjZlq436Ea9B4G8W0MFQezqbhHnhdz3d0Ug2QLa2Qwqg0F1yvWtuUaXycUZRfCcY/3/pRhP7SB1EzUCjavkhdXKNt/n1H7CS273DH3KR9XWoRP/Bjg/YQiHwLaznsGLXTTQN/8nWn3XhoFDD0tvH13qrOmdE5ySgEo2jG0Q6GI7C9h01PI9M0WYMqPxhBRbfgrFF8UC363SmayQlvQ4J/vRKVXgWkP8apAkxBcmE28nRqHW8LzpdyxU3GOgpyMRuARNlEV34VqG4itMRz6E+nrHf6Je3s1AHKlrR/nm81rcaNwUAe6OAj4fWB+VzBR+5qHiKfuj5Tc60sC6/yRnfrumQTyCYBoCYRj7DrIEZQ33FEOr74jPsc2fkiEz/fKCMZAcZ6BS2Y6ZQ== X-Forefront-Antispam-Report: CIP:12.22.5.236; CTRY:US; LANG:en; SCL:1; SRV:; IPV:CAL; SFV:NSPM; H:mail.nvidia.com; PTR:InfoNoRecords; CAT:NONE; SFS:(13230001)(4636009)(46966006)(40470700004)(36840700001)(26005)(1076003)(5660300002)(86362001)(83380400001)(316002)(63370400001)(40460700003)(186003)(508600001)(63350400001)(6916009)(36756003)(107886003)(6666004)(54906003)(8936002)(426003)(16526019)(2906002)(336012)(47076005)(82310400005)(2616005)(7696005)(55016003)(81166007)(70206006)(36860700001)(356005)(70586007)(6286002)(4326008)(8676002)(36900700001); DIR:OUT; SFP:1101; X-OriginatorOrg: Nvidia.com X-MS-Exchange-CrossTenant-OriginalArrivalTime: 12 Apr 2022 15:01:20.6596 (UTC) X-MS-Exchange-CrossTenant-Network-Message-Id: 31166148-ca94-4d0e-3b49-08da1c954dd7 X-MS-Exchange-CrossTenant-Id: 43083d15-7273-40c1-b7db-39efd9ccc17a X-MS-Exchange-CrossTenant-OriginalAttributedTenantConnectingIp: TenantId=43083d15-7273-40c1-b7db-39efd9ccc17a; Ip=[12.22.5.236]; Helo=[mail.nvidia.com] X-MS-Exchange-CrossTenant-AuthSource: DM6NAM11FT063.eop-nam11.prod.protection.outlook.com X-MS-Exchange-CrossTenant-AuthAs: Anonymous X-MS-Exchange-CrossTenant-FromEntityHeader: HybridOnPrem X-MS-Exchange-Transport-CrossTenantHeadersStamped: BN6PR12MB1444 X-BeenThere: dev@dpdk.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: DPDK patches and discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: dev-bounces@dpdk.org Multi-Packet RQ can further save PCIe bandwidth by posting a single large buffer for multiple packets. Instead of posting a buffer per a packet, one large buffer is posted to receive multiple packets on the buffer. Add support for multi-packet RQ on Windows. The feature is disabled by default and can by enabled by setting mprq_en=1 in the PMD specific arguments. Signed-off-by: Tal Shnaiderman --- drivers/common/mlx5/mlx5_devx_cmds.c | 3 +++ drivers/common/mlx5/mlx5_devx_cmds.h | 2 ++ drivers/common/mlx5/windows/mlx5_win_defs.h | 7 +++++++ drivers/net/mlx5/windows/mlx5_os.c | 26 ++++++++++++++++++++++++++ 4 files changed, 38 insertions(+) diff --git a/drivers/common/mlx5/mlx5_devx_cmds.c b/drivers/common/mlx5/mlx5_devx_cmds.c index d02ac2a678..7900254287 100644 --- a/drivers/common/mlx5/mlx5_devx_cmds.c +++ b/drivers/common/mlx5/mlx5_devx_cmds.c @@ -970,6 +970,9 @@ mlx5_devx_cmd_query_hca_attr(void *ctx, general_obj_types) & MLX5_GENERAL_OBJ_TYPES_CAP_CONN_TRACK_OFFLOAD); attr->rq_delay_drop = MLX5_GET(cmd_hca_cap, hcattr, rq_delay_drop); + attr->striding_rq = MLX5_GET(cmd_hca_cap, hcattr, striding_rq); + attr->ext_stride_num_range = + MLX5_GET(cmd_hca_cap, hcattr, ext_stride_num_range); if (hca_cap_2_sup) { hcattr = mlx5_devx_get_hca_cap(ctx, in, out, &rc, MLX5_GET_HCA_CAP_OP_MOD_GENERAL_DEVICE_2 | diff --git a/drivers/common/mlx5/mlx5_devx_cmds.h b/drivers/common/mlx5/mlx5_devx_cmds.h index 1bac18c59d..2d813c0fdc 100644 --- a/drivers/common/mlx5/mlx5_devx_cmds.h +++ b/drivers/common/mlx5/mlx5_devx_cmds.h @@ -256,6 +256,8 @@ struct mlx5_hca_attr { uint32_t esw_mgr_vport_id_valid:1; /* E-Switch Mgr vport ID is valid. */ uint16_t esw_mgr_vport_id; /* E-Switch Mgr vport ID . */ uint16_t max_wqe_sz_sq; + uint32_t striding_rq:1; + uint32_t ext_stride_num_range:1; }; /* LAG Context. */ diff --git a/drivers/common/mlx5/windows/mlx5_win_defs.h b/drivers/common/mlx5/windows/mlx5_win_defs.h index 3554e4a7ff..822104a109 100644 --- a/drivers/common/mlx5/windows/mlx5_win_defs.h +++ b/drivers/common/mlx5/windows/mlx5_win_defs.h @@ -258,4 +258,11 @@ enum { MLX5_MATCH_MISC_PARAMETERS = 1 << 1, MLX5_MATCH_INNER_HEADERS = 1 << 2, }; + +#define MLX5_MIN_SINGLE_WQE_LOG_NUM_STRIDES 9 +#define MLX5_MAX_SINGLE_WQE_LOG_NUM_STRIDES 16 +#define MLX5_MIN_SINGLE_STRIDE_LOG_NUM_BYTES 6 +#define MLX5_MAX_SINGLE_STRIDE_LOG_NUM_BYTES 13 +#define MLX5_EXT_MIN_SINGLE_WQE_LOG_NUM_STRIDES 3 +#define IB_QPT_RAW_PACKET 8 #endif /* __MLX5_WIN_DEFS_H__ */ diff --git a/drivers/net/mlx5/windows/mlx5_os.c b/drivers/net/mlx5/windows/mlx5_os.c index c7bb81549e..02438ece56 100644 --- a/drivers/net/mlx5/windows/mlx5_os.c +++ b/drivers/net/mlx5/windows/mlx5_os.c @@ -187,6 +187,32 @@ mlx5_os_capabilities_prepare(struct mlx5_dev_ctx_shared *sh) if (sh->dev_cap.tso) sh->dev_cap.tso_max_payload_sz = 1 << hca_attr->max_lso_cap; DRV_LOG(DEBUG, "Counters are not supported."); + if (hca_attr->striding_rq) { + sh->dev_cap.mprq.enabled = 1; + sh->dev_cap.mprq.log_min_stride_size = + MLX5_MIN_SINGLE_STRIDE_LOG_NUM_BYTES; + sh->dev_cap.mprq.log_max_stride_size = + MLX5_MAX_SINGLE_STRIDE_LOG_NUM_BYTES; + if (hca_attr->ext_stride_num_range) + sh->dev_cap.mprq.log_min_stride_num = + MLX5_EXT_MIN_SINGLE_WQE_LOG_NUM_STRIDES; + else + sh->dev_cap.mprq.log_min_stride_num = + MLX5_MIN_SINGLE_WQE_LOG_NUM_STRIDES; + sh->dev_cap.mprq.log_max_stride_num = + MLX5_MAX_SINGLE_WQE_LOG_NUM_STRIDES; + DRV_LOG(DEBUG, "\tmin_single_stride_log_num_of_bytes: %u", + sh->dev_cap.mprq.log_min_stride_size); + DRV_LOG(DEBUG, "\tmax_single_stride_log_num_of_bytes: %u", + sh->dev_cap.mprq.log_max_stride_size); + DRV_LOG(DEBUG, "\tmin_single_wqe_log_num_of_strides: %u", + sh->dev_cap.mprq.log_min_stride_num); + DRV_LOG(DEBUG, "\tmax_single_wqe_log_num_of_strides: %u", + sh->dev_cap.mprq.log_max_stride_num); + DRV_LOG(DEBUG, "\tmin_stride_wqe_log_size: %u", + sh->dev_cap.mprq.log_min_stride_wqe_size); + DRV_LOG(DEBUG, "Device supports Multi-Packet RQ."); + } if (hca_attr->rss_ind_tbl_cap) { /* * DPDK doesn't support larger/variable indirection tables. From patchwork Tue Apr 12 14:59:59 2022 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Tal Shnaiderman X-Patchwork-Id: 109612 X-Patchwork-Delegate: rasland@nvidia.com Return-Path: X-Original-To: patchwork@inbox.dpdk.org Delivered-To: patchwork@inbox.dpdk.org Received: from mails.dpdk.org (mails.dpdk.org [217.70.189.124]) by inbox.dpdk.org (Postfix) with ESMTP id 48D35A050A; Tue, 12 Apr 2022 17:01:20 +0200 (CEST) Received: from [217.70.189.124] (localhost [127.0.0.1]) by mails.dpdk.org (Postfix) with ESMTP id 1E7E340DF6; Tue, 12 Apr 2022 17:01:20 +0200 (CEST) Received: from NAM12-MW2-obe.outbound.protection.outlook.com (mail-mw2nam12on2085.outbound.protection.outlook.com [40.107.244.85]) by mails.dpdk.org (Postfix) with ESMTP id 571194014F for ; Tue, 12 Apr 2022 17:01:19 +0200 (CEST) ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=dOepetkAQCLUF3Pv+EOd8QVNRujS1OvxKphVFaXZcrUQ3AZSjf9AguInb4NXJB1ZqHOy7kawErWv0e7ZiO09JJ6cTSPKGQyj7PLsBnXOUGjAWK17u8KMBkcamhAELS2HR+W0vwX4nbfFGQDW561onstnKjup9SlEJpiz3innd3RGfm+YhCtTL+KsxjFm3Prz7FBVaahmouNe+kJnTpjJIPWam7poGFxf9ZfSZnIm9ybBL4tmbugEwmjEH1LoDHlldWKJxllZZfH0Qn8Ncgi++NBdQQdZXUdML8dJGi3eTKGUSKy64tDKp9y7h+Xjco6Gg8YwgFLFhuXQATTySZGHFA== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=Ua5inxSlgC9cKvEyT4gpWobrH10yqr/3mixXhDmKuYY=; b=Q3Pe/I5nDjzotDOLkIIRjJulmaETlVJe2Y83uNqFXmpExXfjBlWqzSVvCMj3VRIBD/xkVDQC4T0hKu/lZqOHzNRlkh6+4YtJKASjMzthcIGd/xK7Gfg13Ax/vkH5kRm6JNrIIqlkcbi1K1A/wa68dSP9jheLqtt59+Tw3xUdBrfiE0SFJljW6My5BYv/a1InnaBQy/PB8EqBJ6MPaP0Q+JyEOPmyOCE3wzP556tobd16xElSqzHVWKME19/pgnDbkkn5wc06UR6ctZUcO0ZwZ0sEUOlmDvSovm4wo2r3NQm+eknFK6Cz63Nfaaav3J3mclvRB25Xj6/eaUfotW7MKw== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass (sender ip is 12.22.5.235) smtp.rcpttodomain=monjalon.net smtp.mailfrom=nvidia.com; dmarc=pass (p=reject sp=reject pct=100) action=none header.from=nvidia.com; dkim=none (message not signed); arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=Nvidia.com; s=selector2; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=Ua5inxSlgC9cKvEyT4gpWobrH10yqr/3mixXhDmKuYY=; b=I0pfmPrPUgXGTsIww1/V4QaNS+kp8Zep5hp62F5oQ92jK45bNrssMjMp0bs66KKnzFEjmMUXjO2kWS7SegOqjC0z2rVl0bCzJU3fYxW3D9a3AVGZKHiVE3xg8D7gtU9JehrBttw+YPB8CO0DEqJmsBpENhqjsl9zouPQAxrzp7C2b8hQ79VZG4RA7YC3zIT++C3CyBRuO+objCgDCjmG1YlgumsPOMcVTOLjwqffuNi/k/ODu3FmK8RsUMf0avixzv5Iclr07I8+jTmsd3Wfw5C1AMy3B1XbZqS5+yof0LuoiMxjJdq/yZZJ3ybS7kV0hqlSbmNBKQTuPTP06EJvDQ== Received: from BN6PR16CA0044.namprd16.prod.outlook.com (2603:10b6:405:14::30) by DM6PR12MB3145.namprd12.prod.outlook.com (2603:10b6:5:3a::10) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.5144.29; Tue, 12 Apr 2022 15:01:16 +0000 Received: from BN8NAM11FT019.eop-nam11.prod.protection.outlook.com (2603:10b6:405:14:cafe::d0) by BN6PR16CA0044.outlook.office365.com (2603:10b6:405:14::30) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.5164.18 via Frontend Transport; Tue, 12 Apr 2022 15:01:16 +0000 X-MS-Exchange-Authentication-Results: spf=pass (sender IP is 12.22.5.235) smtp.mailfrom=nvidia.com; dkim=none (message not signed) header.d=none;dmarc=pass action=none header.from=nvidia.com; Received-SPF: Pass (protection.outlook.com: domain of nvidia.com designates 12.22.5.235 as permitted sender) receiver=protection.outlook.com; client-ip=12.22.5.235; helo=mail.nvidia.com; Received: from mail.nvidia.com (12.22.5.235) by BN8NAM11FT019.mail.protection.outlook.com (10.13.176.158) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384) id 15.20.5144.20 via Frontend Transport; Tue, 12 Apr 2022 15:01:16 +0000 Received: from rnnvmail201.nvidia.com (10.129.68.8) by DRHQMAIL107.nvidia.com (10.27.9.16) with Microsoft SMTP Server (TLS) id 15.0.1497.32; Tue, 12 Apr 2022 15:01:10 +0000 Received: from nvidia.com (10.126.230.35) by rnnvmail201.nvidia.com (10.129.68.8) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.2.986.22; Tue, 12 Apr 2022 08:01:09 -0700 From: Tal Shnaiderman To: CC: , Subject: [RFC PATCH 2/3] net/mlx5: support CQE compression on Windows Date: Tue, 12 Apr 2022 17:59:59 +0300 Message-ID: <20220412150000.3412-3-talshn@nvidia.com> X-Mailer: git-send-email 2.16.1.windows.4 In-Reply-To: <20220412150000.3412-1-talshn@nvidia.com> References: <20220412150000.3412-1-talshn@nvidia.com> MIME-Version: 1.0 X-Originating-IP: [10.126.230.35] X-ClientProxiedBy: rnnvmail203.nvidia.com (10.129.68.9) To rnnvmail201.nvidia.com (10.129.68.8) X-EOPAttributedMessage: 0 X-MS-PublicTrafficType: Email X-MS-Office365-Filtering-Correlation-Id: a1fdc671-a9d7-4a65-4977-08da1c954b52 X-MS-TrafficTypeDiagnostic: DM6PR12MB3145:EE_ X-LD-Processed: 43083d15-7273-40c1-b7db-39efd9ccc17a,ExtAddr X-Microsoft-Antispam-PRVS: X-MS-Exchange-SenderADCheck: 1 X-MS-Exchange-AntiSpam-Relay: 0 X-Microsoft-Antispam: BCL:0; X-Microsoft-Antispam-Message-Info: DGVaD+WEs4u5Eq0E3Y4gfmQyYy4hMRSc/6c2c3l+nF+1b8QRw4bWmGXjvXVihTk6h4KVbB4lpp6vUsRriAQOolFopzN5XfjGeaYlXLjB6Z7lm80FSNTlymhaDCa0Zg20KGpfvZ2ZjQrdh4Gg0JAlj+TirvkO25Yya8Dvgt+WIp89LJsIhPhNqR45HgwsLJpx4KCXfLv4WJq5SeIz47WrgzckiMP1s2nS1E9VTjURdfrCy73gQc5L1bG/ZtpMLm8kebFgbySlh10A4fSCK/5haoIF5Mn7x1asUGRK26+opu4mX00f3goHDy7YLVRoZtONqsCGEn+RzjSM0uOdDVN6p952GGjx9PqafPYq4s3vU62uobuKGAGpoYQYAwro8h8sB1V8R7qdrJwJvWn8FmMCxCkcRUcp9iDLwa4jZhdDkC5YPUpX+GrMobrF3X/+tzM69BNJFERmTR+nrRnnfA6TiSRcuy3yQkrzPTr4T0/BYYp1XOMjwzVg6NFjERu3wIaxEg0hIS6QVTqYZCCQ0movDOME8W6cvLiwrym4lOhgrqy2+YL1wFxYCUFtLSPz/ZkjA6gwXFNrDsYvqGYwIBvGCYqgUgWt8FI5V3pJ/aMeHUZ+SqmCkB0fWVUF1dU9AHV5ZGEoFTHrKdAvZCB9hd9YjpUMUXy8sAvul4cPVeqG/RDb5EG6UGsppNVA/kcpuTldJn/XEadhAauP/DkoezqtzZg0PBp6SHjjb8HQTudCUhCZaxzJdvVpOc9AzpawMO5ptUwbnDC8xTmC1My5v3PepQ== X-Forefront-Antispam-Report: CIP:12.22.5.235; CTRY:US; LANG:en; SCL:1; SRV:; IPV:CAL; SFV:NSPM; H:mail.nvidia.com; PTR:InfoNoRecords; CAT:NONE; SFS:(13230001)(4636009)(46966006)(36840700001)(40470700004)(86362001)(8936002)(55016003)(508600001)(356005)(5660300002)(4326008)(316002)(70586007)(54906003)(70206006)(8676002)(7696005)(336012)(36860700001)(426003)(47076005)(186003)(26005)(1076003)(107886003)(16526019)(40460700003)(82310400005)(6916009)(83380400001)(6666004)(81166007)(2616005)(6286002)(36756003)(2906002)(36900700001); DIR:OUT; SFP:1101; X-OriginatorOrg: Nvidia.com X-MS-Exchange-CrossTenant-OriginalArrivalTime: 12 Apr 2022 15:01:16.3860 (UTC) X-MS-Exchange-CrossTenant-Network-Message-Id: a1fdc671-a9d7-4a65-4977-08da1c954b52 X-MS-Exchange-CrossTenant-Id: 43083d15-7273-40c1-b7db-39efd9ccc17a X-MS-Exchange-CrossTenant-OriginalAttributedTenantConnectingIp: TenantId=43083d15-7273-40c1-b7db-39efd9ccc17a; Ip=[12.22.5.235]; Helo=[mail.nvidia.com] X-MS-Exchange-CrossTenant-AuthSource: BN8NAM11FT019.eop-nam11.prod.protection.outlook.com X-MS-Exchange-CrossTenant-AuthAs: Anonymous X-MS-Exchange-CrossTenant-FromEntityHeader: HybridOnPrem X-MS-Exchange-Transport-CrossTenantHeadersStamped: DM6PR12MB3145 X-BeenThere: dev@dpdk.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: DPDK patches and discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: dev-bounces@dpdk.org CQE Compression reduces PCI overhead by coalescing and compressing multiple CQEs into a single merged CQE. Add supported for the CQE compression feature on Windows. feature is enabled by default unless not supported by the HW or if the rxq_cqe_comp_en PMD argument is explicitly disabled. Signed-off-by: Tal Shnaiderman --- drivers/common/mlx5/mlx5_devx_cmds.c | 2 ++ drivers/common/mlx5/mlx5_devx_cmds.h | 1 + drivers/net/mlx5/windows/mlx5_os.c | 8 ++++++++ 3 files changed, 11 insertions(+) diff --git a/drivers/common/mlx5/mlx5_devx_cmds.c b/drivers/common/mlx5/mlx5_devx_cmds.c index 7900254287..a109341d02 100644 --- a/drivers/common/mlx5/mlx5_devx_cmds.c +++ b/drivers/common/mlx5/mlx5_devx_cmds.c @@ -956,6 +956,8 @@ mlx5_devx_cmd_query_hca_attr(void *ctx, attr->cqe_compression = MLX5_GET(cmd_hca_cap, hcattr, cqe_compression); attr->mini_cqe_resp_flow_tag = MLX5_GET(cmd_hca_cap, hcattr, mini_cqe_resp_flow_tag); + attr->cqe_compression_128 = MLX5_GET(cmd_hca_cap, hcattr, + cqe_compression_128); attr->mini_cqe_resp_l3_l4_tag = MLX5_GET(cmd_hca_cap, hcattr, mini_cqe_resp_l3_l4_tag); attr->umr_indirect_mkey_disabled = diff --git a/drivers/common/mlx5/mlx5_devx_cmds.h b/drivers/common/mlx5/mlx5_devx_cmds.h index 2d813c0fdc..6413176f2e 100644 --- a/drivers/common/mlx5/mlx5_devx_cmds.h +++ b/drivers/common/mlx5/mlx5_devx_cmds.h @@ -258,6 +258,7 @@ struct mlx5_hca_attr { uint16_t max_wqe_sz_sq; uint32_t striding_rq:1; uint32_t ext_stride_num_range:1; + uint32_t cqe_compression_128:1; }; /* LAG Context. */ diff --git a/drivers/net/mlx5/windows/mlx5_os.c b/drivers/net/mlx5/windows/mlx5_os.c index 02438ece56..232f22232b 100644 --- a/drivers/net/mlx5/windows/mlx5_os.c +++ b/drivers/net/mlx5/windows/mlx5_os.c @@ -237,6 +237,14 @@ mlx5_os_capabilities_prepare(struct mlx5_dev_ctx_shared *sh) } else { DRV_LOG(DEBUG, "Tunnel offloading is not supported."); } +#if (RTE_CACHE_LINE_SIZE == 128) + if (hca_attr->hca_attr.cqe_compression_128) + sh->dev_cap.cqe_comp = 1; + DRV_LOG(DEBUG, "Rx CQE 128B compression is %ssupported.", + sh->dev_cap.cqe_comp ? "" : "not "); +#else + sh->dev_cap.cqe_comp = 1; +#endif snprintf(sh->dev_cap.fw_ver, 64, "%x.%x.%04x", MLX5_GET(initial_seg, pv_iseg, fw_rev_major), MLX5_GET(initial_seg, pv_iseg, fw_rev_minor), From patchwork Tue Apr 12 15:00:00 2022 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Tal Shnaiderman X-Patchwork-Id: 109613 X-Patchwork-Delegate: rasland@nvidia.com Return-Path: X-Original-To: patchwork@inbox.dpdk.org Delivered-To: patchwork@inbox.dpdk.org Received: from mails.dpdk.org (mails.dpdk.org [217.70.189.124]) by inbox.dpdk.org (Postfix) with ESMTP id 647F9A050A; Tue, 12 Apr 2022 17:01:26 +0200 (CEST) Received: from [217.70.189.124] (localhost [127.0.0.1]) by mails.dpdk.org (Postfix) with ESMTP id EE97F41611; Tue, 12 Apr 2022 17:01:24 +0200 (CEST) Received: from NAM10-BN7-obe.outbound.protection.outlook.com (mail-bn7nam10on2056.outbound.protection.outlook.com [40.107.92.56]) by mails.dpdk.org (Postfix) with ESMTP id B007A410E1 for ; Tue, 12 Apr 2022 17:01:23 +0200 (CEST) ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=IWwtXJWkWZsfFUuiVVeZ/EEEGAjOqae9q+00JwhKf0g1cmjgZ+uEhVpZoNUyBds7E7v2t4Ccfn7lfkOxWEJ4DBOkySy9loKlRXGMJbA1Uy555YO3AMglBWgyJCS058LULshmPiMjWUQBzihotUw+jY7HhV3kwg1dmcs2cYslp5ZPuZzyGsrqTS/vYgrM3/7zaG+ysZWmeOwmorAtsr7bZ5hkXSFQunSMYbuN/0EATRmLBpGeZi88RtRqo4j+xxmUylIUa8iW9eK+uFSowzyzckqTOegzEDa8BMN89/iDzIWTKsNliBOeenvQUTYud8QDJeO9MBMjsxTiZk+f2bYDWQ== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=jFHvo71J3QpKM0TZjVa4TOw0ewX69LaBlwjdTp5JjJQ=; b=BSEApSOW5KRfNUrVaFszYAmah2gVL8kZtrUplDWVB+uFvgF7BHhaG/uSkP3AQBvczb4AH3R3rG9UYByt/1hxcbzmdR/7ZHXJqu5czAM1NiRZ9SHOxzFWwNqMNZ78h5AsIVsMKuqdMlsAa9NT23zEeeqhq0wyv6P9HeQT/h/GTgWypvyvGHMn80jlnBcPnaCLoSlXFOlSeeCdHzV4bPTVksXe6fg8RAht7ETZX41x2JEXePqvGFZTT8IK3tagDB+kAZyfKYJtDZb+QAGq0KPYEcnxzonPnNG5iXjp4+pb+y5oUdZgBbLeVOon2jJitG0aYwtM+j+1cLf88C3NTEauGA== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass (sender ip is 12.22.5.238) smtp.rcpttodomain=monjalon.net smtp.mailfrom=nvidia.com; dmarc=pass (p=reject sp=reject pct=100) action=none header.from=nvidia.com; dkim=none (message not signed); arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=Nvidia.com; s=selector2; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=jFHvo71J3QpKM0TZjVa4TOw0ewX69LaBlwjdTp5JjJQ=; b=M4QnNPTUQyrnC5Ujl6x++MbWoWoBYByfAGq+VcHG3QRBaJZZ3r0/d7S5lw4UiG6JiQAJ5/j29nT6yIr8dsoGPMT+NS1FKUJZwKOg5c3awLmfgJ2OQRb40ror7gSLhjs/7u+E8336aWzhz5jFjazOYN0WNFl7bqfwT121v6Gzm0SE1GtQ7M0lBSpFl4/KppAKytXsz0/aPTuowsupHRji4fOSJO0YOuHVyTfAwdev+SqSBctHcNng4p00vNnIgciN7U/+fLU5QVIcZ2j1GEhfjZtwsbPAmSy9OGPzJh1lub011UTLRB3ME+Y1HcmFJmbKw6iIy1vU3//5rUoLs23M1Q== Received: from BN7PR02CA0005.namprd02.prod.outlook.com (2603:10b6:408:20::18) by BN7PR12MB2756.namprd12.prod.outlook.com (2603:10b6:408:29::32) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.5144.29; Tue, 12 Apr 2022 15:01:21 +0000 Received: from BN8NAM11FT068.eop-nam11.prod.protection.outlook.com (2603:10b6:408:20:cafe::d4) by BN7PR02CA0005.outlook.office365.com (2603:10b6:408:20::18) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.5164.18 via Frontend Transport; Tue, 12 Apr 2022 15:01:21 +0000 X-MS-Exchange-Authentication-Results: spf=pass (sender IP is 12.22.5.238) smtp.mailfrom=nvidia.com; dkim=none (message not signed) header.d=none;dmarc=pass action=none header.from=nvidia.com; Received-SPF: Pass (protection.outlook.com: domain of nvidia.com designates 12.22.5.238 as permitted sender) receiver=protection.outlook.com; client-ip=12.22.5.238; helo=mail.nvidia.com; Received: from mail.nvidia.com (12.22.5.238) by BN8NAM11FT068.mail.protection.outlook.com (10.13.177.69) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384) id 15.20.5144.20 via Frontend Transport; Tue, 12 Apr 2022 15:01:20 +0000 Received: from rnnvmail201.nvidia.com (10.129.68.8) by DRHQMAIL105.nvidia.com (10.27.9.14) with Microsoft SMTP Server (TLS) id 15.0.1497.32; Tue, 12 Apr 2022 15:01:12 +0000 Received: from nvidia.com (10.126.230.35) by rnnvmail201.nvidia.com (10.129.68.8) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.2.986.22; Tue, 12 Apr 2022 08:01:10 -0700 From: Tal Shnaiderman To: CC: , Subject: [RFC PATCH 3/3] net/mlx5: support enhanced multi-packet write on Windows Date: Tue, 12 Apr 2022 18:00:00 +0300 Message-ID: <20220412150000.3412-4-talshn@nvidia.com> X-Mailer: git-send-email 2.16.1.windows.4 In-Reply-To: <20220412150000.3412-1-talshn@nvidia.com> References: <20220412150000.3412-1-talshn@nvidia.com> MIME-Version: 1.0 X-Originating-IP: [10.126.230.35] X-ClientProxiedBy: rnnvmail203.nvidia.com (10.129.68.9) To rnnvmail201.nvidia.com (10.129.68.8) X-EOPAttributedMessage: 0 X-MS-PublicTrafficType: Email X-MS-Office365-Filtering-Correlation-Id: 97426704-2743-49f4-c5d6-08da1c954e02 X-MS-TrafficTypeDiagnostic: BN7PR12MB2756:EE_ X-LD-Processed: 43083d15-7273-40c1-b7db-39efd9ccc17a,ExtAddr X-Microsoft-Antispam-PRVS: X-MS-Exchange-SenderADCheck: 1 X-MS-Exchange-AntiSpam-Relay: 0 X-Microsoft-Antispam: BCL:0; X-Microsoft-Antispam-Message-Info: 54eC4S3uCA6fwQyFvkmTfgG6MotDdowhbZPiVaF2w4IgkF3xUaN2Xs1/Po2jUIfSWlCYo5Gf17T5ICLbe4ATdBjYIy8RtdTmSHiiWdyLZ0SHGRe/IrddTkS022SlLyqlWmM8dDSkaghdr1FrBUgwwASKZqZxT2WLf5NMBtoIFDGH8VqQrGnPCwWQ4qJEOm4fvZcpdSsjLAMmPy4lM32Shwi5uBBFFDL8ubdetds3b1BS7WNwLl+5tVwAJ/Unz0jJmoeSssMCSe7k9WIS8InkfNFPrxGuJjRIm+4iVVxWN0G24RZfuWhpiYo1o1nAdIQ1mMvNftpabNJU+yMT+BDQ841xXPJfPvM7Pls/271Pd6suH5hjhOSTQppWBHnM8M7vuPeRzBgR7ONUrrpTcpOemRssfeLD0H4xaSMSPO6SwEXI8xo0Jzi7j/oxTF6+4twMLbbLXst8siknWH5ehEBmIgFaZYcBPxbjQaJXvvQyVpef86Ndh60Ff+FFvckfZ2Ad6stXkQn2zDyJoHLlDaEGhOyZq8Uvt9Sw7NT+5Fmb8Ga+VB2+oI4cW5hQhqL7Vlf6Ezsj2XUrfgD/CkoZuCFQ4EOSMS5P3X/r1VYxmiXzlEbKqmGxZYpWFqdLzDks4+fmu5z5vSQNwd09wipm+qUYMCN6XGfzUUA84jhpbGReB48bs+lDTpQK4LhM8pmY7h+PjChhFz0CIAOkTh3dLIPgzQ== X-Forefront-Antispam-Report: CIP:12.22.5.238; CTRY:US; LANG:en; SCL:1; SRV:; IPV:CAL; SFV:NSPM; H:mail.nvidia.com; PTR:InfoNoRecords; CAT:NONE; SFS:(13230001)(4636009)(46966006)(40470700004)(36840700001)(70206006)(86362001)(2616005)(8676002)(7696005)(4326008)(70586007)(107886003)(6286002)(40460700003)(8936002)(508600001)(2906002)(5660300002)(82310400005)(6666004)(6916009)(26005)(16526019)(186003)(54906003)(336012)(83380400001)(426003)(47076005)(316002)(356005)(81166007)(1076003)(36860700001)(55016003)(36756003)(36900700001); DIR:OUT; SFP:1101; X-OriginatorOrg: Nvidia.com X-MS-Exchange-CrossTenant-OriginalArrivalTime: 12 Apr 2022 15:01:20.8980 (UTC) X-MS-Exchange-CrossTenant-Network-Message-Id: 97426704-2743-49f4-c5d6-08da1c954e02 X-MS-Exchange-CrossTenant-Id: 43083d15-7273-40c1-b7db-39efd9ccc17a X-MS-Exchange-CrossTenant-OriginalAttributedTenantConnectingIp: TenantId=43083d15-7273-40c1-b7db-39efd9ccc17a; Ip=[12.22.5.238]; Helo=[mail.nvidia.com] X-MS-Exchange-CrossTenant-AuthSource: BN8NAM11FT068.eop-nam11.prod.protection.outlook.com X-MS-Exchange-CrossTenant-AuthAs: Anonymous X-MS-Exchange-CrossTenant-FromEntityHeader: HybridOnPrem X-MS-Exchange-Transport-CrossTenantHeadersStamped: BN7PR12MB2756 X-BeenThere: dev@dpdk.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: DPDK patches and discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: dev-bounces@dpdk.org Add support for enhanced multi-packet write on Windows. Enhanced multi-packet write allows the Tx burst function to pack up multiple packets in a single descriptor session to save PCI bandwidth and improve performance. The feature can be controlled by the txq_mpw_en PMD argument: txq_mpw_en=1 - PMD will first attempt to use "enhanced multi packet write" if the feature is not supported by the HW the legacy "multi packet write" will be used. if both are unsupported the multi packet write feature is disabled. txq_mpw_en=0 - multi packet write is disabled. txq_mpw_en unset(default) - enhanced multi packet write will be activated if supported. if unsupported the multi packet write feature is disabled. Signed-off-by: Tal Shnaiderman --- drivers/common/mlx5/mlx5_devx_cmds.c | 6 ++++++ drivers/common/mlx5/mlx5_devx_cmds.h | 2 ++ drivers/net/mlx5/windows/mlx5_os.c | 14 ++++++++++++-- 3 files changed, 20 insertions(+), 2 deletions(-) diff --git a/drivers/common/mlx5/mlx5_devx_cmds.c b/drivers/common/mlx5/mlx5_devx_cmds.c index a109341d02..c6fc59dbbe 100644 --- a/drivers/common/mlx5/mlx5_devx_cmds.c +++ b/drivers/common/mlx5/mlx5_devx_cmds.c @@ -1119,6 +1119,12 @@ mlx5_devx_cmd_query_hca_attr(void *ctx, attr->rss_ind_tbl_cap = MLX5_GET (per_protocol_networking_offload_caps, hcattr, rss_ind_tbl_cap); + attr->multi_pkt_send_wqe = MLX5_GET + (per_protocol_networking_offload_caps, + hcattr, multi_pkt_send_wqe); + attr->enhanced_multi_pkt_send_wqe = MLX5_GET + (per_protocol_networking_offload_caps, + hcattr, enhanced_multi_pkt_send_wqe); /* Query HCA attribute for ROCE. */ if (attr->roce) { hcattr = mlx5_devx_get_hca_cap(ctx, in, out, &rc, diff --git a/drivers/common/mlx5/mlx5_devx_cmds.h b/drivers/common/mlx5/mlx5_devx_cmds.h index 6413176f2e..db6f1b2e71 100644 --- a/drivers/common/mlx5/mlx5_devx_cmds.h +++ b/drivers/common/mlx5/mlx5_devx_cmds.h @@ -259,6 +259,8 @@ struct mlx5_hca_attr { uint32_t striding_rq:1; uint32_t ext_stride_num_range:1; uint32_t cqe_compression_128:1; + uint32_t multi_pkt_send_wqe:1; + uint32_t enhanced_multi_pkt_send_wqe:1; }; /* LAG Context. */ diff --git a/drivers/net/mlx5/windows/mlx5_os.c b/drivers/net/mlx5/windows/mlx5_os.c index 232f22232b..a99f4ea183 100644 --- a/drivers/net/mlx5/windows/mlx5_os.c +++ b/drivers/net/mlx5/windows/mlx5_os.c @@ -173,8 +173,6 @@ mlx5_os_capabilities_prepare(struct mlx5_dev_ctx_shared *sh) sh->dev_cap.max_qp = 1 << hca_attr->log_max_qp; sh->dev_cap.max_qp_wr = 1 << hca_attr->log_max_qp_sz; sh->dev_cap.dv_flow_en = 1; - sh->dev_cap.mps = MLX5_MPW_DISABLED; - DRV_LOG(DEBUG, "MPW isn't supported."); DRV_LOG(DEBUG, "MPLS over GRE/UDP tunnel offloading is no supported."); sh->dev_cap.hw_csum = hca_attr->csum_cap; DRV_LOG(DEBUG, "Checksum offloading is %ssupported.", @@ -224,6 +222,18 @@ mlx5_os_capabilities_prepare(struct mlx5_dev_ctx_shared *sh) DRV_LOG(DEBUG, "Maximum Rx indirection table size is %u", sh->dev_cap.ind_table_max_size); } + if (hca_attr->enhanced_multi_pkt_send_wqe) { + sh->dev_cap.mps = MLX5_MPW_ENHANCED; + DRV_LOG(DEBUG, "Enhanced MPW is supported."); + } + else if (hca_attr->multi_pkt_send_wqe && + sh->dev_cap.mps != MLX5_ARG_UNSET) { + sh->dev_cap.mps = MLX5_MPW; + DRV_LOG(DEBUG, "MPW is supported."); + } else { + sh->dev_cap.mps = MLX5_MPW_DISABLED; + DRV_LOG(DEBUG, "MPW isn't supported."); + } sh->dev_cap.swp = mlx5_get_supported_sw_parsing_offloads(hca_attr); sh->dev_cap.tunnel_en = mlx5_get_supported_tunneling_offloads(hca_attr); if (sh->dev_cap.tunnel_en) {