From patchwork Tue Oct 31 14:27:29 2023 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Dariusz Sosnowski X-Patchwork-Id: 133669 X-Patchwork-Delegate: rasland@nvidia.com Return-Path: X-Original-To: patchwork@inbox.dpdk.org Delivered-To: patchwork@inbox.dpdk.org Received: from mails.dpdk.org (mails.dpdk.org [217.70.189.124]) by inbox.dpdk.org (Postfix) with ESMTP id 81D4E43252; Tue, 31 Oct 2023 15:28:15 +0100 (CET) Received: from mails.dpdk.org (localhost [127.0.0.1]) by mails.dpdk.org (Postfix) with ESMTP id 97075406A2; Tue, 31 Oct 2023 15:28:14 +0100 (CET) Received: from NAM11-CO1-obe.outbound.protection.outlook.com (mail-co1nam11on2067.outbound.protection.outlook.com [40.107.220.67]) by mails.dpdk.org (Postfix) with ESMTP id DED6D40284 for ; Tue, 31 Oct 2023 15:28:13 +0100 (CET) ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=SX8TcSq4BUNZ1gIQY5xTPcoi+fDPWLNGXRmLxhikEN5vxWE4n9Btqc1LeNUAg3gJ0a8ge12EdPcfxk/ZoX6eFg78D0dVmm3JlThhdt1XtZofP8YnGRO9pVoOC3J77wWo3SQGyfousL++65p5Rq2hq2ZM2FG6YHBtDFl2CvHQ/ucjfF6R1BemAf40n0oZ28sXlzk63L60Ib8EsfeSh+YTHQwlG4BhHn/Bd0JmFz0qvicDsoSfUGxqBqrn+sr8KSPBg2sq0sub2F4Bf2F0EkwBkScZsg4ZHrAjFwV4E1+yca5eQeCsI095H9FUhKPeeDuYw3JgQM+AnHg8CXNRFixETg== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=eoTQt3AIDJZvuYXeRtKMQoa+ieQz89mUoi0czRaB0wo=; b=l95pXj9vaPdEraOv98sqQQp2OEFEr0VXTXF4MsfF9G6zOpcEw97oatH6b4mXLoTMxU7SwBt3933EDU4wdL/Fwoemi35VjIbviLJ2bvwWTP11MUegxAVwnO9TbXgiIUScbfI41rG9VHRIQNxbfrCM9UrDXRQZFRI5P+zfDZi9X6Jg95FQRxlw9/apsZbTU+4NdY4B8KeJLeCPOSQiqgYT49P3E1AfFAgKj/myUwY8bJ5HCilE0Nt2uUts3Z431W85v+jkMZ6i7MEZ2zTi+atXjMj9TdcSylO3i3rqBYA5LCt2DLnS4SFFf/PkjeLsYl456MEkTPgRi9VFUIU5gRl6Fw== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass (sender ip is 216.228.117.161) smtp.rcpttodomain=dpdk.org smtp.mailfrom=nvidia.com; dmarc=pass (p=reject sp=reject pct=100) action=none header.from=nvidia.com; dkim=none (message not signed); arc=none (0) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=Nvidia.com; s=selector2; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=eoTQt3AIDJZvuYXeRtKMQoa+ieQz89mUoi0czRaB0wo=; b=VRjzLRlsRnxHi5ArhBVu4ju6MJgv9Gb9ujJeele2hYYudnNVQ02k7LE/vRzNGiGhM13tV706DW0+XrfGFJNEC30XKZgxMwFGQUHZRh1S8BKEhu4mZi1iNS6h+u0sCx1QkD2g/fnU0cFFFJ6MgZwzdMfvbX5A1oL3q6j5DQbJDgbNCHlz71sX67W4nuM2k2o1dLPZtBZJH0i31fW3KHwK4cGpCWNO3PqYghlRLr47KVRuGWIXBpepX9mePoNsni9XXoPGIbWRR0FFxh9M47uk687V7Ci98n+0/YMyw048ULBTnq2DWmB6SjyPPxhdYNmO1g8a3GiOHboSwGYFm5fo3w== Received: from CYZPR12CA0018.namprd12.prod.outlook.com (2603:10b6:930:8b::10) by CY8PR12MB8194.namprd12.prod.outlook.com (2603:10b6:930:76::5) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.6933.28; Tue, 31 Oct 2023 14:28:11 +0000 Received: from CY4PEPF0000EDD2.namprd03.prod.outlook.com (2603:10b6:930:8b:cafe::26) by CYZPR12CA0018.outlook.office365.com (2603:10b6:930:8b::10) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.6954.19 via Frontend Transport; Tue, 31 Oct 2023 14:28:11 +0000 X-MS-Exchange-Authentication-Results: spf=pass (sender IP is 216.228.117.161) smtp.mailfrom=nvidia.com; dkim=none (message not signed) header.d=none;dmarc=pass action=none header.from=nvidia.com; Received-SPF: Pass (protection.outlook.com: domain of nvidia.com designates 216.228.117.161 as permitted sender) receiver=protection.outlook.com; client-ip=216.228.117.161; helo=mail.nvidia.com; pr=C Received: from mail.nvidia.com (216.228.117.161) by CY4PEPF0000EDD2.mail.protection.outlook.com (10.167.241.206) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.6954.19 via Frontend Transport; Tue, 31 Oct 2023 14:28:10 +0000 Received: from rnnvmail201.nvidia.com (10.129.68.8) by mail.nvidia.com (10.129.200.67) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.2.986.41; Tue, 31 Oct 2023 07:28:01 -0700 Received: from nvidia.com (10.126.231.35) by rnnvmail201.nvidia.com (10.129.68.8) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.2.986.41; Tue, 31 Oct 2023 07:27:59 -0700 From: Dariusz Sosnowski To: Matan Azrad , Viacheslav Ovsiienko , Ori Kam , Suanming Mou CC: , Raslan Darawsheh Subject: [PATCH 4/8] net/mlx5: add sysfs check for Multiport E-Switch Date: Tue, 31 Oct 2023 16:27:29 +0200 Message-ID: <20231031142733.2009166-5-dsosnowski@nvidia.com> X-Mailer: git-send-email 2.25.1 In-Reply-To: <20231031142733.2009166-1-dsosnowski@nvidia.com> References: <20231031142733.2009166-1-dsosnowski@nvidia.com> MIME-Version: 1.0 X-Originating-IP: [10.126.231.35] X-ClientProxiedBy: rnnvmail202.nvidia.com (10.129.68.7) To rnnvmail201.nvidia.com (10.129.68.8) X-EOPAttributedMessage: 0 X-MS-PublicTrafficType: Email X-MS-TrafficTypeDiagnostic: CY4PEPF0000EDD2:EE_|CY8PR12MB8194:EE_ X-MS-Office365-Filtering-Correlation-Id: 23bd9477-7c79-4f4f-60b2-08dbda1d9c0a X-MS-Exchange-SenderADCheck: 1 X-MS-Exchange-AntiSpam-Relay: 0 X-Microsoft-Antispam: BCL:0; X-Microsoft-Antispam-Message-Info: PtRLrmgveBtLwf4MC12UMA6iq08UmRoo/96lLzLZTy1W/xxaa1iZuwnwTSq7dxvxUVY66gvcJuNRoh6qDhOtKwY8KQ47zAQPSt+weg8pR+28WfJqAsyAEY5Flg3iaDQ3y6rXCB4/Mvh+5v3W6m3qlCeFXmZB6mWEXkd5uKWPFGihi2Tb6nEhUnx6e40MTtoZD4nNTrfODkqmQipKUF412U6Rbi+UNxgco8rSk95+T3FaLtbrr74FT+5ON5En3JzemjvXkLaGLfkRhAcrs4fMT6gSVOv/3K2vSP4zrLtI3siXgxAimszgsf/VOrTIY3E/PZ3mDJidOOVIzdArbiHi3hvgtWe5/J1M72GKE3YvPo8Ea0iCFqWRqRot7SVM4tXyGbiYYLUo02KV8SQwY76u3UPYJA0Tpz4FcIyPFh/Cm+aBkSZb/tCyEiG560vXxvI8a8QnVlrAQ11FHsPqlXOA/zk6rX7vWTIySDHarFvkH84ZtnRoEEvo45k7tEmBQ5tq28s4ln4Z0syDlr6hoWPWWpwwIq1/zOn8kkqh+JSCkQPabTc/czupaEOOwk5Kla0nw1Ij0bo0mR5gtJWAf3HHQnjGSDRn0yWtb6whFLP5gnrtrPA8IJ/EG9SCW9sxGX/qyOycMxLB+MAIMbp7Re5EW119ye636LpwSNhsIDfbmAtuI2rRLgqyktNg/fnMbl/n1W2a4043s+t3wp3F9RnbpnKYsq74DJTD35DCSaimm8nCYUYjirxv5DGUqlCyumhT X-Forefront-Antispam-Report: CIP:216.228.117.161; CTRY:US; LANG:en; SCL:1; SRV:; IPV:NLI; SFV:NSPM; H:mail.nvidia.com; PTR:dc6edge2.nvidia.com; CAT:NONE; SFS:(13230031)(4636009)(396003)(346002)(376002)(136003)(39860400002)(230922051799003)(82310400011)(1800799009)(186009)(64100799003)(451199024)(36840700001)(46966006)(40470700004)(426003)(6286002)(16526019)(26005)(1076003)(55016003)(40460700003)(86362001)(36756003)(40480700001)(82740400003)(356005)(7636003)(6666004)(83380400001)(2906002)(5660300002)(7696005)(107886003)(36860700001)(478600001)(336012)(47076005)(8936002)(8676002)(316002)(4326008)(6636002)(54906003)(70586007)(41300700001)(2616005)(110136005)(70206006); DIR:OUT; SFP:1101; X-OriginatorOrg: Nvidia.com X-MS-Exchange-CrossTenant-OriginalArrivalTime: 31 Oct 2023 14:28:10.8639 (UTC) X-MS-Exchange-CrossTenant-Network-Message-Id: 23bd9477-7c79-4f4f-60b2-08dbda1d9c0a X-MS-Exchange-CrossTenant-Id: 43083d15-7273-40c1-b7db-39efd9ccc17a X-MS-Exchange-CrossTenant-OriginalAttributedTenantConnectingIp: TenantId=43083d15-7273-40c1-b7db-39efd9ccc17a; Ip=[216.228.117.161]; Helo=[mail.nvidia.com] X-MS-Exchange-CrossTenant-AuthSource: CY4PEPF0000EDD2.namprd03.prod.outlook.com X-MS-Exchange-CrossTenant-AuthAs: Anonymous X-MS-Exchange-CrossTenant-FromEntityHeader: HybridOnPrem X-MS-Exchange-Transport-CrossTenantHeadersStamped: CY8PR12MB8194 X-BeenThere: dev@dpdk.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: DPDK patches and discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: dev-bounces@dpdk.org This patch implements checking if Multiport E-Switch is enabled on a given PCI device, using sysfs Linux kernel interface. This facility will be used in follow up commits, which add support for such configuration to mlx5 PMD. MLNX_OFED mlx5_core kernel module versions which support Multiport E-Switch do not expose this configuration through Devlink, but through sysfs interface. If such a version is used, then Multiport E-Switch can be enabled (or its state can be probed) through a sysfs file under path: # should be substituted with Linux interface name. /sys/class/net//compat/devlink/lag_port_select_mode Writing "multiport_esw" to this file enables Multiport E-Switch. If "multiport_esw" is read from this file, then Multiport E-Switch is enabled. If this file does not exist or writing "multiport_esw" to this file, raises an error, then Multiport E-Switch is not supported. Signed-off-by: Dariusz Sosnowski Acked-by: Viacheslav Ovsiienko --- drivers/net/mlx5/linux/mlx5_os.c | 69 ++++++++++++++++++++++++++++++++ 1 file changed, 69 insertions(+) diff --git a/drivers/net/mlx5/linux/mlx5_os.c b/drivers/net/mlx5/linux/mlx5_os.c index 2f08f2354e..7a656a7237 100644 --- a/drivers/net/mlx5/linux/mlx5_os.c +++ b/drivers/net/mlx5/linux/mlx5_os.c @@ -1931,6 +1931,75 @@ mlx5_device_bond_pci_match(const char *ibdev_name, return pf; } +#define SYSFS_MPESW_PARAM_MAX_LEN 16 + +static __rte_unused int +mlx5_sysfs_esw_multiport_get(struct ibv_device *ibv, struct rte_pci_addr *pci_addr, int *enabled) +{ + int nl_rdma; + unsigned int n_ports; + unsigned int i; + int ret; + + /* Provide correct value to have defined enabled state in case of an error. */ + *enabled = 0; + nl_rdma = mlx5_nl_init(NETLINK_RDMA, 0); + if (nl_rdma < 0) + return nl_rdma; + n_ports = mlx5_nl_portnum(nl_rdma, ibv->name); + if (!n_ports) { + ret = -rte_errno; + goto close_nl_rdma; + } + for (i = 1; i <= n_ports; ++i) { + unsigned int ifindex; + char ifname[IF_NAMESIZE + 1]; + struct rte_pci_addr if_pci_addr; + char mpesw[SYSFS_MPESW_PARAM_MAX_LEN + 1]; + FILE *sysfs; + int n; + + ifindex = mlx5_nl_ifindex(nl_rdma, ibv->name, i); + if (!ifindex) + continue; + if (!if_indextoname(ifindex, ifname)) + continue; + MKSTR(sysfs_if_path, "/sys/class/net/%s", ifname); + if (mlx5_get_pci_addr(sysfs_if_path, &if_pci_addr)) + continue; + if (pci_addr->domain != if_pci_addr.domain || + pci_addr->bus != if_pci_addr.bus || + pci_addr->devid != if_pci_addr.devid || + pci_addr->function != if_pci_addr.function) + continue; + MKSTR(sysfs_mpesw_path, + "/sys/class/net/%s/compat/devlink/lag_port_select_mode", ifname); + sysfs = fopen(sysfs_mpesw_path, "r"); + if (!sysfs) + continue; + n = fscanf(sysfs, "%" RTE_STR(SYSFS_MPESW_PARAM_MAX_LEN) "s", mpesw); + fclose(sysfs); + if (n != 1) + continue; + ret = 0; + if (strcmp(mpesw, "multiport_esw") == 0) { + *enabled = 1; + break; + } + *enabled = 0; + break; + } + if (i > n_ports) { + DRV_LOG(DEBUG, "Unable to get Multiport E-Switch state by sysfs."); + rte_errno = ENOENT; + ret = -rte_errno; + } + +close_nl_rdma: + close(nl_rdma); + return ret; +} + /** * Register a PCI device within bonding. *