[0/5] mlx5: workaround MR issues in FW\kernel
| Message ID | 20211107152919.2158802-1-matan@nvidia.com (mailing list archive) |
|---|---|
| Headers |
Return-Path: <dev-bounces@dpdk.org> X-Original-To: patchwork@inbox.dpdk.org Delivered-To: patchwork@inbox.dpdk.org Received: from mails.dpdk.org (mails.dpdk.org [217.70.189.124]) by inbox.dpdk.org (Postfix) with ESMTP id 265EEA0C41; Sun, 7 Nov 2021 16:30:26 +0100 (CET) Received: from [217.70.189.124] (localhost [127.0.0.1]) by mails.dpdk.org (Postfix) with ESMTP id 9EFEC40151; Sun, 7 Nov 2021 16:30:25 +0100 (CET) Received: from NAM10-MW2-obe.outbound.protection.outlook.com (mail-mw2nam10on2085.outbound.protection.outlook.com [40.107.94.85]) by mails.dpdk.org (Postfix) with ESMTP id 267C940040 for <dev@dpdk.org>; Sun, 7 Nov 2021 16:30:24 +0100 (CET) ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=TT4wxnhHiqgCisRNpt1jIMmkRb7AYNnm3afS9OE9SscoHfgK9shM9Hx21X+42JIVPbgw3vP+e/MlRPrvg/TuO8tcsxXpb6W/4uzYgB6UjUrdTEMP2j3nOGuxmGtuKM76MPfr2o/sQuQkd/NRqEgs8lWGM0ZIDBeZv6kZpi7N38ruJyIBjiifPsr6EqEZblbAa0atIOZNTdFjtAAd9SXRegieON5sP9iYUla/ipUgVm4wHHukMW564Se30/0g40P9nuLc8YNt7IPfOHbwkedMdAsB3dsFnSh+/b+9Pcc23oyNNDhSOjBrmC/Xqyw2drvrJKQsSPgzodBXviZtRcd28w== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=RUCL7y+Ar7P41sqShFCS1vr77K8hoMh8lU/N84ISvAY=; b=B43KtnwMxYUKbCsH1rnGy2ME0PIDlPIgGP0DhZAPZqT6xfrTkQeiop24IDb6PPOp3UljatALAQlBZ+LLfsFjKLwXtHYAmYxan8getvQnGdy7c6GKU/Ktc918NWnQFWJB/acBbZ/my2FROVnYyj1lON+LfY7Pb6/kKnHvjfw7EmBQ4FNo7mL4QACpDjMVovaiKHJjU0aZfUFqcN5N5e+W0xKRoWbg2bFNEfzmqTzy17FYGBuFtx8S+v1hHO0KZElzPLn56B9qd7n7lVED87e5s0OFQyMnx5jirGUhr/Z8fMagIXD/dww0BymWUP3316tsWe+2Pll/isGW42m8LX67eg== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass (sender ip is 216.228.112.34) smtp.rcpttodomain=monjalon.net smtp.mailfrom=nvidia.com; dmarc=pass (p=quarantine sp=quarantine pct=100) action=none header.from=nvidia.com; dkim=none (message not signed); arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=Nvidia.com; s=selector2; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=RUCL7y+Ar7P41sqShFCS1vr77K8hoMh8lU/N84ISvAY=; b=KOnZpMCwkfuJ3H1ahrlo84+wfu0bOn3jqbfjw79HfmZAXZN7G4GxxhCVy2JcDySgQw/EQCgmmdX/q0Qy/fAPkoNDtScFnnqp38+zWv5tCsjb3Z1QYG5uYgRrU462/ny6XD8GB0Q3IKGaHel2zcavm4ne1L1uqhBh0BWrT+56tGVmTUT5GWgkBNYlkCc5i4OBHbU0eD33zOGuLcjAYdosC7a5Bg8qua7si7jutrlikqA6wChXqtysqoKRkv4jKjboeDACxfWDQosib79CPXunUGvxg4+hFL5E9K4vn9UdalT7+nE+iGEtwjsQ7d/ObbmD5qEdzEMMpz5XmDWawZVoSg== Received: from MW4PR03CA0276.namprd03.prod.outlook.com (2603:10b6:303:b5::11) by CH2PR12MB4037.namprd12.prod.outlook.com (2603:10b6:610:7a::20) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.4669.11; Sun, 7 Nov 2021 15:30:21 +0000 Received: from CO1NAM11FT047.eop-nam11.prod.protection.outlook.com (2603:10b6:303:b5:cafe::41) by MW4PR03CA0276.outlook.office365.com (2603:10b6:303:b5::11) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.4669.11 via Frontend Transport; Sun, 7 Nov 2021 15:30:21 +0000 X-MS-Exchange-Authentication-Results: spf=pass (sender IP is 216.228.112.34) smtp.mailfrom=nvidia.com; monjalon.net; dkim=none (message not signed) header.d=none;monjalon.net; dmarc=pass action=none header.from=nvidia.com; Received-SPF: Pass (protection.outlook.com: domain of nvidia.com designates 216.228.112.34 as permitted sender) receiver=protection.outlook.com; client-ip=216.228.112.34; helo=mail.nvidia.com; Received: from mail.nvidia.com (216.228.112.34) by CO1NAM11FT047.mail.protection.outlook.com (10.13.174.132) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384) id 15.20.4669.10 via Frontend Transport; Sun, 7 Nov 2021 15:30:20 +0000 Received: from nvidia.com (172.20.187.5) by HQMAIL107.nvidia.com (172.20.187.13) with Microsoft SMTP Server (TLS) id 15.0.1497.18; Sun, 7 Nov 2021 15:30:18 +0000 From: Matan Azrad <matan@nvidia.com> To: Viacheslav Ovsiienko <viacheslavo@nvidia.com> CC: <dev@dpdk.org>, Thomas Monjalon <thomas@monjalon.net> Date: Sun, 7 Nov 2021 17:29:14 +0200 Message-ID: <20211107152919.2158802-1-matan@nvidia.com> X-Mailer: git-send-email 2.25.1 MIME-Version: 1.0 Content-Transfer-Encoding: 8bit Content-Type: text/plain X-Originating-IP: [172.20.187.5] X-ClientProxiedBy: HQMAIL107.nvidia.com (172.20.187.13) To HQMAIL107.nvidia.com (172.20.187.13) X-EOPAttributedMessage: 0 X-MS-PublicTrafficType: Email X-MS-Office365-Filtering-Correlation-Id: 526abc3b-173e-45fa-985f-08d9a2038290 X-MS-TrafficTypeDiagnostic: CH2PR12MB4037: X-LD-Processed: 43083d15-7273-40c1-b7db-39efd9ccc17a,ExtAddr X-Microsoft-Antispam-PRVS: <CH2PR12MB403769C05DDA00FB8BEC667DDF909@CH2PR12MB4037.namprd12.prod.outlook.com> X-MS-Oob-TLC-OOBClassifiers: OLM:451; X-MS-Exchange-SenderADCheck: 1 X-MS-Exchange-AntiSpam-Relay: 0 X-Microsoft-Antispam: BCL:0; X-Microsoft-Antispam-Message-Info: csbfBHCtWCHvr40qfQiZYO4k9keO1YBcYCSV4Fh6zW4OgxRStj8QSvWXpRF8QsJOWDcB7wdnLCp6SwA6sy0Ocn/7+7SgZfzP4/P234jH0E5q8voOyg0dKYdxiaQuy0gFs957muZ1CbY3bk7ws5LM1e0XT9lGi6xQgUXCMVYUUHAzuiI9HYdeU16FGnj0x37TOd6WqgWYo0iZtqUtUWJfaC5PaEM+YS4prPPuvZYK25k3vZfHoX1x3XV+6gC/qKc4AsLbI4rvWRhioHsYeUvNZZ5ogB/XUaGF+Cf3BSbyXY1QVrlOJS+jmhm/LNOlk/itQ5PS2/WIek4RJBpPF+zc4m+hfcfevC+v/A2TBArr2rbNayQJPBv0GtG+5a0XMippztd9iST2dUeJs4zByvCYrSg8igyC6CKIEnl387ZVk8AqNZujHW0fNZ5eNp6c4pnrCvaeh7Aj2/N3GN9HKgW5d2yj3hpABNQ71OK8hGNSFLctCo3JZ6gn0EeLhIOZpGl4QJRSCExZAqv/Jd7XKwAZWHLs8Zog34h0ddUrAYBWZ0dKcC0Yjm8z5Q0CcXyN2aRjwqo07xwrG1LYltlJFkI+f0IsGwe796w6tViweduYQfJLHqEMykOpKXUZiunLe34uWBJotqo+vXOBSL6A924Al6MIt74WWNJQJOLKevtakvZahOlfTL7aOvj/qTp9HkA6+/7zv/eCgzhTDWRxF79XIw== X-Forefront-Antispam-Report: CIP:216.228.112.34; CTRY:US; LANG:en; SCL:1; SRV:; IPV:NLI; SFV:NSPM; H:mail.nvidia.com; PTR:schybrid03.nvidia.com; CAT:NONE; SFS:(4636009)(36840700001)(46966006)(2906002)(1076003)(6636002)(82310400003)(4326008)(16526019)(186003)(26005)(508600001)(8676002)(2616005)(336012)(5660300002)(55016002)(7636003)(54906003)(8936002)(70206006)(6862004)(316002)(6286002)(37006003)(7696005)(356005)(6666004)(86362001)(70586007)(426003)(36756003)(36860700001)(83380400001)(47076005); DIR:OUT; SFP:1101; X-OriginatorOrg: Nvidia.com X-MS-Exchange-CrossTenant-OriginalArrivalTime: 07 Nov 2021 15:30:20.7552 (UTC) X-MS-Exchange-CrossTenant-Network-Message-Id: 526abc3b-173e-45fa-985f-08d9a2038290 X-MS-Exchange-CrossTenant-Id: 43083d15-7273-40c1-b7db-39efd9ccc17a X-MS-Exchange-CrossTenant-OriginalAttributedTenantConnectingIp: TenantId=43083d15-7273-40c1-b7db-39efd9ccc17a; Ip=[216.228.112.34]; Helo=[mail.nvidia.com] X-MS-Exchange-CrossTenant-AuthSource: CO1NAM11FT047.eop-nam11.prod.protection.outlook.com X-MS-Exchange-CrossTenant-AuthAs: Anonymous X-MS-Exchange-CrossTenant-FromEntityHeader: HybridOnPrem X-MS-Exchange-Transport-CrossTenantHeadersStamped: CH2PR12MB4037 Subject: [dpdk-dev] [PATCH 0/5] mlx5: workaround MR issues in FW\kernel X-BeenThere: dev@dpdk.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: DPDK patches and discussions <dev.dpdk.org> List-Unsubscribe: <https://mails.dpdk.org/options/dev>, <mailto:dev-request@dpdk.org?subject=unsubscribe> List-Archive: <http://mails.dpdk.org/archives/dev/> List-Post: <mailto:dev@dpdk.org> List-Help: <mailto:dev-request@dpdk.org?subject=help> List-Subscribe: <https://mails.dpdk.org/listinfo/dev>, <mailto:dev-request@dpdk.org?subject=subscribe> Errors-To: dev-bounces@dpdk.org Sender: "dev" <dev-bounces@dpdk.org> |
Message
Matan Azrad
Nov. 7, 2021, 3:29 p.m. UTC
As a workaround to kernel driver/FW issues of the mlx5 devices, it is needed to use MR, which is an indirect mkey pointing to direct mkey created by the kernel for any DevX command uses an MR. Fix any direct mkey usage to be configured by the ibv_reg_mr API. If the direct mkey is for DevX command usage, werap it with an indiect mkey to workaround the issues. Matan Azrad (2): common/mlx5: add wrapped MR create API vdpa/mlx5: workaround dirty bitmap MR creation Michael Baum (3): common/mlx5: glue MR registration with IOVA vdpa/mlx5: workaround guest MR registrations net/mlx5: workaround counter memory region creation drivers/common/mlx5/linux/meson.build | 2 + drivers/common/mlx5/linux/mlx5_common_os.c | 56 ++++++++++++++++++++++ drivers/common/mlx5/linux/mlx5_glue.c | 18 +++++++ drivers/common/mlx5/linux/mlx5_glue.h | 3 ++ drivers/common/mlx5/mlx5_common.h | 18 +++++++ drivers/common/mlx5/version.map | 3 ++ drivers/net/mlx5/mlx5.c | 8 +--- drivers/net/mlx5/mlx5.h | 5 +- drivers/net/mlx5/mlx5_flow.c | 25 +++------- drivers/vdpa/mlx5/mlx5_vdpa.h | 9 ++-- drivers/vdpa/mlx5/mlx5_vdpa_lm.c | 37 +++----------- drivers/vdpa/mlx5/mlx5_vdpa_mem.c | 43 ++++++----------- 12 files changed, 134 insertions(+), 93 deletions(-)