From patchwork Tue Jan 31 09:33:36 2023 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Alex Vesker X-Patchwork-Id: 122728 X-Patchwork-Delegate: rasland@nvidia.com Return-Path: X-Original-To: patchwork@inbox.dpdk.org Delivered-To: patchwork@inbox.dpdk.org Received: from mails.dpdk.org (mails.dpdk.org [217.70.189.124]) by inbox.dpdk.org (Postfix) with ESMTP id E2BB041B8D; Tue, 31 Jan 2023 10:35:28 +0100 (CET) Received: from mails.dpdk.org (localhost [127.0.0.1]) by mails.dpdk.org (Postfix) with ESMTP id EB50342D2C; Tue, 31 Jan 2023 10:34:44 +0100 (CET) Received: from NAM12-DM6-obe.outbound.protection.outlook.com (mail-dm6nam12on2056.outbound.protection.outlook.com [40.107.243.56]) by mails.dpdk.org (Postfix) with ESMTP id E172541148 for ; Tue, 31 Jan 2023 10:34:39 +0100 (CET) ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=fFdt0rGJU/BPxoRNLTygeNoeXuwPuXi9JOSylDn3vWVwm5HV2mGqOkVf16LQ6Uk5oTyQ0H0+xF/T0l3TG7x/JG/AHHPFq63Wn8TgL/ZahJS0WVq4/TT42sH1ZYbe+ltE+K8DToObji72Tmdl2BvdrwcFF0Zj+D7pAmqqLGmh1HjAPlNQebwLLJnh/T6em1xxvKHHhzzGc9AyYixHP67rAK0AURRXpbAvnrtGZQspoo8HQsaRquIfkZGXF8ELJgRpXBzfXocKCYdh2vVwWlbZHokKHL5aWCS8R7cnKdRED8KmjaQZ5p9GUlaNWfQnE+24DKkKpamSy3u/bG6Je/iGOA== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=A2D0P8B+eE93VbCo8qqLvTULa6Y8ekyxebk8V4wKVvo=; b=ARFC+HLpOmdL+U1vFxSZFjKeYh4fdh29Svbs9TGmSpYHKcC3vzjKDvp3dO3kMe9MV01Wnn9qHK7oCOnBfQ3zg3DYlJoCZH5vLVZq1WKE/ndlxoyxtCUIvfWHwYqyhFcPE+h7ljZoIva7NxLAtDP51zvfdp9+6bVYGVu9+8TW74vjbvhRHXdxYA01mYVJxDg7OWAY5d5E4rBCRHVwoSNKhs3wdIkvuAhjQov3egePzKa8S+tGoWmofegDtEp+pbMesINxVHdHMB40CGJ5Jblv1sDJ0Z6E6Zbwa7jIZKyflXiVNdRo5AF28dm2oYXVFT0Pkb+B9Cgom294Cuy5cNlZ8g== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass (sender ip is 216.228.117.160) smtp.rcpttodomain=monjalon.net smtp.mailfrom=nvidia.com; dmarc=pass (p=reject sp=reject pct=100) action=none header.from=nvidia.com; dkim=none (message not signed); arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=Nvidia.com; s=selector2; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=A2D0P8B+eE93VbCo8qqLvTULa6Y8ekyxebk8V4wKVvo=; b=M6n4kWRBxlkmxupWP9REkEhTHk8BlJCBnYKGfAAN9dezmGF9sUJ2x2mp6Pq8uPdYltWokp+OsrvviGgHyueCn7K9DS6yjO05RPU7gcaYbU/X6sr/KGE6f4QbA17b9YPhFpPuYBIoy+kt4j/MQASc2Ssahu7BaTCNyJKnDyd5ArsTWhS538x2kBxpR/qlSwFhJoj5p4evJvDRwkjBavfA5uqAOWmZREHK+UIszqiiJFny5W4HniN7xgB7gZOxcA5pDk5DuAaClAfHiCJXhGGvIniKvfFQAkBqrhvd+EsfIss3h0NC8+o7fZce4LunEus94XDDnT0llcO7Uipf3/JURA== Received: from MW4PR04CA0087.namprd04.prod.outlook.com (2603:10b6:303:6b::32) by MW4PR12MB7311.namprd12.prod.outlook.com (2603:10b6:303:227::11) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.6043.38; Tue, 31 Jan 2023 09:34:38 +0000 Received: from CO1NAM11FT016.eop-nam11.prod.protection.outlook.com (2603:10b6:303:6b:cafe::db) by MW4PR04CA0087.outlook.office365.com (2603:10b6:303:6b::32) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.6043.38 via Frontend Transport; Tue, 31 Jan 2023 09:34:38 +0000 X-MS-Exchange-Authentication-Results: spf=pass (sender IP is 216.228.117.160) smtp.mailfrom=nvidia.com; dkim=none (message not signed) header.d=none;dmarc=pass action=none header.from=nvidia.com; Received-SPF: Pass (protection.outlook.com: domain of nvidia.com designates 216.228.117.160 as permitted sender) receiver=protection.outlook.com; client-ip=216.228.117.160; helo=mail.nvidia.com; pr=C Received: from mail.nvidia.com (216.228.117.160) by CO1NAM11FT016.mail.protection.outlook.com (10.13.175.141) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.6043.21 via Frontend Transport; Tue, 31 Jan 2023 09:34:38 +0000 Received: from rnnvmail201.nvidia.com (10.129.68.8) by mail.nvidia.com (10.129.200.66) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.2.986.36; Tue, 31 Jan 2023 01:34:21 -0800 Received: from nvidia.com (10.126.231.37) by rnnvmail201.nvidia.com (10.129.68.8) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.2.986.36; Tue, 31 Jan 2023 01:34:19 -0800 From: Alex Vesker To: , , , "Matan Azrad" CC: , Subject: [v1 07/16] net/mlx5/hws: add send FW range STE WQE Date: Tue, 31 Jan 2023 11:33:36 +0200 Message-ID: <20230131093346.1261066-8-valex@nvidia.com> X-Mailer: git-send-email 2.27.0 In-Reply-To: <20230131093346.1261066-1-valex@nvidia.com> References: <20230131093346.1261066-1-valex@nvidia.com> MIME-Version: 1.0 X-Originating-IP: [10.126.231.37] X-ClientProxiedBy: rnnvmail203.nvidia.com (10.129.68.9) To rnnvmail201.nvidia.com (10.129.68.8) X-EOPAttributedMessage: 0 X-MS-PublicTrafficType: Email X-MS-TrafficTypeDiagnostic: CO1NAM11FT016:EE_|MW4PR12MB7311:EE_ X-MS-Office365-Filtering-Correlation-Id: 146e6ada-37ef-4ec9-dc9c-08db036e5f2a X-LD-Processed: 43083d15-7273-40c1-b7db-39efd9ccc17a,ExtAddr X-MS-Exchange-SenderADCheck: 1 X-MS-Exchange-AntiSpam-Relay: 0 X-Microsoft-Antispam: BCL:0; X-Microsoft-Antispam-Message-Info: 3E7Ar5EksJlGrGFt5KwwN+eaf3L2psApmUP0yHKXpk50WUnaWWgn+AzV/T4iaNltiq/8NFRXBo7ZAjXHHEECppL0Uhm2PaFPJ5FuVzbHvKMGgcAhf71+MP8Xtf3Rxu/ditMfDSoOhVuTF7ymcdbnrMjAn8q9hDo8KsY32MCcDxe5/9IB3Zv5adcHqRy7u3p163v82J/wbNwRXG7pRHoSZtIbAiA02DXMSJndlcsOcN6/++5dDKOBP7Yfmr7Jjz94pMi7+ep2Ir2ZBAXWtU74t3VqrhHPAxvQAQRxFZ0wDZXZEcub3xZotm6ce6lh6TAe5ddG4jfbAUqvt6PlBiwF+h3CejhCTfw8sIwrwe4Rd1RAfnMpNDND1uWkNcqMIOu5d2PhqL94pmU49G+q7DZp+js3s1TCSM5izpZjsAkbLY1fHWqFwTKd0/pEKd6w+v6nDQ7kT8DFS/zyQrF3Q0mYz/0xe5NLil465msSxHLYLgtlP0RLFylJ71BRb2pEGvvzwE9R/oKqosMImrvVtFCMKnG+dOV4AO5WDdBonuqqh2GgT4ApGxp1wE7RDLnhCZ/4/ULGmlW5Jz4MtEZneGG/aThC9BvyUJxbBjp3OZV6zYkdq4eBdSTNkQiG320Le0uh2T5feQZHvfhay34tlNGMP6hc/aponHf2APsOiN4o9GlKc7fxGsyDkednzq0yjiihtgwSBjmuOdBDr5AOR+t1nGU+Eow8H93j9SdzluHToHgkmNvsOp1Lni02Fp4X66tt X-Forefront-Antispam-Report: CIP:216.228.117.160; CTRY:US; LANG:en; SCL:1; SRV:; IPV:NLI; SFV:NSPM; H:mail.nvidia.com; PTR:dc6edge1.nvidia.com; CAT:NONE; SFS:(13230025)(4636009)(136003)(346002)(376002)(39860400002)(396003)(451199018)(36840700001)(46966006)(40470700004)(7636003)(86362001)(82310400005)(356005)(40460700003)(40480700001)(55016003)(36756003)(426003)(47076005)(336012)(70586007)(70206006)(8676002)(83380400001)(54906003)(6636002)(110136005)(316002)(107886003)(1076003)(16526019)(6286002)(26005)(186003)(7696005)(478600001)(6666004)(2616005)(82740400003)(2906002)(8936002)(41300700001)(36860700001)(4326008)(5660300002); DIR:OUT; SFP:1101; X-OriginatorOrg: Nvidia.com X-MS-Exchange-CrossTenant-OriginalArrivalTime: 31 Jan 2023 09:34:38.0050 (UTC) X-MS-Exchange-CrossTenant-Network-Message-Id: 146e6ada-37ef-4ec9-dc9c-08db036e5f2a X-MS-Exchange-CrossTenant-Id: 43083d15-7273-40c1-b7db-39efd9ccc17a X-MS-Exchange-CrossTenant-OriginalAttributedTenantConnectingIp: TenantId=43083d15-7273-40c1-b7db-39efd9ccc17a; Ip=[216.228.117.160]; Helo=[mail.nvidia.com] X-MS-Exchange-CrossTenant-AuthSource: CO1NAM11FT016.eop-nam11.prod.protection.outlook.com X-MS-Exchange-CrossTenant-AuthAs: Anonymous X-MS-Exchange-CrossTenant-FromEntityHeader: HybridOnPrem X-MS-Exchange-Transport-CrossTenantHeadersStamped: MW4PR12MB7311 X-BeenThere: dev@dpdk.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: DPDK patches and discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: dev-bounces@dpdk.org FW WQE supports complex rules, constructed from 2 STEs, for example: Hash(DefinerA) SteMatch(DefinerB) SteRange(DefinerC) DefinerA is a subset of DefinerB This complex rule is written using a single FW command which has a single WQE control, STE match data0 and STE range data1. FW manages STEs/ICM and coherency between deletion and creation. It is possible to also pass the definer value as part of the STE, this is not supported with current HW. Signed-off-by: Alex Vesker --- drivers/net/mlx5/hws/mlx5dr_send.c | 19 +++++++++++++++++++ drivers/net/mlx5/hws/mlx5dr_send.h | 3 +++ 2 files changed, 22 insertions(+) diff --git a/drivers/net/mlx5/hws/mlx5dr_send.c b/drivers/net/mlx5/hws/mlx5dr_send.c index a9958df4f2..51aaf5c8e2 100644 --- a/drivers/net/mlx5/hws/mlx5dr_send.c +++ b/drivers/net/mlx5/hws/mlx5dr_send.c @@ -242,11 +242,15 @@ int mlx5dr_send_wqe_fw(struct ibv_context *ibv_ctx, struct mlx5dr_wqe_gta_ctrl_seg *send_wqe_ctrl, void *send_wqe_match_data, void *send_wqe_match_tag, + void *send_wqe_range_data, + void *send_wqe_range_tag, bool is_jumbo, uint8_t gta_opcode) { + bool has_range = send_wqe_range_data || send_wqe_range_tag; bool has_match = send_wqe_match_data || send_wqe_match_tag; struct mlx5dr_wqe_gta_data_seg_ste gta_wqe_data0 = {0}; + struct mlx5dr_wqe_gta_data_seg_ste gta_wqe_data1 = {0}; struct mlx5dr_wqe_gta_ctrl_seg gta_wqe_ctrl = {0}; struct mlx5dr_cmd_generate_wqe_attr attr = {0}; struct mlx5dr_wqe_ctrl_seg wqe_ctrl = {0}; @@ -278,6 +282,17 @@ int mlx5dr_send_wqe_fw(struct ibv_context *ibv_ctx, attr.gta_data_0 = (uint8_t *)>a_wqe_data0; } + /* Set GTA range WQE DATA */ + if (has_range) { + if (send_wqe_range_data) + memcpy(>a_wqe_data1, send_wqe_range_data, sizeof(gta_wqe_data1)); + else + mlx5dr_send_wqe_set_tag(>a_wqe_data1, send_wqe_range_tag, false); + + gta_wqe_data1.rsvd1_definer = htobe32(send_attr->range_definer_id << 8); + attr.gta_data_1 = (uint8_t *)>a_wqe_data1; + } + attr.pdn = pd_num; attr.wqe_ctrl = (uint8_t *)&wqe_ctrl; attr.gta_ctrl = (uint8_t *)>a_wqe_ctrl; @@ -336,6 +351,8 @@ void mlx5dr_send_stes_fw(struct mlx5dr_send_engine *queue, ste_attr->wqe_ctrl, ste_attr->wqe_data, ste_attr->wqe_tag, + ste_attr->range_wqe_data, + ste_attr->range_wqe_tag, ste_attr->wqe_tag_is_jumbo, ste_attr->gta_opcode); if (ret) @@ -350,6 +367,8 @@ void mlx5dr_send_stes_fw(struct mlx5dr_send_engine *queue, ste_attr->wqe_ctrl, ste_attr->wqe_data, ste_attr->wqe_tag, + ste_attr->range_wqe_data, + ste_attr->range_wqe_tag, ste_attr->wqe_tag_is_jumbo, ste_attr->gta_opcode); if (ret) diff --git a/drivers/net/mlx5/hws/mlx5dr_send.h b/drivers/net/mlx5/hws/mlx5dr_send.h index 1e845b1c7a..47bb66b3c7 100644 --- a/drivers/net/mlx5/hws/mlx5dr_send.h +++ b/drivers/net/mlx5/hws/mlx5dr_send.h @@ -161,6 +161,7 @@ struct mlx5dr_send_engine_post_attr { uint8_t notify_hw; uint8_t fence; uint8_t match_definer_id; + uint8_t range_definer_id; size_t len; struct mlx5dr_rule *rule; uint32_t id; @@ -182,8 +183,10 @@ struct mlx5dr_send_ste_attr { uint32_t direct_index; struct mlx5dr_send_engine_post_attr send_attr; struct mlx5dr_rule_match_tag *wqe_tag; + struct mlx5dr_rule_match_tag *range_wqe_tag; struct mlx5dr_wqe_gta_ctrl_seg *wqe_ctrl; struct mlx5dr_wqe_gta_data_seg_ste *wqe_data; + struct mlx5dr_wqe_gta_data_seg_ste *range_wqe_data; }; /**