Cover Detail
Show a cover letter.
GET /api/covers/309/?format=api
{ "id": 309, "url": "http://patchwork.dpdk.org/api/covers/309/?format=api", "web_url": "http://patchwork.dpdk.org/project/dpdk/cover/20231026124347.22477-1-syalavarthi@marvell.com/", "project": { "id": 1, "url": "http://patchwork.dpdk.org/api/projects/1/?format=api", "name": "DPDK", "link_name": "dpdk", "list_id": "dev.dpdk.org", "list_email": "dev@dpdk.org", "web_url": "http://core.dpdk.org", "scm_url": "git://dpdk.org/dpdk", "webscm_url": "http://git.dpdk.org/dpdk", "list_archive_url": "https://inbox.dpdk.org/dev", "list_archive_url_format": "https://inbox.dpdk.org/dev/{}", "commit_url_format": "" }, "msgid": "<20231026124347.22477-1-syalavarthi@marvell.com>", "list_archive_url": "https://inbox.dpdk.org/dev/20231026124347.22477-1-syalavarthi@marvell.com", "date": "2023-10-26T12:43:09", "name": "[v9,00/34] Implementation of revised ml/cnxk driver", "submitter": { "id": 2480, "url": "http://patchwork.dpdk.org/api/people/2480/?format=api", "name": "Srikanth Yalavarthi", "email": "syalavarthi@marvell.com" }, "mbox": "http://patchwork.dpdk.org/project/dpdk/cover/20231026124347.22477-1-syalavarthi@marvell.com/mbox/", "series": [ { "id": 30002, "url": "http://patchwork.dpdk.org/api/series/30002/?format=api", "web_url": "http://patchwork.dpdk.org/project/dpdk/list/?series=30002", "date": "2023-10-26T12:43:09", "name": "Implementation of revised ml/cnxk driver", "version": 9, "mbox": "http://patchwork.dpdk.org/series/30002/mbox/" } ], "comments": "http://patchwork.dpdk.org/api/covers/309/comments/", "headers": { "Return-Path": "<dev-bounces@dpdk.org>", "X-Original-To": "patchwork@inbox.dpdk.org", "Delivered-To": "patchwork@inbox.dpdk.org", "Received": [ "from mails.dpdk.org (mails.dpdk.org [217.70.189.124])\n\tby inbox.dpdk.org (Postfix) with ESMTP id 5EC4443208;\n\tThu, 26 Oct 2023 14:43:56 +0200 (CEST)", "from mails.dpdk.org (localhost [127.0.0.1])\n\tby mails.dpdk.org (Postfix) with ESMTP id 070F740E40;\n\tThu, 26 Oct 2023 14:43:56 +0200 (CEST)", "from mx0b-0016f401.pphosted.com (mx0b-0016f401.pphosted.com\n [67.231.156.173])\n by mails.dpdk.org (Postfix) with ESMTP id B0D6E4025F\n for <dev@dpdk.org>; Thu, 26 Oct 2023 14:43:54 +0200 (CEST)", "from pps.filterd (m0045851.ppops.net [127.0.0.1])\n by mx0b-0016f401.pphosted.com (8.17.1.19/8.17.1.19) with ESMTP id\n 39QALkxx007523 for <dev@dpdk.org>; Thu, 26 Oct 2023 05:43:54 -0700", "from dc5-exch02.marvell.com ([199.233.59.182])\n by mx0b-0016f401.pphosted.com (PPS) with ESMTPS id 3txcsr25pc-1\n (version=TLSv1.2 cipher=ECDHE-RSA-AES256-SHA384 bits=256 verify=NOT)\n for <dev@dpdk.org>; Thu, 26 Oct 2023 05:43:53 -0700", "from DC5-EXCH01.marvell.com (10.69.176.38) by DC5-EXCH02.marvell.com\n (10.69.176.39) with Microsoft SMTP Server (TLS) id 15.0.1497.48;\n Thu, 26 Oct 2023 05:43:51 -0700", "from maili.marvell.com (10.69.176.80) by DC5-EXCH01.marvell.com\n (10.69.176.38) with Microsoft SMTP Server id 15.0.1497.48 via Frontend\n Transport; Thu, 26 Oct 2023 05:43:52 -0700", "from ml-host-33.caveonetworks.com (unknown [10.110.143.233])\n by maili.marvell.com (Postfix) with ESMTP id 88D5E3F7097;\n Thu, 26 Oct 2023 05:43:51 -0700 (PDT)" ], "DKIM-Signature": "v=1; a=rsa-sha256; c=relaxed/relaxed; d=marvell.com;\n h=from : to : cc :\n subject : date : message-id : in-reply-to : references : mime-version :\n content-transfer-encoding : content-type; s=pfpt0220;\n bh=lgRwm0Gda9VLiIALlimcCZh61/Yzok7XYgjvbOi5mPY=;\n b=FGZ3/i2gqzIJ4OFCU0nkAtqftCUn6wB0iVoUhgdUdnLG2UfEsDXHobd2/JViy1/00gQ/\n 4AGQcV/gnty71YU5ZZYp8hZzIHRVD01zfUjQotnU6GSKe7UjX3ADuPdPHVjvZQkdq/LN\n AUU/DCrtbTEHA+1HIleUcPzY7YGkjxL9EjhmE1td9rip9dYr3U+TA6zXgL4fUyHpfsBq\n XxoXhqKV8zynezq4S/4XgDhbI+jtExI/EY+vipbvL86q/GyAB2+nC2P7gGR5wo7KYBUk\n lIoosHJdIPjkjxQXYjh1DZxoxjVNxuwa6NG3KpnNLuaVsxGu3Qy5aYGCjDgdmmhk9iHd dQ==", "From": "Srikanth Yalavarthi <syalavarthi@marvell.com>", "To": "", "CC": "<dev@dpdk.org>, <syalavarthi@marvell.com>, <sshankarnara@marvell.com>,\n <aprabhu@marvell.com>, <ptakkar@marvell.com>", "Subject": "[PATCH v9 00/34] Implementation of revised ml/cnxk driver", "Date": "Thu, 26 Oct 2023 05:43:09 -0700", "Message-ID": "<20231026124347.22477-1-syalavarthi@marvell.com>", "X-Mailer": "git-send-email 2.42.0", "In-Reply-To": "<20230830155927.3566-1-syalavarthi@marvell.com>", "References": "<20230830155927.3566-1-syalavarthi@marvell.com>", "MIME-Version": "1.0", "Content-Transfer-Encoding": "8bit", "Content-Type": "text/plain", "X-Proofpoint-ORIG-GUID": "KVxRGmcJZT23FSloltmORY5ans5rLRkR", "X-Proofpoint-GUID": "KVxRGmcJZT23FSloltmORY5ans5rLRkR", "X-Proofpoint-Virus-Version": "vendor=baseguard\n engine=ICAP:2.0.272,Aquarius:18.0.987,Hydra:6.0.619,FMLib:17.11.176.26\n definitions=2023-10-26_10,2023-10-26_01,2023-05-22_02", "X-BeenThere": "dev@dpdk.org", "X-Mailman-Version": "2.1.29", "Precedence": "list", "List-Id": "DPDK patches and discussions <dev.dpdk.org>", "List-Unsubscribe": "<https://mails.dpdk.org/options/dev>,\n <mailto:dev-request@dpdk.org?subject=unsubscribe>", "List-Archive": "<http://mails.dpdk.org/archives/dev/>", "List-Post": "<mailto:dev@dpdk.org>", "List-Help": "<mailto:dev-request@dpdk.org?subject=help>", "List-Subscribe": "<https://mails.dpdk.org/listinfo/dev>,\n <mailto:dev-request@dpdk.org?subject=subscribe>", "Errors-To": "dev-bounces@dpdk.org" }, "content": "This patch series is an implementation of revised ml/cnxk driver\nto support models compiled with TVM compiler framework. TVM models\nuse a hybrid mode for execution, with regions of the model executing\non the ML accelerator and the rest executing on CPU cores.\n\nThis series of commits reorganizes the ml/cnxk driver and adds support\nto execute multiple regions with-in a TVM model.\n\nv9:\n - Fixed incorrect IO layout for TVM Marvell models\n - Set byte offset to zero for I/O tensors\n - Updated max layers macro definition. Set to TVMDP max layers.\n - Fixed TVM model IO type to RTE IO type map\n\nv8:\n - Updated CMake dependency resolution of external dependencies\n - Updated mldevs/cnxk documentation\n - Updated meson config files for cn9k and cn10k to include cmake\n\nv7:\n - Updated steps to build dependencies in cnxk mldev documentation\n - Replace str functions with rte_str functions\n - Drop use of rte_exit in ml/cnxk driver\n\nv6:\n - Added depends info for series. This series depends on patch-132887\n - Fix merge conflicts with dpdk-23.11-rc1\n - Fix issues with ml/cnxk driver release notes\n - Added build dependency information for dlpack headers\n\nv5:\n - Fix build failures for individual patches in the series\n - Finished build testing with devtools/test-meson-builds.sh script\n\nv4:\n - Squashed release notes\n - Updated external build dependency info in documentation\n\nv3:\n - Reduced use of RTE_MLDEV_CNXK_ENABLE_MVTVM macro\n - Added stubs file with dummy functions to use when TVM is disabled\n - Dropped patch with internal function to read firmware\n - Updated ML CNXK PMD documentation\n - Added external library dependency info in documentation\n - Added release notes for 23.11\n\nv2:\n - Fix xstats reporting\n - Fix issues reported by klocwork static analysis tool\n - Update external header inclusions\n\nv1:\n - Initial changes\n\nAnup Prabhu (2):\n ml/cnxk: enable OCM check for multilayer TVM model\n ml/cnxk: enable fast-path ops for TVM models\n\nPrince Takkar (2):\n ml/cnxk: update internal TVM model info structure\n ml/cnxk: support quantize and dequantize callback\n\nSrikanth Yalavarthi (30):\n ml/cnxk: drop support for register polling\n ml/cnxk: add generic cnxk device structure\n ml/cnxk: add generic model and layer structures\n ml/cnxk: add generic cnxk request structure\n ml/cnxk: add generic cnxk xstats structures\n ml/cnxk: rename cnxk ops function pointers struct\n ml/cnxk: update device handling functions\n ml/cnxk: update queue-pair handling functions\n ml/cnxk: update model load and unload functions\n ml/cnxk: update model start and stop functions\n ml/cnxk: update model utility functions\n ml/cnxk: update data quantization functions\n ml/cnxk: update device debug functions\n ml/cnxk: update device stats functions\n ml/cnxk: update device and model xstats functions\n ml/cnxk: update fast path functions\n ml/cnxk: move error handling to cnxk layer\n ml/cnxk: support config and close of tvmdp library\n ml/cnxk: add structures to support TVM model type\n ml/cnxk: add support for identify model type\n ml/cnxk: add support to parse TVM model objects\n ml/cnxk: fetch layer info and load TVM model\n ml/cnxk: update internal info for TVM model\n ml/cnxk: enable model unload in tvmdp library\n ml/cnxk: support start and stop for TVM models\n ml/cnxk: support device dump for TVM models\n ml/cnxk: enable reporting model runtime as xstats\n ml/cnxk: implement I/O alloc and free callbacks\n ml/cnxk: add generic ML malloc and free callback\n ml/cnxk: enable creation of mvtvm virtual device\n\n config/arm/arm64_cn10k_linux_gcc | 1 +\n config/arm/arm64_cn9k_linux_gcc | 1 +\n doc/guides/mldevs/cnxk.rst | 223 +-\n doc/guides/rel_notes/release_23_11.rst | 3 +\n drivers/ml/cnxk/cn10k_ml_dev.c | 416 ++--\n drivers/ml/cnxk/cn10k_ml_dev.h | 457 +---\n drivers/ml/cnxk/cn10k_ml_model.c | 403 ++--\n drivers/ml/cnxk/cn10k_ml_model.h | 151 +-\n drivers/ml/cnxk/cn10k_ml_ocm.c | 111 +-\n drivers/ml/cnxk/cn10k_ml_ocm.h | 15 +-\n drivers/ml/cnxk/cn10k_ml_ops.c | 2828 ++++++++----------------\n drivers/ml/cnxk/cn10k_ml_ops.h | 358 ++-\n drivers/ml/cnxk/cnxk_ml_dev.c | 22 +\n drivers/ml/cnxk/cnxk_ml_dev.h | 120 +\n drivers/ml/cnxk/cnxk_ml_io.c | 95 +\n drivers/ml/cnxk/cnxk_ml_io.h | 90 +\n drivers/ml/cnxk/cnxk_ml_model.c | 94 +\n drivers/ml/cnxk/cnxk_ml_model.h | 192 ++\n drivers/ml/cnxk/cnxk_ml_ops.c | 1690 ++++++++++++++\n drivers/ml/cnxk/cnxk_ml_ops.h | 87 +\n drivers/ml/cnxk/cnxk_ml_utils.c | 15 +\n drivers/ml/cnxk/cnxk_ml_utils.h | 17 +\n drivers/ml/cnxk/cnxk_ml_xstats.h | 152 ++\n drivers/ml/cnxk/meson.build | 70 +\n drivers/ml/cnxk/mvtvm_ml_dev.c | 196 ++\n drivers/ml/cnxk/mvtvm_ml_dev.h | 40 +\n drivers/ml/cnxk/mvtvm_ml_model.c | 409 ++++\n drivers/ml/cnxk/mvtvm_ml_model.h | 90 +\n drivers/ml/cnxk/mvtvm_ml_ops.c | 652 ++++++\n drivers/ml/cnxk/mvtvm_ml_ops.h | 82 +\n drivers/ml/cnxk/mvtvm_ml_stubs.c | 141 ++\n drivers/ml/cnxk/mvtvm_ml_stubs.h | 36 +\n 32 files changed, 6298 insertions(+), 2959 deletions(-)\n create mode 100644 drivers/ml/cnxk/cnxk_ml_dev.c\n create mode 100644 drivers/ml/cnxk/cnxk_ml_dev.h\n create mode 100644 drivers/ml/cnxk/cnxk_ml_io.c\n create mode 100644 drivers/ml/cnxk/cnxk_ml_io.h\n create mode 100644 drivers/ml/cnxk/cnxk_ml_model.c\n create mode 100644 drivers/ml/cnxk/cnxk_ml_model.h\n create mode 100644 drivers/ml/cnxk/cnxk_ml_ops.c\n create mode 100644 drivers/ml/cnxk/cnxk_ml_ops.h\n create mode 100644 drivers/ml/cnxk/cnxk_ml_utils.c\n create mode 100644 drivers/ml/cnxk/cnxk_ml_utils.h\n create mode 100644 drivers/ml/cnxk/cnxk_ml_xstats.h\n create mode 100644 drivers/ml/cnxk/mvtvm_ml_dev.c\n create mode 100644 drivers/ml/cnxk/mvtvm_ml_dev.h\n create mode 100644 drivers/ml/cnxk/mvtvm_ml_model.c\n create mode 100644 drivers/ml/cnxk/mvtvm_ml_model.h\n create mode 100644 drivers/ml/cnxk/mvtvm_ml_ops.c\n create mode 100644 drivers/ml/cnxk/mvtvm_ml_ops.h\n create mode 100644 drivers/ml/cnxk/mvtvm_ml_stubs.c\n create mode 100644 drivers/ml/cnxk/mvtvm_ml_stubs.h" }