From patchwork Sun Jan 7 15:20:04 2024 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Srikanth Yalavarthi X-Patchwork-Id: 135775 X-Patchwork-Delegate: jerinj@marvell.com Return-Path: X-Original-To: patchwork@inbox.dpdk.org Delivered-To: patchwork@inbox.dpdk.org Received: from mails.dpdk.org (mails.dpdk.org [217.70.189.124]) by inbox.dpdk.org (Postfix) with ESMTP id 5003E43857; Sun, 7 Jan 2024 16:20:10 +0100 (CET) Received: from mails.dpdk.org (localhost [127.0.0.1]) by mails.dpdk.org (Postfix) with ESMTP id 4010C402B1; Sun, 7 Jan 2024 16:20:10 +0100 (CET) Received: from mx0b-0016f401.pphosted.com (mx0b-0016f401.pphosted.com [67.231.156.173]) by mails.dpdk.org (Postfix) with ESMTP id 0F52840263 for ; Sun, 7 Jan 2024 16:20:08 +0100 (CET) Received: from pps.filterd (m0045851.ppops.net [127.0.0.1]) by mx0b-0016f401.pphosted.com (8.17.1.24/8.17.1.24) with ESMTP id 407BtA9P014684 for ; Sun, 7 Jan 2024 07:20:08 -0800 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=marvell.com; h= from:to:cc:subject:date:message-id:mime-version :content-transfer-encoding:content-type; s=pfpt0220; bh=FTepcp9l aKGPLiRm273owhLy71DqLThONC8470KlPqY=; b=BagulfU0uzqn4c+w6LGzBLYl SSo8WNfCaqP0LKh1yiWC8GyLHCpx800RyqZ1uFIGBWnMNMVPDv0HaYcM6UtStF5G DhV3/tzaOMK4Pwpl1rzLO1zPfPAEydFoTZ+hT7AB5g5A1ZUHsXIqN0b2r6matIzm BwiT2VV+4nlr3jFgE2JW+6mhpvMVD8wF3LkmsO1rcl2FX921Vh+jmyaIsA9g1ibJ qwuDSJwskpWWFi8BvWlIQTShPwJy9mdR11sDNsjZLlQ9k9OkDfzFBodC8MZmxwtg 90VweDXueISD5BD+XBAM4mv0xzOOcUV+btREJVemjZUqsNr5toLls+ejpAGeKQ== Received: from dc5-exch01.marvell.com ([199.233.59.181]) by mx0b-0016f401.pphosted.com (PPS) with ESMTPS id 3vf78n29a2-1 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-SHA384 bits=256 verify=NOT) for ; Sun, 07 Jan 2024 07:20:08 -0800 (PST) Received: from DC5-EXCH02.marvell.com (10.69.176.39) by DC5-EXCH01.marvell.com (10.69.176.38) with Microsoft SMTP Server (TLS) id 15.0.1497.48; Sun, 7 Jan 2024 07:20:06 -0800 Received: from maili.marvell.com (10.69.176.80) by DC5-EXCH02.marvell.com (10.69.176.39) with Microsoft SMTP Server id 15.0.1497.48 via Frontend Transport; Sun, 7 Jan 2024 07:20:06 -0800 Received: from ml-host-33.caveonetworks.com (unknown [10.110.143.233]) by maili.marvell.com (Postfix) with ESMTP id 162B23F70A3; Sun, 7 Jan 2024 07:20:06 -0800 (PST) From: Srikanth Yalavarthi To: Srikanth Yalavarthi CC: , , , Subject: [PATCH 1/1] ml/cnxk: enable data caching for TVM models Date: Sun, 7 Jan 2024 07:20:04 -0800 Message-ID: <20240107152004.1658-1-syalavarthi@marvell.com> X-Mailer: git-send-email 2.42.0 MIME-Version: 1.0 X-Proofpoint-ORIG-GUID: Dw8HgP_HeaQMGgDxIq7FXdkjkokb0W3z X-Proofpoint-GUID: Dw8HgP_HeaQMGgDxIq7FXdkjkokb0W3z X-Proofpoint-Virus-Version: vendor=baseguard engine=ICAP:2.0.272,Aquarius:18.0.997,Hydra:6.0.619,FMLib:17.11.176.26 definitions=2023-12-09_02,2023-12-07_01,2023-05-22_02 X-BeenThere: dev@dpdk.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: DPDK patches and discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: dev-bounces@dpdk.org Enabled data caching for TVM models with MRVL only layers. Signed-off-by: Srikanth Yalavarthi --- drivers/ml/cnxk/cn10k_ml_ops.c | 9 +++++++-- 1 file changed, 7 insertions(+), 2 deletions(-) diff --git a/drivers/ml/cnxk/cn10k_ml_ops.c b/drivers/ml/cnxk/cn10k_ml_ops.c index 53700387335..834e55e88e9 100644 --- a/drivers/ml/cnxk/cn10k_ml_ops.c +++ b/drivers/ml/cnxk/cn10k_ml_ops.c @@ -996,8 +996,13 @@ cn10k_ml_layer_start(void *device, uint16_t model_id, const char *layer_name) if (ret < 0) { cn10k_ml_layer_stop(device, model_id, layer_name); } else { - if (cn10k_mldev->cache_model_data && model->type == ML_CNXK_MODEL_TYPE_GLOW) - ret = cn10k_ml_cache_model_data(cnxk_mldev, layer); + if (cn10k_mldev->cache_model_data) { + if ((model->type == ML_CNXK_MODEL_TYPE_GLOW && + model->subtype == ML_CNXK_MODEL_SUBTYPE_GLOW_MRVL) || + (model->type == ML_CNXK_MODEL_TYPE_TVM && + model->subtype == ML_CNXK_MODEL_SUBTYPE_TVM_MRVL)) + ret = cn10k_ml_cache_model_data(cnxk_mldev, layer); + } } return ret;