From patchwork Thu Nov 11 06:27:25 2021 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: "Wang, YuanX" X-Patchwork-Id: 104168 X-Patchwork-Delegate: maxime.coquelin@redhat.com Return-Path: X-Original-To: patchwork@inbox.dpdk.org Delivered-To: patchwork@inbox.dpdk.org Received: from mails.dpdk.org (mails.dpdk.org [217.70.189.124]) by inbox.dpdk.org (Postfix) with ESMTP id E93C7A034F; Thu, 11 Nov 2021 07:39:32 +0100 (CET) Received: from [217.70.189.124] (localhost [127.0.0.1]) by mails.dpdk.org (Postfix) with ESMTP id 6D13E40E2D; Thu, 11 Nov 2021 07:39:32 +0100 (CET) Received: from mga01.intel.com (mga01.intel.com [192.55.52.88]) by mails.dpdk.org (Postfix) with ESMTP id 6EC1640E03 for ; Thu, 11 Nov 2021 07:39:30 +0100 (CET) X-IronPort-AV: E=McAfee;i="6200,9189,10164"; a="256562506" X-IronPort-AV: E=Sophos;i="5.87,225,1631602800"; d="scan'208";a="256562506" Received: from orsmga008.jf.intel.com ([10.7.209.65]) by fmsmga101.fm.intel.com with ESMTP/TLS/ECDHE-RSA-AES256-GCM-SHA384; 10 Nov 2021 22:39:29 -0800 X-IronPort-AV: E=Sophos;i="5.87,225,1631602800"; d="scan'208";a="504301308" Received: from unknown (HELO localhost.localdomain) ([10.240.183.50]) by orsmga008-auth.jf.intel.com with ESMTP/TLS/ECDHE-RSA-AES256-GCM-SHA384; 10 Nov 2021 22:39:25 -0800 From: Yuan Wang To: maxime.coquelin@redhat.com, chenbo.xia@intel.com Cc: dev@dpdk.org, jiayu.hu@intel.com, xuan.ding@intel.com, wenwux.ma@intel.com, xingguang.he@intel.com, yvonnex.yang@intel.com, yuanx.wang@intel.com Subject: [PATCH] vhost: fix get hpa fail from guest pages Date: Thu, 11 Nov 2021 06:27:25 +0000 Message-Id: <20211111062725.108297-1-yuanx.wang@intel.com> X-Mailer: git-send-email 2.25.1 MIME-Version: 1.0 X-BeenThere: dev@dpdk.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: DPDK patches and discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: dev-bounces@dpdk.org When processing front-end memory regions messages, vhost saves the guest/host physical address mappings to guest pages and merges adjacent contiguous pages if hpa is contiguous, however gpa is likely not contiguous in PA mode and merging will cause the gpa range to change. This patch distinguishes the case of discontinuous gpa and does a range lookup on gpa when doing a binary search. Fixes: e246896178e("vhost: get guest/host physical address mappings") Fixes: 6563cf92380 ("vhost: fix async copy on multi-page buffers") Signed-off-by: Yuan Wang --- lib/vhost/vhost.h | 18 ++++++++++++++++-- lib/vhost/vhost_user.c | 15 +++++++++++---- 2 files changed, 27 insertions(+), 6 deletions(-) diff --git a/lib/vhost/vhost.h b/lib/vhost/vhost.h index 7085e0885c..b3f0c1d07c 100644 --- a/lib/vhost/vhost.h +++ b/lib/vhost/vhost.h @@ -587,6 +587,20 @@ static __rte_always_inline int guest_page_addrcmp(const void *p1, return 0; } +static __rte_always_inline int guest_page_rangecmp(const void *p1, const void *p2) +{ + const struct guest_page *page1 = (const struct guest_page *)p1; + const struct guest_page *page2 = (const struct guest_page *)p2; + + if (page1->guest_phys_addr >= page2->guest_phys_addr) { + if (page1->guest_phys_addr < page2->guest_phys_addr + page2->size) + return 0; + else + return 1; + } else + return -1; +} + static __rte_always_inline rte_iova_t gpa_to_first_hpa(struct virtio_net *dev, uint64_t gpa, uint64_t gpa_size, uint64_t *hpa_size) @@ -597,9 +611,9 @@ gpa_to_first_hpa(struct virtio_net *dev, uint64_t gpa, *hpa_size = gpa_size; if (dev->nr_guest_pages >= VHOST_BINARY_SEARCH_THRESH) { - key.guest_phys_addr = gpa & ~(dev->guest_pages[0].size - 1); + key.guest_phys_addr = gpa; page = bsearch(&key, dev->guest_pages, dev->nr_guest_pages, - sizeof(struct guest_page), guest_page_addrcmp); + sizeof(struct guest_page), guest_page_rangecmp); if (page) { if (gpa + gpa_size <= page->guest_phys_addr + page->size) { diff --git a/lib/vhost/vhost_user.c b/lib/vhost/vhost_user.c index a781346c4d..7d58fde458 100644 --- a/lib/vhost/vhost_user.c +++ b/lib/vhost/vhost_user.c @@ -999,10 +999,17 @@ add_one_guest_page(struct virtio_net *dev, uint64_t guest_phys_addr, if (dev->nr_guest_pages > 0) { last_page = &dev->guest_pages[dev->nr_guest_pages - 1]; /* merge if the two pages are continuous */ - if (host_phys_addr == last_page->host_phys_addr + - last_page->size) { - last_page->size += size; - return 0; + if (host_phys_addr == last_page->host_phys_addr + last_page->size) { + if (rte_eal_iova_mode() == RTE_IOVA_VA) { + last_page->size += size; + return 0; + } + + if (rte_eal_iova_mode() == RTE_IOVA_PA && + guest_phys_addr == last_page->guest_phys_addr + last_page->size) { + last_page->size += size; + return 0; + } } }