From patchwork Tue Jul 26 06:57:27 2022 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 8bit X-Patchwork-Submitter: Jun Qiu X-Patchwork-Id: 114214 X-Patchwork-Delegate: thomas@monjalon.net Return-Path: X-Original-To: patchwork@inbox.dpdk.org Delivered-To: patchwork@inbox.dpdk.org Received: from mails.dpdk.org (mails.dpdk.org [217.70.189.124]) by inbox.dpdk.org (Postfix) with ESMTP id DABBDA00C4; Tue, 26 Jul 2022 08:57:32 +0200 (CEST) Received: from [217.70.189.124] (localhost [127.0.0.1]) by mails.dpdk.org (Postfix) with ESMTP id 8B7AE40DDD; Tue, 26 Jul 2022 08:57:32 +0200 (CEST) Received: from APC01-SG2-obe.outbound.protection.outlook.com (mail-sgaapc01on2067.outbound.protection.outlook.com [40.107.215.67]) by mails.dpdk.org (Postfix) with ESMTP id 2528140695; Tue, 26 Jul 2022 08:57:31 +0200 (CEST) ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=Z7R1aEQoB9Ephn6jIu7dnyyIKD/uQLjHzBlnI+GF+xctF9QzazbLRV7+q7ZbZm7KBNXi+cYbSfQjwsoyaC4n3wwX09HFslK+yJFhY0Xh/Kpj/qz5kOvzu8RMw/HvQa18qJ0M36doj/SWDnIzzAUaK1Vr8IPXjfDw2y7WhexlsR3S9fPDnnVuEpp7uBC0qujNkqCiMW2G/xha+z+LqrQkMGJFnW4p2ZMtZX5u7DNo8WBmEBrm5Qp09lES1ea6LUIkNfl/SZfpLAm84G4Uwry1++GRJoJqfgi5S8+3HoUtOPSHlB/92ogRMYMBOvfz9Kr0AVkQnD+q2EgMkofOuErHOA== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=rAQyescHIkpe/D4j3ZSg1rruKMz3e1/LsrhkQUJmejE=; b=bDbjHUKW50mGFU/pYRl60MfsN6WsflHzkckCsyhm51BPCDcBihqU3DTutqjGqcKeVEFUyjVDZ14da0EcKey08LRT32SsMlUtaoWTWyUQHBUZCMaMgaP6UW2CKPX70718TI6kQ3OsCy8yW1xLOMQ6/zsuluvKCzd2ownBqSbEfct55wuwrBYF70kjZFV7G3XoGgypRqeftyFc3esQ0e9XDKijNfeXKlNets7CQWJ+D3fnFez/bsiOsjYhPJh6QSXmsfO4fs98msbRAoSAgjWAsE8HjfmkDqsBDIIFpsknkuyGAcGT6jWk8YJ95LFTWc+Mpb/atws3De71de/vjGpKrw== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=jaguarmicro.com; dmarc=pass action=none header.from=jaguarmicro.com; dkim=pass header.d=jaguarmicro.com; arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=jaguarmicro.com; s=selector1; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=rAQyescHIkpe/D4j3ZSg1rruKMz3e1/LsrhkQUJmejE=; b=Nzq6iCMLwWj7e40ZZLkL8fHu/xbZO+ezPhk3K/V/VV0yze0LENw+rgU21lhQKfdZXnpSljypz558VT021rzVjTPIyPx22Tr8ohsSlVF8rfWodFNxM6xM+RJxRTZ3Ib9ZGMrioTcHwBboP/zngtT+hxuO2jWNx9crZQSYYPxr4vU2Kxm3SxCLbPuiU/DooSrusGCK7mUM8ipsypZh8aVe7ndGrQctrCV6TazM9uIb+DyMjUfrE2w/d5tbZ9bUb0nkHmc0xov1VfX+uiY2s2Y/gUYXsuqFxlavS4ViMS25ajWsNzOVpkCfY1NA34uYcaDm23hQ5Twedmn8cJzvPihZxA== Received: from KL1PR0601MB4530.apcprd06.prod.outlook.com (2603:1096:820:64::10) by SG2PR06MB4868.apcprd06.prod.outlook.com (2603:1096:4:177::14) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.5458.19; Tue, 26 Jul 2022 06:57:27 +0000 Received: from KL1PR0601MB4530.apcprd06.prod.outlook.com ([fe80::59b6:ff9c:d103:9e97]) by KL1PR0601MB4530.apcprd06.prod.outlook.com ([fe80::59b6:ff9c:d103:9e97%9]) with mapi id 15.20.5458.025; Tue, 26 Jul 2022 06:57:27 +0000 From: Jun Qiu To: kumaraparameshwaran rathinavel CC: "dev@dpdk.org" , "jiayu.hu@intel.com" , "stable@dpdk.org" Subject: =?utf-8?b?562U5aSNOiBbUEFUQ0hdIGdybzogZml4IGdybyB3aXRoIHRjcCBwdXNo?= =?utf-8?b?IGZsYWc=?= Thread-Topic: [PATCH] gro: fix gro with tcp push flag Thread-Index: AQHYoLdzwc7SOHq+ikGjq+ryowq21q2QM/cAgAADMwA= Date: Tue, 26 Jul 2022 06:57:27 +0000 Message-ID: References: <20220726061741.21021-1-jun.qiu@jaguarmicro.com> In-Reply-To: Accept-Language: en-US Content-Language: zh-CN X-MS-Has-Attach: X-MS-TNEF-Correlator: authentication-results: dkim=none (message not signed) header.d=none;dmarc=none action=none header.from=jaguarmicro.com; x-ms-publictraffictype: Email x-ms-office365-filtering-correlation-id: b1fd9c07-ca7d-447f-276b-08da6ed419d1 x-ms-traffictypediagnostic: SG2PR06MB4868:EE_ x-ms-exchange-senderadcheck: 1 x-ms-exchange-antispam-relay: 0 x-microsoft-antispam: BCL:0; x-microsoft-antispam-message-info: 7tfkOkF6FOtFH302twnS/bzBeiXh7L2sVRs6HBiIbyCMpxe2W3/r4kf7uoV9zvEKV+RIilhwIrEAjfZNuPOsFLs1s0q0WryjV+ZdzlWZpbh+qvXA5++h0UWsT1fv681AbCTNJKjsTAdth2KS2dz/GGyN66XzDIJw1Fd8I/lBvj4dKCOmro5Bx3YI28nEQ7piftLU1oSytCXl3+M79BpgJ6VEKEbB7e0HgpttX9gKXWv+8cfjv9KZscUbdU+pn8ThaRWMfXV2mgAJGGUows44fZofFe0UMbE9kOk21UGimcEizwJRxgPo6Bp2WM8jtGj7ShQqeyqPifsUdqS6t1+7Bp63KOhQOwYI6vW25XQ57k4QBwHyyhSFXlY8oFpx/cYSLKwZLZKOHPHmUTfdDCNrS9+HgzLNqD3/xgGb+a9/lyGtAHS99muM5+BAjRy7xrRc0hvIm19j5Yd6WcI3wIMlDkd+TqgeoRjH0KVrjyA6aRBLV9feOTgRI3b3h6/CCNKZ/fl2OgB0Z9XGvauJpTj58I4ru7MGPifG6aRyUsUlgoJLaP9BfA2dJbPPvAVsCWSunR4tS2BTEcR9f62QGicgO+dSD2+5nXKZSF4WClS6Egd0qSk2MJl+xpVgOlIQ14PmVgSR4iuvv1chnGOMZvOiVfIfmvtKzMuFhL8kARov+05t0Yu81al0aZYbKN5Z+Et4frzWBpSnNOkkcdq7/Rn03Mk18T8wg6bZSflzMIlTe/rJXE9S2tzbXfEnt9Tce3dimfACXDg/wg1B3CMDS3NTgq3kCvvhKBXpnX2Bk5Iu1UlxxEKS6eq6M045/ExNM/cH x-forefront-antispam-report: CIP:255.255.255.255; CTRY:; LANG:en; SCL:1; SRV:; IPV:NLI; SFV:NSPM; H:KL1PR0601MB4530.apcprd06.prod.outlook.com; PTR:; CAT:NONE; SFS:(13230016)(396003)(366004)(39840400004)(136003)(346002)(376002)(186003)(64756008)(66446008)(66476007)(71200400001)(76116006)(4326008)(66946007)(83380400001)(54906003)(66556008)(6916009)(9686003)(224303003)(53546011)(7696005)(6506007)(41300700001)(2906002)(26005)(33656002)(38070700005)(86362001)(38100700002)(122000001)(5660300002)(44832011)(316002)(55016003)(52536014)(478600001)(8936002); DIR:OUT; SFP:1101; x-ms-exchange-antispam-messagedata-chunkcount: 1 x-ms-exchange-antispam-messagedata-0: =?utf-8?q?YAbqzZVCS/e8VJUVj6k8UOBZktZN?= =?utf-8?q?c5WFDg4M2287Uo6PQwnjGEJvzBmqXSA3DyEx+Hsq3Yf+A7+VXmuoXESxo4ugh0IUq?= =?utf-8?q?U03zKYod/zMqCU0bu/sseotLwBPPEfkBfEGwzdooHEXguim0WvTqR8Zfhu8gB114u?= =?utf-8?q?XtOf6EU2cMn0B37XAzR+zGbX0b0wM8sn7AlOXMk2eTv8RUgmdrLOmZbkCCsintsX2?= =?utf-8?q?JxqgrlushWNMD9cB6qUEmbHOo87X2G/qfHmyLp6nOwzRkBKGbwTflpimCW5kalrFA?= =?utf-8?q?+QPx/EZC45S62F3soEUHYl6ACDfWRml0e8nUZTyl3hNQJWhXaI2wZGI/B8U+QqAA0?= =?utf-8?q?BQFAbVTevevhCVeaJfntcw61WgVOBnYI7ygFxF/fyWwvqYifJxPZxFsU/wFn1XRLC?= =?utf-8?q?d0cAIFC3yH/UhnkI/sMYEUlRwiT5AdmNhwC2QXhdeKASWhBwadcN0YoFqM6i3X2f1?= =?utf-8?q?aiox0rEg5U5t3FiDsj7P0u7JTQDlBsBKfIP/n/rQAyUwgGcueaKYDGBOw1fHt3h3y?= =?utf-8?q?kvRUYf6BX0F3J8+w2kTsjYsWr+zdbtJR2Joy6VpsWxCD0BNBh/HArm8oE+OkPdYIz?= =?utf-8?q?/8uQMIElYNdxncD4+t/V2T8X1qZpuzOh1E5/VhkwVTVPf0Rff66+OxeXXzC7kt5N4?= =?utf-8?q?v2dgzYp61Asa7Ww5LNmqh6G9krmmLHf+CKsfuadL0AfSqBKxsuX8bHQJnyPb4g/+2?= =?utf-8?q?WBWdQj7sVLgDu2wEOWW98w3e3nI4OnFSdIxt6o/yeBIMl1qtX7AfiQKkjCFcBDHa8?= =?utf-8?q?R0VCuErus82JW6rnk+tkUsEjt/ZTMF2h1KtHFUPFKPaNckqMRLFIB7v8La7MGwRpY?= =?utf-8?q?vKi26OAHCyBkMhE70naA3tXCquKv+ybz/jl55aJJM9Cx/SxGPYtOxes2lCOtn6LMy?= =?utf-8?q?W2KCsSUzHIA3sSPEHoDggYX2Xt3/Zjp2uywt3CxOBVkL5CaA8PNebZ1eDkiuiIkel?= =?utf-8?q?CQnWq52ymVINE8Q7KSQh0xsdXlqML0Xt1jRrYatLcAIH+AcifuDpNSHfAgpurOfec?= =?utf-8?q?18JHjXrzTVomZ3iHo0citeP3fLeryAE8Wkm0XH0GjIrYvgAoLFKlOXV8n0p6WqJRK?= =?utf-8?q?xx/RqaO0UiTC6ueDZ6YdCscGaBfIAaDDFODShUn8nh1zdOyz/zk1AV/tA3wkcYPIs?= =?utf-8?q?3QLhnkp0Mx7zC8nnWsQRsyp65KEij0ncAbd3Ef7azrgdDyzWLki0/DcsWl6H+ZjbU?= =?utf-8?q?jbeTM0KvcvQae7xaW7J9Z6K00RZ+0m/RW7o7jy9HW2VQ9ryDRvFuyhypMQ1NqJmTR?= =?utf-8?q?Rd2KalCYZKcZLiHzKyH3JAXWcxYm2h0EFUih7DTBHDMZnkk7Xk4MD2NwP1SJ9UFGM?= =?utf-8?q?wiiwQd1qgkwGccbpoZyaEZmlNxE0gRRT4iW9lTANZOJGX6+KKIuO+/knjzBcW9Ps8?= =?utf-8?q?CRNNiGRPvfOETJveEQ84a0B8aKwr8spOW1ZTzIcHCQDNO+511cVuWjj7QRkJdArV8?= =?utf-8?q?hJXurh+9U0kGBVy9UmVkJEtmJCTtRgphhFFH7i3yQBnx2ZDzGh19dg8P0kbp0Co+o?= =?utf-8?q?Xf5grW3eiTBd?= MIME-Version: 1.0 X-OriginatorOrg: jaguarmicro.com X-MS-Exchange-CrossTenant-AuthAs: Internal X-MS-Exchange-CrossTenant-AuthSource: KL1PR0601MB4530.apcprd06.prod.outlook.com X-MS-Exchange-CrossTenant-Network-Message-Id: b1fd9c07-ca7d-447f-276b-08da6ed419d1 X-MS-Exchange-CrossTenant-originalarrivaltime: 26 Jul 2022 06:57:27.1449 (UTC) X-MS-Exchange-CrossTenant-fromentityheader: Hosted X-MS-Exchange-CrossTenant-id: 1e45a5c2-d3e1-46b3-a0e6-c5ebf6d8ba7b X-MS-Exchange-CrossTenant-mailboxtype: HOSTED X-MS-Exchange-CrossTenant-userprincipalname: T4GzVXN9poAgAlF5IRUvTES7UYrsjcKfhEHlx5jRvWR/BgvTRORFOdfoLC6zaDry8whxDvSoSOd4KU50Z5+huQ== X-MS-Exchange-Transport-CrossTenantHeadersStamped: SG2PR06MB4868 X-BeenThere: dev@dpdk.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: DPDK patches and discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: dev-bounces@dpdk.org May be in rte_gro_reassemble_burst, where no delay is introduced, PUSH packets can be merged 发件人: kumaraparameshwaran rathinavel 发送时间: 2022年7月26日 14:41 收件人: Jun Qiu 抄送: dev@dpdk.org; jiayu.hu@intel.com; stable@dpdk.org 主题: Re: [PATCH] gro: fix gro with tcp push flag On Tue, Jul 26, 2022 at 11:48 AM Jun Qiu > wrote: TCP data packets sometimes carry a PUSH flag. Currently, only the packets that do not have PUSH flag can be GROed. The packets that have a PUSH flag cannot be GROed, the packets that cannot be processed by GRO are placed last. In this case, the received packets may be out of order. For example, there are two packets mbuf1 and mbuf2. mbuf1 contains PUSH flag, mbuf2 does not contain PUSH flag. After GRO processing, mbuf2 is sent for processing before mbuf1. This out-of-order will affect TCP processing performance and lead to unnecessary dup-ACK. Referring to the Linux kernel implementation, packets with PUSH flag can also perform GRO. And if one of the packets containing PUSH flag, the packets after GRO will carry PUSH flag. In case of smaller transfers in which the TCP segment size is not more than one MTU, it is a single TCP packet with PSH flag set, so in those cases we are introducing unwanted delay. I think the better approach would be if there are previous packets in the flow and the current packet received has PSH flag then coalesce with the previous packet, if lookup is failure and the current packet has PSH flag set then deliver it immediately. Fixes: 0d2cbe59b719 ("lib/gro: support TCP/IPv4") Cc: stable@dpdk.org Signed-off-by: Jun Qiu > Signed-off-by: Jun Qiu > --- lib/gro/gro_tcp4.c | 4 ++-- lib/gro/gro_tcp4.h | 16 +++++++++++++--- lib/gro/gro_vxlan_tcp4.c | 4 ++-- 3 files changed, 17 insertions(+), 7 deletions(-) -- 2.25.1 diff --git a/lib/gro/gro_tcp4.c b/lib/gro/gro_tcp4.c index 7498c66141..7849a2bd1d 100644 --- a/lib/gro/gro_tcp4.c +++ b/lib/gro/gro_tcp4.c @@ -220,10 +220,10 @@ gro_tcp4_reassemble(struct rte_mbuf *pkt, hdr_len = pkt->l2_len + pkt->l3_len + pkt->l4_len; /* - * Don't process the packet which has FIN, SYN, RST, PSH, URG, ECE + * Don't process the packet which has FIN, SYN, RST, URG, ECE * or CWR set. */ - if (tcp_hdr->tcp_flags != RTE_TCP_ACK_FLAG) + if (tcp_hdr->tcp_flags & (~(RTE_TCP_ACK_FLAG | RTE_TCP_PSH_FLAG))) return -1; /* * Don't process the packet whose payload length is less than or diff --git a/lib/gro/gro_tcp4.h b/lib/gro/gro_tcp4.h index 212f97a042..2974faf228 100644 --- a/lib/gro/gro_tcp4.h +++ b/lib/gro/gro_tcp4.h @@ -210,7 +210,8 @@ merge_two_tcp4_packets(struct gro_tcp4_item *item, uint16_t l2_offset) { struct rte_mbuf *pkt_head, *pkt_tail, *lastseg; - uint16_t hdr_len, l2_len; + struct rte_tcp_hdr *head_tcp_hdr, *tail_tcp_hdr; + uint16_t hdr_len, l2_len, l3_offset; if (cmp > 0) { pkt_head = item->firstseg; @@ -221,13 +222,22 @@ merge_two_tcp4_packets(struct gro_tcp4_item *item, } /* check if the IPv4 packet length is greater than the max value */ - hdr_len = l2_offset + pkt_head->l2_len + pkt_head->l3_len + - pkt_head->l4_len; + l3_offset = l2_offset + pkt_head->l2_len + pkt_head->l3_len; + hdr_len = l3_offset + pkt_head->l4_len; l2_len = l2_offset > 0 ? pkt_head->outer_l2_len : pkt_head->l2_len; if (unlikely(pkt_head->pkt_len - l2_len + pkt_tail->pkt_len - hdr_len > MAX_IPV4_PKT_LENGTH)) return 0; + /* merge push flag to pkt_head */ + tail_tcp_hdr = rte_pktmbuf_mtod_offset(pkt_tail, + struct rte_tcp_hdr *, l3_offset); + if (tail_tcp_hdr->tcp_flags & RTE_TCP_PSH_FLAG) { + head_tcp_hdr = rte_pktmbuf_mtod_offset(pkt_head, + struct rte_tcp_hdr *, l3_offset); + head_tcp_hdr->tcp_flags |= RTE_TCP_PSH_FLAG; + } + /* remove the packet header for the tail packet */ rte_pktmbuf_adj(pkt_tail, hdr_len); diff --git a/lib/gro/gro_vxlan_tcp4.c b/lib/gro/gro_vxlan_tcp4.c index 3be4deb7c7..884802af0b 100644 --- a/lib/gro/gro_vxlan_tcp4.c +++ b/lib/gro/gro_vxlan_tcp4.c @@ -326,10 +326,10 @@ gro_vxlan_tcp4_reassemble(struct rte_mbuf *pkt, tcp_hdr = (struct rte_tcp_hdr *)((char *)ipv4_hdr + pkt->l3_len); /* - * Don't process the packet which has FIN, SYN, RST, PSH, URG, + * Don't process the packet which has FIN, SYN, RST, URG, * ECE or CWR set. */ - if (tcp_hdr->tcp_flags != RTE_TCP_ACK_FLAG) + if (tcp_hdr->tcp_flags & (~(RTE_TCP_ACK_FLAG | RTE_TCP_PSH_FLAG))) return -1; hdr_len = pkt->outer_l2_len + pkt->outer_l3_len + pkt->l2_len +