From patchwork Wed Sep 6 15:03:57 2017 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Matan Azrad X-Patchwork-Id: 28422 X-Patchwork-Delegate: ferruh.yigit@amd.com Return-Path: X-Original-To: patchwork@dpdk.org Delivered-To: patchwork@dpdk.org Received: from [92.243.14.124] (localhost [IPv6:::1]) by dpdk.org (Postfix) with ESMTP id C6DD0330D; Wed, 6 Sep 2017 17:04:14 +0200 (CEST) Received: from EUR01-VE1-obe.outbound.protection.outlook.com (mail-ve1eur01on0080.outbound.protection.outlook.com [104.47.1.80]) by dpdk.org (Postfix) with ESMTP id 5E823326B for ; Wed, 6 Sep 2017 17:04:12 +0200 (CEST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=Mellanox.com; s=selector1; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version; bh=P7qwb8Rq+mVDFar8RCF0iuranyHx7tr5x53hALjmmu0=; b=hl7AKkWANt6nQwOgo7dONRUl32r+c0O7vxbQQiUhWADpxuEImjvpX7dY7Ihyc1bI6wEWp8Yh3Rqe3ErctdPU5ePf34YoVV6DZ++HS+1u18Kg/VzQ4BzUEQRTnKOjsF7snxy8LGJE62Tyuc2ABCzSlPxmpFuCU8D7M8vyj+z7a7s= Authentication-Results: spf=none (sender IP is ) smtp.mailfrom=matan@mellanox.com; Received: from mellanox.com (37.142.13.130) by DB6PR0502MB3048.eurprd05.prod.outlook.com (2603:10a6:4:9f::8) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384_P256) id 15.20.13.10; Wed, 6 Sep 2017 15:04:10 +0000 From: Matan Azrad To: Nelio Laranjeiro , Adrien Mazarguil Cc: dev@dpdk.org Date: Wed, 6 Sep 2017 18:03:57 +0300 Message-Id: <1504710238-25726-1-git-send-email-matan@mellanox.com> X-Mailer: git-send-email 2.7.4 MIME-Version: 1.0 X-Originating-IP: [37.142.13.130] X-ClientProxiedBy: DB6PR0201CA0017.eurprd02.prod.outlook.com (2603:10a6:4:3f::27) To DB6PR0502MB3048.eurprd05.prod.outlook.com (2603:10a6:4:9f::8) X-MS-PublicTrafficType: Email X-MS-Office365-Filtering-Correlation-Id: 4f00d5dc-c8ed-4598-15e1-08d4f53887d7 X-MS-Office365-Filtering-HT: Tenant X-Microsoft-Antispam: UriScan:; BCL:0; PCL:0; RULEID:(300000500095)(300135000095)(300000501095)(300135300095)(22001)(300000502095)(300135100095)(2017030254152)(48565401081)(300000503095)(300135400095)(201703131423075)(201703031133081)(201702281549075)(300000504095)(300135200095)(300000505095)(300135600095)(300000506095)(300135500095); SRVR:DB6PR0502MB3048; X-Microsoft-Exchange-Diagnostics: 1; DB6PR0502MB3048; 3:7a+0i1Dzuo2xf9qsVhFdjDgms1onLyIwKEokyGHmUOrxXnj2nB6vn1wPWpvGKADT6UvEnuZeWZZOji3B5BXUZlmWLU0Lv73fdfPntMzM0qH+ULDbYkPHi/tDVWSvLNWV/mwzFBcRxgowoGTAyGF/t20y5N5ffLZYRkMIioyBuE7r2nex9s2vnredllcR/L7zbra7VVo1Scp77hlAlTm1rEIgKmLHw7Vu2xnretHy2s+bj363Odwv8mTfjO8T+kC0; 25:X2TzI6CGyXX6axBe/nV1SAg1Gl5rlVZRjZVHFzgyUVimw8pAz6szUh1Z+w5ZaEBS6vKNqimXqLW4OnU3LB+lj+lCpVWPV4jZCDtFzSOawz+FN4WVrOdEyN9XPoYCsYNlDKe2HQplILS6MzJalzIVl7pgi3dtCxM4KPJ6/0ntLUx3rmlDXmxR72IPDHtvTL1ZqOw36FKko3oLMkOpKQGg5BpzywaWF9y/fAOf80OQhFiYuGXtPZ5gjG5Mn8upVgRkFgKBe+sxou5eQ5Pmf7R6gOxOkuMFDoD46NV5VLxIUFQDiCk45YmiH4w52eHCOsi45AYisfAAi3lfIDr7e2Mk2g==; 31:TLJVWhjwzloFjJxGx8OyU3lezyn17zTqo0CXEnkg0IUAA28uScSb39Ng7kIypiKLgRVdXwh4wwXehNNammi3QId+Atbi81/mb8g7jInCRFBci81Kv2uBE10yMD57qWbYugIXiyzsa+zoWyk3crie6WR0D6IKFiUyVmMaJrd6LzkSDGrnLCYiuSjmg09Ob73sEphiyEMOEQtGJidZF7w5Sa1mv10Hx+vgNjDrD7B3z10= X-MS-TrafficTypeDiagnostic: DB6PR0502MB3048: X-LD-Processed: a652971c-7d2e-4d9b-a6a4-d149256f461b,ExtAddr X-Microsoft-Exchange-Diagnostics: 1; DB6PR0502MB3048; 20:qYrvBknnY/Hoc6AEQSuYxJoZDTgmky9EjfLgChcunq2ad5x0MJCppvdnjsV9NaL5l9TbMmOnnflx1stcZ1iF3CE+EaVvfvNZcsGxiQKZVLHMa8LdA0p82SIVhScAXjQOtVT31I0PQ6hYgQJFw0tLy3g70bXSpWldoIT8eeUfbaJVCk5FpDq6tuOZJRqoGdqnQPfdcd1SryjPHhwNDPE0hexLfLbMl1MCBo3ujIu8QRGq/uf+KgcKYpbtxkueyb+DP5F+QM9lvMdE+L7L9IRgOmfRvZOSB8GveOEiAkdcORKDFR9siGZbpVc6cuosm0HfOQ1/U4RamWj4DO/FOlKu37P01Om5YZv5H+KzEgKU2MpTkXeqd5NJEFUihRARDzf5QGplSLlQ+rtgWQDB6n/YKqVhT/OkgMO/HPxQ7sApg2+q6VSke4Y8/pO2Hqx7cfQd7Nhvm5N3aZ5C/DOSiontj/WUL2InVQXSiMBnNdtLgd94H685e2ZBSIX4M1+W06eI; 4:8Vq/R3laENw7GJYuYsagHR8aiAA2F0d9EZwf8Lcs6bQLn5cJm4mFaM0W1XAkRCBvNDueqRvpb+PykdPr7hLXPCbakMegsRAPIK5lbBytBHCU8iqU6E6V4macqCOUvcMG6ReJzw5Q926EqgSKzFJJ+2sY59oGagCrZalX1D1TJnK8joGMGLoRw0yqG+zvmw15s+VAZvEnaNtxfDWHjqk7qiNnD+fBakesOeiaeAsbQep3/hNQL5VjHxMcPHkHxPHBTulZ91XbVcNfH2VxncJkwGsQgIJnPa3fQEEqVpvEWl8= X-Exchange-Antispam-Report-Test: UriScan:(788757137089); X-Microsoft-Antispam-PRVS: X-Exchange-Antispam-Report-CFA-Test: BCL:0; PCL:0; RULEID:(100000700101)(100105000095)(100000701101)(100105300095)(100000702101)(100105100095)(6040450)(2401047)(8121501046)(5005006)(93006095)(93001095)(100000703101)(100105400095)(3002001)(10201501046)(6055026)(6041248)(20161123562025)(20161123558100)(20161123555025)(20161123564025)(20161123560025)(201703131423075)(201702281528075)(201703061421075)(201703061406153)(6072148)(201708071742011)(100000704101)(100105200095)(100000705101)(100105500095); SRVR:DB6PR0502MB3048; BCL:0; PCL:0; RULEID:(100000800101)(100110000095)(100000801101)(100110300095)(100000802101)(100110100095)(100000803101)(100110400095)(100000804101)(100110200095)(100000805101)(100110500095); SRVR:DB6PR0502MB3048; X-Forefront-PRVS: 0422860ED4 X-Forefront-Antispam-Report: SFV:NSPM; SFS:(10009020)(4630300001)(7370300001)(6009001)(39860400002)(199003)(189002)(55016002)(47776003)(53936002)(15650500001)(478600001)(81166006)(81156014)(8676002)(105586002)(5003940100001)(25786009)(4326008)(86362001)(68736007)(21086003)(33646002)(50226002)(33026002)(6116002)(97736004)(189998001)(5660300001)(3846002)(50986999)(7736002)(6666003)(48376002)(305945005)(106356001)(50466002)(36756003)(69596002)(2906002)(42186005)(66066001)(7350300001)(101416001); DIR:OUT; SFP:1101; SCL:1; SRVR:DB6PR0502MB3048; H:mellanox.com; FPR:; SPF:None; PTR:InfoNoRecords; A:1; MX:1; LANG:en; Received-SPF: None (protection.outlook.com: mellanox.com does not designate permitted sender hosts) X-Microsoft-Exchange-Diagnostics: =?us-ascii?Q?1; DB6PR0502MB3048; 23:+2sxvLNY6xV+g5gVzALQCvu6T/Cc3D0QB3JTS/C?= cuRjw9uufxRdWmMcxYOSlZ6WYrRaFPbG3oTdAeNMtAxOsrX/JAdd5XaCbpH7RUtSprFnoJKIiT7x35OreKcDlxiVpwbZRDSr5IdoD3/iJx6xdLoW+k07PFve6ueSuE1jnKWKazsBIkLq7V8bCblyR+dUaz2nKumj95QZt0JLaQCyskOfAwrcHUm1mVs5CdK3hGW9T6HV/pG3klBeTd80V6yFn16OXYRfddGGqa785IoNdXJdSRMS9BwbWqQW1NkAd63jq8HUmf7IIQ0Sr+ZntJdA85jjpYkXOKMKQb5eEfZ4SZsp7efWBjrspxzUkKxMKx+E2EBZzL5RkxQRJ0P3CFQs8p8ZL04FPsgaRk3PUqLzrc45B2etx31wG9TzEHYGHhaDxCYdIKAjymfTGX/BTv9jLDaiYip0NXtKjMRNTzLXZ1FHdy5YLGdIfobw0oYZVrQvQoN7qRBJ3pVSYGodOfTienH9MufcxEEtWtFlPlL4nC7GL8kOkSvuYYKA7VnKKNFI/iNvos+QPsh28+8Yw7s0HJap125Pu4QBgveQnCOV9h7kBIgwNb/51R6aCJ16C5oq+0DSusEE3dRrvWqRP18Z2mBRInVlKkSeq+cBRpmNZQP8P5hud8HDuLxBqwONIG+5do+ShCQri1rYs166ymch8bu03yhYLqbU+FbjjKc37UqRNzsC/33Dw+pXPgO92k4nkfhaPYEJhqjMC/AaRwfcYcTrlabx19YCebavhLKbcJE6pP7BQMz4/3Ik9Ud3kLxHeIKxzLtjPivdZjviq/JU12bQ08Top0ekfMt3q0OtmqoigZUyL+Zx+EAnsZ8T0FXwru7yPemcxMkNw/TDfo9grSZHfEuHg1LfZQ2zoIB0Xs/g/g2HqfQKS4teeuU1UIBFWXQwkFRBxIJB9g0pAG4JHA77pKT7aHOUYxa0Ys0M3Y0Ppwc2a9TGa12e5zoTab/4vzlf2JuU9Zg1nM/2FdWInoM9dfEE5g462KuyRIGqOu3XkLZYu0Rc74oZo7rFfMbs+MCE5g2dAQ1UtrNq7YFrS X-Microsoft-Exchange-Diagnostics: 1; DB6PR0502MB3048; 6:gWvrawjwL6dyesXjEozJMzfELy9NxTIYV0JEUMkyP3ftlsPl06die+iEWnT6JUfiJhcpGUB+PFiQDV1TKYATrSnHOLZqWOJybs1DMAtAr17z41EOb9nGg+3HLQRFnLkrDkR1TViVxnoEUpQFnorzsFtDPnO2kPlnewvp/EHie3JQlvheoREdNMRwIj1TrsQ5WHN4y9D5rKj7XZZisi/ySoZXCgfqGVWa2lvhSw9nEB2LX6NGigS75JPT6aYsjiim/ycLzsuaMfr8OhBOD96KqjEDIASmh5hFQ3c6AfEGYKL2mgVB5Umyt2IEgu2LA+b99q53NEqoX7020lcPeFf9dg==; 5:AKx+X45Xkuu6xW+YVaNUw/7hag9ePL9ES/Z5gyXZUl5wrYIsxb6CKMJdaTh+FKwNxK6V7UADITPQU8FU/RNT06iclFBtbdrWrnMT/jE9WXdmLja8f+LeDcwBETcj3tRoCNfrLRX4Hgg0fFODFuySxg==; 24:I2Bo3sNU1Yx6qUNuRRtCZjNOamiOuc6xFJtbc1eyltypZR2lGiKXM7FJJPs4ibaWyBAck3bJwIB60xe7q5gIxPO+ER2xc8EerJeCAaXnD5Q=; 7:a/Gg9Mz2FpKamfNyYYSj7Wtub8K9wqZ+FKYRIi6sV+Xm6Nen6ceCSt+WI21Vv9pmqNsv9s7RR0mIkT/bCXcka4w7VnsjxNSd2DpTJKdIq36WqNnEd61+l+wmhwK3jKaXnJvQYkk91u/lrA5Li+wvkgaHNfByXROj8q2UrkFLLI9oTt8Vh78IXrLwQE24ZxyaqDanfz0xdKP/rPRP1/77rMIhFS0Vd9t22voAvbb2TQc= SpamDiagnosticOutput: 1:99 SpamDiagnosticMetadata: NSPM X-OriginatorOrg: Mellanox.com X-MS-Exchange-CrossTenant-OriginalArrivalTime: 06 Sep 2017 15:04:10.6294 (UTC) X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted X-MS-Exchange-Transport-CrossTenantHeadersStamped: DB6PR0502MB3048 Subject: [dpdk-dev] [PATCH v4 1/2] net/mlx5: link status update separation X-BeenThere: dev@dpdk.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: DPDK patches and discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: dev-bounces@dpdk.org Sender: "dev" Link status is sometimes inconsistent during a LSC event. When it occurs, the PMD refrains from immediately notifying the application; instead, an alarm is scheduled to check link status later and notify the application once it has settled. In the previous code the alarm callback calls to the interrupt handler for link status recheck and may cause to unnecessary interrupt events check. This patch separates the link status update and the interrupt event handler to avoid the unnecessary check and arranges the interrupt handler for more interrupt supports in the future. Comment was added in the new function to explain the inconsistent link status reason. Signed-off-by: Matan Azrad Acked-by: Adrien Mazarguil --- drivers/net/mlx5/mlx5_ethdev.c | 83 ++++++++++++++++++++++++++++-------------- 1 file changed, 55 insertions(+), 28 deletions(-) Changes: V2: Replace link status update function name. Add inconsistent link workaround comment. V3: Fix indentations. Accurate inconsistent link comment. V4: Separate the patch. Short the comment. diff --git a/drivers/net/mlx5/mlx5_ethdev.c b/drivers/net/mlx5/mlx5_ethdev.c index 57f6237..64a8db8 100644 --- a/drivers/net/mlx5/mlx5_ethdev.c +++ b/drivers/net/mlx5/mlx5_ethdev.c @@ -1112,47 +1112,74 @@ mlx5_ibv_device_to_pci_addr(const struct ibv_device *device, } /** - * Link status handler. + * Update the link status. * * @param priv * Pointer to private structure. - * @param dev - * Pointer to the rte_eth_dev structure. * * @return - * Nonzero if the callback process can be called immediately. + * Zero if the callback process can be called immediately. */ static int -priv_dev_link_status_handler(struct priv *priv, struct rte_eth_dev *dev) +priv_link_status_update(struct priv *priv) +{ + struct rte_eth_link *link = &priv->dev->data->dev_link; + + mlx5_link_update(priv->dev, 0); + if (((link->link_speed == 0) && link->link_status) || + ((link->link_speed != 0) && !link->link_status)) { + /* + * Inconsistent status. Event likely occurred before the + * kernel netdevice exposes the new status. + */ + if (!priv->pending_alarm) { + priv->pending_alarm = 1; + rte_eal_alarm_set(MLX5_ALARM_TIMEOUT_US, + mlx5_dev_link_status_handler, + priv->dev); + } + return 1; + } else if (unlikely(priv->pending_alarm)) { + /* Link interrupt occurred while alarm is already scheduled. */ + priv->pending_alarm = 0; + rte_eal_alarm_cancel(mlx5_dev_link_status_handler, priv->dev); + } + return 0; +} + +/** + * Device status handler. + * + * @param priv + * Pointer to private structure. + * @param events + * Pointer to event flags holder. + * + * @return + * Events bitmap of callback process which can be called immediately. + */ +static uint32_t +priv_dev_status_handler(struct priv *priv) { struct ibv_async_event event; - struct rte_eth_link *link = &dev->data->dev_link; - int ret = 0; + uint32_t ret = 0; /* Read all message and acknowledge them. */ for (;;) { if (ibv_get_async_event(priv->ctx, &event)) break; - - if (event.event_type != IBV_EVENT_PORT_ACTIVE && - event.event_type != IBV_EVENT_PORT_ERR) + if ((event.event_type == IBV_EVENT_PORT_ACTIVE || + event.event_type == IBV_EVENT_PORT_ERR) && + (priv->dev->data->dev_conf.intr_conf.lsc == 1)) + ret |= (1 << RTE_ETH_EVENT_INTR_LSC); + else DEBUG("event type %d on port %d not handled", event.event_type, event.element.port_num); ibv_ack_async_event(&event); } - mlx5_link_update(dev, 0); - if (((link->link_speed == 0) && link->link_status) || - ((link->link_speed != 0) && !link->link_status)) { - if (!priv->pending_alarm) { - /* Inconsistent status, check again later. */ - priv->pending_alarm = 1; - rte_eal_alarm_set(MLX5_ALARM_TIMEOUT_US, - mlx5_dev_link_status_handler, - dev); - } - } else { - ret = 1; - } + if (ret & (1 << RTE_ETH_EVENT_INTR_LSC)) + if (priv_link_status_update(priv)) + ret &= ~(1 << RTE_ETH_EVENT_INTR_LSC); return ret; } @@ -1172,9 +1199,9 @@ mlx5_dev_link_status_handler(void *arg) priv_lock(priv); assert(priv->pending_alarm == 1); priv->pending_alarm = 0; - ret = priv_dev_link_status_handler(priv, dev); + ret = priv_link_status_update(priv); priv_unlock(priv); - if (ret) + if (!ret) _rte_eth_dev_callback_process(dev, RTE_ETH_EVENT_INTR_LSC, NULL, NULL); } @@ -1192,12 +1219,12 @@ mlx5_dev_interrupt_handler(void *cb_arg) { struct rte_eth_dev *dev = cb_arg; struct priv *priv = dev->data->dev_private; - int ret; + uint32_t events; priv_lock(priv); - ret = priv_dev_link_status_handler(priv, dev); + events = priv_dev_status_handler(priv); priv_unlock(priv); - if (ret) + if (events & (1 << RTE_ETH_EVENT_INTR_LSC)) _rte_eth_dev_callback_process(dev, RTE_ETH_EVENT_INTR_LSC, NULL, NULL); }