From patchwork Fri Aug 2 17:29:25 2024 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Jeremy Spewock X-Patchwork-Id: 1192 Return-Path: X-Original-To: patchwork@inbox.dpdk.org Delivered-To: patchwork@inbox.dpdk.org Received: from mails.dpdk.org (mails.dpdk.org [217.70.189.124]) by inbox.dpdk.org (Postfix) with ESMTP id 0FF384571D; Fri, 2 Aug 2024 19:29:47 +0200 (CEST) Received: from mails.dpdk.org (localhost [127.0.0.1]) by mails.dpdk.org (Postfix) with ESMTP id F213E40E22; Fri, 2 Aug 2024 19:29:46 +0200 (CEST) Received: from mail-pl1-f228.google.com (mail-pl1-f228.google.com [209.85.214.228]) by mails.dpdk.org (Postfix) with ESMTP id 6014B40E0A for ; Fri, 2 Aug 2024 19:29:45 +0200 (CEST) Received: by mail-pl1-f228.google.com with SMTP id d9443c01a7336-1fc4fccdd78so65142485ad.2 for ; Fri, 02 Aug 2024 10:29:45 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=iol.unh.edu; s=unh-iol; t=1722619784; x=1723224584; darn=dpdk.org; h=content-transfer-encoding:mime-version:message-id:date:subject:cc :to:from:from:to:cc:subject:date:message-id:reply-to; bh=75MZ4XnkYE+FvkTQKvBbK+q5XrMVi2M1Jw5zo+azmP8=; b=aEumqijHEn3kaSB2s6DN+DveaZ2L4ppH47IZkAuxzRPhwNrg4bv+AeHhIrt2fYs+rP wXetTWEGKL7NXwSYP1f5hXyaphRp3iwhST6W9sQPg2J2WgIBgyCRGmoIBPcGZxd7KJTy Xsupg60VlBNCAkdSYUrnmUCQ4livdy2v/87M8= X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1722619784; x=1723224584; h=content-transfer-encoding:mime-version:message-id:date:subject:cc :to:from:x-gm-message-state:from:to:cc:subject:date:message-id :reply-to; bh=75MZ4XnkYE+FvkTQKvBbK+q5XrMVi2M1Jw5zo+azmP8=; b=wPbJHRKEkcKe1YuRPabZJIrIV5gyR+08CswPiTIka0ZSWEvnLwGYZdOgjuhktNALWp 2T4+K59owfi4bCCe01yq0cpRepBL/MLcwWW9yDlNJDaSgC52Hj/D9wQe4/8gx1+gVMw+ Wzd9uEP7HnMfrwZVPW3q2AzcwUpYa/rX3bJwG/oaIeNQ443rZ3f8cjjamUFVdsa0oZfX X9nWTEpE07Ot346sUT2udAw4vE7LaJXDE2vgZcrgKdNCLIriZGBQPsGjNXPXMgDPQ+pH 3uVgAJQHaNMAj6wdNevqM45ORjSk86Zokz6LmcuAQs6jo9bA+bH+zt4TRPHEfweb6bpP mGEA== X-Gm-Message-State: AOJu0YxaMLR9BhOnyIAV7i/JHlRtrWEC5lkXfzUUILQdpIahjuGYXA6F gWfIby5eF3B5k30j848jXrlf5849itWWUjZbTihDjPUmoGIqhfWmche+jrXv32HKvIziL0TFJqZ 7NYU0QR6r9sPOHKAdD/i1zbKp2WAbUAjD8waQqJZ3la9a3orY X-Google-Smtp-Source: AGHT+IFfN3jawxOc5fTaD2nKPoSX7paKcpUqOSR1cAzmi2nhVA7myERLSU03BeD4/8lVk2iNmdNcZrF+xUAb X-Received: by 2002:a17:902:cf01:b0:1fc:4bdc:d413 with SMTP id d9443c01a7336-1ff574e2258mr50577635ad.60.1722619784473; Fri, 02 Aug 2024 10:29:44 -0700 (PDT) Received: from postal.iol.unh.edu (postal.iol.unh.edu. [2606:4100:3880:1234::84]) by smtp-relay.gmail.com with ESMTPS id d9443c01a7336-1ff58f7860esm806345ad.71.2024.08.02.10.29.44 (version=TLS1_2 cipher=ECDHE-ECDSA-AES128-GCM-SHA256 bits=128/128); Fri, 02 Aug 2024 10:29:44 -0700 (PDT) X-Relaying-Domain: iol.unh.edu Received: from iol.unh.edu (unknown [IPv6:2606:4100:3880:1257::1083]) by postal.iol.unh.edu (Postfix) with ESMTP id 6B6E1605C351; Fri, 2 Aug 2024 13:29:43 -0400 (EDT) From: jspewock@iol.unh.edu To: thomas@monjalon.net, wathsala.vithanage@arm.com, Luca.Vizzarro@arm.com, npratte@iol.unh.edu, yoan.picchi@foss.arm.com, probb@iol.unh.edu, Honnappa.Nagarahalli@arm.com, paul.szczepanek@arm.com, alex.chapman@arm.com, juraj.linkes@pantheon.tech Cc: dev@dpdk.org, Jeremy Spewock Subject: [RFC PATCH v1 0/3] dts: port over stats checks Date: Fri, 2 Aug 2024 13:29:25 -0400 Message-ID: <20240802172928.212277-1-jspewock@iol.unh.edu> X-Mailer: git-send-email 2.45.2 MIME-Version: 1.0 X-BeenThere: dev@dpdk.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: DPDK patches and discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: dev-bounces@dpdk.org From: Jeremy Spewock This series ports over the functionality of the stats_checks test suite from old DTS, but I left it as an RFC just because the verification is different than other test suites that we have written. Mainly because verifying the accuracy of the port statistics while accounting for noise on the wire is not the most straight-forward task. The way I decided to differentiate noise from valid packets in this suite was I used the MAC addresses of the packets and the software packet types that are provided in the verbose output of testpmd. Another idea for how to do this that I tried was using packet checksums. I wanted originally to send packets with bad checksums and assume that noise on the wire would either have a valid checksum or no checksum at all, but this unfortunately only works for the RX side of verbose output as the TX side does not reflect the same checksum information. Jeremy Spewock (3): dts: add clearing port stats and verbose mode to testpmd dts: add port stats checks test suite dts: add stats checks to schemai dts/framework/config/conf_yaml_schema.json | 3 +- dts/framework/remote_session/testpmd_shell.py | 62 +++++++ dts/tests/TestSuite_port_stats_checks.py | 156 ++++++++++++++++++ 3 files changed, 220 insertions(+), 1 deletion(-) create mode 100644 dts/tests/TestSuite_port_stats_checks.py