From patchwork Wed Oct 27 14:04:57 2021 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: David Marchand X-Patchwork-Id: 103051 X-Patchwork-Delegate: david.marchand@redhat.com Return-Path: X-Original-To: patchwork@inbox.dpdk.org Delivered-To: patchwork@inbox.dpdk.org Received: from mails.dpdk.org (mails.dpdk.org [217.70.189.124]) by inbox.dpdk.org (Postfix) with ESMTP id A364BA0C47; Wed, 27 Oct 2021 16:05:15 +0200 (CEST) Received: from [217.70.189.124] (localhost [127.0.0.1]) by mails.dpdk.org (Postfix) with ESMTP id 8ACA940DDA; Wed, 27 Oct 2021 16:05:15 +0200 (CEST) Received: from us-smtp-delivery-124.mimecast.com (us-smtp-delivery-124.mimecast.com [216.205.24.124]) by mails.dpdk.org (Postfix) with ESMTP id 98595407FF for ; Wed, 27 Oct 2021 16:05:14 +0200 (CEST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=redhat.com; s=mimecast20190719; t=1635343514; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding; bh=EW7mqOZ/c/iokgQCjeWCknCrXMjkQg/N1T4UUt6JxhM=; b=UTqPqIfniq3nBA94tcyVdWGXUd6c5Zu4bNa/LhgHP4/sdhDdUwaxEVJdvH2viAWQ0MjMj7 CTGM+s5vS9OmORTsuMuw5T7VT8eek0VUCXvvOsXrx3leTzfkOLc0HDTGhaeP3WUeNKIn+b MqqDH+ujD5xZmSTh+L0KqY6qHGa0x18= Received: from mimecast-mx01.redhat.com (mimecast-mx01.redhat.com [209.132.183.4]) (Using TLS) by relay.mimecast.com with ESMTP id us-mta-387-vgpHB_8ROgKgMkjaXfOSUg-1; Wed, 27 Oct 2021 10:05:10 -0400 X-MC-Unique: vgpHB_8ROgKgMkjaXfOSUg-1 Received: from smtp.corp.redhat.com (int-mx06.intmail.prod.int.phx2.redhat.com [10.5.11.16]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by mimecast-mx01.redhat.com (Postfix) with ESMTPS id CEF1110A8E00 for ; Wed, 27 Oct 2021 14:05:09 +0000 (UTC) Received: from dmarchan.remote.csb (unknown [10.40.192.79]) by smtp.corp.redhat.com (Postfix) with ESMTP id 7A2F068D95; Wed, 27 Oct 2021 14:05:08 +0000 (UTC) From: David Marchand To: dev@dpdk.org Cc: aconole@redhat.com Date: Wed, 27 Oct 2021 16:04:57 +0200 Message-Id: <20211027140458.2502-1-david.marchand@redhat.com> MIME-Version: 1.0 X-Scanned-By: MIMEDefang 2.79 on 10.5.11.16 Authentication-Results: relay.mimecast.com; auth=pass smtp.auth=CUSA124A263 smtp.mailfrom=david.marchand@redhat.com X-Mimecast-Spam-Score: 0 X-Mimecast-Originator: redhat.com Subject: [dpdk-dev] [PATCH 1/2] test: create a list of extra tests X-BeenThere: dev@dpdk.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: DPDK patches and discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: dev-bounces@dpdk.org Sender: "dev" We removed some tests from the "CI" (fast-tests) list because they were not reliable enough or did not make sense as non regression tests. Since we still build those tests code, leave an option for users to call them. This list can also serve as a point where to document why test X is not suitable for the "CI" list. Signed-off-by: David Marchand --- app/test/meson.build | 16 ++++++++++++++++ 1 file changed, 16 insertions(+) diff --git a/app/test/meson.build b/app/test/meson.build index 20f36a1803..200790eda0 100644 --- a/app/test/meson.build +++ b/app/test/meson.build @@ -287,6 +287,14 @@ fast_tests = [ ['trace_autotest', true], ] +# Tests known to have issues or which don't belong in other tests lists. +extra_test_names = [ + # ee00af60170b ("test: remove strict timing requirements some tests") + 'alarm_autotest', + 'cycles_autotest', + 'delay_us_sleep_autotest', +] + perf_test_names = [ 'ring_perf_autotest', 'mempool_perf_autotest', @@ -525,3 +533,11 @@ foreach arg : dump_test_names is_parallel : false, suite : 'debug-tests') endforeach + +foreach arg : extra_test_names + test(arg, dpdk_test, + env : ['DPDK_TEST=' + arg], + timeout : timeout_seconds, + is_parallel : false, + suite : 'extra-tests') +endforeach From patchwork Wed Oct 27 14:04:58 2021 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: David Marchand X-Patchwork-Id: 103052 X-Patchwork-Delegate: david.marchand@redhat.com Return-Path: X-Original-To: patchwork@inbox.dpdk.org Delivered-To: patchwork@inbox.dpdk.org Received: from mails.dpdk.org (mails.dpdk.org [217.70.189.124]) by inbox.dpdk.org (Postfix) with ESMTP id A81B4A0C47; Wed, 27 Oct 2021 16:05:25 +0200 (CEST) Received: from [217.70.189.124] (localhost [127.0.0.1]) by mails.dpdk.org (Postfix) with ESMTP id 93EB040E0F; Wed, 27 Oct 2021 16:05:25 +0200 (CEST) Received: from us-smtp-delivery-124.mimecast.com (us-smtp-delivery-124.mimecast.com [170.10.133.124]) by mails.dpdk.org (Postfix) with ESMTP id 7069E407FF for ; Wed, 27 Oct 2021 16:05:24 +0200 (CEST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=redhat.com; s=mimecast20190719; t=1635343524; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=mJHAU6OLhHweKUsK2C34/YwEvrANk1Mh7+sl8ApvwIk=; b=esmua8DIyXVX0gBdVgMrR8IX+jv3Em5un/O5SaRkf+hQVLps+bFaslawfBdGHU6VD38RW2 mZ5jtBbNSzerBz5+d3lBLJNE82kjOzVBA/Ert52e0+nefRVtzm3CEgsvsFvjdZP9YrCJLH zgOD5YZMgRTYGISr7j8K/Zq2zbVf9pE= Received: from mimecast-mx01.redhat.com (mimecast-mx01.redhat.com [209.132.183.4]) (Using TLS) by relay.mimecast.com with ESMTP id us-mta-336-7cS2NbimN5qzMr3c1mHJnQ-1; Wed, 27 Oct 2021 10:05:14 -0400 X-MC-Unique: 7cS2NbimN5qzMr3c1mHJnQ-1 Received: from smtp.corp.redhat.com (int-mx06.intmail.prod.int.phx2.redhat.com [10.5.11.16]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by mimecast-mx01.redhat.com (Postfix) with ESMTPS id CB16D1006AA4 for ; Wed, 27 Oct 2021 14:05:13 +0000 (UTC) Received: from dmarchan.remote.csb (unknown [10.40.192.79]) by smtp.corp.redhat.com (Postfix) with ESMTP id C5FA55FC23; Wed, 27 Oct 2021 14:05:12 +0000 (UTC) From: David Marchand To: dev@dpdk.org Cc: aconole@redhat.com Date: Wed, 27 Oct 2021 16:04:58 +0200 Message-Id: <20211027140458.2502-2-david.marchand@redhat.com> In-Reply-To: <20211027140458.2502-1-david.marchand@redhat.com> References: <20211027140458.2502-1-david.marchand@redhat.com> MIME-Version: 1.0 X-Scanned-By: MIMEDefang 2.79 on 10.5.11.16 Authentication-Results: relay.mimecast.com; auth=pass smtp.auth=CUSA124A263 smtp.mailfrom=david.marchand@redhat.com X-Mimecast-Spam-Score: 0 X-Mimecast-Originator: redhat.com Subject: [dpdk-dev] [PATCH 2/2] test: move RED to extra tests list X-BeenThere: dev@dpdk.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: DPDK patches and discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: dev-bounces@dpdk.org Sender: "dev" This test gives random failures, disable it. See: https://bugs.dpdk.org/show_bug.cgi?id=826 Signed-off-by: David Marchand --- app/test/meson.build | 3 ++- 1 file changed, 2 insertions(+), 1 deletion(-) diff --git a/app/test/meson.build b/app/test/meson.build index 200790eda0..71fce2efda 100644 --- a/app/test/meson.build +++ b/app/test/meson.build @@ -248,7 +248,6 @@ fast_tests = [ ['pflock_autotest', true], ['prefetch_autotest', true], ['rcu_qsbr_autotest', true], - ['red_autotest', true], ['rib_autotest', true], ['rib6_autotest', true], ['ring_autotest', true], @@ -293,6 +292,8 @@ extra_test_names = [ 'alarm_autotest', 'cycles_autotest', 'delay_us_sleep_autotest', + # https://bugs.dpdk.org/show_bug.cgi?id=826 + 'red_autotest', ] perf_test_names = [