From patchwork Wed Dec 14 01:55:43 2016 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Jerin Jacob X-Patchwork-Id: 17937 X-Patchwork-Delegate: thomas@monjalon.net Return-Path: X-Original-To: patchwork@dpdk.org Delivered-To: patchwork@dpdk.org Received: from [92.243.14.124] (localhost [IPv6:::1]) by dpdk.org (Postfix) with ESMTP id 23B1F68BD; Wed, 14 Dec 2016 02:59:16 +0100 (CET) Received: from NAM03-DM3-obe.outbound.protection.outlook.com (mail-dm3nam03on0064.outbound.protection.outlook.com [104.47.41.64]) by dpdk.org (Postfix) with ESMTP id ADCC04A59 for ; Wed, 14 Dec 2016 02:58:46 +0100 (CET) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=CAVIUMNETWORKS.onmicrosoft.com; s=selector1-cavium-com; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version; bh=Bkt9GGTUPBVDvhMdUjws6XGX55ZCcdQMqDQWcwzM4Sg=; b=U1FWiwb6QAAqmYBi6yY6Ypqmzfhgx6Dqpa3jTAcPxP6pXzzpTqdTfaIkn1LZkqfE9v/RKuesmrdqDpfogAQVWI1Pz1ifBoZsTOc7ZA6Q7rkuDEAM6V3DwxunktlgZylppX+jKreReE3oWk7f+WaCZj6pjYKOMiy8lFs9jDkwzsw= Authentication-Results: spf=none (sender IP is ) smtp.mailfrom=Jerin.Jacob@cavium.com; Received: from localhost.localdomain.localdomain (122.166.91.229) by BN3PR0701MB1719.namprd07.prod.outlook.com (10.163.39.18) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384_P384) id 15.1.771.8; Wed, 14 Dec 2016 01:58:12 +0000 From: Jerin Jacob To: CC: , , , , , Jerin Jacob Date: Wed, 14 Dec 2016 07:25:43 +0530 Message-ID: <1481680558-4003-14-git-send-email-jerin.jacob@caviumnetworks.com> X-Mailer: git-send-email 2.5.5 In-Reply-To: <1481680558-4003-1-git-send-email-jerin.jacob@caviumnetworks.com> References: <1481680558-4003-1-git-send-email-jerin.jacob@caviumnetworks.com> MIME-Version: 1.0 X-Originating-IP: [122.166.91.229] X-ClientProxiedBy: MAXPR01CA0006.INDPRD01.PROD.OUTLOOK.COM (10.164.147.13) To BN3PR0701MB1719.namprd07.prod.outlook.com (10.163.39.18) X-MS-Office365-Filtering-Correlation-Id: 1bb70e2c-2d5c-4b4f-23b2-08d423c4aac2 X-Microsoft-Antispam: UriScan:; BCL:0; PCL:0; RULEID:(22001); SRVR:BN3PR0701MB1719; X-Microsoft-Exchange-Diagnostics: 1; BN3PR0701MB1719; 3:xbl+fWe0Rp/k9wnFQJXx77ne4jVbei9plzscay70Ys50ZGOhhAcYmRg8c5MAZZWbv2X5/08QMVMkm9D+0NGJ3Z75dF7mopeAoNR7CjWmABBx71g082l2NCT6TEoNOXs6GgIVo8zlzCxnYL5c84lkiHdcLFfJVmT4bOr4n4HdIDo4biKFdy6fg5knV+gF7c4/Nlq02ep5TYeqvy7JSNVuGQ7T4jhuEvM1cuNOuo9cE+xeLhfc5hwAkAp8NWvY2LquwudYZgSsTYpT3A/61piNGg==; 25:petx0J1c+6KVZLZdmEGKJ+PCpGHsxvCqmJJLN6HAgSRUtIe0iCD4Vyo8OWeKYK9C+EbGzgjVvElIjJZ9sH1//7+CJ3GlOvi3UFIMhhImf/I6gp3lQvfyJOa5mkDQ62NTjtaQNQJSkUztYCup/CB14xa+u7k9e7SX3/LYvE6V7aDbYjJT1lDQwCCBRkIsN/P4fYsyhn63DxFZx2Ou8Bi7tjuqff4CjmNtIqQxOimoqVRMz4Lq/0pC8SGNSl90kf8CMPinya4DypWA8tJ+i2M2B5GPm8ejJb3UgYqlji4c/5rLpiTOSsqtL1zPc0+1Yo0BaUDKufG9eQzTkv6ITrfs6gqZrp0nkr9dhzQFB9EbBoFKetr/VuoocA2ksj/ZYm1TanXSUW+EE0odj82ccEVekbCp0z3gcp/qP3nkEiQ07k9ZltNRfhYEZxom4Ox4Q0mRByEuQgcOghsr4ZNXi0ylWA== X-Microsoft-Exchange-Diagnostics: 1; BN3PR0701MB1719; 31:k95h1vcWnrr4fU+hwa8fa5TIWHDGkyiSagmqez1YDrfVrKFJ4B4GasU2vkhoNncGtOp3DGtv//Dy1cUjxwT1+0tlRBHZ5blRhWNT0aKNcJy3DeQoKvRUi71EHmO37mtYOvr+aYXMTgd9E0y7xcT8sh4fQwjSTn7Ygr2ruFi24fvPkeU4Fdub25Nuu3WsMv8M8OOAU9V/iUm9azj9TOwhdP72b8HqjDiQZxBb2dS9CSdxx1o8+BkrHLEUBRbHpKuRBolQmSL+DBh7TwUbmoGLDLBkBIUSMJA0SDrmw3p0GNw=; 20:JCLnXorX6aUCR/6BrLmrsTDXTuhKSl4rwJBL4+4y9fMCs8GLHrEw9FLEtUZ7ZJgE7rb6kZtkXVTmlpZQOFihTte+S1TglYDDcUgt1EI9kozMk9531o71tX3/NyJM7Lzwyvk7ka0nID2Q0lXHXPQfEx395qZI5k7fq9vcLqmIrFOZc8vqFr4DVbY1zF37i1v4LK3Q2+xmPnBFvBAIS5oQg2zXch04K3/bQRdFEsm/PjKI6kPBDRyXInqPiC/KT0uA0Nt0Yuqpl5bBZZBTrzaCc4m5iPW/TweT7D7w2rDglq7fZDDRU8PaFE5JLH4TBf8qL5GFTQoe0HQrO/JiSo+bFNaRJxEpsTcR3Xq47+NpHp+xDAym0E9ZacpxWa1j9c0a7rt787cj1zW4Er7LBEdJxrj735RiW6sHuLNsoFYiGPuFJwmXOw8EAv6fS6bRH1jPyASFn/kY6R0CMycY/Sg18sQtdkt31nlz3Ogll7RZQ5g5HUn1Yk58y48Kt8KhSelgZPNdwLquxH1ORmcJLX7546vnDzjaYPZXyifDELqTICncbayBRKz7gFHggupR6rTXxn5AzrCwTsMgJtB/uVcco5sLQmr99sg0HjVeU2edkzA= X-Microsoft-Antispam-PRVS: X-Exchange-Antispam-Report-Test: UriScan:; X-Exchange-Antispam-Report-CFA-Test: BCL:0; PCL:0; RULEID:(6040375)(601004)(2401047)(5005006)(8121501046)(10201501046)(3002001)(6041248)(20161123555025)(20161123560025)(20161123562025)(20161123564025)(6072148); SRVR:BN3PR0701MB1719; BCL:0; PCL:0; RULEID:; SRVR:BN3PR0701MB1719; X-Microsoft-Exchange-Diagnostics: 1; BN3PR0701MB1719; 4:k2UJ2ke3D2tTXWqr7042mwp5Z7sMI17l+4W+/kwZkaxY/e2FZ3Ie17kJVbUTRT0Ra7wbQFxh0r+3V8FbgEAmWBZ/6O1okeT+Lpfu3cSXzLQSslVdmk+KWV+JczHHVEEf+uiJOaNpm73D4dSqKz9xpc0hyEoi/tWQd4aVgH0CtaTyjc5l4Xg2KSsKDYym5zYeOXpHSfDK618T6hyfBryY5MXHXtKQSXD0EH1qgYm0UqTNttKYD4NVpEx6FiQy+xJtIfqxZ6j6qVftJ4cbUMH5VCJ7Tsbzeovfgdq7hUkrXn1TXb5+hWImW1Okk+7EBmHE9XpHaTh4mjTLFFQfY1M8+TqftlioATCSe+FiHTwTduek789aFwVY+3k1Lg2CTCSiwbFL7qk4EDF8tyy+kUtPCX+tmhRYNb1kAXlbQR8FRfF7dNCcvzAuLQXgLxW66uXEbCVYtagJ8NwAxl+AMdzl9jTHXfLYg6TNPdTkXQGC6Ck/v34LEc4A48yaA/RVJIXz5u8c7R/wjMW9XKVJQxiJOjXxQ6P/3WtORTUCimGrLYpJEpW1xOBvYq3U6gXRuRco16Xx1xXYRUW420x0GVXRSw== X-Forefront-PRVS: 01565FED4C X-Forefront-Antispam-Report: SFV:NSPM; SFS:(10009020)(4630300001)(6009001)(6069001)(7916002)(39450400003)(39840400002)(39410400002)(189002)(199003)(6116002)(6512006)(6506006)(6486002)(3846002)(66066001)(68736007)(47776003)(92566002)(5003940100001)(50986999)(76176999)(81156014)(50226002)(2906002)(110136003)(33646002)(6916009)(101416001)(42882006)(2950100002)(6666003)(4326007)(4001430100002)(81166006)(38730400001)(105586002)(8676002)(106356001)(5660300001)(107886002)(305945005)(48376002)(97736004)(50466002)(36756003)(2351001)(42186005)(7736002)(189998001); DIR:OUT; SFP:1101; SCL:1; SRVR:BN3PR0701MB1719; H:localhost.localdomain.localdomain; FPR:; SPF:None; PTR:InfoNoRecords; MX:1; A:1; LANG:en; Received-SPF: None (protection.outlook.com: cavium.com does not designate permitted sender hosts) X-Microsoft-Exchange-Diagnostics: =?us-ascii?Q?1; BN3PR0701MB1719; 23:+d6Wg5qNar3gP6ihm1bYVADLavrV57lHrm/f19L?= WGKJynSIexm25YPrPtakwCoJOAGxc2GiYdhh4gzbTZ/nKjaL+rhYGPOtfzopn1KH6YbITjG0uuYHmCA++LKvTCD19+4ndwgjJwRTvipg15Jsu6gRT5r8dqwMSL48DYNMyzvICuJYuCU4lbsmRowIP6nPWQ+AAWgRid6FBb1E5uq1y9jLAHqwpqrzWlivpyIwBReFXP7X+okUlxoV0hxrr6l1XQ32+Vto+CLlksteiLgj3yOSwOgU5QPrpMMKbAEyCoILC6XMZiXP/JJV0YuFU6QMDy5SMttdOGapUYIdjS/aBygnIrtJf9NJvjK7BTCiYLMcMbNEuHiBhL1AYD7HdU83nkb3OFcK5YusNqDBrODJguDAREeaZuhpIColT53xKNdSucVRHlubbtGm5DndPE+CS3GuNWlZkmFIvDma5+mlFcfq09RsuP4TukciENAoZhyFGIwxjIz36XdvDerjXxZt2sQhteM6r5Vz8un3pPj0xUjZkxbr21lOURFWVKR6plWvi/YeNHQHyhgI+OomxwPEAETnFNcmv3I/jNPmd4eFkAWXVFdYYBkcPJJ2hGQtZVS6EIyZ3lAyxQVg1tolkhAnJD9KOV0Nq4vzK28UpJjQfcbMHKHJvBkAxlN9dccZcYd44/kQ6qGlySnLf52MCKYAjV3CyexXEmirq6OhmJM5JKov4fCsOhSk64DAzZYhEKvXxmrGUTNm8HPTkbEY/ynWqz914lJNdvraNuI6HQz6ZeG3vJiMSeHmAOOlTTp0dLqZ51wJlLBemmz1KDy/9BIF5QQ3FJMHzpGjDMn8xMwc3wKQhUfGhclbSPZ5UO6t8+EVwVAI4/qcViEyTjhHUD2XNdPrImsXrJ2lzRlcX7a0nJJItWDujVPG4JF3+7J9RHF4G+hqwDb8rO7uHH0V1aoqFPRGREZ07NXn0cv+FU3CCCIZJZyzyp61Kb6U00My/vMysqgX4yRVSVQzutbi9lpQurDgsP+finTAUkME2w54jY+G6nwuQ8nH6EXxVdiBUna5mVHs4Vd5w2+WloL/KW1Ts1lrKUIUYez3u/gXW6ho/CwvwPUl/jSbX5j0aqJrgrf7VjF7RIJch/55sAiRi1aidVWDWWfl6h1AVp1NJOuEraX5zhXw+dzMEmJD7TZZhZy0UFAgYW413qECovuKUq3wj X-Microsoft-Exchange-Diagnostics: 1; BN3PR0701MB1719; 6:oHV/7iLOUxFyn3yuFv5uQfO3O8o2+e86rtk4g8ghSyDv9gQesXfbbKPFwjR5mNnAIqfOrbAqrRUXzWxOkskjonpBIUsdqEed7oY0tVZoyFwTJrgiP75ovMmyg+1tEv7e7BHRLk7B4+GroVcxyxK+7uP3C6BHSz68tGrTg9/P1FXnwgx4r1GBBuytmUFlLO+f6iIpX5rFx7LWHT9eH/tVLuvWVofiZdg0st5sokTkv1jV9l3zdxsL7BO8KfojUd1qtccP0oa4a7603Y0fFZcaPOCCeP6hzANOZFcgnSzaZgKdnHXTh+bIfvIzQmCBnGhE6O1iiGTJSismByON9BnKsiIM5J0OgpKZPkx3nysmTXj8c9KllPdlD1BpS78QlxBZ4GFFApgAP5QGyDSDNLCVWfItN6+WmIH/6WDy2AO5QYo=; 5:SQ2GzOFlt+5uOvyQAKfmKvgHdDslO/Kxkp6W8VXQARIKdMad8hazvrHLoDjWcqPCYSA2WXNe+iJdRRDiXdXIDnMJmrcMU+dy1XnC9DuJWFBanWj652EnIakJcb99H8DRxakkgwFDVpcNvWIbYIEUkw==; 24:Hh6nRydZHK1XTrWzaFu/YA3KGyGZSzJQEPEXXJq1IXl4uoCQA0C7012H4IquKcnRGesKlm3TUM0yot71p2eB57lwAYQ7zfBnGtpMbfdEGaQ= SpamDiagnosticOutput: 1:99 SpamDiagnosticMetadata: NSPM X-Microsoft-Exchange-Diagnostics: 1; BN3PR0701MB1719; 7:/do4fk3FO+fMLhvNPWheh5RNj5YLCvRIV1RlOQU/bEUS0O3KTIeOS9qvpNrTrA544F3fyV9DpgTDmVBoiQszCSQL4hmmyzpnzWsCSFA3nNs3Ji1BzT1T2Fz7YPLVlDc78Rk6Vq6fs8fLgOtgv0RPb+JTwktQPRPf8aa346d03/K+0trYKXSSj6925KOiqurVweIKYJZYJMKaDKYV4hzoE0K7YaAAQzVKbXD2Pd0cz6rfrWsVjAMYrY8QNUx563MnXy5s9wOVjrXePagj/zey9+/IdR+A+jPGo5QOyZohhcq62dR4FuP1wipEmLdJNrh+luoTB344Qd8lZCk3Z3EcHJ6PrhwUQawopSQGUhhxTDe+tk3oBgEWzKjT2wEZvFFWeVHVedkU15JujJuYa31JBqbyOacZRcM6qigUpHc6ZuFqpFklKLLBtEEoQHIPcfDouILqMtCgaph54jowzHct6w== X-OriginatorOrg: caviumnetworks.com X-MS-Exchange-CrossTenant-OriginalArrivalTime: 14 Dec 2016 01:58:12.6043 (UTC) X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted X-MS-Exchange-Transport-CrossTenantHeadersStamped: BN3PR0701MB1719 Subject: [dpdk-dev] [PATCH 13/28] eal/arm64: override I/O device read/write access for arm64 X-BeenThere: dev@dpdk.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: DPDK patches and discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: dev-bounces@dpdk.org Sender: "dev" Override the generic I/O device memory read/write access and implement it using armv8 instructions for arm64. Signed-off-by: Jerin Jacob --- lib/librte_eal/common/include/arch/arm/rte_io.h | 4 + lib/librte_eal/common/include/arch/arm/rte_io_64.h | 183 +++++++++++++++++++++ 2 files changed, 187 insertions(+) create mode 100644 lib/librte_eal/common/include/arch/arm/rte_io_64.h diff --git a/lib/librte_eal/common/include/arch/arm/rte_io.h b/lib/librte_eal/common/include/arch/arm/rte_io.h index 74c1f2c..9593b42 100644 --- a/lib/librte_eal/common/include/arch/arm/rte_io.h +++ b/lib/librte_eal/common/include/arch/arm/rte_io.h @@ -38,7 +38,11 @@ extern "C" { #endif +#ifdef RTE_ARCH_64 +#include "rte_io_64.h" +#else #include "generic/rte_io.h" +#endif #ifdef __cplusplus } diff --git a/lib/librte_eal/common/include/arch/arm/rte_io_64.h b/lib/librte_eal/common/include/arch/arm/rte_io_64.h new file mode 100644 index 0000000..09e7a89 --- /dev/null +++ b/lib/librte_eal/common/include/arch/arm/rte_io_64.h @@ -0,0 +1,183 @@ +/* + * BSD LICENSE + * + * Copyright (C) Cavium networks Ltd. 2016. + * + * Redistribution and use in source and binary forms, with or without + * modification, are permitted provided that the following conditions + * are met: + * + * * Redistributions of source code must retain the above copyright + * notice, this list of conditions and the following disclaimer. + * * Redistributions in binary form must reproduce the above copyright + * notice, this list of conditions and the following disclaimer in + * the documentation and/or other materials provided with the + * distribution. + * * Neither the name of Cavium networks nor the names of its + * contributors may be used to endorse or promote products derived + * from this software without specific prior written permission. + * + * THIS SOFTWARE IS PROVIDED BY THE COPYRIGHT HOLDERS AND CONTRIBUTORS + * "AS IS" AND ANY EXPRESS OR IMPLIED WARRANTIES, INCLUDING, BUT NOT + * LIMITED TO, THE IMPLIED WARRANTIES OF MERCHANTABILITY AND FITNESS FOR + * A PARTICULAR PURPOSE ARE DISCLAIMED. IN NO EVENT SHALL THE COPYRIGHT + * OWNER OR CONTRIBUTORS BE LIABLE FOR ANY DIRECT, INDIRECT, INCIDENTAL, + * SPECIAL, EXEMPLARY, OR CONSEQUENTIAL DAMAGES (INCLUDING, BUT NOT + * LIMITED TO, PROCUREMENT OF SUBSTITUTE GOODS OR SERVICES; LOSS OF USE, + * DATA, OR PROFITS; OR BUSINESS INTERRUPTION) HOWEVER CAUSED AND ON ANY + * THEORY OF LIABILITY, WHETHER IN CONTRACT, STRICT LIABILITY, OR TORT + * (INCLUDING NEGLIGENCE OR OTHERWISE) ARISING IN ANY WAY OUT OF THE USE + * OF THIS SOFTWARE, EVEN IF ADVISED OF THE POSSIBILITY OF SUCH DAMAGE. + */ + +#ifndef _RTE_IO_ARM64_H_ +#define _RTE_IO_ARM64_H_ + +#ifdef __cplusplus +extern "C" { +#endif + +#include + +#define RTE_OVERRIDE_IO_H + +#include "generic/rte_io.h" +#include "rte_atomic_64.h" + +static inline __attribute__((always_inline)) uint8_t +__rte_arm64_readb(const volatile void *addr) +{ + uint8_t val; + + asm volatile( + "ldrb %w[val], [%x[addr]]" + : [val] "=r" (val) + : [addr] "r" (addr)); + return val; +} + +static inline __attribute__((always_inline)) uint16_t +__rte_arm64_readw(const volatile void *addr) +{ + uint16_t val; + + asm volatile( + "ldrh %w[val], [%x[addr]]" + : [val] "=r" (val) + : [addr] "r" (addr)); + return val; +} + +static inline __attribute__((always_inline)) uint32_t +__rte_arm64_readl(const volatile void *addr) +{ + uint32_t val; + + asm volatile( + "ldr %w[val], [%x[addr]]" + : [val] "=r" (val) + : [addr] "r" (addr)); + return val; +} + +static inline __attribute__((always_inline)) uint64_t +__rte_arm64_readq(const volatile void *addr) +{ + uint64_t val; + + asm volatile( + "ldr %x[val], [%x[addr]]" + : [val] "=r" (val) + : [addr] "r" (addr)); + return val; +} + +static inline __attribute__((always_inline)) void +__rte_arm64_writeb(uint8_t val, volatile void *addr) +{ + asm volatile( + "strb %w[val], [%x[addr]]" + : + : [val] "r" (val), [addr] "r" (addr)); +} + +static inline __attribute__((always_inline)) void +__rte_arm64_writew(uint16_t val, volatile void *addr) +{ + asm volatile( + "strh %w[val], [%x[addr]]" + : + : [val] "r" (val), [addr] "r" (addr)); +} + +static inline __attribute__((always_inline)) void +__rte_arm64_writel(uint32_t val, volatile void *addr) +{ + asm volatile( + "str %w[val], [%x[addr]]" + : + : [val] "r" (val), [addr] "r" (addr)); +} + +static inline __attribute__((always_inline)) void +__rte_arm64_writeq(uint64_t val, volatile void *addr) +{ + asm volatile( + "str %x[val], [%x[addr]]" + : + : [val] "r" (val), [addr] "r" (addr)); +} + +#define rte_readb_relaxed(addr) \ + ({ uint8_t __v = __rte_arm64_readb(addr); __v; }) + +#define rte_readw_relaxed(addr) \ + ({ uint16_t __v = __rte_arm64_readw(addr); __v; }) + +#define rte_readl_relaxed(addr) \ + ({ uint32_t __v = __rte_arm64_readl(addr); __v; }) + +#define rte_readq_relaxed(addr) \ + ({ uint64_t __v = __rte_arm64_readq(addr); __v; }) + +#define rte_writeb_relaxed(value, addr) \ + ({ __rte_arm64_writeb(value, addr); }) + +#define rte_writew_relaxed(value, addr) \ + ({ __rte_arm64_writew(value, addr); }) + +#define rte_writel_relaxed(value, addr) \ + ({ __rte_arm64_writel(value, addr); }) + +#define rte_writeq_relaxed(value, addr) \ + ({ __rte_arm64_writeq(value, addr); }) + +#define rte_readb(addr) \ + ({ uint8_t __v = __rte_arm64_readb(addr); rte_io_rmb(); __v; }) + +#define rte_readw(addr) \ + ({ uint16_t __v = __rte_arm64_readw(addr); rte_io_rmb(); __v; }) + +#define rte_readl(addr) \ + ({ uint32_t __v = __rte_arm64_readl(addr); rte_io_rmb(); __v; }) + +#define rte_readq(addr) \ + ({ uint64_t __v = __rte_arm64_readq(addr); rte_io_rmb(); __v; }) + +#define rte_writeb(value, addr) \ + ({ rte_io_wmb(); rte_writeb_relaxed(value, addr); }) + +#define rte_writew(value, addr) \ + ({ rte_io_wmb(); rte_writew_relaxed(value, addr); }) + +#define rte_writel(value, addr) \ + ({ rte_io_wmb(); rte_writel_relaxed(value, addr); }) + +#define rte_writeq(value, addr) \ + ({ rte_io_wmb(); rte_writeq_relaxed(value, addr); }) + +#ifdef __cplusplus +} +#endif + +#endif /* _RTE_IO_ARM64_H_ */