Skip to end of metadata
Go to start of metadata

You are viewing an old version of this page. View the current version.

Compare with Current View Page History

Version 1 Current »

In order to try and check the FPGA-to-FPGA serial channel connections of the Intel Stratix 10 cards with the OpenCL tool flow, we have prepared ready-to-use modules with compiled host code and synthesized device code. To run the tests, please follow the steps.

Get Node and Prepare Environment

  1. Get a node with Stratix 10 cards in the right BSP (all BSPs with _max suffix support serial channels)

srun --partition=fpga -A YOUR-PROJECT-NAME --constraint=bittware_520n_20.4.0_max -t 1:00:00  --pty bash

This command allocates one node with the correct BSP for one hour. You get a shell (bash) on the node.

  1. Load the ready-to-use modules to run the linktests

module reset
module load fpga
module load intel/opencl_sdk/21.4.0
module load bittware/520n/20.4.0_max
module load changeFPGAlinks

module load intel/testFPGAlinks-opencl

This commands

  • (intel/opencl_sdk/21.4.0 and bittware/520n/20.4.0_max): load the correct BSP version and the latest OpenCL SDK version that is supported on our systems

  • (changeFPGAlinks): loads the utility to change the topology how the FPGA-to-FPGA network is configured, see FPGA-to-FPGA Networking

  • (intel/testFPGAlinks-opencl): loads the OpenCL linktest suite

Configure Topology and Run Test

Before running a test, the correct topology on the FPGA-to-FPGA network needs to be set. This is done with the changeFPGAlinks utility. The following example describes the required steps for the test testFPGAlinks_throughput_nodes_1_cards_1 (using one FPGA node and one FPGA card). The test has the following parameters

Usage : testFPGAlinks_throughput_nodes_1_cards_1 [<options>] 
        -d <device>          : OpenCL Device
                             : 0 - acl0 (default)
                             : 1 - acl1
                             : 2 - acl2
        -s <sequence>        : Data Sequence
                             : 0 - Random (default)
                             : 1 - Count (with channel in top nibble)
                             : 2 - Inverse of 1
        -n <numerrs>         : Num of errors per channel to display. Default 1
        -v <verbosity>       : How verbose to display. Default 0
        -t <tx_gap>          : Default = 0
        -r <rx_gap>          : Default = 0
        -l <loops>           : Default = 1
        -m <testmode>        : Test connection mode.
                             : 0 - QSFP0 to QSFP1, QSFP2 to QSFP3 (default)
                             : 1 - QSFP0 to QSFP2, QSFP1 to QSFP3
                             : 2 - QSFP0 to QSFP3, QSFP1 to QSPF2
                             : 3 - each QSFP linked to itself (loopback)

The important parameters are

  • -d to select the FPGA card (= 0 for the first FPGA card or = 1 for the second FPGA card)

  • -m to set the connection mode, how the FPGA links are set. The image below shows a visualization of the different testmodes

grafik-20241030-145659.png

If we want to run testmode 0, we need to setup the FPGA-to-FPGA network accordingly. This is done with the changeFPGAlinks utility:

Testmode 0, see FPGA GUI

changeFPGAlinks  --fpgalink=n00:acl0:ch0-n00:acl0:ch1 --fpgalink=n00:acl0:ch2-n00:acl0:ch3 --fpgalink=n00:acl1:ch0-n00:acl1:ch1 --fpgalink=n00:acl1:ch2-n00:acl1:ch3
 Expected output
There are currently no links set up.
Your nodes in this Job (16238960):
	n2fpga25
Started changing link-config with ID 43f27fdd-1cd2-418f-85a9-d79932603455 and test links after setup.
START: Wed Oct 30 16:02:23 CET 2024
INFO: Request from user "deffel" from job "16238960"
INFO: Nodelist of job: n2fpga25
INFO: Setting SPANK_FPGALINK0=n00:acl0:ch0-n00:acl0:ch1
INFO: Setting SPANK_FPGALINK1=n00:acl0:ch2-n00:acl0:ch3
INFO: Setting SPANK_FPGALINK2=n00:acl1:ch0-n00:acl1:ch1
INFO: Setting SPANK_FPGALINK3=n00:acl1:ch2-n00:acl1:ch3
Host list 
n2fpga25
Generated connections
fpgalink n2fpga25:acl0:ch0-n2fpga25:acl0:ch1
fpgalink n2fpga25:acl0:ch2-n2fpga25:acl0:ch3
fpgalink n2fpga25:acl1:ch0-n2fpga25:acl1:ch1
fpgalink n2fpga25:acl1:ch2-n2fpga25:acl1:ch3
Topology configuration request accepted after 0.36612510681152344s
[{"in":"1.8.1","out":"1.8.2","response":{"status":"1","msg":"OK","description":"Cross Connection added successfully!"}},{"in":"1.8.3","out":"1.8.4","response":{"status":"1","msg":"OK","description":"Cross Connection added successfully!"}},{"in":"1.8.5","out":"1.8.6","response":{"status":"1","msg":"OK","description":"Cross Connection added successfully!"}},{"in":"1.8.7","out":"1.8.8","response":{"status":"1","msg":"OK","description":"Cross Connection added successfully!"}}]
Begin link tests
Iteration 1
n2fpga25:acl0:ch0:1.8.1>1.8.2 input: 2.86 output: 0.94 loss: 1.91
n2fpga25:acl0:ch1:1.8.2>1.8.1 input: 3.20 output: 1.52 loss: 1.68
n2fpga25:acl0:ch2:1.8.3>1.8.4 input: 2.63 output: 1.01 loss: 1.62
n2fpga25:acl0:ch3:1.8.4>1.8.3 input: 2.33 output: 0.53 loss: 1.80
n2fpga25:acl1:ch0:1.8.5>1.8.6 input: 1.39 output: -0.30 loss: 1.70
n2fpga25:acl1:ch1:1.8.6>1.8.5 input: 2.91 output: 1.51 loss: 1.40
n2fpga25:acl1:ch2:1.8.7>1.8.8 input: 2.63 output: 0.96 loss: 1.67
n2fpga25:acl1:ch3:1.8.8>1.8.7 input: 3.68 output: 1.67 loss: 2.01

To visualize this configuration click here:
https://pc2.github.io/fpgalink-gui/index.html?import=--fpgalink%3Dn2fpga25%3Aacl0%3Ach0-n2fpga25%3Aacl0%3Ach1%20--fpgalink%3Dn2fpga25%3Aacl0%3Ach2-n2fpga25%3Aacl0%3Ach3%20--fpgalink%3Dn2fpga25%3Aacl1%3Ach0-n2fpga25%3Aacl1%3Ach1%20--fpgalink%3Dn2fpga25%3Aacl1%3Ach2-n2fpga25%3Aacl1%3Ach3

The other topologies for the testmodes can be set accordingly, expand to see details.

 Other testmodes

Testmode 1

changeFPGAlinks --fpgalink=n00:acl1:ch0-n00:acl1:ch2 --fpgalink=n00:acl0:ch0-n00:acl0:ch2 --fpgalink=n00:acl0:ch1-n00:acl0:ch3 --fpgalink=n00:acl1:ch1-n00:acl1:ch3

Testmode 2

changeFPGAlinks --fpgalink=n00:acl1:ch0-n00:acl1:ch3 --fpgalink=n00:acl0:ch0-n00:acl0:ch3 --fpgalink=n00:acl0:ch1-n00:acl0:ch2 --fpgalink=n00:acl1:ch1-n00:acl1:ch2

Testmode 3

changeFPGAlinks --fpgalink=n00:acl0:ch0-n00:acl0:ch0 --fpgalink=n00:acl0:ch1-n00:acl0:ch1 --fpgalink=n00:acl0:ch2-n00:acl0:ch2 --fpgalink=n00:acl0:ch3-n00:acl0:ch3 \
  --fpgalink=n00:acl1:ch0-n00:acl1:ch0 --fpgalink=n00:acl1:ch1-n00:acl1:ch1 --fpgalink=n00:acl1:ch2-n00:acl1:ch2 --fpgalink=n00:acl1:ch3-n00:acl1:ch3

Now we can run the test. To execute the test on the first FPGA card and the first testmode, we use

testFPGAlinks_latency_nodes_1_cards_1 -d 0 -m 0
 Expected output
Querying platform for info:
==========================
CL_PLATFORM_NAME                         = Intel(R) FPGA SDK for OpenCL(TM)
CL_PLATFORM_VENDOR                       = Intel(R) Corporation
CL_PLATFORM_VERSION                      = OpenCL 1.0 Intel(R) FPGA SDK for OpenCL(TM), Version 21.4

number of devices available = 2
number of devices to use = 1
Querying device for info:
========================
CL_DEVICE_NAME                           = p520_max_sg280l : BittWare Stratix 10 OpenCL platform (aclbitt_s10_pcie0)
CL_DEVICE_VENDOR                         = BittWare ltd
CL_DEVICE_VENDOR_ID                      = 4466
CL_DEVICE_VERSION                        = OpenCL 1.0 Intel(R) FPGA SDK for OpenCL(TM), Version 21.4
CL_DRIVER_VERSION                        = 21.4
CL_DEVICE_ADDRESS_BITS                   = 64
CL_DEVICE_AVAILABLE                      = true
CL_DEVICE_ENDIAN_LITTLE                  = true
CL_DEVICE_GLOBAL_MEM_CACHE_SIZE          = 32768
CL_DEVICE_GLOBAL_MEM_CACHELINE_SIZE      = 0
CL_DEVICE_GLOBAL_MEM_SIZE                = 34359737344
CL_DEVICE_IMAGE_SUPPORT                  = false
CL_DEVICE_LOCAL_MEM_SIZE                 = 16384
CL_DEVICE_MAX_CLOCK_FREQUENCY            = 1000
CL_DEVICE_MAX_COMPUTE_UNITS              = 1
CL_DEVICE_MAX_CONSTANT_ARGS              = 8
CL_DEVICE_MAX_CONSTANT_BUFFER_SIZE       = 8589934336
CL_DEVICE_MAX_WORK_ITEM_DIMENSIONS       = 3
CL_DEVICE_MAX_WORK_ITEM_DIMENSIONS       = 8192
CL_DEVICE_MIN_DATA_TYPE_ALIGN_SIZE       = 1024
CL_DEVICE_PREFERRED_VECTOR_WIDTH_CHAR    = 4
CL_DEVICE_PREFERRED_VECTOR_WIDTH_SHORT   = 2
CL_DEVICE_PREFERRED_VECTOR_WIDTH_INT     = 1
CL_DEVICE_PREFERRED_VECTOR_WIDTH_LONG    = 1
CL_DEVICE_PREFERRED_VECTOR_WIDTH_FLOAT   = 1
CL_DEVICE_PREFERRED_VECTOR_WIDTH_DOUBLE  = 0
Command queue out of order?              = true
Command queue profiling enabled?         = true
Using AOCX: ../../device/serial_channels.aocx
MMD INFO : Disabling SmartVID (fix) polling
MMD INFO : Enabling SmartVID (fix) polling
Serial Channel 0 Status: 0x0ff11ff1
Serial Channel 0 Status: PLL locked
Serial Channel 0 Status: Tx PHYs calibration complete
Serial Channel 0 Status: Tx PHYs ready
Serial Channel 0 Status: Kernel stream sink ready
Serial Channel 0 Status: Rx PHYs calibration complete
Serial Channel 0 Status: Rx PHYs ready
Serial Channel 0 Status: All Rx lanes aligned
Serial Channel 1 Status: 0x0ff11ff1
Serial Channel 1 Status: PLL locked
Serial Channel 1 Status: Tx PHYs calibration complete
Serial Channel 1 Status: Tx PHYs ready
Serial Channel 1 Status: Kernel stream sink ready
Serial Channel 1 Status: Rx PHYs calibration complete
Serial Channel 1 Status: Rx PHYs ready
Serial Channel 1 Status: All Rx lanes aligned
Serial Channel 2 Status: 0x0ff11ff1
Serial Channel 2 Status: PLL locked
Serial Channel 2 Status: Tx PHYs calibration complete
Serial Channel 2 Status: Tx PHYs ready
Serial Channel 2 Status: Kernel stream sink ready
Serial Channel 2 Status: Rx PHYs calibration complete
Serial Channel 2 Status: Rx PHYs ready
Serial Channel 2 Status: All Rx lanes aligned
Serial Channel 3 Status: 0x0ff11ff1
Serial Channel 3 Status: PLL locked
Serial Channel 3 Status: Tx PHYs calibration complete
Serial Channel 3 Status: Tx PHYs ready
Serial Channel 3 Status: Kernel stream sink ready
Serial Channel 3 Status: Rx PHYs calibration complete
Serial Channel 3 Status: Rx PHYs ready
Serial Channel 3 Status: All Rx lanes aligned
Serial Channel 0 Rx Ready: 0x00000fff
Serial Channel 1 Rx Ready: 0x00000fff
Serial Channel 2 Rx Ready: 0x00000fff
Serial Channel 3 Rx Ready: 0x00000fff
Serial Channel 0 Tx Valid: 0x00000000
Serial Channel 1 Tx Valid: 0x00000000
Serial Channel 2 Tx Valid: 0x00000000
Serial Channel 3 Tx Valid: 0x00000000
Generating test data...
Done
Quartus Compiled Frequency from AOCX = 297.500MHz
Starting Serial Channel Debug register test...
Note: Tx throughput and Rx availability are snapshots continually measured over 4095 kernel clocks.
      A Kernel clock frequency of 297.50MHz is used when calculating the Tx throughput.
      This Kernel clock frequency needs to be accurate for correct Tx throughput figues.
Generating test data...
Done
Pre-Launch Serial Channel Performance...
Serial Channel 0 Tx throughput: 0.00%
Serial Channel 1 Rx availability: 100.00%
Launching TX0 kernel...
The Rx availability will reduce to 0% as the channel is filled with data but the Rx kernel has not been started.
The Tx throughput may get captured at a non-zero value before it returns to 0% as a small amount of data is written into the channel before the channel fills and no data can be written in.
Serial Channel 0 Tx throughput: 0.00%
Serial Channel 1 Rx availability: 100.00%
Serial Channel 0 Tx throughput: 48.36%
Serial Channel 1 Rx availability: 51.14%
Serial Channel 0 Tx throughput: 7.16%
Serial Channel 1 Rx availability: 0.00%
Launching Rx1 Kernel...
The Tx throughput will increase as data is able to be written into the channel.
The Rx availability will start to increase as data is read from the channel.
Serial Channel 0 Tx throughput: 0.00%
Serial Channel 1 Rx availability: 0.00%
Serial Channel 0 Tx throughput: 22.13%
Serial Channel 1 Rx availability: 34.04%
Serial Channel 0 Tx throughput: 89.18%
Serial Channel 1 Rx availability: 100.00%
Serial Channel 0 Tx throughput: 89.18%
Serial Channel 1 Rx availability: 100.00%
Serial Channel 0 Tx throughput: 89.64%
Serial Channel 1 Rx availability: 100.00%
Tx0 Kernel complete
Serial Channel 0 Tx throughput: 0.00%
Serial Channel 1 Rx availability: 100.00%
Device 0 :RX1 complete in 0.239732 seconds : BW = 4.478924 GBytes/Sec
Rx1 Kernel complete
Serial Channel 0 Tx throughput: 0.00%
Serial Channel 1 Rx availability: 100.00%
Channel Status : PASS 
Errors for burst size 0x40000000 bytes = 0x00000000
Completed Serial Channel Debug register test
Clearing Rx Data...Done
Device 0 :RX0 complete in 0.000022 seconds : BW = 0.001430 GBytes/Sec
Device 0 :RX1 complete in 0.000017 seconds : BW = 0.001939 GBytes/Sec
Device 0 :RX2 complete in 0.000018 seconds : BW = 0.001795 GBytes/Sec
Device 0 :RX3 complete in 0.000016 seconds : BW = 0.001949 GBytes/Sec
Elapsed Time : 0.191000ms
Channel Status : PASS PASS PASS PASS 
Errors for burst size 0x00000020 bytes = 0x00000000
Clearing Rx Data...Done
Device 0 :RX0 complete in 0.000014 seconds : BW = 0.004420 GBytes/Sec
Device 0 :RX1 complete in 0.000015 seconds : BW = 0.004233 GBytes/Sec
Device 0 :RX2 complete in 0.000014 seconds : BW = 0.004469 GBytes/Sec
Device 0 :RX3 complete in 0.000014 seconds : BW = 0.004420 GBytes/Sec
Elapsed Time : 0.211000ms
Channel Status : PASS PASS PASS PASS 
Errors for burst size 0x00000040 bytes = 0x00000000
Clearing Rx Data...Done
Device 0 :RX0 complete in 0.000015 seconds : BW = 0.008416 GBytes/Sec
Device 0 :RX1 complete in 0.000015 seconds : BW = 0.008755 GBytes/Sec
Device 0 :RX2 complete in 0.000015 seconds : BW = 0.008471 GBytes/Sec
Device 0 :RX3 complete in 0.000023 seconds : BW = 0.005679 GBytes/Sec
Elapsed Time : 0.295000ms
Channel Status : PASS PASS PASS PASS 
Errors for burst size 0x00000080 bytes = 0x00000000
Clearing Rx Data...Done
Device 0 :RX0 complete in 0.000009 seconds : BW = 0.029630 GBytes/Sec
Device 0 :RX1 complete in 0.000016 seconds : BW = 0.016400 GBytes/Sec
Device 0 :RX2 complete in 0.000015 seconds : BW = 0.016645 GBytes/Sec
Device 0 :RX3 complete in 0.000017 seconds : BW = 0.015385 GBytes/Sec
Elapsed Time : 0.433000ms
Channel Status : PASS PASS PASS PASS 
Errors for burst size 0x00000100 bytes = 0x00000000
Clearing Rx Data...Done
Device 0 :RX0 complete in 0.000014 seconds : BW = 0.037048 GBytes/Sec
Device 0 :RX1 complete in 0.000013 seconds : BW = 0.038152 GBytes/Sec
Device 0 :RX2 complete in 0.000014 seconds : BW = 0.037758 GBytes/Sec
Device 0 :RX3 complete in 0.000014 seconds : BW = 0.036364 GBytes/Sec
Elapsed Time : 0.738000ms
Channel Status : PASS PASS PASS PASS 
Errors for burst size 0x00000200 bytes = 0x00000000
Clearing Rx Data...Done
Device 0 :RX0 complete in 0.000014 seconds : BW = 0.075018 GBytes/Sec
Device 0 :RX1 complete in 0.000014 seconds : BW = 0.074365 GBytes/Sec
Device 0 :RX2 complete in 0.000014 seconds : BW = 0.074854 GBytes/Sec
Device 0 :RX3 complete in 0.000015 seconds : BW = 0.066884 GBytes/Sec
Elapsed Time : 0.207000ms
Channel Status : PASS PASS PASS PASS 
Errors for burst size 0x00000400 bytes = 0x00000000
Clearing Rx Data...Done
Device 0 :RX0 complete in 0.000014 seconds : BW = 0.148945 GBytes/Sec
Device 0 :RX1 complete in 0.000020 seconds : BW = 0.100936 GBytes/Sec
Device 0 :RX2 complete in 0.000014 seconds : BW = 0.144735 GBytes/Sec
Device 0 :RX3 complete in 0.000014 seconds : BW = 0.146915 GBytes/Sec
Elapsed Time : 0.203000ms
Channel Status : PASS PASS PASS PASS 
Errors for burst size 0x00000800 bytes = 0x00000000
Clearing Rx Data...Done
Device 0 :RX0 complete in 0.000014 seconds : BW = 0.289675 GBytes/Sec
Device 0 :RX1 complete in 0.000015 seconds : BW = 0.277131 GBytes/Sec
Device 0 :RX2 complete in 0.000014 seconds : BW = 0.289061 GBytes/Sec
Device 0 :RX3 complete in 0.000017 seconds : BW = 0.242798 GBytes/Sec
Elapsed Time : 0.410000ms
Channel Status : PASS PASS PASS PASS 
Errors for burst size 0x00001000 bytes = 0x00000000
Clearing Rx Data...Done
Device 0 :RX0 complete in 0.000015 seconds : BW = 0.557279 GBytes/Sec
Device 0 :RX1 complete in 0.000015 seconds : BW = 0.549062 GBytes/Sec
Device 0 :RX2 complete in 0.000015 seconds : BW = 0.564576 GBytes/Sec
Device 0 :RX3 complete in 0.000015 seconds : BW = 0.539657 GBytes/Sec
Elapsed Time : 0.453000ms
Channel Status : PASS PASS PASS PASS 
Errors for burst size 0x00002000 bytes = 0x00000000
Clearing Rx Data...Done
Device 0 :RX0 complete in 0.000009 seconds : BW = 1.748559 GBytes/Sec
Device 0 :RX1 complete in 0.000016 seconds : BW = 1.012608 GBytes/Sec
Device 0 :RX2 complete in 0.000016 seconds : BW = 1.037619 GBytes/Sec
Device 0 :RX3 complete in 0.000016 seconds : BW = 0.993572 GBytes/Sec
Elapsed Time : 0.453000ms
Channel Status : PASS PASS PASS PASS 
Errors for burst size 0x00004000 bytes = 0x00000000
Clearing Rx Data...Done
Device 0 :RX0 complete in 0.000013 seconds : BW = 2.566014 GBytes/Sec
Device 0 :RX1 complete in 0.000019 seconds : BW = 1.768376 GBytes/Sec
Device 0 :RX2 complete in 0.000028 seconds : BW = 1.162810 GBytes/Sec
Device 0 :RX3 complete in 0.000012 seconds : BW = 2.788766 GBytes/Sec
Elapsed Time : 0.468000ms
Channel Status : PASS PASS PASS PASS 
Errors for burst size 0x00008000 bytes = 0x00000000
Clearing Rx Data...Done
Device 0 :RX0 complete in 0.000022 seconds : BW = 2.995247 GBytes/Sec
Device 0 :RX1 complete in 0.000032 seconds : BW = 2.017113 GBytes/Sec
Device 0 :RX2 complete in 0.000021 seconds : BW = 3.119277 GBytes/Sec
Device 0 :RX3 complete in 0.000033 seconds : BW = 1.969823 GBytes/Sec
Elapsed Time : 0.522000ms
Channel Status : PASS PASS PASS PASS 
Errors for burst size 0x00010000 bytes = 0x00000000
Clearing Rx Data...Done
Device 0 :RX0 complete in 0.000036 seconds : BW = 3.625782 GBytes/Sec
Device 0 :RX1 complete in 0.000049 seconds : BW = 2.652205 GBytes/Sec
Device 0 :RX2 complete in 0.000039 seconds : BW = 3.384250 GBytes/Sec
Device 0 :RX3 complete in 0.000040 seconds : BW = 3.294094 GBytes/Sec
Elapsed Time : 0.560000ms
Channel Status : PASS PASS PASS PASS 
Errors for burst size 0x00020000 bytes = 0x00000000
Clearing Rx Data...Done
Device 0 :RX0 complete in 0.000069 seconds : BW = 3.824128 GBytes/Sec
Device 0 :RX1 complete in 0.000060 seconds : BW = 4.348773 GBytes/Sec
Device 0 :RX2 complete in 0.000071 seconds : BW = 3.693209 GBytes/Sec
Device 0 :RX3 complete in 0.000061 seconds : BW = 4.275016 GBytes/Sec
Elapsed Time : 0.675000ms
Channel Status : PASS PASS PASS PASS 
Errors for burst size 0x00040000 bytes = 0x00000000
Clearing Rx Data...Done
Device 0 :RX0 complete in 0.000127 seconds : BW = 4.123057 GBytes/Sec
Device 0 :RX1 complete in 0.000118 seconds : BW = 4.454443 GBytes/Sec
Device 0 :RX2 complete in 0.000132 seconds : BW = 3.964970 GBytes/Sec
Device 0 :RX3 complete in 0.000122 seconds : BW = 4.293220 GBytes/Sec
Elapsed Time : 0.922000ms
Channel Status : PASS PASS PASS PASS 
Errors for burst size 0x00080000 bytes = 0x00000000
Clearing Rx Data...Done
Device 0 :RX0 complete in 0.000245 seconds : BW = 4.276934 GBytes/Sec
Device 0 :RX1 complete in 0.000236 seconds : BW = 4.438605 GBytes/Sec
Device 0 :RX2 complete in 0.000251 seconds : BW = 4.184596 GBytes/Sec
Device 0 :RX3 complete in 0.000240 seconds : BW = 4.361253 GBytes/Sec
Elapsed Time : 1.417000ms
Channel Status : PASS PASS PASS PASS 
Errors for burst size 0x00100000 bytes = 0x00000000
Clearing Rx Data...Done
Device 0 :RX0 complete in 0.000479 seconds : BW = 4.377913 GBytes/Sec
Device 0 :RX1 complete in 0.000471 seconds : BW = 4.453687 GBytes/Sec
Device 0 :RX2 complete in 0.000485 seconds : BW = 4.325273 GBytes/Sec
Device 0 :RX3 complete in 0.000475 seconds : BW = 4.411621 GBytes/Sec
Elapsed Time : 2.641000ms
Channel Status : PASS PASS PASS PASS 
Errors for burst size 0x00200000 bytes = 0x00000000
Clearing Rx Data...Done
Device 0 :RX0 complete in 0.000947 seconds : BW = 4.429371 GBytes/Sec
Device 0 :RX1 complete in 0.000937 seconds : BW = 4.474401 GBytes/Sec
Device 0 :RX2 complete in 0.000951 seconds : BW = 4.409348 GBytes/Sec
Device 0 :RX3 complete in 0.000942 seconds : BW = 4.452978 GBytes/Sec
Elapsed Time : 4.308000ms
Channel Status : PASS PASS PASS PASS 
Errors for burst size 0x00400000 bytes = 0x00000000
Clearing Rx Data...Done
Device 0 :RX0 complete in 0.001885 seconds : BW = 4.450072 GBytes/Sec
Device 0 :RX1 complete in 0.001874 seconds : BW = 4.476957 GBytes/Sec
Device 0 :RX2 complete in 0.001888 seconds : BW = 4.441966 GBytes/Sec
Device 0 :RX3 complete in 0.001877 seconds : BW = 4.468919 GBytes/Sec
Elapsed Time : 7.732000ms
Channel Status : PASS PASS PASS PASS 
Errors for burst size 0x00800000 bytes = 0x00000000
Clearing Rx Data...Done
Device 0 :RX0 complete in 0.003761 seconds : BW = 4.460922 GBytes/Sec
Device 0 :RX1 complete in 0.003772 seconds : BW = 4.447972 GBytes/Sec
Device 0 :RX2 complete in 0.003750 seconds : BW = 4.473375 GBytes/Sec
Device 0 :RX3 complete in 0.003754 seconds : BW = 4.469193 GBytes/Sec
Elapsed Time : 19.978000ms
Channel Status : PASS PASS PASS PASS 
Errors for burst size 0x01000000 bytes = 0x00000000
Clearing Rx Data...Done
Device 0 :RX0 complete in 0.007502 seconds : BW = 4.472558 GBytes/Sec
Device 0 :RX1 complete in 0.007509 seconds : BW = 4.468776 GBytes/Sec
Device 0 :RX2 complete in 0.007497 seconds : BW = 4.475565 GBytes/Sec
Device 0 :RX3 complete in 0.007498 seconds : BW = 4.475052 GBytes/Sec
Elapsed Time : 30.703000ms
Channel Status : PASS PASS PASS PASS 
Errors for burst size 0x02000000 bytes = 0x00000000
Clearing Rx Data...Done
Device 0 :RX0 complete in 0.015016 seconds : BW = 4.469053 GBytes/Sec
Device 0 :RX1 complete in 0.014994 seconds : BW = 4.475720 GBytes/Sec
Device 0 :RX2 complete in 0.015008 seconds : BW = 4.471528 GBytes/Sec
Device 0 :RX3 complete in 0.014985 seconds : BW = 4.478409 GBytes/Sec
Elapsed Time : 62.407000ms
Channel Status : PASS PASS PASS PASS 
Errors for burst size 0x04000000 bytes = 0x00000000
Clearing Rx Data...Done
Device 0 :RX0 complete in 0.029994 seconds : BW = 4.474788 GBytes/Sec
Device 0 :RX1 complete in 0.029971 seconds : BW = 4.478288 GBytes/Sec
Device 0 :RX2 complete in 0.029977 seconds : BW = 4.477354 GBytes/Sec
Device 0 :RX3 complete in 0.029970 seconds : BW = 4.478346 GBytes/Sec
Elapsed Time : 119.826000ms
Channel Status : PASS PASS PASS PASS 
Errors for burst size 0x08000000 bytes = 0x00000000
Clearing Rx Data...Done
Device 0 :RX0 complete in 0.059971 seconds : BW = 4.476071 GBytes/Sec
Device 0 :RX1 complete in 0.059950 seconds : BW = 4.477653 GBytes/Sec
Device 0 :RX2 complete in 0.059926 seconds : BW = 4.479425 GBytes/Sec
Device 0 :RX3 complete in 0.059931 seconds : BW = 4.479057 GBytes/Sec
Elapsed Time : 230.033000ms
Channel Status : PASS PASS PASS PASS 
Errors for burst size 0x10000000 bytes = 0x00000000
Clearing Rx Data...Done
Device 0 :RX0 complete in 0.119881 seconds : BW = 4.478359 GBytes/Sec
Device 0 :RX1 complete in 0.119848 seconds : BW = 4.479604 GBytes/Sec
Device 0 :RX2 complete in 0.119848 seconds : BW = 4.479615 GBytes/Sec
Device 0 :RX3 complete in 0.119847 seconds : BW = 4.479630 GBytes/Sec
Elapsed Time : 456.974000ms
Channel Status : PASS PASS PASS PASS 
Errors for burst size 0x20000000 bytes = 0x00000000
Clearing Rx Data...Done
Device 0 :RX0 complete in 0.239717 seconds : BW = 4.479200 GBytes/Sec
Device 0 :RX1 complete in 0.239697 seconds : BW = 4.479584 GBytes/Sec
Device 0 :RX2 complete in 0.239683 seconds : BW = 4.479839 GBytes/Sec
Device 0 :RX3 complete in 0.239698 seconds : BW = 4.479570 GBytes/Sec
Elapsed Time : 905.470000ms
Channel Status : PASS PASS PASS PASS 
Errors for burst size 0x40000000 bytes = 0x00000000
Test completed with 0 errors
Serial channel test PASSED

The test should end with Serial channel test PASSED.

  • No labels