User:Qfabric/qfabric

=== - fundamental verification of the qfabric control-plane  - FM-Fabric Manager connectivity to the  SNG/RSNG node switches,  Interconnect switches , Fabric Controllers ( Route Reflectors ) and DRE    === root@qfabric&gt; show fabric administration inventory Item                   Identifier              Connection      Configuration Node group NW-NG-0                                      Connected       Configured g1                                           Connected       Configured node1              P1473-C                 Connected g2                                           Connected       Configured node2              P2011-C                 Connected g7                                           Connected       Configured node7              P1461-C                 Connected g8                                           Connected       Configured node8              P2012-C                 Connected service-group                                Connected       Configured node3              P2017-C                 Connected node4              P2019-C                 Connected Interconnect device IC-F3718                                     Connected       Configured F3718/RE0                                  Connected F3718/RE1                                  Connected IC-F3724                                     Connected       Configured F3724/RE0                                  Connected F3724/RE1                                  Connected Fabric manager FM-0                                         Connected       Configured Fabric control FC-0                                         Connected       Configured FC-1                                         Connected       Configured Diagnostic routing engine DRE-0                                        Connected       Configured

root@qfabric&gt;

verify the load-balancing/hashing algorithm efficiency on the 40GIG ( aka FTE ) interfaces
root@qfabric&gt; show interfaces fabric node1:fte-0/1/* detail | match "fte|pps" | except Logi | except "    I" | except "     O"    show interfaces fabric node2:fte-0/1/* detail | match "fte|pps" | except Logi | except "     I" | except "     O"   show interfaces fabric node3:fte-0/1/* detail | match "fte|pps" | except Logi | except "     I" | except "     O"   show interfaces fabric node4:fte-0/1/* detail | match "fte|pps" | except Logi | except "     I" | except "     O"   show interfaces fabric node7:fte-0/1/* detail | match "fte|pps" | except Logi | except "     I" | except "     O"   show interfaces fabric node8:fte-0/1/* detail | match "fte|pps" | except Logi | except "     I" | except "     O"   root@qfabric&gt;

Verify the "load-balancing" of the trafic over the interfaces 40GIG aka FTE via the SSH session on the node
root@g1&gt; show interfaces fte-*/1/* detail | match "fte|pps" | except Logi | except " I " | except " O "

Real time verification of the load distribution done at the node level in the qfabric
root@g1&gt; monitor traffic interface root@g1&gt;

Virtual Marchines state at the directors, CPU utilization of the directors, state of the LAG between the directors and the c-plane switches " :
root@qfabric&gt; show fabric administration inventory director-group status Cluster Status Sat Oct 15 08:42:32 PDT 2011 Member Status Role    Mgmt Address    CPU Free Memory VMs Up Time -- -- --- --- --- --- - dg0    online standby  10.194.93.17    3%  28306508k   2   5 days, 11:18 hrs dg1   online master   10.194.93.18    4%  24718260k   4   5 days, 12:19 hrs

Member Device Id/Alias Status Role -- --- --- - dg0   N/A             online  standby

Cluster Managed Services Shared File System            online Network File System           online Virtual Machine Server        online Load Balancer/DHCP            online

Director Group Processes Cluster Manager               online Resource Group Manager        online Software Mirroring            online Shared File System master     online Secure Shell Daemon           online Network File System           online DHCP Server master            online     standby FTP Server                    online Syslog                        online Distributed Management        online SNMP Trap Forwarder           online SNMP Daemon                   online Platform Management           online

Interface Link Status - Control Plane Bridge           up          Control Plane LAG              up          CP Slave [eth3]                up          CP Slave [eth4]                up          CP Slave [eth5]                up          Crossover LAG                  up          Crossover Slave [eth2]         up          Crossover Slave [eth6]         up

Member Device Id/Alias Status Role -- --- --- - dg1   N/A             online  master

Master Services --- Database Server                online Load Balancer Director        online QFabric Partition Address     online

Cluster Managed Services Shared File System            online Network File System           online Virtual Machine Server        online Load Balancer/DHCP            online

Director Group Processes Cluster Manager               online Resource Group Manager        online Software Mirroring            online Shared File System master     online Secure Shell Daemon           online Network File System           online DHCP Server master            online     master FTP Server                    online Syslog                        online Distributed Management        online SNMP Trap Forwarder           online SNMP Daemon                   online Platform Management           online

Interface Link Status - Control Plane Bridge           up          Control Plane LAG              up          CP Slave [eth3]                up          CP Slave [eth4]                up          CP Slave [eth5]                up          Crossover LAG                  up          Crossover Slave [eth2]         up          Crossover Slave [eth6]         up

root@qfabric&gt;

Qfabric interfaces per node
root@qfabric&gt; show interfaces node2:xe* terse Interface              Admin Link Proto    Local                 Remote node2:xe-0/0/0         up    up  node2:xe-0/0/0.0        up    up   eth-switch node2:xe-0/0/1         up    up  node2:xe-0/0/1.0        up    up   eth-switch node2:xe-0/0/2         up    up  node2:xe-0/0/2.0        up    up   eth-switch node2:xe-0/0/3         up    up  node2:xe-0/0/3.0        up    up   eth-switch node2:xe-0/0/4         up    up  node2:xe-0/0/5          up    up  node2:xe-0/0/6          up    up  node2:xe-0/0/7          up    up  node2:xe-0/0/8          up    down node2:xe-0/0/9         up    down node2:xe-0/0/10        up    down node2:xe-0/0/11        up    down node2:xe-0/0/12        up    down node2:xe-0/0/13        up    down node2:xe-0/0/14        up    down node2:xe-0/0/15        up    down

state of the virtual-machines across the two directors
[root@dg0 ~]# lsvm NODE   ACTIVE  TAG                             UUID dg0    1       _DCF_default___NW-INE-0_RE0_    ed431ee2-f08c-11e0-becd-00e081c57cf8 dg0    1       _DCF_default___RR-INE-1_RE0_    f8782ff0-f08c-11e0-9cb9-00e081c57cf8 dg1    1       _DCF_default___NW-INE-0_RE1_    f02e70b6-f08c-11e0-98f1-00e081c57cf8 dg1    1       _DCF_default___RR-INE-0_RE0_    f4d29d54-f08c-11e0-a4ab-00e081c57cf8 dg1    1       _TAG_DCF_ROOT_                  aef56abe-f08c-11e0-8e64-00e081c57cf8 dg1    1       _TAG_DRE_                       b2ecbbc2-f08c-11e0-a15a-00e081c57cf8 [root@dg0 ~]# [root@dg0 ~]#

Qfabric - registration of the nodes into the local DNS of the qfabric + fundamental verification of the "connexions" between the directors, nodes, IC and the VMs
[root@dg0 ~]# [root@dg0 ~]# ./dns.dump pkg.dcbg.juniper.net. 600    IN      SOA     ns.pkg.dcbg.juniper.net. mail.pkg.dcbg.juniper.net. 125 3600 600 7200 3600 pkg.dcbg.juniper.net. 600    IN      NS      ns.pkg.dcbg.juniper.net. pkg.dcbg.juniper.net. 600    IN      A       169.254.0.1 pkg.dcbg.juniper.net. 600    IN      MX      1 mail.pkg.dcbg.juniper.net. dcfnode---DCF-ROOT.pkg.dcbg.juniper.net. 45 IN A 169.254.192.17 dcfnode---DRE-0.pkg.dcbg.juniper.net. 45 IN A  169.254.3.3 dcfnode-default---FABC-INE-F3718.pkg.dcbg.juniper.net. 45 IN A 169.254.193.5 dcfnode-default---FABC-INE-F3724.pkg.dcbg.juniper.net. 45 IN A 169.254.193.6 dcfnode-default---NW-INE-0.pkg.dcbg.juniper.net. 45 IN A 169.254.192.34 dcfnode-default---RR-INE-0.pkg.dcbg.juniper.net. 45 IN A 169.254.192.35 dcfnode-default---RR-INE-1.pkg.dcbg.juniper.net. 45 IN A 169.254.192.36 dcfnode-default-g1.pkg.dcbg.juniper.net. 45 IN A 169.254.193.12 dcfnode-default-g2.pkg.dcbg.juniper.net. 45 IN A 169.254.193.13 dcfnode-default-g7.pkg.dcbg.juniper.net. 45 IN A 169.254.193.14 dcfnode-default-g8.pkg.dcbg.juniper.net. 45 IN A 169.254.193.15 dcfnode-default-service-group.pkg.dcbg.juniper.net. 45 IN A 169.254.193.11 dcfnode-ed431ee2-f08c-11e0-becd-00e081c57cf8.pkg.dcbg.juniper.net. 45 IN A 169.254.128.5 dcfnode-f02e70b6-f08c-11e0-98f1-00e081c57cf8.pkg.dcbg.juniper.net. 45 IN A 169.254.128.6 dcfnode-F3718-RE0.pkg.dcbg.juniper.net. 45 IN A 169.254.128.17 dcfnode-F3718-RE1.pkg.dcbg.juniper.net. 45 IN A 169.254.128.11 dcfnode-F3724-RE0.pkg.dcbg.juniper.net. 45 IN A 169.254.128.15 dcfnode-F3724-RE1.pkg.dcbg.juniper.net. 45 IN A 169.254.128.12 dcfnode-f4d29d54-f08c-11e0-a4ab-00e081c57cf8.pkg.dcbg.juniper.net. 45 IN A 169.254.128.7 dcfnode-f8782ff0-f08c-11e0-9cb9-00e081c57cf8.pkg.dcbg.juniper.net. 45 IN A 169.254.128.8 dcfnode-P1461-C.pkg.dcbg.juniper.net. 45 IN A  169.254.128.24 dcfnode-P1473-C.pkg.dcbg.juniper.net. 45 IN A  169.254.128.19 dcfnode-P2011-C.pkg.dcbg.juniper.net. 45 IN A  169.254.128.22 dcfnode-P2012-C.pkg.dcbg.juniper.net. 45 IN A  169.254.128.20 dcfnode-P2017-C.pkg.dcbg.juniper.net. 45 IN A  169.254.128.21 dcfnode-P2019-C.pkg.dcbg.juniper.net. 45 IN A  169.254.128.23 mail.pkg.dcbg.juniper.net. 600 IN      A       169.254.0.1 ns.pkg.dcbg.juniper.net. 600   IN      A       169.254.0.1 server.pkg.dcbg.juniper.net. 600 IN    A       169.254.0.1 pkg.dcbg.juniper.net. 600    IN      SOA     ns.pkg.dcbg.juniper.net. mail.pkg.dcbg.juniper.net. 125 3600 600 7200 3600
 * &lt;&lt;&gt;&gt; DiG 9.3.6-P1-RedHat-9.3.6-4.P1.el5 &lt;&lt;&gt;&gt; -t axfr pkg.dcbg.juniper.net @169.254.0.1
 * global options: printcmd
 * Query time: 0 msec
 * SERVER: 169.254.0.1#53(169.254.0.1)
 * WHEN: Mon Oct 10 23:53:35 2011
 * XFR size: 34 records (messages 1)

pkg.dcbg.juniper.net. 600    IN      SOA     ns.pkg.dcbg.juniper.net. mail.pkg.dcbg.juniper.net. 125 3600 600 7200 3600 pkg.dcbg.juniper.net. 600    IN      NS      ns.pkg.dcbg.juniper.net. pkg.dcbg.juniper.net. 600    IN      A       169.254.0.2 pkg.dcbg.juniper.net. 600    IN      MX      1 mail.pkg.dcbg.juniper.net. dcfnode---DCF-ROOT.pkg.dcbg.juniper.net. 45 IN A 169.254.192.17 dcfnode---DRE-0.pkg.dcbg.juniper.net. 45 IN A  169.254.3.3 dcfnode-default---FABC-INE-F3718.pkg.dcbg.juniper.net. 45 IN A 169.254.193.5 dcfnode-default---FABC-INE-F3724.pkg.dcbg.juniper.net. 45 IN A 169.254.193.6 dcfnode-default---NW-INE-0.pkg.dcbg.juniper.net. 45 IN A 169.254.192.34 dcfnode-default---RR-INE-0.pkg.dcbg.juniper.net. 45 IN A 169.254.192.35 dcfnode-default---RR-INE-1.pkg.dcbg.juniper.net. 45 IN A 169.254.192.36 dcfnode-default-g1.pkg.dcbg.juniper.net. 45 IN A 169.254.193.12 dcfnode-default-g2.pkg.dcbg.juniper.net. 45 IN A 169.254.193.13 dcfnode-default-g7.pkg.dcbg.juniper.net. 45 IN A 169.254.193.14 dcfnode-default-g8.pkg.dcbg.juniper.net. 45 IN A 169.254.193.15 dcfnode-default-service-group.pkg.dcbg.juniper.net. 45 IN A 169.254.193.11 dcfnode-ed431ee2-f08c-11e0-becd-00e081c57cf8.pkg.dcbg.juniper.net. 45 IN A 169.254.128.5 dcfnode-f02e70b6-f08c-11e0-98f1-00e081c57cf8.pkg.dcbg.juniper.net. 45 IN A 169.254.128.6 dcfnode-F3718-RE0.pkg.dcbg.juniper.net. 45 IN A 169.254.128.17 dcfnode-F3718-RE1.pkg.dcbg.juniper.net. 45 IN A 169.254.128.11 dcfnode-F3724-RE0.pkg.dcbg.juniper.net. 45 IN A 169.254.128.15 dcfnode-F3724-RE1.pkg.dcbg.juniper.net. 45 IN A 169.254.128.12 dcfnode-f4d29d54-f08c-11e0-a4ab-00e081c57cf8.pkg.dcbg.juniper.net. 45 IN A 169.254.128.7 dcfnode-f8782ff0-f08c-11e0-9cb9-00e081c57cf8.pkg.dcbg.juniper.net. 45 IN A 169.254.128.8 dcfnode-P1461-C.pkg.dcbg.juniper.net. 45 IN A  169.254.128.24 dcfnode-P1473-C.pkg.dcbg.juniper.net. 45 IN A  169.254.128.19 dcfnode-P2011-C.pkg.dcbg.juniper.net. 45 IN A  169.254.128.22 dcfnode-P2012-C.pkg.dcbg.juniper.net. 45 IN A  169.254.128.20 dcfnode-P2017-C.pkg.dcbg.juniper.net. 45 IN A  169.254.128.21 dcfnode-P2019-C.pkg.dcbg.juniper.net. 45 IN A  169.254.128.23 mail.pkg.dcbg.juniper.net. 600 IN      A       169.254.0.2 ns.pkg.dcbg.juniper.net. 600   IN      A       169.254.0.2 server.pkg.dcbg.juniper.net. 600 IN    A       169.254.0.2 pkg.dcbg.juniper.net. 600    IN      SOA     ns.pkg.dcbg.juniper.net. mail.pkg.dcbg.juniper.net. 125 3600 600 7200 3600
 * &lt;&lt;&gt;&gt; DiG 9.3.6-P1-RedHat-9.3.6-4.P1.el5 &lt;&lt;&gt;&gt; -t axfr pkg.dcbg.juniper.net @169.254.0.2
 * global options: printcmd
 * Query time: 3990 msec
 * SERVER: 169.254.0.2#53(169.254.0.2)
 * WHEN: Mon Oct 10 23:53:39 2011
 * XFR size: 34 records (messages 1)

[root@dg0 ~]#

=== Node level - VCCP protocol adjacency towards the VMs ( FM et autres ) ( Juniper L2 IS-IS )- adjacence established via the c-plane dedicated network - verification at the node or a logical component level  ===

This goes at the node level if you ssh onto the node from the director for example show virtual-chassis protocol adjacency provisioning Interface            System         State        Hold (secs) vcp1.32768           5647.0182.0061 Up                  59 vcp1.32768           5647.0185.0066 Up                  58 vcp1.32768           8418.88d1.4628 Up                  59 vcp1.32768           8418.88d0.4ae8 Up                  57 vcp1.32768           0022.8328.c841 Up                  58 vcp1.32768           8418.88d1.64a0 Up                  58 vcp1.32768           8418.88d0.41c4 Up                  59 vcp1.32768           8418.88d0.c11c Up                  58 vcp1.32768           8418.88d1.6cc0 Up                  58 vcp1.32768           8418.88d0.edcc Up                  58 vcp1.32768           0022.8328.c8c9 Up                  59 vcp1.32768           8418.88d1.e088 Up                  58 vcp1.32768           5647.0185.0012 Up                  59 vcp1.32768           5647.0181.0075 Up                  59

VCCP protocol fabric type adjacency towards the interconnects over the 40GIG interfaces - L2-IS-IS like adjacency - verification at the node level
root@g1&gt; show virtual-chassis protocol adjacency fabric Interface            System         State        Hold (secs) fte-0/1/0.32768      0206.0100.000e Up                  29 fte-0/1/1.32768      0206.0100.000f Up                  29 fte-0/1/2.32768      0205.0100.000e Up                  29 fte-0/1/3.32768      0205.0100.000f Up                  29 root@g1&gt;

Qfabric - verification of the node to IC-Interconnects connectivity and front to rear card connectivity of the Interconnects
root@qfabric# run show chassis fabric topology Device ID: P1473-C, Type: qfx3500 Management status: On, Hardware status: Ok Fabric links                                                           State

Fabric: Incoming links: qfxc08-3008_F3724_Front_Card_7_F4_1_1 -&gt; TQ_0_0                        Ok      qfxc08-3008_F3724_Front_Card_7_F4_3_7 -&gt; TQ_0_1                         Ok      qfxc08-3008_F3718_Front_Card_7_F4_1_0 -&gt; TQ_0_2                         Ok      qfxc08-3008_F3718_Front_Card_7_F4_3_7 -&gt; TQ_0_3                         Ok

Fabric: Outgoing links: TQ_0_0                           -&gt; qfxc08-3008_F3724_Front_Card_7_F0_0_1 Ok      TQ_0_1                            -&gt; qfxc08-3008_F3724_Front_Card_7_F0_2_7 Ok      TQ_0_2                            -&gt; qfxc08-3008_F3718_Front_Card_7_F0_0_0 Ok      TQ_0_3                            -&gt; qfxc08-3008_F3718_Front_Card_7_F0_2_7 Ok

Device ID: P2012-C, Type: qfx3500 Management status: On, Hardware status: Ok

Fabric links                                                          State

Fabric: Incoming links: qfxc08-3008_F3724_Front_Card_7_F4_1_5 -&gt; TQ_0_0                        Ok      qfxc08-3008_F3724_Front_Card_7_F4_3_2 -&gt; TQ_0_1                         Ok      qfxc08-3008_F3718_Front_Card_7_F4_1_5 -&gt; TQ_0_2                         Ok      qfxc08-3008_F3718_Front_Card_7_F4_3_2 -&gt; TQ_0_3                         Ok

Fabric: Outgoing links: TQ_0_0                           -&gt; qfxc08-3008_F3724_Front_Card_7_F0_0_5 Ok      TQ_0_1                            -&gt; qfxc08-3008_F3724_Front_Card_7_F0_2_2 Ok      TQ_0_2                            -&gt; qfxc08-3008_F3718_Front_Card_7_F0_0_5 Ok      TQ_0_3                            -&gt; qfxc08-3008_F3718_Front_Card_7_F0_2_2 Ok

Device ID: P2017-C, Type: qfx3500 Management status: On, Hardware status: Ok

Fabric links                                                          State

Fabric: Incoming links: qfxc08-3008_F3724_Front_Card_7_F4_1_2 -&gt; TQ_0_0                        Ok      qfxc08-3008_F3724_Front_Card_7_F4_3_5 -&gt; TQ_0_1                         Ok      qfxc08-3008_F3718_Front_Card_7_F4_1_2 -&gt; TQ_0_2                         Ok      qfxc08-3008_F3718_Front_Card_7_F4_3_5 -&gt; TQ_0_3                         Ok

Fabric: Outgoing links: TQ_0_0                           -&gt; qfxc08-3008_F3724_Front_Card_7_F0_0_2 Ok      TQ_0_1                            -&gt; qfxc08-3008_F3724_Front_Card_7_F0_2_5 Ok      TQ_0_2                            -&gt; qfxc08-3008_F3718_Front_Card_7_F0_0_2 Ok      TQ_0_3                            -&gt; qfxc08-3008_F3718_Front_Card_7_F0_2_5 Ok

Device ID: P2011-C, Type: qfx3500 Management status: On, Hardware status: Ok

Fabric links                                                          State

Fabric: Incoming links: qfxc08-3008_F3724_Front_Card_7_F4_1_0 -&gt; TQ_0_0                        Ok      qfxc08-3008_F3724_Front_Card_7_F4_3_6 -&gt; TQ_0_1                         Ok      qfxc08-3008_F3718_Front_Card_7_F4_1_1 -&gt; TQ_0_2                         Ok      qfxc08-3008_F3718_Front_Card_7_F4_3_6 -&gt; TQ_0_3                         Ok

Fabric: Outgoing links: TQ_0_0                           -&gt; qfxc08-3008_F3724_Front_Card_7_F0_0_0 Ok      TQ_0_1                            -&gt; qfxc08-3008_F3724_Front_Card_7_F0_2_6 Ok      TQ_0_2                            -&gt; qfxc08-3008_F3718_Front_Card_7_F0_0_1 Ok      TQ_0_3                            -&gt; qfxc08-3008_F3718_Front_Card_7_F0_2_6 Ok

Device ID: P2019-C, Type: qfx3500 Management status: On, Hardware status: Ok

Fabric links                                                          State

Fabric: Incoming links: qfxc08-3008_F3724_Front_Card_7_F4_1_3 -&gt; TQ_0_0                        Ok      qfxc08-3008_F3724_Front_Card_7_F4_3_4 -&gt; TQ_0_1                         Ok      qfxc08-3008_F3718_Front_Card_7_F4_1_3 -&gt; TQ_0_2                         Ok      qfxc08-3008_F3718_Front_Card_7_F4_3_4 -&gt; TQ_0_3                         Ok

Fabric: Outgoing links: TQ_0_0                           -&gt; qfxc08-3008_F3724_Front_Card_7_F0_0_3 Ok      TQ_0_1                            -&gt; qfxc08-3008_F3724_Front_Card_7_F0_2_4 Ok      TQ_0_2                            -&gt; qfxc08-3008_F3718_Front_Card_7_F0_0_3 Ok      TQ_0_3                            -&gt; qfxc08-3008_F3718_Front_Card_7_F0_2_4 Ok

Device ID: P1461-C, Type: qfx3500 Management status: On, Hardware status: Ok

Fabric links                                                          State

Fabric: Incoming links: qfxc08-3008_F3724_Front_Card_7_F4_1_4 -&gt; TQ_0_0                        Ok      qfxc08-3008_F3724_Front_Card_7_F4_3_3 -&gt; TQ_0_1                         Ok      qfxc08-3008_F3718_Front_Card_7_F4_1_4 -&gt; TQ_0_2                         Ok      qfxc08-3008_F3718_Front_Card_7_F4_3_3 -&gt; TQ_0_3                         Ok

Fabric: Outgoing links: TQ_0_0                           -&gt; qfxc08-3008_F3724_Front_Card_7_F0_0_4 Ok      TQ_0_1                            -&gt; qfxc08-3008_F3724_Front_Card_7_F0_2_3 Ok      TQ_0_2                            -&gt; qfxc08-3008_F3718_Front_Card_7_F0_0_4 Ok      TQ_0_3                            -&gt; qfxc08-3008_F3718_Front_Card_7_F0_2_3 Ok

Device ID: F3718, Type: qfxc08-3008 Management status: On, Hardware status: Ok

Fabric links                                                          State

Front Card 7   : Incoming links: qfx3500_P1473-C_TQ_0_2           -&gt; Front_Card_7_F0_0_0                Ok      qfx3500_P2011-C_TQ_0_2            -&gt; Front_Card_7_F0_0_1                Ok      qfx3500_P2017-C_TQ_0_2            -&gt; Front_Card_7_F0_0_2                Ok      qfx3500_P2019-C_TQ_0_2            -&gt; Front_Card_7_F0_0_3                Ok      qfx3500_P1461-C_TQ_0_2            -&gt; Front_Card_7_F0_0_4                Ok      qfx3500_P2012-C_TQ_0_2            -&gt; Front_Card_7_F0_0_5                Ok      Rear_Card_0_F2_0_14               -&gt; Front_Card_7_F4_1_0                Ok      Rear_Card_1_F2_0_14               -&gt; Front_Card_7_F4_1_1                Ok      Rear_Card_2_F2_0_14               -&gt; Front_Card_7_F4_1_2                Ok      Rear_Card_3_F2_0_14               -&gt; Front_Card_7_F4_1_3                Ok      Rear_Card_4_F2_0_14               -&gt; Front_Card_7_F4_1_4                Ok      Rear_Card_5_F2_0_14               -&gt; Front_Card_7_F4_1_5                Ok      Rear_Card_6_F2_0_14               -&gt; Front_Card_7_F4_1_6                Ok      Rear_Card_7_F2_0_14               -&gt; Front_Card_7_F4_1_7                Ok      qfx3500_P2012-C_TQ_0_3            -&gt; Front_Card_7_F0_2_2                Ok      qfx3500_P1461-C_TQ_0_3            -&gt; Front_Card_7_F0_2_3                Ok      qfx3500_P2019-C_TQ_0_3            -&gt; Front_Card_7_F0_2_4                Ok      qfx3500_P2017-C_TQ_0_3            -&gt; Front_Card_7_F0_2_5                Ok      qfx3500_P2011-C_TQ_0_3            -&gt; Front_Card_7_F0_2_6                Ok      qfx3500_P1473-C_TQ_0_3            -&gt; Front_Card_7_F0_2_7                Ok      Rear_Card_0_F2_0_15               -&gt; Front_Card_7_F4_3_0                Ok      Rear_Card_1_F2_0_15               -&gt; Front_Card_7_F4_3_1                Ok      Rear_Card_2_F2_0_15               -&gt; Front_Card_7_F4_3_2                Ok      Rear_Card_3_F2_0_15               -&gt; Front_Card_7_F4_3_3                Ok      Rear_Card_4_F2_0_15               -&gt; Front_Card_7_F4_3_4                Ok      Rear_Card_5_F2_0_15               -&gt; Front_Card_7_F4_3_5                Ok      Rear_Card_6_F2_0_15               -&gt; Front_Card_7_F4_3_6                Ok      Rear_Card_7_F2_0_15               -&gt; Front_Card_7_F4_3_7                Ok

Front Card 7   : Outgoing links: Front_Card_7_F0_0_0              -&gt; Rear_Card_0_F2_0_14                Ok      Front_Card_7_F0_0_1               -&gt; Rear_Card_1_F2_0_14                Ok      Front_Card_7_F0_0_2               -&gt; Rear_Card_2_F2_0_14                Ok      Front_Card_7_F0_0_3               -&gt; Rear_Card_3_F2_0_14                Ok      Front_Card_7_F0_0_4               -&gt; Rear_Card_4_F2_0_14                Ok      Front_Card_7_F0_0_5               -&gt; Rear_Card_5_F2_0_14                Ok      Front_Card_7_F0_0_6               -&gt; Rear_Card_6_F2_0_14                Ok      Front_Card_7_F0_0_7               -&gt; Rear_Card_7_F2_0_14                Ok      Front_Card_7_F4_1_0               -&gt; qfx3500_P1473-C_TQ_0_2             Ok      Front_Card_7_F4_1_1               -&gt; qfx3500_P2011-C_TQ_0_2             Ok      Front_Card_7_F4_1_2               -&gt; qfx3500_P2017-C_TQ_0_2             Ok      Front_Card_7_F4_1_3               -&gt; qfx3500_P2019-C_TQ_0_2             Ok      Front_Card_7_F4_1_4               -&gt; qfx3500_P1461-C_TQ_0_2             Ok      Front_Card_7_F4_1_5               -&gt; qfx3500_P2012-C_TQ_0_2             Ok      Front_Card_7_F0_2_0               -&gt; Rear_Card_0_F2_0_15                Ok      Front_Card_7_F0_2_1               -&gt; Rear_Card_1_F2_0_15                Ok      Front_Card_7_F0_2_2               -&gt; Rear_Card_2_F2_0_15                Ok      Front_Card_7_F0_2_3               -&gt; Rear_Card_3_F2_0_15                Ok      Front_Card_7_F0_2_4               -&gt; Rear_Card_4_F2_0_15                Ok      Front_Card_7_F0_2_5               -&gt; Rear_Card_5_F2_0_15                Ok      Front_Card_7_F0_2_6               -&gt; Rear_Card_6_F2_0_15                Ok      Front_Card_7_F0_2_7               -&gt; Rear_Card_7_F2_0_15                Ok      Front_Card_7_F4_3_2               -&gt; qfx3500_P2012-C_TQ_0_3             Ok      Front_Card_7_F4_3_3               -&gt; qfx3500_P1461-C_TQ_0_3             Ok      Front_Card_7_F4_3_4               -&gt; qfx3500_P2019-C_TQ_0_3             Ok      Front_Card_7_F4_3_5               -&gt; qfx3500_P2017-C_TQ_0_3             Ok      Front_Card_7_F4_3_6               -&gt; qfx3500_P2011-C_TQ_0_3             Ok      Front_Card_7_F4_3_7               -&gt; qfx3500_P1473-C_TQ_0_3             Ok

Rear  Card 0   : Incoming links: Front_Card_7_F0_0_0              -&gt; Rear_Card_0_F2_0_14                Ok      Front_Card_7_F0_2_0               -&gt; Rear_Card_0_F2_0_15                Ok

Rear  Card 0   : Outgoing links: Rear_Card_0_F2_0_14              -&gt; Front_Card_7_F4_1_0                Ok      Rear_Card_0_F2_0_15               -&gt; Front_Card_7_F4_3_0                Ok

Rear  Card 1   : Incoming links: Front_Card_7_F0_0_1              -&gt; Rear_Card_1_F2_0_14                Ok      Front_Card_7_F0_2_1               -&gt; Rear_Card_1_F2_0_15                Ok

Rear  Card 1   : Outgoing links: Rear_Card_1_F2_0_14              -&gt; Front_Card_7_F4_1_1                Ok      Rear_Card_1_F2_0_15               -&gt; Front_Card_7_F4_3_1                Ok

Rear  Card 2   : Incoming links: Front_Card_7_F0_0_2              -&gt; Rear_Card_2_F2_0_14                Ok      Front_Card_7_F0_2_2               -&gt; Rear_Card_2_F2_0_15                Ok

Rear  Card 2   : Outgoing links: Rear_Card_2_F2_0_14              -&gt; Front_Card_7_F4_1_2                Ok      Rear_Card_2_F2_0_15               -&gt; Front_Card_7_F4_3_2                Ok

Rear  Card 3   : Incoming links: Front_Card_7_F0_0_3              -&gt; Rear_Card_3_F2_0_14                Ok      Front_Card_7_F0_2_3               -&gt; Rear_Card_3_F2_0_15                Ok

Rear  Card 3   : Outgoing links: Rear_Card_3_F2_0_14              -&gt; Front_Card_7_F4_1_3                Ok      Rear_Card_3_F2_0_15               -&gt; Front_Card_7_F4_3_3                Ok

Rear  Card 4   : Incoming links: Front_Card_7_F0_0_4              -&gt; Rear_Card_4_F2_0_14                Ok      Front_Card_7_F0_2_4               -&gt; Rear_Card_4_F2_0_15                Ok

Rear  Card 4   : Outgoing links: Rear_Card_4_F2_0_14              -&gt; Front_Card_7_F4_1_4                Ok      Rear_Card_4_F2_0_15               -&gt; Front_Card_7_F4_3_4                Ok

Rear  Card 5   : Incoming links: Front_Card_7_F0_0_5              -&gt; Rear_Card_5_F2_0_14                Ok      Front_Card_7_F0_2_5               -&gt; Rear_Card_5_F2_0_15                Ok

Rear  Card 5   : Outgoing links: Rear_Card_5_F2_0_14              -&gt; Front_Card_7_F4_1_5                Ok      Rear_Card_5_F2_0_15               -&gt; Front_Card_7_F4_3_5                Ok

Rear  Card 6   : Incoming links: Front_Card_7_F0_0_6              -&gt; Rear_Card_6_F2_0_14                Ok      Front_Card_7_F0_2_6               -&gt; Rear_Card_6_F2_0_15                Ok

Rear  Card 6   : Outgoing links: Rear_Card_6_F2_0_14              -&gt; Front_Card_7_F4_1_6                Ok      Rear_Card_6_F2_0_15               -&gt; Front_Card_7_F4_3_6                Ok

Rear  Card 7   : Incoming links: Front_Card_7_F0_0_7              -&gt; Rear_Card_7_F2_0_14                Ok      Front_Card_7_F0_2_7               -&gt; Rear_Card_7_F2_0_15                Ok

Rear  Card 7   : Outgoing links: Rear_Card_7_F2_0_14              -&gt; Front_Card_7_F4_1_7                Ok      Rear_Card_7_F2_0_15               -&gt; Front_Card_7_F4_3_7                Ok

Device ID: F3724, Type: qfxc08-3008 Management status: On, Hardware status: Ok

Fabric links                                                          State

Front Card 7   : Incoming links: qfx3500_P2011-C_TQ_0_0           -&gt; Front_Card_7_F0_0_0                Ok      qfx3500_P1473-C_TQ_0_0            -&gt; Front_Card_7_F0_0_1                Ok      qfx3500_P2017-C_TQ_0_0            -&gt; Front_Card_7_F0_0_2                Ok      qfx3500_P2019-C_TQ_0_0            -&gt; Front_Card_7_F0_0_3                Ok      qfx3500_P1461-C_TQ_0_0            -&gt; Front_Card_7_F0_0_4                Ok      qfx3500_P2012-C_TQ_0_0            -&gt; Front_Card_7_F0_0_5                Ok      Rear_Card_0_F2_0_14               -&gt; Front_Card_7_F4_1_0                Ok      Rear_Card_1_F2_0_14               -&gt; Front_Card_7_F4_1_1                Ok      Rear_Card_2_F2_0_14               -&gt; Front_Card_7_F4_1_2                Ok      Rear_Card_3_F2_0_14               -&gt; Front_Card_7_F4_1_3                Ok      Rear_Card_4_F2_0_14               -&gt; Front_Card_7_F4_1_4                Ok      Rear_Card_5_F2_0_14               -&gt; Front_Card_7_F4_1_5                Ok      Rear_Card_6_F2_0_14               -&gt; Front_Card_7_F4_1_6                Ok      Rear_Card_7_F2_0_14               -&gt; Front_Card_7_F4_1_7                Ok      qfx3500_P2012-C_TQ_0_1            -&gt; Front_Card_7_F0_2_2                Ok      qfx3500_P1461-C_TQ_0_1            -&gt; Front_Card_7_F0_2_3                Ok      qfx3500_P2019-C_TQ_0_1            -&gt; Front_Card_7_F0_2_4                Ok      qfx3500_P2017-C_TQ_0_1            -&gt; Front_Card_7_F0_2_5                Ok      qfx3500_P2011-C_TQ_0_1            -&gt; Front_Card_7_F0_2_6                Ok      qfx3500_P1473-C_TQ_0_1            -&gt; Front_Card_7_F0_2_7                Ok      Rear_Card_0_F2_0_15               -&gt; Front_Card_7_F4_3_0                Ok      Rear_Card_1_F2_0_15               -&gt; Front_Card_7_F4_3_1                Ok      Rear_Card_2_F2_0_15               -&gt; Front_Card_7_F4_3_2                Ok      Rear_Card_3_F2_0_15               -&gt; Front_Card_7_F4_3_3                Ok      Rear_Card_4_F2_0_15               -&gt; Front_Card_7_F4_3_4                Ok      Rear_Card_5_F2_0_15               -&gt; Front_Card_7_F4_3_5                Ok      Rear_Card_6_F2_0_15               -&gt; Front_Card_7_F4_3_6                Ok      Rear_Card_7_F2_0_15               -&gt; Front_Card_7_F4_3_7                Ok

Front Card 7   : Outgoing links: Front_Card_7_F0_0_0              -&gt; Rear_Card_0_F2_0_14                Ok      Front_Card_7_F0_0_1               -&gt; Rear_Card_1_F2_0_14                Ok      Front_Card_7_F0_0_2               -&gt; Rear_Card_2_F2_0_14                Ok      Front_Card_7_F0_0_3               -&gt; Rear_Card_3_F2_0_14                Ok      Front_Card_7_F0_0_4               -&gt; Rear_Card_4_F2_0_14                Ok      Front_Card_7_F0_0_5               -&gt; Rear_Card_5_F2_0_14                Ok      Front_Card_7_F0_0_6               -&gt; Rear_Card_6_F2_0_14                Ok      Front_Card_7_F0_0_7               -&gt; Rear_Card_7_F2_0_14                Ok      Front_Card_7_F4_1_0               -&gt; qfx3500_P2011-C_TQ_0_0             Ok      Front_Card_7_F4_1_1               -&gt; qfx3500_P1473-C_TQ_0_0             Ok      Front_Card_7_F4_1_2               -&gt; qfx3500_P2017-C_TQ_0_0             Ok      Front_Card_7_F4_1_3               -&gt; qfx3500_P2019-C_TQ_0_0             Ok      Front_Card_7_F4_1_4               -&gt; qfx3500_P1461-C_TQ_0_0             Ok      Front_Card_7_F4_1_5               -&gt; qfx3500_P2012-C_TQ_0_0             Ok      Front_Card_7_F0_2_0               -&gt; Rear_Card_0_F2_0_15                Ok      Front_Card_7_F0_2_1               -&gt; Rear_Card_1_F2_0_15                Ok      Front_Card_7_F0_2_2               -&gt; Rear_Card_2_F2_0_15                Ok      Front_Card_7_F0_2_3               -&gt; Rear_Card_3_F2_0_15                Ok      Front_Card_7_F0_2_4               -&gt; Rear_Card_4_F2_0_15                Ok      Front_Card_7_F0_2_5               -&gt; Rear_Card_5_F2_0_15                Ok      Front_Card_7_F0_2_6               -&gt; Rear_Card_6_F2_0_15                Ok      Front_Card_7_F0_2_7               -&gt; Rear_Card_7_F2_0_15                Ok      Front_Card_7_F4_3_2               -&gt; qfx3500_P2012-C_TQ_0_1             Ok      Front_Card_7_F4_3_3               -&gt; qfx3500_P1461-C_TQ_0_1             Ok      Front_Card_7_F4_3_4               -&gt; qfx3500_P2019-C_TQ_0_1             Ok      Front_Card_7_F4_3_5               -&gt; qfx3500_P2017-C_TQ_0_1             Ok      Front_Card_7_F4_3_6               -&gt; qfx3500_P2011-C_TQ_0_1             Ok      Front_Card_7_F4_3_7               -&gt; qfx3500_P1473-C_TQ_0_1             Ok

Rear  Card 0   : Incoming links: Front_Card_7_F0_0_0              -&gt; Rear_Card_0_F2_0_14                Ok      Front_Card_7_F0_2_0               -&gt; Rear_Card_0_F2_0_15                Ok

Rear  Card 0   : Outgoing links: Rear_Card_0_F2_0_14              -&gt; Front_Card_7_F4_1_0                Ok      Rear_Card_0_F2_0_15               -&gt; Front_Card_7_F4_3_0                Ok

Rear  Card 1   : Incoming links: Front_Card_7_F0_0_1              -&gt; Rear_Card_1_F2_0_14                Ok      Front_Card_7_F0_2_1               -&gt; Rear_Card_1_F2_0_15                Ok

Rear  Card 1   : Outgoing links: Rear_Card_1_F2_0_14              -&gt; Front_Card_7_F4_1_1                Ok      Rear_Card_1_F2_0_15               -&gt; Front_Card_7_F4_3_1                Ok

Rear  Card 2   : Incoming links: Front_Card_7_F0_0_2              -&gt; Rear_Card_2_F2_0_14                Ok      Front_Card_7_F0_2_2               -&gt; Rear_Card_2_F2_0_15                Ok

Rear  Card 2   : Outgoing links: Rear_Card_2_F2_0_14              -&gt; Front_Card_7_F4_1_2                Ok      Rear_Card_2_F2_0_15               -&gt; Front_Card_7_F4_3_2                Ok

Rear  Card 3   : Incoming links: Front_Card_7_F0_0_3              -&gt; Rear_Card_3_F2_0_14                Ok      Front_Card_7_F0_2_3               -&gt; Rear_Card_3_F2_0_15                Ok

Rear  Card 3   : Outgoing links: Rear_Card_3_F2_0_14              -&gt; Front_Card_7_F4_1_3                Ok      Rear_Card_3_F2_0_15               -&gt; Front_Card_7_F4_3_3                Ok

Rear  Card 4   : Incoming links: Front_Card_7_F0_0_4              -&gt; Rear_Card_4_F2_0_14                Ok      Front_Card_7_F0_2_4               -&gt; Rear_Card_4_F2_0_15                Ok

Rear  Card 4   : Outgoing links: Rear_Card_4_F2_0_14              -&gt; Front_Card_7_F4_1_4                Ok      Rear_Card_4_F2_0_15               -&gt; Front_Card_7_F4_3_4                Ok

Rear  Card 5   : Incoming links: Front_Card_7_F0_0_5              -&gt; Rear_Card_5_F2_0_14                Ok      Front_Card_7_F0_2_5               -&gt; Rear_Card_5_F2_0_15                Ok

Rear  Card 5   : Outgoing links: Rear_Card_5_F2_0_14              -&gt; Front_Card_7_F4_1_5                Ok      Rear_Card_5_F2_0_15               -&gt; Front_Card_7_F4_3_5                Ok

Rear  Card 6   : Incoming links: Front_Card_7_F0_0_6              -&gt; Rear_Card_6_F2_0_14                Ok      Front_Card_7_F0_2_6               -&gt; Rear_Card_6_F2_0_15                Ok

Rear  Card 6   : Outgoing links: Rear_Card_6_F2_0_14              -&gt; Front_Card_7_F4_1_6                Ok      Rear_Card_6_F2_0_15               -&gt; Front_Card_7_F4_3_6                Ok

Rear  Card 7   : Incoming links: Front_Card_7_F0_0_7              -&gt; Rear_Card_7_F2_0_14                Ok      Front_Card_7_F0_2_7               -&gt; Rear_Card_7_F2_0_15                Ok

Rear  Card 7   : Outgoing links: Rear_Card_7_F2_0_14              -&gt; Front_Card_7_F4_1_7                Ok      Rear_Card_7_F2_0_15               -&gt; Front_Card_7_F4_3_7                Ok

[edit]

Qfabric -hardware verification
root@qfabric&gt; show chassis hardware IC-F3718: -- Hardware inventory: Item            Version  Part number  Serial number     Description Chassis         REV 10                F3718             QFXC08-3008 Midplane        REV 10   750-035835   F3718-C           QFX Midplane CB 0            REV 14   750-035855   ZJ9408            QFX Chassis Control Board Routing Engine 0       BUILTIN      BUILTIN           QFX Routing Engine CB 1            REV 14   750-035855   ZJ9464            QFX Chassis Control Board Routing Engine 1       BUILTIN      BUILTIN           QFX Routing Engine FPM Board       REV 06   711-026591   ZJ9381            QFX Front Panel Module FC 7 FPC 7      REV 09   750-035853   ZL2547            QFX 16-port QSFP+ Front Card PIC 0                  BUILTIN      BUILTIN           16x 40G-QSFP+ Xcvr 0      REV 01   740-032986   QA500265          QSFP+-40G-SR4 Xcvr 1      REV 01   740-032986   QA500268          QSFP+-40G-SR4 Xcvr 2      REV 01   740-032986   QA520132          QSFP+-40G-SR4 Xcvr 3      REV 01   740-032986   QA520128          QSFP+-40G-SR4 Xcvr 4      REV 01   740-032986   QA500289          QSFP+-40G-SR4 Xcvr 5      REV 01   740-032986   QA500261          QSFP+-40G-SR4 Xcvr 6      REV 01   740-032986   QA500256          QSFP+-40G-SR4 Xcvr 7      REV 01   740-032986   QA520129          QSFP+-40G-SR4 Xcvr 8      REV 01   740-032986   QA500276          QSFP+-40G-SR4 Xcvr 10     REV 01   740-032986   QA510593          QSFP+-40G-SR4 PIC 1                  BUILTIN      BUILTIN           16x Fabric Internal Ports RC 0 FPC 8      REV 10   750-035854   ZK1616            QFX Fabric Rear Card PIC 0                  BUILTIN      BUILTIN           16x Fabric Internal Ports RC 1 FPC 9      REV 10   750-035854   ZK1572            QFX Fabric Rear Card PIC 0                  BUILTIN      BUILTIN           16x Fabric Internal Ports RC 2 FPC 10     REV 10   750-035854   ZK1447            QFX Fabric Rear Card PIC 0                  BUILTIN      BUILTIN           16x Fabric Internal Ports RC 3 FPC 11     REV 10   750-035854   ZK1345            QFX Fabric Rear Card PIC 0                  BUILTIN      BUILTIN           16x Fabric Internal Ports RC 4 FPC 12     REV 10   750-035854   ZK1400            QFX Fabric Rear Card PIC 0                  BUILTIN      BUILTIN           16x Fabric Internal Ports RC 5 FPC 13     REV 10   750-035854   ZK1401            QFX Fabric Rear Card PIC 0                  BUILTIN      BUILTIN           16x Fabric Internal Ports RC 6 FPC 14     REV 10   750-035854   ZK1342            QFX Fabric Rear Card PIC 0                  BUILTIN      BUILTIN           16x Fabric Internal Ports RC 7 FPC 15     REV 10   750-035854   ZK1489            QFX Fabric Rear Card PIC 0                  BUILTIN      BUILTIN           16x Fabric Internal Ports PEM 0           REV 01   740-029343   QCS1120P07A       QFX PS 4000W; 200-240V AC in PEM 1            REV 01   740-029343   QCS1120P031       QFX PS 4000W; 200-240V AC in PEM 2            REV 01   740-029343   QCS1120P098       QFX PS 4000W; 200-240V AC in PEM 3            REV 01   740-029343   QCS1120P09L       QFX PS 4000W; 200-240V AC in PEM 4            REV 01   740-029343   QCS1123P02W       QFX PS 4000W; 200-240V AC in PEM 5            REV 01   740-029343   QCS1123P00Y       QFX PS 4000W; 200-240V AC in Wiring Tray 0    REV 01   740-032189   QCS11260100M      QFX AC Wiring Tray C19 Wiring Tray 1   REV 01   740-032189   QCS112601018      QFX AC Wiring Tray C19 Top Fan Tray 0  REV 04   750-035836   ZK2256            QFX Top Fan Tray Btm Fan Tray 1  REV 12   750-035837   ZJ9242            QFX Bottom Fan Tray Side Fan Tray 0 REV 04   750-035838   ZK2530            QFX Side Fan Tray Side Fan Tray 1 REV 04   750-035838   ZK2537            QFX Side Fan Tray Side Fan Tray 2 REV 04   750-035838   ZK2473            QFX Side Fan Tray Side Fan Tray 3 REV 04   750-035838   ZK2536            QFX Side Fan Tray Side Fan Tray 4 REV 04   750-035838   ZK2651            QFX Side Fan Tray Side Fan Tray 5 REV 04   750-035838   ZK2414            QFX Side Fan Tray Side Fan Tray 6 REV 04   750-035838   ZK2452            QFX Side Fan Tray Side Fan Tray 7 REV 04   750-035838   ZK2447            QFX Side Fan Tray IC-F3724: -- Hardware inventory: Item            Version  Part number  Serial number     Description Chassis         REV 10                F3724             QFXC08-3008 Midplane        REV 10   750-035835   F3724-C           QFX Midplane CB 0            REV 14   750-035855   ZJ9449            QFX Chassis Control Board Routing Engine 0       BUILTIN      BUILTIN           QFX Routing Engine CB 1            REV 14   750-035855   ZJ9436            QFX Chassis Control Board Routing Engine 1       BUILTIN      BUILTIN           QFX Routing Engine FPM Board       REV 06   711-026591   ZJ9368            QFX Front Panel Module FC 7 FPC 7      REV 07   750-035853   ZJ9337            QFX 16-port QSFP+ Front Card PIC 0                  BUILTIN      BUILTIN           16x 40G-QSFP+ Xcvr 0      REV 01   740-032986   QA500266          QSFP+-40G-SR4 Xcvr 1      REV 01   740-032986   QA500274          QSFP+-40G-SR4 Xcvr 2      REV 01   740-032986   QA520125          QSFP+-40G-SR4 Xcvr 3      REV 01   740-032986   QA500258          QSFP+-40G-SR4 Xcvr 4      REV 01   740-032986   QA520124          QSFP+-40G-SR4 Xcvr 5      REV 01   740-032986   QA500285          QSFP+-40G-SR4 Xcvr 6      REV 01   740-032986   QA520133          QSFP+-40G-SR4 Xcvr 7      REV 01   740-032986   QA500291          QSFP+-40G-SR4 Xcvr 8      REV 01   740-032986   QA500287          QSFP+-40G-SR4 Xcvr 10     REV 01   740-032986   QA500290          QSFP+-40G-SR4 PIC 1                  BUILTIN      BUILTIN           16x Fabric Internal Ports RC 0 FPC 8      REV 10   750-035854   ZK1253            QFX Fabric Rear Card PIC 0                  BUILTIN      BUILTIN           16x Fabric Internal Ports RC 1 FPC 9      REV 10   750-035854   ZK1478            QFX Fabric Rear Card PIC 0                  BUILTIN      BUILTIN           16x Fabric Internal Ports RC 2 FPC 10     REV 10   750-035854   ZK1237            QFX Fabric Rear Card PIC 0                  BUILTIN      BUILTIN           16x Fabric Internal Ports RC 3 FPC 11     REV 10   750-035854   ZK1548            QFX Fabric Rear Card PIC 0                  BUILTIN      BUILTIN           16x Fabric Internal Ports RC 4 FPC 12     REV 10   750-035854   ZK1289            QFX Fabric Rear Card PIC 0                  BUILTIN      BUILTIN           16x Fabric Internal Ports RC 5 FPC 13     REV 10   750-035854   ZK1413            QFX Fabric Rear Card PIC 0                  BUILTIN      BUILTIN           16x Fabric Internal Ports RC 6 FPC 14     REV 10   750-035854   ZK1515            QFX Fabric Rear Card PIC 0                  BUILTIN      BUILTIN           16x Fabric Internal Ports RC 7 FPC 15     REV 10   750-035854   ZK1513            QFX Fabric Rear Card PIC 0                  BUILTIN      BUILTIN           16x Fabric Internal Ports PEM 0           REV 01   740-029343   QCS1123P01J       QFX PS 4000W; 200-240V AC in PEM 1            REV 01   740-029343   QCS1123P02F       QFX PS 4000W; 200-240V AC in PEM 2            REV 01   740-029343   QCS1120P05M       QFX PS 4000W; 200-240V AC in PEM 3            REV 01   740-029343   QCS1123P01K       QFX PS 4000W; 200-240V AC in PEM 4            REV 01   740-029343   QCS1120P09A       QFX PS 4000W; 200-240V AC in PEM 5            REV 01   740-029343   QCS1123P039       QFX PS 4000W; 200-240V AC in Wiring Tray 0    REV 01   740-032189   QCS112601010      QFX AC Wiring Tray C19 Wiring Tray 1   REV 01   740-032189   QCS11260101D      QFX AC Wiring Tray C19 Top Fan Tray 0  REV 04   750-035836   ZK2237            QFX Top Fan Tray Btm Fan Tray 1  REV 12   750-035837   ZJ9267            QFX Bottom Fan Tray Side Fan Tray 0 REV 04   750-035838   ZK2387            QFX Side Fan Tray Side Fan Tray 1 REV 04   750-035838   ZK2557            QFX Side Fan Tray Side Fan Tray 2 REV 04   750-035838   ZK2635            QFX Side Fan Tray Side Fan Tray 3 REV 04   750-035838   ZK2512            QFX Side Fan Tray Side Fan Tray 4 REV 04   750-035838   ZK2653            QFX Side Fan Tray Side Fan Tray 5 REV 04   750-035838   ZK2397            QFX Side Fan Tray Side Fan Tray 6 REV 04   750-035838   ZK2442            QFX Side Fan Tray Side Fan Tray 7 REV 04   750-035838   ZK2618            QFX Side Fan Tray

service-group: -- Hardware inventory: Item            Version  Part number  Serial number     Description Chassis                               P2017             Virtual Chassis Routing Engine 0         BUILTIN      BUILTIN           QFX Routing Engine Routing Engine 1         BUILTIN      BUILTIN           QFX Routing Engine node3           REV 15   750-036931   P2017-C           QFX 48x10G 4x40G Switch CPU                    BUILTIN      BUILTIN           FPC CPU PIC 0                  BUILTIN      BUILTIN           48x 10G-SFP+ Xcvr 0      REV 01   740-021308   13T511100411      SFP+-10G-SR Xcvr 1      REV 01   740-021308   13T511100473      SFP+-10G-SR Xcvr 2      REV 01   740-021308   13T511100379      SFP+-10G-SR Xcvr 3      REV 01   740-021308   13T511100374      SFP+-10G-SR Xcvr 4      REV 01   740-021308   13T511100366      SFP+-10G-SR Xcvr 5      REV 01   740-021308   13T511100417      SFP+-10G-SR Xcvr 40     REV 01   740-021308   13T511100389      SFP+-10G-SR Xcvr 41     REV 01   740-021308   13T511100390      SFP+-10G-SR Xcvr 42     REV 01   740-021308   13T511100386      SFP+-10G-SR Xcvr 43     REV 01   740-021308   13T511100674      SFP+-10G-SR Xcvr 44     REV 01   740-021308   13T511100883      SFP+-10G-SR Xcvr 45     REV 01   740-021308   13T511100378      SFP+-10G-SR Xcvr 46     REV 01   740-021308   13T511100402      SFP+-10G-SR Xcvr 47     REV 01   740-021308   13T511100462      SFP+-10G-SR PIC 1                  BUILTIN      BUILTIN           4x 40G-QSFP+ Xcvr 0      REV 01   740-032986   QA500284          QSFP+-40G-SR4 Xcvr 2      REV 01   740-032986   QA520127          QSFP+-40G-SR4 MGMT BRD      REV 09   750-036946   BBAK4682          QFX3500-MB Power Supply 0 Rev 04  740-032091   VC05069           QFX PS 650W AC  Fan Tray 0                                             QFX Fan Tray Fan Tray 1                                            QFX Fan Tray Fan Tray 2                                            QFX Fan Tray node4           REV 15   750-036931   P2019-C           QFX 48x10G 4x40G Switch CPU                    BUILTIN      BUILTIN           FPC CPU PIC 0                  BUILTIN      BUILTIN           48x 10G-SFP+ Xcvr 0      REV 01   740-021308   13T511100373      SFP+-10G-SR Xcvr 1      REV 01   740-021308   13T511100147      SFP+-10G-SR Xcvr 2      REV 01   740-021308   13T511100688      SFP+-10G-SR Xcvr 3      REV 01   740-021308   13T511100410      SFP+-10G-SR Xcvr 4      REV 01   740-021308   13T511100393      SFP+-10G-SR Xcvr 5      REV 01   740-021308   13T511100678      SFP+-10G-SR Xcvr 40     REV 01   740-021308   13T511100044      SFP+-10G-SR Xcvr 41     REV 01   740-021308   13T511100464      SFP+-10G-SR Xcvr 42     REV 01   740-021308   13T511100694      SFP+-10G-SR Xcvr 43     REV 01   740-021308   13T511100677      SFP+-10G-SR Xcvr 44     REV 01   740-021308   13T511100471      SFP+-10G-SR Xcvr 45     REV 01   740-021308   13T511100367      SFP+-10G-SR Xcvr 46     REV 01   740-021308   13T511100418      SFP+-10G-SR Xcvr 47     REV 01   740-021308   13T511100419      SFP+-10G-SR PIC 1                  BUILTIN      BUILTIN           4x 40G-QSFP+ Xcvr 0      REV 01   740-032986   QA500272          QSFP+-40G-SR4 Xcvr 2      REV 01   740-032986 QA500215          QSFP+-40G-SR4 ---(more 56%)---[abort]

root@qfabric&gt;

Qfabric - 40GIG interfaces admin and opearational state
root@qfabric&gt; show interfaces fabric terse | no-more Interface              Admin Link Proto    Local                 Remote IC-F3718:fte-7/0/0     up    up  IC-F3718:fte-7/0/0.32768 up   up   eth-switch IC-F3718:fte-7/0/1     up    down IC-F3718:fte-7/0/1.32768 up  down eth-switch IC-F3718:fte-7/0/2     up    up  IC-F3718:fte-7/0/2.32768 up   up   eth-switch IC-F3718:fte-7/0/3     up    down IC-F3718:fte-7/0/3.32768 up  down eth-switch IC-F3718:fte-7/0/4     up    up  IC-F3718:fte-7/0/4.32768 up   up   eth-switch IC-F3718:fte-7/0/5     up    down IC-F3718:fte-7/0/5.32768 up  down eth-switch IC-F3718:fte-7/0/6     up    up  IC-F3718:fte-7/0/6.32768 up   up   eth-switch IC-F3718:fte-7/0/7     up    down IC-F3718:fte-7/0/7.32768 up  down eth-switch IC-F3718:fte-7/0/8     up    up  IC-F3718:fte-7/0/8.32768 up   up   eth-switch IC-F3718:fte-7/0/10    up    up  IC-F3718:fte-7/0/10.32768 up  up   eth-switch IC-F3718:bme0          up    up  IC-F3718:bme0.0         up    up   inet     128.0.32.0          --&gt; 0/0 IC-F3718:bme0.1        up    up   inet     128.0.0.17/2 128.0.130.10/2 IC-F3718:bme0.2         up    up   inet     128.0.0.17/8 128.0.130.10/8                                             169.254.128.17/16                                            169.254.193.5/16 IC-F3718:bme1           up    up  IC-F3718:bme1.0         up    up   inet     128.0.0.1/2 128.0.0.4/2                                                128.0.0.23/2                                                128.0.0.24/2                                                128.0.0.25/2                                                128.0.0.26/2                                                128.0.0.27/2                                                128.0.0.28/2                                                128.0.0.29/2                                                128.0.0.30/2                                                128.0.0.31/2                                       tnp      0x4 IC-F3718:dcfabric      up    up  IC-F3718:dcfabric.0     up    up   inet mpls eth-switch IC-F3724:fte-7/0/0     up    up  IC-F3724:fte-7/0/0.32768 up   up   eth-switch IC-F3724:fte-7/0/1     up    down IC-F3724:fte-7/0/1.32768 up  down eth-switch IC-F3724:fte-7/0/2     up    up  IC-F3724:fte-7/0/2.32768 up   up   eth-switch IC-F3724:fte-7/0/3     up    down IC-F3724:fte-7/0/3.32768 up  down eth-switch IC-F3724:fte-7/0/4     up    up  IC-F3724:fte-7/0/4.32768 up   up   eth-switch IC-F3724:fte-7/0/5     up    down IC-F3724:fte-7/0/5.32768 up  down eth-switch IC-F3724:fte-7/0/6     up    up  IC-F3724:fte-7/0/6.32768 up   up   eth-switch IC-F3724:fte-7/0/7     up    down IC-F3724:fte-7/0/7.32768 up  down eth-switch IC-F3724:fte-7/0/8     up    up  IC-F3724:fte-7/0/8.32768 up   up   eth-switch IC-F3724:fte-7/0/10    up    up  IC-F3724:fte-7/0/10.32768 up  up   eth-switch IC-F3724:bme0          up    up  IC-F3724:bme0.0         up    up   inet     128.0.32.0          --&gt; 0/0 IC-F3724:bme0.1        up    up   inet     128.0.0.15/2 128.0.130.12/2 IC-F3724:bme0.2         up    up   inet     128.0.0.15/8 128.0.130.12/8                                             169.254.128.15/16                                            169.254.193.6/16 IC-F3724:bme1           up    up  IC-F3724:bme1.0         up    up   inet     128.0.0.1/2 128.0.0.4/2                                                128.0.0.23/2                                                128.0.0.24/2                                                128.0.0.25/2                                                128.0.0.26/2                                                128.0.0.27/2                                                128.0.0.28/2                                                128.0.0.29/2                                                128.0.0.30/2                                                128.0.0.31/2                                       tnp      0x4 IC-F3724:dcfabric      up    up  IC-F3724:dcfabric.0     up    up   inet mpls eth-switch node8:fte-0/1/0        up    up  node8:fte-0/1/0.32768   up    up   eth-switch node8:fte-0/1/2        up    up  node8:fte-0/1/2.32768   up    up   eth-switch g8:bme0                up    up  g8:bme0.0               up    up   inet     128.0.0.1/2 128.0.0.16/2                                               128.0.32.0/2                                       tnp      0x10 g8:bme0.1              up    up   inet     128.0.0.20/2 128.0.130.30/2 g8:bme0.2               up    up   inet     128.0.0.20/8 128.0.130.30/8                                             169.254.128.20/16                                            169.254.193.15/16 g8:dcfabric             up    up  g8:dcfabric.0           up    up   inet mpls eth-switch node7:fte-0/1/0        up    up  node7:fte-0/1/0.32768   up    up   eth-switch node7:fte-0/1/2        up    up  node7:fte-0/1/2.32768   up    up   eth-switch g7:bme0                up    up  g7:bme0.0               up    up   inet     128.0.0.1/2 128.0.0.16/2                                               128.0.32.0/2                                       tnp      0x10 g7:bme0.1              up    up   inet     128.0.0.24/2 128.0.130.28/2 g7:bme0.2               up    up   inet     128.0.0.24/8 128.0.130.28/8                                             169.254.128.24/16                                            169.254.193.14/16 g7:dcfabric             up    up  g7:dcfabric.0           up    up   inet mpls eth-switch node3:fte-0/1/0        up    up  node3:fte-0/1/0.32768   up    up   eth-switch node3:fte-0/1/2        up    up  node3:fte-0/1/2.32768   up    up   eth-switch node4:fte-0/1/0        up    up  node4:fte-0/1/0.32768   up    up   eth-switch node4:fte-0/1/2        up    up  node4:fte-0/1/2.32768   up    up   eth-switch service-group:bme0     up    up  service-group:bme0.0    up    up   inet     128.0.0.1/2 128.0.0.16/2                                               128.0.32.0/2                                       tnp      0x10 service-group:bme0.1   up    up   inet     128.0.0.21/2 128.0.130.22/2 service-group:bme0.2    up    up   inet     128.0.0.21/8 128.0.130.22/8                                             169.254.128.21/16                                            169.254.193.11/16 service-group:dcfabric  up    up  service-group:dcfabric.0 up   up   inet mpls eth-switch node2:fte-0/1/0        up    up  node2:fte-0/1/0.32768   up    up   eth-switch node2:fte-0/1/2        up    up  node2:fte-0/1/2.32768   up    up   eth-switch g2:bme0                up    up  g2:bme0.0               up    up   inet     128.0.0.1/2 128.0.0.16/2                                               128.0.32.0/2                                       tnp      0x10 g2:bme0.1              up    up   inet     128.0.0.22/2 128.0.130.26/2 g2:bme0.2               up    up   inet     128.0.0.22/8 128.0.130.26/8                                             169.254.128.22/16                                            169.254.193.13/16 g2:dcfabric             up    up  g2:dcfabric.0           up    up   inet mpls eth-switch node1:fte-0/1/0        up    up  node1:fte-0/1/0.32768   up    up   eth-switch node1:fte-0/1/2        up    up  node1:fte-0/1/2.32768   up    up   eth-switch g1:bme0                up    up  g1:bme0.0               up    up   inet     128.0.0.1/2 128.0.0.16/2                                               128.0.32.0/2                                       tnp      0x10 g1:bme0.1              up    up   inet     128.0.0.19/2 128.0.130.24/2 g1:bme0.2               up    up   inet     128.0.0.19/8 128.0.130.24/8                                             169.254.128.19/16                                            169.254.193.12/16 g1:dcfabric             up    up  g1:dcfabric.0           up    up   inet mpls eth-switch NW-NG-0:bme0           up    up  NW-NG-0:bme0.0          up    up   inet     128.0.0.1/2 128.0.0.5/2                                                128.0.32.0/2                                       tnp      0x5 NW-NG-0:bme0.1         up    up   inet     128.0.0.6/2 128.0.128.4/2  NW-NG-0:bme0.2          up    up   inet     128.0.0.6/8 128.0.128.68/8                                             169.254.128.6/16                                            169.254.192.34/16 NW-NG-0:dcfabric        up    up  NW-NG-0:dcfabric.0      up    up   inet mpls eth-switch root@qfabric&gt;

reboot of the SNG/RSNG-node/director/interconnect or of the whole qfabric :
root@qfabric&gt; request system reboot all root@qfabric&gt; request system reboot ? Possible completions: all                 Reboot all QFabric components director-group      Reboot director devices fabric              Reboot interconnect devices and fabric controls node-group          Reboot node group root@qfabric&gt;

CPU at the node level - ssh onto the node
root@qfabric&gt; show system processes extensive | except 0.00 last pid: 2052;  load averages:  0.44,  0.49,  0.48  up 5+09:03:17    15:52:10 166 processes: 34 running, 111 sleeping, 1 zombie, 15 waiting, 5 lock Mem: 211M Active, 163M Inact, 1329M Wired, 119M Cache, 112M Buf, 966M Free Swap:

PID USERNAME THR PRI NICE   SIZE    RES STATE  C   TIME   WCPU COMMAND 36 root       1 171   52     0K    16K CPU6   6 128.9H 93.95% idle: cpu6 37 root       1 171   52     0K    16K CPU5   5 128.8H 93.95% idle: cpu5 40 root       1 171   52     0K    16K CPU2   2 124.5H 92.48% idle: cpu2 39 root       1 171   52     0K    16K CPU3   3 126.2H 91.70% idle: cpu3 41 root       1 171   52     0K    16K CPU1   1 116.4H 91.70% idle: cpu1 42 root       1 171   52     0K    16K RUN    0 110.8H 90.97% idle: cpu0 38 root       1 171   52     0K    16K CPU4   4 123.7H 90.19% idle: cpu4 35 root       1 171   52     0K    16K CPU7   7 117.6H 86.43% idle: cpu7 34 root       1 171   52     0K    16K CPU8   8  90.5H 64.65% idle: cpu8 1289 root       1  88    0   172M 19348K *Giant 8  38.6H 26.27% pafxpc 1178 root       1   4    0 38492K 11384K kqread 7 682:21  4.49% chassism 1181 root       2  44  -52   146M 14684K *Giant 4 333:36  1.46% sfid

root@qfabric&gt;

commit + comments and rollbacks
root@qfabric# commit comment "commit passe bien" commit complete [edit] root@qfabric# run show system commit, to verify what are the last 50 configs

rollback xx - pour loader la conf precedante

file list /config/

storage of the files in the director shell and view from the Junos CLI SSH management IP
In the director shell we get different scripts, the most useful to use for the JTAC is the createpblogs.sh : [root@dg0 ~]# ls anaconda-ks.cfg               install_dhcp.sh bootstrap.sh                   install_interfaces.sh core.sh                        install.log createpblogs.sh               install.log.syslog dcf_cluster_operations.sh     lf.hosts dcf_config_backup.pl          monitor.sh dcf_config_restore.pl          mpt-status dcf_find_local_cluster_rpm.sh new_profile dcf_reset_root_password.sh    ntp.hosts dcf_sfc_show_versions.sh      panic.ko dcf_sfc_wipe_cluster.sh        panic.sh dcf_show_cluster_version.sh    pb.hosts dcf_show_health.sh            pbupdate.rpm.sh dcf-tools                      pingtest.sh dcf_upgrade.sh                 post_install_via_ks_usb.log dhcpd.new                     reset_initial_configuration.sh dns.dump                       resolv.conf.preserved dnsupdate.sh                  scp.ex expect                         sfc_lf_ipaddrs0.txt exports                       sfc_lf_ipaddrs0.txt.bak format.sh                     sfc_lf_ipaddrs1.txt gatherpbinfo.sh               sfc.repo generate_dcf_config.pl        show_dcf_model genpblogs.sh                  show_logical_fabrics getJMB.ex                     show_tor_groups get_logs_from_fabric.pl       ssh.ex hosts.allow                    syslog_cc.sh ifcfg-bond1.saved              timer.sh initial_configuration.pl       tmp install                       verifyPkg.sh [root@dg0 ~]#

Using the JunOS software: root@qfabric&gt; file list / /: modprobe.edit.1 pbdata/ mnt/ modprobe.edit.2 var/ misc/ proc/ selinux/ lost+found/ modprobe.edit bin/ lib64/ dev/ sys/ lib/ boot/ .autofsck net/ usr/ tmp/ home/ media/ library/ .autorelabel sbin/ srv/ root/ modprobe.edit.3 opt/ vmm/ etc/ vmm-disks/ export/

root@qfabric&gt; To copy in the JunOS to the ftp server: file copy /var/tmp/ma_conf_de_28-09-2011 ftp://juniper:juniper@10.10.3.219/ The original configs are first stored in the mySQL database at the directors, they are then sent to the nodes , IC and other logical components of the qfabric system

storage related commands in JunOS
[edit] root@qfabric# run file list /var/tmp/

/var/tmp/: sfc_lf_ipaddrs.txt

[edit] root@qfabric#

debugging - monitoring in real time:
run monitor start MLDv2_trace

paste the large config into the terminal - console for example :
qfabric # load set terminal [Type ^D at a new line to end input]

monitoring/tshooting des interfaces 10GIG - XE - at the node session level in the qfabric:
run sh interface xe-0/0/7.0 extensive | match pps

run monitor interface xe-0/0/7&lt;/pre&gt; run monitor interface ae0 run monitor interface ae1 run monitor traffic interface ae0 layer2-headers

Per Queue frame drops of the 40GIG - FTE interfaces :
root@qfabric&gt; show interfaces queue fabric node1:fte-0/1/0 Physical interface: node1:fte-0/1/0, Enabled, Physical link is Up Interface index: 49183, SNMP ifIndex: 8651253 Forwarding classes: 16 supported, 5 in use Egress queues: 12 supported, 5 in use Queue: 0, Forwarding classes: best-effort Queued: Packets             :                     0                     0 pps Bytes               :                     0                     0 bps Transmitted: Packets             :           25853084960                3279515 pps Bytes               :         5593349125176            8611939688 bps Tail-dropped packets : Not Available Total-dropped pkts  :                     0                     0 pps Total-dropped bytes :                     0                     0 bps Queue: 3, Forwarding classes: fcoe Queued: Packets             :                     0                     0 pps Bytes               :                     0                     0 bps Transmitted: Packets             :             245452205                      0 pps Bytes               :          517413244100                     0 bps Tail-dropped packets : Not Available Total-dropped pkts  :                     0                     0 pps Total-dropped bytes :                     0                     0 bps Queue: 4, Forwarding classes: no-loss Queued: Packets             :                     0                     0 pps Bytes               :                     0                     0 bps Transmitted: Packets             :                     0                      0 pps Bytes               :                     0                     0 bps Tail-dropped packets : Not Available Total-dropped pkts  :                     0                     0 pps Total-dropped bytes :                     0                     0 bps Queue: 7, Forwarding classes: network-control Queued: Packets             :                     0                     0 pps Bytes               :                     0                     0 bps Transmitted: Packets             :                     0                      0 pps Bytes               :                     0                     0 bps Tail-dropped packets : Not Available Total-dropped pkts  :                     0                     0 pps Total-dropped bytes :                     0                     0 bps Queue: 8, Forwarding classes: mcast Queued: Packets             :                     0                     0 pps Bytes               :                     0                     0 bps Transmitted: Packets             :                 65551                      2 pps Bytes               :               3933060                  1064 bps Tail-dropped packets : Not Available Total-dropped pkts  :                     0                     0 pps Total-dropped bytes :                     0                     0 bps root@qfabric&gt;

Frame drop per queue in the Qfabric 10GIG interfaces ( XE ) :
root@qfabric&gt; show interfaces queue node1:xe-0/0/0 Physical interface: node1:xe-0/0/0, Enabled, Physical link is Up Interface index: 49161, SNMP ifIndex: 8651261 Forwarding classes: 16 supported, 5 in use Egress queues: 12 supported, 5 in use Queue: 0, Forwarding classes: best-effort Queued: Packets             :                     0                     0 pps Bytes               :                     0                     0 bps Transmitted: Packets             :           22753833291                      0 pps Bytes               :        14016151426458                     0 bps Tail-dropped packets : Not Available Total-dropped pkts  :             717830113                     0 pps Total-dropped bytes :          592748675072                     0 bps Queue: 3, Forwarding classes: fcoe Queued: Packets             :                     0                     0 pps Bytes               :                     0                     0 bps Transmitted: Packets             :                     0                      0 pps Bytes               :                     0                     0 bps Tail-dropped packets : Not Available Total-dropped pkts  :                     0                     0 pps Total-dropped bytes :                     0                     0 bps Queue: 4, Forwarding classes: no-loss Queued: Packets             :                     0                     0 pps Bytes               :                     0                     0 bps Transmitted: Packets             :                     0                      0 pps Bytes               :                     0                     0 bps Tail-dropped packets : Not Available Total-dropped pkts  :                     0                     0 pps Total-dropped bytes :                     0                     0 bps Queue: 7, Forwarding classes: network-control Queued: Packets             :                     0                     0 pps Bytes               :                     0                     0 bps Transmitted: Packets             :                    80                      0 pps Bytes               :                  5120                     0 bps Tail-dropped packets : Not Available Total-dropped pkts  :                     0                     0 pps Total-dropped bytes :                     0                     0 bps Queue: 8, Forwarding classes: mcast Queued: Packets             :                     0                     0 pps Bytes               :                     0                     0 bps Transmitted: Packets             :            3512911121                      4 pps Bytes               :         3007888252158                  2512 bps Tail-dropped packets : Not Available Total-dropped pkts  :            7996778673                     0 pps Total-dropped bytes :        10759749384034                     0 bps root@qfabric&gt;

Frame drop in fonction of the " forwarding-class " :
root@qfabric# run show class-of-service forwarding-class Forwarding class                   ID                      Queue  Policing priority best-effort                            0                       0           normal fcoe                                   1                       3           normal no-loss                                2                       4           normal network-control                        3                       7           normal mcast                                  8                       8           normal [edit] root@qfabric#

root@qfabric# run show interfaces queue fabric node1:fte-0/1/* egress forwarding-class mcast Physical interface: node1:fte-0/1/0, Enabled, Physical link is Up Interface index: 49183, SNMP ifIndex: 8651253 Forwarding classes: 16 supported, 5 in use Egress queues: 12 supported, 5 in use Queue: 8, Forwarding classes: mcast Queued: Packets             :                     0                     0 pps Bytes               :                     0                     0 bps Transmitted: Packets             :            1322114832                3296975 pps Bytes               :          474642951832            8766136720 bps Tail-dropped packets : Not Available Total-dropped pkts  :               3413390                  8636 pps Total-dropped bytes :            5120079256             103637336 bps

Physical interface: node1:fte-0/1/1, Enabled, Physical link is Up Interface index: 49184, SNMP ifIndex: 8651357 Forwarding classes: 16 supported, 5 in use Egress queues: 12 supported, 5 in use Queue: 8, Forwarding classes: mcast Queued: Packets             :                     0                     0 pps Bytes               :                     0                     0 bps Transmitted: Packets             :              23716046                      5 pps Bytes               :           26883447244                  2544 bps Tail-dropped packets : Not Available Total-dropped pkts  :                 49177                     0 pps Total-dropped bytes :              73765500                     0 bps

Physical interface: node1:fte-0/1/2, Enabled, Physical link is Up Interface index: 49185, SNMP ifIndex: 8651255 Forwarding classes: 16 supported, 5 in use Egress queues: 12 supported, 5 in use Queue: 8, Forwarding classes: mcast Queued: Packets             :                     0                     0 pps Bytes               :                     0                     0 bps Transmitted: Packets             :                     0                      0 pps Bytes               :                     0                     0 bps Tail-dropped packets : Not Available Total-dropped pkts  :                     0                     0 pps Total-dropped bytes :                     0                     0 bps

Physical interface: node1:fte-0/1/3, Enabled, Physical link is Up Interface index: 49186, SNMP ifIndex: 8651259 Forwarding classes: 16 supported, 5 in use Egress queues: 12 supported, 5 in use Queue: 8, Forwarding classes: mcast Queued: Packets             :                     0                     0 pps Bytes               :                     0                     0 bps Transmitted: Packets             :              23712901                      1 pps Bytes               :           26883331780                   632 bps Tail-dropped packets : Not Available Total-dropped pkts  :                 49126                     0 pps Total-dropped bytes :              73689000                     0 bps

[edit] root@qfabric#

MAC address table verification - number of MAC@ in the Qfabric switch:
root@qfabric&gt; show ethernet-switching table summary Total                              : 11373 Dynamic entries                    : 3219 Flood entries                      : 8154

root@qfabric&gt; show ethernet-switching table vlan VLAN-100 summary VLAN-100---qfabric Total                              : 3208 Flood entries                      : 5  Dynamic entries                     : 3203

MAC address table verification of the qfabric per node alias - ici node1:
root@qfabric&gt; show ethernet-switching table vlan VLAN-100 | match learn|match node1 | count Count: 1600 lines root@qfabric&gt;

MAC address table verification of the qfabric per node and per interface:
root@qfabric&gt; show ethernet-switching table vlan VLAN-100 | match learn|match node1:xe-0/0/0 | count Count: 100 lines root@qfabric&gt;

MAC address table verification in the qfabric - dernier MAC de la liste
root@qfabric&gt; show ethernet-switching table vlan VLAN-100 | match learn | last 10 VLAN-100         00:10:94:1f:00:5d Learn       2:34 node2:xe-0/0/15.0 VLAN-100         00:10:94:1f:00:5e Learn       2:49 node2:xe-0/0/15.0 VLAN-100         00:10:94:1f:00:5f Learn       2:46 node2:xe-0/0/15.0 VLAN-100         00:10:94:1f:00:60 Learn       2:44 node2:xe-0/0/15.0 VLAN-100         00:10:94:1f:00:61 Learn       2:37 node2:xe-0/0/15.0 VLAN-100         00:10:94:1f:00:62 Learn       2:37 node2:xe-0/0/15.0 VLAN-100         00:10:94:1f:00:63 Learn       2:43 node2:xe-0/0/15.0 VLAN-100         00:10:94:1f:00:64 Learn       2:48 node2:xe-0/0/15.0 VLAN-100         00:1d:b5:a8:67:c7 Learn       9:02 g8:ae7.0 VLAN-100         00:1d:b5:a8:77:c6 Learn         35 g1:ae6.0 root@qfabric&gt;

MAC address table - number of MAC@ learned in the particular VLAN-id of the whole Qfabric:
root@qfabric&gt; show ethernet-switching table vlan VLAN-100 | match learn | count Count: 3203 lines root@qfabric&gt;

How the SNG and RSNG nodes are connected to the IC-Interconnects modules ?
root@qfabric&gt; show chassis fabric connectivity Device ID: P1473-C, Type: qfx3500 Fabric: Incoming links: F3724:fte-7/0/0                  -&gt; P1473-C:fte-0/1/0                  Ok      F3724:fte-7/0/15                  -&gt; P1473-C:fte-0/1/1                  Ok      F3718:fte-7/0/0                   -&gt; P1473-C:fte-0/1/2                  Ok      F3718:fte-7/0/15                  -&gt; P1473-C:fte-0/1/3                  Ok

Fabric: Outgoing links: P1473-C:fte-0/1/0                -&gt; F3724:fte-7/0/0                    Ok      P1473-C:fte-0/1/1                 -&gt; F3724:fte-7/0/15                   Ok      P1473-C:fte-0/1/2                 -&gt; F3718:fte-7/0/0                    Ok      P1473-C:fte-0/1/3                 -&gt; F3718:fte-7/0/15                   Ok

Device ID: P2012-C, Type: qfx3500

Fabric: Incoming links: F3724:fte-7/0/5                  -&gt; P2012-C:fte-0/1/0                  Ok      F3724:fte-7/0/10                  -&gt; P2012-C:fte-0/1/1                  Ok      F3718:fte-7/0/5                   -&gt; P2012-C:fte-0/1/2                  Ok      F3718:fte-7/0/10                  -&gt; P2012-C:fte-0/1/3                  Ok

Fabric: Outgoing links: P2012-C:fte-0/1/0                -&gt; F3724:fte-7/0/5                    Ok      P2012-C:fte-0/1/1                 -&gt; F3724:fte-7/0/10                   Ok      P2012-C:fte-0/1/2                 -&gt; F3718:fte-7/0/5                    Ok      P2012-C:fte-0/1/3                 -&gt; F3718:fte-7/0/10                   Ok

Device ID: P2017-C, Type: qfx3500

Fabric: Incoming links: F3724:fte-7/0/2                  -&gt; P2017-C:fte-0/1/0                  Ok      F3724:fte-7/0/13                  -&gt; P2017-C:fte-0/1/1                  Ok      F3718:fte-7/0/2                   -&gt; P2017-C:fte-0/1/2                  Ok      F3718:fte-7/0/13                  -&gt; P2017-C:fte-0/1/3                  Ok

Fabric: Outgoing links: P2017-C:fte-0/1/0                -&gt; F3724:fte-7/0/2                    Ok      P2017-C:fte-0/1/1                 -&gt; F3724:fte-7/0/13                   Ok      P2017-C:fte-0/1/2                 -&gt; F3718:fte-7/0/2                    Ok      P2017-C:fte-0/1/3                 -&gt; F3718:fte-7/0/13                   Ok

Device ID: P2011-C, Type: qfx3500

Fabric: Incoming links: F3724:fte-7/0/1                  -&gt; P2011-C:fte-0/1/0                  Ok      F3724:fte-7/0/14                  -&gt; P2011-C:fte-0/1/1                  Ok      F3718:fte-7/0/1                   -&gt; P2011-C:fte-0/1/2                  Ok      F3718:fte-7/0/14                  -&gt; P2011-C:fte-0/1/3                  Ok

Fabric: Outgoing links: P2011-C:fte-0/1/0                -&gt; F3724:fte-7/0/1                    Ok      P2011-C:fte-0/1/1                 -&gt; F3724:fte-7/0/14                   Ok      P2011-C:fte-0/1/2                 -&gt; F3718:fte-7/0/1                    Ok      P2011-C:fte-0/1/3                 -&gt; F3718:fte-7/0/14                   Ok

Device ID: P2019-C, Type: qfx3500

Fabric: Incoming links: F3724:fte-7/0/3                  -&gt; P2019-C:fte-0/1/0                  Ok      F3724:fte-7/0/12                  -&gt; P2019-C:fte-0/1/1                  Ok      F3718:fte-7/0/3                   -&gt; P2019-C:fte-0/1/2                  Ok      F3718:fte-7/0/12                  -&gt; P2019-C:fte-0/1/3                  Ok

Fabric: Outgoing links: P2019-C:fte-0/1/0                -&gt; F3724:fte-7/0/3                    Ok      P2019-C:fte-0/1/1                 -&gt; F3724:fte-7/0/12                   Ok      P2019-C:fte-0/1/2                 -&gt; F3718:fte-7/0/3                    Ok      P2019-C:fte-0/1/3                 -&gt; F3718:fte-7/0/12                   Ok    Device ID: P1461-C, Type: qfx3500

Fabric: Incoming links: F3724:fte-7/0/4                  -&gt; P1461-C:fte-0/1/0                  Ok      F3724:fte-7/0/11                  -&gt; P1461-C:fte-0/1/1                  Ok      F3718:fte-7/0/4                   -&gt; P1461-C:fte-0/1/2                  Ok      F3718:fte-7/0/11                  -&gt; P1461-C:fte-0/1/3                  Ok

Fabric: Outgoing links: P1461-C:fte-0/1/0                -&gt; F3724:fte-7/0/4                    Ok      P1461-C:fte-0/1/1                 -&gt; F3724:fte-7/0/11                   Ok      P1461-C:fte-0/1/2                 -&gt; F3718:fte-7/0/4                    Ok      P1461-C:fte-0/1/3                 -&gt; F3718:fte-7/0/11                   Ok

Device ID: F3718, Type: qfxc08-3008

Front Card 7   : Incoming links: P1473-C:fte-0/1/2                -&gt; F3718:fte-7/0/0                    Ok      P2011-C:fte-0/1/2                 -&gt; F3718:fte-7/0/1                    Ok      P2017-C:fte-0/1/2                 -&gt; F3718:fte-7/0/2                    Ok      P2019-C:fte-0/1/2                 -&gt; F3718:fte-7/0/3                    Ok      P1461-C:fte-0/1/2                 -&gt; F3718:fte-7/0/4                    Ok      P2012-C:fte-0/1/2                 -&gt; F3718:fte-7/0/5                    Ok      P2012-C:fte-0/1/3                 -&gt; F3718:fte-7/0/10                   Ok      P1461-C:fte-0/1/3                 -&gt; F3718:fte-7/0/11                   Ok      P2019-C:fte-0/1/3                 -&gt; F3718:fte-7/0/12                   Ok      P2017-C:fte-0/1/3                 -&gt; F3718:fte-7/0/13                   Ok      P2011-C:fte-0/1/3                 -&gt; F3718:fte-7/0/14                   Ok      P1473-C:fte-0/1/3                 -&gt; F3718:fte-7/0/15                   Ok

Front Card 7   : Outgoing links: F3718:fte-7/0/10                 -&gt; P2012-C:fte-0/1/3                  Ok      F3718:fte-7/0/11                  -&gt; P1461-C:fte-0/1/3                  Ok      F3718:fte-7/0/12                  -&gt; P2019-C:fte-0/1/3                  Ok      F3718:fte-7/0/13                  -&gt; P2017-C:fte-0/1/3                  Ok      F3718:fte-7/0/14                  -&gt; P2011-C:fte-0/1/3                  Ok      F3718:fte-7/0/15                  -&gt; P1473-C:fte-0/1/3                  Ok      F3718:fte-7/0/0                   -&gt; P1473-C:fte-0/1/2                  Ok      F3718:fte-7/0/1                   -&gt; P2011-C:fte-0/1/2                  Ok      F3718:fte-7/0/2                   -&gt; P2017-C:fte-0/1/2                  Ok      F3718:fte-7/0/3                   -&gt; P2019-C:fte-0/1/2                  Ok      F3718:fte-7/0/4                   -&gt; P1461-C:fte-0/1/2                  Ok      F3718:fte-7/0/5                   -&gt; P2012-C:fte-0/1/2                  Ok

Device ID: F3724, Type: qfxc08-3008 Front Card 7   : Incoming links: P1473-C:fte-0/1/0                -&gt; F3724:fte-7/0/0                    Ok      P2011-C:fte-0/1/0                 -&gt; F3724:fte-7/0/1                    Ok      P2017-C:fte-0/1/0                 -&gt; F3724:fte-7/0/2                    Ok      P2019-C:fte-0/1/0                 -&gt; F3724:fte-7/0/3                    Ok      P1461-C:fte-0/1/0                 -&gt; F3724:fte-7/0/4                    Ok      P2012-C:fte-0/1/0                 -&gt; F3724:fte-7/0/5                    Ok      P2012-C:fte-0/1/1                 -&gt; F3724:fte-7/0/10                   Ok      P1461-C:fte-0/1/1                 -&gt; F3724:fte-7/0/11                   Ok      P2019-C:fte-0/1/1                 -&gt; F3724:fte-7/0/12                   Ok      P2017-C:fte-0/1/1                 -&gt; F3724:fte-7/0/13                   Ok      P2011-C:fte-0/1/1                 -&gt; F3724:fte-7/0/14                   Ok      P1473-C:fte-0/1/1                 -&gt; F3724:fte-7/0/15                   Ok

Front Card 7   : Outgoing links: F3724:fte-7/0/10                 -&gt; P2012-C:fte-0/1/1                  Ok      F3724:fte-7/0/11                  -&gt; P1461-C:fte-0/1/1                  Ok      F3724:fte-7/0/12                  -&gt; P2019-C:fte-0/1/1                  Ok      F3724:fte-7/0/13                  -&gt; P2017-C:fte-0/1/1                  Ok      F3724:fte-7/0/14                  -&gt; P2011-C:fte-0/1/1                  Ok      F3724:fte-7/0/15                  -&gt; P1473-C:fte-0/1/1                  Ok      F3724:fte-7/0/0                   -&gt; P1473-C:fte-0/1/0                  Ok      F3724:fte-7/0/1                   -&gt; P2011-C:fte-0/1/0                  Ok      F3724:fte-7/0/2                   -&gt; P2017-C:fte-0/1/0                  Ok      F3724:fte-7/0/3                   -&gt; P2019-C:fte-0/1/0                  Ok      F3724:fte-7/0/4                   -&gt; P1461-C:fte-0/1/0                  Ok      F3724:fte-7/0/5                   -&gt; P2012-C:fte-0/1/0                  Ok

root@qfabric&gt;

clear the stats from the FTE interface
root@qfabric&gt; clear interfaces statistics fabric node1:fte-0/1/*

The statistics of a 40GIG interface of a given node:
root@qfabric&gt; show interfaces fabric node1:fte-0/1/0 extensive Physical interface: node1:fte-0/1/0, Enabled, Physical link is Up Interface index: 49183, SNMP ifIndex: 8651253, Generation: 158 Link-level type: Ethernet, MTU: 9232, Speed: 40Gbps, Duplex: Full-Duplex, BPDU Error: None, MAC-REWRITE Error: None, Loopback: Disabled, Source filtering: Disabled, Flow control: Disabled Device flags  : Present Running Interface flags: Internal: 0x0 CoS queues    : 12 supported, 12 maximum usable queues Hold-times    : Up 0 ms, Down 0 ms  Current address: 84:18:88:dc:dc:34, Hardware address: 84:18:88:dc:dc:34 Last flapped  : 2011-11-14 09:14:31 UTC (2d 09:41 ago) Statistics last cleared: 2011-11-16 11:01:22 UTC (07:54:39 ago) Traffic statistics: Input bytes  :       14078510287017          31086495720 bps Output bytes :       15509064507295          35071949760 bps Input packets:          24896621242              2569983 pps Output packets:         33151752282              2899468 pps IPv6 transit statistics: Input bytes  :                   0 Output bytes :                   0 Input packets:                   0 Output packets:                  0 Input errors: Errors: 0, Drops: 0, Framing errors: 0, Runts: 0, Policed discards: 0, L3 incompletes: 0, L2 channel errors: 0, L2 mismatch timeouts: 0, FIFO errors: 0, Resource errors: 0 Output errors: Carrier transitions: 0, Errors: 0, Drops: 0, Collisions: 0, Aged packets: 0, FIFO errors: 0, HS link CRC errors: 0, MTU errors: 0, Resource errors: 0 Egress queues: 12 supported, 5 in use Queue counters:      Queued packets  Transmitted packets      Dropped packets 0 best-effort                   0          25399549107                    0 3 fcoe                          0            245452205                    0 4 no-loss                       0                    0                    0 7 network-cont                  0                    0                    0 8 mcast                         0                65022                    0 Active alarms : None Active defects : None MAC statistics:                     Receive         Transmit Total octets               14078510287017   15509064507295 Total packets                 24896621242      33151752282 Unicast packets               24896621242      33151687266 Broadcast packets                       0                0 Multicast packets                       0            65016 CRC/Align errors                        0                0 FIFO errors                             0                0 MAC control frames                      0                0 MAC pause frames                        0                0 Oversized frames                        0 Jabber frames                           0 Fragment frames                         0 VLAN tagged frames                      0 Code violations                         0 MAC Priority Flow Control Statistics: Prioity : 0                             0                0 Prioity : 1                             0                0 Prioity : 2                             0                0 Prioity : 3                             0                0 Prioity : 4                             0                0 Prioity : 5                             0                0 Prioity : 6                             0                0 Prioity : 7                             0                0 Filter statistics: Input packet count                      0 Input packet rejects                    0 Input DA rejects                        0 Input SA rejects                        0 Output packet count                                      0 Output packet pad count                                  0 Output packet error count                                0 CAM destination filters: 1, CAM source filters: 0 Packet Forwarding Engine configuration: Destination slot: 0 Direction : Output CoS transmit queue              Bandwidth               Buffer Priority   Limit %           bps     %           usec 0 best-effort            5     2000000000     5              0      low    none 3 fcoe                  35    14000000000    35              0      low    none 4 no-loss               35    14000000000    35              0      low    none 7 network-control        5     2000000000     5              0      low    none 8 mcast                 20     8000000000    20              0      low    none Logical interface node1:fte-0/1/0.32768 (Index 66) (SNMP ifIndex 8651254) (Generation 131) Flags: 0x0 Encapsulation: ENET2 Traffic statistics: Input bytes  :              4959282 Output bytes :              2230148 Input packets:                36758 Output packets:               12315 Local statistics: Input bytes  :              4959282 Output bytes :              2230148 Input packets:                36758 Output packets:               12315 Transit statistics: Input bytes  :                    0                    0 bps Output bytes :                    0                    0 bps Input packets:                    0                    0 pps Output packets:                   0                    0 pps Protocol eth-switch, MTU: 0, Generation: 159, Route table: 0

root@qfabric&gt;

various CLI to be considered on the qfabric or NPV switch
o in the director's shell : ./createpblogs.sh

o Request support information o Show log messages o Request support information o Core files (use the ‘show system core-dumps’ in order to find where the core-dumps are located ) o Show version component all o Show system uptime o Show system core-dumps o Show chassis alarms o Show configuration o Show interfaces extensive o show ethernet-switching table o show ethernet-switching interfaces detail o show vlans extensive o show fip snooping detail o show fip snooping statistics

Qfabric video blog
http://qfabric.blogspot.com/