HOS – Control Plane Service Verification (1 of 4)

2015-11-25

HOS – Control Plane Service Verification (1 of 4)

Following on from the previous post it is necessary to demonstrate that the Helion OpenStack environment is in a healthy state and the neutron networking is operational.

First let’s verify the basic overcloud control plane services:

Check the compute services

nova service-list

[expect Status:enabled and State:up]

+----+------------------+-----------------------------------------------------+----------+---------+-------+----------------------------+-----------------+
| Id | Binary           | Host                                          | Zone     | Status  | State | Updated_at               | Disabled Reason |
+----+------------------+-----------------------------------------------------+----------+---------+-------+----------------------------+-----------------+
| 3  | nova-conductor   | overcloud-ce-controller-controller1-7g6rbkrawrmb| internal | enabled | up    | 2015-11-23T09:53:00.000000 | -               |
| 6  | nova-cert        | overcloud-ce-controller-controller1-7g6rbkrawrmb| internal | enabled | up    | 2015-11-23T09:52:59.000000 | -               |
| 9  | nova-conductor   | overcloud-ce-controller-controller2-wjg7a27togvj| internal | enabled | up    | 2015-11-23T09:53:02.000000 | -               |
| 15 | nova-scheduler   | overcloud-ce-controller-controller1-7g6rbkrawrmb| internal | enabled | up    | 2015-11-23T09:53:00.000000 | -               |
| 18 | nova-cert        | overcloud-ce-controller-controller2-wjg7a27togvj| internal | enabled | up    | 2015-11-23T09:53:01.000000 | -               |
| 21 | nova-scheduler   | overcloud-ce-controller-controller2-wjg7a27togvj| internal | enabled | up    | 2015-11-23T09:52:58.000000 | -               |
| 24 | nova-conductor   | overcloud-ce-controller-controller0-dlmy4f5tbc5d| internal | enabled | up    | 2015-11-23T09:53:04.000000 | -               |
| 27 | nova-cert        | overcloud-ce-controller-controller0-dlmy4f5tbc5d| internal | enabled | up    | 2015-11-23T09:53:01.000000 | -               |
| 30 | nova-scheduler   | overcloud-ce-controller-controller0-dlmy4f5tbc5d| internal | enabled | up    | 2015-11-23T09:53:03.000000 | -               |
| 33 | nova-consoleauth | overcloud-ce-controller-controller0-dlmy4f5tbc5d| internal | enabled | up    | 2015-11-23T09:52:57.000000 | -               |
| 36 | nova-compute     | overcloud-ce-novacompute1-novacompute1-tpodwp2ljbhw | nova   | enabled | up    | 2015-11-23T09:53:03.000000 | None            |
| 39 | nova-compute     | overcloud-ce-novacompute0-novacompute0-cnfiwerfvbht | nova   | enabled | up    | 2015-11-23T09:53:04.000000 | None            |
+----+------------------+-----------------------------------------------------+----------+---------+-------+----------------------------+-----------------+

Check the networking services

neutron agent-list

[expect alive: πŸ™‚ and admin_state_up:true]

+--------------------------------------+--------------------+-----------------------------------------------------+-------+----------------+---------------------------+
| id                                   | agent_type         | host                                              | alive | admin_state_up | binary                    |
+--------------------------------------+--------------------+-----------------------------------------------------+-------+----------------+---------------------------+
| 1867a83d-e4fa-4ee3-9893-1d8b72547ccf | Open vSwitch agent | overcloud-ce-novacompute1-novacompute1-tpodwp2ljbhw | πŸ™‚   | True           | neutron-openvswitch-agent |
| 193548d7-009a-4432-9533-28d8445ccd6f | Open vSwitch agent | overcloud-ce-novacompute0-novacompute0-cnfiwerfvbht | πŸ™‚   | True           | neutron-openvswitch-agent |
| 2ae95bab-0ad4-47d6-a4dc-288f6cac2aff | L3 agent           | overcloud-ce-controller-controller1-7g6rbkrawrmb| πŸ™‚   | True           | neutron-l3-agent          |
| 2d174ed9-5076-4d24-83e1-f8e13c01e20c | Metadata agent     | overcloud-ce-novacompute0-novacompute0-cnfiwerfvbht | πŸ™‚   | True           | neutron-metadata-agent    |
| 2dab983c-ecc6-4616-ba66-60aa5de5ca00 | L3 agent           | overcloud-ce-controller-controller0-dlmy4f5tbc5d| πŸ™‚   | True           | neutron-l3-agent          |
| 32ea5ae1-035c-45f4-9499-a99e8517d5f9 | Metadata agent     | overcloud-ce-controller-controller0-dlmy4f5tbc5d| πŸ™‚   | True           | neutron-metadata-agent    |
| 4283a946-62f4-488d-be5f-c65e95ffcde2 | DHCP agent         | overcloud-ce-controller-controller2-wjg7a27togvj| πŸ™‚   | True           | neutron-dhcp-agent        |
| 4801da91-b2a9-4310-b11f-a5cc5e995977 | L3 agent           | overcloud-ce-controller-controller2-wjg7a27togvj| πŸ™‚   | True           | neutron-l3-agent          |
| 4e75a59e-002b-4e6a-9cdf-1a18d690f729 | L3 agent           | overcloud-ce-novacompute0-novacompute0-cnfiwerfvbht | πŸ™‚   | True           | neutron-l3-agent          |
| 61546593-86fb-4954-8cc5-56f7592ecfe3 | Open vSwitch agent | overcloud-ce-controller-controller2-wjg7a27togvj| πŸ™‚   | True           | neutron-openvswitch-agent |
| 65894379-60d3-4ba9-8c83-154903a1b1c4 | DHCP agent         | overcloud-ce-controller-controller0-dlmy4f5tbc5d| πŸ™‚   | True           | neutron-dhcp-agent        |
| 78d8c1e9-e594-4436-b361-8ae8c5e93eca | DHCP agent         | overcloud-ce-controller-controller1-7g6rbkrawrmb| πŸ™‚   | True           | neutron-dhcp-agent        |
| 818cd044-ac99-41a8-b265-5e5bcc588ebe | L3 agent           | overcloud-ce-novacompute1-novacompute1-tpodwp2ljbhw | πŸ™‚   | True           | neutron-l3-agent          |
| 86335e06-ca66-49e3-9284-08e19fba202d | Metadata agent     | overcloud-ce-novacompute1-novacompute1-tpodwp2ljbhw | πŸ™‚   | True           | neutron-metadata-agent    |
| b6c3c769-8093-4e7b-8210-4875dc12f034 | Open vSwitch agent | overcloud-ce-controller-controller0-dlmy4f5tbc5d| πŸ™‚   | True           | neutron-openvswitch-agent |
| b91d9eb2-a7ac-439b-8f8b-e5ad13f00bb1 | Metadata agent     | overcloud-ce-controller-controller2-wjg7a27togvj| πŸ™‚   | True           | neutron-metadata-agent    |
| e2f34b55-b759-4b6a-accb-543d576851a0 | Open vSwitch agent | overcloud-ce-controller-controller1-7g6rbkrawrmb| πŸ™‚   | True           | neutron-openvswitch-agent |
| eddf55c5-ae7b-402a-991a-7d2f401d7c59 | Metadata agent     | overcloud-ce-controller-controller1-7g6rbkrawrmb| πŸ™‚   | True           | neutron-metadata-agent    |
+--------------------------------------+--------------------+-----------------------------------------------------+-------+----------------+---------------------------+

Check the galera mysql cluster

mysql -e β€œshow status like β€˜wsrep_%'”

[expect wsrep_replicated:2, wsrep_incoming_addresses:[,,] or [3 ip addresses], wsrep_local_state_comment:Synced]

+----------------------------+--------------------------------------+
| Variable_name              | Value                                |
+----------------------------+--------------------------------------+
| wsrep_local_state_uuid     | bc0491b1-77fc-11e5-8494-dabc449af6f2 |
| wsrep_protocol_version     | 4                                    |
| wsrep_last_committed       | 5986661                              |
| wsrep_replicated           | 5986657                              |
| wsrep_replicated_bytes     | 4137351580                           |
| wsrep_received             | 13627                                |
| wsrep_received_bytes       | 110649                               |
| wsrep_local_commits        | 5985563                              |
| wsrep_local_cert_failures  | 1                                    |
| wsrep_local_replays        | 0                                    |
| wsrep_local_send_queue     | 0                                    |
| wsrep_local_send_queue_avg | 0.000000                             |
| wsrep_local_recv_queue     | 0                                    |
| wsrep_local_recv_queue_avg | 0.000000                             |
| wsrep_flow_control_paused  | 0.000000                             |
| wsrep_flow_control_sent    | 0                                    |
| wsrep_flow_control_recv    | 0                                    |
| wsrep_cert_deps_distance   | 19.111524                            |
| wsrep_apply_oooe           | 0.000000                             |
| wsrep_apply_oool           | 0.000000                             |
| wsrep_apply_window         | 1.000000                             |
| wsrep_commit_oooe          | 0.000000                             |
| wsrep_commit_oool          | 0.000000                             |
| wsrep_commit_window        | 1.000000                             |
| wsrep_local_state          | 4                                    |
| wsrep_local_state_comment  | Synced                               |
| wsrep_cert_index_size      | 68                                   |
| wsrep_causal_reads         | 0                                    |
| wsrep_incoming_addresses   | ,,                                   |
| wsrep_cluster_conf_id      | 4                                    |
| wsrep_cluster_size         | 3                                    |
| wsrep_cluster_state_uuid  | bc0491b1-77fc-11e5-8494-dabc449af6f2 |
| wsrep_cluster_status       | Primary                              |
| wsrep_connected            | ON                                   |
| wsrep_local_bf_aborts      | 0                                    |
| wsrep_local_index          | 2                                    |
| wsrep_provider_name        | Galera                               |
| wsrep_provider_vendor      | Codership Oy <info@codership.com>    |
| wsrep_provider_version     | 2.10(r175)                           |
| wsrep_ready                | ON                                   |
+----------------------------+--------------------------------------+

Check the message queue is running

rabbitmqctl cluster_status

root@overcloud-ce-controller-controller0-dlmy4f5tbc5d:~# rabbitmqctl cluster_status
Cluster status of node 'rabbit@overcloud-ce-controller-controller0-dlmy4f5tbc5d' ...
[{nodes,[{disc,['rabbit@overcloud-ce-controller-controller0-dlmy4f5tbc5d',
               'rabbit@overcloud-ce-controller-controller1-7g6rbkrawrmb',
               'rabbit@overcloud-ce-controller-controller2-wjg7a27togvj']}]},
 {running_nodes,['rabbit@overcloud-ce-controller-controller1-7g6rbkrawrmb',
                 'rabbit@overcloud-ce-controller-controller2-wjg7a27togvj',
                 'rabbit@overcloud-ce-controller-controller0-dlmy4f5tbc5d']},
 {cluster_name,<< "rabbit@overcloud-ce-controller-controller0-dlmy4f5tbc5d.novalocal" >>},
 {partitions,[]}]

Gather the controller configurations

Controller 0

Get the Openvswitch configuration

ovs-vsctl show

root@overcloud-ce-controller-controller0-dlmy4f5tbc5d:~# ovs-vsctl show
4a0f6c38-215d-498f-a5ac-0d0804d21665
   Bridge br-ex
   Port br-ex
       Interface br-ex
           type: internal
   Port "qg-5b6914d7-f7"
       Interface "qg-5b6914d7-f7"
           type: internal
   Port "vlan1274"
       Interface "vlan1274"
   Port "qg-1d075498-b3"
       Interface "qg-1d075498-b3"
           type: internal
   Bridge br-int
       fail_mode: secure
       Port "qr-0703300d-84"
           tag: 1
           Interface "qr-0703300d-84"
               type: internal
       Port "tap9065ae01-64"
           tag: 6
           Interface "tap9065ae01-64"
               type: internal
       Port "qr-0b36af9c-8c"
           Interface "qr-0b36af9c-8c"
               type: internal
       Port "sg-f4b08ba6-10"
           Interface "sg-f4b08ba6-10"
               type: internal
       Port "sg-161f8764-8f"
           tag: 1
           Interface "sg-161f8764-8f"
               type: internal
       Port patch-tun
           Interface patch-tun
               type: patch
               options: {peer=patch-int}
       Port "sg-8b3ee21d-13"
           tag: 3
           Interface "sg-8b3ee21d-13"
               type: internal
       Port br-int
           Interface br-int
               type: internal
       Port "tapc8e92a29-75"
           tag: 1
           Interface "tapc8e92a29-75"
               type: internal
       Port int-br-svc
           Interface int-br-svc
               type: patch
               options: {peer=phy-br-svc}
       Port "sg-00f5256d-4f"
           tag: 1
           Interface "sg-00f5256d-4f"
               type: internal
       Port "tapd4181845-fb"
           tag: 2
           Interface "tapd4181845-fb"
               type: internal
       Port "qr-c73759bd-9d"
           tag: 3
           Interface "qr-c73759bd-9d"
               type: internal
       Port "qr-accfb1df-cc"
           tag: 1
           Interface "qr-accfb1df-cc"
               type: internal
       Port "tapfc6ec33e-66"
           tag: 3
           Interface "tapfc6ec33e-66"
               type: internal
   Bridge br-tun
       fail_mode: secure
       Port patch-int
           Interface patch-int
               type: patch
               options: {peer=patch-tun}
       Port "vxlan-0afe1927"
           Interface "vxlan-0afe1927"
           type: vxlan
           options: {df_default="false", in_key=flow, local_ip="10.254.25.41", out_key=flow, remote_ip="10.254.25.39"}
       Port "vxlan-0afe192b"
           Interface "vxlan-0afe192b"
           type: vxlan
           options: {df_default="false", in_key=flow, local_ip="10.254.25.41", out_key=flow, remote_ip="10.254.25.43"}
       Port "vxlan-0afe192c"
           Interface "vxlan-0afe192c"
           type: vxlan
           options: {df_default="false", in_key=flow, local_ip="10.254.25.41", out_key=flow, remote_ip="10.254.25.44"}
       Port br-tun
           Interface br-tun
               type: internal
   Bridge br-svc
       Port phy-br-svc
           Interface phy-br-svc
               type: patch
               options: {peer=int-br-svc}
       Port br-svc
           Interface br-svc
               type: internal
       Port "vlan1273"
           Interface "vlan1273"
   ovs_version: "2.3.0"

Gather the firewall configuration

iptables -L

root@overcloud-ce-controller-controller0-dlmy4f5tbc5d:~# iptables -L
Chain INPUT (policy ACCEPT)
target     prot opt source               destination
neutron-openvswi-INPUT  all  --  anywhere             anywhere
nova-api-INPUT  all  --  anywhere             anywhere
ACCEPT     tcp  --  anywhere             anywhere             tcp dpt:1993
ACCEPT     tcp  --  anywhere             anywhere             tcp dpt:21131
ACCEPT     tcp  --  anywhere             anywhere             tcp dpt:6080
ACCEPT     tcp  --  anywhere             anywhere             tcp dpt:8775
ACCEPT     tcp  --  anywhere             anywhere             tcp dpt:8774
ACCEPT     tcp  --  anywhere             anywhere             tcp dpt:8000
ACCEPT     tcp  --  anywhere             anywhere             tcp dpt:8003
ACCEPT     tcp  --  anywhere             anywhere             tcp dpt:8004
ACCEPT     tcp  --  anywhere             anywhere             tcp dpt:https
ACCEPT     tcp  --  anywhere             anywhere             tcp dpt:5000
ACCEPT     tcp  --  anywhere             anywhere             tcp dpt:35357
ACCEPT     tcp  --  anywhere             anywhere             tcp dpt:14000
ACCEPT     tcp  --  anywhere             anywhere             multiport dports epmd,61000
ACCEPT     tcp  --  anywhere             anywhere             multiport dports 5900:5999
ACCEPT     tcp  --  anywhere             anywhere             multiport dports 6080
ACCEPT     tcp  --  anywhere             anywhere             tcp dpt:amqps
ACCEPT     tcp  --  anywhere             anywhere             tcp dpt:rmqchk
ACCEPT     tcp  --  anywhere             anywhere             tcp dpt:amqp
ACCEPT     tcp  --  anywhere             anywhere             multiport dports 8774,8775
ACCEPT     tcp  --  anywhere             anywhere             tcp dpt:9501
ACCEPT     tcp  --  anywhere             anywhere             tcp dpt:mysqlchk
ACCEPT     tcp  --  anywhere             anywhere             tcp dpt:mysql
ACCEPT     tcp  --  anywhere             anywhere             tcp dpt:4444
ACCEPT     tcp  --  anywhere             anywhere             tcp dpt:4568
ACCEPT     tcp  --  anywhere             anywhere             tcp dpt:4567
ACCEPT     tcp  --  anywhere             anywhere             multiport dports 5000,35357
ACCEPT     tcp  --  anywhere             anywhere             multiport dports http,https
ACCEPT     tcp  --  anywhere             anywhere             multiport dports 8000,8003,8004
ACCEPT     tcp  --  anywhere             anywhere             tcp dpt:9191
ACCEPT     tcp  --  anywhere             anywhere             tcp dpt:9292
ACCEPT     udp  --  anywhere             anywhere             udp dpt:tftp
ACCEPT     tcp  --  anywhere             anywhere             tcp dpt:9696
ACCEPT     tcp  --  anywhere             anywhere             tcp dpt:8777
ACCEPT     tcp  --  anywhere             anywhere             tcp dpt:iscsi-target
ACCEPT     tcp  --  anywhere             anywhere             tcp dpt:8776
ACCEPT     tcp  --  anywhere             anywhere             tcp dpt:6556
ACCEPT     tcp  --  anywhere             anywhere             tcp dpt:http-alt
ACCEPT     all  --  anywhere             anywhere             PKTTYPE = multicast
ACCEPT     udp  --  anywhere             anywhere             udp dpt:4789
ACCEPT     all  --  anywhere             anywhere
ACCEPT     tcp  --  anywhere             anywhere             tcp dpt:ssh
ACCEPT     udp  --  anywhere             anywhere             udp dpt:ntp
ACCEPT     tcp  --  anywhere             anywhere             tcp dpt:sunrpc
ACCEPT     udp  --  anywhere             anywhere             udp dpt:sunrpc
ACCEPT     tcp  --  anywhere             anywhere             multiport dports domain,953
ACCEPT     udp  --  anywhere             anywhere             multiport dports domain,953
ACCEPT     tcp  --  anywhere             anywhere             tcp dpt:nfs
ACCEPT     udp  --  anywhere             anywhere             udp dpt:nfs
ACCEPT     udp  --  anywhere             anywhere             udp dpt:bootpc
ACCEPT     udp  --  anywhere             anywhere             udp dpt:bootps
ACCEPT     tcp  --  anywhere             anywhere             tcp dpt:27410
ACCEPT     all  --  anywhere             anywhere             state RELATED,ESTABLISHED
ACCEPT     icmp --  anywhere             anywhere             icmp echo-request state NEW,RELATED,ESTABLISHED
DROP       all  --  anywhere             anywhere

Chain FORWARD (policy ACCEPT)
target     prot opt source               destination
neutron-filter-top  all  --  anywhere             anywhere
neutron-openvswi-FORWARD  all  --  anywhere             anywhere
nova-filter-top  all  --  anywhere             anywhere
nova-api-FORWARD  all  --  anywhere             anywhere
ACCEPT     all  --  anywhere             192.168.122.0/24
ACCEPT     all  --  anywhere             192.0.2.0/24

Chain OUTPUT (policy ACCEPT)
target     prot opt source               destination
neutron-filter-top  all  --  anywhere             anywhere
neutron-openvswi-OUTPUT  all  --  anywhere             anywhere
nova-filter-top  all  --  anywhere             anywhere
nova-api-OUTPUT  all  --  anywhere             anywhere
ACCEPT     icmp --  anywhere             anywhere             icmp echo-reply state RELATED,ESTABLISHED

Chain neutron-filter-top (2 references)
target     prot opt source               destination
neutron-openvswi-local  all  --  anywhere             anywhere

Chain neutron-openvswi-FORWARD (1 references)
target     prot opt source               destination

Chain neutron-openvswi-INPUT (1 references)
target     prot opt source               destination

Chain neutron-openvswi-OUTPUT (1 references)
target     prot opt source               destination

Chain neutron-openvswi-local (1 references)
target     prot opt source               destination

Chain neutron-openvswi-sg-chain (0 references)
target     prot opt source               destination

Chain neutron-openvswi-sg-fallback (0 references)
target     prot opt source               destination
DROP       all  --  anywhere             anywhere

Chain nova-api-FORWARD (1 references)
target     prot opt source               destination

Chain nova-api-INPUT (1 references)
target     prot opt source               destination
ACCEPT     tcp  --  anywhere             overcloud-ce-controller-controller0-dlmy4f5tbc5d  tcp dpt:8775

Chain nova-api-OUTPUT (1 references)
target     prot opt source               destination

Chain nova-api-local (1 references)
target     prot opt source               destination

Chain nova-filter-top (2 references)
target     prot opt source               destination
nova-api-local  all  --  anywhere             anywhere

Check the network interfaces

ifconfig

root@overcloud-ce-controller-controller0-dlmy4f5tbc5d:~# ifconfig
br-svc    Link encap:Ethernet  HWaddr 00:17:a4:77:c4:4c
          inet6 addr: fe80::217:a4ff:fe77:c44c/64 Scope:Link
          UP BROADCAST RUNNING MULTICAST  MTU:1500  Metric:1
          RX packets:2772493 errors:0 dropped:0 overruns:0 frame:0
          TX packets:46102 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:0
          RX bytes:290319675 (276.8 MiB)  TX bytes:16179642 (15.4 MiB)

eth0      Link encap:Ethernet  HWaddr 00:17:a4:77:c4:4c
          inet addr:10.254.25.41  Bcast:10.254.25.255  Mask:255.255.255.0
          inet6 addr: fe80::217:a4ff:fe77:c44c/64 Scope:Link
          UP BROADCAST RUNNING MULTICAST  MTU:1500  Metric:1
          RX packets:1523742964 errors:0 dropped:0 overruns:0 frame:0
          TX packets:1790497085 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:1000
          RX bytes:726306267812 (676.4 GiB)  TX bytes:1050402770254 (978.2 GiB)

eth1      Link encap:Ethernet  HWaddr 00:17:a4:77:c4:4e
          UP BROADCAST MULTICAST  MTU:1500  Metric:1
          RX packets:0 errors:0 dropped:0 overruns:0 frame:0
          TX packets:0 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:1000
          RX bytes:0 (0.0 B)  TX bytes:0 (0.0 B)

eth2      Link encap:Ethernet  HWaddr a0:48:1c:e3:76:d8
          UP BROADCAST MULTICAST  MTU:1500  Metric:1
          RX packets:0 errors:0 dropped:0 overruns:0 frame:0
          TX packets:0 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:1000
          RX bytes:0 (0.0 B)  TX bytes:0 (0.0 B)

eth3      Link encap:Ethernet  HWaddr a0:48:1c:e3:76:dc
          UP BROADCAST MULTICAST  MTU:1500  Metric:1
          RX packets:0 errors:0 dropped:0 overruns:0 frame:0
          TX packets:0 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:1000
          RX bytes:0 (0.0 B)  TX bytes:0 (0.0 B)

lo        Link encap:Local Loopback
          inet addr:127.0.0.1  Mask:255.0.0.0
          inet6 addr: ::1/128 Scope:Host
          UP LOOPBACK RUNNING  MTU:65536  Metric:1
          RX packets:1945047763 errors:0 dropped:0 overruns:0 frame:0
          TX packets:1945047763 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:0
          RX bytes:602522625790 (561.1 GiB)  TX bytes:602522625790 (561.1 GiB)

vlan1273  Link encap:Ethernet  HWaddr 00:17:a4:77:c4:4c
          UP BROADCAST RUNNING MULTICAST  MTU:1500  Metric:1
          RX packets:4256076 errors:0 dropped:0 overruns:0 frame:0
          TX packets:49957 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:0
          RX bytes:328535584 (313.3 MiB)  TX bytes:16677363 (15.9 MiB)

vlan1274  Link encap:Ethernet  HWaddr 00:17:a4:77:c4:4c
          inet6 addr: fe80::217:a4ff:fe77:c44c/64 Scope:Link
          UP BROADCAST RUNNING MULTICAST  MTU:1500  Metric:1
          RX packets:4177709 errors:0 dropped:0 overruns:0 frame:0
          TX packets:112156 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:0
          RX bytes:581570315 (554.6 MiB)  TX bytes:7187715 (6.8 MiB)

Check the routing configuration

route -n

root@overcloud-ce-controller-controller0-dlmy4f5tbc5d:~# route -n
Kernel IP routing table
Destination     Gateway         Genmask         Flags   Metric Ref Use Iface
0.0.0.0         10.254.25.1     0.0.0.0         UG      0      0   0   eth0
10.254.25.0     0.0.0.0         255.255.255.0   U       0      0   0   eth0
169.254.169.254 10.254.25.14    255.255.255.255 UGH     0      0   0   eth0

Sometimes it’s useful to get the arp table too

arp -an

root@overcloud-ce-controller-controller0-dlmy4f5tbc5d:~# arp -an
? (10.254.25.1) at 00:00:0c:9f:f4:f8 [ether] on eth0
? (10.254.25.43) at 00:17:a4:77:c4:58 [ether] on eth0
? (10.254.25.12) at 00:17:a4:77:c4:3c [ether] on eth0
? (10.254.25.35) at 00:17:a4:77:c4:48 [ether] on eth0
? (10.254.25.42) at 00:17:a4:77:c4:50 [ether] on eth0
? (10.254.25.39) at 00:17:a4:77:c4:40 [ether] on eth0
? (10.254.25.38) at 00:17:a4:77:c4:48 [ether] on eth0
? (10.254.25.3) at 00:2a:6a:8b:88:43 [ether] on eth0
? (10.254.25.14) at 00:17:a4:77:c4:44 [ether] on eth0
? (10.254.25.40) at 00:17:a4:77:c4:54 [ether] on eth0
? (10.254.25.2) at 00:2a:6a:8b:8a:43 [ether] on eth0
? (10.254.25.44) at 00:17:a4:77:c4:f2 [ether] on eth0
? (10.254.25.250) at 2c:59:e5:95:0d:ae [ether] on eth0
? (10.254.25.13) at 00:56:31:33:8d:a1 [ether] on eth0

Check what network namespaces are configured

ip netns

root@overcloud-ce-controller-controller0-dlmy4f5tbc5d:~# ip netns
qrouter-6903d563-80f4-40b0-ba77-8774a915a323
qdhcp-e99f2cdd-eb42-4466-9b17-7cb85636c013
qdhcp-73ff3b91-77ad-4ef4-aa67-a99a5ef57650
snat-8497d1cb-c2fa-46a5-9e42-1bfceb810204
qrouter-8497d1cb-c2fa-46a5-9e42-1bfceb810204
qdhcp-e70da3b0-ad8d-4ec0-9dd7-40ba563d2416
qdhcp-4259ab26-a1c4-427e-a7e0-b941368c4e23
snat-64b856f2-00a7-4e2f-8abd-aa34ab454c34
qrouter-64b856f2-00a7-4e2f-8abd-aa34ab454c34

Sometimes it’s useful to get the arp table too

If you’re trying to debug an OpenStack issue then gather the same details above for all controller and compute nodes.

The next post will cover North-South Fixed IP Traffic Flow

Originally published on allthingscloud.eu (2015-11-25).

← All posts