[Users] Multi-homed, dual stack (ip4/ip6) Debian - Network Issues
Axton
axton.grams at gmail.com
Tue Feb 25 22:05:58 PST 2014
*Synopsis: *Servers are connected to a series of vlans. When server boots
with vz enabled in the inittab, the HN cannot reach routed ipv6 hosts. VEs
can reach routed ipv6 hosts.
I have tried to narrow down the cause of the issue to the extent that I
can, so the information presented below uses the fewest variables required
to illustrate the issues I see. In practice, these servers are connected
to more than two vlans and there are many CT's on each HE, which have
different combinations of vlan access. For the purposes of this
conversation I am only referencing 2 vlans since I can consistently
reproduce the issue with just 2 vlans.
*System Information (HE):*
Debian 7 (wheezy)
Software installed from http://download.openvz.org/debian wheezy main
linux-image-2.6.32-openvz-amd64 042stab084.26
linux-image-openvz-amd64 042+1
vzctl 4.6-1
vzquota 3.0.12-3
vzstats 0.5.2-1
*System Information (CT):*
Debian 7 (wheezy)
ploop
vswap
*General Network Information:*
The routers for all vlans offer ipv6 router advertisements.
Native ipv6 is available on all vlans.
The following VLANs are accessed by the HE:
vlan30 10.0.16.0/22 2001:xyz:abc:30::10/64
vlan40 10.0.20.0/22 2001:xyz:abc:40::10/64
*Network Information (HE):*
HE connects to the following VLANs, both of which are ipv4 and ipv6 dual
stack:
vlan30
vlan40
vlan30 is available as an interface to bridge to CT interfaces; it has not
addresses.
vlan40 (server) has addresses assigned.
venet is not used. All interfaces are veth.
/etc/network/interfaces contains the following:
root at cluster-02:~# cat /etc/network/interfaces |grep -v '#'
auto lo
iface lo inet loopback
iface eth1 inet manual
auto vmbr30
iface vmbr30 inet manual
up ip link set $IFACE up
bridge_ports eth1.30
bridge_stp off
bridge_fd 0
accept_ra 0
up echo 0 > /proc/sys/net/ipv6/conf/$IFACE/autoconf
up echo 0 > /proc/sys/net/ipv6/conf/$IFACE/accept_ra
auto vmbr40
iface vmbr40 inet static
address 10.0.20.58
netmask 255.255.252.0
broadcast 10.0.23.255
gateway 10.0.20.1
bridge_ports eth1.40
bridge_stp off
bridge_fd 0
My network interfaces look like this with the configuration above:
root at cluster-02:~# ifconfig -a
eth0 Link encap:Ethernet HWaddr 00:25:90:61:74:52
BROADCAST MULTICAST MTU:1500 Metric:1
RX packets:0 errors:0 dropped:0 overruns:0 frame:0
TX packets:0 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:1000
RX bytes:0 (0.0 B) TX bytes:0 (0.0 B)
Interrupt:16 Memory:fe9e0000-fea00000
eth1 Link encap:Ethernet HWaddr 00:25:90:61:74:53
inet6 addr: fe80::225:90ff:fe61:7453/64 Scope:Link
UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1
RX packets:344 errors:0 dropped:0 overruns:0 frame:0
TX packets:202 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:1000
RX bytes:40443 (39.4 KiB) TX bytes:25467 (24.8 KiB)
Interrupt:17 Memory:feae0000-feb00000
eth1.30 Link encap:Ethernet HWaddr 00:25:90:61:74:53
UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1
RX packets:27 errors:0 dropped:0 overruns:0 frame:0
TX packets:2 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:0
RX bytes:2542 (2.4 KiB) TX bytes:140 (140.0 B)
eth1.40 Link encap:Ethernet HWaddr 00:25:90:61:74:53
UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1
RX packets:227 errors:0 dropped:0 overruns:0 frame:0
TX packets:193 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:0
RX bytes:24822 (24.2 KiB) TX bytes:24749 (24.1 KiB)
lo Link encap:Local Loopback
inet addr:127.0.0.1 Mask:255.0.0.0
inet6 addr: ::1/128 Scope:Host
UP LOOPBACK RUNNING MTU:16436 Metric:1
RX packets:0 errors:0 dropped:0 overruns:0 frame:0
TX packets:0 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:0
RX bytes:0 (0.0 B) TX bytes:0 (0.0 B)
vmbr30 Link encap:Ethernet HWaddr 00:25:90:61:74:53
inet6 addr: fe80::225:90ff:fe61:7453/64 Scope:Link
UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1
RX packets:27 errors:0 dropped:0 overruns:0 frame:0
TX packets:7 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:0
RX bytes:2542 (2.4 KiB) TX bytes:578 (578.0 B)
vmbr40 Link encap:Ethernet HWaddr 00:25:90:61:74:53
inet addr:10.0.20.58 Bcast:10.0.23.255 Mask:255.255.252.0
inet6 addr: 2001:xyz:abc:40:225:90ff:fe61:7453/64 Scope:Global
inet6 addr: fe80::225:90ff:fe61:7453/64 Scope:Link
UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1
RX packets:227 errors:0 dropped:0 overruns:0 frame:0
TX packets:196 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:0
RX bytes:24762 (24.1 KiB) TX bytes:25039 (24.4 KiB)
My routes look like this:
root at cluster-02:~# ip -4 route show
10.0.20.0/22 dev vmbr40 proto kernel scope link src 10.0.20.58
default via 10.0.20.1 dev vmbr40
root at cluster-02:~# ip -6 route show
2001:xyz:abc:40::/64 dev vmbr40 proto kernel metric 256 expires
2147157sec mtu 1500 advmss 1440 hoplimit 0
fe80::/64 dev vmbr30 proto kernel metric 256 mtu 1500 advmss 1440
hoplimit 0
fe80::/64 dev vmbr40 proto kernel metric 256 mtu 1500 advmss 1440
hoplimit 0
fe80::/64 dev eth1 proto kernel metric 256 mtu 1500 advmss 1440 hoplimit
0
fe80::/64 dev eth1.40 proto kernel metric 256 mtu 1500 advmss 1440
hoplimit 0
fe80::/64 dev eth1.30 proto kernel metric 256 mtu 1500 advmss 1440
hoplimit 0
default via fe80::225:90ff:fe09:9b81 dev vmbr40 proto kernel metric 1024
expires 11sec mtu 1500 advmss 1440 hoplimit 64
root at cluster-02:~# ip -6 neigh
2001:xyz:abc:40::10 dev vmbr40 lladdr 00:25:90:09:9b:81 router STALE
fe80::225:90ff:fe09:9b81 dev vmbr30 lladdr 00:25:90:09:9b:81 router STALE
fe80::225:90ff:fe09:9b81 dev vmbr40 lladdr 00:25:90:09:9b:81 router STALE
*Network Information (CT):*
*HE Information:*
sysctl.conf contains no entries; I do not use venet interfaces.
*CT Information:*
*Here are my observations:*
*1. **If I boot the machine with vz disabled in the inittab, I am able to
reach ipv6 hosts on the other side of my router.*
root at cluster-02:~# ping6 google.com
PING google.com(yv-in-x8b.1e100.net) 56 data bytes
64 bytes from yv-in-x8b.1e100.net: icmp_seq=1 ttl=56 time=58.4 ms
64 bytes from yv-in-x8b.1e100.net: icmp_seq=2 ttl=56 time=58.4 ms
^C
--- google.com ping statistics ---
2 packets transmitted, 2 received, 0% packet loss, time 1002ms
rtt min/avg/max/mdev = 58.413/58.454/58.495/0.041 ms
root at cluster-02:~# ping google.com
PING google.com (74.125.21.138) 56(84) bytes of data.
64 bytes from yv-in-f138.1e100.net (74.125.21.138): icmp_req=1 ttl=39
time=36.9 ms
64 bytes from yv-in-f138.1e100.net (74.125.21.138): icmp_req=2 ttl=39
time=48.1 ms
^C
--- google.com ping statistics ---
2 packets transmitted, 2 received, 0% packet loss, time 1002ms
rtt min/avg/max/mdev = 36.949/42.548/48.147/5.599 ms
root at cluster-02:~# ping router
PING router.home.arswiki.org (10.0.20.1) 56(84) bytes of data.
64 bytes from router.home.arswiki.org (10.0.20.1): icmp_req=1 ttl=255
time=0.265 ms
64 bytes from router.home.arswiki.org (10.0.20.1): icmp_req=2 ttl=255
time=0.243 ms
^C
--- router.home.arswiki.org ping statistics ---
2 packets transmitted, 2 received, 0% packet loss, time 1005ms
rtt min/avg/max/mdev = 0.243/0.254/0.265/0.011 ms
root at cluster-02:~# ping6 router
PING router(2001:xyz:abc:40::10) 56 data bytes
64 bytes from 2001:xyz:abc:40::10: icmp_seq=1 ttl=64 time=0.480 ms
64 bytes from 2001:xyz:abc:40::10: icmp_seq=2 ttl=64 time=0.275 ms
^C
--- router ping statistics ---
2 packets transmitted, 2 received, 0% packet loss, time 1001ms
*2.* *If I boot the machine with vz disabled in the inittab and I start vz
after the system is fully available; everything works as desired.*
My interfaces in the CT look good:
root at cluster-02:/etc/init.d# vzctl enter 10000
root at debtmp01:/# ifconfig -a
eth30 Link encap:Ethernet HWaddr 00:30:51:e3:59:2c
inet addr:10.0.19.9 Bcast:10.0.19.255 Mask:255.255.252.0
inet6 addr: 2001:xyz:abc:30:230:51ff:fee3:592c/64 Scope:Global
inet6 addr: fe80::230:51ff:fee3:592c/64 Scope:Link
UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1
RX packets:118 errors:0 dropped:0 overruns:0 frame:0
TX packets:53 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:0
RX bytes:13089 (12.7 KiB) TX bytes:4308 (4.2 KiB)
eth40 Link encap:Ethernet HWaddr 00:30:51:d9:db:0d
inet addr:10.0.23.10 Bcast:10.0.23.255 Mask:255.255.252.0
inet6 addr: 2001:xyz:abc:40:230:51ff:fed9:db0d/64 Scope:Global
inet6 addr: fe80::230:51ff:fed9:db0d/64 Scope:Link
UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1
RX packets:86 errors:0 dropped:0 overruns:0 frame:0
TX packets:13 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:0
RX bytes:7682 (7.5 KiB) TX bytes:1376 (1.3 KiB)
lo Link encap:Local Loopback
inet addr:127.0.0.1 Mask:255.0.0.0
inet6 addr: ::1/128 Scope:Host
UP LOOPBACK RUNNING MTU:16436 Metric:1
RX packets:0 errors:0 dropped:0 overruns:0 frame:0
TX packets:0 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:0
RX bytes:0 (0.0 B) TX bytes:0 (0.0 B)
venet0 Link encap:UNSPEC HWaddr
00-00-00-00-00-00-00-00-00-00-00-00-00-00-00-00
BROADCAST POINTOPOINT NOARP MTU:1500 Metric:1
RX packets:0 errors:0 dropped:0 overruns:0 frame:0
TX packets:0 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:0
RX bytes:0 (0.0 B) TX bytes:0 (0.0 B)
I can ping routed hosts/router from HE:
root at cluster-02:/etc/init.d# ping6 google.com
PING google.com(yv-in-x65.1e100.net) 56 data bytes
64 bytes from yv-in-x65.1e100.net: icmp_seq=1 ttl=56 time=58.8 ms
64 bytes from yv-in-x65.1e100.net: icmp_seq=2 ttl=56 time=59.0 ms
^C
--- google.com ping statistics ---
2 packets transmitted, 2 received, 0% packet loss, time 1002ms
rtt min/avg/max/mdev = 58.872/58.961/59.051/0.258 ms
root at cluster-02:/etc/init.d# ping google.com
PING google.com (74.125.21.102) 56(84) bytes of data.
64 bytes from yv-in-f102.1e100.net (74.125.21.102): icmp_req=1 ttl=39
time=31.6 ms
64 bytes from yv-in-f102.1e100.net (74.125.21.102): icmp_req=2 ttl=39
time=30.3 ms
^C
--- google.com ping statistics ---
2 packets transmitted, 2 received, 0% packet loss, time 1003ms
rtt min/avg/max/mdev = 30.323/30.969/31.615/0.646 ms
root at cluster-02:/etc/init.d# ping router
PING router.home.arswiki.org (10.0.20.1) 56(84) bytes of data.
64 bytes from router.home.arswiki.org (10.0.20.1): icmp_req=1 ttl=255
time=0.232 ms
64 bytes from router.home.arswiki.org (10.0.20.1): icmp_req=2 ttl=255
time=0.256 ms
^C
--- router.home.arswiki.org ping statistics ---
2 packets transmitted, 2 received, 0% packet loss, time 1001ms
rtt min/avg/max/mdev = 0.232/0.244/0.256/0.012 ms
root at cluster-02:/etc/init.d# ping6 router
PING router(2001:xyz:abc:40::10) 56 data bytes
64 bytes from 2001:xyz:abc:40::10: icmp_seq=1 ttl=64 time=0.302 ms
64 bytes from 2001:xyz:abc:40::10: icmp_seq=2 ttl=64 time=0.250 ms
^C
--- router ping statistics ---
2 packets transmitted, 2 received, 0% packet loss, time 1001ms
rtt min/avg/max/mdev = 0.250/0.276/0.302/0.026 ms
I can ping routed hosts/router from CT:
root at cluster-02:/etc/init.d# vzctl enter 10000
entered into CT 10000
root at debtmp01:/# ping6 google.com
PING google.com(yv-in-x8a.1e100.net) 56 data bytes
64 bytes from yv-in-x8a.1e100.net: icmp_seq=1 ttl=56 time=60.8 ms
64 bytes from yv-in-x8a.1e100.net: icmp_seq=2 ttl=56 time=66.9 ms
^C
--- google.com ping statistics ---
2 packets transmitted, 2 received, 0% packet loss, time 1008ms
rtt min/avg/max/mdev = 60.870/63.894/66.918/3.024 ms
root at debtmp01:/# ping google.com
PING google.com (74.125.21.138) 56(84) bytes of data.
64 bytes from yv-in-f138.1e100.net (74.125.21.138): icmp_req=1 ttl=39
time=39.1 ms
64 bytes from yv-in-f138.1e100.net (74.125.21.138): icmp_req=2 ttl=39
time=36.2 ms
^C
--- google.com ping statistics ---
2 packets transmitted, 2 received, 0% packet loss, time 1002ms
rtt min/avg/max/mdev = 36.209/37.683/39.158/1.487 ms
root at debtmp01:/# ping router
PING router.home.arswiki.org (10.0.16.1) 56(84) bytes of data.
64 bytes from router.home.arswiki.org (10.0.16.1): icmp_req=1 ttl=255
time=0.327 ms
64 bytes from router.home.arswiki.org (10.0.16.1): icmp_req=2 ttl=255
time=0.307 ms
^C
--- router.home.arswiki.org ping statistics ---
2 packets transmitted, 2 received, 0% packet loss, time 1001ms
rtt min/avg/max/mdev = 0.307/0.317/0.327/0.010 ms
root at debtmp01:/# ping6 router
PING router(2001:xyz:abc:30::10) 56 data bytes
64 bytes from 2001:xyz:abc:30::10: icmp_seq=1 ttl=64 time=1.65 ms
64 bytes from 2001:xyz:abc:30::10: icmp_seq=2 ttl=64 time=0.290 ms
^C
--- router ping statistics ---
2 packets transmitted, 2 received, 0% packet loss, time 1002ms
rtt min/avg/max/mdev = 0.290/0.970/1.650/0.680 ms
*3. **If I boot the machine with vz enabled in the inittab, I am not able
to reach ipv6 hosts on the other side of my router from the HE.*
The interfaces on the HE look good:
root at cluster-02:~# ifconfig -a
eth0 Link encap:Ethernet HWaddr 00:25:90:61:74:52
BROADCAST MULTICAST MTU:1500 Metric:1
RX packets:0 errors:0 dropped:0 overruns:0 frame:0
TX packets:0 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:1000
RX bytes:0 (0.0 B) TX bytes:0 (0.0 B)
Interrupt:16 Memory:fe9e0000-fea00000
eth1 Link encap:Ethernet HWaddr 00:25:90:61:74:53
inet6 addr: fe80::225:90ff:fe61:7453/64 Scope:Link
UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1
RX packets:409 errors:0 dropped:0 overruns:0 frame:0
TX packets:210 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:1000
RX bytes:48062 (46.9 KiB) TX bytes:28975 (28.2 KiB)
Interrupt:17 Memory:feae0000-feb00000
eth1.30 Link encap:Ethernet HWaddr 00:25:90:61:74:53
UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1
RX packets:48 errors:0 dropped:0 overruns:0 frame:0
TX packets:2 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:0
RX bytes:4151 (4.0 KiB) TX bytes:140 (140.0 B)
eth1.40 Link encap:Ethernet HWaddr 00:25:90:61:74:53
UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1
RX packets:248 errors:0 dropped:0 overruns:0 frame:0
TX packets:201 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:0
RX bytes:28171 (27.5 KiB) TX bytes:28257 (27.5 KiB)
lo Link encap:Local Loopback
inet addr:127.0.0.1 Mask:255.0.0.0
inet6 addr: ::1/128 Scope:Host
UP LOOPBACK RUNNING MTU:16436 Metric:1
RX packets:0 errors:0 dropped:0 overruns:0 frame:0
TX packets:0 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:0
RX bytes:0 (0.0 B) TX bytes:0 (0.0 B)
venet0 Link encap:UNSPEC HWaddr
00-00-00-00-00-00-00-00-00-00-00-00-00-00-00-00
inet6 addr: fe80::1/128 Scope:Link
UP BROADCAST POINTOPOINT RUNNING NOARP MTU:1500 Metric:1
RX packets:0 errors:0 dropped:0 overruns:0 frame:0
TX packets:0 errors:0 dropped:3 overruns:0 carrier:0
collisions:0 txqueuelen:0
RX bytes:0 (0.0 B) TX bytes:0 (0.0 B)
veth10000.30 Link encap:Ethernet HWaddr 00:30:51:0b:82:75
inet6 addr: fe80::230:51ff:fe0b:8275/64 Scope:Link
UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1
RX packets:1 errors:0 dropped:0 overruns:0 frame:0
TX packets:37 errors:0 dropped:10 overruns:0 carrier:0
collisions:0 txqueuelen:0
RX bytes:76 (76.0 B) TX bytes:3353 (3.2 KiB)
veth10000.40 Link encap:Ethernet HWaddr 00:30:51:01:f6:5b
inet6 addr: fe80::230:51ff:fe01:f65b/64 Scope:Link
UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1
RX packets:1 errors:0 dropped:0 overruns:0 frame:0
TX packets:41 errors:0 dropped:10 overruns:0 carrier:0
collisions:0 txqueuelen:0
RX bytes:76 (76.0 B) TX bytes:3515 (3.4 KiB)
vmbr30 Link encap:Ethernet HWaddr 00:25:90:61:74:53
inet6 addr: fe80::225:90ff:fe61:7453/64 Scope:Link
UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1
RX packets:41 errors:0 dropped:0 overruns:0 frame:0
TX packets:7 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:0
RX bytes:3619 (3.5 KiB) TX bytes:578 (578.0 B)
vmbr40 Link encap:Ethernet HWaddr 00:25:90:61:74:53
inet addr:10.0.20.58 Bcast:10.0.23.255 Mask:255.255.252.0
inet6 addr: 2001:xyz:abc:40:225:90ff:fe61:7453/64 Scope:Global
inet6 addr: fe80::225:90ff:fe61:7453/64 Scope:Link
UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1
RX packets:241 errors:0 dropped:0 overruns:0 frame:0
TX packets:205 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:0
RX bytes:27589 (26.9 KiB) TX bytes:28625 (27.9 KiB)
The routes on the HE look good:
root at cluster-02:~# ip -4 route
10.0.20.0/22 dev vmbr40 proto kernel scope link src 10.0.20.58
default via 10.0.20.1 dev vmbr40
root at cluster-02:~# ip -6 route
2001:xyz:abc:40::/64 dev vmbr40 proto kernel metric 256 expires
2147157sec mtu 1500 advmss 1440 hoplimit 0
fe80::1 dev venet0 proto kernel metric 256 mtu 1500 advmss 1440 hoplimit
0
fe80::/64 dev vmbr30 proto kernel metric 256 mtu 1500 advmss 1440
hoplimit 0
fe80::/64 dev vmbr40 proto kernel metric 256 mtu 1500 advmss 1440
hoplimit 0
fe80::/64 dev eth1 proto kernel metric 256 mtu 1500 advmss 1440 hoplimit
0
fe80::/64 dev eth1.40 proto kernel metric 256 mtu 1500 advmss 1440
hoplimit 0
fe80::/64 dev eth1.30 proto kernel metric 256 mtu 1500 advmss 1440
hoplimit 0
fe80::/64 dev venet0 proto kernel metric 256 mtu 1500 advmss 1440
hoplimit 0
fe80::/64 dev veth10000.40 proto kernel metric 256 mtu 1500 advmss 1440
hoplimit 0
fe80::/64 dev veth10000.30 proto kernel metric 256 mtu 1500 advmss 1440
hoplimit 0
default via fe80::225:90ff:fe09:9b81 dev vmbr40 proto kernel metric 1024
expires 11sec mtu 1500 advmss 1440 hoplimit 64
root at cluster-02:~# ip -6 neigh
fe80::225:90ff:fe09:9b81 dev vmbr40 lladdr 00:25:90:09:9b:81 router
REACHABLE
2001:xyz:abc:40::10 dev vmbr40 lladdr 00:25:90:09:9b:81 router STALE
fe80::225:90ff:fe09:9b81 dev vmbr30 lladdr 00:25:90:09:9b:81 router STALE
The ipv6 traffic from the HE cannot, however, get past the router.
agrams at cluster-02:~$ sudo su -
root at cluster-02:~# ping6 router
PING router(2001:xyz:abc:40::10) 56 data bytes
64 bytes from 2001:xyz:abc:40::10: icmp_seq=1 ttl=64 time=0.259 ms
64 bytes from 2001:xyz:abc:40::10: icmp_seq=2 ttl=64 time=0.251 ms
^C
--- router ping statistics ---
2 packets transmitted, 2 received, 0% packet loss, time 1001ms
rtt min/avg/max/mdev = 0.251/0.255/0.259/0.004 ms
root at cluster-02:~# ping6 google.com
PING google.com(yv-in-x64.1e100.net) 56 data bytes
ping: sendmsg: Network is down
ping: sendmsg: Network is down
^C
--- google.com ping statistics ---
2 packets transmitted, 0 received, 100% packet loss, time 999ms
root at cluster-02:~# ping google.com
PING google.com (74.125.21.113) 56(84) bytes of data.
64 bytes from yv-in-f113.1e100.net (74.125.21.113): icmp_req=1 ttl=39
time=29.8 ms
64 bytes from yv-in-f113.1e100.net (74.125.21.113): icmp_req=2 ttl=39
time=46.0 ms
^C
--- google.com ping statistics ---
2 packets transmitted, 2 received, 0% packet loss, time 1001ms
rtt min/avg/max/mdev = 29.845/37.942/46.040/8.099 ms
root at cluster-02:~# ping router
PING router.home.arswiki.org (10.0.20.1) 56(84) bytes of data.
64 bytes from router.home.arswiki.org (10.0.20.1): icmp_req=1 ttl=255
time=0.273 ms
64 bytes from router.home.arswiki.org (10.0.20.1): icmp_req=2 ttl=255
time=0.254 ms
^C
--- router.home.arswiki.org ping statistics ---
2 packets transmitted, 2 received, 0% packet loss, time 1001ms
rtt min/avg/max/mdev = 0.254/0.263/0.273/0.018 ms
The ipv6 traffic from the HE can, however, get past the router:
root at debtmp01:/# ping6 google.com
PING google.com(yv-in-x64.1e100.net) 56 data bytes
64 bytes from yv-in-x64.1e100.net: icmp_seq=1 ttl=56 time=57.6 ms
64 bytes from yv-in-x64.1e100.net: icmp_seq=2 ttl=56 time=57.7 ms
^C
--- google.com ping statistics ---
2 packets transmitted, 2 received, 0% packet loss, time 1001ms
rtt min/avg/max/mdev = 57.630/57.702/57.775/0.250 ms
root at debtmp01:/# ping6 router
PING router(2001:xyz:abc:40::10) 56 data bytes
64 bytes from 2001:xyz:abc:40::10: icmp_seq=1 ttl=64 time=1.61 ms
64 bytes from 2001:xyz:abc:40::10: icmp_seq=2 ttl=64 time=0.289 ms
^C
--- router ping statistics ---
2 packets transmitted, 2 received, 0% packet loss, time 1001ms
rtt min/avg/max/mdev = 0.289/0.953/1.618/0.665 ms
root at debtmp01:/# ping google.com
PING google.com (74.125.21.138) 56(84) bytes of data.
64 bytes from yv-in-f138.1e100.net (74.125.21.138): icmp_req=1 ttl=39
time=32.7 ms
64 bytes from yv-in-f138.1e100.net (74.125.21.138): icmp_req=2 ttl=39
time=31.2 ms
^C
--- google.com ping statistics ---
2 packets transmitted, 2 received, 0% packet loss, time 1001ms
rtt min/avg/max/mdev = 31.273/31.989/32.706/0.738 ms
root at debtmp01:/# ping router
PING router.home.arswiki.org (10.0.20.1) 56(84) bytes of data.
64 bytes from router.home.arswiki.org (10.0.20.1): icmp_req=1 ttl=255
time=2.06 ms
64 bytes from router.home.arswiki.org (10.0.20.1): icmp_req=2 ttl=255
time=0.268 ms
^C
--- router.home.arswiki.org ping statistics ---
2 packets transmitted, 2 received, 0% packet loss, time 1002ms
rtt min/avg/max/mdev = 0.268/1.165/2.063/0.898 ms
If I stop VZ when things are in this condition, the ipv6 traffic from the
HE still cannot get past the router. I have to ifdown/ifup vzbr40 to
correct the issue. After the ifdown/ifup, the interface looks like this:
root at cluster-02:~# ifconfig vmbr40
vmbr40 Link encap:Ethernet HWaddr 00:25:90:61:74:53
inet addr:10.0.20.58 Bcast:10.0.23.255 Mask:255.255.252.0
inet6 addr: 2001:470:e067:40:225:90ff:fe61:7453/64 Scope:Global
inet6 addr: fe80::225:90ff:fe61:7453/64 Scope:Link
UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1
RX packets:190 errors:0 dropped:0 overruns:0 frame:0
TX packets:125 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:0
RX bytes:17957 (17.5 KiB) TX bytes:16928 (16.5 KiB)
root at cluster-02:~# ip neigh
2001:470:e067:40::10 dev vmbr40 lladdr 00:25:90:09:9b:81 router STALE
fe80::225:90ff:fe09:9b81 dev vmbr30 lladdr 00:25:90:09:9b:81 router STALE
fe80::225:90ff:fe09:9b81 dev vmbr40 lladdr 00:25:90:09:9b:81 router STALE
10.0.20.250 dev vmbr40 lladdr 00:18:51:08:cb:0b STALE
10.0.23.11 dev vmbr40 lladdr ac:22:0b:51:32:de REACHABLE
root at cluster-02:~# ip -6 route
2001:470:e067:40::/64 dev vmbr40 proto kernel metric 256 expires
2147157sec mtu 1500 advmss 1440 hoplimit 0
fe80::/64 dev vmbr30 proto kernel metric 256 mtu 1500 advmss 1440
hoplimit 0
fe80::/64 dev eth1 proto kernel metric 256 mtu 1500 advmss 1440 hoplimit
0
fe80::/64 dev eth1.30 proto kernel metric 256 mtu 1500 advmss 1440
hoplimit 0
fe80::/64 dev eth1.40 proto kernel metric 256 mtu 1500 advmss 1440
hoplimit 0
fe80::/64 dev vmbr40 proto kernel metric 256 mtu 1500 advmss 1440
hoplimit 0
default via fe80::225:90ff:fe09:9b81 dev vmbr40 proto kernel metric 1024
expires 9sec mtu 1500 advmss 1440 hoplimit 64
root at cluster-02:~# ip route
10.0.20.0/22 dev vmbr40 proto kernel scope link src 10.0.20.58
default via 10.0.20.1 dev vmbr40
This issue looks to be some kind of race condition during system
initialization between VZ and the network configuration, though I have yet
to nail down the exact cause. It does not look to be an issue with the
network configuration itself, since that works correctly if I start VZ
after the system is fully up. I am looking for any guidance on
troubleshooting this issue further. I cannot find a difference in the
configuration between the working state (observation 2) and broken state
(observation 3).
Any help is appreciated.
Thanks,
Axton Grams
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.openvz.org/pipermail/users/attachments/20140226/ceb0da2b/attachment-0001.html>
More information about the Users
mailing list