[CRIU] Dumping a FUSE mount

Jonathan 'Wolf' Rentzsch nil at redshed.net
Thu Oct 8 16:06:47 PDT 2015


> On Oct 8, 2015, at 1:49 PM, Pavel Emelyanov <xemul at parallels.com> wrote:
>> The "/app/available_modules:/mnt/stretch/all_modules_dupe" external mount was already in place.
>> 
>> I went further and manually added a hard-coded “./app/available_modules:/mnt/stretch/all_modules_dupe” to make sure that leading period wasn’t tripping things up some how.
>> 
>> Same error: 
>> 
>> Error (mount.c:1480): Can't mount at ./app/available_modules: No such device
>> 
>> Obviously I’m missing something else.
> 
> Indeed. Can you attach full restore log?

Of course. It follows. I added a bit more logging to this version, see the lines with ‘wolf’ in them,

-Wolf

root at ip-172-31-46-108:/tmp/checkpoints/6533f087751536cd506bc1c98a8a5984# cat 3d74f66b2398232ad415d99fc8bc7be195affd3e at 2/restore-work-1444345530603/restore.log 
(00.000025) Added eth0:veth3d3c54e veth map
(00.000043) Added /app/available_modules:/mnt/stretch/all_modules_dupe ext mount mapping
(00.000048) Added /etc/resolv.conf:/var/lib/evaldocker/containers/820991fd8b4b723760204cd199feb400b2b0960d1fd0f6e04a778057f941defb/resolv.conf ext mount mapping
(00.000050) Added /etc/hostname:/var/lib/evaldocker/containers/820991fd8b4b723760204cd199feb400b2b0960d1fd0f6e04a778057f941defb/hostname ext mount mapping
(00.000052) Added /etc/hosts:/var/lib/evaldocker/containers/820991fd8b4b723760204cd199feb400b2b0960d1fd0f6e04a778057f941defb/hosts ext mount mapping
(00.000055) Added ./app/available_modules:/mnt/stretch/all_modules_dupe ext mount mapping
(00.000130) TCP recv queue memory limit is 3145728
(00.000156) cpu: fpu:1 fxsr:1 xsave:1
(00.000249) vdso: Parsing at 7ffff1585000 7ffff1587000
(00.000256) vdso: PT_LOAD p_vaddr: ffffffffff700000
(00.000259) vdso: DT_HASH: 0xffffffffff700120
(00.000261) vdso: DT_STRTAB: 0xffffffffff700268
(00.000263) vdso: DT_SYMTAB: 0xffffffffff700160
(00.000265) vdso: DT_STRSZ: 94
(00.000267) vdso: DT_SYMENT: 24
(00.000269) vdso: nbucket 3 nchain 11 bucket 0x7ffff1585128 chain 0x7ffff1585134
(00.000273) vdso: rt [vdso] 7ffff1585000-7ffff1587000 [vvar] ffffffffffffffff-ffffffffffffffff
(00.000306) Reading image tree
(00.000338) Add mnt ns 11 pid 1
(00.000361) Will restore in 6c020000 namespaces
(00.000365) NS mask to use 6c020000
(00.000372) Collecting 36/21 (flags 0)
(00.000395)  `- ... done
(00.000434) cg: Preparing cgroups yard
(00.000508) cg: Opening .criu.cgyard.zuK63w as cg yard
(00.000517) cg: 	Making subdir .criu.cgyard.zuK63w/cpuset (cpuset)
(00.000641) cg: Created dir cpuset/docker/ded4bc2bda613f947cf1447c02004176512636c9c2ff77ccb0bead670b094827
(00.000768) cg: Restored cgroup property value 0-1 to cpuset/docker/ded4bc2bda613f947cf1447c02004176512636c9c2ff77ccb0bead670b094827/cpuset.cpus
(00.000796) cg: Restored cgroup property value 0 to cpuset/docker/ded4bc2bda613f947cf1447c02004176512636c9c2ff77ccb0bead670b094827/cpuset.mems
(00.000801) cg: 	Making subdir .criu.cgyard.zuK63w/cpu (cpu)
(00.000864) cg: Created dir cpu/docker/ded4bc2bda613f947cf1447c02004176512636c9c2ff77ccb0bead670b094827
(00.000869) cg: 	Making subdir .criu.cgyard.zuK63w/cpuacct (cpuacct)
(00.000953) cg: Created dir cpuacct/docker/ded4bc2bda613f947cf1447c02004176512636c9c2ff77ccb0bead670b094827
(00.000957) cg: 	Making subdir .criu.cgyard.zuK63w/memory (memory)
(00.001059) cg: Created dir memory/docker/ded4bc2bda613f947cf1447c02004176512636c9c2ff77ccb0bead670b094827
(00.001063) cg: 	Making subdir .criu.cgyard.zuK63w/devices (devices)
(00.001112) cg: Created dir devices/docker/ded4bc2bda613f947cf1447c02004176512636c9c2ff77ccb0bead670b094827
(00.001116) cg: 	Making subdir .criu.cgyard.zuK63w/freezer (freezer)
(00.001163) cg: Created dir freezer/docker/ded4bc2bda613f947cf1447c02004176512636c9c2ff77ccb0bead670b094827
(00.001167) cg: 	Making subdir .criu.cgyard.zuK63w/blkio (blkio)
(00.001253) cg: Created dir blkio/docker/ded4bc2bda613f947cf1447c02004176512636c9c2ff77ccb0bead670b094827
(00.001258) cg: 	Making subdir .criu.cgyard.zuK63w/perf_event (perf_event)
(00.001320) cg: Created dir perf_event/docker/ded4bc2bda613f947cf1447c02004176512636c9c2ff77ccb0bead670b094827
(00.001324) cg: 	Making subdir .criu.cgyard.zuK63w/hugetlb (hugetlb)
(00.001347) cg: Determined dir hugetlb/ already existed
(00.001351) cg: Determined dir hugetlb//docker already existed
(00.001355) cg: Determined dir hugetlb//docker/e990bf1017b6868b94fcd1852814e3f7bb2b8959fe8d9d2962dd372fa82fa49d already existed
(00.001358) cg: Determined dir hugetlb//docker/ae4a38a9d5602538ca6820adf33e1879cd79554bc9ce60af33c8342ad6a51a9f already existed
(00.001362) cg: Determined dir hugetlb//docker/2aedc19a1af35a2e209ff67cc8c06fd2efced49980c01c96f0781ec8c3233045 already existed
(00.001366) cg: Determined dir hugetlb//docker/3f5ec2f8598e7d3811035fdc2fad25024c3135540609b8c71707fa087109ab27 already existed
(00.001369) cg: Determined dir hugetlb//docker/79b924319ddf33f5529064db0b3cb5f9f9d3750d533acbc70690f70e902947a4 already existed
(00.001373) cg: Determined dir hugetlb//docker/6b5a0d0e4e0dd6df87ff6917cc49f07e8ad99fcdec0fef3a0ece97787bac3b4a already existed
(00.001382) cg: Determined dir hugetlb//docker/3453f9fa6743c3f0df4b3f47a44c379d4e6370369c23dff2917678293033ccc3 already existed
(00.001385) cg: Determined dir hugetlb//docker/3933a1d2b31150d591e7b6bbc66c3e1d1d1f7477ed5bbc7b06d969c4bda2fb05 already existed
(00.001389) cg: Determined dir hugetlb//docker/17f118c16022c8997a018950a2ab06196b2e7d99f2cdb1f0bbee50a9986ee3f5 already existed
(00.001392) cg: Determined dir hugetlb//docker/71e3ccc1ecb392f0e8ec5f81329de197a5bcb9d3dac5e7a2ad1a3355a0b6dc02 already existed
(00.001396) cg: Determined dir hugetlb//docker/7ddc715444ee16ab5018e60949df45844384ffc81eb17d8b951e40c5852f62d2 already existed
(00.001399) cg: Determined dir hugetlb//docker/1c417c45ab83559a76b53f2225e2529645cedf1f2414714288cf4ade5db3be20 already existed
(00.001403) cg: Determined dir hugetlb//docker/a5cfcebfa0a9f394eba6af9329f7f049665df8bec3c16d6906f74811a3326b6c already existed
(00.001406) cg: Determined dir hugetlb//docker/8bc9384f3af47c35776a254aac9e5391e3351f238cf13767adbfb331d8e11c38 already existed
(00.001409) cg: Determined dir hugetlb//docker/e44bd388e77ec08abdb61ef59b2e86437b796bce5c7fc8e15c1bc946fe11edd6 already existed
(00.001412) cg: Determined dir hugetlb//docker/fdc3dc8e5786ed009ba89de65f435f3be8aa1ee196d6f6770b4a239362c6c2b9 already existed
(00.001416) cg: Determined dir hugetlb//docker/9f8a929b11dd9d3c867942629888cd48844a9da81eef95f79fb7c51b217b9b42 already existed
(00.001419) cg: Determined dir hugetlb//docker/7fe964599bb3ac46e85c8248b1be0a6eb2949daa763a1ef903a2a2e401cbf635 already existed
(00.001422) cg: Determined dir hugetlb//docker/05ca6459dfaaeb9a3a5b93bfa6864da2939d6700b75927ef682ca63c9857b1c4 already existed
(00.001426) cg: Determined dir hugetlb//docker/1c595f99fb238b876097f1e63d311a029a43959ef1781780cbeb05e4c1377aa1 already existed
(00.001429) cg: Determined dir hugetlb//docker/397ed88cdb24bc3063a937eeb2e351160249149f1acb0ff6f54325024cd65910 already existed
(00.001432) cg: Determined dir hugetlb//docker/fc14b7874ae1dc7122f2ae2222164f402bcdc728d0931ab0c87a089f5d4d5d43 already existed
(00.001436) cg: Determined dir hugetlb//docker/4eb09e2808b0af9df456ff05c96b692fb04a6ada60b7d536f0b5e5e6720ac346 already existed
(00.001439) cg: Determined dir hugetlb//user already existed
(00.001442) cg: Determined dir hugetlb//user/0.user already existed
(00.001448) cg: Determined dir hugetlb//user/0.user/231.session already existed
(00.001452) cg: Determined dir hugetlb//user/0.user/176.session already existed
(00.001455) cg: Determined dir hugetlb//user/0.user/24.session already existed
(00.001458) cg: Determined dir hugetlb//user/0.user/15.session already existed
(00.001464) cg: 	Making subdir .criu.cgyard.zuK63w/systemd (none,name=systemd)
(00.001487) cg: Determined dir systemd/ already existed
(00.001491) cg: Determined dir systemd//user already existed
(00.001495) cg: Determined dir systemd//user/0.user already existed
(00.001498) cg: Determined dir systemd//user/0.user/231.session already existed
(00.001502) cg: Determined dir systemd//user/0.user/176.session already existed
(00.001505) cg: Determined dir systemd//user/0.user/24.session already existed
(00.001508) cg: Determined dir systemd//user/0.user/15.session already existed
(00.001554) Warn  (cr-restore.c:1004): Set CLONE_PARENT | CLONE_NEWPID but it might cause restore problem,because not all kernels support such clone flags combinations!
(00.001559) Forking task with 1 pid (flags 0x6c028000)
(00.001580) Saved netns fd for links restore
(00.006851) Wait until namespaces are created
(00.296051) Running setup-namespaces scripts
(00.296105) 	RPC
(00.296450)      1: Restoring namespaces 1 flags 0x6c028000
(00.296562)      1: Restoring link lo type 1
(00.296959)      1: Restoring link eth0 type 2
(00.296968)      1: Restoring netdev eth0 idx 1075
(00.296973)      1: Restore ll addr (02:../6) for device
(00.297629)      1: 	Running ip addr restore
(00.303091)      1: Found fd 1 (id pipe:[2403598]) in inherit fd list (caller inherit_fd_resolve_clash)
(00.303139)      1: Inherit fd 1 moved to 7 to resolve clash
RTNETLINK answers: File exists
RTNETLINK answers: File exists
(00.304459)      1: 	Running ip route restore
(00.309995)      1: Found fd 1 (id pipe:[2403598]) in inherit fd list (caller inherit_fd_resolve_clash)
(00.310055)      1: Inherit fd 1 moved to 7 to resolve clash
RTNETLINK answers: File exists
(00.311283)      1: 	Running iptables-restore for iptables-restore
(00.316730)      1: Found fd 1 (id pipe:[2403598]) in inherit fd list (caller inherit_fd_resolve_clash)
(00.316763)      1: Inherit fd 1 moved to 7 to resolve clash
(00.319058)      1: kernel/hostname nr 12
(00.319114)      1: kernel/domainname nr 6
(00.319139)      1: Restoring IPC namespace
(00.319144)      1: Restoring IPC variables
(00.319259)      1: Restoring IPC shared memory
(00.319273)      1: Restoring IPC message queues
(00.319285)      1: Restoring IPC semaphores sets
(00.319299)      1: Restoring mount namespace
(00.319411)      1: 	type sysfs source sysfs mnt_id 0x11 s_dev 0xf root / mountpoint ./sys flags 0x20000e external false options 
(00.319430)      1: 	type proc source proc mnt_id 0x12 s_dev 0x3 root / mountpoint ./proc flags 0x20000e external false options 
(00.319447)      1: 	type devtmpfs source udev mnt_id 0x13 s_dev 0x5 root / mountpoint ./dev flags 0x200000 external false options size=15697036k,nr_inodes=3924259,mode=755
(00.319460)      1: 	type devpts source devpts mnt_id 0x14 s_dev 0xc root / mountpoint ./dev/pts flags 0x20000a external false options gid=5,mode=620,ptmxmode=000
(00.319490)      1: 	type tmpfs source tmpfs mnt_id 0x15 s_dev 0x10 root / mountpoint ./run flags 0x20000a external false options size=3141628k,mode=755
(00.319503)      1: 	type ext4 source /dev/disk/by-uuid/c70a26ec-1dda-455c-acfd-792015b2bb6f mnt_id 0x16 s_dev 0xca00001 root / mountpoint ./ flags 0x200000 external false options discard,data=ordered
(00.319514)      1: 	type tmpfs source none mnt_id 0x17 s_dev 0x11 root / mountpoint ./sys/fs/cgroup flags 0x200000 external false options size=4k,mode=755
(00.319524)      1: 	type fusectl source none mnt_id 0x18 s_dev 0x12 root / mountpoint ./sys/fs/fuse/connections flags 0x200000 external false options 
(00.319534)      1: 	type debugfs source none mnt_id 0x19 s_dev 0x6 root / mountpoint ./sys/kernel/debug flags 0x200000 external false options 
(00.319543)      1: 	type securityfs source none mnt_id 0x1a s_dev 0xa root / mountpoint ./sys/kernel/security flags 0x200000 external false options 
(00.319553)      1: 	type tmpfs source none mnt_id 0x1b s_dev 0x13 root / mountpoint ./run/lock flags 0x20000e external false options size=5120k
(00.319562)      1: 	type tmpfs source none mnt_id 0x1c s_dev 0x14 root / mountpoint ./run/shm flags 0x200006 external false options 
(00.319573)      1: 	type tmpfs source none mnt_id 0x1d s_dev 0x15 root / mountpoint ./run/user flags 0x20000e external false options size=102400k,mode=755
(00.319618)      1: 	type pstore source none mnt_id 0x1e s_dev 0x16 root / mountpoint ./sys/fs/pstore flags 0x200000 external false options 
(00.319633)      1: 	type cgroup source cgroup mnt_id 0x1f s_dev 0x17 root / mountpoint ./sys/fs/cgroup/cpuset flags 0x200000 external false options cpuset
(00.319643)      1: 	type cgroup source cgroup mnt_id 0x20 s_dev 0x18 root / mountpoint ./sys/fs/cgroup/cpu flags 0x200000 external false options cpu
(00.319653)      1: 	type cgroup source cgroup mnt_id 0x21 s_dev 0x19 root / mountpoint ./sys/fs/cgroup/cpuacct flags 0x200000 external false options cpuacct
(00.319662)      1: 	type cgroup source cgroup mnt_id 0x22 s_dev 0x1a root / mountpoint ./sys/fs/cgroup/memory flags 0x200000 external false options memory
(00.319671)      1: 	type cgroup source cgroup mnt_id 0x23 s_dev 0x1b root / mountpoint ./sys/fs/cgroup/devices flags 0x200000 external false options devices
(00.319679)      1: 	type cgroup source cgroup mnt_id 0x24 s_dev 0x1c root / mountpoint ./sys/fs/cgroup/freezer flags 0x200000 external false options freezer
(00.319689)      1: 	type cgroup source cgroup mnt_id 0x25 s_dev 0x1d root / mountpoint ./sys/fs/cgroup/blkio flags 0x200000 external false options blkio
(00.319710)      1: 	type cgroup source cgroup mnt_id 0x26 s_dev 0x1e root / mountpoint ./sys/fs/cgroup/perf_event flags 0x200000 external false options perf_event
(00.319720)      1: 	type cgroup source cgroup mnt_id 0x27 s_dev 0x1f root / mountpoint ./sys/fs/cgroup/hugetlb flags 0x200000 external false options hugetlb
(00.319731)      1: 	type cgroup source systemd mnt_id 0x28 s_dev 0x20 root / mountpoint ./sys/fs/cgroup/systemd flags 0x20000e external false options name=systemd
(00.319742)      1: 	type ext4 source /dev/disk/by-uuid/c70a26ec-1dda-455c-acfd-792015b2bb6f mnt_id 0x29 s_dev 0xca00001 root /var/lib/docker/aufs mountpoint ./var/lib/docker/aufs flags 0x200000 external false options discard,data=ordered
(00.319780)      1: 	type fuse.dupe source dupe mnt_id 0x2a s_dev 0x21 root / mountpoint ./mnt/stretch/all_modules_dupe flags 0x200006 external false options user_id=0,group_id=0
(00.319791)      1: 	type aufs source none mnt_id 0x2b s_dev 0x22 root / mountpoint ./var/lib/docker/aufs/mnt/397ed88cdb24bc3063a937eeb2e351160249149f1acb0ff6f54325024cd65910 flags 0x200000 external false options si=55678734945310c4,dio
(00.319804)      1: 	type aufs source none mnt_id 0x2d s_dev 0x24 root / mountpoint ./var/lib/docker/aufs/mnt/4eb09e2808b0af9df456ff05c96b692fb04a6ada60b7d536f0b5e5e6720ac346 flags 0x200000 external false options si=5567873494ddf0c4,dio
(00.319814)      1: 	type aufs source none mnt_id 0x2e s_dev 0x25 root / mountpoint ./var/lib/docker/aufs/mnt/05ca6459dfaaeb9a3a5b93bfa6864da2939d6700b75927ef682ca63c9857b1c4 flags 0x200000 external false options si=5567873492c6b0c4,dio
(00.319826)      1: 	type aufs source none mnt_id 0x31 s_dev 0x27 root / mountpoint ./var/lib/docker/aufs/mnt/1c595f99fb238b876097f1e63d311a029a43959ef1781780cbeb05e4c1377aa1 flags 0x200000 external false options si=556787349032e0c4,dio
(00.319839)      1: 	type proc source proc mnt_id 0x32 s_dev 0x3 root / mountpoint ./run/docker/netns/4eb09e2808b0 flags 0x20000e external false options 
(00.319849)      1: 	type aufs source none mnt_id 0x33 s_dev 0x28 root / mountpoint ./var/lib/docker/aufs/mnt/fc14b7874ae1dc7122f2ae2222164f402bcdc728d0931ab0c87a089f5d4d5d43 flags 0x200000 external false options si=5567873497eab0c4,dio
(00.319858)      1: 	type proc source proc mnt_id 0x144 s_dev 0x3 root / mountpoint ./run/docker/netns/fc14b7874ae1 flags 0x20000e external false options 
(00.319911)      1: 	type proc source proc mnt_id 0x7f s_dev 0x3 root / mountpoint ./run/docker/netns/default flags 0x20000e external false options 
(00.319925)      1: 	type ext4 source /dev/disk/by-uuid/c70a26ec-1dda-455c-acfd-792015b2bb6f mnt_id 0x82 s_dev 0xca00001 root /var/lib/evaldocker/aufs mountpoint ./var/lib/evaldocker/aufs flags 0x200000 external false options discard,data=ordered
(00.319935)      1: 	type aufs source none mnt_id 0x37 s_dev 0x23 root / mountpoint ./var/lib/docker/aufs/mnt/01bc40566d522908bf486bb38b4543dfbac3f9306394480aaf7748ad9e6ea5a9 flags 0x200000 external false options si=556787349352f0c4,dio
(00.319944)      1: 	type proc source proc mnt_id 0x4e s_dev 0x3 root / mountpoint ./run/docker/netns/01bc40566d52 flags 0x20000e external false options 
(00.319954)      1: 	type proc source proc mnt_id 0x30 s_dev 0x3 root / mountpoint ./run/docker/netns/397ed88cdb24 flags 0x20000e external false options 
(00.319965)      1: 	type proc source proc mnt_id 0x3a s_dev 0x3 root / mountpoint ./run/docker/netns/1c595f99fb23 flags 0x20000e external false options 
(00.319974)      1: 	type proc source proc mnt_id 0x34 s_dev 0x3 root / mountpoint ./run/docker/netns/05ca6459dfaa flags 0x20000e external false options 
(00.319984)      1: 	type aufs source none mnt_id 0x42 s_dev 0x53 root / mountpoint ./var/lib/docker/aufs/mnt/6b5a0d0e4e0dd6df87ff6917cc49f07e8ad99fcdec0fef3a0ece97787bac3b4a flags 0x200000 external false options si=556787342525b0c4,dio
(00.319994)      1: 	type proc source proc mnt_id 0x59 s_dev 0x3 root / mountpoint ./run/docker/netns/6b5a0d0e4e0d flags 0x20000e external false options 
(00.320038)      1: 	type aufs source none mnt_id 0x6c s_dev 0x67 root / mountpoint ./var/lib/docker/aufs/mnt/79b924319ddf33f5529064db0b3cb5f9f9d3750d533acbc70690f70e902947a4 flags 0x200000 external false options si=55678734252f00c4,dio
(00.320051)      1: 	type aufs source none mnt_id 0x7b s_dev 0x68 root / mountpoint ./var/lib/docker/aufs/mnt/3f5ec2f8598e7d3811035fdc2fad25024c3135540609b8c71707fa087109ab27 flags 0x200000 external false options si=55678734247c90c4,dio
(00.320060)      1: 	type proc source proc mnt_id 0x7d s_dev 0x3 root / mountpoint ./run/docker/netns/79b924319ddf flags 0x20000e external false options 
(00.320070)      1: 	type aufs source none mnt_id 0x7c s_dev 0x69 root / mountpoint ./var/lib/docker/aufs/mnt/2aedc19a1af35a2e209ff67cc8c06fd2efced49980c01c96f0781ec8c3233045 flags 0x200000 external false options si=556787341861b0c4,dio
(00.320084)      1: 	type aufs source none mnt_id 0x1e4 s_dev 0x86 root / mountpoint ./var/lib/docker/aufs/mnt/ae4a38a9d5602538ca6820adf33e1879cd79554bc9ce60af33c8342ad6a51a9f flags 0x200000 external false options si=55678735c40160c4,dio
(00.320094)      1: 	type proc source proc mnt_id 0x89 s_dev 0x3 root / mountpoint ./run/docker/netns/3f5ec2f8598e flags 0x20000e external false options 
(00.320103)      1: 	type proc source proc mnt_id 0x1f4 s_dev 0x3 root / mountpoint ./run/docker/netns/2aedc19a1af3 flags 0x20000e external false options 
(00.320112)      1: 	type proc source proc mnt_id 0x225 s_dev 0x3 root / mountpoint ./run/docker/netns/ae4a38a9d560 flags 0x20000e external false options 
(00.320151)      1: 	type aufs source none mnt_id 0x14c s_dev 0xbd root / mountpoint ./var/lib/evaldocker/aufs/mnt/08a36b2e3ce715ee8c6d8ca0b9c55e150e5f34038b06744d1e28a38edcfbcae4 flags 0x200000 external false options si=5567873494f780c4,dio
(00.320163)      1: 	type aufs source none mnt_id 0x180 s_dev 0xbe root / mountpoint ./var/lib/evaldocker/aufs/mnt/b29925c2ff9f6d9dae37ce09c47df0194863a3ddba60ff0f94b226ed19e29506 flags 0x200000 external false options si=556787366092d0c4,dio
(00.320177)      1: 	type aufs source none mnt_id 0x181 s_dev 0xbf root / mountpoint ./var/lib/evaldocker/aufs/mnt/561ff6ffd5d559332e410cf4c69a0d56963cb1f9b48f7b0710a76d4de23bde0c flags 0x200000 external false options si=55678735c40120c4,dio
(00.320188)      1: 	type aufs source none mnt_id 0x183 s_dev 0xc1 root / mountpoint ./var/lib/evaldocker/aufs/mnt/20c5943becb4330f95d36f10584d6133d172034ea703ac5687139d749869397a flags 0x200000 external false options si=55678736a2b7a0c4,dio
(00.320201)      1: 	type aufs source none mnt_id 0x3ff s_dev 0x10b root / mountpoint ./var/lib/evaldocker/aufs/mnt/614a5d9aaa57637ae52a7f9790f7844a24349dfc9d0e759ead203ec5e8de44ca flags 0x200000 external false options si=556787354e63f0c4,dio
(00.320212)      1: 	type aufs source none mnt_id 0x4dc s_dev 0x111 root / mountpoint ./var/lib/evaldocker/aufs/mnt/2af269260f317cc26f86d01462f2a399b91cbca00075cfdd6386d5182e530714 flags 0x200000 external false options si=556787352b7200c4,dio
(00.320254)      1: 	type aufs source none mnt_id 0x565 s_dev 0x116 root / mountpoint ./var/lib/evaldocker/aufs/mnt/c2bb9de3557e6bf999dcaa7a88b7dc6d6b4a2268299f9c9796573d0349fc464b flags 0x200000 external false options si=5567873434cc10c4,dio
(00.320267)      1: 	type aufs source none mnt_id 0x5ca s_dev 0x11f root / mountpoint ./var/lib/evaldocker/aufs/mnt/d24e99ecbf3f0f7b61e9bf5540fb3157c293baed01064bed2183c6dbfcda6c53 flags 0x200000 external false options si=55678733276690c4,dio
(00.320276)      1: 	type aufs source none mnt_id 0x627 s_dev 0x122 root / mountpoint ./var/lib/evaldocker/aufs/mnt/3f4febb60e0785d1196c89a24b862292eceedb1af8e514c4f95eb9aee6756117 flags 0x200000 external false options si=5567873570e7f0c4,dio
(00.320286)      1: 	type aufs source none mnt_id 0x70a s_dev 0x12a root / mountpoint ./var/lib/evaldocker/aufs/mnt/2eafebb2f97678fd95745e81fc005c27931af25c28dee76a6abc7f6333388c07 flags 0x200000 external false options si=5567873434d210c4,dio
(00.320297)      1: 	type aufs source none mnt_id 0x2c s_dev 0x26 root / mountpoint ./var/lib/docker/aufs/mnt/e990bf1017b6868b94fcd1852814e3f7bb2b8959fe8d9d2962dd372fa82fa49d flags 0x200000 external false options si=556787359cd3c0c4,dio
(00.320316)      1: 	type proc source proc mnt_id 0x2f s_dev 0x3 root / mountpoint ./run/docker/netns/e990bf1017b6 flags 0x20000e external false options 
(00.320328)      1: 	type aufs source none mnt_id 0x90 s_dev 0xa4 root / mountpoint ./var/lib/evaldocker/aufs/mnt/d641271c673b2632532b086de1f0669fc9aecc3f799912fb359df4d55406c468 flags 0x200000 external false options si=556787369205d0c4,dio
(00.320364)      1: 	type aufs source none mnt_id 0x76 s_dev 0x61 root / mountpoint ./var/lib/evaldocker/aufs/mnt/cda15a03103694c68383aeec3243fc28108dfae6b4234f94d1eec7b0add1a358 flags 0x200000 external false options si=55678734903290c4,dio
(00.320374)      1: 	type aufs source none mnt_id 0x74 s_dev 0x77 root / mountpoint ./var/lib/evaldocker/aufs/mnt/b5b3c8cf72503a19b9ef0c13bb89734896ad430009b0a7fdc13fecf79fc25011 flags 0x200000 external false options si=556787332765d0c4,dio
(00.320384)      1: 	type aufs source none mnt_id 0x7a s_dev 0x76 root / mountpoint ./var/lib/evaldocker/aufs/mnt/c4513f7be64f47cc645684b3cfe801012f12776b086b2f38449bb67abbfdf124 flags 0x200000 external false options si=55678735ab63e0c4,dio
(00.320394)      1: 	type aufs source none mnt_id 0x8e s_dev 0xab root / mountpoint ./var/lib/evaldocker/aufs/mnt/159a44cb9a63c41e5251471fca00ab3e31185e04758ca7f1db8aec40021735d4 flags 0x200000 external false options si=556787366f2d30c4,dio
(00.320404)      1: 	type aufs source none mnt_id 0x4d s_dev 0x5f root / mountpoint ./var/lib/evaldocker/aufs/mnt/2a3ac387542c109668c22e01bf293157ec8af8a6ba8d9893760dbb4061693155 flags 0x200000 external false options si=55678735e7df30c4,dio
(00.320413)      1: 	type aufs source none mnt_id 0x6b s_dev 0xda root / mountpoint ./var/lib/evaldocker/aufs/mnt/820991fd8b4b723760204cd199feb400b2b0960d1fd0f6e04a778057f941defb flags 0x200000 external false options si=556787343be1e0c4,dio
(00.320453)      1: 	type aufs source none mnt_id 0x226 s_dev 0xda root / mountpoint ./run/docker/execdriver/native/820991fd8b4b723760204cd199feb400b2b0960d1fd0f6e04a778057f941defb/criu-root flags 0x200000 external false options si=556787343be1e0c4,dio
(00.320466)      1: 	type tmpfs source none mnt_id 0x22a s_dev 0xdb root / mountpoint ./tmp/checkpoints/6533f087751536cd506bc1c98a8a5984/3d74f66b2398232ad415d99fc8bc7be195affd3e at 2/restore-work-1444345530603/.criu.cgyard.zuK63w flags 0x200000 external false options 
(00.320477)      1: 	type cgroup source none mnt_id 0x272 s_dev 0x17 root / mountpoint ./tmp/checkpoints/6533f087751536cd506bc1c98a8a5984/3d74f66b2398232ad415d99fc8bc7be195affd3e at 2/restore-work-1444345530603/.criu.cgyard.zuK63w/cpuset flags 0x200000 external false options cpuset
(00.320487)      1: 	type cgroup source none mnt_id 0x242 s_dev 0x18 root / mountpoint ./tmp/checkpoints/6533f087751536cd506bc1c98a8a5984/3d74f66b2398232ad415d99fc8bc7be195affd3e at 2/restore-work-1444345530603/.criu.cgyard.zuK63w/cpu flags 0x200000 external false options cpu
(00.320496)      1: 	type cgroup source none mnt_id 0x273 s_dev 0x19 root / mountpoint ./tmp/checkpoints/6533f087751536cd506bc1c98a8a5984/3d74f66b2398232ad415d99fc8bc7be195affd3e at 2/restore-work-1444345530603/.criu.cgyard.zuK63w/cpuacct flags 0x200000 external false options cpuacct
(00.320507)      1: 	type cgroup source none mnt_id 0x278 s_dev 0x1a root / mountpoint ./tmp/checkpoints/6533f087751536cd506bc1c98a8a5984/3d74f66b2398232ad415d99fc8bc7be195affd3e at 2/restore-work-1444345530603/.criu.cgyard.zuK63w/memory flags 0x200000 external false options memory
(00.320544)      1: 	type cgroup source none mnt_id 0x279 s_dev 0x1b root / mountpoint ./tmp/checkpoints/6533f087751536cd506bc1c98a8a5984/3d74f66b2398232ad415d99fc8bc7be195affd3e at 2/restore-work-1444345530603/.criu.cgyard.zuK63w/devices flags 0x200000 external false options devices
(00.320557)      1: 	type cgroup source none mnt_id 0x27a s_dev 0x1c root / mountpoint ./tmp/checkpoints/6533f087751536cd506bc1c98a8a5984/3d74f66b2398232ad415d99fc8bc7be195affd3e at 2/restore-work-1444345530603/.criu.cgyard.zuK63w/freezer flags 0x200000 external false options freezer
(00.320640)      1: 	type cgroup source none mnt_id 0x27f s_dev 0x1d root / mountpoint ./tmp/checkpoints/6533f087751536cd506bc1c98a8a5984/3d74f66b2398232ad415d99fc8bc7be195affd3e at 2/restore-work-1444345530603/.criu.cgyard.zuK63w/blkio flags 0x200000 external false options blkio
(00.320655)      1: 	type cgroup source none mnt_id 0x280 s_dev 0x1e root / mountpoint ./tmp/checkpoints/6533f087751536cd506bc1c98a8a5984/3d74f66b2398232ad415d99fc8bc7be195affd3e at 2/restore-work-1444345530603/.criu.cgyard.zuK63w/perf_event flags 0x200000 external false options perf_event
(00.320664)      1: 	type cgroup source none mnt_id 0x282 s_dev 0x1f root / mountpoint ./tmp/checkpoints/6533f087751536cd506bc1c98a8a5984/3d74f66b2398232ad415d99fc8bc7be195affd3e at 2/restore-work-1444345530603/.criu.cgyard.zuK63w/hugetlb flags 0x200000 external false options hugetlb
(00.320678)      1: 	type cgroup source none mnt_id 0x283 s_dev 0x20 root / mountpoint ./tmp/checkpoints/6533f087751536cd506bc1c98a8a5984/3d74f66b2398232ad415d99fc8bc7be195affd3e at 2/restore-work-1444345530603/.criu.cgyard.zuK63w/systemd flags 0x200000 external false options name=systemd
(00.320698)      1: Building mountpoints tree
(00.320703)      1: 	Building plain mount tree
(00.320707)      1: 		Working on 643->554
(00.320710)      1: 		Working on 642->554
(00.320713)      1: 		Working on 640->554
(00.320716)      1: 		Working on 639->554
(00.320720)      1: 		Working on 634->554
(00.320723)      1: 		Working on 633->554
(00.320726)      1: 		Working on 632->554
(00.320730)      1: 		Working on 627->554
(00.320733)      1: 		Working on 578->554
(00.320737)      1: 		Working on 626->554
(00.320740)      1: 		Working on 554->22
(00.320744)      1: 		Working on 550->21
(00.320748)      1: 		Working on 107->130
(00.320751)      1: 		Working on 77->130
(00.320754)      1: 		Working on 142->130
(00.320757)      1: 		Working on 122->130
(00.320760)      1: 		Working on 116->130
(00.320764)      1: 		Working on 118->130
(00.320768)      1: 		Working on 144->130
(00.320771)      1: 		Working on 47->21
(00.320775)      1: 		Working on 44->41
(00.320778)      1: 		Working on 1802->130
(00.320781)      1: 		Working on 1575->130
(00.320785)      1: 		Working on 1482->130
(00.320788)      1: 		Working on 1381->130
(00.320790)      1: 		Working on 1244->130
(00.320793)      1: 		Working on 1023->130
(00.320796)      1: 		Working on 387->130
(00.320799)      1: 		Working on 385->130
(00.320802)      1: 		Working on 384->130
(00.320804)      1: 		Working on 332->130
(00.320807)      1: 		Working on 549->21
(00.320810)      1: 		Working on 500->21
(00.320814)      1: 		Working on 137->21
(00.320818)      1: 		Working on 484->41
(00.320821)      1: 		Working on 124->41
(00.320824)      1: 		Working on 125->21
(00.320828)      1: 		Working on 123->41
(00.320832)      1: 		Working on 108->41
(00.320835)      1: 		Working on 89->21
(00.320839)      1: 		Working on 66->41
(00.320843)      1: 		Working on 52->21
(00.320847)      1: 		Working on 58->21
(00.320851)      1: 		Working on 48->21
(00.320854)      1: 		Working on 78->21
(00.320858)      1: 		Working on 55->41
(00.320861)      1: 		Working on 130->22
(00.320865)      1: 		Working on 127->21
(00.320868)      1: 		Working on 324->21
(00.320872)      1: 		Working on 51->41
(00.320875)      1: 		Working on 50->21
(00.320878)      1: 		Working on 49->41
(00.320882)      1: 		Working on 46->41
(00.320885)      1: 		Working on 45->41
(00.320889)      1: 		Working on 43->41
(00.320893)      1: 		Working on 42->22
(00.320897)      1: 		Working on 41->22
(00.320900)      1: 		Working on 40->23
(00.320904)      1: 		Working on 39->23
(00.320908)      1: 		Working on 38->23
(00.320912)      1: 		Working on 37->23
(00.320916)      1: 		Working on 36->23
(00.320920)      1: 		Working on 35->23
(00.320923)      1: 		Working on 34->23
(00.320927)      1: 		Working on 33->23
(00.320931)      1: 		Working on 32->23
(00.320934)      1: 		Working on 31->23
(00.320945)      1: 		Working on 30->17
(00.320949)      1: 		Working on 29->21
(00.320953)      1: 		Working on 28->21
(00.320957)      1: 		Working on 27->21
(00.320960)      1: 		Working on 26->17
(00.320965)      1: 		Working on 25->17
(00.320969)      1: 		Working on 24->17
(00.320973)      1: 		Working on 23->17
(00.320976)      1: 		Working on 22->1
(00.320980)      1: 		Working on 21->22
(00.320984)      1: 		Working on 20->19
(00.320989)      1: 		Working on 19->22
(00.320993)      1: 		Working on 18->22
(00.320997)      1: 		Working on 17->22
(00.321004)      1: 	Resorting siblings on 22
(00.321008)      1: 	Resorting siblings on 554
(00.321011)      1: 	Resorting siblings on 643
(00.321015)      1: 	Resorting siblings on 642
(00.321019)      1: 	Resorting siblings on 640
(00.321023)      1: 	Resorting siblings on 639
(00.321026)      1: 	Resorting siblings on 634
(00.321030)      1: 	Resorting siblings on 633
(00.321034)      1: 	Resorting siblings on 632
(00.321038)      1: 	Resorting siblings on 627
(00.321042)      1: 	Resorting siblings on 578
(00.321046)      1: 	Resorting siblings on 626
(00.321049)      1: 	Resorting siblings on 130
(00.321053)      1: 	Resorting siblings on 107
(00.321057)      1: 	Resorting siblings on 77
(00.321061)      1: 	Resorting siblings on 142
(00.321064)      1: 	Resorting siblings on 122
(00.321068)      1: 	Resorting siblings on 116
(00.321072)      1: 	Resorting siblings on 118
(00.321076)      1: 	Resorting siblings on 144
(00.321079)      1: 	Resorting siblings on 1802
(00.321083)      1: 	Resorting siblings on 1575
(00.321087)      1: 	Resorting siblings on 1482
(00.321091)      1: 	Resorting siblings on 1381
(00.321095)      1: 	Resorting siblings on 1244
(00.321099)      1: 	Resorting siblings on 1023
(00.321102)      1: 	Resorting siblings on 387
(00.321106)      1: 	Resorting siblings on 385
(00.321110)      1: 	Resorting siblings on 384
(00.321114)      1: 	Resorting siblings on 332
(00.321117)      1: 	Resorting siblings on 42
(00.321121)      1: 	Resorting siblings on 41
(00.321125)      1: 	Resorting siblings on 44
(00.321129)      1: 	Resorting siblings on 484
(00.321132)      1: 	Resorting siblings on 124
(00.321136)      1: 	Resorting siblings on 123
(00.321139)      1: 	Resorting siblings on 108
(00.321143)      1: 	Resorting siblings on 66
(00.321146)      1: 	Resorting siblings on 55
(00.321150)      1: 	Resorting siblings on 51
(00.321153)      1: 	Resorting siblings on 49
(00.321157)      1: 	Resorting siblings on 46
(00.321160)      1: 	Resorting siblings on 45
(00.321164)      1: 	Resorting siblings on 43
(00.321167)      1: 	Resorting siblings on 21
(00.321170)      1: 	Resorting siblings on 550
(00.321173)      1: 	Resorting siblings on 47
(00.321176)      1: 	Resorting siblings on 549
(00.321180)      1: 	Resorting siblings on 500
(00.321183)      1: 	Resorting siblings on 137
(00.321187)      1: 	Resorting siblings on 125
(00.321190)      1: 	Resorting siblings on 89
(00.321194)      1: 	Resorting siblings on 52
(00.321197)      1: 	Resorting siblings on 58
(00.321200)      1: 	Resorting siblings on 48
(00.321204)      1: 	Resorting siblings on 78
(00.321207)      1: 	Resorting siblings on 127
(00.321211)      1: 	Resorting siblings on 324
(00.321214)      1: 	Resorting siblings on 50
(00.321218)      1: 	Resorting siblings on 29
(00.321222)      1: 	Resorting siblings on 28
(00.321225)      1: 	Resorting siblings on 27
(00.321228)      1: 	Resorting siblings on 19
(00.321231)      1: 	Resorting siblings on 20
(00.321234)      1: 	Resorting siblings on 18
(00.321237)      1: 	Resorting siblings on 17
(00.321240)      1: 	Resorting siblings on 30
(00.321244)      1: 	Resorting siblings on 26
(00.321247)      1: 	Resorting siblings on 25
(00.321250)      1: 	Resorting siblings on 24
(00.321254)      1: 	Resorting siblings on 23
(00.321257)      1: 	Resorting siblings on 40
(00.321261)      1: 	Resorting siblings on 39
(00.321264)      1: 	Resorting siblings on 38
(00.321267)      1: 	Resorting siblings on 37
(00.321271)      1: 	Resorting siblings on 36
(00.321281)      1: 	Resorting siblings on 35
(00.321285)      1: 	Resorting siblings on 34
(00.321288)      1: 	Resorting siblings on 33
(00.321292)      1: 	Resorting siblings on 32
(00.321295)      1: 	Resorting siblings on 31
(00.321298)      1: Done:
(00.321302)      1: [./](22->1)
(00.321306)      1:  [./run](21->22)
(00.321310)      1:   [./run/user](29->21)
(00.321314)      1:   <--
(00.321317)      1:   [./run/lock](27->21)
(00.321320)      1:   <--
(00.321323)      1:   [./run/shm](28->21)
(00.321327)      1:   <--
(00.321329)      1:   [./run/docker/netns/e990bf1017b6](47->21)
(00.321333)      1:   <--
(00.321336)      1:   [./run/docker/netns/4eb09e2808b0](50->21)
(00.321339)      1:   <--
(00.321343)      1:   [./run/docker/netns/fc14b7874ae1](324->21)
(00.321346)      1:   <--
(00.321349)      1:   [./run/docker/netns/default](127->21)
(00.321352)      1:   <--
(00.321355)      1:   [./run/docker/netns/01bc40566d52](78->21)
(00.321359)      1:   <--
(00.321362)      1:   [./run/docker/netns/397ed88cdb24](48->21)
(00.321366)      1:   <--
(00.321369)      1:   [./run/docker/netns/1c595f99fb23](58->21)
(00.321372)      1:   <--
(00.321375)      1:   [./run/docker/netns/05ca6459dfaa](52->21)
(00.321379)      1:   <--
(00.321382)      1:   [./run/docker/netns/6b5a0d0e4e0d](89->21)
(00.321385)      1:   <--
(00.321389)      1:   [./run/docker/netns/79b924319ddf](125->21)
(00.321393)      1:   <--
(00.321396)      1:   [./run/docker/netns/3f5ec2f8598e](137->21)
(00.321400)      1:   <--
(00.321403)      1:   [./run/docker/netns/2aedc19a1af3](500->21)
(00.321480)      1:   <--
(00.321486)      1:   [./run/docker/netns/ae4a38a9d560](549->21)
(00.321491)      1:   <--
(00.321494)      1:   [./run/docker/execdriver/native/820991fd8b4b723760204cd199feb400b2b0960d1fd0f6e04a778057f941defb/criu-root](550->21)
(00.321498)      1:   <--
(00.321501)      1:  <--
(00.321504)      1:  [./sys](17->22)
(00.321508)      1:   [./sys/fs/pstore](30->17)
(00.321512)      1:   <--
(00.321515)      1:   [./sys/fs/cgroup](23->17)
(00.321519)      1:    [./sys/fs/cgroup/systemd](40->23)
(00.321523)      1:    <--
(00.321526)      1:    [./sys/fs/cgroup/cpuset](31->23)
(00.321530)      1:    <--
(00.321533)      1:    [./sys/fs/cgroup/cpu](32->23)
(00.321537)      1:    <--
(00.321580)      1:    [./sys/fs/cgroup/cpuacct](33->23)
(00.321588)      1:    <--
(00.321591)      1:    [./sys/fs/cgroup/memory](34->23)
(00.321595)      1:    <--
(00.321598)      1:    [./sys/fs/cgroup/devices](35->23)
(00.321601)      1:    <--
(00.321604)      1:    [./sys/fs/cgroup/freezer](36->23)
(00.321607)      1:    <--
(00.321610)      1:    [./sys/fs/cgroup/blkio](37->23)
(00.321614)      1:    <--
(00.321617)      1:    [./sys/fs/cgroup/perf_event](38->23)
(00.321620)      1:    <--
(00.321623)      1:    [./sys/fs/cgroup/hugetlb](39->23)
(00.321627)      1:    <--
(00.321630)      1:   <--
(00.321633)      1:   [./sys/fs/fuse/connections](24->17)
(00.321636)      1:   <--
(00.321639)      1:   [./sys/kernel/debug](25->17)
(00.321642)      1:   <--
(00.321646)      1:   [./sys/kernel/security](26->17)
(00.321649)      1:   <--
(00.321652)      1:  <--
(00.321655)      1:  [./proc](18->22)
(00.321658)      1:  <--
(00.321661)      1:  [./dev](19->22)
(00.321664)      1:   [./dev/pts](20->19)
(00.321668)      1:   <--
(00.321671)      1:  <--
(00.321674)      1:  [./mnt/stretch/all_modules_dupe](42->22)
(00.321677)      1:  <--
(00.321680)      1:  [./var/lib/docker/aufs](41->22)
(00.321683)      1:   [./var/lib/docker/aufs/mnt/e990bf1017b6868b94fcd1852814e3f7bb2b8959fe8d9d2962dd372fa82fa49d](44->41)
(00.321687)      1:   <--
(00.321690)      1:   [./var/lib/docker/aufs/mnt/397ed88cdb24bc3063a937eeb2e351160249149f1acb0ff6f54325024cd65910](43->41)
(00.321693)      1:   <--
(00.321696)      1:   [./var/lib/docker/aufs/mnt/4eb09e2808b0af9df456ff05c96b692fb04a6ada60b7d536f0b5e5e6720ac346](45->41)
(00.321699)      1:   <--
(00.321703)      1:   [./var/lib/docker/aufs/mnt/05ca6459dfaaeb9a3a5b93bfa6864da2939d6700b75927ef682ca63c9857b1c4](46->41)
(00.321706)      1:   <--
(00.321715)      1:   [./var/lib/docker/aufs/mnt/1c595f99fb238b876097f1e63d311a029a43959ef1781780cbeb05e4c1377aa1](49->41)
(00.321719)      1:   <--
(00.321722)      1:   [./var/lib/docker/aufs/mnt/fc14b7874ae1dc7122f2ae2222164f402bcdc728d0931ab0c87a089f5d4d5d43](51->41)
(00.321725)      1:   <--
(00.321772)      1:   [./var/lib/docker/aufs/mnt/01bc40566d522908bf486bb38b4543dfbac3f9306394480aaf7748ad9e6ea5a9](55->41)
(00.321780)      1:   <--
(00.321783)      1:   [./var/lib/docker/aufs/mnt/6b5a0d0e4e0dd6df87ff6917cc49f07e8ad99fcdec0fef3a0ece97787bac3b4a](66->41)
(00.321787)      1:   <--
(00.321790)      1:   [./var/lib/docker/aufs/mnt/79b924319ddf33f5529064db0b3cb5f9f9d3750d533acbc70690f70e902947a4](108->41)
(00.321794)      1:   <--
(00.321797)      1:   [./var/lib/docker/aufs/mnt/3f5ec2f8598e7d3811035fdc2fad25024c3135540609b8c71707fa087109ab27](123->41)
(00.321801)      1:   <--
(00.321805)      1:   [./var/lib/docker/aufs/mnt/2aedc19a1af35a2e209ff67cc8c06fd2efced49980c01c96f0781ec8c3233045](124->41)
(00.321809)      1:   <--
(00.321812)      1:   [./var/lib/docker/aufs/mnt/ae4a38a9d5602538ca6820adf33e1879cd79554bc9ce60af33c8342ad6a51a9f](484->41)
(00.321815)      1:   <--
(00.321818)      1:  <--
(00.321860)      1:  [./var/lib/evaldocker/aufs](130->22)
(00.321868)      1:   [./var/lib/evaldocker/aufs/mnt/820991fd8b4b723760204cd199feb400b2b0960d1fd0f6e04a778057f941defb](107->130)
(00.321872)      1:   <--
(00.321876)      1:   [./var/lib/evaldocker/aufs/mnt/08a36b2e3ce715ee8c6d8ca0b9c55e150e5f34038b06744d1e28a38edcfbcae4](332->130)
(00.321879)      1:   <--
(00.321883)      1:   [./var/lib/evaldocker/aufs/mnt/b29925c2ff9f6d9dae37ce09c47df0194863a3ddba60ff0f94b226ed19e29506](384->130)
(00.321886)      1:   <--
(00.321889)      1:   [./var/lib/evaldocker/aufs/mnt/561ff6ffd5d559332e410cf4c69a0d56963cb1f9b48f7b0710a76d4de23bde0c](385->130)
(00.321893)      1:   <--
(00.321896)      1:   [./var/lib/evaldocker/aufs/mnt/20c5943becb4330f95d36f10584d6133d172034ea703ac5687139d749869397a](387->130)
(00.321899)      1:   <--
(00.321902)      1:   [./var/lib/evaldocker/aufs/mnt/614a5d9aaa57637ae52a7f9790f7844a24349dfc9d0e759ead203ec5e8de44ca](1023->130)
(00.321906)      1:   <--
(00.321909)      1:   [./var/lib/evaldocker/aufs/mnt/2af269260f317cc26f86d01462f2a399b91cbca00075cfdd6386d5182e530714](1244->130)
(00.321913)      1:   <--
(00.321916)      1:   [./var/lib/evaldocker/aufs/mnt/c2bb9de3557e6bf999dcaa7a88b7dc6d6b4a2268299f9c9796573d0349fc464b](1381->130)
(00.321920)      1:   <--
(00.321923)      1:   [./var/lib/evaldocker/aufs/mnt/d24e99ecbf3f0f7b61e9bf5540fb3157c293baed01064bed2183c6dbfcda6c53](1482->130)
(00.321927)      1:   <--
(00.321930)      1:   [./var/lib/evaldocker/aufs/mnt/3f4febb60e0785d1196c89a24b862292eceedb1af8e514c4f95eb9aee6756117](1575->130)
(00.321934)      1:   <--
(00.321937)      1:   [./var/lib/evaldocker/aufs/mnt/2eafebb2f97678fd95745e81fc005c27931af25c28dee76a6abc7f6333388c07](1802->130)
(00.321941)      1:   <--
(00.321945)      1:   [./var/lib/evaldocker/aufs/mnt/d641271c673b2632532b086de1f0669fc9aecc3f799912fb359df4d55406c468](144->130)
(00.321949)      1:   <--
(00.321952)      1:   [./var/lib/evaldocker/aufs/mnt/cda15a03103694c68383aeec3243fc28108dfae6b4234f94d1eec7b0add1a358](118->130)
(00.321956)      1:   <--
(00.321959)      1:   [./var/lib/evaldocker/aufs/mnt/b5b3c8cf72503a19b9ef0c13bb89734896ad430009b0a7fdc13fecf79fc25011](116->130)
(00.321963)      1:   <--
(00.321966)      1:   [./var/lib/evaldocker/aufs/mnt/c4513f7be64f47cc645684b3cfe801012f12776b086b2f38449bb67abbfdf124](122->130)
(00.321970)      1:   <--
(00.321973)      1:   [./var/lib/evaldocker/aufs/mnt/159a44cb9a63c41e5251471fca00ab3e31185e04758ca7f1db8aec40021735d4](142->130)
(00.321977)      1:   <--
(00.321980)      1:   [./var/lib/evaldocker/aufs/mnt/2a3ac387542c109668c22e01bf293157ec8af8a6ba8d9893760dbb4061693155](77->130)
(00.321984)      1:   <--
(00.321987)      1:  <--
(00.321991)      1:  [./tmp/checkpoints/6533f087751536cd506bc1c98a8a5984/3d74f66b2398232ad415d99fc8bc7be195affd3e at 2/restore-work-1444345530603/.criu.cgyard.zuK63w](554->22)
(00.322002)      1:   [./tmp/checkpoints/6533f087751536cd506bc1c98a8a5984/3d74f66b2398232ad415d99fc8bc7be195affd3e at 2/restore-work-1444345530603/.criu.cgyard.zuK63w/systemd](643->554)
(00.322007)      1:   <--
(00.322051)      1:   [./tmp/checkpoints/6533f087751536cd506bc1c98a8a5984/3d74f66b2398232ad415d99fc8bc7be195affd3e at 2/restore-work-1444345530603/.criu.cgyard.zuK63w/cpuset](626->554)
(00.322089)      1:   <--
(00.322094)      1:   [./tmp/checkpoints/6533f087751536cd506bc1c98a8a5984/3d74f66b2398232ad415d99fc8bc7be195affd3e at 2/restore-work-1444345530603/.criu.cgyard.zuK63w/cpu](578->554)
(00.322098)      1:   <--
(00.322100)      1:   [./tmp/checkpoints/6533f087751536cd506bc1c98a8a5984/3d74f66b2398232ad415d99fc8bc7be195affd3e at 2/restore-work-1444345530603/.criu.cgyard.zuK63w/cpuacct](627->554)
(00.322104)      1:   <--
(00.322106)      1:   [./tmp/checkpoints/6533f087751536cd506bc1c98a8a5984/3d74f66b2398232ad415d99fc8bc7be195affd3e at 2/restore-work-1444345530603/.criu.cgyard.zuK63w/memory](632->554)
(00.322109)      1:   <--
(00.322112)      1:   [./tmp/checkpoints/6533f087751536cd506bc1c98a8a5984/3d74f66b2398232ad415d99fc8bc7be195affd3e at 2/restore-work-1444345530603/.criu.cgyard.zuK63w/devices](633->554)
(00.322115)      1:   <--
(00.322118)      1:   [./tmp/checkpoints/6533f087751536cd506bc1c98a8a5984/3d74f66b2398232ad415d99fc8bc7be195affd3e at 2/restore-work-1444345530603/.criu.cgyard.zuK63w/freezer](634->554)
(00.322121)      1:   <--
(00.322124)      1:   [./tmp/checkpoints/6533f087751536cd506bc1c98a8a5984/3d74f66b2398232ad415d99fc8bc7be195affd3e at 2/restore-work-1444345530603/.criu.cgyard.zuK63w/blkio](639->554)
(00.322127)      1:   <--
(00.322130)      1:   [./tmp/checkpoints/6533f087751536cd506bc1c98a8a5984/3d74f66b2398232ad415d99fc8bc7be195affd3e at 2/restore-work-1444345530603/.criu.cgyard.zuK63w/perf_event](640->554)
(00.322134)      1:   <--
(00.322137)      1:   [./tmp/checkpoints/6533f087751536cd506bc1c98a8a5984/3d74f66b2398232ad415d99fc8bc7be195affd3e at 2/restore-work-1444345530603/.criu.cgyard.zuK63w/hugetlb](642->554)
(00.322140)      1:   <--
(00.322144)      1:  <--
(00.322147)      1: <--
(00.322206)      1: Reading mountpoint images
(00.322253)      1: 		Getting root for 342
(00.322294)      1: 		Getting mpt for 342 ./proc/kcore
(00.322298)      1: 		Getting source for 342
(00.322302)      1: 		Getting opts for 342
(00.322306)      1: 	Read 342 mp @ ./proc/kcore
(00.322346)      1: 		Getting root for 341
(00.322354)      1: 		Getting mpt for 341 ./proc/bus
(00.322358)      1: 		Getting source for 341
(00.322361)      1: 		Getting opts for 341
(00.322365)      1: 	Read 341 mp @ ./proc/bus
(00.322370)      1: 		Getting root for 340
(00.322374)      1: 		Getting mpt for 340 ./proc/irq
(00.322378)      1: 		Getting source for 340
(00.322381)      1: 		Getting opts for 340
(00.322385)      1: 	Read 340 mp @ ./proc/irq
(00.322390)      1: 		Getting root for 339
(00.322394)      1: 		Getting mpt for 339 ./proc/sysrq-trigger
(00.322398)      1: 		Getting source for 339
(00.322401)      1: 		Getting opts for 339
(00.322405)      1: 	Read 339 mp @ ./proc/sysrq-trigger
(00.322410)      1: 		Getting root for 121
(00.322447)      1: 		Getting mpt for 121 ./proc/sys
(00.322455)      1: 		Getting source for 121
(00.322458)      1: 		Getting opts for 121
(00.322461)      1: 	Read 121 mp @ ./proc/sys
(00.322468)      1: Mountpoint /etc/hosts will have root from /var/lib/evaldocker/containers/820991fd8b4b723760204cd199feb400b2b0960d1fd0f6e04a778057f941defb/hosts
(00.322475)      1: 		Getting mpt for 646 ./etc/hosts
(00.322478)      1: 		Getting source for 646
(00.322481)      1: 		Getting opts for 646
(00.322484)      1: 	Read 646 mp @ ./etc/hosts
(00.322489)      1: Mountpoint /etc/hostname will have root from /var/lib/evaldocker/containers/820991fd8b4b723760204cd199feb400b2b0960d1fd0f6e04a778057f941defb/hostname
(00.322493)      1: 		Getting mpt for 640 ./etc/hostname
(00.322496)      1: 		Getting source for 640
(00.322499)      1: 		Getting opts for 640
(00.322502)      1: 	Read 640 mp @ ./etc/hostname
(00.322514)      1: Mountpoint /etc/resolv.conf will have root from /var/lib/evaldocker/containers/820991fd8b4b723760204cd199feb400b2b0960d1fd0f6e04a778057f941defb/resolv.conf
(00.322518)      1: 		Getting mpt for 639 ./etc/resolv.conf
(00.322521)      1: 		Getting source for 639
(00.322525)      1: 		Getting opts for 639
(00.322528)      1: 	Read 639 mp @ ./etc/resolv.conf
(00.322533)      1: 		Getting root for 626
(00.322536)      1: 		Getting mpt for 626 ./app/available_modules
(00.322540)      1: 		Getting source for 626
(00.322543)      1: 		Getting opts for 626
(00.322546)      1: 	Read 626 mp @ ./app/available_modules
(00.322552)      1: 		Getting root for 554
(00.322556)      1: 		Getting mpt for 554 ./sys
(00.322559)      1: 		Getting source for 554
(00.322562)      1: 		Getting opts for 554
(00.322566)      1: 	Read 554 mp @ ./sys
(00.322571)      1: 		Getting root for 550
(00.322575)      1: 		Getting mpt for 550 ./dev/mqueue
(00.322579)      1: 		Getting source for 550
(00.322582)      1: 		Getting opts for 550
(00.322586)      1: 	Read 550 mp @ ./dev/mqueue
(00.322591)      1: 		Getting root for 326
(00.322595)      1: 		Getting mpt for 326 ./dev/shm
(00.322599)      1: 		Getting source for 326
(00.322602)      1: 		Getting opts for 326
(00.322606)      1: 	Read 326 mp @ ./dev/shm
(00.322616)      1: 		Getting root for 223
(00.322660)      1: 		Getting mpt for 223 ./dev/pts
(00.322667)      1: 		Getting source for 223
(00.322671)      1: 		Getting opts for 223
(00.322675)      1: 	Read 223 mp @ ./dev/pts
(00.322681)      1: 		Getting root for 180
(00.322685)      1: 		Getting mpt for 180 ./dev
(00.322689)      1: 		Getting source for 180
(00.322692)      1: 		Getting opts for 180
(00.322732)      1: 	Read 180 mp @ ./dev
(00.322742)      1: 		Getting root for 169
(00.322746)      1: 		Getting mpt for 169 ./proc
(00.322750)      1: 		Getting source for 169
(00.322753)      1: 		Getting opts for 169
(00.322757)      1: 	Read 169 mp @ ./proc
(00.322762)      1: 		Getting root for 168
(00.322766)      1: 		Getting mpt for 168 ./
(00.322769)      1: 		Getting source for 168
(00.322772)      1: 		Getting opts for 168
(00.322776)      1: 	Read 168 mp @ ./
(00.322792)      1: Path `/run/docker/execdriver/native/820991fd8b4b723760204cd199feb400b2b0960d1fd0f6e04a778057f941defb/criu-root' resolved to `./run/docker/execdriver/native/820991fd8b4b723760204cd199feb400b2b0960d1fd0f6e04a778057f941defb/criu-root' mountpoint
(00.322832)      1: Building mountpoints tree
(00.322838)      1: 	Building plain mount tree
(00.322842)      1: 		Working on 168->152
(00.322845)      1: 		Working on 169->168
(00.322849)      1: 		Working on 180->168
(00.322852)      1: 		Working on 223->180
(00.322855)      1: 		Working on 326->180
(00.322859)      1: 		Working on 550->180
(00.322905)      1: 		Working on 554->168
(00.322912)      1: 		Working on 626->168
(00.322916)      1: 		Working on 639->168
(00.322919)      1: 		Working on 640->168
(00.322922)      1: 		Working on 646->168
(00.322926)      1: 		Working on 121->169
(00.322929)      1: 		Working on 339->169
(00.322932)      1: 		Working on 340->169
(00.322935)      1: 		Working on 341->169
(00.322939)      1: 		Working on 342->169
(00.322945)      1: 	Resorting siblings on 168
(00.322949)      1: 	Resorting siblings on 169
(00.322952)      1: 	Resorting siblings on 121
(00.322956)      1: 	Resorting siblings on 339
(00.322959)      1: 	Resorting siblings on 340
(00.322962)      1: 	Resorting siblings on 341
(00.322966)      1: 	Resorting siblings on 342
(00.322969)      1: 	Resorting siblings on 180
(00.322972)      1: 	Resorting siblings on 223
(00.322975)      1: 	Resorting siblings on 326
(00.322978)      1: 	Resorting siblings on 550
(00.322982)      1: 	Resorting siblings on 554
(00.322985)      1: 	Resorting siblings on 626
(00.322989)      1: 	Resorting siblings on 639
(00.322992)      1: 	Resorting siblings on 640
(00.322995)      1: 	Resorting siblings on 646
(00.322998)      1: Done:
(00.323001)      1: [./](168->152)
(00.323005)      1:  [./proc](169->168)
(00.323009)      1:   [./proc/sys](121->169)
(00.323020)      1:   <--
(00.323023)      1:   [./proc/kcore](342->169)
(00.323027)      1:   <--
(00.323030)      1:   [./proc/bus](341->169)
(00.323034)      1:   <--
(00.323037)      1:   [./proc/irq](340->169)
(00.323040)      1:   <--
(00.323043)      1:   [./proc/sysrq-trigger](339->169)
(00.323047)      1:   <--
(00.323050)      1:  <--
(00.323053)      1:  [./etc/hosts](646->168)
(00.323057)      1:  <--
(00.323060)      1:  [./etc/hostname](640->168)
(00.323063)      1:  <--
(00.323066)      1:  [./etc/resolv.conf](639->168)
(00.323070)      1:  <--
(00.323073)      1:  [./app/available_modules](626->168)
(00.323077)      1:  <--
(00.323080)      1:  [./sys](554->168)
(00.323084)      1:  <--
(00.323087)      1:  [./dev](180->168)
(00.323090)      1:   [./dev/pts](223->180)
(00.323094)      1:   <--
(00.323097)      1:   [./dev/mqueue](550->180)
(00.323101)      1:   <--
(00.323104)      1:   [./dev/shm](326->180)
(00.323107)      1:   <--
(00.323111)      1:  <--
(00.323114)      1: <--
(00.323122)      1: Start with 168:./
(00.323126)      1: 	Mounting aufs @./ (0)
(00.323130)      1: 168:./ private 1 shared 0 slave 0
(00.323143)      1: 	Mounting proc @./proc (0)
(00.323148)      1: wolf about to mount proc ./proc proc 2097166 
(00.323247)      1: wolf mount succeeded
(00.323253)      1: wolf about to restore_shared_options
(00.323257)      1: 169:./proc private 0 shared 0 slave 0
(00.323261)      1: wolf restore_shared_options succeeded
(00.323264)      1: 	Mounting proc @./proc/sys (0)
(00.323269)      1: 	Bind ./proc/sys to ./proc/sys
(00.323308)      1: 121:./proc/sys private 1 shared 0 slave 0
(00.323321)      1: Postpone slave ./proc/kcore
(00.323325)      1: 	Mounting proc @./proc/bus (0)
(00.323330)      1: 	Bind ./proc/bus to ./proc/bus
(00.323361)      1: 341:./proc/bus private 1 shared 0 slave 0
(00.323373)      1: 	Mounting proc @./proc/irq (0)
(00.323378)      1: 	Bind ./proc/irq to ./proc/irq
(00.323409)      1: 340:./proc/irq private 1 shared 0 slave 0
(00.323422)      1: 	Mounting proc @./proc/sysrq-trigger (0)
(00.323426)      1: 	Bind ./proc/sysrq-trigger to ./proc/sysrq-trigger
(00.323457)      1: 339:./proc/sysrq-trigger private 1 shared 0 slave 0
(00.323469)      1: 	Mounting unsupported @./etc/hosts (0)
(00.323474)      1: 	Bind /var/lib/evaldocker/containers/820991fd8b4b723760204cd199feb400b2b0960d1fd0f6e04a778057f941defb/hosts to ./etc/hosts
(00.323507)      1: 646:./etc/hosts private 1 shared 0 slave 0
(00.323528)      1: 	Mounting unsupported @./etc/hostname (0)
(00.323533)      1: 	Bind /var/lib/evaldocker/containers/820991fd8b4b723760204cd199feb400b2b0960d1fd0f6e04a778057f941defb/hostname to ./etc/hostname
(00.323562)      1: 640:./etc/hostname private 1 shared 0 slave 0
(00.323582)      1: 	Mounting unsupported @./etc/resolv.conf (0)
(00.323588)      1: 	Bind /var/lib/evaldocker/containers/820991fd8b4b723760204cd199feb400b2b0960d1fd0f6e04a778057f941defb/resolv.conf to ./etc/resolv.conf
(00.323616)      1: 639:./etc/resolv.conf private 1 shared 0 slave 0
(00.323635)      1: 	Mounting unsupported @./app/available_modules (0)
(00.323640)      1: wolf about to mount dupe ./app/available_modules unsupported 2097153 user_id=0,group_id=0
(00.324783)      1: Error (mount.c:1486): Can't mount at ./app/available_modules: No such device
(00.340737) Error (cr-restore.c:1867): Restoring FAILED.
root at ip-172-31-46-108:/tmp/checkpoints/6533f087751536cd506bc1c98a8a5984# 




More information about the CRIU mailing list