[CRIU] [PATCH 1/2] finalize cgroups correctly
Saied Kazemi
saied at google.com
Fri Mar 20 12:38:13 PDT 2015
Hi Tycho,
Yes, if we move the image directory outside the container's root, cgyard
will not show up in the restored process. But we need to understand why it
doesn't work when the image directory is in the container's root. One
thing I noticed is that rmdir(cg_yard) in fini_cgroup() fails with a device
busy error. I added code to close all service descriptors, close log file,
change dir to "/" but it didn't help.
If somewhere in container's root is not a valid destination for image
directory, CRIU should print an error and exit.
Pavel, do you have an ideas?
--Saied
On Thu, Mar 19, 2015 at 9:31 PM, Tycho Andersen <
tycho.andersen at canonical.com> wrote:
> Hi Saied,
>
> On Thu, Mar 19, 2015 at 10:41:58AM -0700, Saied Kazemi wrote:
> > Hi Tycho,
> >
> > I tried the patch but it didn't work for me as cgyard is visible after
> > restore (please see below). Here are criu dump and restore commands.
> I've
> > also attached the log files.
> >
> > criu dump -v4 -D /home/saied/work/nsinit/busybox/nsinit/checkpoint -o
> > dump.log --root /home/saied/work/nsinit/busybox --manage-cgroups
> > --evasive-devices -t 31361
> >
> > criu restore -v4 -D /home/saied/work/nsinit/busybox/nsinit/checkpoint -o
> > restore.log --root /home/saied/work/nsinit/busybox --pidfile
> > /home/saied/work/nsinit/busybox/nsinit/restoredpid --manage-cgroups
> > --evasive-devices --inherit-fd fd[0]:pipe:[69253] --inherit-fd
> > fd[1]:pipe:[69254] --inherit-fd fd[2]:pipe:[69255]
> >
> > Any ideas why?!
>
> So I tried to reproduce this and it seems to work correctly for me.
> However, I noticed that you're setting the files directory (-D) to be
> inside the --root. Does this still happen when you don't do that?
>
> What I think might be happening is:
>
> 1. criu mounts the cg fd
> 2. the rest of the restore happens, including the unshare() of the
> mount ns
> 3. criu unmounts the cg fd in the parent namespace
>
> Does that sound possible? (I'll admit I don't have a great
> understanding of namespaces.)
>
> Tycho
>
> > --Saied
> >
> > [Terminal A]
> > $ sudo nsinit exec -- sh -c 'while :; do mount >> /foo; sleep 3; done'
> >
> > [Terminal B]
> > $ sudo nsinit -criu /usr/local/bin/criu checkpoint && echo OK
> > OK
> > $
> >
> > [Terminal A]
> > $ sudo nsinit -criu /usr/local/bin/criu restore
> >
> > [Terminal B]
> > $ cat foo
> > ...
> > rootfs on / type rootfs (rw)
> > /dev/disk/by-uuid/18ec1400-9724-446f-be66-f8426f43f206 on / type ext4
> > (rw,relatime,errors=remount-ro,data=ordered)
> > none on /nsinit/checkpoint/.criu.cgyard.SOcu9c type tmpfs (rw,relatime)
> > none on /nsinit/checkpoint/.criu.cgyard.SOcu9c/cpuset type cgroup
> > (rw,relatime,cpuset)
> > none on /nsinit/checkpoint/.criu.cgyard.SOcu9c/cpu type cgroup
> > (rw,relatime,cpu)
> > none on /nsinit/checkpoint/.criu.cgyard.SOcu9c/cpuacct type cgroup
> > (rw,relatime,cpuacct)
> > none on /nsinit/checkpoint/.criu.cgyard.SOcu9c/memory type cgroup
> > (rw,relatime,memory)
> > none on /nsinit/checkpoint/.criu.cgyard.SOcu9c/devices type cgroup
> > (rw,relatime,devices)
> > none on /nsinit/checkpoint/.criu.cgyard.SOcu9c/freezer type cgroup
> > (rw,relatime,freezer)
> > none on /nsinit/checkpoint/.criu.cgyard.SOcu9c/blkio type cgroup
> > (rw,relatime,blkio)
> > none on /nsinit/checkpoint/.criu.cgyard.SOcu9c/perf_event type cgroup
> > (rw,relatime,perf_event)
> > none on /nsinit/checkpoint/.criu.cgyard.SOcu9c/hugetlb type cgroup
> > (rw,relatime,hugetlb)
> > none on /nsinit/checkpoint/.criu.cgyard.SOcu9c/systemd type cgroup
> > (rw,relatime,name=systemd)
> > proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
> > proc on /proc/sys type proc (rw,nosuid,nodev,noexec,relatime)
> > proc on /proc/bus type proc (rw,nosuid,nodev,noexec,relatime)
> > proc on /proc/irq type proc (rw,nosuid,nodev,noexec,relatime)
> > proc on /proc/sysrq-trigger type proc (rw,nosuid,nodev,noexec,relatime)
> > sysfs on /sys type sysfs (ro,nosuid,nodev,noexec,relatime)
> > tmpfs on /dev type tmpfs (rw,nosuid,relatime,mode=755)
> > devpts on /dev/pts type devpts
> > (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=666)
> > mqueue on /dev/mqueue type mqueue (rw,nosuid,nodev,noexec,relatime)
> > shm on /dev/shm type tmpfs (rw,nosuid,nodev,noexec,relatime,size=65536k)
> > tmpfs on /proc/kcore type tmpfs (rw,nosuid,relatime,mode=755)
> >
> >
> >
> >
> >
> >
> > On Thu, Mar 19, 2015 at 7:50 AM, Tycho Andersen <
> > tycho.andersen at canonical.com> wrote:
> >
> > > We need to finalize the cg yard both on successful cgroup restore and
> on a
> > > failed restore. Further, we should restore the cgroup properties before
> > > allowing the task to continue in all modes (previously properties were
> only
> > > restored correctly in --restore-detached mode).
> > >
> > > CC: Saied Kazemi <saied at google.com>
> > > Signed-off-by: Tycho Andersen <tycho.andersen at canonical.com>
> > > ---
> > > cr-restore.c | 12 ++++++------
> > > 1 file changed, 6 insertions(+), 6 deletions(-)
> > >
> > > diff --git a/cr-restore.c b/cr-restore.c
> > > index 4a1fe4e..8d82945 100644
> > > --- a/cr-restore.c
> > > +++ b/cr-restore.c
> > > @@ -1798,6 +1798,11 @@ static int restore_root_task(struct pstree_item
> > > *init)
> > > if (ret < 0)
> > > goto out_kill;
> > >
> > > + ret = prepare_cgroup_properties();
> > > + fini_cgroup();
> > > + if (ret < 0)
> > > + goto out_kill;
> > > +
> > > ret = run_scripts(ACT_POST_RESTORE);
> > > if (ret != 0) {
> > > pr_err("Aborting restore due to script ret code %d\n",
> > > ret);
> > > @@ -1934,13 +1939,8 @@ int cr_restore_tasks(void)
> > > if (criu_signals_setup() < 0)
> > > goto err;
> > >
> > > - if (restore_root_task(root_item) < 0)
> > > - goto err;
> > > -
> > > - ret = prepare_cgroup_properties();
> > > -
> > > + ret = restore_root_task(root_item);
> > > err:
> > > - fini_cgroup();
> > > cr_plugin_fini(CR_PLUGIN_STAGE__RESTORE, ret);
> > > return ret;
> > > }
> > > --
> > > 2.1.0
> > >
> > >
>
> > (00.000034) Probing sock diag modules
> > (00.000119) Done probing
> > (00.000128) ========================================
> > (00.000142) Dumping processes (pid: 31361)
> > (00.000147) ========================================
> > (00.000253) Found anon-shmem device at 4
> > (00.000269) Reset 31384's dirty tracking
> > (00.000321) ... done
> > (00.000354) Dirty track supported on kernel
> > (00.000389) irmap: Searching irmap cache in work dir
> > (00.000413) No irmap-cache image
> > (00.000419) irmap: Searching irmap cache in parent
> > (00.000426) irmap: No irmap cache
> > (00.000440) cpu: fpu:1 fxsr:1 xsave:1
> > (00.000520) vdso: Parsing at 7fff73349000 7fff7334b000
> > (00.000525) vdso: PT_LOAD p_vaddr: ffffffffff700000
> > (00.000531) vdso: DT_HASH: 0xffffffffff700120
> > (00.000535) vdso: DT_STRTAB: 0xffffffffff700268
> > (00.000537) vdso: DT_SYMTAB: 0xffffffffff700160
> > (00.000539) vdso: DT_STRSZ: 94
> > (00.000541) vdso: DT_SYMENT: 24
> > (00.000543) vdso: nbucket 3 nchain 11 bucket 0x7fff73349128 chain
> 0x7fff73349134
> > (00.000547) vdso: rt [vdso] 7fff73349000-7fff7334b000 [vvar]
> ffffffffffffffff-ffffffffffffffff
> > (00.000622) Writing image inventory (version 1)
> > (00.000685) Add pid ns 1 pid 31384
> > (00.000705) Add net ns 2 pid 31384
> > (00.000715) Add ipc ns 3 pid 31384
> > (00.000727) Add uts ns 4 pid 31384
> > (00.000777) Add mnt ns 5 pid 31384
> > (00.000800) Add user ns 6 pid 31384
> > (00.000805) cg: Dumping cgroups for 31384
> > (00.000858) cg: `- New css ID 1
> > (00.000864) cg: `- [blkio] -> [/user/1003.user/3.session]
> > (00.000866) cg: `- [cpu] -> [/user/1003.user/3.session]
> > (00.000868) cg: `- [cpuacct] -> [/user/1003.user/3.session]
> > (00.000870) cg: `- [cpuset] -> [/]
> > (00.000872) cg: `- [devices] -> [/user/1003.user/3.session]
> > (00.000874) cg: `- [freezer] -> [/user/1003.user/3.session]
> > (00.000876) cg: `- [hugetlb] -> [/user/1003.user/3.session]
> > (00.000878) cg: `- [memory] -> [/user/1003.user/3.session]
> > (00.000880) cg: `- [name=systemd] -> [/user/1003.user/3.session]
> > (00.000882) cg: `- [perf_event] -> [/user/1003.user/3.session]
> > (00.000884) cg: Set 1 is criu one
> > (00.001085) Seized task 31361, state 1
> > (00.001141) Seized task 31376, state 0
> > (00.001300) Collected 31376 in 1 state
> > (00.001324) Collected 31361 in 1 state
> > (00.001353) Will take pid namespace in the image
> > (00.001361) Add pid ns 7 pid 31361
> > (00.001368) Will take net namespace in the image
> > (00.001371) Add net ns 8 pid 31361
> > (00.001380) Will take ipc namespace in the image
> > (00.001383) Add ipc ns 9 pid 31361
> > (00.001392) Will take uts namespace in the image
> > (00.001395) Add uts ns 10 pid 31361
> > (00.001404) Will take mnt namespace in the image
> > (00.001407) Add mnt ns 11 pid 31361
> > (00.001443) Lock network
> > (00.001447) Running network-lock scripts
> > (00.001485) lockinfo: 1:2 1 1095 00:13:9161 0 EOF
> > (00.001493) lockinfo: 2:2 1 899 00:10:9737 0 EOF
> > (00.001585) type ext4 source
> /dev/disk/by-uuid/18ec1400-9724-446f-be66-f8426f43f206 mnt_id 0x46 s_dev
> 0x800001 /home/saied/work/nsinit/busybox @ ./ flags 0x200000 options
> errors=remount-ro,data=ordered
> > (00.001608) type proc source proc mnt_id 0x47 s_dev 0x22 / @ ./proc
> flags 0x20000e options
> > (00.001617) type tmpfs source tmpfs mnt_id 0x48 s_dev 0x23 / @ ./dev
> flags 0x2 options mode=755
> > (00.001623) type devpts source devpts mnt_id 0x49 s_dev 0x24 / @
> ./dev/pts flags 0x20000a options gid=5,mode=620,ptmxmode=666
> > (00.001646) type tmpfs source shm mnt_id 0x4a s_dev 0x25 / @ ./dev/shm
> flags 0x20000e options size=65536k
> > (00.001653) type mqueue source mqueue mnt_id 0x4b s_dev 0x21 / @
> ./dev/mqueue flags 0x20000e options
> > (00.001659) type sysfs source sysfs mnt_id 0x4c s_dev 0x26 / @ ./sys
> flags 0x20000f options
> > (00.001664) type proc source proc mnt_id 0x2c s_dev 0x22 /sys @
> ./proc/sys flags 0x20000f options
> > (00.001670) type proc source proc mnt_id 0x2d s_dev 0x22
> /sysrq-trigger @ ./proc/sysrq-trigger flags 0x20000f options
> > (00.001681) type proc source proc mnt_id 0x2e s_dev 0x22 /irq @
> ./proc/irq flags 0x20000f options
> > (00.001688) type proc source proc mnt_id 0x2f s_dev 0x22 /bus @
> ./proc/bus flags 0x20000f options
> > (00.001694) type tmpfs source tmpfs mnt_id 0x30 s_dev 0x23 /null @
> ./proc/kcore flags 0x2 options mode=755
> > (00.001713) Building mountpoints tree
> > (00.001724) Building plain mount tree
> > (00.001727) Working on 48->71
> > (00.001729) Working on 47->71
> > (00.001731) Working on 46->71
> > (00.001733) Working on 45->71
> > (00.001735) Working on 44->71
> > (00.001737) Working on 76->70
> > (00.001739) Working on 75->72
> > (00.001741) Working on 74->72
> > (00.001743) Working on 73->72
> > (00.001745) Working on 72->70
> > (00.001747) Working on 71->70
> > (00.001749) Working on 70->42
> > (00.001755) Resorting siblings on 70
> > (00.001759) Resorting siblings on 76
> > (00.001761) Resorting siblings on 72
> > (00.001763) Resorting siblings on 75
> > (00.001765) Resorting siblings on 74
> > (00.001766) Resorting siblings on 73
> > (00.001768) Resorting siblings on 71
> > (00.001770) Resorting siblings on 48
> > (00.001772) Resorting siblings on 47
> > (00.001774) Resorting siblings on 46
> > (00.001776) Resorting siblings on 45
> > (00.001778) Resorting siblings on 44
> > (00.001780) Done:
> > (00.001782) [./](70->42)
> > (00.001788) [./sys](76->70)
> > (00.001790) <--
> > (00.001792) [./proc](71->70)
> > (00.001794) [./proc/kcore](48->71)
> > (00.001796) <--
> > (00.001798) [./proc/sys](44->71)
> > (00.001800) <--
> > (00.001802) [./proc/sysrq-trigger](45->71)
> > (00.001804) <--
> > (00.001806) [./proc/irq](46->71)
> > (00.001808) <--
> > (00.001809) [./proc/bus](47->71)
> > (00.001811) <--
> > (00.001813) <--
> > (00.001815) [./dev](72->70)
> > (00.001817) [./dev/mqueue](75->72)
> > (00.001819) <--
> > (00.001821) [./dev/pts](73->72)
> > (00.001823) <--
> > (00.001825) [./dev/shm](74->72)
> > (00.001827) <--
> > (00.001829) <--
> > (00.001831) <--
> > (00.001835) Collecting netns 8/31361
> > (00.001837) Switching to 31361's net for collecting sockets
> > (00.001934) Collected: ino 0x10bcd peer_ino 0 family 1 type 5
> state 7 name (null)
> > (00.002763) Collect netlink sock 0x10e8c
> > (00.002771) Collect netlink sock 0x10bcc
> > (00.002773) Collect netlink sock 0x10e94
> > (00.002775) Collect netlink sock 0x10e8f
> > (00.002777) Collect netlink sock 0x10e8d
> > (00.002780) Collect netlink sock 0x10e8e
> > (00.002802) ========================================
> > (00.002806) Dumping task (pid: 31361)
> > (00.002808) ========================================
> > (00.002810) Obtaining task stat ... (00.002836)
> > (00.002840) Collecting mappings (pid: 31361)
> > (00.002842) ----------------------------------------
> > (00.002966) vma 688000 borrows vfi from previous 400000
> > (00.003043) vma 7f8f98581000 borrows vfi from previous 7f8f98580000
> > (00.003133) vma 7f8f9878e000 borrows vfi from previous 7f8f9878d000
> > (00.003161) Collected, longest area occupies 512 pages
> > (00.003165) 0x400000-0x489000 (548K) prot 0x5 flags 0x2 st 0x41 off 0
> reg fp shmid: 0
> > (00.003173) 0x688000-0x689000 (4K) prot 0x3 flags 0x2 st 0x41 off
> 0x88000 reg fp shmid: 0
> > (00.003176) 0x689000-0x68b000 (8K) prot 0x3 flags 0x22 st 0x201 off 0
> reg ap shmid: 0
> > (00.003179) 0x2443000-0x2447000 (16K) prot 0x3 flags 0x22 st 0x221 off 0
> reg heap ap shmid: 0
> > (00.003181) 0x7f8f9832f000-0x7f8f98380000 (324K) prot 0x5 flags 0x2 st
> 0x41 off 0 reg fp shmid: 0
> > (00.003184) 0x7f8f98380000-0x7f8f98580000 (2048K) prot 0 flags 0x22 st
> 0x201 off 0 reg ap shmid: 0
> > (00.003186) 0x7f8f98580000-0x7f8f98581000 (4K) prot 0x1 flags 0x2 st
> 0x41 off 0x51000 reg fp shmid: 0
> > (00.003189) 0x7f8f98581000-0x7f8f98582000 (4K) prot 0x3 flags 0x2 st
> 0x41 off 0x52000 reg fp shmid: 0
> > (00.003191) 0x7f8f98582000-0x7f8f98587000 (20K) prot 0x3 flags 0x22 st
> 0x201 off 0 reg ap shmid: 0
> > (00.003194) 0x7f8f98587000-0x7f8f9858d000 (24K) prot 0x5 flags 0x2 st
> 0x41 off 0 reg fp shmid: 0
> > (00.003196) 0x7f8f9878a000-0x7f8f9878d000 (12K) prot 0x3 flags 0x22 st
> 0x201 off 0 reg ap shmid: 0
> > (00.003198) 0x7f8f9878d000-0x7f8f9878e000 (4K) prot 0x1 flags 0x2 st
> 0x41 off 0x6000 reg fp shmid: 0
> > (00.003201) 0x7f8f9878e000-0x7f8f9878f000 (4K) prot 0x3 flags 0x2 st
> 0x41 off 0x7000 reg fp shmid: 0
> > (00.003203) 0x7fff79953000-0x7fff79975000 (136K) prot 0x3 flags 0x122 st
> 0x201 off 0 reg ap shmid: 0
> > (00.003206) 0x7fff799fe000-0x7fff79a00000 (8K) prot 0x5 flags 0x22 st
> 0x209 off 0 reg vdso ap shmid: 0
> > (00.003208) 0xffffffffff600000-0xffffffffff601000 (4K) prot 0x5 flags
> 0x22 st 0x204 off 0 vsys ap shmid: 0
> > (00.003219) ----------------------------------------
> > (00.003222)
> > (00.003224) Collecting fds (pid: 31361)
> > (00.003226) ----------------------------------------
> > (00.003241) Found 3 file descriptors
> > (00.003245) ----------------------------------------
> > (00.003258) Dump private signals of 31361
> > (00.003268) Dump shared signals of 31361
> > (00.003285) Parasite syscall_ip at 0x400000
> > (00.003415) Putting parasite blob into 0x7f473d6a1000->0x7f8f9877d000
> > (00.003456) Dumping GP/FPU registers for 31361
> > (00.003469) xsave runtime structure
> > (00.003473) -----------------------
> > (00.003475) cwd:37f swd:0 twd:0 fop:0 mxcsr:1f80 mxcsr_mask:ffff
> > (00.003477) magic1:46505853 extended_size:344 xstate_bv:7 xstate_size:340
> > (00.003479) xstate_bv: 7
> > (00.003481) -----------------------
> > (00.003491) Putting tsock into pid 31361
> > (00.003582) Wait for parasite being daemonized...
> > (00.003592) Wait for ack 2 on daemon socket
> > pie: Running daemon thread leader
> > pie: __sent ack msg: 2 2 0
> > pie: Daemon wais for command
> > (00.003638) Fetched ack: 2 2 0
> > (00.003647) Parasite 31361 has been switched to daemon mode
> > (00.003661) Sent msg to daemon 15 0 0
> > pie: __fetched msg: 15 0 0
> > pie: __sent ack msg: 15 15 0
> > pie: Daemon wais for command
> > (00.003716) Wait for ack 15 on daemon socket
> > (00.003725) Fetched ack: 15 15 0
> > (00.003749) Sent msg to daemon 17 0 0
> > (00.003757) Wait for ack 17 on daemon socket
> > pie: __fetched msg: 17 0 0
> > pie: __sent ack msg: 17 17 0
> > pie: Daemon wais for command
> > (00.003799) Fetched ack: 17 17 0
> > (00.003823) Sent msg to daemon 12 0 0
> > (00.003830) Wait for ack 12 on daemon socket
> > pie: __fetched msg: 12 0 0
> > pie: __sent ack msg: 12 12 0
> > pie: Daemon wais for command
> > (00.003889) Fetched ack: 12 12 0
> > (00.003901) sid=1 pgid=1 pid=1
> > (00.003942)
> > (00.003946) Dumping opened files (pid: 31361)
> > (00.003952) ----------------------------------------
> > (00.003963) Sent msg to daemon 14 0 0
> > pie: __fetched msg: 14 0 0
> > pie: __sent ack msg: 14 14 0
> > pie: Daemon wais for command
> > (00.004041) Wait for ack 14 on daemon socket
> > (00.004048) Fetched ack: 14 14 0
> > (00.004083) 31361 fdinfo 0: pos: 0x 0 flags:
> 0/0
> > (00.004100) Dumping pipe 13 with id 0x1 pipe_id 0x10e85
> > (00.004125) Dumping data from pipe 0x10e85 fd 13
> > (00.004170) fdinfo: type: 0x 2 flags: 0/0 pos: 0x 0 fd: 0
> > (00.004207) 31361 fdinfo 1: pos: 0x 0 flags:
> 1/0
> > (00.004213) Dumping pipe 14 with id 0x2 pipe_id 0x10e86
> > (00.004217) fdinfo: type: 0x 2 flags: 01/0 pos: 0x 0 fd: 1
> > (00.004238) 31361 fdinfo 2: pos: 0x 0 flags:
> 1/0
> > (00.004243) Dumping pipe 15 with id 0x3 pipe_id 0x10e87
> > (00.004246) fdinfo: type: 0x 2 flags: 01/0 pos: 0x 0 fd: 2
> > (00.004257) ----------------------------------------
> > (00.004270) Sent msg to daemon 7 0 0
> > (00.004273) Wait for ack 7 on daemon socket
> > pie: __fetched msg: 7 0 0
> > pie: __sent ack msg: 7 7 0
> > pie: Daemon wais for command
> > (00.004332) Fetched ack: 7 7 0
> > (00.004339)
> > (00.004341) Dumping pages (type: 59 pid: 31361)
> > (00.004344) ----------------------------------------
> > (00.004346) Private vmas 512/791 pages
> > (00.004361) pagemap-cache: created for pid 31361 (takes 4096 bytes)
> > (00.004368) page-pipe: Create page pipe for 791 segs
> > (00.004374) page-pipe: Will grow page pipe (iov off is 0)
> > (00.004415) pagemap-cache: filling VMA 400000-489000 (548K) [l:400000
> h:600000]
> > (00.004420) pagemap-cache: 400000-489000 nr:1
> cov:561152
> > (00.004422) pagemap-cache: simple mode [l:400000 h:489000]
> > (00.004430) page-pipe: Add iov to page pipe (0 iovs, 0/791 total)
> > (00.004433) Pagemap generated: 1 pages 0 holes
> > (00.004436) pagemap-cache: filling VMA 688000-689000 (4K) [l:600000
> h:800000]
> > (00.004440) page-pipe: Add iov to page pipe (1 iovs, 1/791 total)
> > (00.004442) Pagemap generated: 1 pages 0 holes
> > (00.004445) pagemap-cache: filling VMA 689000-68b000 (8K) [l:600000
> h:800000]
> > (00.004448) Pagemap generated: 2 pages 0 holes
> > (00.004451) pagemap-cache: filling VMA 2443000-2447000 (16K) [l:2400000
> h:2600000]
> > (00.004453) pagemap-cache: 2443000-2447000 nr:1
> cov:16384
> > (00.004463) pagemap-cache: simple mode [l:2443000 h:2447000]
> > (00.004468) page-pipe: Add iov to page pipe (2 iovs, 2/791 total)
> > (00.004471) Pagemap generated: 4 pages 0 holes
> > (00.004473) pagemap-cache: filling VMA 7f8f9832f000-7f8f98380000 (324K)
> [l:7f8f98200000 h:7f8f98400000]
> > (00.004478) Pagemap generated: 0 pages 0 holes
> > (00.004481) pagemap-cache: filling VMA 7f8f98380000-7f8f98580000 (2048K)
> [l:7f8f98200000 h:7f8f98400000]
> > (00.004488) Pagemap generated: 0 pages 0 holes
> > (00.004491) pagemap-cache: filling VMA 7f8f98580000-7f8f98581000 (4K)
> [l:7f8f98400000 h:7f8f98600000]
> > (00.004494) page-pipe: Add iov to page pipe (3 iovs, 3/791 total)
> > (00.004497) Pagemap generated: 1 pages 0 holes
> > (00.004499) pagemap-cache: filling VMA 7f8f98581000-7f8f98582000 (4K)
> [l:7f8f98400000 h:7f8f98600000]
> > (00.004502) Pagemap generated: 1 pages 0 holes
> > (00.004505) pagemap-cache: filling VMA 7f8f98582000-7f8f98587000 (20K)
> [l:7f8f98400000 h:7f8f98600000]
> > (00.004508) page-pipe: Add iov to page pipe (4 iovs, 4/791 total)
> > (00.004510) Pagemap generated: 3 pages 0 holes
> > (00.004513) pagemap-cache: filling VMA 7f8f98587000-7f8f9858d000 (24K)
> [l:7f8f98400000 h:7f8f98600000]
> > (00.004516) Pagemap generated: 0 pages 0 holes
> > (00.004518) pagemap-cache: filling VMA 7f8f9878a000-7f8f9878d000 (12K)
> [l:7f8f98600000 h:7f8f98800000]
> > (00.004521) page-pipe: Add iov to page pipe (5 iovs, 5/791 total)
> > (00.004524) Pagemap generated: 3 pages 0 holes
> > (00.004526) pagemap-cache: filling VMA 7f8f9878d000-7f8f9878e000 (4K)
> [l:7f8f98600000 h:7f8f98800000]
> > (00.004530) page-pipe: Grow pipe 10 -> 20
> > (00.004533) Pagemap generated: 1 pages 0 holes
> > (00.004535) pagemap-cache: filling VMA 7f8f9878e000-7f8f9878f000 (4K)
> [l:7f8f98600000 h:7f8f98800000]
> > (00.004546) Pagemap generated: 1 pages 0 holes
> > (00.004549) pagemap-cache: filling VMA 7fff79953000-7fff79975000 (136K)
> [l:7fff79800000 h:7fff79a00000]
> > (00.004553) page-pipe: Add iov to page pipe (6 iovs, 6/791 total)
> > (00.004556) Pagemap generated: 2 pages 0 holes
> > (00.004558) pagemap-cache: filling VMA 7fff799fe000-7fff79a00000 (8K)
> [l:7fff79800000 h:7fff79a00000]
> > (00.004561) page-pipe: Add iov to page pipe (7 iovs, 7/791 total)
> > (00.004563) Pagemap generated: 2 pages 0 holes
> > (00.004566) page-pipe: Page pipe:
> > (00.004567) page-pipe: * 1 pipes 8/791 iovs:
> > (00.004570) page-pipe: buf 22 pages, 8 iovs:
> > (00.004572) page-pipe: 0x400000 1
> > (00.004574) page-pipe: 0x688000 3
> > (00.004576) page-pipe: 0x2443000 4
> > (00.004578) page-pipe: 0x7f8f98580000 3
> > (00.004579) page-pipe: 0x7f8f98585000 2
> > (00.004581) page-pipe: 0x7f8f9878a000 5
> > (00.004583) page-pipe: 0x7fff79973000 2
> > (00.004585) page-pipe: 0x7fff799fe000 2
> > (00.004587) page-pipe: * 0 holes:
> > (00.004589) PPB: 22 pages 8 segs 32 pipe 0 off
> > (00.004599) Sent msg to daemon 8 0 0
> > (00.004606) Wait for ack 8 on daemon socket
> > pie: __fetched msg: 8 0 0
> > pie: __sent ack msg: 8 8 0
> > pie: Daemon wais for command
> > (00.004680) Fetched ack: 8 8 0
> > (00.004687) Transfering pages:
> > (00.004689) buf 22/8
> > (00.004691) p 0x400000 [1]
> > (00.004706) p 0x688000 [3]
> > (00.004720) p 0x2443000 [4]
> > (00.004767) p 0x7f8f98580000 [3]
> > (00.004788) p 0x7f8f98585000 [2]
> > (00.004803) p 0x7f8f9878a000 [5]
> > (00.004825) p 0x7fff79973000 [2]
> > (00.004843) p 0x7fff799fe000 [2]
> > (00.004878) page-pipe: Killing page pipe
> > (00.004885) ----------------------------------------
> > (00.004897) Sent msg to daemon 7 0 0
> > (00.004900) Wait for ack 7 on daemon socket
> > pie: __fetched msg: 7 0 0
> > pie: __sent ack msg: 7 7 0
> > pie: Daemon wais for command
> > (00.004944) Fetched ack: 7 7 0
> > (00.004957) Sent msg to daemon 9 0 0
> > (00.004961) Wait for ack 9 on daemon socket
> > pie: __fetched msg: 9 0 0
> > pie: __sent ack msg: 9 9 0
> > pie: Daemon wais for command
> > (00.005001) Fetched ack: 9 9 0
> > (00.005041) Sent msg to daemon 10 0 0
> > (00.005046) Wait for ack 10 on daemon socket
> > pie: __fetched msg: 10 0 0
> > pie: __sent ack msg: 10 10 0
> > pie: Daemon wais for command
> > (00.005088) Fetched ack: 10 10 0
> > (00.005103) Sent msg to daemon 11 0 0
> > (00.005106) Wait for ack 11 on daemon socket
> > pie: __fetched msg: 11 0 0
> > pie: __sent ack msg: 11 11 0
> > pie: Daemon wais for command
> > (00.005139) Fetched ack: 11 11 0
> > (00.005151)
> > (00.005153) Dumping core (pid: 31361)
> > (00.005155) ----------------------------------------
> > (00.005157) Obtaining personality ... (00.005177) 31361 has 0 sched
> policy
> > (00.005183) dumping 0 nice for 31361
> > (00.005189) cg: Dumping cgroups for 31361
> > (00.005242) cg: `- New css ID 2
> > (00.005248) cg: `- [blkio] -> [/nsinit/busybox]
> > (00.005251) cg: `- [cpu] -> [/nsinit/busybox]
> > (00.005253) cg: `- [cpuacct] -> [/nsinit/busybox]
> > (00.005255) cg: `- [cpuset] -> [/nsinit/busybox]
> > (00.005257) cg: `- [devices] -> [/nsinit/busybox]
> > (00.005259) cg: `- [freezer] -> [/nsinit/busybox]
> > (00.005261) cg: `- [hugetlb] -> [/user/1003.user/2.session]
> > (00.005263) cg: `- [memory] -> [/nsinit/busybox]
> > (00.005265) cg: `- [name=systemd] -> [/user/1003.user/2.session]
> > (00.005267) cg: `- [perf_event] -> [/nsinit/busybox]
> > (00.005269) cg: Set 2 is root one
> > (00.016882) cg: adding cgroup /proc/self/fd/14/nsinit/busybox
> > (00.016915) cg: Dumping value 500 from
> /proc/self/fd/14/nsinit/busybox/blkio.weight
> > (00.016931) cg: Dumping value 0 from
> /proc/self/fd/14/nsinit/busybox/notify_on_release
> > (00.036909) cg: adding cgroup /proc/self/fd/14/nsinit/busybox
> > (00.036950) cg: Dumping value 1024 from
> /proc/self/fd/14/nsinit/busybox/cpu.shares
> > (00.036966) cg: Dumping value 100000 from
> /proc/self/fd/14/nsinit/busybox/cpu.cfs_period_us
> > (00.036982) cg: Dumping value -1 from
> /proc/self/fd/14/nsinit/busybox/cpu.cfs_quota_us
> > (00.036993) cg: Couldn't open
> /proc/self/fd/14/nsinit/busybox/cpu.rt_period_us. This cgroup property may
> not exist on this kernel
> > (00.037003) cg: Couldn't open
> /proc/self/fd/14/nsinit/busybox/cpu.rt_runtime_us. This cgroup property may
> not exist on this kernel
> > (00.037027) cg: Dumping value 0 from
> /proc/self/fd/14/nsinit/busybox/notify_on_release
> > (00.044864) cg: adding cgroup /proc/self/fd/14/nsinit/busybox
> > (00.052867) cg: adding cgroup /proc/self/fd/14/nsinit/busybox
> > (00.052917) cg: Dumping value 0-3 from
> /proc/self/fd/14/nsinit/busybox/cpuset.cpus
> > (00.052931) cg: Dumping value 0 from
> /proc/self/fd/14/nsinit/busybox/cpuset.mems
> > (00.052946) cg: Dumping value 0 from
> /proc/self/fd/14/nsinit/busybox/cpuset.memory_migrate
> > (00.052959) cg: Dumping value 0 from
> /proc/self/fd/14/nsinit/busybox/cpuset.cpu_exclusive
> > (00.052973) cg: Dumping value 0 from
> /proc/self/fd/14/nsinit/busybox/cpuset.mem_exclusive
> > (00.052986) cg: Dumping value 0 from
> /proc/self/fd/14/nsinit/busybox/cpuset.mem_hardwall
> > (00.052997) cg: Dumping value 0 from
> /proc/self/fd/14/nsinit/busybox/cpuset.memory_spread_page
> > (00.053007) cg: Dumping value 0 from
> /proc/self/fd/14/nsinit/busybox/cpuset.memory_spread_slab
> > (00.053019) cg: Dumping value 1 from
> /proc/self/fd/14/nsinit/busybox/cpuset.sched_load_balance
> > (00.053033) cg: Dumping value -1 from
> /proc/self/fd/14/nsinit/busybox/cpuset.sched_relax_domain_level
> > (00.053056) cg: Dumping value 0 from
> /proc/self/fd/14/nsinit/busybox/notify_on_release
> > (00.060838) cg: adding cgroup /proc/self/fd/14/nsinit/busybox
> > (00.068869) cg: adding cgroup /proc/self/fd/14/nsinit/busybox
> > (00.068900) cg: Dumping value 0 from
> /proc/self/fd/14/nsinit/busybox/notify_on_release
> > (00.076875) cg: adding cgroup /proc/self/fd/14/user/1003.user/2.session
> > (00.084914) cg: adding cgroup /proc/self/fd/14/nsinit/busybox
> > (00.084957) cg: Dumping value -1 from
> /proc/self/fd/14/nsinit/busybox/memory.limit_in_bytes
> > (00.084967) cg: Couldn't open
> /proc/self/fd/14/nsinit/busybox/memory.memsw.limit_in_bytes. This cgroup
> property may not exist on this kernel
> > (00.084985) cg: Dumping value 0 from
> /proc/self/fd/14/nsinit/busybox/memory.use_hierarchy
> > (00.084999) cg: Dumping value 0 from
> /proc/self/fd/14/nsinit/busybox/notify_on_release
> > (00.092930) cg: adding cgroup /proc/self/fd/14/user/1003.user/2.session
> > (00.100917) cg: adding cgroup /proc/self/fd/14/nsinit/busybox
> > (00.101007) ----------------------------------------
> > (00.101013)
> > (00.101015) Dumping creds for 31361)
> > (00.101017) ----------------------------------------
> > (00.101031) Sent msg to daemon 13 0 0
> > (00.101037) Wait for ack 13 on daemon socket
> > pie: __fetched msg: 13 0 0
> > pie: __sent ack msg: 13 13 0
> > pie: Daemon wais for command
> > (00.101118) Fetched ack: 13 13 0
> > (00.101181) Waiting for 31361 to trap
> > (00.101244) Daemon 31361 exited trapping
> > (00.101255) Sent msg to daemon 6 0 0
> > pie: __fetched msg: 6 0 0
> > pie: 1: new_sp=0x7f8f98785008 ip 0x7f8f9833ee1a
> > (00.101573) 31361 was trapped
> > (00.101581) `- Expecting exit
> > (00.101627) 31361 was trapped
> > (00.101634) 31361 is going to execute the syscall f
> > (00.101714) 31361 was stopped
> > (00.101772) 31361 was trapped
> > (00.101779) 31361 is going to execute the syscall 1
> > (00.101849) 31361 was trapped
> > (00.101854) `- Expecting exit
> > (00.101889) 31361 was trapped
> > (00.101896) 31361 is going to execute the syscall b
> > (00.101947) 31361 was stopped
> > (00.101987)
> > (00.101991) Dumping mm (pid: 31361)
> > (00.101993) ----------------------------------------
> > (00.101996) 0x400000-0x489000 (548K) prot 0x5 flags 0x2 st 0x41 off 0
> reg fp shmid: 0
> > (00.102022) Dumping path for -3 fd via self 6 [/bin/busybox]
> > (00.102061) 0x688000-0x689000 (4K) prot 0x3 flags 0x2 st 0x41 off
> 0x88000 reg fp shmid: 0
> > (00.102067) 0x689000-0x68b000 (8K) prot 0x3 flags 0x22 st 0x201 off 0
> reg ap shmid: 0
> > (00.102070) 0x2443000-0x2447000 (16K) prot 0x3 flags 0x22 st 0x221 off 0
> reg heap ap shmid: 0
> > (00.102072) 0x7f8f9832f000-0x7f8f98380000 (324K) prot 0x5 flags 0x2 st
> 0x41 off 0 reg fp shmid: 0
> > (00.102082) Dumping path for -3 fd via self 9 [/lib/
> libuClibc-0.9.33.2.so]
> > (00.102089) 0x7f8f98380000-0x7f8f98580000 (2048K) prot 0 flags 0x22 st
> 0x201 off 0 reg ap shmid: 0
> > (00.102092) 0x7f8f98580000-0x7f8f98581000 (4K) prot 0x1 flags 0x2 st
> 0x41 off 0x51000 reg fp shmid: 0
> > (00.102095) 0x7f8f98581000-0x7f8f98582000 (4K) prot 0x3 flags 0x2 st
> 0x41 off 0x52000 reg fp shmid: 0
> > (00.102097) 0x7f8f98582000-0x7f8f98587000 (20K) prot 0x3 flags 0x22 st
> 0x201 off 0 reg ap shmid: 0
> > (00.102100) 0x7f8f98587000-0x7f8f9858d000 (24K) prot 0x5 flags 0x2 st
> 0x41 off 0 reg fp shmid: 0
> > (00.102108) Dumping path for -3 fd via self 11 [/lib/
> ld64-uClibc-0.9.33.2.so]
> > (00.102113) 0x7f8f9878a000-0x7f8f9878d000 (12K) prot 0x3 flags 0x22 st
> 0x201 off 0 reg ap shmid: 0
> > (00.102116) 0x7f8f9878d000-0x7f8f9878e000 (4K) prot 0x1 flags 0x2 st
> 0x41 off 0x6000 reg fp shmid: 0
> > (00.102119) 0x7f8f9878e000-0x7f8f9878f000 (4K) prot 0x3 flags 0x2 st
> 0x41 off 0x7000 reg fp shmid: 0
> > (00.102122) 0x7fff79953000-0x7fff79975000 (136K) prot 0x3 flags 0x122 st
> 0x201 off 0 reg ap shmid: 0
> > (00.102124) 0x7fff799fe000-0x7fff79a00000 (8K) prot 0x5 flags 0x22 st
> 0x209 off 0 reg vdso ap shmid: 0
> > (00.102127) 0xffffffffff600000-0xffffffffff601000 (4K) prot 0x5 flags
> 0x22 st 0x204 off 0 vsys ap shmid: 0
> > (00.102130) Obtaining task auvx ...
> > (00.102232) Dumping path for -3 fd via self 18 [/]
> > (00.102251) Dumping task cwd id 0x7 root id 0x7
> > (00.102323) ========================================
> > (00.102327) Dumping task (pid: 31376)
> > (00.102330) ========================================
> > (00.102331) Obtaining task stat ... (00.102371)
> > (00.102375) Collecting mappings (pid: 31376)
> > (00.102378) ----------------------------------------
> > (00.102466) vma 688000 borrows vfi from previous 400000
> > (00.102514) vma 7f5475cea000 borrows vfi from previous 7f5475ce9000
> > (00.102588) vma 7f5475ef7000 borrows vfi from previous 7f5475ef6000
> > (00.102611) Collected, longest area occupies 512 pages
> > (00.102615) 0x400000-0x489000 (548K) prot 0x5 flags 0x2 st 0x41 off 0
> reg fp shmid: 0
> > (00.102618) 0x688000-0x689000 (4K) prot 0x3 flags 0x2 st 0x41 off
> 0x88000 reg fp shmid: 0
> > (00.102621) 0x689000-0x68b000 (8K) prot 0x3 flags 0x22 st 0x201 off 0
> reg ap shmid: 0
> > (00.102623) 0x7f5475a98000-0x7f5475ae9000 (324K) prot 0x5 flags 0x2 st
> 0x41 off 0 reg fp shmid: 0
> > (00.102626) 0x7f5475ae9000-0x7f5475ce9000 (2048K) prot 0 flags 0x22 st
> 0x201 off 0 reg ap shmid: 0
> > (00.102628) 0x7f5475ce9000-0x7f5475cea000 (4K) prot 0x1 flags 0x2 st
> 0x41 off 0x51000 reg fp shmid: 0
> > (00.102631) 0x7f5475cea000-0x7f5475ceb000 (4K) prot 0x3 flags 0x2 st
> 0x41 off 0x52000 reg fp shmid: 0
> > (00.102633) 0x7f5475ceb000-0x7f5475cf0000 (20K) prot 0x3 flags 0x22 st
> 0x201 off 0 reg ap shmid: 0
> > (00.102636) 0x7f5475cf0000-0x7f5475cf6000 (24K) prot 0x5 flags 0x2 st
> 0x41 off 0 reg fp shmid: 0
> > (00.102654) 0x7f5475ef3000-0x7f5475ef6000 (12K) prot 0x3 flags 0x22 st
> 0x201 off 0 reg ap shmid: 0
> > (00.102657) 0x7f5475ef6000-0x7f5475ef7000 (4K) prot 0x1 flags 0x2 st
> 0x41 off 0x6000 reg fp shmid: 0
> > (00.102660) 0x7f5475ef7000-0x7f5475ef8000 (4K) prot 0x3 flags 0x2 st
> 0x41 off 0x7000 reg fp shmid: 0
> > (00.102663) 0x7fffa844a000-0x7fffa846c000 (136K) prot 0x3 flags 0x122 st
> 0x201 off 0 reg ap shmid: 0
> > (00.102665) 0x7fffa8476000-0x7fffa8478000 (8K) prot 0x5 flags 0x22 st
> 0x209 off 0 reg vdso ap shmid: 0
> > (00.102667) 0xffffffffff600000-0xffffffffff601000 (4K) prot 0x5 flags
> 0x22 st 0x204 off 0 vsys ap shmid: 0
> > (00.102670) ----------------------------------------
> > (00.102680)
> > (00.102682) Collecting fds (pid: 31376)
> > (00.102684) ----------------------------------------
> > (00.102709) Found 3 file descriptors
> > (00.102713) ----------------------------------------
> > (00.102734) Dump private signals of 31376
> > (00.102739) Dump shared signals of 31376
> > (00.102750) Parasite syscall_ip at 0x400000
> > (00.102854) Putting parasite blob into 0x7f473d6a1000->0x7f5475ee6000
> > (00.102894) Dumping GP/FPU registers for 31376
> > (00.102905) xsave runtime structure
> > (00.102909) -----------------------
> > (00.102911) cwd:37f swd:0 twd:0 fop:0 mxcsr:1f80 mxcsr_mask:ffff
> > (00.102913) magic1:46505853 extended_size:344 xstate_bv:7 xstate_size:340
> > (00.102915) xstate_bv: 7
> > (00.102917) -----------------------
> > (00.102924) Putting tsock into pid 31376
> > (00.102996) Wait for parasite being daemonized...
> > (00.103003) Wait for ack 2 on daemon socket
> > pie: Running daemon thread leader
> > pie: __sent ack msg: 2 2 0
> > pie: Daemon wais for command
> > (00.103042) Fetched ack: 2 2 0
> > (00.103048) Parasite 31376 has been switched to daemon mode
> > (00.103074) Sent msg to daemon 17 0 0
> > (00.103078) Wait for ack 17 on daemon socket
> > pie: __fetched msg: 17 0 0
> > pie: __sent ack msg: 17 17 0
> > pie: Daemon wais for command
> > (00.103112) Fetched ack: 17 17 0
> > (00.103139) Sent msg to daemon 12 0 0
> > (00.103143) Wait for ack 12 on daemon socket
> > pie: __fetched msg: 12 0 0
> > pie: __sent ack msg: 12 12 0
> > pie: Daemon wais for command
> > (00.103178) Fetched ack: 12 12 0
> > (00.103184) sid=1 pgid=1 pid=11
> > (00.103210)
> > (00.103214) Dumping opened files (pid: 31376)
> > (00.103216) ----------------------------------------
> > (00.103227) Sent msg to daemon 14 0 0
> > pie: __fetched msg: 14 0 0
> > pie: __sent ack msg: 14 14 0
> > pie: Daemon wais for command
> > (00.103268) Wait for ack 14 on daemon socket
> > (00.103275) Fetched ack: 14 14 0
> > (00.103290) 31376 fdinfo 0: pos: 0x 0 flags:
> 0/0
> > (00.103297) fdinfo: type: 0x 2 flags: 0/0 pos: 0x 0 fd: 0
> > (00.103320) 31376 fdinfo 1: pos: 0x 0 flags:
> 1/0
> > (00.103326) fdinfo: type: 0x 2 flags: 01/0 pos: 0x 0 fd: 1
> > (00.103335) 31376 fdinfo 2: pos: 0x 0 flags:
> 1/0
> > (00.103339) fdinfo: type: 0x 2 flags: 01/0 pos: 0x 0 fd: 2
> > (00.103355) ----------------------------------------
> > (00.103368) Sent msg to daemon 7 0 0
> > (00.103372) Wait for ack 7 on daemon socket
> > pie: __fetched msg: 7 0 0
> > pie: __sent ack msg: 7 7 0
> > pie: Daemon wais for command
> > (00.103416) Fetched ack: 7 7 0
> > (00.103422)
> > (00.103424) Dumping pages (type: 59 pid: 31376)
> > (00.103426) ----------------------------------------
> > (00.103429) Private vmas 512/787 pages
> > (00.103436) pagemap-cache: created for pid 31376 (takes 4096 bytes)
> > (00.103439) page-pipe: Create page pipe for 787 segs
> > (00.103441) page-pipe: Will grow page pipe (iov off is 0)
> > (00.103480) pagemap-cache: filling VMA 400000-489000 (548K) [l:400000
> h:600000]
> > (00.103485) pagemap-cache: 400000-489000 nr:1
> cov:561152
> > (00.103487) pagemap-cache: simple mode [l:400000 h:489000]
> > (00.103494) page-pipe: Add iov to page pipe (0 iovs, 0/787 total)
> > (00.103497) Pagemap generated: 1 pages 0 holes
> > (00.103499) pagemap-cache: filling VMA 688000-689000 (4K) [l:600000
> h:800000]
> > (00.103503) page-pipe: Add iov to page pipe (1 iovs, 1/787 total)
> > (00.103506) Pagemap generated: 1 pages 0 holes
> > (00.103508) pagemap-cache: filling VMA 689000-68b000 (8K) [l:600000
> h:800000]
> > (00.103521) Pagemap generated: 2 pages 0 holes
> > (00.103523) pagemap-cache: filling VMA 7f5475a98000-7f5475ae9000 (324K)
> [l:7f5475a00000 h:7f5475c00000]
> > (00.103530) Pagemap generated: 0 pages 0 holes
> > (00.103532) pagemap-cache: filling VMA 7f5475ae9000-7f5475ce9000 (2048K)
> [l:7f5475a00000 h:7f5475c00000]
> > (00.103540) Pagemap generated: 0 pages 0 holes
> > (00.103543) pagemap-cache: filling VMA 7f5475ce9000-7f5475cea000 (4K)
> [l:7f5475c00000 h:7f5475e00000]
> > (00.103546) page-pipe: Add iov to page pipe (2 iovs, 2/787 total)
> > (00.103549) Pagemap generated: 1 pages 0 holes
> > (00.103551) pagemap-cache: filling VMA 7f5475cea000-7f5475ceb000 (4K)
> [l:7f5475c00000 h:7f5475e00000]
> > (00.103555) Pagemap generated: 1 pages 0 holes
> > (00.103557) pagemap-cache: filling VMA 7f5475ceb000-7f5475cf0000 (20K)
> [l:7f5475c00000 h:7f5475e00000]
> > (00.103561) page-pipe: Add iov to page pipe (3 iovs, 3/787 total)
> > (00.103563) Pagemap generated: 2 pages 0 holes
> > (00.103565) pagemap-cache: filling VMA 7f5475cf0000-7f5475cf6000 (24K)
> [l:7f5475c00000 h:7f5475e00000]
> > (00.103569) Pagemap generated: 0 pages 0 holes
> > (00.103571) pagemap-cache: filling VMA 7f5475ef3000-7f5475ef6000 (12K)
> [l:7f5475e00000 h:7f5476000000]
> > (00.103575) page-pipe: Add iov to page pipe (4 iovs, 4/787 total)
> > (00.103577) Pagemap generated: 3 pages 0 holes
> > (00.103579) pagemap-cache: filling VMA 7f5475ef6000-7f5475ef7000 (4K)
> [l:7f5475e00000 h:7f5476000000]
> > (00.103583) Pagemap generated: 1 pages 0 holes
> > (00.103585) pagemap-cache: filling VMA 7f5475ef7000-7f5475ef8000 (4K)
> [l:7f5475e00000 h:7f5476000000]
> > (00.103589) Pagemap generated: 1 pages 0 holes
> > (00.103591) pagemap-cache: filling VMA 7fffa844a000-7fffa846c000 (136K)
> [l:7fffa8400000 h:7fffa8600000]
> > (00.103593) pagemap-cache: 7fffa844a000-7fffa846c000 nr:1
> cov:139264
> > (00.103596) pagemap-cache: 7fffa8476000-7fffa8478000 nr:2
> cov:147456
> > (00.103598) pagemap-cache: cache mode [l:7fffa844a000 h:7fffa8600000]
> > (00.103602) page-pipe: Add iov to page pipe (5 iovs, 5/787 total)
> > (00.103605) Pagemap generated: 3 pages 0 holes
> > (00.103608) page-pipe: Grow pipe 10 -> 20
> > (00.103610) page-pipe: Add iov to page pipe (6 iovs, 6/787 total)
> > (00.103612) Pagemap generated: 2 pages 0 holes
> > (00.103614) page-pipe: Page pipe:
> > (00.103616) page-pipe: * 1 pipes 7/787 iovs:
> > (00.103618) page-pipe: buf 18 pages, 7 iovs:
> > (00.103620) page-pipe: 0x400000 1
> > (00.103622) page-pipe: 0x688000 3
> > (00.103625) page-pipe: 0x7f5475ce9000 2
> > (00.103629) page-pipe: 0x7f5475cee000 2
> > (00.103633) page-pipe: 0x7f5475ef3000 5
> > (00.103636) page-pipe: 0x7fffa8469000 3
> > (00.103639) page-pipe: 0x7fffa8476000 2
> > (00.103642) page-pipe: * 0 holes:
> > (00.103645) PPB: 18 pages 7 segs 32 pipe 0 off
> > (00.103668) Sent msg to daemon 8 0 0
> > pie: __fetched msg: 8 0 0
> > (00.103685) Wait for ack 8 on daemon socket
> > pie: __sent ack msg: 8 8 0
> > pie: Daemon wais for command
> > (00.103724) Fetched ack: 8 8 0
> > (00.103734) Transfering pages:
> > (00.103738) buf 18/7
> > (00.103742) p 0x400000 [1]
> > (00.103770) p 0x688000 [3]
> > (00.103814) p 0x7f5475ce9000 [2]
> > (00.103831) p 0x7f5475cee000 [2]
> > (00.103867) p 0x7f5475ef3000 [5]
> > (00.103898) p 0x7fffa8469000 [3]
> > (00.103920) p 0x7fffa8476000 [2]
> > (00.103946) page-pipe: Killing page pipe
> > (00.103955) ----------------------------------------
> > (00.103966) Sent msg to daemon 7 0 0
> > (00.103970) Wait for ack 7 on daemon socket
> > pie: __fetched msg: 7 0 0
> > pie: __sent ack msg: 7 7 0
> > pie: Daemon wais for command
> > (00.104008) Fetched ack: 7 7 0
> > (00.104022) Sent msg to daemon 9 0 0
> > (00.104026) Wait for ack 9 on daemon socket
> > pie: __fetched msg: 9 0 0
> > pie: __sent ack msg: 9 9 0
> > pie: Daemon wais for command
> > (00.104063) Fetched ack: 9 9 0
> > (00.104107) Sent msg to daemon 10 0 0
> > (00.104112) Wait for ack 10 on daemon socket
> > pie: __fetched msg: 10 0 0
> > pie: __sent ack msg: 10 10 0
> > pie: Daemon wais for command
> > (00.104143) Fetched ack: 10 10 0
> > (00.104157) Sent msg to daemon 11 0 0
> > (00.104160) Wait for ack 11 on daemon socket
> > pie: __fetched msg: 11 0 0
> > pie: __sent ack msg: 11 11 0
> > pie: Daemon wais for command
> > (00.104191) Fetched ack: 11 11 0
> > (00.104197)
> > (00.104199) Dumping core (pid: 31376)
> > (00.104210) ----------------------------------------
> > (00.104213) Obtaining personality ... (00.104230) 31376 has 0 sched
> policy
> > (00.104234) dumping 0 nice for 31376
> > (00.104240) cg: Dumping cgroups for 31376
> > (00.104278) cg: `- Existing css 2 found
> > (00.104313) ----------------------------------------
> > (00.104320)
> > (00.104325) Dumping creds for 31376)
> > (00.104329) ----------------------------------------
> > (00.104343) Sent msg to daemon 13 0 0
> > (00.104347) Wait for ack 13 on daemon socket
> > pie: __fetched msg: 13 0 0
> > pie: __sent ack msg: 13 13 0
> > pie: Daemon wais for command
> > (00.104394) Fetched ack: 13 13 0
> > (00.104426) Waiting for 31376 to trap
> > (00.104455) Daemon 31376 exited trapping
> > (00.104469) Sent msg to daemon 6 0 0
> > pie: __fetched msg: 6 0 0
> > pie: 11: new_sp=0x7f5475eee008 ip 0x7f5475aa66bf
> > (00.104541) 31376 was trapped
> > (00.104548) `- Expecting exit
> > (00.104585) 31376 was trapped
> > (00.104591) 31376 is going to execute the syscall f
> > (00.104631) 31376 was stopped
> > (00.104676) 31376 was trapped
> > (00.104683) 31376 is going to execute the syscall 1
> > (00.104716) 31376 was trapped
> > (00.104722) `- Expecting exit
> > (00.104767) 31376 was trapped
> > (00.104789) 31376 is going to execute the syscall b
> > (00.104855) 31376 was stopped
> > (00.104895)
> > (00.104899) Dumping mm (pid: 31376)
> > (00.104901) ----------------------------------------
> > (00.104904) 0x400000-0x489000 (548K) prot 0x5 flags 0x2 st 0x41 off 0
> reg fp shmid: 0
> > (00.104909) 0x688000-0x689000 (4K) prot 0x3 flags 0x2 st 0x41 off
> 0x88000 reg fp shmid: 0
> > (00.104912) 0x689000-0x68b000 (8K) prot 0x3 flags 0x22 st 0x201 off 0
> reg ap shmid: 0
> > (00.104914) 0x7f5475a98000-0x7f5475ae9000 (324K) prot 0x5 flags 0x2 st
> 0x41 off 0 reg fp shmid: 0
> > (00.104917) 0x7f5475ae9000-0x7f5475ce9000 (2048K) prot 0 flags 0x22 st
> 0x201 off 0 reg ap shmid: 0
> > (00.104920) 0x7f5475ce9000-0x7f5475cea000 (4K) prot 0x1 flags 0x2 st
> 0x41 off 0x51000 reg fp shmid: 0
> > (00.104922) 0x7f5475cea000-0x7f5475ceb000 (4K) prot 0x3 flags 0x2 st
> 0x41 off 0x52000 reg fp shmid: 0
> > (00.104925) 0x7f5475ceb000-0x7f5475cf0000 (20K) prot 0x3 flags 0x22 st
> 0x201 off 0 reg ap shmid: 0
> > (00.104928) 0x7f5475cf0000-0x7f5475cf6000 (24K) prot 0x5 flags 0x2 st
> 0x41 off 0 reg fp shmid: 0
> > (00.104930) 0x7f5475ef3000-0x7f5475ef6000 (12K) prot 0x3 flags 0x22 st
> 0x201 off 0 reg ap shmid: 0
> > (00.104933) 0x7f5475ef6000-0x7f5475ef7000 (4K) prot 0x1 flags 0x2 st
> 0x41 off 0x6000 reg fp shmid: 0
> > (00.104935) 0x7f5475ef7000-0x7f5475ef8000 (4K) prot 0x3 flags 0x2 st
> 0x41 off 0x7000 reg fp shmid: 0
> > (00.104938) 0x7fffa844a000-0x7fffa846c000 (136K) prot 0x3 flags 0x122 st
> 0x201 off 0 reg ap shmid: 0
> > (00.104941) 0x7fffa8476000-0x7fffa8478000 (8K) prot 0x5 flags 0x22 st
> 0x209 off 0 reg vdso ap shmid: 0
> > (00.104943) 0xffffffffff600000-0xffffffffff601000 (4K) prot 0x5 flags
> 0x22 st 0x204 off 0 vsys ap shmid: 0
> > (00.104946) Obtaining task auvx ...
> > (00.105033) Dumping task cwd id 0x7 root id 0x7
> > (00.105097) Dumping mountpoints
> > (00.105102) 48: 23:/null @ ./proc/kcore
> > (00.105126) 47: 22:/bus @ ./proc/bus
> > (00.105131) 46: 22:/irq @ ./proc/irq
> > (00.105134) 45: 22:/sysrq-trigger @ ./proc/sysrq-trigger
> > (00.105137) 44: 22:/sys @ ./proc/sys
> > (00.105140) 76: 26:/ @ ./sys
> > (00.105143) 75: 21:/ @ ./dev/mqueue
> > (00.105156) Path `/dev/mqueue' resolved to `./dev/mqueue' mountpoint
> > (00.105178) 74: 25:/ @ ./dev/shm
> > (00.105185) Path `/dev/shm' resolved to `./dev/shm' mountpoint
> > (00.107613) 73: 24:/ @ ./dev/pts
> > (00.107622) 72: 23:/ @ ./dev
> > (00.107625) Something is mounted on top of ./dev
> > (00.120860) Path `/dev' resolved to `./dev' mountpoint
> > (00.122772) 71: 22:/ @ ./proc
> > (00.122782) 70: 800001:/home/saied/work/nsinit/busybox @ ./
> > (00.122805) Dumping file-locks
> > (00.122817)
> > (00.122820) Dumping pstree (pid: 31361)
> > (00.122822) ----------------------------------------
> > (00.122826) Process: 1(31361)
> > (00.122853) Process: 11(31376)
> > (00.122857) ----------------------------------------
> > (00.122867) Dumping 1(31361)'s namespaces
> > (00.123021) Dump UTS namespace 10 via 31361
> > (00.123388) Dump IPC namespace 9 via 31361
> > (00.123600) IPC shared memory segments: 0
> > (00.123614) IPC message queues: 0
> > (00.123627) IPC semaphore sets: 0
> > (00.123783) Dump NET namespace info 8 via 31361
> > (00.123977) Mount ns' sysfs in crtools-sys.0sQiVE
> > (00.136869) Dumping netns links
> > (00.136917) LD: Got link 1, type 772
> > (00.136991) Running ip addr save
> > (00.137721) Running ip route save
> > (00.138372) Running iptables-save for iptables-save
> > (00.152877) Namespaces dump complete
> > (00.152894) cg: Dumping 1 sets
> > (00.152907) cg: `- Dumping 2 set (10 ctls)
> > (00.152920) cg: `- Dumping blkio of /nsinit/busybox
> > (00.152924) cg: `- Dumping cpu of /nsinit/busybox
> > (00.152934) cg: `- Dumping cpuacct of /nsinit/busybox
> > (00.152936) cg: `- Dumping cpuset of /nsinit/busybox
> > (00.152938) cg: `- Dumping devices of /nsinit/busybox
> > (00.152941) cg: `- Dumping freezer of /nsinit/busybox
> > (00.152943) cg: `- Dumping hugetlb of /user/1003.user/2.session
> > (00.152945) cg: `- Dumping memory of /nsinit/busybox
> > (00.152947) cg: `- Dumping name=systemd of /user/1003.user/2.session
> > (00.152949) cg: `- Dumping perf_event of /nsinit/busybox
> > (00.152963) cg: Writing CG image
> > (00.153019) Dumping external sockets
> > (00.153025) Tree of 0 objects
> > (00.153027) 0x10e8e.0x2
> > (00.153030) left:
> > (00.153032) 0x10e8d.0x1
> > (00.153034) | SubTree
> > (00.153036) | 0x10e8d.0x1 (self)
> > (00.153038) --s
> > (00.153040) --l
> > (00.153042) right:
> > (00.153044) 0x10e8f.0x3
> > (00.153046) | SubTree
> > (00.153048) | 0x10e8f.0x3 (self)
> > (00.153050) --s
> > (00.153051) --r
> > (00.153053) | SubTree
> > (00.153055) | 0x10e8e.0x2 (self)
> > (00.153057) --s
> > (00.153098) Running post-dump scripts
> > (00.153102) Unfreezing tasks into 2
> > (00.153105) Unseizing 31361 into 2
> > (00.153131) Unseizing 31376 into 2
> > (00.153162) Writing stats
> > (00.153326) Dumping finished successfully
>
> > (00.000034) File pipe:[69253] will be restored from inherit fd 0
> > (00.000076) File pipe:[69254] will be restored from inherit fd 1
> > (00.000083) File pipe:[69255] will be restored from inherit fd 2
> > (00.000253) TCP recv queue memory limit is 3145728
> > (00.000289) cpu: fpu:1 fxsr:1 xsave:1
> > (00.000363) vdso: Parsing at 7fffed72b000 7fffed72d000
> > (00.000369) vdso: PT_LOAD p_vaddr: ffffffffff700000
> > (00.000373) vdso: DT_HASH: 0xffffffffff700120
> > (00.000376) vdso: DT_STRTAB: 0xffffffffff700268
> > (00.000378) vdso: DT_SYMTAB: 0xffffffffff700160
> > (00.000379) vdso: DT_STRSZ: 94
> > (00.000381) vdso: DT_SYMENT: 24
> > (00.000383) vdso: nbucket 3 nchain 11 bucket 0x7fffed72b128 chain
> 0x7fffed72b134
> > (00.000387) vdso: rt [vdso] 7fffed72b000-7fffed72d000 [vvar]
> ffffffffffffffff-ffffffffffffffff
> > (00.000434) Reading image tree
> > (00.000469) Add mnt ns 11 pid 1
> > (00.000504) Will restore in 6c020000 namespaces
> > (00.000511) NS mask to use 6c020000
> > (00.000524) Collecting 36/21 (flags 0)
> > (00.000546) No inetsk.img image
> > (00.000552) `- ... done
> > (00.000601) cg: Preparing cgroups yard
> > (00.000700) cg: Opening .criu.cgyard.HPv7Iv as cg yard
> > (00.000715) cg: Making subdir .criu.cgyard.HPv7Iv/cpuset (cpuset)
> > (00.000751) cg: Determined dir cpuset/nsinit/busybox already existed
> > (00.000759) cg: Making subdir .criu.cgyard.HPv7Iv/cpu (cpu)
> > (00.000793) cg: Determined dir cpu/nsinit/busybox already existed
> > (00.000800) cg: Making subdir .criu.cgyard.HPv7Iv/cpuacct (cpuacct)
> > (00.000835) cg: Determined dir cpuacct/nsinit/busybox already existed
> > (00.000843) cg: Making subdir .criu.cgyard.HPv7Iv/memory (memory)
> > (00.000877) cg: Determined dir memory/nsinit/busybox already existed
> > (00.000882) cg: Making subdir .criu.cgyard.HPv7Iv/devices (devices)
> > (00.000902) cg: Determined dir devices/nsinit/busybox already existed
> > (00.000906) cg: Making subdir .criu.cgyard.HPv7Iv/freezer (freezer)
> > (00.000927) cg: Determined dir freezer/nsinit/busybox already existed
> > (00.000932) cg: Making subdir .criu.cgyard.HPv7Iv/blkio (blkio)
> > (00.000962) cg: Determined dir blkio/nsinit/busybox already existed
> > (00.000968) cg: Making subdir .criu.cgyard.HPv7Iv/perf_event
> (perf_event)
> > (00.000988) cg: Determined dir perf_event/nsinit/busybox already existed
> > (00.000995) cg: Making subdir .criu.cgyard.HPv7Iv/hugetlb (hugetlb)
> > (00.001019) cg: Determined dir hugetlb/user/1003.user/2.session already
> existed
> > (00.001027) cg: Making subdir .criu.cgyard.HPv7Iv/systemd
> (none,name=systemd)
> > (00.001048) cg: Determined dir systemd/user/1003.user/2.session already
> existed
> > (00.001102) Forking task with 1 pid (flags 0x6c020000)
> > (00.001130) Saved netns fd for links restore
> > (00.001355) Wait until namespaces are created
> > (00.001714) Running setup-namespaces scripts
> > (00.001755) 1: Restoring namespaces 1 flags 0x6c020000
> > (00.001825) 1: Restoring link lo type 1
> > (00.001950) 1: Running ip addr restore
> > (00.002415) 1: Found fd 0 (id pipe:[69253]) in inherit fd list
> (caller inherit_fd_resolve_clash)
> > (00.002444) 1: Inherit fd 0 moved to 8 to resolve clash
> > (00.002451) 1: Found fd 1 (id pipe:[69254]) in inherit fd list
> (caller inherit_fd_resolve_clash)
> > (00.002455) 1: Inherit fd 1 moved to 6 to resolve clash
> > RTNETLINK answers: File exists
> > RTNETLINK answers: File exists
> > (00.003255) 1: Running ip route restore
> > (00.003389) 1: Found fd 0 (id pipe:[69253]) in inherit fd list
> (caller inherit_fd_resolve_clash)
> > (00.003417) 1: Inherit fd 0 moved to 8 to resolve clash
> > (00.003424) 1: Found fd 1 (id pipe:[69254]) in inherit fd list
> (caller inherit_fd_resolve_clash)
> > (00.003428) 1: Inherit fd 1 moved to 6 to resolve clash
> > (00.003967) 1: Running iptables-restore for iptables-restore
> > (00.004102) 1: Found fd 0 (id pipe:[69253]) in inherit fd list
> (caller inherit_fd_resolve_clash)
> > (00.004130) 1: Inherit fd 0 moved to 8 to resolve clash
> > (00.004137) 1: Found fd 1 (id pipe:[69254]) in inherit fd list
> (caller inherit_fd_resolve_clash)
> > (00.004140) 1: Inherit fd 1 moved to 6 to resolve clash
> > (00.005443) 1: kernel/hostname nr 6
> > (00.005489) 1: kernel/domainname nr 6
> > (00.005510) 1: Restoring IPC namespace
> > (00.005520) 1: Restoring IPC variables
> > (00.005608) 1: Restoring IPC shared memory
> > (00.005621) 1: No ipcns-shm-9.img image
> > (00.005629) 1: Restoring IPC message queues
> > (00.005638) 1: No ipcns-msg-9.img image
> > (00.005641) 1: Restoring IPC semaphores sets
> > (00.005651) 1: No ipcns-sem-9.img image
> > (00.005656) 1: Restoring mount namespace
> > (00.005735) 1: type sysfs source sysfs mnt_id 0x11 s_dev 0xf / @
> ./sys flags 0x20000e options
> > (00.005747) 1: type proc source proc mnt_id 0x12 s_dev 0x3 / @
> ./proc flags 0x20000e options
> > (00.005757) 1: type devtmpfs source udev mnt_id 0x13 s_dev 0x5 /
> @ ./dev flags 0x200000 options size=7625344k,nr_inodes=1906336,mode=755
> > (00.005764) 1: type devpts source devpts mnt_id 0x14 s_dev 0xc /
> @ ./dev/pts flags 0x20000a options gid=5,mode=620,ptmxmode=000
> > (00.005783) 1: type tmpfs source tmpfs mnt_id 0x15 s_dev 0x10 / @
> ./run flags 0x20000a options size=1540220k,mode=755
> > (00.005791) 1: type ext4 source
> /dev/disk/by-uuid/18ec1400-9724-446f-be66-f8426f43f206 mnt_id 0x16 s_dev
> 0x800001 / @ ./ flags 0x200000 options errors=remount-ro,data=ordered
> > (00.005797) 1: type tmpfs source none mnt_id 0x17 s_dev 0x11 / @
> ./sys/fs/cgroup flags 0x200000 options size=4k,mode=755
> > (00.005803) 1: type fusectl source none mnt_id 0x18 s_dev 0x12 /
> @ ./sys/fs/fuse/connections flags 0x200000 options
> > (00.005808) 1: type debugfs source none mnt_id 0x19 s_dev 0x6 / @
> ./sys/kernel/debug flags 0x200000 options
> > (00.005816) 1: type securityfs source none mnt_id 0x1a s_dev 0xa
> / @ ./sys/kernel/security flags 0x200000 options
> > (00.005823) 1: type tmpfs source none mnt_id 0x1b s_dev 0x13 / @
> ./run/lock flags 0x20000e options size=5120k
> > (00.005828) 1: type tmpfs source none mnt_id 0x1c s_dev 0x14 / @
> ./run/shm flags 0x200006 options
> > (00.005852) 1: type tmpfs source none mnt_id 0x1d s_dev 0x15 / @
> ./run/user flags 0x20000e options size=102400k,mode=755
> > (00.005858) 1: type pstore source none mnt_id 0x1e s_dev 0x16 / @
> ./sys/fs/pstore flags 0x200000 options
> > (00.005864) 1: type cgroup source cgroup mnt_id 0x1f s_dev 0x17 /
> @ ./sys/fs/cgroup/cpuset flags 0x200000 options cpuset
> > (00.005869) 1: type cgroup source cgroup mnt_id 0x20 s_dev 0x18 /
> @ ./sys/fs/cgroup/cpu flags 0x200000 options cpu
> > (00.005875) 1: type cgroup source cgroup mnt_id 0x21 s_dev 0x19 /
> @ ./sys/fs/cgroup/cpuacct flags 0x200000 options cpuacct
> > (00.005883) 1: type cgroup source cgroup mnt_id 0x22 s_dev 0x1a /
> @ ./sys/fs/cgroup/memory flags 0x200000 options memory
> > (00.005889) 1: type cgroup source cgroup mnt_id 0x23 s_dev 0x1b /
> @ ./sys/fs/cgroup/devices flags 0x200000 options devices
> > (00.005894) 1: type cgroup source cgroup mnt_id 0x24 s_dev 0x1c /
> @ ./sys/fs/cgroup/freezer flags 0x200000 options freezer
> > (00.005899) 1: type cgroup source cgroup mnt_id 0x25 s_dev 0x1d /
> @ ./sys/fs/cgroup/blkio flags 0x200000 options blkio
> > (00.005904) 1: type cgroup source cgroup mnt_id 0x26 s_dev 0x1e /
> @ ./sys/fs/cgroup/perf_event flags 0x200000 options perf_event
> > (00.005909) 1: type cgroup source cgroup mnt_id 0x27 s_dev 0x1f /
> @ ./sys/fs/cgroup/hugetlb flags 0x200000 options hugetlb
> > (00.005915) 1: type ext4 source /dev/sda2 mnt_id 0x28 s_dev
> 0x800002 / @ ./sda2 flags 0x200000 options data=ordered
> > (00.005920) 1: type cgroup source systemd mnt_id 0x29 s_dev 0x20
> / @ ./sys/fs/cgroup/systemd flags 0x20000e options name=systemd
> > (00.005938) 1: type ext4 source
> /dev/disk/by-uuid/18ec1400-9724-446f-be66-f8426f43f206 mnt_id 0x2a s_dev
> 0x800001 /home/saied/work/nsinit/busybox @ ./home/saied/work/nsinit/busybox
> flags 0x200000 options errors=remount-ro,data=ordered
> > (00.005947) 1: type tmpfs source none mnt_id 0x2b s_dev 0x21 / @
> ./home/saied/work/nsinit/busybox/nsinit/checkpoint/.criu.cgyard.HPv7Iv
> flags 0x200000 options
> > (00.005953) 1: type cgroup source none mnt_id 0x2c s_dev 0x17 / @
> ./home/saied/work/nsinit/busybox/nsinit/checkpoint/.criu.cgyard.HPv7Iv/cpuset
> flags 0x200000 options cpuset
> > (00.005964) 1: type cgroup source none mnt_id 0x2d s_dev 0x18 / @
> ./home/saied/work/nsinit/busybox/nsinit/checkpoint/.criu.cgyard.HPv7Iv/cpu
> flags 0x200000 options cpu
> > (00.005970) 1: type cgroup source none mnt_id 0x2e s_dev 0x19 / @
> ./home/saied/work/nsinit/busybox/nsinit/checkpoint/.criu.cgyard.HPv7Iv/cpuacct
> flags 0x200000 options cpuacct
> > (00.005975) 1: type cgroup source none mnt_id 0x2f s_dev 0x1a / @
> ./home/saied/work/nsinit/busybox/nsinit/checkpoint/.criu.cgyard.HPv7Iv/memory
> flags 0x200000 options memory
> > (00.005981) 1: type cgroup source none mnt_id 0x30 s_dev 0x1b / @
> ./home/saied/work/nsinit/busybox/nsinit/checkpoint/.criu.cgyard.HPv7Iv/devices
> flags 0x200000 options devices
> > (00.005988) 1: type cgroup source none mnt_id 0x31 s_dev 0x1c / @
> ./home/saied/work/nsinit/busybox/nsinit/checkpoint/.criu.cgyard.HPv7Iv/freezer
> flags 0x200000 options freezer
> > (00.006002) 1: type cgroup source none mnt_id 0x32 s_dev 0x1d / @
> ./home/saied/work/nsinit/busybox/nsinit/checkpoint/.criu.cgyard.HPv7Iv/blkio
> flags 0x200000 options blkio
> > (00.006009) 1: type cgroup source none mnt_id 0x33 s_dev 0x1e / @
> ./home/saied/work/nsinit/busybox/nsinit/checkpoint/.criu.cgyard.HPv7Iv/perf_event
> flags 0x200000 options perf_event
> > (00.006014) 1: type cgroup source none mnt_id 0x34 s_dev 0x1f / @
> ./home/saied/work/nsinit/busybox/nsinit/checkpoint/.criu.cgyard.HPv7Iv/hugetlb
> flags 0x200000 options hugetlb
> > (00.006020) 1: type cgroup source none mnt_id 0x35 s_dev 0x20 / @
> ./home/saied/work/nsinit/busybox/nsinit/checkpoint/.criu.cgyard.HPv7Iv/systemd
> flags 0x200000 options name=systemd
> > (00.006032) 1: Building mountpoints tree
> > (00.006036) 1: Building plain mount tree
> > (00.006038) 1: Working on 53->43
> > (00.006040) 1: Working on 52->43
> > (00.006042) 1: Working on 51->43
> > (00.006044) 1: Working on 50->43
> > (00.006046) 1: Working on 49->43
> > (00.006048) 1: Working on 48->43
> > (00.006050) 1: Working on 47->43
> > (00.006052) 1: Working on 46->43
> > (00.006054) 1: Working on 45->43
> > (00.006058) 1: Working on 44->43
> > (00.006062) 1: Working on 43->42
> > (00.006065) 1: Working on 42->22
> > (00.006067) 1: Working on 41->23
> > (00.006068) 1: Working on 40->22
> > (00.006070) 1: Working on 39->23
> > (00.006072) 1: Working on 38->23
> > (00.006074) 1: Working on 37->23
> > (00.006076) 1: Working on 36->23
> > (00.006078) 1: Working on 35->23
> > (00.006079) 1: Working on 34->23
> > (00.006081) 1: Working on 33->23
> > (00.006083) 1: Working on 32->23
> > (00.006085) 1: Working on 31->23
> > (00.006087) 1: Working on 30->17
> > (00.006088) 1: Working on 29->21
> > (00.006090) 1: Working on 28->21
> > (00.006092) 1: Working on 27->21
> > (00.006094) 1: Working on 26->17
> > (00.006096) 1: Working on 25->17
> > (00.006098) 1: Working on 24->17
> > (00.006099) 1: Working on 23->17
> > (00.006101) 1: Working on 22->1
> > (00.006103) 1: Working on 21->22
> > (00.006105) 1: Working on 20->19
> > (00.006107) 1: Working on 19->22
> > (00.006109) 1: Working on 18->22
> > (00.006110) 1: Working on 17->22
> > (00.006114) 1: Resorting siblings on 22
> > (00.006117) 1: Resorting siblings on 42
> > (00.006119) 1: Resorting siblings on 43
> > (00.006121) 1: Resorting siblings on 53
> > (00.006123) 1: Resorting siblings on 52
> > (00.006125) 1: Resorting siblings on 51
> > (00.006127) 1: Resorting siblings on 50
> > (00.006128) 1: Resorting siblings on 49
> > (00.006130) 1: Resorting siblings on 48
> > (00.006132) 1: Resorting siblings on 47
> > (00.006134) 1: Resorting siblings on 46
> > (00.006136) 1: Resorting siblings on 45
> > (00.006138) 1: Resorting siblings on 44
> > (00.006139) 1: Resorting siblings on 40
> > (00.006141) 1: Resorting siblings on 21
> > (00.006143) 1: Resorting siblings on 29
> > (00.006145) 1: Resorting siblings on 28
> > (00.006146) 1: Resorting siblings on 27
> > (00.006148) 1: Resorting siblings on 19
> > (00.006154) 1: Resorting siblings on 20
> > (00.006156) 1: Resorting siblings on 18
> > (00.006158) 1: Resorting siblings on 17
> > (00.006160) 1: Resorting siblings on 30
> > (00.006161) 1: Resorting siblings on 26
> > (00.006163) 1: Resorting siblings on 25
> > (00.006165) 1: Resorting siblings on 24
> > (00.006167) 1: Resorting siblings on 23
> > (00.006168) 1: Resorting siblings on 41
> > (00.006170) 1: Resorting siblings on 39
> > (00.006172) 1: Resorting siblings on 38
> > (00.006174) 1: Resorting siblings on 37
> > (00.006175) 1: Resorting siblings on 36
> > (00.006177) 1: Resorting siblings on 35
> > (00.006179) 1: Resorting siblings on 34
> > (00.006180) 1: Resorting siblings on 33
> > (00.006182) 1: Resorting siblings on 32
> > (00.006184) 1: Resorting siblings on 31
> > (00.006185) 1: Done:
> > (00.006187) 1: [./](22->1)
> > (00.006189) 1: [./sda2](40->22)
> > (00.006191) 1: <--
> > (00.006193) 1: [./sys](17->22)
> > (00.006195) 1: [./sys/fs/pstore](30->17)
> > (00.006197) 1: <--
> > (00.006199) 1: [./sys/fs/cgroup](23->17)
> > (00.006200) 1: [./sys/fs/cgroup/systemd](41->23)
> > (00.006202) 1: <--
> > (00.006204) 1: [./sys/fs/cgroup/cpuset](31->23)
> > (00.006206) 1: <--
> > (00.006208) 1: [./sys/fs/cgroup/cpu](32->23)
> > (00.006210) 1: <--
> > (00.006211) 1: [./sys/fs/cgroup/cpuacct](33->23)
> > (00.006213) 1: <--
> > (00.006215) 1: [./sys/fs/cgroup/memory](34->23)
> > (00.006217) 1: <--
> > (00.006218) 1: [./sys/fs/cgroup/devices](35->23)
> > (00.006220) 1: <--
> > (00.006222) 1: [./sys/fs/cgroup/freezer](36->23)
> > (00.006224) 1: <--
> > (00.006226) 1: [./sys/fs/cgroup/blkio](37->23)
> > (00.006227) 1: <--
> > (00.006229) 1: [./sys/fs/cgroup/perf_event](38->23)
> > (00.006231) 1: <--
> > (00.006233) 1: [./sys/fs/cgroup/hugetlb](39->23)
> > (00.006234) 1: <--
> > (00.006236) 1: <--
> > (00.006238) 1: [./sys/fs/fuse/connections](24->17)
> > (00.006240) 1: <--
> > (00.006242) 1: [./sys/kernel/debug](25->17)
> > (00.006243) 1: <--
> > (00.006245) 1: [./sys/kernel/security](26->17)
> > (00.006247) 1: <--
> > (00.006249) 1: <--
> > (00.006250) 1: [./proc](18->22)
> > (00.006252) 1: <--
> > (00.006254) 1: [./dev](19->22)
> > (00.006256) 1: [./dev/pts](20->19)
> > (00.006258) 1: <--
> > (00.006259) 1: <--
> > (00.006261) 1: [./run](21->22)
> > (00.006263) 1: [./run/user](29->21)
> > (00.006265) 1: <--
> > (00.006267) 1: [./run/lock](27->21)
> > (00.006269) 1: <--
> > (00.006270) 1: [./run/shm](28->21)
> > (00.006272) 1: <--
> > (00.006274) 1: <--
> > (00.006275) 1: [./home/saied/work/nsinit/busybox](42->22)
> > (00.006277) 1:
> [./home/saied/work/nsinit/busybox/nsinit/checkpoint/.criu.cgyard.HPv7Iv](43->42)
> > (00.006279) 1:
> [./home/saied/work/nsinit/busybox/nsinit/checkpoint/.criu.cgyard.HPv7Iv/systemd](53->43)
> > (00.006281) 1: <--
> > (00.006283) 1:
> [./home/saied/work/nsinit/busybox/nsinit/checkpoint/.criu.cgyard.HPv7Iv/cpuset](44->43)
> > (00.006285) 1: <--
> > (00.006287) 1:
> [./home/saied/work/nsinit/busybox/nsinit/checkpoint/.criu.cgyard.HPv7Iv/cpu](45->43)
> > (00.006289) 1: <--
> > (00.006290) 1:
> [./home/saied/work/nsinit/busybox/nsinit/checkpoint/.criu.cgyard.HPv7Iv/cpuacct](46->43)
> > (00.006292) 1: <--
> > (00.006294) 1:
> [./home/saied/work/nsinit/busybox/nsinit/checkpoint/.criu.cgyard.HPv7Iv/memory](47->43)
> > (00.006296) 1: <--
> > (00.006298) 1:
> [./home/saied/work/nsinit/busybox/nsinit/checkpoint/.criu.cgyard.HPv7Iv/devices](48->43)
> > (00.006299) 1: <--
> > (00.006301) 1:
> [./home/saied/work/nsinit/busybox/nsinit/checkpoint/.criu.cgyard.HPv7Iv/freezer](49->43)
> > (00.006303) 1: <--
> > (00.006305) 1:
> [./home/saied/work/nsinit/busybox/nsinit/checkpoint/.criu.cgyard.HPv7Iv/blkio](50->43)
> > (00.006307) 1: <--
> > (00.006308) 1:
> [./home/saied/work/nsinit/busybox/nsinit/checkpoint/.criu.cgyard.HPv7Iv/perf_event](51->43)
> > (00.006313) 1: <--
> > (00.006315) 1:
> [./home/saied/work/nsinit/busybox/nsinit/checkpoint/.criu.cgyard.HPv7Iv/hugetlb](52->43)
> > (00.006317) 1: <--
> > (00.006319) 1: <--
> > (00.006321) 1: <--
> > (00.006322) 1: <--
> > (00.006341) 1: Reading mountpoint images
> > (00.006348) 1: Getting root for 48
> > (00.006351) 1: Getting mpt for 48 ./proc/kcore
> > (00.006353) 1: Getting source for 48
> > (00.006355) 1: Getting opts for 48
> > (00.006357) 1: Read 48 mp @ ./proc/kcore
> > (00.006361) 1: Getting root for 47
> > (00.006363) 1: Getting mpt for 47 ./proc/bus
> > (00.006365) 1: Getting source for 47
> > (00.006367) 1: Getting opts for 47
> > (00.006369) 1: Read 47 mp @ ./proc/bus
> > (00.006372) 1: Getting root for 46
> > (00.006374) 1: Getting mpt for 46 ./proc/irq
> > (00.006376) 1: Getting source for 46
> > (00.006378) 1: Getting opts for 46
> > (00.006380) 1: Read 46 mp @ ./proc/irq
> > (00.006382) 1: Getting root for 45
> > (00.006385) 1: Getting mpt for 45 ./proc/sysrq-trigger
> > (00.006387) 1: Getting source for 45
> > (00.006389) 1: Getting opts for 45
> > (00.006390) 1: Read 45 mp @ ./proc/sysrq-trigger
> > (00.006393) 1: Getting root for 44
> > (00.006395) 1: Getting mpt for 44 ./proc/sys
> > (00.006397) 1: Getting source for 44
> > (00.006399) 1: Getting opts for 44
> > (00.006401) 1: Read 44 mp @ ./proc/sys
> > (00.006404) 1: Getting root for 76
> > (00.006406) 1: Getting mpt for 76 ./sys
> > (00.006408) 1: Getting source for 76
> > (00.006410) 1: Getting opts for 76
> > (00.006412) 1: Read 76 mp @ ./sys
> > (00.006414) 1: Getting root for 75
> > (00.006417) 1: Getting mpt for 75 ./dev/mqueue
> > (00.006419) 1: Getting source for 75
> > (00.006420) 1: Getting opts for 75
> > (00.006422) 1: Read 75 mp @ ./dev/mqueue
> > (00.006425) 1: Getting root for 74
> > (00.006427) 1: Getting mpt for 74 ./dev/shm
> > (00.006429) 1: Getting source for 74
> > (00.006431) 1: Getting opts for 74
> > (00.006433) 1: Read 74 mp @ ./dev/shm
> > (00.006436) 1: Getting root for 73
> > (00.006438) 1: Getting mpt for 73 ./dev/pts
> > (00.006440) 1: Getting source for 73
> > (00.006442) 1: Getting opts for 73
> > (00.006444) 1: Read 73 mp @ ./dev/pts
> > (00.006447) 1: Getting root for 72
> > (00.006449) 1: Getting mpt for 72 ./dev
> > (00.006451) 1: Getting source for 72
> > (00.006453) 1: Getting opts for 72
> > (00.006455) 1: Read 72 mp @ ./dev
> > (00.006457) 1: Getting root for 71
> > (00.006460) 1: Getting mpt for 71 ./proc
> > (00.006462) 1: Getting source for 71
> > (00.006464) 1: Getting opts for 71
> > (00.006466) 1: Read 71 mp @ ./proc
> > (00.006468) 1: Getting root for 70
> > (00.006471) 1: Getting mpt for 70 ./
> > (00.006473) 1: Getting source for 70
> > (00.006475) 1: Getting opts for 70
> > (00.006477) 1: Read 70 mp @ ./
> > (00.006488) 1: Path `/home/saied/work/nsinit/busybox' resolved to
> `./home/saied/work/nsinit/busybox' mountpoint
> > (00.006502) 1: Building mountpoints tree
> > (00.006505) 1: Building plain mount tree
> > (00.006507) 1: Working on 70->42
> > (00.006509) 1: Working on 71->70
> > (00.006511) 1: Working on 72->70
> > (00.006513) 1: Working on 73->72
> > (00.006515) 1: Working on 74->72
> > (00.006517) 1: Working on 75->72
> > (00.006518) 1: Working on 76->70
> > (00.006520) 1: Working on 44->71
> > (00.006522) 1: Working on 45->71
> > (00.006523) 1: Working on 46->71
> > (00.006525) 1: Working on 47->71
> > (00.006527) 1: Working on 48->71
> > (00.006528) 1: Resorting siblings on 70
> > (00.006530) 1: Resorting siblings on 71
> > (00.006532) 1: Resorting siblings on 44
> > (00.006534) 1: Resorting siblings on 45
> > (00.006536) 1: Resorting siblings on 46
> > (00.006538) 1: Resorting siblings on 47
> > (00.006539) 1: Resorting siblings on 48
> > (00.006541) 1: Resorting siblings on 72
> > (00.006543) 1: Resorting siblings on 73
> > (00.006545) 1: Resorting siblings on 74
> > (00.006551) 1: Resorting siblings on 75
> > (00.006553) 1: Resorting siblings on 76
> > (00.006561) 1: Done:
> > (00.006563) 1: [./](70->42)
> > (00.006565) 1: [./proc](71->70)
> > (00.006567) 1: [./proc/sys](44->71)
> > (00.006569) 1: <--
> > (00.006570) 1: [./proc/kcore](48->71)
> > (00.006572) 1: <--
> > (00.006574) 1: [./proc/bus](47->71)
> > (00.006576) 1: <--
> > (00.006578) 1: [./proc/irq](46->71)
> > (00.006580) 1: <--
> > (00.006581) 1: [./proc/sysrq-trigger](45->71)
> > (00.006583) 1: <--
> > (00.006585) 1: <--
> > (00.006587) 1: [./sys](76->70)
> > (00.006589) 1: <--
> > (00.006590) 1: [./dev](72->70)
> > (00.006592) 1: [./dev/pts](73->72)
> > (00.006594) 1: <--
> > (00.006596) 1: [./dev/mqueue](75->72)
> > (00.006598) 1: <--
> > (00.006599) 1: [./dev/shm](74->72)
> > (00.006601) 1: <--
> > (00.006603) 1: <--
> > (00.006605) 1: <--
> > (00.006609) 1: Start with 70:./
> > (00.006611) 1: Mounting unsupported @./ (0)
> > (00.006613) 1: 70:./ private 1 shared 0 slave 0
> > (00.006624) 1: Mounting proc @./proc (0)
> > (00.006646) 1: 71:./proc private 0 shared 0 slave 0
> > (00.006650) 1: Mounting proc @./proc/sys (0)
> > (00.006653) 1: Bind ./proc/sys to ./proc/sys
> > (00.006667) 1: 44:./proc/sys private 1 shared 0 slave 0
> > (00.006672) 1: Postpone slave ./proc/kcore
> > (00.006675) 1: Mounting proc @./proc/bus (0)
> > (00.006677) 1: Bind ./proc/bus to ./proc/bus
> > (00.006686) 1: 47:./proc/bus private 1 shared 0 slave 0
> > (00.006693) 1: Mounting proc @./proc/irq (0)
> > (00.006696) 1: Bind ./proc/irq to ./proc/irq
> > (00.006705) 1: 46:./proc/irq private 1 shared 0 slave 0
> > (00.006710) 1: Mounting proc @./proc/sysrq-trigger (0)
> > (00.006712) 1: Bind ./proc/sysrq-trigger to ./proc/sysrq-trigger
> > (00.006723) 1: 45:./proc/sysrq-trigger private 1 shared 0 slave 0
> > (00.006727) 1: Mounting sysfs @./sys (0)
> > (00.006749) 1: 76:./sys private 0 shared 0 slave 0
> > (00.006753) 1: Mounting tmpfs @./dev (0)
> > (00.006780) 1: 72:./dev private 0 shared 0 slave 0
> > (00.006910) 1: Found fd 0 (id pipe:[69253]) in inherit fd list
> (caller inherit_fd_resolve_clash)
> > (00.006944) 1: Inherit fd 0 moved to 5 to resolve clash
> > (00.006956) 1: Found fd 1 (id pipe:[69254]) in inherit fd list
> (caller inherit_fd_resolve_clash)
> > (00.006959) 1: Inherit fd 1 moved to 3 to resolve clash
> > (00.009289) 1: Mounting devpts @./dev/pts (0)
> > (00.009326) 1: 73:./dev/pts private 0 shared 0 slave 0
> > (00.009331) 1: Mounting mqueue @./dev/mqueue (0)
> > (00.009347) 1: 75:./dev/mqueue private 0 shared 0 slave 0
> > (00.009351) 1: Mounting tmpfs @./dev/shm (0)
> > (00.009367) 1: 74:./dev/shm private 0 shared 0 slave 0
> > (00.009533) 1: Found fd 0 (id pipe:[69253]) in inherit fd list
> (caller inherit_fd_resolve_clash)
> > (00.009561) 1: Inherit fd 0 moved to 5 to resolve clash
> > (00.009568) 1: Found fd 1 (id pipe:[69254]) in inherit fd list
> (caller inherit_fd_resolve_clash)
> > (00.009571) 1: Inherit fd 1 moved to 3 to resolve clash
> > (00.011457) 1: Mounting tmpfs @./proc/kcore (0)
> > (00.011467) 1: Bind ./dev/null to ./proc/kcore
> > (00.011483) 1: 48:./proc/kcore private 1 shared 0 slave 0
> > (00.011489) 1: Move the root to .
> > (00.036730) 1: Mount procfs in crtools-proc.TcM8jF
> > (00.044807) 1: Found fd 0 (id pipe:[69253]) in inherit fd list
> (caller close_old_fds)
> > (00.044818) 1: Found fd 1 (id pipe:[69254]) in inherit fd list
> (caller close_old_fds)
> > (00.044821) 1: Found fd 2 (id pipe:[69255]) in inherit fd list
> (caller close_old_fds)
> > (00.044840) 1: Preparing info about shared resources
> > (00.044859) 1: Collecting 33/18 (flags 0)
> > (00.044888) 1: Collected [bin/busybox] ID 0x4
> > (00.044897) 1: Collected [lib/libuClibc-0.9.33.2.so] ID 0x5
> > (00.044902) 1: Collected [lib/ld64-uClibc-0.9.33.2.so] ID 0x6
> > (00.044905) 1: Collected [.] ID 0x7
> > (00.044910) 1: `- ... done
> > (00.044912) 1: Collecting 46/52 (flags 0)
> > (00.044922) 1: No remap-fpath.img image
> > (00.044932) 1: `- ... done
> > (00.044936) 1: Collecting 35/20 (flags 0)
> > (00.044945) 1: No ns-files.img image
> > (00.044960) 1: `- ... done
> > (00.044967) 1: Collecting 40/25 (flags 0)
> > (00.044983) 1: Collected pipe entry ID 0x1 PIPE ID 0x10e85
> > (00.044989) 1: Collected pipe entry ID 0x2 PIPE ID 0x10e86
> > (00.044992) 1: Collected pipe entry ID 0x3 PIPE ID 0x10e87
> > (00.044997) 1: `- ... done
> > (00.044999) 1: Collecting 42/26 (flags 0)
> > (00.045008) 1: No fifo.img image
> > (00.045011) 1: `- ... done
> > (00.045015) 1: Collecting 37/22 (flags 1)
> > (00.045022) 1: No unixsk.img image
> > (00.045026) 1: `- ... done
> > (00.045028) 1: Collecting 38/23 (flags 0)
> > (00.045032) 1: No packetsk.img image
> > (00.045035) 1: `- ... done
> > (00.045037) 1: Collecting 39/24 (flags 0)
> > (00.045044) 1: No netlinksk.img image
> > (00.045047) 1: `- ... done
> > (00.045049) 1: Collecting 47/28 (flags 0)
> > (00.045061) 1: No eventfd.img image
> > (00.045064) 1: `- ... done
> > (00.045066) 1: Collecting 73/30 (flags 0)
> > (00.045073) 1: No eventpoll-tfd.img image
> > (00.045077) 1: `- ... done
> > (00.045079) 1: Collecting 48/29 (flags 0)
> > (00.045086) 1: No eventpoll.img image
> > (00.045089) 1: `- ... done
> > (00.045091) 1: Collecting 49/31 (flags 0)
> > (00.045098) 1: No signalfd.img image
> > (00.045102) 1: `- ... done
> > (00.045105) 1: Collecting 50/32 (flags 0)
> > (00.045112) 1: No inotify.img image
> > (00.045119) 1: `- ... done
> > (00.045123) 1: Collecting 71/33 (flags 0)
> > (00.045130) 1: No inotify-wd.img image
> > (00.045133) 1: `- ... done
> > (00.045136) 1: Collecting 51/34 (flags 0)
> > (00.045143) 1: No fanotify.img image
> > (00.045146) 1: `- ... done
> > (00.045148) 1: Collecting 72/35 (flags 0)
> > (00.045156) 1: No fanotify-mark.img image
> > (00.045159) 1: `- ... done
> > (00.045161) 1: Collecting 45/37 (flags 0)
> > (00.045166) 1: No tty-info.img image
> > (00.045169) 1: `- ... done
> > (00.045171) 1: Collecting 44/36 (flags 0)
> > (00.045177) 1: No tty.img image
> > (00.045181) 1: `- ... done
> > (00.045183) 1: Collecting 52/42 (flags 0)
> > (00.045190) 1: No tunfile.img image
> > (00.045196) 1: `- ... done
> > (00.045200) 1: Collecting 34/19 (flags 0)
> > (00.045205) 1: No ext-files.img image
> > (00.045208) 1: `- ... done
> > (00.045210) 1: Collecting 54/45 (flags 0)
> > (00.045217) 1: No timerfd.img image
> > (00.045220) 1: `- ... done
> > (00.045222) 1: Collecting 55/38 (flags 0)
> > (00.045229) 1: No filelocks.img image
> > (00.045232) 1: `- ... done
> > (00.045244) 1: Collected pipe data for 0x10e85 (chain 5)
> > (00.045254) 1: No fifo-data.img image
> > (00.045260) 1: Trying to read socket queues image
> > (00.045266) 1: No sk-queues.img image
> > (00.045290) 1: Found 16 VMAs in image
> > (00.045295) 1: vma 0x400000 0x489000
> > (00.045298) 1: vma 0x688000 0x689000
> > (00.045300) 1: vma 0x689000 0x68b000
> > (00.045303) 1: vma 0x2443000 0x2447000
> > (00.045305) 1: vma 0x7f8f9832f000 0x7f8f98380000
> > (00.045307) 1: vma 0x7f8f98380000 0x7f8f98580000
> > (00.045310) 1: vma 0x7f8f98580000 0x7f8f98581000
> > (00.045312) 1: vma 0x7f8f98581000 0x7f8f98582000
> > (00.045314) 1: vma 0x7f8f98582000 0x7f8f98587000
> > (00.045317) 1: vma 0x7f8f98587000 0x7f8f9858d000
> > (00.045319) 1: vma 0x7f8f9878a000 0x7f8f9878d000
> > (00.045321) 1: vma 0x7f8f9878d000 0x7f8f9878e000
> > (00.045323) 1: vma 0x7f8f9878e000 0x7f8f9878f000
> > (00.045326) 1: vma 0x7fff79953000 0x7fff79975000
> > (00.045328) 1: vma 0x7fff799fe000 0x7fff79a00000
> > (00.045330) 1: vma 0xffffffffff600000 0xffffffffff601000
> > (00.045340) 1: Collect fdinfo pid=1 fd=0 id=0x1
> > (00.045344) 1: Collect fdinfo pid=1 fd=1 id=0x2
> > (00.045346) 1: Collect fdinfo pid=1 fd=2 id=0x3
> > (00.045377) 1: Found 15 VMAs in image
> > (00.045381) 1: vma 0x400000 0x489000
> > (00.045383) 1: vma 0x688000 0x689000
> > (00.045386) 1: vma 0x689000 0x68b000
> > (00.045388) 1: vma 0x7f5475a98000 0x7f5475ae9000
> > (00.045402) 1: vma 0x7f5475ae9000 0x7f5475ce9000
> > (00.045405) 1: vma 0x7f5475ce9000 0x7f5475cea000
> > (00.045407) 1: vma 0x7f5475cea000 0x7f5475ceb000
> > (00.045410) 1: vma 0x7f5475ceb000 0x7f5475cf0000
> > (00.045412) 1: vma 0x7f5475cf0000 0x7f5475cf6000
> > (00.045414) 1: vma 0x7f5475ef3000 0x7f5475ef6000
> > (00.045416) 1: vma 0x7f5475ef6000 0x7f5475ef7000
> > (00.045419) 1: vma 0x7f5475ef7000 0x7f5475ef8000
> > (00.045421) 1: vma 0x7fffa844a000 0x7fffa846c000
> > (00.045423) 1: vma 0x7fffa8476000 0x7fffa8478000
> > (00.045425) 1: vma 0xffffffffff600000 0xffffffffff601000
> > (00.045433) 1: Collect fdinfo pid=11 fd=0 id=0x1
> > (00.045436) 1: Collect fdinfo pid=11 fd=1 id=0x2
> > (00.045439) 1: Collect fdinfo pid=11 fd=2 id=0x3
> > (00.045449) 1: Pipes:
> > (00.045452) 1: `- PIPE ID 0x10e85
> > (00.045454) 1: `- ID 0x14f3580 0x1pn(00.045456) 1: `- FD
> 0 pid 1
> > (00.045458) 1: `- FD 0 pid 11
> > (00.045460) 1: by 0x1
> > (00.045461) 1: `- PIPE ID 0x10e86
> > (00.045463) 1: `- ID 0x14f3970 0x2pn(00.045465) 1: `- FD
> 1 pid 1
> > (00.045467) 1: `- FD 1 pid 11
> > (00.045468) 1: by 0x2
> > (00.045470) 1: `- PIPE ID 0x10e87
> > (00.045472) 1: `- ID 0x14f3f30 0x3pn(00.045473) 1: `- FD
> 2 pid 1
> > (00.045475) 1: `- FD 2 pid 11
> > (00.045477) 1: by 0x3
> > (00.045479) 1: Unix sockets:
> > (00.045510) 1: Saved shmems:
> > (00.045515) 1: File descs:
> > (00.045517) 1: `- type 2 ID 0x1
> > (00.045518) 1: `- FD 0 pid 1
> > (00.045520) 1: `- FD 0 pid 11
> > (00.045522) 1: `- type 2 ID 0x2
> > (00.045524) 1: `- FD 1 pid 1
> > (00.045526) 1: `- FD 1 pid 11
> > (00.045527) 1: `- type 2 ID 0x3
> > (00.045529) 1: `- FD 2 pid 1
> > (00.045531) 1: `- FD 2 pid 11
> > (00.045533) 1: `- type 1 ID 0x4
> > (00.045534) 1: `- type 1 ID 0x5
> > (00.045536) 1: `- type 1 ID 0x6
> > (00.045538) 1: `- type 1 ID 0x7
> > (00.045612) 1: Map 0x0000000000400000-0x0000000000489000
> 0x0000000000000000 vma
> > (00.045625) 1: premap 0x0000000000400000-0x0000000000489000 ->
> 00007fbfe9c32000
> > (00.045631) 1: Map 0x0000000000688000-0x0000000000689000
> 0x0000000000088000 vma
> > (00.045636) 1: premap 0x0000000000688000-0x0000000000689000 ->
> 00007fbfe9cbb000
> > (00.045639) 1: Map 0x0000000000689000-0x000000000068b000
> 0x0000000000000000 vma
> > (00.045642) 1: premap 0x0000000000689000-0x000000000068b000 ->
> 00007fbfe9cbc000
> > (00.045645) 1: Map 0x0000000002443000-0x0000000002447000
> 0x0000000000000000 vma
> > (00.045648) 1: premap 0x0000000002443000-0x0000000002447000 ->
> 00007fbfe9cbe000
> > (00.045654) 1: Map 0x00007f8f9832f000-0x00007f8f98380000
> 0x0000000000000000 vma
> > (00.045658) 1: premap 0x00007f8f9832f000-0x00007f8f98380000 ->
> 00007fbfe9cc2000
> > (00.045661) 1: Map 0x00007f8f98380000-0x00007f8f98580000
> 0x0000000000000000 vma
> > (00.045665) 1: premap 0x00007f8f98380000-0x00007f8f98580000 ->
> 00007fbfe9d13000
> > (00.045670) 1: Map 0x00007f8f98580000-0x00007f8f98581000
> 0x0000000000051000 vma
> > (00.045674) 1: premap 0x00007f8f98580000-0x00007f8f98581000 ->
> 00007fbfe9f13000
> > (00.045678) 1: Map 0x00007f8f98581000-0x00007f8f98582000
> 0x0000000000052000 vma
> > (00.045683) 1: premap 0x00007f8f98581000-0x00007f8f98582000 ->
> 00007fbfe9f14000
> > (00.045685) 1: Map 0x00007f8f98582000-0x00007f8f98587000
> 0x0000000000000000 vma
> > (00.045689) 1: premap 0x00007f8f98582000-0x00007f8f98587000 ->
> 00007fbfe9f15000
> > (00.045694) 1: Map 0x00007f8f98587000-0x00007f8f9858d000
> 0x0000000000000000 vma
> > (00.045698) 1: premap 0x00007f8f98587000-0x00007f8f9858d000 ->
> 00007fbfe9f1a000
> > (00.045701) 1: Map 0x00007f8f9878a000-0x00007f8f9878d000
> 0x0000000000000000 vma
> > (00.045704) 1: premap 0x00007f8f9878a000-0x00007f8f9878d000 ->
> 00007fbfe9f20000
> > (00.045709) 1: Map 0x00007f8f9878d000-0x00007f8f9878e000
> 0x0000000000006000 vma
> > (00.045713) 1: premap 0x00007f8f9878d000-0x00007f8f9878e000 ->
> 00007fbfe9f23000
> > (00.045717) 1: Map 0x00007f8f9878e000-0x00007f8f9878f000
> 0x0000000000007000 vma
> > (00.045732) 1: premap 0x00007f8f9878e000-0x00007f8f9878f000 ->
> 00007fbfe9f24000
> > (00.045736) 1: Map 0x00007fff79952000-0x00007fff79975000
> 0x0000000000000000 vma
> > (00.045739) 1: premap 0x00007fff79952000-0x00007fff79975000 ->
> 00007fbfe9f25000
> > (00.045742) 1: Map 0x00007fff799fe000-0x00007fff79a00000
> 0x0000000000000000 vma
> > (00.045746) 1: premap 0x00007fff799fe000-0x00007fff79a00000 ->
> 00007fbfe9f48000
> > (00.045767) 1: Opened page read 1 (parent 0)
> > (00.045773) 1: pr1 Read page 400000 from self 400000/0
> > (00.045792) 1: pr1 Read page 688000 from self 688000/1000
> > (00.045803) 1: pr1 Read page 689000 from self 689000/2000
> > (00.045809) 1: pr1 Read page 68a000 from self 68a000/3000
> > (00.045821) 1: pr1 Read page 2443000 from self 2443000/4000
> > (00.045826) 1: pr1 Read page 2444000 from self 2444000/5000
> > (00.045831) 1: pr1 Read page 2445000 from self 2445000/6000
> > (00.045836) 1: pr1 Read page 2446000 from self 2446000/7000
> > (00.045842) 1: pr1 Read page 7f8f98580000 from self
> 7f8f98580000/8000
> > (00.045849) 1: pr1 Read page 7f8f98581000 from self
> 7f8f98581000/9000
> > (00.045855) 1: pr1 Read page 7f8f98582000 from self
> 7f8f98582000/a000
> > (00.045862) 1: pr1 Read page 7f8f98585000 from self
> 7f8f98585000/b000
> > (00.045868) 1: pr1 Read page 7f8f98586000 from self
> 7f8f98586000/c000
> > (00.045876) 1: pr1 Read page 7f8f9878a000 from self
> 7f8f9878a000/d000
> > (00.045882) 1: pr1 Read page 7f8f9878b000 from self
> 7f8f9878b000/e000
> > (00.045888) 1: pr1 Read page 7f8f9878c000 from self
> 7f8f9878c000/f000
> > (00.045894) 1: pr1 Read page 7f8f9878d000 from self
> 7f8f9878d000/10000
> > (00.045900) 1: pr1 Read page 7f8f9878e000 from self
> 7f8f9878e000/11000
> > (00.045910) 1: pr1 Read page 7fff79973000 from self
> 7fff79973000/12000
> > (00.045922) 1: pr1 Read page 7fff79974000 from self
> 7fff79974000/13000
> > (00.045929) 1: pr1 Read page 7fff799fe000 from self
> 7fff799fe000/14000
> > (00.045935) 1: pr1 Read page 7fff799ff000 from self
> 7fff799ff000/15000
> > (00.045947) 1: nr_restored_pages: 22
> > (00.045950) 1: nr_shared_pages: 0
> > (00.045952) 1: nr_droped_pages: 0
> > (00.045971) 1: Found fd 0 (id pipe:[69253]) in inherit fd list
> (caller close_old_fds)
> > (00.045976) 1: Found fd 1 (id pipe:[69254]) in inherit fd list
> (caller close_old_fds)
> > (00.045979) 1: Found fd 2 (id pipe:[69255]) in inherit fd list
> (caller close_old_fds)
> > (00.045992) 1: cg: Move into 2
> > (00.046000) 1: cg: `-> blkio//nsinit/busybox/tasks
> > (00.046020) 1: cg: `-> cpu//nsinit/busybox/tasks
> > (00.046036) 1: cg: `-> cpuacct//nsinit/busybox/tasks
> > (00.046046) 1: cg: `-> cpuset//nsinit/busybox/tasks
> > (00.046068) 1: cg: `-> devices//nsinit/busybox/tasks
> > (00.046079) 1: cg: `-> freezer//nsinit/busybox/tasks
> > (00.046089) 1: cg: `-> hugetlb//user/1003.user/2.session/tasks
> > (00.046099) 1: cg: `-> memory//nsinit/busybox/tasks
> > (00.046109) 1: cg: `-> systemd//user/1003.user/2.session/tasks
> > (00.046118) 1: cg: `-> perf_event//nsinit/busybox/tasks
> > (00.046128) 1: Restore sigacts for 1
> > (00.046156) 1: Restored 61/61 sigacts
> > (00.046160) 1: Restoring children in alien sessions:
> > (00.046163) 1: Restoring 1 to 1 sid
> > (00.046182) 1: Restoring children in our session:
> > (00.046215) 1: Forking task with 11 pid (flags 0x0)
> > (00.046375) 1: Restoring 1 to 1 pgid
> > (00.046373) 1: PID: real 31443 virt 11
> > (00.046438) 11: COW 0x0000000000400000-0x0000000000489000
> 0x0000000000000000 vma
> > (00.046482) 11: premap 0x0000000000400000-0x0000000000489000 ->
> 00007fbfe991e000
> > (00.046499) 11: COW 0x0000000000688000-0x0000000000689000
> 0x0000000000088000 vma
> > (00.046508) 11: premap 0x0000000000688000-0x0000000000689000 ->
> 00007fbfe99a7000
> > (00.046515) 11: COW 0x0000000000689000-0x000000000068b000
> 0x0000000000000000 vma
> > (00.046522) 11: premap 0x0000000000689000-0x000000000068b000 ->
> 00007fbfe99a8000
> > (00.046529) 11: Map 0x00007f5475a98000-0x00007f5475ae9000
> 0x0000000000000000 vma
> > (00.046541) 11: premap 0x00007f5475a98000-0x00007f5475ae9000 ->
> 00007fbfe99aa000
> > (00.046546) 11: Map 0x00007f5475ae9000-0x00007f5475ce9000
> 0x0000000000000000 vma
> > (00.046551) 11: premap 0x00007f5475ae9000-0x00007f5475ce9000 ->
> 00007fbfe99fb000
> > (00.046556) 11: Map 0x00007f5475ce9000-0x00007f5475cea000
> 0x0000000000051000 vma
> > (00.046560) 11: premap 0x00007f5475ce9000-0x00007f5475cea000 ->
> 00007fbfe9bfb000
> > (00.046565) 11: Map 0x00007f5475cea000-0x00007f5475ceb000
> 0x0000000000052000 vma
> > (00.046569) 11: premap 0x00007f5475cea000-0x00007f5475ceb000 ->
> 00007fbfe9bfc000
> > (00.046572) 11: Map 0x00007f5475ceb000-0x00007f5475cf0000
> 0x0000000000000000 vma
> > (00.046576) 11: premap 0x00007f5475ceb000-0x00007f5475cf0000 ->
> 00007fbfe9bfd000
> > (00.046580) 11: Map 0x00007f5475cf0000-0x00007f5475cf6000
> 0x0000000000000000 vma
> > (00.046585) 11: premap 0x00007f5475cf0000-0x00007f5475cf6000 ->
> 00007fbfe9c02000
> > (00.046587) 11: Map 0x00007f5475ef3000-0x00007f5475ef6000
> 0x0000000000000000 vma
> > (00.046591) 11: premap 0x00007f5475ef3000-0x00007f5475ef6000 ->
> 00007fbfe9c08000
> > (00.046595) 11: Map 0x00007f5475ef6000-0x00007f5475ef7000
> 0x0000000000006000 vma
> > (00.046599) 11: premap 0x00007f5475ef6000-0x00007f5475ef7000 ->
> 00007fbfe9c0b000
> > (00.046603) 11: Map 0x00007f5475ef7000-0x00007f5475ef8000
> 0x0000000000007000 vma
> > (00.046608) 11: premap 0x00007f5475ef7000-0x00007f5475ef8000 ->
> 00007fbfe9c0c000
> > (00.046611) 11: Map 0x00007fffa8449000-0x00007fffa846c000
> 0x0000000000000000 vma
> > (00.046615) 11: premap 0x00007fffa8449000-0x00007fffa846c000 ->
> 00007fbfe9c0d000
> > (00.046617) 11: Map 0x00007fffa8476000-0x00007fffa8478000
> 0x0000000000000000 vma
> > (00.046620) 11: premap 0x00007fffa8476000-0x00007fffa8478000 ->
> 00007fbfe9c30000
> > (00.046676) 11: Opened page read 2 (parent 0)
> > (00.046683) 11: pr2 Read page 400000 from self 400000/0
> > (00.046697) 11: pr2 Read page 688000 from self 688000/1000
> > (00.046705) 11: pr2 Read page 689000 from self 689000/2000
> > (00.046713) 11: pr2 Read page 68a000 from self 68a000/3000
> > (00.046722) 11: pr2 Read page 7f5475ce9000 from self
> 7f5475ce9000/4000
> > (00.046735) 11: pr2 Read page 7f5475cea000 from self
> 7f5475cea000/5000
> > (00.046745) 11: pr2 Read page 7f5475cee000 from self
> 7f5475cee000/6000
> > (00.046751) 11: pr2 Read page 7f5475cef000 from self
> 7f5475cef000/7000
> > (00.046757) 11: pr2 Read page 7f5475ef3000 from self
> 7f5475ef3000/8000
> > (00.046763) 11: pr2 Read page 7f5475ef4000 from self
> 7f5475ef4000/9000
> > (00.046768) 11: pr2 Read page 7f5475ef5000 from self
> 7f5475ef5000/a000
> > (00.046774) 11: pr2 Read page 7f5475ef6000 from self
> 7f5475ef6000/b000
> > (00.046780) 11: pr2 Read page 7f5475ef7000 from self
> 7f5475ef7000/c000
> > (00.046788) 11: pr2 Read page 7fffa8469000 from self
> 7fffa8469000/d000
> > (00.046793) 11: pr2 Read page 7fffa846a000 from self
> 7fffa846a000/e000
> > (00.046798) 11: pr2 Read page 7fffa846b000 from self
> 7fffa846b000/f000
> > (00.046807) 11: pr2 Read page 7fffa8476000 from self
> 7fffa8476000/10000
> > (00.046814) 11: pr2 Read page 7fffa8477000 from self
> 7fffa8477000/11000
> > (00.046825) 11: nr_restored_pages: 17
> > (00.046829) 11: nr_shared_pages: 1
> > (00.046831) 11: nr_droped_pages: 0
> > (00.046887) 11: Found fd 0 (id pipe:[69253]) in inherit fd list
> (caller close_old_fds)
> > (00.046895) 11: Found fd 1 (id pipe:[69254]) in inherit fd list
> (caller close_old_fds)
> > (00.046898) 11: Found fd 2 (id pipe:[69255]) in inherit fd list
> (caller close_old_fds)
> > (00.046907) 11: cg: Cgroups 2 inherited from parent
> > (00.046911) 11: Restore sigacts for 11
> > (00.046935) 11: Restored 4/61 sigacts
> > (00.046940) 11: Restoring children in alien sessions:
> > (00.046944) 11: Restoring children in our session:
> > (00.046956) 11: Restoring 11 to 1 pgid
> > (00.047019) 1: Restoring resources
> > (00.047028) 11: Restoring resources
> > (00.047031) 1: Opening fdinfo-s
> > (00.047038) 11: Opening fdinfo-s
> > (00.047040) 1: Restoring fd 0 (state -> prepare)
> > (00.047042) 11: Restoring fd 0 (state -> prepare)
> > (00.047052) 11: Create transport fd /crtools-fd-11-0
> > (00.047044) 1: Restoring fd 1 (state -> prepare)
> > (00.047057) 1: Restoring fd 2 (state -> prepare)
> > (00.047060) 1: Restoring fd 0 (state -> create)
> > (00.047063) 1: Found id pipe:[69253] (fd 0) in inherit fd list
> > (00.047069) 1: File pipe:[69253] will be restored from fd 3 duped
> from inherit fd 0
> > (00.047072) 1: Found fd 0 (id pipe:[69253]) in inherit fd list
> (caller inherit_fd_resolve_clash)
> > (00.047076) 1: Inherit fd 0 moved to 4 to resolve clash
> > (00.047075) 11: Found fd 0 (id pipe:[69253]) in inherit fd list
> (caller inherit_fd_resolve_clash)
> > (00.047088) 11: Inherit fd 0 moved to 4 to resolve clash
> > (00.047090) 1: Create fd for 0
> > (00.047097) 1: Wait fdinfo pid=11 fd=0
> > (00.047100) 11: Wake up fdinfo pid=11 fd=0
> > (00.047108) 11: Restoring fd 1 (state -> prepare)
> > (00.047111) 11: Create transport fd /crtools-fd-11-1
> > (00.047111) 1: Send fd 0 to /crtools-fd-11-0
> > (00.047118) 11: Found fd 1 (id pipe:[69254]) in inherit fd list
> (caller inherit_fd_resolve_clash)
> > (00.047121) 11: Inherit fd 1 moved to 5 to resolve clash
> > (00.047124) 11: Wake up fdinfo pid=11 fd=1
> > (00.047126) 11: Restoring fd 2 (state -> prepare)
> > (00.047129) 11: Create transport fd /crtools-fd-11-2
> > (00.047129) 1: Restoring fd 1 (state -> create)
> > (00.047133) 11: Found fd 2 (id pipe:[69255]) in inherit fd list
> (caller inherit_fd_resolve_clash)
> > (00.047134) 1: Found id pipe:[69254] (fd 1) in inherit fd list
> > (00.047137) 11: Inherit fd 2 moved to 6 to resolve clash
> > (00.047138) 1: File pipe:[69254] will be restored from fd 3 duped
> from inherit fd 1
> > (00.047140) 11: Wake up fdinfo pid=11 fd=2
> > (00.047142) 1: Found fd 1 (id pipe:[69254]) in inherit fd list
> (caller inherit_fd_resolve_clash)
> > (00.047145) 1: Inherit fd 1 moved to 5 to resolve clash
> > (00.047144) 11: Restoring fd 0 (state -> create)
> > (00.047149) 11: Restoring fd 1 (state -> create)
> > (00.047151) 1: Create fd for 1
> > (00.047151) 11: Restoring fd 2 (state -> create)
> > (00.047154) 1: Wait fdinfo pid=11 fd=1
> > (00.047155) 11: Restoring fd 0 (state -> receive)
> > (00.047157) 1: Send fd 1 to /crtools-fd-11-1
> > (00.047158) 11: Receive fd for 0
> > (00.047165) 1: Restoring fd 2 (state -> create)
> > (00.047169) 1: Found id pipe:[69255] (fd 2) in inherit fd list
> > (00.047171) 11: Restoring fd 1 (state -> receive)
> > (00.047172) 1: File pipe:[69255] will be restored from fd 3 duped
> from inherit fd 2
> > (00.047175) 11: Receive fd for 1
> > (00.047178) 1: Found fd 2 (id pipe:[69255]) in inherit fd list
> (caller inherit_fd_resolve_clash)
> > (00.047181) 1: Inherit fd 2 moved to 6 to resolve clash
> > (00.047183) 11: Restoring fd 2 (state -> receive)
> > (00.047185) 1: Create fd for 2
> > (00.047187) 11: Receive fd for 2
> > (00.047189) 1: Wait fdinfo pid=11 fd=2
> > (00.047192) 1: Send fd 2 to /crtools-fd-11-2
> > (00.047201) 1: Skipping receive fd stage
> > (00.047204) 1: Skipping post_create fd stage
> > (00.047215) 11: Skipping post_create fd stage
> > (00.047215) 1: Opening 0x0000000000400000-0x0000000000489000
> 0x0000000000000000 (41) vma
> > (00.047222) 11: Opening 0x0000000000400000-0x0000000000489000
> 0x0000000000000000 (41) vma
> > (00.047224) 1: Opening 0x0000000000688000-0x0000000000689000
> 0x0000000000088000 (41) vma
> > (00.047226) 11: Opening 0x0000000000688000-0x0000000000689000
> 0x0000000000088000 (41) vma
> > (00.047228) 1: Opening 0x0000000000689000-0x000000000068b000
> 0x0000000000000000 (201) vma
> > (00.047230) 11: Opening 0x0000000000689000-0x000000000068b000
> 0x0000000000000000 (201) vma
> > (00.047231) 1: Opening 0x0000000002443000-0x0000000002447000
> 0x0000000000000000 (221) vma
> > (00.047233) 11: Opening 0x00007f5475a98000-0x00007f5475ae9000
> 0x0000000000000000 (41) vma
> > (00.047234) 1: Opening 0x00007f8f9832f000-0x00007f8f98380000
> 0x0000000000000000 (41) vma
> > (00.047236) 11: Opening 0x00007f5475ae9000-0x00007f5475ce9000
> 0x0000000000000000 (201) vma
> > (00.047237) 1: Opening 0x00007f8f98380000-0x00007f8f98580000
> 0x0000000000000000 (201) vma
> > (00.047244) 11: Opening 0x00007f5475ce9000-0x00007f5475cea000
> 0x0000000000051000 (41) vma
> > (00.047246) 1: Opening 0x00007f8f98580000-0x00007f8f98581000
> 0x0000000000051000 (41) vma
> > (00.047247) 11: Opening 0x00007f5475cea000-0x00007f5475ceb000
> 0x0000000000052000 (41) vma
> > (00.047249) 1: Opening 0x00007f8f98581000-0x00007f8f98582000
> 0x0000000000052000 (41) vma
> > (00.047250) 11: Opening 0x00007f5475ceb000-0x00007f5475cf0000
> 0x0000000000000000 (201) vma
> > (00.047252) 1: Opening 0x00007f8f98582000-0x00007f8f98587000
> 0x0000000000000000 (201) vma
> > (00.047254) 11: Opening 0x00007f5475cf0000-0x00007f5475cf6000
> 0x0000000000000000 (41) vma
> > (00.047255) 1: Opening 0x00007f8f98587000-0x00007f8f9858d000
> 0x0000000000000000 (41) vma
> > (00.047257) 11: Opening 0x00007f5475ef3000-0x00007f5475ef6000
> 0x0000000000000000 (201) vma
> > (00.047258) 1: Opening 0x00007f8f9878a000-0x00007f8f9878d000
> 0x0000000000000000 (201) vma
> > (00.047260) 11: Opening 0x00007f5475ef6000-0x00007f5475ef7000
> 0x0000000000006000 (41) vma
> > (00.047261) 1: Opening 0x00007f8f9878d000-0x00007f8f9878e000
> 0x0000000000006000 (41) vma
> > (00.047263) 11: Opening 0x00007f5475ef7000-0x00007f5475ef8000
> 0x0000000000007000 (41) vma
> > (00.047264) 1: Opening 0x00007f8f9878e000-0x00007f8f9878f000
> 0x0000000000007000 (41) vma
> > (00.047266) 11: Opening 0x00007fffa844a000-0x00007fffa846c000
> 0x0000000000000000 (201) vma
> > (00.047268) 1: Opening 0x00007fff79953000-0x00007fff79975000
> 0x0000000000000000 (201) vma
> > (00.047269) 11: Opening 0x00007fffa8476000-0x00007fffa8478000
> 0x0000000000000000 (209) vma
> > (00.047275) 1: Opening 0x00007fff799fe000-0x00007fff79a00000
> 0x0000000000000000 (209) vma
> > (00.047283) 11: Closing inherit fd 4 -> pipe:[69253]
> > (00.047286) 1: Closing inherit fd 4 -> pipe:[69253]
> > (00.047287) 11: Closing inherit fd 5 -> pipe:[69254]
> > (00.047290) 1: Closing inherit fd 5 -> pipe:[69254]
> > (00.047291) 11: Closing inherit fd 6 -> pipe:[69255]
> > (00.047293) 1: Closing inherit fd 6 -> pipe:[69255]
> > (00.047295) 11: Restore via sigreturn
> > (00.047296) 1: Restore via sigreturn
> > (00.047298) 11: 1 threads require 40K of memory
> > (00.047299) 1: 1 threads require 40K of memory
> > (00.047345) 1: Parsed 400000-4bc000 vma
> > (00.047348) 11: Parsed 400000-4bc000 vma
> > (00.047351) 1: Parsed 6bb000-6bc000 vma
> > (00.047354) 11: Parsed 6bb000-6bc000 vma
> > (00.047356) 1: Parsed 6bc000-6cc000 vma
> > (00.047358) 11: Parsed 6bc000-6cc000 vma
> > (00.047360) 1: Parsed 6cc000-6d6000 vma
> > (00.047361) 11: Parsed 6cc000-6d6000 vma
> > (00.047364) 1: Parsed 14ef000-1510000 vma
> > (00.047365) 11: Parsed 14ef000-1510000 vma
> > (00.047367) 1: Parsed 7fbfe9c32000-7fbfe9cbb000 vma
> > (00.047369) 11: Parsed 7fbfe991e000-7fbfe99a7000 vma
> > (00.047371) 1: Parsed 7fbfe9cbb000-7fbfe9cbc000 vma
> > (00.047372) 11: Parsed 7fbfe99a7000-7fbfe99a8000 vma
> > (00.047374) 1: Parsed 7fbfe9cbc000-7fbfe9cc2000 vma
> > (00.047376) 11: Parsed 7fbfe99a8000-7fbfe99aa000 vma
> > (00.047377) 1: Parsed 7fbfe9cc2000-7fbfe9d13000 vma
> > (00.047379) 11: Parsed 7fbfe99aa000-7fbfe99fb000 vma
> > (00.047380) 1: Parsed 7fbfe9d13000-7fbfe9f13000 vma
> > (00.047382) 11: Parsed 7fbfe99fb000-7fbfe9bfb000 vma
> > (00.047384) 1: Parsed 7fbfe9f13000-7fbfe9f14000 vma
> > (00.047385) 11: Parsed 7fbfe9bfb000-7fbfe9bfc000 vma
> > (00.047387) 1: Parsed 7fbfe9f14000-7fbfe9f15000 vma
> > (00.047389) 11: Parsed 7fbfe9bfc000-7fbfe9bfd000 vma
> > (00.047400) 1: Parsed 7fbfe9f15000-7fbfe9f1a000 vma
> > (00.047401) 11: Parsed 7fbfe9bfd000-7fbfe9c02000 vma
> > (00.047404) 1: Parsed 7fbfe9f1a000-7fbfe9f20000 vma
> > (00.047406) 11: Parsed 7fbfe9c02000-7fbfe9c08000 vma
> > (00.047408) 1: Parsed 7fbfe9f20000-7fbfe9f23000 vma
> > (00.047409) 11: Parsed 7fbfe9c08000-7fbfe9c0b000 vma
> > (00.047411) 1: Parsed 7fbfe9f23000-7fbfe9f24000 vma
> > (00.047413) 11: Parsed 7fbfe9c0b000-7fbfe9c0c000 vma
> > (00.047414) 1: Parsed 7fbfe9f24000-7fbfe9f25000 vma
> > (00.047416) 11: Parsed 7fbfe9c0c000-7fbfe9c0d000 vma
> > (00.047423) 1: Parsed 7fbfe9f27000-7fbfe9f48000 vma
> > (00.047425) 11: Parsed 7fbfe9c0f000-7fbfe9c30000 vma
> > (00.047427) 1: Parsed 7fbfe9f48000-7fbfe9f4a000 vma
> > (00.047429) 11: Parsed 7fbfe9c30000-7fbfe9c32000 vma
> > (00.047430) 1: Parsed 7fbfe9f4a000-7fbfea105000 vma
> > (00.047434) 1: Parsed 7fbfea105000-7fbfea304000 vma
> > (00.047435) 11: Parsed 7fbfe9cbe000-7fbfe9cc2000 vma
> > (00.047436) 1: Parsed 7fbfea304000-7fbfea308000 vma
> > (00.047440) 11: Parsed 7fbfe9cc2000-7fbfe9d13000 vma
> > (00.047443) 1: Parsed 7fbfea308000-7fbfea30a000 vma
> > (00.047444) 11: Parsed 7fbfe9d13000-7fbfe9f13000 vma
> > (00.047446) 1: Parsed 7fbfea30a000-7fbfea30f000 vma
> > (00.047448) 11: Parsed 7fbfe9f13000-7fbfe9f14000 vma
> > (00.047451) 11: Parsed 7fbfe9f14000-7fbfe9f15000 vma
> > (00.047454) 11: Parsed 7fbfe9f15000-7fbfe9f1a000 vma
> > (00.047459) 1: Parsed 7fbfea30f000-7fbfea312000 vma
> > (00.047464) 1: Parsed 7fbfea312000-7fbfea511000 vma
> > (00.047466) 11: Parsed 7fbfe9f1a000-7fbfe9f20000 vma
> > (00.047467) 1: Parsed 7fbfea511000-7fbfea512000 vma
> > (00.047469) 11: Parsed 7fbfe9f20000-7fbfe9f23000 vma
> > (00.047471) 1: Parsed 7fbfea512000-7fbfea513000 vma
> > (00.047472) 11: Parsed 7fbfe9f23000-7fbfe9f24000 vma
> > (00.047474) 1: Parsed 7fbfea513000-7fbfea522000 vma
> > (00.047476) 11: Parsed 7fbfe9f24000-7fbfe9f25000 vma
> > (00.047478) 1: Parsed 7fbfea522000-7fbfea721000 vma
> > (00.047479) 11: Parsed 7fbfe9f26000-7fbfe9f48000 vma
> > (00.047481) 1: Parsed 7fbfea721000-7fbfea722000 vma
> > (00.047482) 11: Parsed 7fbfe9f48000-7fbfe9f4a000 vma
> > (00.047484) 1: Parsed 7fbfea722000-7fbfea723000 vma
> > (00.047486) 11: Parsed 7fbfe9f4a000-7fbfea105000 vma
> > (00.047487) 1: Parsed 7fbfea723000-7fbfea73c000 vma
> > (00.047632) 11: Parsed 7fbfea105000-7fbfea304000 vma
> > (00.047638) 11: Parsed 7fbfea304000-7fbfea308000 vma
> > (00.047641) 11: Parsed 7fbfea308000-7fbfea30a000 vma
> > (00.047643) 11: Parsed 7fbfea30a000-7fbfea30f000 vma
> > (00.047646) 11: Parsed 7fbfea30f000-7fbfea312000 vma
> > (00.047646) 1: Parsed 7fbfea73c000-7fbfea93b000 vma
> > (00.047651) 1: Parsed 7fbfea93b000-7fbfea93c000 vma
> > (00.047654) 1: Parsed 7fbfea93c000-7fbfea93d000 vma
> > (00.047657) 1: Parsed 7fbfea93d000-7fbfea941000 vma
> > (00.047658) 11: Parsed 7fbfea312000-7fbfea511000 vma
> > (00.047659) 1: Parsed 7fbfea941000-7fbfea964000 vma
> > (00.047662) 11: Parsed 7fbfea511000-7fbfea512000 vma
> > (00.047664) 1: Parsed 7fbfeab40000-7fbfeab46000 vma
> > (00.047665) 11: Parsed 7fbfea512000-7fbfea513000 vma
> > (00.047667) 1: Parsed 7fbfeab46000-7fbfeab5a000 vma
> > (00.047669) 11: Parsed 7fbfea513000-7fbfea522000 vma
> > (00.047671) 1: Parsed 7fbfeab5a000-7fbfeab5d000 vma
> > (00.047674) 1: Parsed 7fbfeab5d000-7fbfeab5f000 vma
> > (00.047675) 11: Parsed 7fbfea522000-7fbfea721000 vma
> > (00.047676) 1: Parsed 7fbfeab5f000-7fbfeab61000 vma
> > (00.047679) 11: Parsed 7fbfea721000-7fbfea722000 vma
> > (00.047681) 1: Parsed 7fbfeab61000-7fbfeab63000 vma
> > (00.047682) 11: Parsed 7fbfea722000-7fbfea723000 vma
> > (00.047684) 1: Parsed 7fbfeab63000-7fbfeab64000 vma
> > (00.047686) 11: Parsed 7fbfea723000-7fbfea73c000 vma
> > (00.047689) 11: Parsed 7fbfea73c000-7fbfea93b000 vma
> > (00.047691) 1: Parsed 7fbfeab64000-7fbfeab65000 vma
> > (00.047697) 1: Parsed 7fbfeab65000-7fbfeab66000 vma
> > (00.047701) 1: Parsed 7fffed6d2000-7fffed714000 vma
> > (00.047701) 11: Parsed 7fbfea93b000-7fbfea93c000 vma
> > (00.047703) 1: Parsed 7fffed72b000-7fffed72d000 vma
> > (00.047705) 11: Parsed 7fbfea93c000-7fbfea93d000 vma
> > (00.047707) 1: Parsed ffffffffff600000-ffffffffff601000 vma
> > (00.047709) 11: Parsed 7fbfea93d000-7fbfea941000 vma
> > (00.047712) 11: Parsed 7fbfea941000-7fbfea964000 vma
> > (00.047714) 11: Parsed 7fbfeab40000-7fbfeab46000 vma
> > (00.047717) 11: Parsed 7fbfeab46000-7fbfeab5a000 vma
> > (00.047719) 11: Parsed 7fbfeab5a000-7fbfeab5d000 vma
> > (00.047720) 1: Found bootstrap VMA hint at: 0x10000 (needs ~88K)
> > (00.047722) 11: Parsed 7fbfeab5d000-7fbfeab5f000 vma
> > (00.047731) 11: Parsed 7fbfeab5f000-7fbfeab61000 vma
> > (00.047734) 11: Parsed 7fbfeab61000-7fbfeab63000 vma
> > (00.047737) 11: Parsed 7fbfeab63000-7fbfeab64000 vma
> > (00.047739) 11: Parsed 7fbfeab64000-7fbfeab65000 vma
> > (00.047741) 11: Parsed 7fbfeab65000-7fbfeab66000 vma
> > (00.047747) 11: Parsed 7fffed6d2000-7fffed714000 vma
> > (00.047749) 11: Parsed 7fffed72b000-7fffed72d000 vma
> > (00.047752) 11: Parsed ffffffffff600000-ffffffffff601000 vma
> > (00.047755) 1: call mremap(0x7fbfeab5b000, 8192, 8192, MAYMOVE |
> FIXED, 0x20000)
> > (00.047765) 11: Found bootstrap VMA hint at: 0x10000 (needs ~88K)
> > (00.047767) 1: call mremap(0x7fbfeab5d000, 8192, 8192, MAYMOVE |
> FIXED, 0x22000)
> > (00.047783) 1: xsave runtime structure
> > (00.047788) 1: -----------------------
> > (00.047790) 1: cwd:37f swd:0 twd:0 fop:0 mxcsr:1f80 mxcsr_mask:ffff
> > (00.047792) 1: magic1:46505853 extended_size:344 xstate_bv:7
> xstate_size:340
> > (00.047794) 1: xstate_bv: 7
> > (00.047796) 1: -----------------------
> > (00.047798) 1: Thread 0 stack 0x165c0 rt_sigframe 0x1e5c0
> > (00.047798) 11: call mremap(0x7fbfeab5b000, 8192, 8192, MAYMOVE |
> FIXED, 0x20000)
> > (00.047809) 11: call mremap(0x7fbfeab5d000, 8192, 8192, MAYMOVE |
> FIXED, 0x22000)
> > (00.047824) 11: xsave runtime structure
> > (00.047829) 11: -----------------------
> > (00.047831) 11: cwd:37f swd:0 twd:0 fop:0 mxcsr:1f80 mxcsr_mask:ffff
> > (00.047833) 11: magic1:46505853 extended_size:344 xstate_bv:7
> xstate_size:340
> > (00.047835) 11: xstate_bv: 7
> > (00.047837) 11: -----------------------
> > (00.047839) 11: Thread 0 stack 0x165c0 rt_sigframe 0x1e5c0
> > (00.047844) 1: Going to chroot into ./self/fd/6
> > (00.047861) 1: Restoring umask to 22
> > (00.047867) 1: task_args: 0x16000
> > task_args->pid: 1
> > task_args->nr_threads: 1
> > task_args->clone_restore_fn: 0x10b20
> > task_args->thread_args: 0x16540
> > pie: Switched to the restorer 1
> > pie: vdso: Remap rt-vdso 0x7fffed72b000 -> 0x24000
> > (00.047890) 11: Going to chroot into ./self/fd/6
> > (00.047905) 11: Restoring umask to 22
> > (00.047914) 11: task_args: 0x16000
> > task_args->pid: 11
> > task_args->nr_threads: 1
> > task_args->clone_restore_fn: 0x10b20
> > task_args->thread_args: 0x16540
> > pie: Switched to the restorer 11
> > pie: vdso: Remap rt-vdso 0x7fffed72b000 -> 0x24000
> > pie: Remap 0x7fbfe9c32000->0x400000 len 0x89000
> > pie: Remap 0x7fbfe9cbb000->0x688000 len 0x1000
> > pie: Remap 0x7fbfe9cbc000->0x689000 len 0x2000
> > pie: Remap 0x7fbfe9cbe000->0x2443000 len 0x4000
> > pie: Remap 0x7fbfe9cc2000->0x7f8f9832f000 len 0x51000
> > pie: Remap 0x7fbfe9d13000->0x7f8f98380000 len 0x200000
> > pie: Remap 0x7fbfe9f13000->0x7f8f98580000 len 0x1000
> > pie: Remap 0x7fbfe9f14000->0x7f8f98581000 len 0x1000
> > pie: Remap 0x7fbfe9f15000->0x7f8f98582000 len 0x5000
> > pie: Remap 0x7fbfe9f1a000->0x7f8f98587000 len 0x6000
> > pie: Remap 0x7fbfe9f20000->0x7f8f9878a000 len 0x3000
> > pie: Remap 0x7fbfe991e000->0x400000 len 0x89000
> > pie: Remap 0x7fbfe9f23000->0x7f8f9878d000 len 0x1000
> > pie: Remap 0x7fbfe9f24000->0x7f8f9878e000 len 0x1000
> > pie: Remap 0x7fbfe99a7000->0x688000 len 0x1000
> > pie: Remap 0x7fbfe9f48000->0x7fff799fe000 len 0x2000
> > pie: Remap 0x7fbfe99a8000->0x689000 len 0x2000
> > pie: Remap 0x7fbfe9f26000->0x7fff79953000 len 0x22000
> > pie: Remap 0x7fbfe99aa000->0x7f5475a98000 len 0x51000
> > pie: vdso: Parsing at 0x7fff799fe000 0x7fff79a00000
> > pie: vdso: PT_LOAD p_vaddr: 0xffffffffff700000
> > pie: vdso: DT_HASH:
> > pie: Remap 0x7fbfe99fb000->0x7f5475ae9000 len 0x200000
> > pie: vdso: DT_STRTAB:
> > pie: vdso: DT_SYMTAB:
> > pie: vdso: DT_STRSZ:
> > pie: Remap 0x7fbfe9bfb000->0x7f5475ce9000 len 0x1000
> > pie: vdso: DT_SYMENT:
> > pie: vdso: nbucket nchain bucket chain
> > pie: Remap 0x7fbfe9bfc000->0x7f5475cea000 len 0x1000
> > pie: vdso: image [vdso] 0x7fff799fe000-0x7fff79a00000 [vvar] 0xfffffff>
> > pie: fffffffff-0xffffffffffffffff
> > pie: vdso: Runtime vdso/vvar matches dumpee, remap inplace
> > pie: Remap 0x7fbfe9bfd000->0x7f5475ceb000 len 0x5000
> > pie: vdso: Remap dumpee 0x24000 -> 0x7fff799fe000
> > pie: Remap 0x7fbfe9c02000->0x7f5475cf0000 len 0x6000
> > pie: Remap 0x7fbfe9c08000->0x7f5475ef3000 len 0x3000
> > pie: Remap 0x7fbfe9c0b000->0x7f5475ef6000 len 0x1000
> > pie: Remap 0x7fbfe9c0c000->0x7f5475ef7000 len 0x1000
> > pie: Remap 0x7fbfe9c30000->0x7fffa8476000 len 0x2000
> > pie: Restoring EXE link
> > pie: Remap 0x7fbfe9c0e000->0x7fffa844a000 len 0x22000
> > pie: Restoring scheduler params 0.0.0
> > pie: vdso: Parsing at 0x7fffa8476000 0x7fffa8478000
> > pie: vdso: PT_LOAD p_vaddr: 0xffffffffff700000
> > pie: vdso: DT_HASH:
> > pie: vdso: DT_STRTAB:
> > pie: 1: Restored
> > pie: vdso: DT_SYMTAB:
> > pie: vdso: DT_STRSZ:
> > pie: vdso: DT_SYMENT:
> > pie: vdso: nbucket nchain bucket chain
> > pie: vdso: image [vdso] 0x7fffa8476000-0x7fffa8478000 [vvar] 0xfffffff>
> > pie: fffffffff-0xffffffffffffffff
> > pie: vdso: Runtime vdso/vvar matches dumpee, remap inplace
> > pie: vdso: Remap dumpee 0x24000 -> 0x7fffa8476000
> > pie: Restoring EXE link
> > pie: Restoring scheduler params 0.0.0
> > pie: 11: Restored
> > (00.052700) Running post-restore scripts
> > (00.052712) Unlock network
> > (00.052724) Running network-unlock scripts
> > (00.053117) Restore finished successfully. Resuming tasks.
> > (00.053187) 31443 was trapped
> > (00.053200) 31443 is going to execute the syscall ffffffffffffffff
> > (00.053218) 31430 was trapped
> > (00.053225) 31430 is going to execute the syscall ffffffffffffffff
> > (00.053270) 31443 was trapped
> > (00.053280) 31443 is going to execute the syscall f
> > (00.053332) 31443 was stopped
> > (00.053341) 31430 was trapped
> > (00.053345) 31430 is going to execute the syscall f
> > (00.053390) 31430 was stopped
> > (00.053440) 31430 was trapped
> > (00.053447) 31430 is going to execute the syscall b
> > (00.053488) 31430 was stopped
> > (00.053551) 31443 was trapped
> > (00.053561) 31443 is going to execute the syscall b
> > (00.053620) 31443 was stopped
> > (00.053637) Writing stats
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.openvz.org/pipermail/criu/attachments/20150320/2767bb11/attachment-0001.html>
More information about the CRIU
mailing list