[CRIU] Lazy Migration Failure and Environment Questions

[Mike Rapoport]

Hi,

On Tue, Jan 23, 2018 at 12:47:28PM +0000, Dmitry Safonov wrote:
> 2018-01-23 4:01 GMT+00:00 John Goen <jtgoen at gmail.com>:
> > Hello,
> >
> >
> > However, when performing the lazy migration steps nearly verbatim from the
> > tutorial video, the lazy migration restore command fails when using the
> > build of CRIU from master, with the following error:
> >     $ pie: <procnum>: Error (criu/pie/util-vdso.c:97): vdso: ELF header
> > magic mismatch
> 
> Ugh, that should be my bug somewhere..
> Do you try to migrate an app from a node with vdso vma to a node with
> vdso=none kernel cmdline? ITOW, do you have vdso linked on the dest
> node (if you cat /proc/self/maps?)
> Could you provide a full restore.log? And maybe anything particular how-to
> reproduce it?

It easily reproducible. I'm attaching the log for completeness, but it does
not seem related to vdso code. As far as I can tell, there is an issue with
dumping partial data when criu dump runs with --lazy-pages.

If I revert the latest changes to page-pipe ("page-pipe: allow to share
pipes between page pipe buffers") everything works just fine...
 
> > When running the same migration steps in the criu-dev branch, I encountered
> > the following different errors when attempting to start the lazy-pages
> > daemon (never being able to reach the proper restore step:
> >     $ Error (criu/util.c:703): Can't read link of fd -404: No such file or
> > directory
> >     $ Error (criu/protobuf.c:75): Unexpected EOF on (null)
> >
> > After running the daemon through GDB, I've determined that the -404 file
> > descriptor is being produced erroneously via image.c by incorrectly reading
> > the lazy flags (or something of that sort, since the lazy variable, set here
> > https://github.com/checkpoint-restore/criu/blob/51c4dc7c25b8687b455675dc33d45fbfd7a99689/criu/image.c#L254
> > is never made true).
> 
> +CC Mike, he has a lazy-migration kung-fu ribbon

+CC Andrei, just in case :)
 
> > I'm unsure if this is an issue with my command setup (which was only
> > slightly modified from the example commands) something wrong with my
> > environment, or a current bug, but if any assistance could be provided on
> > any of these possibilities, it would be much appreciated.
> >
> > Also, if there are any suggestions on available dev environment setups for
> > working on CRIU/P.Haul, they are also welcome.
> 
> 
> -- 
>              Dmitry
> 

-- 
Sincerely yours,
Mike.
-------------- next part --------------
(00.000092) Version: 3.6 (gitid v3.6-472-g51c4dc7)
(00.000150) Running on lxc-host2 Linux 4.4.0-64-generic #85-Ubuntu SMP Mon Feb 20 11:50:30 UTC 2017 x86_64
(00.003276) cpu: fpu:1 fxsr:1 xsave:1
(00.003539) No ns.img image
(00.003587) kernel pid_max=32768
(00.003596) Reading image tree
(00.006672) Add mnt ns 6 pid 23034
(00.006695) Add net ns 3 pid 23034
(00.006702) Add user ns 2 pid 23034
(00.006706) Add pid ns 1 pid 23034
(00.006711) Add ipc ns 4 pid 23034
(00.006716) Add uts ns 5 pid 23034
(00.006720) Add cgroup ns 7 pid 23034
(00.007707) pstree pid_max=23034
(00.007761) Migrating process tree (GID 23034->24278 SID 14103->1790)
(00.007787) Will restore in 0 namespaces
(00.007792) NS mask to use 0
(00.007854) Collecting 37/54 (flags 2)
(00.010701) Collected [mnt/test/test] ID 0x1
(00.010731) Collected [lib/x86_64-linux-gnu/libc-2.23.so] ID 0x2
(00.010740) Collected [lib/x86_64-linux-gnu/ld-2.23.so] ID 0x3
(00.010747) Collected [dev/pts/1] ID 0x5
(00.010777) Collected [mnt/test] ID 0x6
(00.010786) Collected [.] ID 0x7
(00.011635)  `- ... done
(00.011660) Collecting 43/63 (flags 0)
(00.012538) No remap-fpath.img image
(00.012564)  `- ... done
(00.020270) cg: Preparing cgroups yard (cgroups restore mode 0x4)
(00.066925) cg: Opening .criu.cgyard.mKt7mE as cg yard
(00.068038) cg: 	Making controller dir .criu.cgyard.mKt7mE/pids (pids)
(00.069958) cg: Determined cgroup dir pids/user.slice/user-1000.slice already exist
(00.069977) cg: Skip restoring properties on cgroup dir pids/user.slice/user-1000.slice
(00.070018) cg: 	Making controller dir .criu.cgyard.mKt7mE/devices (devices)
(00.072719) cg: Determined cgroup dir devices/user.slice already exist
(00.072759) cg: Skip restoring properties on cgroup dir devices/user.slice
(00.072800) cg: 	Making controller dir .criu.cgyard.mKt7mE/memory (memory)
(00.072992) cg: Determined cgroup dir memory/user/ubuntu/0 already exist
(00.073004) cg: Skip restoring properties on cgroup dir memory/user/ubuntu/0
(00.073028) cg: 	Making controller dir .criu.cgyard.mKt7mE/cpuset (cpuset)
(00.073085) cg: Determined cgroup dir cpuset/ already exist
(00.073093) cg: Skip restoring properties on cgroup dir cpuset/
(00.073111) cg: 	Making controller dir .criu.cgyard.mKt7mE/hugetlb (hugetlb)
(00.073168) cg: Determined cgroup dir hugetlb/ already exist
(00.073175) cg: Skip restoring properties on cgroup dir hugetlb/
(00.073192) cg: 	Making controller dir .criu.cgyard.mKt7mE/net_cls,net_prio (net_cls,net_prio)
(00.073264) cg: Determined cgroup dir net_cls,net_prio/ already exist
(00.073272) cg: Skip restoring properties on cgroup dir net_cls,net_prio/
(00.073291) cg: 	Making controller dir .criu.cgyard.mKt7mE/cpu,cpuacct (cpu,cpuacct)
(00.073358) cg: Determined cgroup dir cpu,cpuacct/user.slice already exist
(00.073367) cg: Skip restoring properties on cgroup dir cpu,cpuacct/user.slice
(00.073385) cg: 	Making controller dir .criu.cgyard.mKt7mE/blkio (blkio)
(00.073655) cg: Determined cgroup dir blkio/user.slice already exist
(00.073669) cg: Skip restoring properties on cgroup dir blkio/user.slice
(00.073695) cg: 	Making controller dir .criu.cgyard.mKt7mE/freezer (freezer)
(00.073834) cg: Determined cgroup dir freezer/user/ubuntu/0 already exist
(00.073847) cg: Skip restoring properties on cgroup dir freezer/user/ubuntu/0
(00.073873) cg: 	Making controller dir .criu.cgyard.mKt7mE/perf_event (perf_event)
(00.074033) cg: Determined cgroup dir perf_event/ already exist
(00.074046) cg: Skip restoring properties on cgroup dir perf_event/
(00.074082) cg: 	Making controller dir .criu.cgyard.mKt7mE/systemd (none,name=systemd)
(00.074380) cg: Determined cgroup dir systemd/user.slice/user-1000.slice/session-5.scope already exist
(00.074392) cg: Skip restoring properties on cgroup dir systemd/user.slice/user-1000.slice/session-5.scope
(00.075537) Running pre-restore scripts
(00.076522) No mountpoints-6.img image
(00.076549) mnt: Reading mountpoint images (id 6 pid 23034)
(00.080322) Forking task with 23034 pid (flags 0x0)
(00.105193) PID: real 23034 virt 23034
(00.105370)  23034: cg: Move into 2
(00.105402)  23034: cg:   `-> blkio//user.slice/tasks
(00.119165)  23034: cg:   `-> cpu,cpuacct//user.slice/tasks
(00.119218)  23034: cg:   `-> cpuset///tasks
(00.119238)  23034: cg:   `-> devices//user.slice/tasks
(00.119287)  23034: cg:   `-> freezer//user/ubuntu/0/tasks
(00.119336)  23034: cg:   `-> hugetlb///tasks
(00.119355)  23034: cg:   `-> memory//user/ubuntu/0/tasks
(00.119398)  23034: cg:   `-> systemd//user.slice/user-1000.slice/session-5.scope/tasks
(00.119430)  23034: cg:   `-> net_cls,net_prio///tasks
(00.119457)  23034: cg:   `-> perf_event///tasks
(00.119476)  23034: cg:   `-> pids//user.slice/user-1000.slice/tasks
(00.119524)  23034: Calling restore_sid() for init
(00.119553)  23034: Collecting 41/37 (flags 2)
(00.124899)  23034: tty: Collected tty ID 0x4 (pts)
(00.125920)  23034:  `- ... done
(00.125945)  23034: Collecting 42/51 (flags 0)
(00.126898)  23034: No tty-data.img image
(00.126942)  23034:  `- ... done
(00.126949)  23034: Restoring namespaces 23034 flags 0x0
(00.126976)  23034: Preparing info about shared resources
(00.128008)  23034: No seccomp.img image
(00.128037)  23034: Collecting 45/38 (flags 0)
(00.129099)  23034: No filelocks.img image
(00.129127)  23034:  `- ... done
(00.129133)  23034: Collecting 39/27 (flags 0)
(00.130177)  23034: No pipes-data.img image
(00.130205)  23034:  `- ... done
(00.130212)  23034: Collecting 40/27 (flags 0)
(00.131208)  23034: No fifo-data.img image
(00.131237)  23034:  `- ... done
(00.131243)  23034: Collecting 38/64 (flags 0)
(00.132272)  23034: No sk-queues.img image
(00.132301)  23034:  `- ... done
(00.136131)  23034: Found 18 VMAs in image
(00.136162)  23034: vma 0x400000 0x401000
(00.136169)  23034: vma 0x600000 0x601000
(00.136175)  23034: vma 0x601000 0x602000
(00.136180)  23034: vma 0x13da000 0x13fb000
(00.136184)  23034: vma 0x7f9aa4173000 0x7f9aa4333000
(00.136190)  23034: vma 0x7f9aa4333000 0x7f9aa4533000
(00.136194)  23034: vma 0x7f9aa4533000 0x7f9aa4537000
(00.136199)  23034: vma 0x7f9aa4537000 0x7f9aa4539000
(00.136203)  23034: vma 0x7f9aa4539000 0x7f9aa453d000
(00.136208)  23034: vma 0x7f9aa453d000 0x7f9aa4563000
(00.136212)  23034: vma 0x7f9aa4753000 0x7f9aa4756000
(00.136217)  23034: vma 0x7f9aa4762000 0x7f9aa4763000
(00.136221)  23034: vma 0x7f9aa4763000 0x7f9aa4764000
(00.136225)  23034: vma 0x7f9aa4764000 0x7f9aa4765000
(00.136230)  23034: vma 0x7ffc24b64000 0x7ffc24b85000
(00.136234)  23034: vma 0x7ffc24be2000 0x7ffc24be4000
(00.136239)  23034: vma 0x7ffc24be4000 0x7ffc24be6000
(00.136243)  23034: vma 0xffffffffff600000 0xffffffffff601000
(00.139173)  23034: Collect fdinfo pid=23034 fd=0 id=0x4
(00.139206)  23034: Collect fdinfo pid=23034 fd=1 id=0x4
(00.139214)  23034: Collect fdinfo pid=23034 fd=2 id=0x4
(00.142954)  23034: Preparing SCMs
(00.142981)  23034: tty: Unpaired slave 1
(00.142989)  23034: tty: ctl tty leader 0x4
(00.142994)  23034: tty: Inherit terminal for id 0x4
(00.143011)  23034: tty: head driver pts id 0x4 index 1 (master 0 sid 14103 pgrp 23034 inherit 1)
(00.143079)  23034: tty: Found orphan slave fake leader (0x4)
(00.143087)  23034: File descs:
(00.143092)  23034:  `- type 1 ID 0x1
(00.143096)  23034:  `- type 1 ID 0x2
(00.143100)  23034:  `- type 1 ID 0x3
(00.143103)  23034:  `- type 11 ID 0x4
(00.143107)  23034:    `- FD 0 pid 23034
(00.143111)  23034:    `- FD 1 pid 23034
(00.143115)  23034:    `- FD 2 pid 23034
(00.143119)  23034:  `- type 1 ID 0x5
(00.143122)  23034:  `- type 1 ID 0x6
(00.143126)  23034:  `- type 1 ID 0x7
(00.156273)  23034: Opened local page read 1 (parent 0)
(00.159914)  23034: 	premap 0x00000000400000-0x00000000401000 -> 00007fedb484f000
(00.159946)  23034: 	premap 0x00000000600000-0x00000000601000 -> 00007fedb4850000
(00.159958)  23034: 	premap 0x00000000601000-0x00000000602000 -> 00007fedb4851000
(00.159967)  23034: 	premap 0x000000013da000-0x000000013fb000 -> 00007fedb4852000
(00.159997)  23034: 	premap 0x007f9aa4173000-0x007f9aa4333000 -> 00007fedb4873000
(00.160009)  23034: 	premap 0x007f9aa4333000-0x007f9aa4533000 -> 00007fedb4a33000
(00.160018)  23034: 	premap 0x007f9aa4533000-0x007f9aa4537000 -> 00007fedb4c33000
(00.160043)  23034: 	premap 0x007f9aa4537000-0x007f9aa4539000 -> 00007fedb4c37000
(00.160053)  23034: 	premap 0x007f9aa4539000-0x007f9aa453d000 -> 00007fedb4c39000
(00.160071)  23034: 	premap 0x007f9aa453d000-0x007f9aa4563000 -> 00007fedb4c3d000
(00.160080)  23034: 	premap 0x007f9aa4753000-0x007f9aa4756000 -> 00007fedb4c63000
(00.160090)  23034: 	premap 0x007f9aa4762000-0x007f9aa4763000 -> 00007fedb4c66000
(00.160099)  23034: 	premap 0x007f9aa4763000-0x007f9aa4764000 -> 00007fedb4c67000
(00.160108)  23034: 	premap 0x007f9aa4764000-0x007f9aa4765000 -> 00007fedb4c68000
(00.160115)  23034: 	premap 0x007ffc24b63000-0x007ffc24b85000 -> 00007fedb4c69000
(00.160123)  23034: 	premap 0x007ffc24be2000-0x007ffc24be4000 -> 00007fedb4c8b000
(00.160131)  23034: 	premap 0x007ffc24be4000-0x007ffc24be6000 -> 00007fedb4c8d000
(00.160137)  23034: pr23034-1 Read 400000 1 pages
(00.160145)  23034: pr23034-1 Read 600000 1 pages
(00.160149)  23034: pr23034-1 Read 601000 1 pages
(00.160154)  23034: Lazy restore skips 1 pages at 13da000
(00.160159)  23034: pr23034-1 Read 7f9aa4533000 4 pages
(00.160171)  23034: pr23034-1 Read 7f9aa4537000 2 pages
(00.160176)  23034: Lazy restore skips 1 pages at 7f9aa4539000
(00.160180)  23034: Lazy restore skips 1 pages at 7f9aa453c000
(00.160184)  23034: Lazy restore skips 3 pages at 7f9aa4753000
(00.160188)  23034: pr23034-1 Read 7f9aa4762000 1 pages
(00.160193)  23034: pr23034-1 Read 7f9aa4763000 1 pages
(00.160197)  23034: Lazy restore skips 1 pages at 7f9aa4764000
(00.160201)  23034: Lazy restore skips 3 pages at 7ffc24b82000
(00.160205)  23034: pr23034-1 Read 7ffc24be4000 2 pages
(00.160209)  23034: Read piov iovs 4, from 0, len 53248, first 0x7fedb484f000:12288
(00.164308)  23034: nr_restored_pages: 13
(00.164333)  23034: nr_shared_pages:   0
(00.164339)  23034: nr_droped_pages:   0
(00.164342)  23034: nr_lazy:           10
(00.164347)  23034: Restore on-core sigactions for 23034
(00.164398)  23034: Restoring children in alien sessions:
(00.164404)  23034: Restoring children in our session:
(00.164436)  23034: Restoring 23034 to 24278 pgid
(00.164450)  23034: Restoring resources
(00.164473)  23034: Opening fdinfo-s
(00.164481)  23034: tty: open driver pts id 0x4 index 1 (master 0 sid 14103 pgrp 23034 inherit 1)
(00.164511)  23034: tty: Migrated slave peer 0x4 -> to fd 0
(00.164568)  23034: tty: Restore inherited group 24278
(00.164581)  23034: 		Create fd for 0
(00.164586)  23034: 			Going to dup 0 into 1
(00.164591)  23034: 			Going to dup 0 into 2
(00.164596)  23034: 	Receive fd for 1
(00.164600)  23034: 	Receive fd for 2
(00.165725)  23034: uffd: Sending PID 23034
(00.165786)  23034: Restore via sigreturn
(00.165916)  23034: Parsed 400000-52d000 vma
(00.165926)  23034: Parsed 72c000-72d000 vma
(00.165930)  23034: Parsed 72c000-733000 vma
(00.165934)  23034: Parsed 72c000-744000 vma
(00.165939)  23034: Parsed 1417000-1438000 vma
(00.165943)  23034: Parsed 7fedb484f000-7fedb4850000 vma
(00.165948)  23034: Parsed 7fedb484f000-7fedb4852000 vma
(00.165952)  23034: Parsed 7fedb484f000-7fedb4873000 vma
(00.165956)  23034: Parsed 7fedb484f000-7fedb4a33000 vma
(00.165960)  23034: Parsed 7fedb484f000-7fedb4c33000 vma
(00.165964)  23034: Parsed 7fedb484f000-7fedb4c39000 vma
(00.165968)  23034: Parsed 7fedb484f000-7fedb4c3d000 vma
(00.165972)  23034: Parsed 7fedb484f000-7fedb4c63000 vma
(00.165976)  23034: Parsed 7fedb484f000-7fedb4c66000 vma
(00.165980)  23034: Parsed 7fedb484f000-7fedb4c68000 vma
(00.165984)  23034: Parsed 7fedb484f000-7fedb4c69000 vma
(00.165988)  23034: Parsed 7fedb4c6b000-7fedb4c8b000 vma
(00.165992)  23034: Parsed 7fedb4c6b000-7fedb4c8d000 vma
(00.165996)  23034: Parsed 7fedb4c6b000-7fedb4c8f000 vma
(00.166000)  23034: Parsed 7fedb4c6b000-7fedb4d97000 vma
(00.166004)  23034: Parsed 7fedb4c6b000-7fedb4f96000 vma
(00.166008)  23034: Parsed 7fedb4c6b000-7fedb4f97000 vma
(00.166012)  23034: Parsed 7fedb4c6b000-7fedb4f98000 vma
(00.166016)  23034: Parsed 7fedb4c6b000-7fedb5158000 vma
(00.166020)  23034: Parsed 7fedb4c6b000-7fedb5358000 vma
(00.166024)  23034: Parsed 7fedb4c6b000-7fedb535c000 vma
(00.166039)  23034: Parsed 7fedb4c6b000-7fedb535e000 vma
(00.166044)  23034: Parsed 7fedb4c6b000-7fedb5362000 vma
(00.166056)  23034: Parsed 7fedb4c6b000-7fedb5378000 vma
(00.166060)  23034: Parsed 7fedb4c6b000-7fedb5577000 vma
(00.166064)  23034: Parsed 7fedb4c6b000-7fedb5578000 vma
(00.166068)  23034: Parsed 7fedb4c6b000-7fedb5579000 vma
(00.166072)  23034: Parsed 7fedb4c6b000-7fedb557b000 vma
(00.166076)  23034: Parsed 7fedb4c6b000-7fedb5598000 vma
(00.166080)  23034: Parsed 7fedb4c6b000-7fedb5797000 vma
(00.166084)  23034: Parsed 7fedb4c6b000-7fedb5799000 vma
(00.166088)  23034: Parsed 7fedb4c6b000-7fedb579a000 vma
(00.166092)  23034: Parsed 7fedb4c6b000-7fedb579d000 vma
(00.166096)  23034: Parsed 7fedb4c6b000-7fedb599c000 vma
(00.166099)  23034: Parsed 7fedb4c6b000-7fedb599d000 vma
(00.166103)  23034: Parsed 7fedb4c6b000-7fedb599e000 vma
(00.166107)  23034: Parsed 7fedb4c6b000-7fedb59a6000 vma
(00.166111)  23034: Parsed 7fedb4c6b000-7fedb5ba5000 vma
(00.166151)  23034: Parsed 7fedb4c6b000-7fedb5ba6000 vma
(00.166156)  23034: Parsed 7fedb4c6b000-7fedb5ba7000 vma
(00.166160)  23034: Parsed 7fedb4c6b000-7fedb5bbf000 vma
(00.166164)  23034: Parsed 7fedb4c6b000-7fedb5dbe000 vma
(00.166168)  23034: Parsed 7fedb4c6b000-7fedb5dbf000 vma
(00.166176)  23034: Parsed 7fedb4c6b000-7fedb5dc0000 vma
(00.166181)  23034: Parsed 7fedb4c6b000-7fedb5dc4000 vma
(00.166189)  23034: Parsed 7fedb4c6b000-7fedb5dea000 vma
(00.166194)  23034: Parsed 7fedb5fbf000-7fedb5fc9000 vma
(00.166198)  23034: Parsed 7fedb5fbf000-7fedb5fdf000 vma
(00.166202)  23034: Parsed 7fedb5fe2000-7fedb5fe5000 vma
(00.166206)  23034: Parsed 7fedb5fe2000-7fedb5fe7000 vma
(00.166210)  23034: Parsed 7fedb5fe2000-7fedb5fe9000 vma
(00.166214)  23034: Parsed 7fedb5fe2000-7fedb5fea000 vma
(00.166218)  23034: Parsed 7fedb5fe2000-7fedb5feb000 vma
(00.166222)  23034: Parsed 7fedb5fe2000-7fedb5fec000 vma
(00.166226)  23034: Parsed 7ffd44d6c000-7ffd44d8d000 vma
(00.166230)  23034: Parsed 7ffd44d90000-7ffd44d92000 vma
(00.166234)  23034: Parsed 7ffd44d90000-7ffd44d94000 vma
(00.166238)  23034: Parsed ffffffffff600000-ffffffffff601000 vma
(00.166249)  23034: 1 threads require 96K of memory
(00.166255)  23034: Found bootstrap VMA hint at: 0x10000 (needs ~112K)
(00.166326)  23034: 	call mremap(0x7fedb5fe2000, 8192, 8192, MAYMOVE | FIXED, 0x24000)
(00.166352)  23034: 	call mremap(0x7fedb5fe5000, 8192, 8192, MAYMOVE | FIXED, 0x26000)
(00.166381)  23034: xsave runtime structure
(00.166388)  23034: -----------------------
(00.166391)  23034: cwd:37f swd:0 twd:0 fop:0 mxcsr:1f80 mxcsr_mask:ffff
(00.166396)  23034: magic1:46505853 extended_size:344 xstate_bv:7 xstate_size:340
(00.166400)  23034: xstate_bv: 7
(00.166404)  23034: -----------------------
(00.166407)  23034: Thread    0 stack  0x1a080 rt_sigframe  0x22080
(00.167808)  23034: Going to chroot into /proc/self/fd/8
(00.167845)  23034: Restoring umask to 2
(00.167866)  23034: task_args: 0x23000
task_args->pid: 23034
task_args->nr_threads: 1
task_args->clone_restore_fn: 0x11240
task_args->thread_args: 0x23600
(00.167876)pie: 23034: Switched to the restorer 23034
(00.167882)pie: 23034: lazy-pages: uffd 6
(00.167885)pie: 23034: vdso: Remap rt-vdso 0x7ffd44d92000 -> 0x2a000
(00.167902)pie: 23034: vdso: Remap rt-vvar 0x7ffd44d90000 -> 0x28000
(00.168069)pie: 23034: Remap 0x7fedb484f000->0x400000 len 0x1000
(00.168087)pie: 23034: Remap 0x7fedb4850000->0x600000 len 0x1000
(00.168102)pie: 23034: Remap 0x7fedb4851000->0x601000 len 0x1000
(00.168113)pie: 23034: Remap 0x7fedb4852000->0x13da000 len 0x21000
(00.168130)pie: 23034: lazy-pages: register: 0x13da000, len 0x21000
(00.168137)pie: 23034: Remap 0x7fedb4873000->0x7f9aa4173000 len 0x1c0000
(00.168154)pie: 23034: Remap 0x7fedb4a33000->0x7f9aa4333000 len 0x200000
(00.168165)pie: 23034: Remap 0x7fedb4c33000->0x7f9aa4533000 len 0x4000
(00.168177)pie: 23034: Remap 0x7fedb4c37000->0x7f9aa4537000 len 0x2000
(00.168187)pie: 23034: Remap 0x7fedb4c39000->0x7f9aa4539000 len 0x4000
(00.168197)pie: 23034: lazy-pages: register: 0x7f9aa4539000, len 0x4000
(00.168202)pie: 23034: Remap 0x7fedb4c3d000->0x7f9aa453d000 len 0x26000
(00.168223)pie: 23034: Remap 0x7fedb4c63000->0x7f9aa4753000 len 0x3000
(00.168234)pie: 23034: lazy-pages: register: 0x7f9aa4753000, len 0x3000
(00.168240)pie: 23034: Remap 0x7fedb4c66000->0x7f9aa4762000 len 0x1000
(00.168252)pie: 23034: Remap 0x7fedb4c67000->0x7f9aa4763000 len 0x1000
(00.168262)pie: 23034: Remap 0x7fedb4c68000->0x7f9aa4764000 len 0x1000
(00.168271)pie: 23034: lazy-pages: register: 0x7f9aa4764000, len 0x1000
(00.168276)pie: 23034: Remap 0x7fedb4c8d000->0x7ffc24be4000 len 0x2000
(00.168287)pie: 23034: Remap 0x7fedb4c8b000->0x7ffc24be2000 len 0x2000
(00.168296)pie: 23034: lazy-pages: register: 0x7ffc24be2000, len 0x2000
(00.168301)pie: 23034: Remap 0x7fedb4c6a000->0x7ffc24b64000 len 0x21000
(00.168318)pie: 23034: lazy-pages: register: 0x7ffc24b64000, len 0x21000
(00.168323)pie: 23034: lazy-pages: closing uffd 6
(00.168333)pie: 23034: vdso: Parsing at 0x7ffc24be4000 0x7ffc24be6000
(00.168337)pie: 23034: Error (criu/pie/util-vdso.c:97): vdso: ELF header magi>
(00.168337)pie: 23034: c mismatch
(00.168365)pie: 23034: Error (criu/pie/restorer.c:1765): Restorer fail 23034
>
(00.183257) Error (criu/namespaces.c:1604): Spurious pid ns helper: pid=23034
(00.183289) Error (criu/cr-restore.c:1578): 23034 exited, status=1
(00.184351) Error (criu/cr-restore.c:2494): Restoring FAILED.