[CRIU] Fw: Restore Error in Cgroup Systemd

Andrew Vagin avagin at gmail.com
Thu Jul 23 02:41:23 PDT 2015


On Thu, Jul 23, 2015 at 06:46:34AM +0000, Z F wrote:
> 
>  
> Hi,

Hi,

>  
> I am trying migrating a simple shell job between hosts and failed in restore
> as:
>  
> (00.042759)  38289: Error (cgroup.c:908): cg: Can't move into systemd//
> user.slice/user-0.slice/session-741.scope/tasks (-1/-1): No such file or
> directory
> (00.043022) Error (cr-restore.c:1193): 38289 exited, status=1
> (00.044078) Error (cr-restore.c:1867): Restoring FAILED.
>  
> The environments:
> [root at compute1 criu-br-1.5-stable]# uname -a
> Linux compute1 3.12.44 #1 SMP Mon Jul 20 09:16:11 CST 2015 x86_64 x86_64 x86_64
> GNU/Linux
> [root at compute1 criu-br-1.5-stable]# ./criu -V
> Version: 1.5.2
> [root at compute1 criu-br-1.5-stable]# ./criu restore --images-dir /mnt/nfs/home/
> zf/criutest/dumps/ --shell-job -v4 
> 
> Restore log attached.

Hi,

I met the same problem a few days ago. Currently I'm thinking how to fix
this issue.

As a workaround, You can try to change root_cg_set in inventory.img:
./crit decode -i inventory.img  | sed 's/"root_cg_set": 1/"root_cg_set": 2/' | ./crit encode > inventory.img

Thanks,
Andrew

> 
>  
>  
> The cause is that for each session in the system a directory created as /sys/fs
> /cgroup/system/user.slice/user-x.slice/session-y.scope/. While the source and
> destination have different sessions.
>  
> Would you please help to solve the problem? Thank you very much.
>  
> Best Regards
> Zhang Fan
> 
> 
> (00.001610) TCP recv queue memory limit is 3145728
> (00.001684) cpu: fpu:1 fxsr:1 xsave:1
> (00.001825) vdso: Parsing at 7fff5abc1000 7fff5abc3000
> (00.001829) vdso: PT_LOAD p_vaddr: ffffffffff700000
> (00.001831) vdso: DT_HASH: 0xffffffffff700120
> (00.001832) vdso: DT_STRTAB: 0xffffffffff700268
> (00.001833) vdso: DT_SYMTAB: 0xffffffffff700160
> (00.001834) vdso: DT_STRSZ: 94
> (00.001835) vdso: DT_SYMENT: 24
> (00.001836) vdso: nbucket 3 nchain 11 bucket 0x7fff5abc1128 chain 0x7fff5abc1134
> (00.001840) vdso: rt [vdso] 7fff5abc1000-7fff5abc3000 [vvar] ffffffffffffffff-ffffffffffffffff
> (00.001874) Reading image tree
> (00.003912) Add mnt ns 5 pid 38289
> (00.003923) Migrating process tree (GID 38289->38799 SID 21867->38650)
> (00.003927) Will restore in 0 namespaces
> (00.003928) NS mask to use 0
> (00.003933) Collecting 36/21 (flags 0)
> (00.005009)  `- ... done
> (00.005846) cg: Preparing cgroups yard
> (00.006992) cg: Opening .criu.cgyard.RlA64B as cg yard
> (00.007496) cg:         Making subdir .criu.cgyard.RlA64B/cpuset (cpuset)
> (00.007602) cg:         Making subdir .criu.cgyard.RlA64B/cpu,cpuacct (cpu,cpuacct)
> (00.007639) cg:         Making subdir .criu.cgyard.RlA64B/memory (memory)
> (00.007671) cg:         Making subdir .criu.cgyard.RlA64B/devices (devices)
> (00.007704) cg:         Making subdir .criu.cgyard.RlA64B/freezer (freezer)
> (00.007740) cg:         Making subdir .criu.cgyard.RlA64B/net_cls (net_cls)
> (00.007770) cg:         Making subdir .criu.cgyard.RlA64B/blkio (blkio)
> (00.007816) cg:         Making subdir .criu.cgyard.RlA64B/perf_event (perf_event)
> (00.007850) cg:         Making subdir .criu.cgyard.RlA64B/hugetlb (hugetlb)
> (00.007892) cg:         Making subdir .criu.cgyard.RlA64B/systemd (none,name=systemd)
> (00.007934) cg:         Making subdir .criu.cgyard.RlA64B/zdtmtst (none,name=zdtmtst)
> (00.008079) cg:         Making subdir .criu.cgyard.RlA64B/zdtmtst.defaultroot (none,name=zdtmtst.defaultroot)
> (00.008965) Forking task with 38289 pid (flags 0x0)
> (00.009044) Wait until namespaces are created
> (00.009180) Running setup-namespaces scripts
> (00.009211)  38289: Restoring namespaces 38289 flags 0x0
> (00.009246)  38289: Add mnt ns 0 pid 38289
> (00.009387)  38289:     type proc source proc mnt_id 0x11 s_dev 0x4 / @ ./proc flags 0x30000e options 
> (00.009402)  38289:     type sysfs source sysfs mnt_id 0x12 s_dev 0x11 / @ ./sys flags 0x30000e options seclabel
> (00.009410)  38289:     type devtmpfs source devtmpfs mnt_id 0x13 s_dev 0x6 / @ ./dev flags 0x100002 options seclabel,size=16437952k,nr_inodes=4109488,mode=755
> (00.009418)  38289:     type securityfs source securityfs mnt_id 0x14 s_dev 0x10 / @ ./sys/kernel/security flags 0x30000e options 
> (00.009425)  38289:     type tmpfs source tmpfs mnt_id 0x15 s_dev 0x12 / @ ./dev/shm flags 0x100006 options seclabel
> (00.009431)  38289:     type devpts source devpts mnt_id 0x16 s_dev 0xc / @ ./dev/pts flags 0x30000a options seclabel,gid=5,mode=620,ptmxmode=000
> (00.009554)  38289:     type tmpfs source tmpfs mnt_id 0x17 s_dev 0x13 / @ ./run flags 0x100006 options seclabel,mode=755
> (00.009561)  38289:     type tmpfs source tmpfs mnt_id 0x18 s_dev 0x14 / @ ./sys/fs/cgroup flags 0x10000e options seclabel,mode=755
> (00.009569)  38289:     type cgroup source cgroup mnt_id 0x19 s_dev 0x15 / @ ./sys/fs/cgroup/systemd flags 0x30000e options xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd
> (00.009575)  38289:     type pstore source pstore mnt_id 0x1a s_dev 0x16 / @ ./sys/fs/pstore flags 0x30000e options 
> (00.009603)  38289:     type cgroup source cgroup mnt_id 0x1b s_dev 0x17 / @ ./sys/fs/cgroup/cpuset flags 0x30000e options cpuset
> (00.009609)  38289:     type cgroup source cgroup mnt_id 0x1c s_dev 0x18 / @ ./sys/fs/cgroup/cpu,cpuacct flags 0x30000e options cpuacct,cpu
> (00.009615)  38289:     type cgroup source cgroup mnt_id 0x1d s_dev 0x19 / @ ./sys/fs/cgroup/memory flags 0x30000e options memory
> (00.009620)  38289:     type cgroup source cgroup mnt_id 0x1e s_dev 0x1a / @ ./sys/fs/cgroup/devices flags 0x30000e options devices
> (00.009626)  38289:     type cgroup source cgroup mnt_id 0x1f s_dev 0x1b / @ ./sys/fs/cgroup/freezer flags 0x30000e options freezer
> (00.009631)  38289:     type cgroup source cgroup mnt_id 0x20 s_dev 0x1c / @ ./sys/fs/cgroup/net_cls flags 0x30000e options net_cls
> (00.009636)  38289:     type cgroup source cgroup mnt_id 0x21 s_dev 0x1d / @ ./sys/fs/cgroup/blkio flags 0x30000e options blkio
> (00.009643)  38289:     type cgroup source cgroup mnt_id 0x22 s_dev 0x1e / @ ./sys/fs/cgroup/perf_event flags 0x30000e options perf_event
> (00.009648)  38289:     type cgroup source cgroup mnt_id 0x23 s_dev 0x1f / @ ./sys/fs/cgroup/hugetlb flags 0x30000e options hugetlb
> (00.009653)  38289:     type configfs source configfs mnt_id 0x24 s_dev 0x20 / @ ./sys/kernel/config flags 0x300000 options 
> (00.009684)  38289:     type ext4 source /dev/sda1 mnt_id 0x25 s_dev 0x800001 / @ ./ flags 0x300000 options seclabel,stripe=64,data=ordered
> (00.009689)  38289:     type selinuxfs source selinuxfs mnt_id 0x26 s_dev 0xf / @ ./sys/fs/selinux flags 0x300000 options 
> (00.009696)  38289:     type autofs source systemd-1 mnt_id 0x27 s_dev 0x21 / @ ./proc/sys/fs/binfmt_misc flags 0x300000 options fd=34,pgrp=1,timeout=300,minproto=5,maxproto=5,direct
> (00.009701)  38289:     type debugfs source debugfs mnt_id 0x28 s_dev 0x8 / @ ./sys/kernel/debug flags 0x300000 options 
> (00.009708)  38289:     type mqueue source mqueue mnt_id 0x29 s_dev 0xe / @ ./dev/mqueue flags 0x300000 options seclabel
> (00.009713)  38289:     type hugetlbfs source hugetlbfs mnt_id 0x2a s_dev 0x22 / @ ./dev/hugepages flags 0x300000 options seclabel
> (00.009719)  38289:     type ext4 source /dev/sdb1 mnt_id 0x2b s_dev 0x800011 / @ ./boot flags 0x300000 options seclabel,data=ordered
> (00.009727)  38289:     type nfs source 192.168.1.5:/mnt/n1 mnt_id 0x69 s_dev 0x23 / @ ./mnt/nfs flags 0x300000 options vers=3,rsize=32768,wsize=32768,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,mountaddr=192.168.1.5,mountvers=3,mountport=691,mountproto=udp,local_lock=none,addr=192.168.1.5
> (00.009734)  38289:     type tmpfs source none mnt_id 0x6b s_dev 0x24 / @ ./mnt/nfs/home/zf/criutest/dumps/.criu.cgyard.RlA64B flags 0x200000 options seclabel
> (00.009753)  38289:     type cgroup source none mnt_id 0x6f s_dev 0x17 / @ ./mnt/nfs/home/zf/criutest/dumps/.criu.cgyard.RlA64B/cpuset flags 0x200000 options cpuset
> (00.009759)  38289:     type cgroup source none mnt_id 0x70 s_dev 0x18 / @ ./mnt/nfs/home/zf/criutest/dumps/.criu.cgyard.RlA64B/cpu,cpuacct flags 0x200000 options cpuacct,cpu
> (00.009765)  38289:     type cgroup source none mnt_id 0x71 s_dev 0x19 / @ ./mnt/nfs/home/zf/criutest/dumps/.criu.cgyard.RlA64B/memory flags 0x200000 options memory
> (00.009772)  38289:     type cgroup source none mnt_id 0x72 s_dev 0x1a / @ ./mnt/nfs/home/zf/criutest/dumps/.criu.cgyard.RlA64B/devices flags 0x200000 options devices
> (00.009778)  38289:     type cgroup source none mnt_id 0x73 s_dev 0x1b / @ ./mnt/nfs/home/zf/criutest/dumps/.criu.cgyard.RlA64B/freezer flags 0x200000 options freezer
> (00.009783)  38289:     type cgroup source none mnt_id 0x74 s_dev 0x1c / @ ./mnt/nfs/home/zf/criutest/dumps/.criu.cgyard.RlA64B/net_cls flags 0x200000 options net_cls
> (00.009797)  38289:     type cgroup source none mnt_id 0x75 s_dev 0x1d / @ ./mnt/nfs/home/zf/criutest/dumps/.criu.cgyard.RlA64B/blkio flags 0x200000 options blkio
> (00.009804)  38289:     type cgroup source none mnt_id 0x76 s_dev 0x1e / @ ./mnt/nfs/home/zf/criutest/dumps/.criu.cgyard.RlA64B/perf_event flags 0x200000 options perf_event
> (00.009813)  38289:     type cgroup source none mnt_id 0x77 s_dev 0x1f / @ ./mnt/nfs/home/zf/criutest/dumps/.criu.cgyard.RlA64B/hugetlb flags 0x200000 options hugetlb
> (00.009825)  38289:     type cgroup source none mnt_id 0x78 s_dev 0x15 / @ ./mnt/nfs/home/zf/criutest/dumps/.criu.cgyard.RlA64B/systemd flags 0x200000 options xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd
> (00.009831)  38289:     type cgroup source none mnt_id 0x79 s_dev 0x25 / @ ./mnt/nfs/home/zf/criutest/dumps/.criu.cgyard.RlA64B/zdtmtst flags 0x200000 options name=zdtmtst
> (00.009838)  38289:     type cgroup source none mnt_id 0x7a s_dev 0x26 / @ ./mnt/nfs/home/zf/criutest/dumps/.criu.cgyard.RlA64B/zdtmtst.defaultroot flags 0x200000 options name=zdtmtst.defaultroot
> (00.009849)  38289: Building mountpoints tree
> (00.009851)  38289:     Building plain mount tree
> (00.009853)  38289:             Working on 122->107
> (00.009854)  38289:             Working on 121->107
> (00.009856)  38289:             Working on 120->107
> (00.009857)  38289:             Working on 119->107
> (00.009859)  38289:             Working on 118->107
> (00.009860)  38289:             Working on 117->107
> (00.009862)  38289:             Working on 116->107
> (00.009863)  38289:             Working on 115->107
> (00.009865)  38289:             Working on 114->107
> (00.009875)  38289:             Working on 113->107
> (00.009876)  38289:             Working on 112->107
> (00.009878)  38289:             Working on 111->107
> (00.009879)  38289:             Working on 107->105
> (00.009881)  38289:             Working on 105->37
> (00.009882)  38289:             Working on 43->37
> (00.009884)  38289:             Working on 42->19
> (00.009886)  38289:             Working on 41->19
> (00.009887)  38289:             Working on 40->18
> (00.009889)  38289:             Working on 39->17
> (00.009890)  38289:             Working on 38->18
> (00.009892)  38289:             Working on 37->1
> (00.009893)  38289:             Working on 36->18
> (00.009895)  38289:             Working on 35->24
> (00.009896)  38289:             Working on 34->24
> (00.009898)  38289:             Working on 33->24
> (00.009899)  38289:             Working on 32->24
> (00.009901)  38289:             Working on 31->24
> (00.009902)  38289:             Working on 30->24
> (00.009904)  38289:             Working on 29->24
> (00.009905)  38289:             Working on 28->24
> (00.009907)  38289:             Working on 27->24
> (00.009909)  38289:             Working on 26->18
> (00.009910)  38289:             Working on 25->24
> (00.009911)  38289:             Working on 24->18
> (00.009913)  38289:             Working on 23->37
> (00.009914)  38289:             Working on 22->19
> (00.009916)  38289:             Working on 21->19
> (00.009917)  38289:             Working on 20->18
> (00.009919)  38289:             Working on 19->37
> (00.009920)  38289:             Working on 18->37
> (00.009921)  38289:             Working on 17->37
> (00.009924)  38289:     Resorting siblings on 37
> (00.009926)  38289:     Resorting siblings on 105
> (00.009927)  38289:     Resorting siblings on 107
> (00.009929)  38289:     Resorting siblings on 122
> (00.009930)  38289:     Resorting siblings on 121
> (00.009932)  38289:     Resorting siblings on 120
> (00.009933)  38289:     Resorting siblings on 119
> (00.009935)  38289:     Resorting siblings on 118
> (00.009936)  38289:     Resorting siblings on 117
> (00.009938)  38289:     Resorting siblings on 116
> (00.009939)  38289:     Resorting siblings on 115
> (00.009941)  38289:     Resorting siblings on 114
> (00.009942)  38289:     Resorting siblings on 113
> (00.009943)  38289:     Resorting siblings on 112
> (00.009945)  38289:     Resorting siblings on 111
> (00.009946)  38289:     Resorting siblings on 43
> (00.009948)  38289:     Resorting siblings on 23
> (00.009949)  38289:     Resorting siblings on 19
> (00.009951)  38289:     Resorting siblings on 42
> (00.009952)  38289:     Resorting siblings on 41
> (00.009953)  38289:     Resorting siblings on 22
> (00.009955)  38289:     Resorting siblings on 21
> (00.009956)  38289:     Resorting siblings on 18
> (00.009958)  38289:     Resorting siblings on 40
> (00.009959)  38289:     Resorting siblings on 38
> (00.009960)  38289:     Resorting siblings on 36
> (00.009962)  38289:     Resorting siblings on 26
> (00.009963)  38289:     Resorting siblings on 24
> (00.009964)  38289:     Resorting siblings on 35
> (00.009966)  38289:     Resorting siblings on 34
> (00.009967)  38289:     Resorting siblings on 33
> (00.009969)  38289:     Resorting siblings on 32
> (00.009970)  38289:     Resorting siblings on 31
> (00.009971)  38289:     Resorting siblings on 30
> (00.009972)  38289:     Resorting siblings on 29
> (00.009974)  38289:     Resorting siblings on 28
> (00.009975)  38289:     Resorting siblings on 27
> (00.009976)  38289:     Resorting siblings on 25
> (00.009977)  38289:     Resorting siblings on 20
> (00.009979)  38289:     Resorting siblings on 17
> (00.009980)  38289:     Resorting siblings on 39
> (00.009981)  38289: Done:
> (00.009982)  38289: [./](37->1)
> (00.009984)  38289:  [./boot](43->37)
> (00.009986)  38289:  <--
> (00.009987)  38289:  [./proc](17->37)
> (00.009988)  38289:   [./proc/sys/fs/binfmt_misc](39->17)
> (00.009989)  38289:   <--
> (00.009990)  38289:  <--
> (00.009991)  38289:  [./sys](18->37)
> (00.009993)  38289:   [./sys/kernel/debug](40->18)
> (00.009994)  38289:   <--
> (00.009995)  38289:   [./sys/kernel/security](20->18)
> (00.009996)  38289:   <--
> (00.009997)  38289:   [./sys/fs/cgroup](24->18)
> (00.009999)  38289:    [./sys/fs/cgroup/hugetlb](35->24)
> (00.010000)  38289:    <--
> (00.010001)  38289:    [./sys/fs/cgroup/systemd](25->24)
> (00.010002)  38289:    <--
> (00.010003)  38289:    [./sys/fs/cgroup/cpuset](27->24)
> (00.010004)  38289:    <--
> (00.010005)  38289:    [./sys/fs/cgroup/cpu,cpuacct](28->24)
> (00.010007)  38289:    <--
> (00.010008)  38289:    [./sys/fs/cgroup/memory](29->24)
> (00.010009)  38289:    <--
> (00.010010)  38289:    [./sys/fs/cgroup/devices](30->24)
> (00.010011)  38289:    <--
> (00.010012)  38289:    [./sys/fs/cgroup/freezer](31->24)
> (00.010013)  38289:    <--
> (00.010014)  38289:    [./sys/fs/cgroup/net_cls](32->24)
> (00.010016)  38289:    <--
> (00.010017)  38289:    [./sys/fs/cgroup/blkio](33->24)
> (00.010018)  38289:    <--
> (00.010020)  38289:    [./sys/fs/cgroup/perf_event](34->24)
> (00.010021)  38289:    <--
> (00.010022)  38289:   <--
> (00.010023)  38289:   [./sys/fs/pstore](26->18)
> (00.010025)  38289:   <--
> (00.010026)  38289:   [./sys/kernel/config](36->18)
> (00.010027)  38289:   <--
> (00.010028)  38289:   [./sys/fs/selinux](38->18)
> (00.010029)  38289:   <--
> (00.010030)  38289:  <--
> (00.010032)  38289:  [./dev](19->37)
> (00.010033)  38289:   [./dev/hugepages](42->19)
> (00.010034)  38289:   <--
> (00.010035)  38289:   [./dev/shm](21->19)
> (00.010037)  38289:   <--
> (00.010038)  38289:   [./dev/pts](22->19)
> (00.010039)  38289:   <--
> (00.010040)  38289:   [./dev/mqueue](41->19)
> (00.010041)  38289:   <--
> (00.010042)  38289:  <--
> (00.010044)  38289:  [./run](23->37)
> (00.010045)  38289:  <--
> (00.010046)  38289:  [./mnt/nfs](105->37)
> (00.010047)  38289:   [./mnt/nfs/home/zf/criutest/dumps/.criu.cgyard.RlA64B](107->105)
> (00.010049)  38289:    [./mnt/nfs/home/zf/criutest/dumps/.criu.cgyard.RlA64B/zdtmtst.defaultroot](122->107)
> (00.010051)  38289:    <--
> (00.010052)  38289:    [./mnt/nfs/home/zf/criutest/dumps/.criu.cgyard.RlA64B/cpuset](111->107)
> (00.010053)  38289:    <--
> (00.010054)  38289:    [./mnt/nfs/home/zf/criutest/dumps/.criu.cgyard.RlA64B/cpu,cpuacct](112->107)
> (00.010056)  38289:    <--
> (00.010057)  38289:    [./mnt/nfs/home/zf/criutest/dumps/.criu.cgyard.RlA64B/memory](113->107)
> (00.010059)  38289:    <--
> (00.010060)  38289:    [./mnt/nfs/home/zf/criutest/dumps/.criu.cgyard.RlA64B/devices](114->107)
> (00.010061)  38289:    <--
> (00.010063)  38289:    [./mnt/nfs/home/zf/criutest/dumps/.criu.cgyard.RlA64B/freezer](115->107)
> (00.010064)  38289:    <--
> (00.010065)  38289:    [./mnt/nfs/home/zf/criutest/dumps/.criu.cgyard.RlA64B/net_cls](116->107)
> (00.010066)  38289:    <--
> (00.010067)  38289:    [./mnt/nfs/home/zf/criutest/dumps/.criu.cgyard.RlA64B/blkio](117->107)
> (00.010069)  38289:    <--
> (00.010070)  38289:    [./mnt/nfs/home/zf/criutest/dumps/.criu.cgyard.RlA64B/perf_event](118->107)
> (00.010071)  38289:    <--
> (00.010072)  38289:    [./mnt/nfs/home/zf/criutest/dumps/.criu.cgyard.RlA64B/hugetlb](119->107)
> (00.010074)  38289:    <--
> (00.010075)  38289:    [./mnt/nfs/home/zf/criutest/dumps/.criu.cgyard.RlA64B/systemd](120->107)
> (00.010076)  38289:    <--
> (00.010077)  38289:    [./mnt/nfs/home/zf/criutest/dumps/.criu.cgyard.RlA64B/zdtmtst](121->107)
> (00.010079)  38289:    <--
> (00.010080)  38289:   <--
> (00.010081)  38289:  <--
> (00.010082)  38289: <--
> (00.010700)  38289: Mount procfs in crtools-proc.CPAW4K
> (00.012696)  38289: Preparing info about shared resources
> (00.012708)  38289: Collecting 33/18 (flags 0)
> (00.013492)  38289: Collected [dev/pts/5] ID 0x1
> (00.013500)  38289: Collected [mnt/nfs/home/zf/criutest/a.out] ID 0x2
> (00.013503)  38289: Collected [usr/lib64/libpthread-2.17.so] ID 0x3
> (00.013505)  38289: Collected [usr/lib64/libc-2.17.so] ID 0x4
> (00.013507)  38289: Collected [usr/lib64/libgcc_s-4.8.3-20140911.so.1] ID 0x5
> (00.013510)  38289: Collected [usr/lib64/libm-2.17.so] ID 0x6
> (00.013512)  38289: Collected [usr/lib64/libstdc++.so.6.0.19] ID 0x7
> (00.013514)  38289: Collected [usr/lib64/librt-2.17.so] ID 0x8
> (00.013516)  38289: Collected [usr/lib64/ld-2.17.so] ID 0x9
> (00.013518)  38289: Collected [mnt/nfs/home/zf/criutest] ID 0xa
> (00.013520)  38289: Collected [.] ID 0xb
> (00.013525)  38289:  `- ... done
> (00.013526)  38289: Collecting 46/52 (flags 0)
> (00.014358)  38289:  `- ... done
> (00.014363)  38289: Collecting 35/20 (flags 2)
> (00.015143)  38289:  `- ... done
> (00.015147)  38289: Collecting 40/25 (flags 0)
> (00.015710)  38289:  `- ... done
> (00.015714)  38289: Collecting 42/26 (flags 0)
> (00.016778)  38289:  `- ... done
> (00.016782)  38289: Collecting 37/22 (flags 1)
> (00.017860)  38289:  `- ... done
> (00.017864)  38289: Collecting 38/23 (flags 2)
> (00.018481)  38289:  `- ... done
> (00.018496)  38289: Collecting 39/24 (flags 2)
> (00.019380)  38289:  `- ... done
> (00.019384)  38289: Collecting 47/28 (flags 0)
> (00.020189)  38289:  `- ... done
> (00.020194)  38289: Collecting 73/30 (flags 2)
> (00.021047)  38289:  `- ... done
> (00.021051)  38289: Collecting 48/29 (flags 0)
> (00.021840)  38289:  `- ... done
> (00.021843)  38289: Collecting 49/31 (flags 2)
> (00.022925)  38289:  `- ... done
> (00.022929)  38289: Collecting 50/32 (flags 2)
> (00.023737)  38289:  `- ... done
> (00.023753)  38289: Collecting 71/33 (flags 2)
> (00.024565)  38289:  `- ... done
> (00.024568)  38289: Collecting 51/34 (flags 2)
> (00.025253)  38289:  `- ... done
> (00.025256)  38289: Collecting 72/35 (flags 2)
> (00.026081)  38289:  `- ... done
> (00.026085)  38289: Collecting 45/37 (flags 2)
> (00.026871)  38289:  `- ... done
> (00.026874)  38289: Collecting 44/36 (flags 2)
> (00.027967)  38289: tty: Collected tty ID 0x1
> (00.027994)  38289:  `- ... done
> (00.027996)  38289: Collecting 52/42 (flags 2)
> (00.029081)  38289:  `- ... done
> (00.029084)  38289: Collecting 34/19 (flags 0)
> (00.030142)  38289:  `- ... done
> (00.030146)  38289: Collecting 54/45 (flags 2)
> (00.031162)  38289:  `- ... done
> (00.031166)  38289: Collecting 55/38 (flags 2)
> (00.031722)  38289:  `- ... done
> (00.033616)  38289: Trying to read socket queues image
> (00.034717)  38289: tty: Unpaired slave 5
> (00.035846)  38289: Found 39 VMAs in image
> (00.035851)  38289: vma 0x400000 0x401000
> (00.035853)  38289: vma 0x600000 0x601000
> (00.035854)  38289: vma 0x601000 0x602000
> (00.035855)  38289: vma 0x7f884ab3b000 0x7f884ab51000
> (00.035856)  38289: vma 0x7f884ab51000 0x7f884ad51000
> (00.035858)  38289: vma 0x7f884ad51000 0x7f884ad52000
> (00.035859)  38289: vma 0x7f884ad52000 0x7f884ad53000
> (00.035860)  38289: vma 0x7f884ad53000 0x7f884ad57000
> (00.035862)  38289: vma 0x7f884ad57000 0x7f884af0d000
> (00.035863)  38289: vma 0x7f884af0d000 0x7f884b10d000
> (00.035864)  38289: vma 0x7f884b10d000 0x7f884b111000
> (00.035866)  38289: vma 0x7f884b111000 0x7f884b113000
> (00.035867)  38289: vma 0x7f884b113000 0x7f884b118000
> (00.035868)  38289: vma 0x7f884b118000 0x7f884b12d000
> (00.035870)  38289: vma 0x7f884b12d000 0x7f884b32c000
> (00.035871)  38289: vma 0x7f884b32c000 0x7f884b32d000
> (00.035872)  38289: vma 0x7f884b32d000 0x7f884b32e000
> (00.035874)  38289: vma 0x7f884b32e000 0x7f884b42f000
> (00.035875)  38289: vma 0x7f884b42f000 0x7f884b62e000
> (00.035876)  38289: vma 0x7f884b62e000 0x7f884b62f000
> (00.035878)  38289: vma 0x7f884b62f000 0x7f884b630000
> (00.035890)  38289: vma 0x7f884b630000 0x7f884b719000
> (00.035891)  38289: vma 0x7f884b719000 0x7f884b918000
> (00.035892)  38289: vma 0x7f884b918000 0x7f884b920000
> (00.035894)  38289: vma 0x7f884b920000 0x7f884b922000
> (00.035895)  38289: vma 0x7f884b922000 0x7f884b937000
> (00.035896)  38289: vma 0x7f884b937000 0x7f884b93e000
> (00.035898)  38289: vma 0x7f884b93e000 0x7f884bb3d000
> (00.035899)  38289: vma 0x7f884bb3d000 0x7f884bb3e000
> (00.035902)  38289: vma 0x7f884bb3e000 0x7f884bb3f000
> (00.035903)  38289: vma 0x7f884bb3f000 0x7f884bb60000
> (00.035904)  38289: vma 0x7f884bd4f000 0x7f884bd55000
> (00.035906)  38289: vma 0x7f884bd5e000 0x7f884bd60000
> (00.035907)  38289: vma 0x7f884bd60000 0x7f884bd61000
> (00.035908)  38289: vma 0x7f884bd61000 0x7f884bd62000
> (00.035910)  38289: vma 0x7f884bd62000 0x7f884bd63000
> (00.035911)  38289: vma 0x7fff06f88000 0x7fff06faa000
> (00.035912)  38289: vma 0x7fff06fcc000 0x7fff06fce000
> (00.035913)  38289: vma 0xffffffffff600000 0xffffffffff601000
> (00.036692)  38289: Collect fdinfo pid=38289 fd=0 id=0x1
> (00.036698)  38289: Collect fdinfo pid=38289 fd=1 id=0x1
> (00.036700)  38289: Collect fdinfo pid=38289 fd=2 id=0x1
> (00.037577)  38289: Pipes:
> (00.037582)  38289: tty: Inherit terminal for id 1
> (00.037584)  38289: tty: head type pts id 0x1 index 5 (master 0 sid 21867 pgrp 38289 inherit 1)
> (00.037588)  38289: tty: Found orphan slave fake leader (0x1)
> (00.037590)  38289: Unix sockets:
> (00.037609)  38289:     Saved shmems:
> (00.037611)  38289: File descs:
> (00.037612)  38289:  `- type 11 ID 0x1
> (00.037613)  38289:    `- FD 0 pid 38289
> (00.037614)  38289:    `- FD 1 pid 38289
> (00.037615)  38289:    `- FD 2 pid 38289
> (00.037616)  38289:  `- type 1 ID 0x1
> (00.037617)  38289:  `- type 1 ID 0x2
> (00.037619)  38289:  `- type 1 ID 0x3
> (00.037620)  38289:  `- type 1 ID 0x4
> (00.037621)  38289:  `- type 1 ID 0x5
> (00.037622)  38289:  `- type 1 ID 0x6
> (00.037623)  38289:  `- type 1 ID 0x7
> (00.037624)  38289:  `- type 1 ID 0x8
> (00.037625)  38289:  `- type 1 ID 0x9
> (00.037626)  38289:  `- type 1 ID 0xa
> (00.037627)  38289:  `- type 1 ID 0xb
> (00.038739)  38289: Map 0x0000000000400000-0x0000000000401000 0x0000000000000000 vma
> (00.038750)  38289:     premap 0x0000000000400000-0x0000000000401000 -> 00007f9d9da99000
> (00.039308)  38289: Map 0x0000000000600000-0x0000000000601000 0x0000000000000000 vma
> (00.039329)  38289:     premap 0x0000000000600000-0x0000000000601000 -> 00007f9d9da9a000
> (00.039820)  38289: Map 0x0000000000601000-0x0000000000602000 0x0000000000001000 vma
> (00.039832)  38289:     premap 0x0000000000601000-0x0000000000602000 -> 00007f9d9da9b000
> (00.039838)  38289: Map 0x00007f884ab3b000-0x00007f884ab51000 0x0000000000000000 vma
> (00.039843)  38289:     premap 0x00007f884ab3b000-0x00007f884ab51000 -> 00007f9d9da9c000
> (00.039847)  38289: Map 0x00007f884ab51000-0x00007f884ad51000 0x0000000000016000 vma
> (00.039851)  38289:     premap 0x00007f884ab51000-0x00007f884ad51000 -> 00007f9d9dab2000
> (00.039854)  38289: Map 0x00007f884ad51000-0x00007f884ad52000 0x0000000000016000 vma
> (00.039857)  38289:     premap 0x00007f884ad51000-0x00007f884ad52000 -> 00007f9d9dcb2000
> (00.039860)  38289: Map 0x00007f884ad52000-0x00007f884ad53000 0x0000000000017000 vma
> (00.039864)  38289:     premap 0x00007f884ad52000-0x00007f884ad53000 -> 00007f9d9dcb3000
> (00.039866)  38289: Map 0x00007f884ad53000-0x00007f884ad57000 0x0000000000000000 vma
> (00.039869)  38289:     premap 0x00007f884ad53000-0x00007f884ad57000 -> 00007f9d9dcb4000
> (00.039872)  38289: Map 0x00007f884ad57000-0x00007f884af0d000 0x0000000000000000 vma
> (00.039876)  38289:     premap 0x00007f884ad57000-0x00007f884af0d000 -> 00007f9d9dcb8000
> (00.039879)  38289: Map 0x00007f884af0d000-0x00007f884b10d000 0x00000000001b6000 vma
> (00.039883)  38289:     premap 0x00007f884af0d000-0x00007f884b10d000 -> 00007f9d9de6e000
> (00.039886)  38289: Map 0x00007f884b10d000-0x00007f884b111000 0x00000000001b6000 vma
> (00.039889)  38289:     premap 0x00007f884b10d000-0x00007f884b111000 -> 00007f9d9e06e000
> (00.039892)  38289: Map 0x00007f884b111000-0x00007f884b113000 0x00000000001ba000 vma
> (00.039896)  38289:     premap 0x00007f884b111000-0x00007f884b113000 -> 00007f9d9e072000
> (00.039898)  38289: Map 0x00007f884b113000-0x00007f884b118000 0x0000000000000000 vma
> (00.039900)  38289:     premap 0x00007f884b113000-0x00007f884b118000 -> 00007f9d9e074000
> (00.039904)  38289: Map 0x00007f884b118000-0x00007f884b12d000 0x0000000000000000 vma
> (00.039908)  38289:     premap 0x00007f884b118000-0x00007f884b12d000 -> 00007f9d9e079000
> (00.039912)  38289: Map 0x00007f884b12d000-0x00007f884b32c000 0x0000000000015000 vma
> (00.039916)  38289:     premap 0x00007f884b12d000-0x00007f884b32c000 -> 00007f9d9e08e000
> (00.039919)  38289: Map 0x00007f884b32c000-0x00007f884b32d000 0x0000000000014000 vma
> (00.039923)  38289:     premap 0x00007f884b32c000-0x00007f884b32d000 -> 00007f9d9e28d000
> (00.039926)  38289: Map 0x00007f884b32d000-0x00007f884b32e000 0x0000000000015000 vma
> (00.039929)  38289:     premap 0x00007f884b32d000-0x00007f884b32e000 -> 00007f9d9e28e000
> (00.039933)  38289: Map 0x00007f884b32e000-0x00007f884b42f000 0x0000000000000000 vma
> (00.039937)  38289:     premap 0x00007f884b32e000-0x00007f884b42f000 -> 00007f9d9e28f000
> (00.039941)  38289: Map 0x00007f884b42f000-0x00007f884b62e000 0x0000000000101000 vma
> (00.039944)  38289:     premap 0x00007f884b42f000-0x00007f884b62e000 -> 00007f9d9e390000
> (00.039947)  38289: Map 0x00007f884b62e000-0x00007f884b62f000 0x0000000000100000 vma
> (00.039950)  38289:     premap 0x00007f884b62e000-0x00007f884b62f000 -> 00007f9d9e58f000
> (00.039954)  38289: Map 0x00007f884b62f000-0x00007f884b630000 0x0000000000101000 vma
> (00.039957)  38289:     premap 0x00007f884b62f000-0x00007f884b630000 -> 00007f9d9e590000
> (00.039961)  38289: Map 0x00007f884b630000-0x00007f884b719000 0x0000000000000000 vma
> (00.039964)  38289:     premap 0x00007f884b630000-0x00007f884b719000 -> 00007f9d9e591000
> (00.039968)  38289: Map 0x00007f884b719000-0x00007f884b918000 0x00000000000e9000 vma
> (00.039971)  38289:     premap 0x00007f884b719000-0x00007f884b918000 -> 00007f9d9e67a000
> (00.039975)  38289: Map 0x00007f884b918000-0x00007f884b920000 0x00000000000e8000 vma
> (00.039978)  38289:     premap 0x00007f884b918000-0x00007f884b920000 -> 00007f9d9e879000
> (00.039982)  38289: Map 0x00007f884b920000-0x00007f884b922000 0x00000000000f0000 vma
> (00.039985)  38289:     premap 0x00007f884b920000-0x00007f884b922000 -> 00007f9d9e881000
> (00.039987)  38289: Map 0x00007f884b922000-0x00007f884b937000 0x0000000000000000 vma
> (00.039990)  38289:     premap 0x00007f884b922000-0x00007f884b937000 -> 00007f9d9e883000
> (00.039994)  38289: Map 0x00007f884b937000-0x00007f884b93e000 0x0000000000000000 vma
> (00.039997)  38289:     premap 0x00007f884b937000-0x00007f884b93e000 -> 00007f9d9e898000
> (00.040001)  38289: Map 0x00007f884b93e000-0x00007f884bb3d000 0x0000000000007000 vma
> (00.040005)  38289:     premap 0x00007f884b93e000-0x00007f884bb3d000 -> 00007f9d9e89f000
> (00.040008)  38289: Map 0x00007f884bb3d000-0x00007f884bb3e000 0x0000000000006000 vma
> (00.040012)  38289:     premap 0x00007f884bb3d000-0x00007f884bb3e000 -> 00007f9d9ea9e000
> (00.040015)  38289: Map 0x00007f884bb3e000-0x00007f884bb3f000 0x0000000000007000 vma
> (00.040018)  38289:     premap 0x00007f884bb3e000-0x00007f884bb3f000 -> 00007f9d9ea9f000
> (00.040022)  38289: Map 0x00007f884bb3f000-0x00007f884bb60000 0x0000000000000000 vma
> (00.040025)  38289:     premap 0x00007f884bb3f000-0x00007f884bb60000 -> 00007f9d9eaa0000
> (00.040027)  38289: Map 0x00007f884bd4f000-0x00007f884bd55000 0x0000000000000000 vma
> (00.040030)  38289:     premap 0x00007f884bd4f000-0x00007f884bd55000 -> 00007f9d9eac1000
> (00.040032)  38289: Map 0x00007f884bd5e000-0x00007f884bd60000 0x0000000000000000 vma
> (00.040035)  38289:     premap 0x00007f884bd5e000-0x00007f884bd60000 -> 00007f9d9eac7000
> (00.040038)  38289: Map 0x00007f884bd60000-0x00007f884bd61000 0x0000000000021000 vma
> (00.040041)  38289:     premap 0x00007f884bd60000-0x00007f884bd61000 -> 00007f9d9eac9000
> (00.040045)  38289: Map 0x00007f884bd61000-0x00007f884bd62000 0x0000000000022000 vma
> (00.040048)  38289:     premap 0x00007f884bd61000-0x00007f884bd62000 -> 00007f9d9eaca000
> (00.040050)  38289: Map 0x00007f884bd62000-0x00007f884bd63000 0x0000000000000000 vma
> (00.040053)  38289:     premap 0x00007f884bd62000-0x00007f884bd63000 -> 00007f9d9eacb000
> (00.040055)  38289: Map 0x00007fff06f87000-0x00007fff06faa000 0x0000000000000000 vma
> (00.040058)  38289:     premap 0x00007fff06f87000-0x00007fff06faa000 -> 00007f9d9eacc000
> (00.040060)  38289: Map 0x00007fff06fcc000-0x00007fff06fce000 0x0000000000000000 vma
> (00.040062)  38289:     premap 0x00007fff06fcc000-0x00007fff06fce000 -> 00007f9d9eaef000
> (00.042284)  38289: Opened page read 1 (parent 0)
> (00.042311)  38289:     pr1 Read page 400000 from self 400000/0
> (00.042320)  38289:     pr1 Read page 600000 from self 600000/1000
> (00.042325)  38289:     pr1 Read page 601000 from self 601000/2000
> (00.042330)  38289:     pr1 Read page 7f884ad51000 from self 7f884ad51000/3000
> (00.042335)  38289:     pr1 Read page 7f884ad52000 from self 7f884ad52000/4000
> (00.042341)  38289:     pr1 Read page 7f884ad56000 from self 7f884ad56000/5000
> (00.042346)  38289:     pr1 Read page 7f884b10d000 from self 7f884b10d000/6000
> (00.042351)  38289:     pr1 Read page 7f884b10e000 from self 7f884b10e000/7000
> (00.042357)  38289:     pr1 Read page 7f884b10f000 from self 7f884b10f000/8000
> (00.042361)  38289:     pr1 Read page 7f884b110000 from self 7f884b110000/9000
> (00.042365)  38289:     pr1 Read page 7f884b111000 from self 7f884b111000/a000
> (00.042370)  38289:     pr1 Read page 7f884b112000 from self 7f884b112000/b000
> (00.042374)  38289:     pr1 Read page 7f884b113000 from self 7f884b113000/c000
> (00.042379)  38289:     pr1 Read page 7f884b114000 from self 7f884b114000/d000
> (00.042384)  38289:     pr1 Read page 7f884b116000 from self 7f884b116000/e000
> (00.042388)  38289:     pr1 Read page 7f884b32c000 from self 7f884b32c000/f000
> (00.042393)  38289:     pr1 Read page 7f884b32d000 from self 7f884b32d000/10000
> (00.042398)  38289:     pr1 Read page 7f884b62e000 from self 7f884b62e000/11000
> (00.042403)  38289:     pr1 Read page 7f884b62f000 from self 7f884b62f000/12000
> (00.042408)  38289:     pr1 Read page 7f884b918000 from self 7f884b918000/13000
> (00.042414)  38289:     pr1 Read page 7f884b919000 from self 7f884b919000/14000
> (00.042418)  38289:     pr1 Read page 7f884b91a000 from self 7f884b91a000/15000
> (00.042422)  38289:     pr1 Read page 7f884b91b000 from self 7f884b91b000/16000
> (00.042426)  38289:     pr1 Read page 7f884b91c000 from self 7f884b91c000/17000
> (00.042430)  38289:     pr1 Read page 7f884b91d000 from self 7f884b91d000/18000
> (00.042434)  38289:     pr1 Read page 7f884b91e000 from self 7f884b91e000/19000
> (00.042438)  38289:     pr1 Read page 7f884b91f000 from self 7f884b91f000/1a000
> (00.042442)  38289:     pr1 Read page 7f884b920000 from self 7f884b920000/1b000
> (00.042446)  38289:     pr1 Read page 7f884b921000 from self 7f884b921000/1c000
> (00.042451)  38289:     pr1 Read page 7f884b933000 from self 7f884b933000/1d000
> (00.042455)  38289:     pr1 Read page 7f884b934000 from self 7f884b934000/1e000
> (00.042459)  38289:     pr1 Read page 7f884b935000 from self 7f884b935000/1f000
> (00.042463)  38289:     pr1 Read page 7f884b936000 from self 7f884b936000/20000
> (00.042467)  38289:     pr1 Read page 7f884bb3d000 from self 7f884bb3d000/21000
> (00.042471)  38289:     pr1 Read page 7f884bb3e000 from self 7f884bb3e000/22000
> (00.042476)  38289:     pr1 Read page 7f884bd4f000 from self 7f884bd4f000/23000
> (00.042481)  38289:     pr1 Read page 7f884bd50000 from self 7f884bd50000/24000
> (00.042485)  38289:     pr1 Read page 7f884bd51000 from self 7f884bd51000/25000
> (00.042488)  38289:     pr1 Read page 7f884bd52000 from self 7f884bd52000/26000
> (00.042494)  38289:     pr1 Read page 7f884bd53000 from self 7f884bd53000/27000
> (00.042497)  38289:     pr1 Read page 7f884bd54000 from self 7f884bd54000/28000
> (00.042501)  38289:     pr1 Read page 7f884bd5e000 from self 7f884bd5e000/29000
> (00.042505)  38289:     pr1 Read page 7f884bd5f000 from self 7f884bd5f000/2a000
> (00.042509)  38289:     pr1 Read page 7f884bd60000 from self 7f884bd60000/2b000
> (00.042513)  38289:     pr1 Read page 7f884bd61000 from self 7f884bd61000/2c000
> (00.042517)  38289:     pr1 Read page 7f884bd62000 from self 7f884bd62000/2d000
> (00.042522)  38289:     pr1 Read page 7fff06fa8000 from self 7fff06fa8000/2e000
> (00.042526)  38289:     pr1 Read page 7fff06fa9000 from self 7fff06fa9000/2f000
> (00.042531)  38289:     pr1 Read page 7fff06fcc000 from self 7fff06fcc000/30000
> (00.042535)  38289:     pr1 Read page 7fff06fcd000 from self 7fff06fcd000/31000
> (00.042544)  38289: nr_restored_pages: 50
> (00.042545)  38289: nr_shared_pages:   0
> (00.042546)  38289: nr_droped_pages:   0
> (00.042598)  38289: cg: Move into 2
> (00.042603)  38289: cg: ce->path: / 
> (00.042604)  38289: cg:   `-> blkio///tasks
> (00.042703)  38289: cg: ce->path: / 
> (00.042705)  38289: cg:   `-> cpu,cpuacct///tasks
> (00.042711)  38289: cg: ce->path: / 
> (00.042712)  38289: cg:   `-> cpuset///tasks
> (00.042717)  38289: cg: ce->path: / 
> (00.042718)  38289: cg:   `-> devices///tasks
> (00.042723)  38289: cg: ce->path: / 
> (00.042725)  38289: cg:   `-> freezer///tasks
> (00.042729)  38289: cg: ce->path: / 
> (00.042731)  38289: cg:   `-> hugetlb///tasks
> (00.042736)  38289: cg: ce->path: / 
> (00.042737)  38289: cg:   `-> memory///tasks
> (00.042742)  38289: cg: ce->path: /user.slice/user-0.slice/session-741.scope 
> (00.042743)  38289: cg:   `-> systemd//user.slice/user-0.slice/session-741.scope/tasks
> (00.042759)  38289: Error (cgroup.c:908): cg: Can't move into systemd//user.slice/user-0.slice/session-741.scope/tasks (-1/-1): No such file or directory
> (00.043022) Error (cr-restore.c:1193): 38289 exited, status=1
> (00.044078) Error (cr-restore.c:1867): Restoring FAILED.
> [root at compute1 criu-br-1.5-stable]# 

> _______________________________________________
> CRIU mailing list
> CRIU at openvz.org
> https://lists.openvz.org/mailman/listinfo/criu



More information about the CRIU mailing list