<div dir="ltr">Hi, <div><br></div><div>The two Rpi2 are identical, and has each 4 processors.</div><div>Here is their respective /proc/cpuinfo : </div><div><br></div><div><div>RPI 1 (where restore fails)</div><div><br></div><div>pi@raspberrypi:~ $ cat /proc/cpuinfo </div><div>processor<span style="white-space:pre-wrap"> </span>: 0</div><div>model name<span style="white-space:pre-wrap"> </span>: ARMv7 Processor rev 5 (v7l)</div><div>BogoMIPS<span style="white-space:pre-wrap"> </span>: 38.40</div><div>Features<span style="white-space:pre-wrap"> </span>: half thumb fastmult vfp edsp neon vfpv3 tls vfpv4 idiva idivt vfpd32 lpae evtstrm </div><div>CPU implementer<span style="white-space:pre-wrap"> </span>: 0x41</div><div>CPU architecture: 7</div><div>CPU variant<span style="white-space:pre-wrap"> </span>: 0x0</div><div>CPU part<span style="white-space:pre-wrap"> </span>: 0xc07</div><div>CPU revision<span style="white-space:pre-wrap"> </span>: 5</div><div><br></div><div>processor<span style="white-space:pre-wrap"> </span>: 1</div><div>model name<span style="white-space:pre-wrap"> </span>: ARMv7 Processor rev 5 (v7l)</div><div>BogoMIPS<span style="white-space:pre-wrap"> </span>: 38.40</div><div>Features<span style="white-space:pre-wrap"> </span>: half thumb fastmult vfp edsp neon vfpv3 tls vfpv4 idiva idivt vfpd32 lpae evtstrm </div><div>CPU implementer<span style="white-space:pre-wrap"> </span>: 0x41</div><div>CPU architecture: 7</div><div>CPU variant<span style="white-space:pre-wrap"> </span>: 0x0</div><div>CPU part<span style="white-space:pre-wrap"> </span>: 0xc07</div><div>CPU revision<span style="white-space:pre-wrap"> </span>: 5</div><div><br></div><div>processor<span style="white-space:pre-wrap"> </span>: 2</div><div>model name<span style="white-space:pre-wrap"> </span>: ARMv7 Processor rev 5 (v7l)</div><div>BogoMIPS<span style="white-space:pre-wrap"> </span>: 38.40</div><div>Features<span style="white-space:pre-wrap"> </span>: half thumb fastmult vfp edsp neon vfpv3 tls vfpv4 idiva idivt vfpd32 lpae evtstrm </div><div>CPU implementer<span style="white-space:pre-wrap"> </span>: 0x41</div><div>CPU architecture: 7</div><div>CPU variant<span style="white-space:pre-wrap"> </span>: 0x0</div><div>CPU part<span style="white-space:pre-wrap"> </span>: 0xc07</div><div>CPU revision<span style="white-space:pre-wrap"> </span>: 5</div><div><br></div><div>processor<span style="white-space:pre-wrap"> </span>: 3</div><div>model name<span style="white-space:pre-wrap"> </span>: ARMv7 Processor rev 5 (v7l)</div><div>BogoMIPS<span style="white-space:pre-wrap"> </span>: 38.40</div><div>Features<span style="white-space:pre-wrap"> </span>: half thumb fastmult vfp edsp neon vfpv3 tls vfpv4 idiva idivt vfpd32 lpae evtstrm </div><div>CPU implementer<span style="white-space:pre-wrap"> </span>: 0x41</div><div>CPU architecture: 7</div><div>CPU variant<span style="white-space:pre-wrap"> </span>: 0x0</div><div>CPU part<span style="white-space:pre-wrap"> </span>: 0xc07</div><div>CPU revision<span style="white-space:pre-wrap"> </span>: 5</div><div><br></div><div>Hardware<span style="white-space:pre-wrap"> </span>: BCM2709</div><div>Revision<span style="white-space:pre-wrap"> </span>: a01041</div><div>Serial<span style="white-space:pre-wrap"> </span>: 0000000026505904</div><div><br></div><div>----------------------------------------------------------------------</div><div>RPI 2 (where restore suceeds)</div><div><br></div><div><div>pi@raspberrypi:~ $ cat /proc/cpuinfo </div><div>processor<span style="white-space:pre-wrap"> </span>: 0</div><div>model name<span style="white-space:pre-wrap"> </span>: ARMv7 Processor rev 5 (v7l)</div><div>BogoMIPS<span style="white-space:pre-wrap"> </span>: 38.40</div><div>Features<span style="white-space:pre-wrap"> </span>: half thumb fastmult vfp edsp neon vfpv3 tls vfpv4 idiva idivt vfpd32 lpae evtstrm </div><div>CPU implementer<span style="white-space:pre-wrap"> </span>: 0x41</div><div>CPU architecture: 7</div><div>CPU variant<span style="white-space:pre-wrap"> </span>: 0x0</div><div>CPU part<span style="white-space:pre-wrap"> </span>: 0xc07</div><div>CPU revision<span style="white-space:pre-wrap"> </span>: 5</div><div><br></div><div>processor<span style="white-space:pre-wrap"> </span>: 1</div><div>model name<span style="white-space:pre-wrap"> </span>: ARMv7 Processor rev 5 (v7l)</div><div>BogoMIPS<span style="white-space:pre-wrap"> </span>: 38.40</div><div>Features<span style="white-space:pre-wrap"> </span>: half thumb fastmult vfp edsp neon vfpv3 tls vfpv4 idiva idivt vfpd32 lpae evtstrm </div><div>CPU implementer<span style="white-space:pre-wrap"> </span>: 0x41</div><div>CPU architecture: 7</div><div>CPU variant<span style="white-space:pre-wrap"> </span>: 0x0</div><div>CPU part<span style="white-space:pre-wrap"> </span>: 0xc07</div><div>CPU revision<span style="white-space:pre-wrap"> </span>: 5</div><div><br></div><div>processor<span style="white-space:pre-wrap"> </span>: 2</div><div>model name<span style="white-space:pre-wrap"> </span>: ARMv7 Processor rev 5 (v7l)</div><div>BogoMIPS<span style="white-space:pre-wrap"> </span>: 38.40</div><div>Features<span style="white-space:pre-wrap"> </span>: half thumb fastmult vfp edsp neon vfpv3 tls vfpv4 idiva idivt vfpd32 lpae evtstrm </div><div>CPU implementer<span style="white-space:pre-wrap"> </span>: 0x41</div><div>CPU architecture: 7</div><div>CPU variant<span style="white-space:pre-wrap"> </span>: 0x0</div><div>CPU part<span style="white-space:pre-wrap"> </span>: 0xc07</div><div>CPU revision<span style="white-space:pre-wrap"> </span>: 5</div><div><br></div><div>processor<span style="white-space:pre-wrap"> </span>: 3</div><div>model name<span style="white-space:pre-wrap"> </span>: ARMv7 Processor rev 5 (v7l)</div><div>BogoMIPS<span style="white-space:pre-wrap"> </span>: 38.40</div><div>Features<span style="white-space:pre-wrap"> </span>: half thumb fastmult vfp edsp neon vfpv3 tls vfpv4 idiva idivt vfpd32 lpae evtstrm </div><div>CPU implementer<span style="white-space:pre-wrap"> </span>: 0x41</div><div>CPU architecture: 7</div><div>CPU variant<span style="white-space:pre-wrap"> </span>: 0x0</div><div>CPU part<span style="white-space:pre-wrap"> </span>: 0xc07</div><div>CPU revision<span style="white-space:pre-wrap"> </span>: 5</div><div><br></div><div>Hardware<span style="white-space:pre-wrap"> </span>: BCM2709</div><div>Revision<span style="white-space:pre-wrap"> </span>: a01041</div><div>Serial<span style="white-space:pre-wrap"> </span>: 0000000004b73703</div></div></div></div><div class="gmail_extra"><br><div class="gmail_quote">2016-05-21 17:01 GMT+02:00 Andrew Vagin <span dir="ltr"><<a href="mailto:avagin@virtuozzo.com" target="_blank">avagin@virtuozzo.com</a>></span>:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">How many cpus has each of these RPi-s?<br>
<br>
cat /proc/cpuinfo<br>
<div><div class="h5"><br>
On Fri, May 20, 2016 at 11:06:53AM +0200, alex vk wrote:<br>
> Hi Andrew,<br>
><br>
> You're right, there was no "cpuset" on the Rpi where I tried the restoring<br>
> process, whereas it's present on the other one..<br>
> If I swap the roles between the two Pis, the checkpoint/restore succeeds :)<br>
><br>
> I dont't really understand how come the configuration is different as I was<br>
> using the exact same image loaded on the SD card..<br>
> Do you have an idea why cpuset it disabled on one Rpi, or how I could enable it<br>
> ?<br>
><br>
> Thanks a lot,<br>
> Alex.<br>
><br>
><br>
> Raspberry 1 : (Restore on this Rpi)<br>
> pi@raspberrypi:~ $ cat /proc/cgroups<br>
> #subsys_name hierarchy num_cgroups enabled<br>
> cpu 2 1 1<br>
> cpuacct 2 1 1<br>
> memory 0 1 0<br>
> devices 3 1 1<br>
> freezer 4 1 1<br>
> net_cls 5 1 1<br>
> blkio 6 1 1<br>
><br>
> Raspberry 2 : (Snapshot on this Rpi)<br>
> #subsys_name hierarchy num_cgroups enabled<br>
> cpuset 2 1 1<br>
> cpu 3 1 1<br>
> cpuacct 3 1 1<br>
> memory 0 1 0<br>
> devices 4 1 1<br>
> freezer 5 1 1<br>
> net_cls 6 1 1<br>
> blkio 7 1 1<br>
><br>
> 2016-05-19 23:26 GMT+02:00 Andrew Vagin <<a href="mailto:avagin@virtuozzo.com">avagin@virtuozzo.com</a>>:<br>
><br>
> Hi Alex,<br>
><br>
> Can you show /proc/cgroups from both hosts?<br>
><br>
> On Thu, May 19, 2016 at 06:37:10PM +0200, alex vk wrote:<br>
> ><br>
> > pi@raspberrypi:~/criu/criu $ ./migrate-ssh.sh<br>
> > Warn (autofs.c:74): Failed to find pipe_ino option (old kernel?)<br>
> > Connection to 192.168.0.2 closed.<br>
> > Snapshoted<br>
> > cgroup.img 100% 1948 1.9KB/s<br>
> 00:00<br>
> > core-943.img 100% 602 0.6KB/s<br>
> 00:00<br>
> > fdinfo-2.img 100% 80 0.1KB/s<br>
> 00:00<br>
> > fs-943.img 100% 18 0.0KB/s<br>
> 00:00<br>
> > ids-943.img 100% 32 0.0KB/s<br>
> 00:00<br>
> > inetsk.img 100% 251 0.3KB/s<br>
> 00:00<br>
> > inventory.img 100% 38 0.0KB/s<br>
> 00:00<br>
> > mm-943.img 100% 1862 1.8KB/s<br>
> 00:00<br>
> > pagemap-943.img 100% 242 0.2KB/s<br>
> 00:00<br>
> > pages-1.img 100% 252KB 252.0KB/s<br>
> 00:00<br>
> > pstree.img 100% 26 0.0KB/s<br>
> 00:00<br>
> > reg-files.img 100% 994 1.0KB/s<br>
> 00:00<br>
> > sigacts-943.img 100% 752 0.7KB/s<br>
> 00:00<br>
> > stats-dump 100% 36 0.0KB/s<br>
> 00:00<br>
> > tty.img 100% 30 0.0KB/s<br>
> 00:00<br>
> > tty-info.img 100% 178 0.2KB/s<br>
> 00:00<br>
> > Image transfered<br>
> > (00.082257) Pagemap is fully functional<br>
> > (00.082543) Found task size of 7f000000<br>
> > (00.082892) Reading image tree<br>
> > (00.083089) Add mnt ns 5 pid 943<br>
> > (00.083211) Migrating process tree (GID 943->805 SID 791->741)<br>
> > (00.083259) Will restore in 0 namespaces<br>
> > (00.083295) NS mask to use 0<br>
> > (00.083331) Collecting 39/18 (flags 1)<br>
> > (00.083428) Collected [dev/pts/0] ID 0x1<br>
> > (00.083486) Collected [lib/arm-linux-gnueabihf/<a href="http://libresolv-2.19.so" rel="noreferrer" target="_blank">libresolv-2.19.so</a>] ID 0x5<br>
> > (00.083536) Collected [lib/arm-linux-gnueabihf/<a href="http://libnss_dns-2.19.so" rel="noreferrer" target="_blank">libnss_dns-2.19.so</a>] ID 0x6<br>
> > (00.083581) Collected [lib/arm-linux-gnueabihf/<a href="http://libnss_files-2.19.so" rel="noreferrer" target="_blank">libnss_files-2.19.so</a>] ID<br>
> 0x7<br>
> > (00.083626) Collected [lib/arm-linux-gnueabihf/<a href="http://libc-2.19.so" rel="noreferrer" target="_blank">libc-2.19.so</a>] ID 0x8<br>
> > (00.083672) Collected [lib/arm-linux-gnueabihf/libgcc_s.so.1] ID 0x9<br>
> > (00.083715) Collected [lib/arm-linux-gnueabihf/<a href="http://libm-2.19.so" rel="noreferrer" target="_blank">libm-2.19.so</a>] ID 0xa<br>
> > (00.083759) Collected [usr/lib/arm-linux-gnueabihf/libstdc++.so.6.0.20]<br>
> ID 0xb<br>
> > (00.083804) Collected [lib/arm-linux-gnueabihf/libz.so.1.2.8] ID 0xc<br>
> > (00.083847) Collected [usr/lib/arm-linux-gnueabihf/libenet.so.7.0.0] ID<br>
> 0xd<br>
> > (00.083892) Collected [usr/lib/arm-linux-gnueabihf/libarmmem.so] ID 0xe<br>
> > (00.083935) Collected [lib/arm-linux-gnueabihf/<a href="http://ld-2.19.so" rel="noreferrer" target="_blank">ld-2.19.so</a>] ID 0xf<br>
> > (00.083978) Collected [lib/arm-linux-gnueabihf/libnss_mdns4_minimal.so.2]<br>
> ID<br>
> > 0x10<br>
> > (00.084022) Collected [usr/lib/cube2/cube2_server] ID 0x11<br>
> > (00.084064) Collected [usr/lib/cube2] ID 0x12<br>
> > (00.084104) Collected [.] ID 0x13<br>
> > (00.084151) `- ... done<br>
> > (00.084182) Collecting 52/56 (flags 0)<br>
> > (00.084259) No remap-fpath.img image<br>
> > (00.084318) `- ... done<br>
> > (00.084384) Collecting 42/21 (flags 0)<br>
> > (00.084549) `- ... done<br>
> > (00.084991) cg: Preparing cgroups yard (cgroups restore mode 0x4)<br>
> > (00.089011) cg: Opening .criu.cgyard.lg48ci as cg yard<br>
> > (00.089161) cg: Making controller dir .criu.cgyard.lg48ci/blkio (blkio)<br>
> > (00.089465) cg: Determined cgroup dir blkio/ already exist<br>
> > (00.089495) cg: Skip restoring properties on cgroup dir blkio/<br>
> > (00.089593) cg: Making controller dir .criu.cgyard.lg48ci/net_cls<br>
> (net_cls)<br>
> > (00.089862) cg: Determined cgroup dir net_cls/ already exist<br>
> > (00.089899) cg: Skip restoring properties on cgroup dir net_cls/<br>
> > (00.089978) cg: Making controller dir .criu.cgyard.lg48ci/freezer<br>
> (freezer)<br>
> > (00.090218) cg: Determined cgroup dir freezer/ already exist<br>
> > (00.090257) cg: Skip restoring properties on cgroup dir freezer/<br>
> > (00.090334) cg: Making controller dir .criu.cgyard.lg48ci/devices<br>
> (devices)<br>
> > (00.090646) cg: Determined cgroup dir devices/ already exist<br>
> > (00.090708) cg: Skip restoring properties on cgroup dir devices/<br>
> > (00.090811) cg: Making controller dir .criu.cgyard.lg48ci/cpu,cpuacct<br>
> > (cpu,cpuacct)<br>
> > (00.091066) cg: Determined cgroup dir cpu,cpuacct/ already exist<br>
> > (00.091123) cg: Skip restoring properties on cgroup dir cpu,cpuacct/<br>
> > (00.091229) cg: Making controller dir .criu.cgyard.lg48ci/cpuset<br>
> (cpuset)<br>
> > (00.091431) Error (cgroup.c:1562): cg: Can't mount controller dir<br>
> > .criu.cgyard.lg48ci/cpuset: No such file or directory<br>
> ><br>
> > Hi everyone,<br>
> ><br>
> > I'm coming back to you because I<br>
> > still have a problem when<br>
> > restoring a snapshotted process<br>
> > from a given RPi2 on another<br>
> > RPi2.<br>
> ><br>
> > The snapshot/restore works well<br>
> > on the same RPi2 thanks to the<br>
> > patch :<br>
> > <a href="https://lists.openvz.org/" rel="noreferrer" target="_blank">https://lists.openvz.org/</a><br>
> > pipermail/criu/2016-April/<br>
> > 027743.html<br>
> > (Criu-dev version + patch and<br>
> > Kernel 3.18)<br>
> ><br>
> > However when I try to restore a<br>
> > snapshotted process from a given<br>
> > RPi2 on another RPi2. (with<br>
> > exactly the same image installed ssh -t<br>
> > on the SD card) I obtain the <a href="mailto:pi@192.168.0.1">pi@192.168.0.1</a><br>
> > following error : 'pid=$(pidof scp<br>
> > (00.091431) Error cube2_server);<br>
> <a href="mailto:pi@192.168.0.1">pi@192.168.0.1</a>: sudo criu restore<br>
> > (cgroup.c:1562): cg: Can't mount sudo criu dump -D echo /home/<br>
</div></div>> pi/ echo "Image -d -D /home/pi/ echo "Image restored"<br>
<span class="">> > controller dir /home/pi/ "Snapshotted"<br>
> checkpoint/* / transferred" checkpoint/<br>
> --------------------------------<br>
> > .criu.cgyard.lg48ci/cpuset: No checkpoint/ -t home/pi<br>
</span>> / --shell-job<br>
<div class="HOEnZb"><div class="h5">> > such file or directory $pid<br>
> checkpoint/ --tcp-established<br>
> > (the snapshot process has --tcp-established<br>
> > succeeded on the first Rpi2) --shell-job'<br>
> ><br>
> > The dir .criu.cgyard.lg48ci is<br>
> > indeed empty.<br>
> > CONFIG_CGROUPS and CONFIG_MEMCG<br>
> > are enabled (CONFIG_MEMCG_SWAP<br>
> > and CONFIG_MEMCG_KMEM are<br>
> > disabled) if that matters...<br>
> ><br>
> > Am I doing something wrong here ?<br>
> ><br>
> ><br>
> > Thanks again for your help,<br>
> ><br>
> > Alex<br>
> ><br>
> ><br>
> > Here is the simple script i'm<br>
> > using to migrate and the full log<br>
> > of the restore:<br>
> ><br>
> > --------------------------------<br>
><br>
> > _______________________________________________<br>
> > CRIU mailing list<br>
> > <a href="mailto:CRIU@openvz.org">CRIU@openvz.org</a><br>
> > <a href="https://lists.openvz.org/mailman/listinfo/criu" rel="noreferrer" target="_blank">https://lists.openvz.org/mailman/listinfo/criu</a><br>
><br>
><br>
><br>
</div></div></blockquote></div><br></div>