[CRIU] cgroup02: Failed writing 1 to cpuset//newroot/cpuset.cpu_exclusive: Invalid argument

[Kir Kolyshkin]

I got the following test fail while running latest criu-dev 
(v2.4-243-g10b4479)
on a Fedora 24 (kernel 4.6.4-301.fc24.x86_64). Andrey (in Cc) suggested 
to post it here.

I found a similar issue on github (https://github.com/xemul/criu/issues/118)
but in my case I run tests on a host.

Anyway, below is the error. Let me know if you need any logs or images 
from the test run.


======================== Run zdtm/static/cgroup02 in h 
=========================
Start test
Test is SUID
./cgroup02 --pidfile=cgroup02.pid --outfile=cgroup02.out 
--dirname=cgroup02.test
Cleaning cgclean.RyhCdv (name=zdtmtst.defaultroot)
cgclean.RyhCdv/oldroot
Left there is:
cgroup.clone_children
cgroup.procs
cgroup.sane_behavior
holder
notify_on_release
release_agent
tasks
Cleaning cgclean.RyhCdv (name=zdtmtst)
cgclean.RyhCdv/oldroot
Left there is:
cgroup.clone_children
cgroup.procs
cgroup.sane_behavior
holder
notify_on_release
release_agent
tasks
Cleaning cgclean.RyhCdv (perf_event)
Left there is:
cgroup.clone_children
cgroup.procs
cgroup.sane_behavior
machine.slice
notify_on_release
release_agent
tasks
Cleaning cgclean.RyhCdv (freezer)
Left there is:
cgroup.clone_children
cgroup.procs
cgroup.sane_behavior
machine.slice
notify_on_release
release_agent
tasks
Cleaning cgclean.RyhCdv (memory)
Left there is:
cgroup.clone_children
cgroup.event_control
cgroup.procs
cgroup.sane_behavior
init.scope
machine.slice
memory.failcnt
memory.force_empty
memory.kmem.failcnt
memory.kmem.limit_in_bytes
memory.kmem.max_usage_in_bytes
memory.kmem.slabinfo
memory.kmem.tcp.failcnt
memory.kmem.tcp.limit_in_bytes
memory.kmem.tcp.max_usage_in_bytes
memory.kmem.tcp.usage_in_bytes
memory.kmem.usage_in_bytes
memory.limit_in_bytes
memory.max_usage_in_bytes
memory.memsw.failcnt
memory.memsw.limit_in_bytes
memory.memsw.max_usage_in_bytes
memory.memsw.usage_in_bytes
memory.move_charge_at_immigrate
memory.numa_stat
memory.oom_control
memory.pressure_level
memory.soft_limit_in_bytes
memory.stat
memory.swappiness
memory.usage_in_bytes
memory.use_hierarchy
notify_on_release
release_agent
system.slice
tasks
user.slice
zdtmtst
Cleaning cgclean.RyhCdv (net_cls,net_prio)
Left there is:
cgroup.clone_children
cgroup.procs
cgroup.sane_behavior
machine.slice
net_cls.classid
net_prio.ifpriomap
net_prio.prioidx
notify_on_release
release_agent
tasks
Cleaning cgclean.RyhCdv (blkio)
Left there is:
blkio.io_merged
blkio.io_merged_recursive
blkio.io_queued
blkio.io_queued_recursive
blkio.io_service_bytes
blkio.io_service_bytes_recursive
blkio.io_service_time
blkio.io_service_time_recursive
blkio.io_serviced
blkio.io_serviced_recursive
blkio.io_wait_time
blkio.io_wait_time_recursive
blkio.leaf_weight
blkio.leaf_weight_device
blkio.reset_stats
blkio.sectors
blkio.sectors_recursive
blkio.throttle.io_service_bytes
blkio.throttle.io_serviced
blkio.throttle.read_bps_device
blkio.throttle.read_iops_device
blkio.throttle.write_bps_device
blkio.throttle.write_iops_device
blkio.time
blkio.time_recursive
blkio.weight
blkio.weight_device
cgroup.clone_children
cgroup.procs
cgroup.sane_behavior
init.scope
machine.slice
notify_on_release
release_agent
system.slice
tasks
user.slice
Cleaning cgclean.RyhCdv (cpuset)
Left there is:
cgroup.clone_children
cgroup.procs
cgroup.sane_behavior
cpuset.cpu_exclusive
cpuset.cpus
cpuset.effective_cpus
cpuset.effective_mems
cpuset.mem_exclusive
cpuset.mem_hardwall
cpuset.memory_migrate
cpuset.memory_pressure
cpuset.memory_pressure_enabled
cpuset.memory_spread_page
cpuset.memory_spread_slab
cpuset.mems
cpuset.sched_load_balance
cpuset.sched_relax_domain_level
machine.slice
notify_on_release
release_agent
tasks
Cleaning cgclean.RyhCdv (pids)
Left there is:
cgroup.clone_children
cgroup.procs
cgroup.sane_behavior
init.scope
machine.slice
notify_on_release
release_agent
system.slice
tasks
user.slice
Cleaning cgclean.RyhCdv (hugetlb)
Left there is:
cgroup.clone_children
cgroup.procs
cgroup.sane_behavior
hugetlb.1GB.failcnt
hugetlb.1GB.limit_in_bytes
hugetlb.1GB.max_usage_in_bytes
hugetlb.1GB.usage_in_bytes
hugetlb.2MB.failcnt
hugetlb.2MB.limit_in_bytes
hugetlb.2MB.max_usage_in_bytes
hugetlb.2MB.usage_in_bytes
notify_on_release
release_agent
tasks
Cleaning cgclean.RyhCdv (devices)
Left there is:
cgroup.clone_children
cgroup.procs
cgroup.sane_behavior
devices.allow
devices.deny
devices.list
init.scope
machine.slice
notify_on_release
release_agent
system.slice
tasks
user.slice
zdtmtst
Cleaning cgclean.RyhCdv (cpu,cpuacct)
Left there is:
cgroup.clone_children
cgroup.procs
cgroup.sane_behavior
cpu.cfs_period_us
cpu.cfs_quota_us
cpu.shares
cpu.stat
cpuacct.stat
cpuacct.usage
cpuacct.usage_percpu
init.scope
machine.slice
notify_on_release
release_agent
system.slice
tasks
user.slice
Cleaning cgclean.RyhCdv (name=systemd)
Left there is:
cgroup.clone_children
cgroup.procs
cgroup.sane_behavior
init.scope
machine.slice
notify_on_release
release_agent
system.slice
tasks
user.slice
Run criu dump
Running zdtm/static/cgroup02.hook(--pre-restore)
Run criu restore
=[log]=> dump/zdtm/static/cgroup02/12/1/restore.log
------------------------ grep Error ------------------------
(00.314554) Error (criu/cgroup.c:1209): cg: Failed writing 1 to 
cpuset//newroot/cpuset.cpu_exclusive: Invalid argument
(00.331918) Error (criu/cr-restore.c:1130): 12 killed by signal 9: Killed
(00.331972) Error (criu/cr-restore.c:2012): Restoring FAILED.
------------------------ ERROR OVER ------------------------
################ Test zdtm/static/cgroup02 FAIL at CRIU restore 
################