<html>
<head>
<meta http-equiv="Content-Type" content="text/html; charset=Windows-1252">
</head>
<body style="word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;">
Edward,
<div><br>
</div>
<div>can you send me in private email output of:</div>
<div># pstorage -c <cluster> stat</div>
<div>output?</div>
<div><br>
</div>
<div>Do you have a skype?</div>
<div><br>
</div>
<div>Thanks,</div>
<div>Kirill</div>
<div><br>
<div><br>
</div>
<div><br>
<div>
<div>On 29 Jan 2014, at 10:26, Edward Konetzko <<a href="mailto:konetzed@gmail.com">konetzed@gmail.com</a>> wrote:</div>
<br class="Apple-interchange-newline">
<blockquote type="cite">
<div bgcolor="#FFFFFF" text="#000000">
<div class="moz-cite-prefix">On 01/28/2014 09:51 AM, Kir Kolyshkin wrote:<br>
</div>
<blockquote cite="mid:CAGmPdrydKUc+AgQh=A1-tPeDEdb7yVO0uEA6=Z23A+OW9QK14w@mail.gmail.com" type="cite">
<div dir="ltr">
<div class="gmail_extra">
<div class="gmail_quote">On 28 January 2014 02:55, Kirill Korotaev <span dir="ltr">
<<a moz-do-not-send="true" href="mailto:dev@parallels.com" target="_blank">dev@parallels.com</a>></span> wrote:<br>
<blockquote class="gmail_quote" style="margin:0px 0px 0px
0.8ex;border-left-width:1px;border-left-color:rgb(204,204,204);border-left-style:solid;padding-left:1ex">
<div class="im">>> On 25 Jan 2014, at 07:38, Rene C. <a moz-do-not-send="true" href="mailto:openvz@dokbua.com">
openvz@dokbua.com</a> wrote:<br>
>><br>
><br>
> Hi,<br>
><br>
> I read the website about the cloud storage and I found some words, which seems familiar for me.<br>
><br>
> May I ask, which filesystem do you use to be able to regularly scrub and self-heal the filesystem?<br>
><br>
> Personaly I use zfsonlinux in production for a long time now and I am very satisfied with it, and based on your description, it seems you should use something like that and something on top of the native filesystem to get a cloud storage.<br>
><br>
> Or you use a ceph or alike "filesystem", which has similar capabilities with cloud features.<br>
<br>
</div>
It’s more like a ceph. Data is stored in a distributed way, so unlike to zfs you have access to the data even in case of node failure (crash, CPU/memory fault etc.) and access is available from ANY cluster node.<br>
As such we store the data and maintain checksums on every node and can do periodic scrubbing of the data.<br>
</blockquote>
<div><br>
</div>
<div>Just to clarify -- this is Parallels own distributed/cloud filesystem, not CEPH or GlusterFS,</div>
<div>but similar to. For more info, check the links at <a moz-do-not-send="true" href="https://openvz.org/Parallels_Cloud_Storage#External_links">https://openvz.org/Parallels_Cloud_Storage#External_links</a></div>
</div>
<br>
</div>
</div>
<br>
<fieldset class="mimeAttachmentHeader"></fieldset> <br>
<pre wrap="">_______________________________________________
Users mailing list
<a class="moz-txt-link-abbreviated" href="mailto:Users@openvz.org">Users@openvz.org</a>
<a class="moz-txt-link-freetext" href="https://lists.openvz.org/mailman/listinfo/users">https://lists.openvz.org/mailman/listinfo/users</a>
</pre>
</blockquote>
Setup a cluster using Centos 6.5 64bit, fresh install in KVM instances. I wanted to test functionality not actual speed.
<br>
<br>
All software was latest as of last night and I followed the quick how to here <a class="moz-txt-link-freetext" href="https://openvz.org/Parallels_Cloud_Storage">
https://openvz.org/Parallels_Cloud_Storage</a><br>
<br>
Everything works great until I try to create an instance using the command "vzctl create 101 --layout ploop --ostemplate centos-6-x86_64 --private /pcs/containers/101" from the docs.<br>
<br>
About one mb of data is written to disk and then it just hangs. The following is output from dmesg<br>
<br>
[ 360.414242] INFO: task vzctl:1646 blocked for more than 120 seconds.<br>
[ 360.414770] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.<br>
[ 360.415406] vzctl D ffff88007e444500 0 1646 1611 0 0x00000084<br>
[ 360.415418] ffff88007ea59a68 0000000000000086 ffff8800ffffffff 000006b62934b8c0<br>
[ 360.415428] 0000000000000000 ffff88007e9f2ad0 0000000000005eaa ffffffffad17694d<br>
[ 360.415437] 000000000ad7ef74 ffffffff81a97b40 ffff88007e444ac8 000000000001eb80<br>
[ 360.415452] Call Trace:<br>
[ 360.415492] [<ffffffff81517353>] io_schedule+0x73/0xc0<br>
[ 360.415516] [<ffffffff811f39b3>] wait_on_sync_kiocb+0x53/0x80<br>
[ 360.415537] [<ffffffffa04dbf47>] fuse_direct_IO+0x167/0x230 [fuse]<br>
[ 360.415558] [<ffffffff8112e948>] mapping_direct_IO+0x48/0x70<br>
[ 360.415567] [<ffffffff811301a6>] generic_file_direct_write_iter+0xf6/0x170<br>
[ 360.415576] [<ffffffff81130c8e>] __generic_file_write_iter+0x32e/0x420<br>
[ 360.415585] [<ffffffff81130e05>] __generic_file_aio_write+0x85/0xa0<br>
[ 360.415594] [<ffffffff81130ea8>] generic_file_aio_write+0x88/0x100<br>
[ 360.415605] [<ffffffffa04da085>] fuse_file_aio_write+0x185/0x430 [fuse]<br>
[ 360.415623] [<ffffffff811a530a>] do_sync_write+0xfa/0x140<br>
[ 360.415641] [<ffffffff8109d930>] ? autoremove_wake_function+0x0/0x40<br>
[ 360.415655] [<ffffffff812902da>] ? strncpy_from_user+0x4a/0x90<br>
[ 360.415664] [<ffffffff811a55e8>] vfs_write+0xb8/0x1a0<br>
[ 360.415671] [<ffffffff811a5ee1>] sys_write+0x51/0x90<br>
[ 360.415681] [<ffffffff8100b102>] system_call_fastpath+0x16/0x1b<br>
<br>
Even just trying to create a 10k file with dd causes a task to hang. "dd if=/dev/zero of=/pcs/test.junk bs=1k count=10"<br>
<br>
<br>
Any ideas? Anymore info you would like for debugging. <br>
</div>
_______________________________________________<br>
Users mailing list<br>
<a href="mailto:Users@openvz.org">Users@openvz.org</a><br>
https://lists.openvz.org/mailman/listinfo/users<br>
</blockquote>
</div>
<br>
</div>
</div>
</body>
</html>