<html>
<head>
<meta content="text/html; charset=windows-1252"
http-equiv="Content-Type">
</head>
<body text="#000000" bgcolor="#FFFFFF">
<br>
<div class="moz-cite-prefix">On 11/27/2014 04:14 PM, Nipun Arora
wrote:<br>
</div>
<blockquote
cite="mid:CAA9cJVXRQ41V36LYU3Kj6tWbxZMmR72AHNb9UHpt1a2eYaA3gA@mail.gmail.com"
type="cite">
<meta http-equiv="Content-Type" content="text/html;
charset=windows-1252">
<div dir="ltr">Thanks, the speed is improved by an order of
magnitude :)
<div><br>
</div>
<div>btw. is there any benchmark, that you all have looked into
for testing how good/practical live migration is for
real-world systems?</div>
<div>Additionally, I'm trying to run a java application(dacapo
benchmark), but keep having trouble in getting java to run..</div>
<div><br>
</div>
<div>
<p
style="margin:0px;font-size:13px;font-family:Monaco;color:rgb(169,169,169);background-color:rgb(0,0,0)">java
-version</p>
<p
style="margin:0px;font-size:13px;font-family:Monaco;color:rgb(169,169,169);background-color:rgb(0,0,0)">Error
occurred during initialization of VM</p>
<p
style="margin:0px;font-size:13px;font-family:Monaco;color:rgb(169,169,169);background-color:rgb(0,0,0)">Could
not reserve enough space for object heap</p>
<p
style="margin:0px;font-size:13px;font-family:Monaco;color:rgb(169,169,169);background-color:rgb(0,0,0)">Could
not create the Java virtual machine.</p>
</div>
<div><br>
</div>
<div>I've put my vz conf file below, can anyone suggest what
could be the problem?</div>
</div>
</blockquote>
<br>
Your config is not fully converted to VSwap. You need to remove all
beancounters except ram&swap (PHYSPAGES and SWAPPAGES).<br>
<br>
<blockquote
cite="mid:CAA9cJVXRQ41V36LYU3Kj6tWbxZMmR72AHNb9UHpt1a2eYaA3gA@mail.gmail.com"
type="cite">
<div dir="ltr">
<div>Thanks</div>
<div>Nipun</div>
<div><br>
</div>
<div>
<p
style="margin:0px;font-size:13px;font-family:Monaco;color:rgb(169,169,169);background-color:rgb(0,0,0)">#
UBC parameters (in form of barrier:limit)</p>
<p
style="margin:0px;font-size:13px;font-family:Monaco;color:rgb(169,169,169);background-color:rgb(0,0,0)">KMEMSIZE="14372700:14790164"</p>
<p
style="margin:0px;font-size:13px;font-family:Monaco;color:rgb(169,169,169);background-color:rgb(0,0,0)">LOCKEDPAGES="2048:2048"</p>
<p
style="margin:0px;font-size:13px;font-family:Monaco;color:rgb(169,169,169);background-color:rgb(0,0,0)">PRIVVMPAGES="65536:69632"</p>
<p
style="margin:0px;font-size:13px;font-family:Monaco;color:rgb(169,169,169);background-color:rgb(0,0,0)">SHMPAGES="21504:21504"</p>
<p
style="margin:0px;font-size:13px;font-family:Monaco;color:rgb(169,169,169);background-color:rgb(0,0,0)">NUMPROC="240:240"</p>
<p
style="margin:0px;font-size:13px;font-family:Monaco;color:rgb(169,169,169);background-color:rgb(0,0,0)">PHYSPAGES="0:131072"</p>
<p
style="margin:0px;font-size:13px;font-family:Monaco;color:rgb(169,169,169);background-color:rgb(0,0,0)">VMGUARPAGES="33792:unlimited"</p>
<p
style="margin:0px;font-size:13px;font-family:Monaco;color:rgb(169,169,169);background-color:rgb(0,0,0)">OOMGUARPAGES="26112:unlimited"</p>
<p
style="margin:0px;font-size:13px;font-family:Monaco;color:rgb(169,169,169);background-color:rgb(0,0,0)">NUMTCPSOCK="360:360"</p>
<p
style="margin:0px;font-size:13px;font-family:Monaco;color:rgb(169,169,169);background-color:rgb(0,0,0)">NUMFLOCK="188:206"</p>
<p
style="margin:0px;font-size:13px;font-family:Monaco;color:rgb(169,169,169);background-color:rgb(0,0,0)">NUMPTY="16:16"</p>
<p
style="margin:0px;font-size:13px;font-family:Monaco;color:rgb(169,169,169);background-color:rgb(0,0,0)">NUMSIGINFO="256:256"</p>
<p
style="margin:0px;font-size:13px;font-family:Monaco;color:rgb(169,169,169);background-color:rgb(0,0,0)">TCPSNDBUF="1720320:2703360"</p>
<p
style="margin:0px;font-size:13px;font-family:Monaco;color:rgb(169,169,169);background-color:rgb(0,0,0)">TCPRCVBUF="1720320:2703360"</p>
<p
style="margin:0px;font-size:13px;font-family:Monaco;color:rgb(169,169,169);background-color:rgb(0,0,0)">OTHERSOCKBUF="1126080:2097152"</p>
<p
style="margin:0px;font-size:13px;font-family:Monaco;color:rgb(169,169,169);background-color:rgb(0,0,0)">DGRAMRCVBUF="262144:262144"</p>
<p
style="margin:0px;font-size:13px;font-family:Monaco;color:rgb(169,169,169);background-color:rgb(0,0,0)">NUMOTHERSOCK="1200"</p>
<p
style="margin:0px;font-size:13px;font-family:Monaco;color:rgb(169,169,169);background-color:rgb(0,0,0)">DCACHESIZE="3409920:3624960"</p>
<p
style="margin:0px;font-size:13px;font-family:Monaco;color:rgb(169,169,169);background-color:rgb(0,0,0)">NUMFILE="9312:9312"</p>
<p
style="margin:0px;font-size:13px;font-family:Monaco;color:rgb(169,169,169);background-color:rgb(0,0,0)">AVNUMPROC="180:180"</p>
<p
style="margin:0px;font-size:13px;font-family:Monaco;color:rgb(169,169,169);background-color:rgb(0,0,0)">NUMIPTENT="128:128"</p>
<p
style="margin:0px;font-size:13px;font-family:Monaco;color:rgb(169,169,169);background-color:rgb(0,0,0);min-height:17px"><br>
</p>
<p
style="margin:0px;font-size:13px;font-family:Monaco;color:rgb(169,169,169);background-color:rgb(0,0,0)">#
Disk quota parameters (in form of softlimit:hardlimit)</p>
<p
style="margin:0px;font-size:13px;font-family:Monaco;color:rgb(169,169,169);background-color:rgb(0,0,0)">DISKSPACE="3145728:3145728"</p>
<p
style="margin:0px;font-size:13px;font-family:Monaco;color:rgb(169,169,169);background-color:rgb(0,0,0)">DISKINODES="131072:144179"</p>
<p
style="margin:0px;font-size:13px;font-family:Monaco;color:rgb(169,169,169);background-color:rgb(0,0,0)">QUOTATIME="0"</p>
<p
style="margin:0px;font-size:13px;font-family:Monaco;color:rgb(169,169,169);background-color:rgb(0,0,0);min-height:17px"><br>
</p>
<p
style="margin:0px;font-size:13px;font-family:Monaco;color:rgb(169,169,169);background-color:rgb(0,0,0)">#
CPU fair scheduler parameter</p>
<p
style="margin:0px;font-size:13px;font-family:Monaco;color:rgb(169,169,169);background-color:rgb(0,0,0)">CPUUNITS="1000"</p>
<p
style="margin:0px;font-size:13px;font-family:Monaco;color:rgb(169,169,169);background-color:rgb(0,0,0);min-height:17px"><br>
</p>
<p
style="margin:0px;font-size:13px;font-family:Monaco;color:rgb(169,169,169);background-color:rgb(0,0,0)">NETFILTER="stateless"</p>
<p
style="margin:0px;font-size:13px;font-family:Monaco;color:rgb(169,169,169);background-color:rgb(0,0,0)">VE_ROOT="/vz/root/101"</p>
<p
style="margin:0px;font-size:13px;font-family:Monaco;color:rgb(169,169,169);background-color:rgb(0,0,0)">VE_PRIVATE="/vz/private/101"</p>
<p
style="margin:0px;font-size:13px;font-family:Monaco;color:rgb(169,169,169);background-color:rgb(0,0,0)">OSTEMPLATE="centos-6-x86_64"</p>
<p
style="margin:0px;font-size:13px;font-family:Monaco;color:rgb(169,169,169);background-color:rgb(0,0,0)">ORIGIN_SAMPLE="basic"</p>
<p
style="margin:0px;font-size:13px;font-family:Monaco;color:rgb(169,169,169);background-color:rgb(0,0,0)">HOSTNAME="test"</p>
<p
style="margin:0px;font-size:13px;font-family:Monaco;color:rgb(169,169,169);background-color:rgb(0,0,0)">IP_ADDRESS="192.168.1.101"</p>
<p
style="margin:0px;font-size:13px;font-family:Monaco;color:rgb(169,169,169);background-color:rgb(0,0,0)">NAMESERVER="8.8.8.8
8.8.4.4"</p>
<p
style="margin:0px;font-size:13px;font-family:Monaco;color:rgb(169,169,169);background-color:rgb(0,0,0)">CPULIMIT="25"</p>
<p
style="margin:0px;font-size:13px;font-family:Monaco;color:rgb(169,169,169);background-color:rgb(0,0,0)">SWAPPAGES="0:262144"</p>
</div>
<div><br>
</div>
</div>
<div class="gmail_extra"><br>
<div class="gmail_quote">On Mon, Nov 24, 2014 at 12:16 PM, Kir
Kolyshkin <span dir="ltr"><<a moz-do-not-send="true"
href="mailto:kir@openvz.org" target="_blank">kir@openvz.org</a>></span>
wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0
.8ex;border-left:1px #ccc solid;padding-left:1ex">
<div text="#000000" bgcolor="#FFFFFF"><span class=""> <br>
<div>On 11/23/2014 07:13 PM, Nipun Arora wrote:<br>
</div>
<blockquote type="cite">
<div dir="ltr">Thanks, I will try your suggestions,
and get back to you.
<div>btw... any idea what could be used to share the
base image on both containers? </div>
<div>Like hardlink it in what way? Once both
containers start, won't they have to write to
different locations?</div>
</div>
</blockquote>
<br>
</span> ploop is composed as a set of stacked images, with
all of them but the top one being read-only.<span class=""><br>
<br>
<blockquote type="cite">
<div dir="ltr">
<div><br>
</div>
<div>I understand that some file systems have a copy
on write mechanism, where after a snapshot all
future writes are written to a additional linked
disks.</div>
<div>Does ploop operate in a similar way?</div>
</div>
</blockquote>
<br>
</span> yes<br>
<br>
<blockquote type="cite">
<div dir="ltr">
<div><br>
</div>
<div><a moz-do-not-send="true"
href="http://wiki.qemu.org/Features/Snapshots"
target="_blank">http://wiki.qemu.org/Features/Snapshots</a><br>
</div>
</div>
</blockquote>
<br>
<a moz-do-not-send="true"
href="http://openvz.livejournal.com/44508.html"
target="_blank">http://openvz.livejournal.com/44508.html</a>
<div>
<div class="h5"><br>
<br>
<blockquote type="cite">
<div dir="ltr">
<div><br>
</div>
<div>The cloning with a modified vzmigrate script
helps.</div>
<div><br>
</div>
<div>- Nipun</div>
</div>
<div class="gmail_extra"><br>
<div class="gmail_quote">On Sun, Nov 23, 2014 at
5:29 PM, Kir Kolyshkin <span dir="ltr"><<a
moz-do-not-send="true"
href="mailto:kir@openvz.org" target="_blank">kir@openvz.org</a>></span>
wrote:<br>
<blockquote class="gmail_quote" style="margin:0
0 0 .8ex;border-left:1px #ccc
solid;padding-left:1ex">
<div text="#000000" bgcolor="#FFFFFF"><span> <br>
<div>On 11/23/2014 04:59 AM, Nipun Arora
wrote:<br>
</div>
<blockquote type="cite">
<div dir="ltr">Hi Kir,
<div><br>
</div>
<div>Thanks for the response, I'll
update it, and tell you about the
results.</div>
<div><br>
</div>
<div>1. A follow up question... I
found that the write I/O speed of
500-1Mbps increased the suspend time
to several minutes.(mostly pcopy
stage)</div>
<div>This seems extremely high for a
relatively low I/O workload, which
is why I was wondering if there are
any special things I need to take
care of.</div>
<div>(I ran fio (flexible i/o writer)
with fixed throughput while doing
live migration)</div>
</div>
</blockquote>
<br>
</span> Please retry with vzctl 4.8 and
ploop 1.12.1 (make sure they are on both
sides).<br>
There was a 5 second wait for the remote
side to finish syncing<br>
copied ploop data. It helped a case with not
much I/O activity in container, but<br>
ruined the case you are talking about.<br>
<br>
Newer ploop and vzctl implement a feedback
channel for ploop copy that eliminates<br>
that wait time. <br>
<br>
<a moz-do-not-send="true"
href="http://git.openvz.org/?p=ploop;a=commit;h=20d754c91079165b"
target="_blank">http://git.openvz.org/?p=ploop;a=commit;h=20d754c91079165b</a><br>
<a moz-do-not-send="true"
href="http://git.openvz.org/?p=vzctl;a=commit;h=374b759dec45255d4"
target="_blank">http://git.openvz.org/?p=vzctl;a=commit;h=374b759dec45255d4</a><br>
<br>
There are some other major improvements as
well, such as async send for ploop.<br>
<br>
<a moz-do-not-send="true"
href="http://git.openvz.org/?p=ploop;a=commit;h=a55e26e9606e0b"
target="_blank">http://git.openvz.org/?p=ploop;a=commit;h=a55e26e9606e0b</a><span><br>
<blockquote type="cite">
<div dir="ltr">
<div><br>
</div>
<div>2. <span
style="font-family:arial,sans-serif;font-size:13px">For
my purposes, I have modified the
live migration script to allow me
to do cloning... i.e. I start both
the containers instead of deleting
the original. I need to do this
"cloning" from time to time for
the same target container... </span></div>
<div
style="font-family:arial,sans-serif;font-size:13px"><br>
</div>
<div
style="font-family:arial,sans-serif;font-size:13px">
a. Which means that lets say we
cloned container C1 to container C2,
and let both execute at time t0,
this works with no apparent loss of
service.</div>
<div
style="font-family:arial,sans-serif;font-size:13px">
</div>
<div
style="font-family:arial,sans-serif;font-size:13px">
b. Now at time t1 I would like
to again clone C1 to C2, and would
like to optimize the rsync process
as most of the ploop file for C1 and
C2 should still be the same (i.e.
less time to sync). Can anyone
suggest what would be the best way
to realize the second point? <br>
</div>
</div>
</blockquote>
<br>
</span> You can create a ploop snapshot and
use shared base image for both containers<br>
(instead of copying the base delta, hardlink
it). This is not supported by tools<br>
(for example, since base delta is now shared
you can't merge down to it, but the<br>
tools are not aware) so you need to figure
it out by yourself and be accurate<br>
but it should work.
<div>
<div><br>
<br>
<blockquote type="cite">
<div dir="ltr">
<div><br>
</div>
<div><br>
</div>
<div>Thanks</div>
<div>Nipun</div>
</div>
<div class="gmail_extra"><br>
<div class="gmail_quote">On Sun, Nov
23, 2014 at 12:56 AM, Kir
Kolyshkin <span dir="ltr"><<a
moz-do-not-send="true"
href="mailto:kir@openvz.org"
target="_blank">kir@openvz.org</a>></span>
wrote:<br>
<blockquote class="gmail_quote"
style="margin:0 0 0
.8ex;border-left:1px #ccc
solid;padding-left:1ex">
<div text="#000000"
bgcolor="#FFFFFF"><span> <br>
<div>On 11/22/2014 09:09 AM,
Nipun Arora wrote:<br>
</div>
<blockquote type="cite">
<div dir="ltr">Hi All,
<div><br>
</div>
<div>I was wondering if
anyone can suggest
what is the most
optimal way to do the
following</div>
<div><br>
</div>
<div>1. Can anyone
clarify if ploop is
the best layout for
minimum suspend time
during live migration?</div>
</div>
</blockquote>
<br>
</span> Yes (due to ploop copy
which only copies the modified
blocks).<span><br>
<br>
<blockquote type="cite">
<div dir="ltr">
<div><br>
</div>
<div>2. I tried
migrating a ploop
device where I
increased the
--diskspace to 5G,<br>
and found that the
suspend time taken by
live migration
increased to 57
seconds<br>
(mainly undump and
restore increased)...<br>
whereas a 2G diskspace
was taking 2-3 seconds
suspend time... Is
this expected?</div>
<div><br>
</div>
</div>
</blockquote>
<br>
</span> No. Undump and restore
times depends mostly on amount
of RAM used by a container.<br>
<br>
Having said that, live
migration stages influence
each other, although it's less
so<br>
in the latest vzctl release (I
won't go into details here if
you allow me -- just make sure<br>
you test with vzctl 4.8).<span><br>
<br>
<br>
<blockquote type="cite">
<div dir="ltr">
<div>3. I tried running
a write intensive
workload, and found
that beyond
100-150Kbps,<br>
the suspend time
during live migration
rapidly increased? Is
this an expected
trend?</div>
</div>
</blockquote>
<br>
</span> Sure. With increased
writing speed, the amount of
data that needs to be copied
after CT<br>
is suspended increases.<span><br>
<br>
<blockquote type="cite">
<div dir="ltr">
<div><br>
</div>
<div>I am using vzctl
4.7, and ploop 1.11 in
centos 6.5</div>
</div>
</blockquote>
<br>
</span> You need to update
vzctl and ploop and rerun your
tests, there should be<br>
some improvement (in
particular with respect to
issue #3).<span><br>
<br>
<blockquote type="cite">
<div dir="ltr">
<div><br>
</div>
<div>Thanks</div>
<div>Nipun</div>
</div>
<br>
<fieldset></fieldset>
<br>
<pre>_______________________________________________
Users mailing list
<a moz-do-not-send="true" href="mailto:Users@openvz.org" target="_blank">Users@openvz.org</a>
<a moz-do-not-send="true" href="https://lists.openvz.org/mailman/listinfo/users" target="_blank">https://lists.openvz.org/mailman/listinfo/users</a>
</pre>
</blockquote>
<br>
</span></div>
<br>
_______________________________________________<br>
Users mailing list<br>
<a moz-do-not-send="true"
href="mailto:Users@openvz.org"
target="_blank">Users@openvz.org</a><br>
<a moz-do-not-send="true"
href="https://lists.openvz.org/mailman/listinfo/users"
target="_blank">https://lists.openvz.org/mailman/listinfo/users</a><br>
<br>
</blockquote>
</div>
<br>
</div>
<br>
<fieldset></fieldset>
<br>
<pre>_______________________________________________
Users mailing list
<a moz-do-not-send="true" href="mailto:Users@openvz.org" target="_blank">Users@openvz.org</a>
<a moz-do-not-send="true" href="https://lists.openvz.org/mailman/listinfo/users" target="_blank">https://lists.openvz.org/mailman/listinfo/users</a>
</pre>
</blockquote>
<br>
</div>
</div>
</div>
<br>
_______________________________________________<br>
Users mailing list<br>
<a moz-do-not-send="true"
href="mailto:Users@openvz.org"
target="_blank">Users@openvz.org</a><br>
<a moz-do-not-send="true"
href="https://lists.openvz.org/mailman/listinfo/users"
target="_blank">https://lists.openvz.org/mailman/listinfo/users</a><br>
<br>
</blockquote>
</div>
<br>
</div>
<br>
<fieldset></fieldset>
<br>
<pre>_______________________________________________
Users mailing list
<a moz-do-not-send="true" href="mailto:Users@openvz.org" target="_blank">Users@openvz.org</a>
<a moz-do-not-send="true" href="https://lists.openvz.org/mailman/listinfo/users" target="_blank">https://lists.openvz.org/mailman/listinfo/users</a>
</pre>
</blockquote>
<br>
</div>
</div>
</div>
<br>
_______________________________________________<br>
Users mailing list<br>
<a moz-do-not-send="true" href="mailto:Users@openvz.org">Users@openvz.org</a><br>
<a moz-do-not-send="true"
href="https://lists.openvz.org/mailman/listinfo/users"
target="_blank">https://lists.openvz.org/mailman/listinfo/users</a><br>
<br>
</blockquote>
</div>
<br>
</div>
<br>
<fieldset class="mimeAttachmentHeader"></fieldset>
<br>
<pre wrap="">_______________________________________________
Users mailing list
<a class="moz-txt-link-abbreviated" href="mailto:Users@openvz.org">Users@openvz.org</a>
<a class="moz-txt-link-freetext" href="https://lists.openvz.org/mailman/listinfo/users">https://lists.openvz.org/mailman/listinfo/users</a>
</pre>
</blockquote>
<br>
</body>
</html>