<div dir="ltr"><div>Hello!<br></div>I'd recommend set only ram/swap limits (via --ram/--swap) , letting other settings be mostly unlimited (while ram/swap limits are not overflowed of course) - <a href="http://wiki.openvz.org/VSwap">http://wiki.openvz.org/VSwap</a> <br></div><div class="gmail_extra"><br><div class="gmail_quote">On Fri, Nov 28, 2014 at 3:31 AM, Nipun Arora <span dir="ltr"><<a href="mailto:nipunarora2512@gmail.com" target="_blank">nipunarora2512@gmail.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr">Nevermind, I figured it out by changing the fail counters in /proc/user_beans<div><br></div><div>Thanks</div><span class="HOEnZb"><font color="#888888"><div>Nipun</div></font></span></div><div class="HOEnZb"><div class="h5"><div class="gmail_extra"><br><div class="gmail_quote">On Thu, Nov 27, 2014 at 7:14 PM, Nipun Arora <span dir="ltr"><<a href="mailto:nipunarora2512@gmail.com" target="_blank">nipunarora2512@gmail.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr">Thanks, the speed is improved by an order of magnitude :)<div><br></div><div>btw. is there any benchmark, that you all have looked into for testing how good/practical live migration is for real-world systems?</div><div>Additionally, I'm trying to run a java application(dacapo benchmark), but keep having trouble in getting java to run..</div><div><br></div><div><p style="margin:0px;font-size:13px;font-family:Monaco;color:rgb(169,169,169);background-color:rgb(0,0,0)">java -version</p>
<p style="margin:0px;font-size:13px;font-family:Monaco;color:rgb(169,169,169);background-color:rgb(0,0,0)">Error occurred during initialization of VM</p>
<p style="margin:0px;font-size:13px;font-family:Monaco;color:rgb(169,169,169);background-color:rgb(0,0,0)">Could not reserve enough space for object heap</p>
<p style="margin:0px;font-size:13px;font-family:Monaco;color:rgb(169,169,169);background-color:rgb(0,0,0)">Could not create the Java virtual machine.</p></div><div><br></div><div>I've put my vz conf file below, can anyone suggest what could be the problem?</div><div><br></div><div>Thanks</div><div>Nipun</div><div><br></div><div><p style="margin:0px;font-size:13px;font-family:Monaco;color:rgb(169,169,169);background-color:rgb(0,0,0)"># UBC parameters (in form of barrier:limit)</p>
<p style="margin:0px;font-size:13px;font-family:Monaco;color:rgb(169,169,169);background-color:rgb(0,0,0)">KMEMSIZE="14372700:14790164"</p>
<p style="margin:0px;font-size:13px;font-family:Monaco;color:rgb(169,169,169);background-color:rgb(0,0,0)">LOCKEDPAGES="2048:2048"</p>
<p style="margin:0px;font-size:13px;font-family:Monaco;color:rgb(169,169,169);background-color:rgb(0,0,0)">PRIVVMPAGES="65536:69632"</p>
<p style="margin:0px;font-size:13px;font-family:Monaco;color:rgb(169,169,169);background-color:rgb(0,0,0)">SHMPAGES="21504:21504"</p>
<p style="margin:0px;font-size:13px;font-family:Monaco;color:rgb(169,169,169);background-color:rgb(0,0,0)">NUMPROC="240:240"</p>
<p style="margin:0px;font-size:13px;font-family:Monaco;color:rgb(169,169,169);background-color:rgb(0,0,0)">PHYSPAGES="0:131072"</p>
<p style="margin:0px;font-size:13px;font-family:Monaco;color:rgb(169,169,169);background-color:rgb(0,0,0)">VMGUARPAGES="33792:unlimited"</p>
<p style="margin:0px;font-size:13px;font-family:Monaco;color:rgb(169,169,169);background-color:rgb(0,0,0)">OOMGUARPAGES="26112:unlimited"</p>
<p style="margin:0px;font-size:13px;font-family:Monaco;color:rgb(169,169,169);background-color:rgb(0,0,0)">NUMTCPSOCK="360:360"</p>
<p style="margin:0px;font-size:13px;font-family:Monaco;color:rgb(169,169,169);background-color:rgb(0,0,0)">NUMFLOCK="188:206"</p>
<p style="margin:0px;font-size:13px;font-family:Monaco;color:rgb(169,169,169);background-color:rgb(0,0,0)">NUMPTY="16:16"</p>
<p style="margin:0px;font-size:13px;font-family:Monaco;color:rgb(169,169,169);background-color:rgb(0,0,0)">NUMSIGINFO="256:256"</p>
<p style="margin:0px;font-size:13px;font-family:Monaco;color:rgb(169,169,169);background-color:rgb(0,0,0)">TCPSNDBUF="1720320:2703360"</p>
<p style="margin:0px;font-size:13px;font-family:Monaco;color:rgb(169,169,169);background-color:rgb(0,0,0)">TCPRCVBUF="1720320:2703360"</p>
<p style="margin:0px;font-size:13px;font-family:Monaco;color:rgb(169,169,169);background-color:rgb(0,0,0)">OTHERSOCKBUF="1126080:2097152"</p>
<p style="margin:0px;font-size:13px;font-family:Monaco;color:rgb(169,169,169);background-color:rgb(0,0,0)">DGRAMRCVBUF="262144:262144"</p>
<p style="margin:0px;font-size:13px;font-family:Monaco;color:rgb(169,169,169);background-color:rgb(0,0,0)">NUMOTHERSOCK="1200"</p>
<p style="margin:0px;font-size:13px;font-family:Monaco;color:rgb(169,169,169);background-color:rgb(0,0,0)">DCACHESIZE="3409920:3624960"</p>
<p style="margin:0px;font-size:13px;font-family:Monaco;color:rgb(169,169,169);background-color:rgb(0,0,0)">NUMFILE="9312:9312"</p>
<p style="margin:0px;font-size:13px;font-family:Monaco;color:rgb(169,169,169);background-color:rgb(0,0,0)">AVNUMPROC="180:180"</p>
<p style="margin:0px;font-size:13px;font-family:Monaco;color:rgb(169,169,169);background-color:rgb(0,0,0)">NUMIPTENT="128:128"</p>
<p style="margin:0px;font-size:13px;font-family:Monaco;color:rgb(169,169,169);background-color:rgb(0,0,0);min-height:17px"><br></p>
<p style="margin:0px;font-size:13px;font-family:Monaco;color:rgb(169,169,169);background-color:rgb(0,0,0)"># Disk quota parameters (in form of softlimit:hardlimit)</p>
<p style="margin:0px;font-size:13px;font-family:Monaco;color:rgb(169,169,169);background-color:rgb(0,0,0)">DISKSPACE="3145728:3145728"</p>
<p style="margin:0px;font-size:13px;font-family:Monaco;color:rgb(169,169,169);background-color:rgb(0,0,0)">DISKINODES="131072:144179"</p>
<p style="margin:0px;font-size:13px;font-family:Monaco;color:rgb(169,169,169);background-color:rgb(0,0,0)">QUOTATIME="0"</p>
<p style="margin:0px;font-size:13px;font-family:Monaco;color:rgb(169,169,169);background-color:rgb(0,0,0);min-height:17px"><br></p>
<p style="margin:0px;font-size:13px;font-family:Monaco;color:rgb(169,169,169);background-color:rgb(0,0,0)"># CPU fair scheduler parameter</p>
<p style="margin:0px;font-size:13px;font-family:Monaco;color:rgb(169,169,169);background-color:rgb(0,0,0)">CPUUNITS="1000"</p>
<p style="margin:0px;font-size:13px;font-family:Monaco;color:rgb(169,169,169);background-color:rgb(0,0,0);min-height:17px"><br></p>
<p style="margin:0px;font-size:13px;font-family:Monaco;color:rgb(169,169,169);background-color:rgb(0,0,0)">NETFILTER="stateless"</p>
<p style="margin:0px;font-size:13px;font-family:Monaco;color:rgb(169,169,169);background-color:rgb(0,0,0)">VE_ROOT="/vz/root/101"</p>
<p style="margin:0px;font-size:13px;font-family:Monaco;color:rgb(169,169,169);background-color:rgb(0,0,0)">VE_PRIVATE="/vz/private/101"</p>
<p style="margin:0px;font-size:13px;font-family:Monaco;color:rgb(169,169,169);background-color:rgb(0,0,0)">OSTEMPLATE="centos-6-x86_64"</p>
<p style="margin:0px;font-size:13px;font-family:Monaco;color:rgb(169,169,169);background-color:rgb(0,0,0)">ORIGIN_SAMPLE="basic"</p>
<p style="margin:0px;font-size:13px;font-family:Monaco;color:rgb(169,169,169);background-color:rgb(0,0,0)">HOSTNAME="test"</p>
<p style="margin:0px;font-size:13px;font-family:Monaco;color:rgb(169,169,169);background-color:rgb(0,0,0)">IP_ADDRESS="192.168.1.101"</p>
<p style="margin:0px;font-size:13px;font-family:Monaco;color:rgb(169,169,169);background-color:rgb(0,0,0)">NAMESERVER="8.8.8.8 8.8.4.4"</p>
<p style="margin:0px;font-size:13px;font-family:Monaco;color:rgb(169,169,169);background-color:rgb(0,0,0)">CPULIMIT="25"</p>
<p style="margin:0px;font-size:13px;font-family:Monaco;color:rgb(169,169,169);background-color:rgb(0,0,0)">SWAPPAGES="0:262144"</p></div><div><br></div></div><div><div><div class="gmail_extra"><br><div class="gmail_quote">On Mon, Nov 24, 2014 at 12:16 PM, Kir Kolyshkin <span dir="ltr"><<a href="mailto:kir@openvz.org" target="_blank">kir@openvz.org</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div text="#000000" bgcolor="#FFFFFF"><span>
<br>
<div>On 11/23/2014 07:13 PM, Nipun Arora
wrote:<br>
</div>
<blockquote type="cite">
<div dir="ltr">Thanks, I will try your suggestions, and get back
to you.
<div>btw... any idea what could be used to share the base image
on both containers? </div>
<div>Like hardlink it in what way? Once both containers start,
won't they have to write to different locations?</div>
</div>
</blockquote>
<br></span>
ploop is composed as a set of stacked images, with all of them but
the top one being read-only.<span><br>
<br>
<blockquote type="cite">
<div dir="ltr">
<div><br>
</div>
<div>I understand that some file systems have a copy on write
mechanism, where after a snapshot all future writes are
written to a additional linked disks.</div>
<div>Does ploop operate in a similar way?</div>
</div>
</blockquote>
<br></span>
yes<br>
<br>
<blockquote type="cite">
<div dir="ltr">
<div><br>
</div>
<div><a href="http://wiki.qemu.org/Features/Snapshots" target="_blank">http://wiki.qemu.org/Features/Snapshots</a><br>
</div>
</div>
</blockquote>
<br>
<a href="http://openvz.livejournal.com/44508.html" target="_blank">http://openvz.livejournal.com/44508.html</a><div><div><br>
<br>
<blockquote type="cite">
<div dir="ltr">
<div><br>
</div>
<div>The cloning with a modified vzmigrate script helps.</div>
<div><br>
</div>
<div>- Nipun</div>
</div>
<div class="gmail_extra"><br>
<div class="gmail_quote">On Sun, Nov 23, 2014 at 5:29 PM, Kir
Kolyshkin <span dir="ltr"><<a href="mailto:kir@openvz.org" target="_blank">kir@openvz.org</a>></span>
wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div text="#000000" bgcolor="#FFFFFF"><span> <br>
<div>On 11/23/2014 04:59 AM, Nipun Arora wrote:<br>
</div>
<blockquote type="cite">
<div dir="ltr">Hi Kir,
<div><br>
</div>
<div>Thanks for the response, I'll update it, and
tell you about the results.</div>
<div><br>
</div>
<div>1. A follow up question... I found that the
write I/O speed of 500-1Mbps increased the suspend
time to several minutes.(mostly pcopy stage)</div>
<div>This seems extremely high for a relatively low
I/O workload, which is why I was wondering if
there are any special things I need to take care
of.</div>
<div>(I ran fio (flexible i/o writer) with fixed
throughput while doing live migration)</div>
</div>
</blockquote>
<br>
</span> Please retry with vzctl 4.8 and ploop 1.12.1 (make
sure they are on both sides).<br>
There was a 5 second wait for the remote side to finish
syncing<br>
copied ploop data. It helped a case with not much I/O
activity in container, but<br>
ruined the case you are talking about.<br>
<br>
Newer ploop and vzctl implement a feedback channel for
ploop copy that eliminates<br>
that wait time. <br>
<br>
<a href="http://git.openvz.org/?p=ploop;a=commit;h=20d754c91079165b" target="_blank">http://git.openvz.org/?p=ploop;a=commit;h=20d754c91079165b</a><br>
<a href="http://git.openvz.org/?p=vzctl;a=commit;h=374b759dec45255d4" target="_blank">http://git.openvz.org/?p=vzctl;a=commit;h=374b759dec45255d4</a><br>
<br>
There are some other major improvements as well, such as
async send for ploop.<br>
<br>
<a href="http://git.openvz.org/?p=ploop;a=commit;h=a55e26e9606e0b" target="_blank">http://git.openvz.org/?p=ploop;a=commit;h=a55e26e9606e0b</a><span><br>
<blockquote type="cite">
<div dir="ltr">
<div><br>
</div>
<div>2. <span style="font-family:arial,sans-serif;font-size:13px">For
my purposes, I have modified the live migration
script to allow me to do cloning... i.e. I start
both the containers instead of deleting the
original. I need to do this "cloning" from time
to time for the same target container... </span></div>
<div style="font-family:arial,sans-serif;font-size:13px"><br>
</div>
<div style="font-family:arial,sans-serif;font-size:13px">
a. Which means that lets say we cloned
container C1 to container C2, and let both execute
at time t0, this works with no apparent loss of
service.</div>
<div style="font-family:arial,sans-serif;font-size:13px">
</div>
<div style="font-family:arial,sans-serif;font-size:13px">
b. Now at time t1 I would like to again
clone C1 to C2, and would like to optimize the
rsync process as most of the ploop file for C1 and
C2 should still be the same (i.e. less time to
sync). Can anyone suggest what would be the best
way to realize the second point? <br>
</div>
</div>
</blockquote>
<br>
</span> You can create a ploop snapshot and use shared
base image for both containers<br>
(instead of copying the base delta, hardlink it). This is
not supported by tools<br>
(for example, since base delta is now shared you can't
merge down to it, but the<br>
tools are not aware) so you need to figure it out by
yourself and be accurate<br>
but it should work.
<div>
<div><br>
<br>
<blockquote type="cite">
<div dir="ltr">
<div><br>
</div>
<div><br>
</div>
<div>Thanks</div>
<div>Nipun</div>
</div>
<div class="gmail_extra"><br>
<div class="gmail_quote">On Sun, Nov 23, 2014 at
12:56 AM, Kir Kolyshkin <span dir="ltr"><<a href="mailto:kir@openvz.org" target="_blank">kir@openvz.org</a>></span>
wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div text="#000000" bgcolor="#FFFFFF"><span> <br>
<div>On 11/22/2014 09:09 AM, Nipun Arora
wrote:<br>
</div>
<blockquote type="cite">
<div dir="ltr">Hi All,
<div><br>
</div>
<div>I was wondering if anyone can
suggest what is the most optimal way
to do the following</div>
<div><br>
</div>
<div>1. Can anyone clarify if ploop is
the best layout for minimum suspend
time during live migration?</div>
</div>
</blockquote>
<br>
</span> Yes (due to ploop copy which only
copies the modified blocks).<span><br>
<br>
<blockquote type="cite">
<div dir="ltr">
<div><br>
</div>
<div>2. I tried migrating a ploop
device where I increased the
--diskspace to 5G,<br>
and found that the suspend time
taken by live migration increased to
57 seconds<br>
(mainly undump and restore
increased)...<br>
whereas a 2G diskspace was taking
2-3 seconds suspend time... Is this
expected?</div>
<div><br>
</div>
</div>
</blockquote>
<br>
</span> No. Undump and restore times depends
mostly on amount of RAM used by a container.<br>
<br>
Having said that, live migration stages
influence each other, although it's less so<br>
in the latest vzctl release (I won't go into
details here if you allow me -- just make
sure<br>
you test with vzctl 4.8).<span><br>
<br>
<br>
<blockquote type="cite">
<div dir="ltr">
<div>3. I tried running a write
intensive workload, and found that
beyond 100-150Kbps,<br>
the suspend time during live
migration rapidly increased? Is this
an expected trend?</div>
</div>
</blockquote>
<br>
</span> Sure. With increased writing speed,
the amount of data that needs to be copied
after CT<br>
is suspended increases.<span><br>
<br>
<blockquote type="cite">
<div dir="ltr">
<div><br>
</div>
<div>I am using vzctl 4.7, and ploop
1.11 in centos 6.5</div>
</div>
</blockquote>
<br>
</span> You need to update vzctl and ploop
and rerun your tests, there should be<br>
some improvement (in particular with respect
to issue #3).<span><br>
<br>
<blockquote type="cite">
<div dir="ltr">
<div><br>
</div>
<div>Thanks</div>
<div>Nipun</div>
</div>
<br>
<fieldset></fieldset>
<br>
<pre>_______________________________________________
Users mailing list
<a href="mailto:Users@openvz.org" target="_blank">Users@openvz.org</a>
<a href="https://lists.openvz.org/mailman/listinfo/users" target="_blank">https://lists.openvz.org/mailman/listinfo/users</a>
</pre>
</blockquote>
<br>
</span></div>
<br>
_______________________________________________<br>
Users mailing list<br>
<a href="mailto:Users@openvz.org" target="_blank">Users@openvz.org</a><br>
<a href="https://lists.openvz.org/mailman/listinfo/users" target="_blank">https://lists.openvz.org/mailman/listinfo/users</a><br>
<br>
</blockquote>
</div>
<br>
</div>
<br>
<fieldset></fieldset>
<br>
<pre>_______________________________________________
Users mailing list
<a href="mailto:Users@openvz.org" target="_blank">Users@openvz.org</a>
<a href="https://lists.openvz.org/mailman/listinfo/users" target="_blank">https://lists.openvz.org/mailman/listinfo/users</a>
</pre>
</blockquote>
<br>
</div>
</div>
</div>
<br>
_______________________________________________<br>
Users mailing list<br>
<a href="mailto:Users@openvz.org" target="_blank">Users@openvz.org</a><br>
<a href="https://lists.openvz.org/mailman/listinfo/users" target="_blank">https://lists.openvz.org/mailman/listinfo/users</a><br>
<br>
</blockquote>
</div>
<br>
</div>
<br>
<fieldset></fieldset>
<br>
<pre>_______________________________________________
Users mailing list
<a href="mailto:Users@openvz.org" target="_blank">Users@openvz.org</a>
<a href="https://lists.openvz.org/mailman/listinfo/users" target="_blank">https://lists.openvz.org/mailman/listinfo/users</a>
</pre>
</blockquote>
<br>
</div></div></div>
<br>_______________________________________________<br>
Users mailing list<br>
<a href="mailto:Users@openvz.org" target="_blank">Users@openvz.org</a><br>
<a href="https://lists.openvz.org/mailman/listinfo/users" target="_blank">https://lists.openvz.org/mailman/listinfo/users</a><br>
<br></blockquote></div><br></div>
</div></div></blockquote></div><br></div>
</div></div><br>_______________________________________________<br>
Users mailing list<br>
<a href="mailto:Users@openvz.org">Users@openvz.org</a><br>
<a href="https://lists.openvz.org/mailman/listinfo/users" target="_blank">https://lists.openvz.org/mailman/listinfo/users</a><br>
<br></blockquote></div><br><br clear="all"><br>-- <br><div class="gmail_signature">Best regards,<br>[COOLCOLD-RIPN] </div>
</div>