<html xmlns:v="urn:schemas-microsoft-com:vml" xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:w="urn:schemas-microsoft-com:office:word" xmlns:x="urn:schemas-microsoft-com:office:excel" xmlns:p="urn:schemas-microsoft-com:office:powerpoint" xmlns:a="urn:schemas-microsoft-com:office:access" xmlns:dt="uuid:C2F41010-65B3-11d1-A29F-00AA00C14882" xmlns:s="uuid:BDC6E3F0-6DA3-11d1-A2A3-00AA00C14882" xmlns:rs="urn:schemas-microsoft-com:rowset" xmlns:z="#RowsetSchema" xmlns:b="urn:schemas-microsoft-com:office:publisher" xmlns:ss="urn:schemas-microsoft-com:office:spreadsheet" xmlns:c="urn:schemas-microsoft-com:office:component:spreadsheet" xmlns:odc="urn:schemas-microsoft-com:office:odc" xmlns:oa="urn:schemas-microsoft-com:office:activation" xmlns:html="http://www.w3.org/TR/REC-html40" xmlns:q="http://schemas.xmlsoap.org/soap/envelope/" xmlns:rtc="http://microsoft.com/officenet/conferencing" xmlns:D="DAV:" xmlns:Repl="http://schemas.microsoft.com/repl/" xmlns:mt="http://schemas.microsoft.com/sharepoint/soap/meetings/" xmlns:x2="http://schemas.microsoft.com/office/excel/2003/xml" xmlns:ppda="http://www.passport.com/NameSpace.xsd" xmlns:ois="http://schemas.microsoft.com/sharepoint/soap/ois/" xmlns:dir="http://schemas.microsoft.com/sharepoint/soap/directory/" xmlns:ds="http://www.w3.org/2000/09/xmldsig#" xmlns:dsp="http://schemas.microsoft.com/sharepoint/dsp" xmlns:udc="http://schemas.microsoft.com/data/udc" xmlns:xsd="http://www.w3.org/2001/XMLSchema" xmlns:sub="http://schemas.microsoft.com/sharepoint/soap/2002/1/alerts/" xmlns:ec="http://www.w3.org/2001/04/xmlenc#" xmlns:sp="http://schemas.microsoft.com/sharepoint/" xmlns:sps="http://schemas.microsoft.com/sharepoint/soap/" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xmlns:udcs="http://schemas.microsoft.com/data/udc/soap" xmlns:udcxf="http://schemas.microsoft.com/data/udc/xmlfile" xmlns:udcp2p="http://schemas.microsoft.com/data/udc/parttopart" xmlns:wf="http://schemas.microsoft.com/sharepoint/soap/workflow/" xmlns:dsss="http://schemas.microsoft.com/office/2006/digsig-setup" xmlns:dssi="http://schemas.microsoft.com/office/2006/digsig" xmlns:mdssi="http://schemas.openxmlformats.org/package/2006/digital-signature" xmlns:mver="http://schemas.openxmlformats.org/markup-compatibility/2006" xmlns:m="http://schemas.microsoft.com/office/2004/12/omml" xmlns:mrels="http://schemas.openxmlformats.org/package/2006/relationships" xmlns:spwp="http://microsoft.com/sharepoint/webpartpages" xmlns:ex12t="http://schemas.microsoft.com/exchange/services/2006/types" xmlns:ex12m="http://schemas.microsoft.com/exchange/services/2006/messages" xmlns:pptsl="http://schemas.microsoft.com/sharepoint/soap/SlideLibrary/" xmlns:spsl="http://microsoft.com/webservices/SharePointPortalServer/PublishedLinksService" xmlns:Z="urn:schemas-microsoft-com:" xmlns:st="" xmlns="http://www.w3.org/TR/REC-html40">
<head>
<meta http-equiv=Content-Type content="text/html; charset=iso-8859-1">
<meta name=Generator content="Microsoft Word 12 (filtered medium)">
<base href="x-msg://1226/">
<style>
<!--
/* Font Definitions */
@font-face
{font-family:Helvetica;
panose-1:2 11 6 4 2 2 2 2 2 4;}
@font-face
{font-family:Helvetica;
panose-1:2 11 6 4 2 2 2 2 2 4;}
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;}
@font-face
{font-family:Tahoma;
panose-1:2 11 6 4 3 5 4 4 2 4;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0in;
margin-bottom:.0001pt;
font-size:12.0pt;
font-family:"Times New Roman","serif";}
a:link, span.MsoHyperlink
{mso-style-priority:99;
color:blue;
text-decoration:underline;}
a:visited, span.MsoHyperlinkFollowed
{mso-style-priority:99;
color:purple;
text-decoration:underline;}
p.MsoListParagraph, li.MsoListParagraph, div.MsoListParagraph
{mso-style-priority:34;
margin-top:0in;
margin-right:0in;
margin-bottom:0in;
margin-left:.5in;
margin-bottom:.0001pt;
font-size:12.0pt;
font-family:"Times New Roman","serif";}
span.apple-style-span
{mso-style-name:apple-style-span;}
span.apple-converted-space
{mso-style-name:apple-converted-space;}
span.EmailStyle19
{mso-style-type:personal;
font-family:"Calibri","sans-serif";
color:#1F497D;}
span.EmailStyle20
{mso-style-type:personal-reply;
font-family:"Calibri","sans-serif";
color:#1F497D;}
.MsoChpDefault
{mso-style-type:export-only;
font-size:10.0pt;}
@page WordSection1
{size:8.5in 11.0in;
margin:70.85pt 70.85pt 56.7pt 70.85pt;}
div.WordSection1
{page:WordSection1;}
/* List Definitions */
@list l0
{mso-list-id:1572961928;
mso-list-type:hybrid;
mso-list-template-ids:-1116197536 67698705 67698713 67698715 67698703 67698713 67698715 67698703 67698713 67698715;}
@list l0:level1
{mso-level-text:"%1\)";
mso-level-tab-stop:none;
mso-level-number-position:left;
text-indent:-.25in;}
@list l1
{mso-list-id:1705591671;
mso-list-type:hybrid;
mso-list-template-ids:-1116197536 67698705 67698713 67698715 67698703 67698713 67698715 67698703 67698713 67698715;}
@list l1:level1
{mso-level-text:"%1\)";
mso-level-tab-stop:none;
mso-level-number-position:left;
text-indent:-.25in;}
ol
{margin-bottom:0in;}
ul
{margin-bottom:0in;}
-->
</style>
<!--[if gte mso 9]><xml>
<o:shapedefaults v:ext="edit" spidmax="1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext="edit">
<o:idmap v:ext="edit" data="1" />
</o:shapelayout></xml><![endif]-->
</head>
<body lang=EN-US link=blue vlink=purple>
<div class=WordSection1>
<p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";
color:#1F497D'>Hello guys,<o:p></o:p></span></p>
<p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";
color:#1F497D'><o:p> </o:p></span></p>
<p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";
color:#1F497D'>I have the same problem with XFS(without LVM), I tested newest(2.6.32-openvz-bykovsky.1)
kernel with patch provided in Bugzilla, and 2.6.27-openvz-briullov kernel the
results are almost the same is where work ground ? <o:p></o:p></span></p>
<p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";
color:#1F497D'><o:p> </o:p></span></p>
<p class=MsoNormal><b><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";
color:#1F497D'><o:p> </o:p></span></b></p>
<p class=MsoListParagraph style='text-indent:-.25in;mso-list:l0 level1 lfo1'><![if !supportLists]><b><span
style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'><span
style='mso-list:Ignore'>1)<span style='font:7.0pt "Times New Roman"'>
</span></span></span></b><![endif]><b><span style='font-size:11.0pt;font-family:
"Calibri","sans-serif";color:#1F497D'>With2.6.32-openvz-bykovsky.1 kernel and
patch:<o:p></o:p></span></b></p>
<p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";
color:#1F497D'>Command: uname -a<o:p></o:p></span></p>
<p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";
color:#1F497D'>Linux vps1_public 2.6.32-openvz-bykovsky.1 #1 SMP Mon Sep 13
18:12:07 EEST 2010 i686 Pentium(R) Dual-Core CPU E5200 @ 2.50GHz GenuineIntel
GNU/Linux<o:p></o:p></span></p>
<p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";
color:#1F497D'>Command: sysbench --test=fileio --file-num=1 --file-total-size=50G
--file-fsync-all=on --file-test-mode=seqrewr --max-time=100
--file-block-size=4096 --max-requests=0 run<o:p></o:p></span></p>
<p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";
color:#1F497D'>sysbench 0.4.10: multi-threaded system evaluation benchmark<o:p></o:p></span></p>
<p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";
color:#1F497D'><o:p> </o:p></span></p>
<p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";
color:#1F497D'>Running the test with following options:<o:p></o:p></span></p>
<p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";
color:#1F497D'>Number of threads: 1<o:p></o:p></span></p>
<p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";
color:#1F497D'><o:p> </o:p></span></p>
<p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";
color:#1F497D'>Extra file open flags: 0<o:p></o:p></span></p>
<p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";
color:#1F497D'>1 files, 50Gb each<o:p></o:p></span></p>
<p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";
color:#1F497D'>50Gb total file size<o:p></o:p></span></p>
<p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";
color:#1F497D'>Block size 4Kb<o:p></o:p></span></p>
<p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";
color:#1F497D'>Calling fsync() after each write operation.<o:p></o:p></span></p>
<p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";
color:#1F497D'>Using synchronous I/O mode<o:p></o:p></span></p>
<p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";
color:#1F497D'>Doing sequential rewrite test<o:p></o:p></span></p>
<p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";
color:#1F497D'>Threads started!<o:p></o:p></span></p>
<p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";
color:#1F497D'>Time limit exceeded, exiting...<o:p></o:p></span></p>
<p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";
color:#1F497D'>Done.<o:p></o:p></span></p>
<p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";
color:#1F497D'><o:p> </o:p></span></p>
<p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";
color:#1F497D'>Operations performed: 0 Read, 2372 Write, 2372 Other = 4744
Total<o:p></o:p></span></p>
<p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";
color:#1F497D'>Read 0b Written 9.2656Mb Total transferred 9.2656Mb
(94.86Kb/sec)<o:p></o:p></span></p>
<p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";
color:#1F497D'> 23.72 Requests/sec executed<o:p></o:p></span></p>
<p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";
color:#1F497D'><o:p> </o:p></span></p>
<p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";
color:#1F497D'>Test execution summary:<o:p></o:p></span></p>
<p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";
color:#1F497D'> total time: 100.0207s<o:p></o:p></span></p>
<p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";
color:#1F497D'> total number of events: 2372<o:p></o:p></span></p>
<p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";
color:#1F497D'> total time taken by event execution: 100.0155<o:p></o:p></span></p>
<p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";
color:#1F497D'> per-request statistics:<o:p></o:p></span></p>
<p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";
color:#1F497D'> min: 24.82ms<o:p></o:p></span></p>
<p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";
color:#1F497D'> avg: 42.17ms<o:p></o:p></span></p>
<p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";
color:#1F497D'> max: 132.44ms<o:p></o:p></span></p>
<p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";
color:#1F497D'> approx. 95 percentile: 66.20ms<o:p></o:p></span></p>
<p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";
color:#1F497D'><o:p> </o:p></span></p>
<p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";
color:#1F497D'>Threads fairness:<o:p></o:p></span></p>
<p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";
color:#1F497D'> events (avg/stddev): 2372.0000/0.00<o:p></o:p></span></p>
<p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";
color:#1F497D'> execution time (avg/stddev): 100.0155/0.00<o:p></o:p></span></p>
<p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";
color:#1F497D'><o:p> </o:p></span></p>
<p class=MsoListParagraph style='text-indent:-.25in;mso-list:l0 level1 lfo1'><![if !supportLists]><b><span
style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'><span
style='mso-list:Ignore'>2)<span style='font:7.0pt "Times New Roman"'>
</span></span></span></b><![endif]><b><span style='font-size:11.0pt;font-family:
"Calibri","sans-serif";color:#1F497D'>With 2.6.27-openvz-briullov.1 kernel:<o:p></o:p></span></b></p>
<p class=MsoListParagraph><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";
color:#1F497D'><o:p> </o:p></span></p>
<p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";
color:#1F497D'>Command: uname -a<o:p></o:p></span></p>
<p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";
color:#1F497D'>Linux vps1_public 2.6.27-openvz-briullov.1-r4ovz-i7 #1 SMP Thu
Dec 17 06:37:57 EET 2009 i686 Pentium(R) Dual-Core CPU E5200 @ 2.50GHz
GenuineIntel GNU/Linux<o:p></o:p></span></p>
<p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";
color:#1F497D'>Command: sysbench --test=fileio --file-num=1 --file-total-size=50G
--file-fsync-all=on --file-test-mode=seqrewr --max-time=100
--file-block-size=4096 --max-requests=0 run<o:p></o:p></span></p>
<p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";
color:#1F497D'>sysbench 0.4.10: multi-threaded system evaluation benchmark<o:p></o:p></span></p>
<p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";
color:#1F497D'><o:p> </o:p></span></p>
<p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";
color:#1F497D'>Running the test with following options:<o:p></o:p></span></p>
<p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";
color:#1F497D'>Number of threads: 1<o:p></o:p></span></p>
<p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";
color:#1F497D'><o:p> </o:p></span></p>
<p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";
color:#1F497D'>Extra file open flags: 0<o:p></o:p></span></p>
<p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";
color:#1F497D'>1 files, 50Gb each<o:p></o:p></span></p>
<p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";
color:#1F497D'>50Gb total file size<o:p></o:p></span></p>
<p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";
color:#1F497D'>Block size 4Kb<o:p></o:p></span></p>
<p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";
color:#1F497D'>Calling fsync() after each write operation.<o:p></o:p></span></p>
<p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";
color:#1F497D'>Using synchronous I/O mode<o:p></o:p></span></p>
<p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";
color:#1F497D'>Doing sequential rewrite test<o:p></o:p></span></p>
<p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";
color:#1F497D'>Threads started!<o:p></o:p></span></p>
<p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";
color:#1F497D'>Time limit exceeded, exiting...<o:p></o:p></span></p>
<p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";
color:#1F497D'>Done.<o:p></o:p></span></p>
<p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";
color:#1F497D'><o:p> </o:p></span></p>
<p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";
color:#1F497D'>Operations performed: 0 Read, 2245 Write, 2245 Other = 4490
Total<o:p></o:p></span></p>
<p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";
color:#1F497D'>Read 0b Written 8.7695Mb Total transferred 8.7695Mb
(89.757Kb/sec)<o:p></o:p></span></p>
<p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";
color:#1F497D'> 22.44 Requests/sec executed<o:p></o:p></span></p>
<p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";
color:#1F497D'><o:p> </o:p></span></p>
<p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";
color:#1F497D'>Test execution summary:<o:p></o:p></span></p>
<p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";
color:#1F497D'> total time: 100.0481s<o:p></o:p></span></p>
<p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";
color:#1F497D'> total number of events: 2245<o:p></o:p></span></p>
<p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";
color:#1F497D'> total time taken by event execution: 100.0430<o:p></o:p></span></p>
<p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";
color:#1F497D'> per-request statistics:<o:p></o:p></span></p>
<p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";
color:#1F497D'> min: 24.82ms<o:p></o:p></span></p>
<p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";
color:#1F497D'> avg: 44.56ms<o:p></o:p></span></p>
<p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";
color:#1F497D'> max: 149.03ms<o:p></o:p></span></p>
<p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";
color:#1F497D'> approx. 95 percentile: 74.47ms<o:p></o:p></span></p>
<p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";
color:#1F497D'><o:p> </o:p></span></p>
<p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";
color:#1F497D'>Threads fairness:<o:p></o:p></span></p>
<p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";
color:#1F497D'> events (avg/stddev): 2245.0000/0.00<o:p></o:p></span></p>
<p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";
color:#1F497D'> execution time (avg/stddev): 100.0430/0.00<o:p></o:p></span></p>
<p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";
color:#1F497D'><o:p> </o:p></span></p>
<div>
<div style='border:none;border-top:solid #B5C4DF 1.0pt;padding:3.0pt 0in 0in 0in'>
<p class=MsoNormal><b><span style='font-size:10.0pt;font-family:"Tahoma","sans-serif"'>From:</span></b><span
style='font-size:10.0pt;font-family:"Tahoma","sans-serif"'> users-bounces@openvz.org
[mailto:users-bounces@openvz.org] <b>On Behalf Of </b>Martin Maurer<br>
<b>Sent:</b> Thursday, September 02, 2010 17:21<br>
<b>To:</b> users@openvz.org<br>
<b>Cc:</b> Kirill Korotaev<br>
<b>Subject:</b> RE: [Users] RE: slow fsync rate<o:p></o:p></span></p>
</div>
</div>
<p class=MsoNormal><o:p> </o:p></p>
<p class=MsoNormal><span lang=DE-AT style='font-size:11.0pt;font-family:"Calibri","sans-serif";
color:#1F497D'>Hi Kir,<o:p></o:p></span></p>
<p class=MsoNormal><span lang=DE-AT style='font-size:11.0pt;font-family:"Calibri","sans-serif";
color:#1F497D'><o:p> </o:p></span></p>
<p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";
color:#1F497D'>Yes, we already see the fix and I can confirm that CFQ scheduler
is working again.<o:p></o:p></span></p>
<p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";
color:#1F497D'>We are already using it in our Proxmox VE, now also with OpenVZ
in the 2.6.32 kernel – released today.<o:p></o:p></span></p>
<p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";
color:#1F497D'><o:p> </o:p></span></p>
<p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";
color:#1F497D'>(my post was from 25.8, was held back due to size issues).<o:p></o:p></span></p>
<p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";
color:#1F497D'><o:p> </o:p></span></p>
<p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";
color:#1F497D'>Thanks,<o:p></o:p></span></p>
<p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";
color:#1F497D'>Br, martin<o:p></o:p></span></p>
<p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";
color:#1F497D'><o:p> </o:p></span></p>
<div style='border:none;border-left:solid blue 1.5pt;padding:0in 0in 0in 4.0pt'>
<div>
<div style='border:none;border-top:solid #B5C4DF 1.0pt;padding:3.0pt 0in 0in 0in'>
<p class=MsoNormal><b><span style='font-size:10.0pt;font-family:"Tahoma","sans-serif"'>From:</span></b><span
style='font-size:10.0pt;font-family:"Tahoma","sans-serif"'> Kirill Korotaev
[mailto:dev@parallels.com] <br>
<b>Sent:</b> Donnerstag, 02. September 2010 14:27<br>
<b>To:</b> users@openvz.org<br>
<b>Cc:</b> Martin Maurer<br>
<b>Subject:</b> Re: [Users] RE: slow fsync rate<o:p></o:p></span></p>
</div>
</div>
<p class=MsoNormal><span lang=DE-AT><o:p> </o:p></span></p>
<p class=MsoNormal><span lang=DE-AT>Pavel has already confirmed that this
is a problem of mainstream group CFS scheduler, see bug in bugzilla for fix.<o:p></o:p></span></p>
<div>
<p class=MsoNormal><span lang=DE-AT>Will be applied soon. Use deadline
scheduler for some time until it is fixed in the tree.<o:p></o:p></span></p>
<div>
<p class=MsoNormal><span lang=DE-AT><o:p> </o:p></span></p>
</div>
<div>
<p class=MsoNormal><span lang=DE-AT>Thanks,<o:p></o:p></span></p>
</div>
<div>
<p class=MsoNormal><span lang=DE-AT>Kirill<o:p></o:p></span></p>
</div>
<div>
<p class=MsoNormal><span lang=DE-AT><o:p> </o:p></span></p>
<div>
<p class=MsoNormal><span lang=DE-AT><o:p> </o:p></span></p>
<div>
<div>
<p class=MsoNormal><span lang=DE-AT>On Aug 25, 2010, at 10:33 , Martin Maurer
wrote:<o:p></o:p></span></p>
</div>
<p class=MsoNormal style='margin-bottom:12.0pt'><span lang=DE-AT><o:p> </o:p></span></p>
<div>
<div>
<p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";
color:#1F497D'>Hi Kir,</span><span lang=DE-AT><o:p></o:p></span></p>
</div>
<div>
<p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";
color:#1F497D'> </span><span lang=DE-AT><o:p></o:p></span></p>
</div>
<div>
<p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";
color:#1F497D'>Yes, the performance number shows that it does not use the cache
so if anyone want to run high load like a database on such a system the
performance loss will be significant and the system will be more or less
unusable (compared to current stable). I got this behavior ONLY with 2.6.32
OpenVZ kernels. E.g. also the standard Debian Squeeze Kernel give the expected
performance, the OpenVZ enabled kernel from Squeeze doesn´t. (see also<span
class=apple-converted-space> </span></span><span lang=DE-AT><a
href="http://lists.debian.org/debian-kernel/2010/08/msg00217.html"><span
lang=EN-US>http://lists.debian.org/debian-kernel/2010/08/msg00217.html</span></a></span>).<span
lang=DE-AT><o:p></o:p></span></p>
</div>
<div>
<p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";
color:#1F497D'> </span><span lang=DE-AT><o:p></o:p></span></p>
</div>
<div>
<p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";
color:#1F497D'>We tested on several hardware and distributions, e.g. with
single drives, hardware raid controllers with BBU – e.g. the Intel
Modular Server but also on single drives on ICH7/8/9. The logs always shows
that the disk has read and write cache enabled, but the values are just bad.</span><span
lang=DE-AT><o:p></o:p></span></p>
</div>
<div>
<p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";
color:#1F497D'> </span><span lang=DE-AT><o:p></o:p></span></p>
</div>
<div>
<p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";
color:#1F497D'>Can you reproduce the issue (just run the sysbench)?</span><span
lang=DE-AT><o:p></o:p></span></p>
</div>
<div>
<p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";
color:#1F497D'> </span><span lang=DE-AT><o:p></o:p></span></p>
</div>
<div>
<p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";
color:#1F497D'>Br, Martin</span><span lang=DE-AT><o:p></o:p></span></p>
</div>
<div>
<p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";
color:#1F497D'> </span><span lang=DE-AT><o:p></o:p></span></p>
</div>
<div style='border:none;border-left:solid blue 1.5pt;padding:0in 0in 0in 4.0pt;
border-width:initial;border-color:initial'>
<div>
<div style='border:none;border-top:solid #B5C4DF 1.0pt;padding:3.0pt 0in 0in 0in;
border-width:initial;border-color:initial'>
<div>
<p class=MsoNormal><b><span style='font-size:10.0pt;font-family:"Tahoma","sans-serif"'>From:</span></b><span
class=apple-converted-space><span style='font-size:10.0pt;font-family:"Tahoma","sans-serif"'> </span></span><span
style='font-size:10.0pt;font-family:"Tahoma","sans-serif"'><a
href="mailto:users-bounces@openvz.org">users-bounces@openvz.org</a><span
class=apple-converted-space> </span>[mailto:users-bounces@openvz.org]<span
class=apple-converted-space> </span><b>On Behalf Of<span
class=apple-converted-space> </span></b>Kirill Korotaev<br>
<b>Sent:</b><span class=apple-converted-space> </span>Dienstag, 24. August
2010 21:42<br>
<b>To:</b><span class=apple-converted-space> </span><a
href="mailto:users@openvz.org">users@openvz.org</a><br>
<b>Subject:</b><span class=apple-converted-space> </span>Re: [Users] RE:
slow fsync rate</span><span lang=DE-AT><o:p></o:p></span></p>
</div>
</div>
</div>
<div>
<p class=MsoNormal><span lang=DE-AT> <o:p></o:p></span></p>
</div>
<div>
<p class=MsoNormal><span lang=DE-AT>These numbers very much resemble fsync()
rate with write cache enabled (~1000/sec) and disabled (50-70/sec).<o:p></o:p></span></p>
</div>
<div>
<div>
<p class=MsoNormal><span lang=DE-AT>check write cache settings with hdparm +
check whether you have barrier mount option on ext3.<o:p></o:p></span></p>
</div>
</div>
<div>
<div>
<p class=MsoNormal><span lang=DE-AT> <o:p></o:p></span></p>
</div>
</div>
<div>
<div>
<p class=MsoNormal><span lang=DE-AT>I believe, 2.6.32 is just more honest on
fsync and really forces drive to save data. While earlier kernels<o:p></o:p></span></p>
</div>
</div>
<div>
<div>
<p class=MsoNormal><span lang=DE-AT>did this only with BARRIER mount option (or
ignored this problem at all)...<o:p></o:p></span></p>
</div>
</div>
<div>
<div>
<p class=MsoNormal><span lang=DE-AT> <o:p></o:p></span></p>
</div>
</div>
<div>
<div>
<p class=MsoNormal><span lang=DE-AT>Thanks,<o:p></o:p></span></p>
</div>
</div>
<div>
<div>
<p class=MsoNormal><span lang=DE-AT>Kirill<o:p></o:p></span></p>
</div>
</div>
<div>
<div>
<p class=MsoNormal><span lang=DE-AT> <o:p></o:p></span></p>
</div>
</div>
<div>
<div>
<div>
<p class=MsoNormal><span lang=DE-AT> <o:p></o:p></span></p>
</div>
<div>
<div>
<div>
<p class=MsoNormal><span lang=DE-AT>On Aug 24, 2010, at 22:53 , Martin Maurer
wrote:<o:p></o:p></span></p>
</div>
</div>
<div>
<p class=MsoNormal style='margin-bottom:12.0pt'><span lang=DE-AT><br>
<br>
<o:p></o:p></span></p>
</div>
<div>
<div>
<div>
<p class=MsoNormal><span lang=DE-AT style='font-size:11.0pt;font-family:"Calibri","sans-serif";
color:#1F497D'>Hi all,</span><span lang=DE-AT><o:p></o:p></span></p>
</div>
</div>
<div>
<div>
<p class=MsoNormal><span lang=DE-AT style='font-size:11.0pt;font-family:"Calibri","sans-serif";
color:#1F497D'> </span><span lang=DE-AT><o:p></o:p></span></p>
</div>
</div>
<div>
<div>
<p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";
color:#1F497D'>I just tested the latest OpenVZ kernel 2.6.32 (bykovsky) from
today with sysbench, I just got 63.12 Requests/sec executed (see below).</span><span
lang=DE-AT><o:p></o:p></span></p>
</div>
</div>
<div>
<div>
<p class=MsoNormal><span lang=DE-AT style='font-size:11.0pt;font-family:"Calibri","sans-serif";
color:#1F497D'>2.6.18 and 2.6.24 OpenVZ Kernels performs well, I
got 1074.81 Requests/sec executed.<span class=apple-converted-space> </span></span><span
style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'>What's
wrong here, why is the 2.6.32 branch so slow regarding fsyns/sec? (I am using
ext3)</span><span lang=DE-AT><o:p></o:p></span></p>
</div>
</div>
<div>
<div>
<p class=MsoNormal><span lang=DE-AT style='font-size:11.0pt;font-family:"Calibri","sans-serif";
color:#1F497D'>____</span><span lang=DE-AT><o:p></o:p></span></p>
</div>
</div>
<div>
<div>
<p class=MsoNormal><span lang=DE-AT style='font-size:11.0pt;font-family:"Calibri","sans-serif";
color:#1F497D'>OpenVZ 2.6.24:~# sysbench --test=fileio --file-num=1
--file-total-size=50G --file-fsync-all=on --file-test-mode=seqrewr
--max-time=100 --file-block-size=4096 --max-requests=0 run</span><span
lang=DE-AT><o:p></o:p></span></p>
</div>
</div>
<div>
<div>
<p class=MsoNormal><span lang=DE-AT style='font-size:11.0pt;font-family:"Calibri","sans-serif";
color:#1F497D'>sysbench 0.4.12: multi-threaded system evaluation
benchmark</span><span lang=DE-AT><o:p></o:p></span></p>
</div>
</div>
<div>
<div>
<p class=MsoNormal><span lang=DE-AT style='font-size:11.0pt;font-family:"Calibri","sans-serif";
color:#1F497D'> </span><span lang=DE-AT><o:p></o:p></span></p>
</div>
</div>
<div>
<div>
<p class=MsoNormal><span lang=DE-AT style='font-size:11.0pt;font-family:"Calibri","sans-serif";
color:#1F497D'>Running the test with following options:</span><span lang=DE-AT><o:p></o:p></span></p>
</div>
</div>
<div>
<div>
<p class=MsoNormal><span lang=DE-AT style='font-size:11.0pt;font-family:"Calibri","sans-serif";
color:#1F497D'>Number of threads: 1</span><span lang=DE-AT><o:p></o:p></span></p>
</div>
</div>
<div>
<div>
<p class=MsoNormal><span lang=DE-AT style='font-size:11.0pt;font-family:"Calibri","sans-serif";
color:#1F497D'> </span><span lang=DE-AT><o:p></o:p></span></p>
</div>
</div>
<div>
<div>
<p class=MsoNormal><span lang=DE-AT style='font-size:11.0pt;font-family:"Calibri","sans-serif";
color:#1F497D'>Extra file open flags: 0</span><span lang=DE-AT><o:p></o:p></span></p>
</div>
</div>
<div>
<div>
<p class=MsoNormal><span lang=DE-AT style='font-size:11.0pt;font-family:"Calibri","sans-serif";
color:#1F497D'>1 files, 50Gb each</span><span lang=DE-AT><o:p></o:p></span></p>
</div>
</div>
<div>
<div>
<p class=MsoNormal><span lang=DE-AT style='font-size:11.0pt;font-family:"Calibri","sans-serif";
color:#1F497D'>50Gb total file size</span><span lang=DE-AT><o:p></o:p></span></p>
</div>
</div>
<div>
<div>
<p class=MsoNormal><span lang=DE-AT style='font-size:11.0pt;font-family:"Calibri","sans-serif";
color:#1F497D'>Block size 4Kb</span><span lang=DE-AT><o:p></o:p></span></p>
</div>
</div>
<div>
<div>
<p class=MsoNormal><span lang=DE-AT style='font-size:11.0pt;font-family:"Calibri","sans-serif";
color:#1F497D'>Calling fsync() after each write operation.</span><span
lang=DE-AT><o:p></o:p></span></p>
</div>
</div>
<div>
<div>
<p class=MsoNormal><span lang=DE-AT style='font-size:11.0pt;font-family:"Calibri","sans-serif";
color:#1F497D'>Using synchronous I/O mode</span><span lang=DE-AT><o:p></o:p></span></p>
</div>
</div>
<div>
<div>
<p class=MsoNormal><span lang=DE-AT style='font-size:11.0pt;font-family:"Calibri","sans-serif";
color:#1F497D'>Doing sequential rewrite test</span><span lang=DE-AT><o:p></o:p></span></p>
</div>
</div>
<div>
<div>
<p class=MsoNormal><span lang=DE-AT style='font-size:11.0pt;font-family:"Calibri","sans-serif";
color:#1F497D'>Threads started!</span><span lang=DE-AT><o:p></o:p></span></p>
</div>
</div>
<div>
<div>
<p class=MsoNormal><span lang=DE-AT style='font-size:11.0pt;font-family:"Calibri","sans-serif";
color:#1F497D'>Time limit exceeded, exiting...</span><span lang=DE-AT><o:p></o:p></span></p>
</div>
</div>
<div>
<div>
<p class=MsoNormal><span lang=DE-AT style='font-size:11.0pt;font-family:"Calibri","sans-serif";
color:#1F497D'>Done.</span><span lang=DE-AT><o:p></o:p></span></p>
</div>
</div>
<div>
<div>
<p class=MsoNormal><span lang=DE-AT style='font-size:11.0pt;font-family:"Calibri","sans-serif";
color:#1F497D'> </span><span lang=DE-AT><o:p></o:p></span></p>
</div>
</div>
<div>
<div>
<p class=MsoNormal><span lang=DE-AT style='font-size:11.0pt;font-family:"Calibri","sans-serif";
color:#1F497D'>Operations performed: 0 Read, 107485 Write, 107485 Other =
214970 Total</span><span lang=DE-AT><o:p></o:p></span></p>
</div>
</div>
<div>
<div>
<p class=MsoNormal><span lang=DE-AT style='font-size:11.0pt;font-family:"Calibri","sans-serif";
color:#1F497D'>Read 0b Written 419.86Mb Total transferred
419.86Mb (4.1985Mb/sec)</span><span lang=DE-AT><o:p></o:p></span></p>
</div>
</div>
<div>
<div>
<p class=MsoNormal><span lang=DE-AT style='font-size:11.0pt;font-family:"Calibri","sans-serif";
color:#1F497D'>1074.81 Requests/sec executed</span><span lang=DE-AT><o:p></o:p></span></p>
</div>
</div>
<div>
<div>
<p class=MsoNormal><span lang=DE-AT style='font-size:11.0pt;font-family:"Calibri","sans-serif";
color:#1F497D'> </span><span lang=DE-AT><o:p></o:p></span></p>
</div>
</div>
<div>
<div>
<p class=MsoNormal><span lang=DE-AT style='font-size:11.0pt;font-family:"Calibri","sans-serif";
color:#1F497D'>Test execution summary:</span><span lang=DE-AT><o:p></o:p></span></p>
</div>
</div>
<div>
<div>
<p class=MsoNormal><span lang=DE-AT style='font-size:11.0pt;font-family:"Calibri","sans-serif";
color:#1F497D'> total
time:
100.0033s</span><span
lang=DE-AT><o:p></o:p></span></p>
</div>
</div>
<div>
<div>
<p class=MsoNormal><span lang=DE-AT style='font-size:11.0pt;font-family:"Calibri","sans-serif";
color:#1F497D'> total number of
events:
107485</span><span lang=DE-AT><o:p></o:p></span></p>
</div>
</div>
<div>
<div>
<p class=MsoNormal><span lang=DE-AT style='font-size:11.0pt;font-family:"Calibri","sans-serif";
color:#1F497D'> total time taken by event execution: 99.9460</span><span
lang=DE-AT><o:p></o:p></span></p>
</div>
</div>
<div>
<div>
<p class=MsoNormal><span lang=DE-AT style='font-size:11.0pt;font-family:"Calibri","sans-serif";
color:#1F497D'> per-request statistics:</span><span
lang=DE-AT><o:p></o:p></span></p>
</div>
</div>
<div>
<div>
<p class=MsoNormal><span lang=DE-AT style='font-size:11.0pt;font-family:"Calibri","sans-serif";
color:#1F497D'>
min:
0.54ms</span><span lang=DE-AT><o:p></o:p></span></p>
</div>
</div>
<div>
<div>
<p class=MsoNormal><span lang=DE-AT style='font-size:11.0pt;font-family:"Calibri","sans-serif";
color:#1F497D'>
avg:
0.93ms</span><span lang=DE-AT><o:p></o:p></span></p>
</div>
</div>
<div>
<div>
<p class=MsoNormal><span lang=DE-AT style='font-size:11.0pt;font-family:"Calibri","sans-serif";
color:#1F497D'>
max:
97.34ms</span><span lang=DE-AT><o:p></o:p></span></p>
</div>
</div>
<div>
<div>
<p class=MsoNormal><span lang=DE-AT style='font-size:11.0pt;font-family:"Calibri","sans-serif";
color:#1F497D'> approx.
95
percentile:
0.87ms</span><span lang=DE-AT><o:p></o:p></span></p>
</div>
</div>
<div>
<div>
<p class=MsoNormal><span lang=DE-AT style='font-size:11.0pt;font-family:"Calibri","sans-serif";
color:#1F497D'> </span><span lang=DE-AT><o:p></o:p></span></p>
</div>
</div>
<div>
<div>
<p class=MsoNormal><span lang=DE-AT style='font-size:11.0pt;font-family:"Calibri","sans-serif";
color:#1F497D'>Threads fairness:</span><span lang=DE-AT><o:p></o:p></span></p>
</div>
</div>
<div>
<div>
<p class=MsoNormal><span lang=DE-AT style='font-size:11.0pt;font-family:"Calibri","sans-serif";
color:#1F497D'> events
(avg/stddev):
107485.0000/0.00</span><span lang=DE-AT><o:p></o:p></span></p>
</div>
</div>
<div>
<div>
<p class=MsoNormal><span lang=DE-AT style='font-size:11.0pt;font-family:"Calibri","sans-serif";
color:#1F497D'> execution time (avg/stddev):
99.9460/0.00</span><span lang=DE-AT><o:p></o:p></span></p>
</div>
</div>
<div>
<div>
<p class=MsoNormal><span lang=DE-AT style='font-size:11.0pt;font-family:"Calibri","sans-serif";
color:#1F497D'> </span><span lang=DE-AT><o:p></o:p></span></p>
</div>
</div>
<div>
<div>
<p class=MsoNormal><span lang=DE-AT style='font-size:11.0pt;font-family:"Calibri","sans-serif";
color:#1F497D'>_____</span><span lang=DE-AT><o:p></o:p></span></p>
</div>
</div>
<div>
<div>
<p class=MsoNormal><span lang=DE-AT style='font-size:11.0pt;font-family:"Calibri","sans-serif";
color:#1F497D'> </span><span lang=DE-AT><o:p></o:p></span></p>
</div>
</div>
<div>
<div>
<p class=MsoNormal><span lang=DE-AT style='font-size:11.0pt;font-family:"Calibri","sans-serif";
color:#1F497D'> </span><span lang=DE-AT><o:p></o:p></span></p>
</div>
</div>
<div>
<div>
<p class=MsoNormal><span lang=DE-AT style='font-size:11.0pt;font-family:"Calibri","sans-serif";
color:#1F497D'>Testing newest Kernel: 2.6.32-bykovsky.1 #1 SMP Mon Aug 23
19:59:54 MSD 2010 x86_64</span><span lang=DE-AT><o:p></o:p></span></p>
</div>
</div>
<div>
<div>
<p class=MsoNormal><span lang=DE-AT style='font-size:11.0pt;font-family:"Calibri","sans-serif";
color:#1F497D'> </span><span lang=DE-AT><o:p></o:p></span></p>
</div>
</div>
<div>
<div>
<p class=MsoNormal><span lang=DE-AT style='font-size:11.0pt;font-family:"Calibri","sans-serif";
color:#1F497D'>I just got 63.12 Requests/sec executed. Here are the details,
can someone reproduce this?</span><span lang=DE-AT><o:p></o:p></span></p>
</div>
</div>
<div>
<div>
<p class=MsoNormal><span lang=DE-AT style='font-size:11.0pt;font-family:"Calibri","sans-serif";
color:#1F497D'>_____</span><span lang=DE-AT><o:p></o:p></span></p>
</div>
</div>
<div>
<div>
<p class=MsoNormal><span lang=DE-AT style='font-size:11.0pt;font-family:"Calibri","sans-serif";
color:#1F497D'>OpenVZ 2.6.32:~# sysbench --test=fileio --file-num=1
--file-total-size=50G --file-fsync-all=on --file-test-mode=seqrewr
--max-time=100 --file-block-size=4096 --max-requests=0 run</span><span
lang=DE-AT><o:p></o:p></span></p>
</div>
</div>
<div>
<div>
<p class=MsoNormal><span lang=DE-AT style='font-size:11.0pt;font-family:"Calibri","sans-serif";
color:#1F497D'> </span><span lang=DE-AT><o:p></o:p></span></p>
</div>
</div>
<div>
<div>
<p class=MsoNormal><span lang=DE-AT style='font-size:11.0pt;font-family:"Calibri","sans-serif";
color:#1F497D'>sysbench 0.4.12: multi-threaded system evaluation
benchmark</span><span lang=DE-AT><o:p></o:p></span></p>
</div>
</div>
<div>
<div>
<p class=MsoNormal><span lang=DE-AT style='font-size:11.0pt;font-family:"Calibri","sans-serif";
color:#1F497D'> </span><span lang=DE-AT><o:p></o:p></span></p>
</div>
</div>
<div>
<div>
<p class=MsoNormal><span lang=DE-AT style='font-size:11.0pt;font-family:"Calibri","sans-serif";
color:#1F497D'>Running the test with following options:</span><span lang=DE-AT><o:p></o:p></span></p>
</div>
</div>
<div>
<div>
<p class=MsoNormal><span lang=DE-AT style='font-size:11.0pt;font-family:"Calibri","sans-serif";
color:#1F497D'>Number of threads: 1</span><span lang=DE-AT><o:p></o:p></span></p>
</div>
</div>
<div>
<div>
<p class=MsoNormal><span lang=DE-AT style='font-size:11.0pt;font-family:"Calibri","sans-serif";
color:#1F497D'> </span><span lang=DE-AT><o:p></o:p></span></p>
</div>
</div>
<div>
<div>
<p class=MsoNormal><span lang=DE-AT style='font-size:11.0pt;font-family:"Calibri","sans-serif";
color:#1F497D'>Extra file open flags: 0</span><span lang=DE-AT><o:p></o:p></span></p>
</div>
</div>
<div>
<div>
<p class=MsoNormal><span lang=DE-AT style='font-size:11.0pt;font-family:"Calibri","sans-serif";
color:#1F497D'>1 files, 50Gb each</span><span lang=DE-AT><o:p></o:p></span></p>
</div>
</div>
<div>
<div>
<p class=MsoNormal><span lang=DE-AT style='font-size:11.0pt;font-family:"Calibri","sans-serif";
color:#1F497D'>50Gb total file size</span><span lang=DE-AT><o:p></o:p></span></p>
</div>
</div>
<div>
<div>
<p class=MsoNormal><span lang=DE-AT style='font-size:11.0pt;font-family:"Calibri","sans-serif";
color:#1F497D'>Block size 4Kb</span><span lang=DE-AT><o:p></o:p></span></p>
</div>
</div>
<div>
<div>
<p class=MsoNormal><span lang=DE-AT style='font-size:11.0pt;font-family:"Calibri","sans-serif";
color:#1F497D'>Calling fsync() after each write operation.</span><span
lang=DE-AT><o:p></o:p></span></p>
</div>
</div>
<div>
<div>
<p class=MsoNormal><span lang=DE-AT style='font-size:11.0pt;font-family:"Calibri","sans-serif";
color:#1F497D'>Using synchronous I/O mode</span><span lang=DE-AT><o:p></o:p></span></p>
</div>
</div>
<div>
<div>
<p class=MsoNormal><span lang=DE-AT style='font-size:11.0pt;font-family:"Calibri","sans-serif";
color:#1F497D'>Doing sequential rewrite test</span><span lang=DE-AT><o:p></o:p></span></p>
</div>
</div>
<div>
<div>
<p class=MsoNormal><span lang=DE-AT style='font-size:11.0pt;font-family:"Calibri","sans-serif";
color:#1F497D'>Threads started!</span><span lang=DE-AT><o:p></o:p></span></p>
</div>
</div>
<div>
<div>
<p class=MsoNormal><span lang=DE-AT style='font-size:11.0pt;font-family:"Calibri","sans-serif";
color:#1F497D'>Time limit exceeded, exiting...</span><span lang=DE-AT><o:p></o:p></span></p>
</div>
</div>
<div>
<div>
<p class=MsoNormal><span lang=DE-AT style='font-size:11.0pt;font-family:"Calibri","sans-serif";
color:#1F497D'>Done.</span><span lang=DE-AT><o:p></o:p></span></p>
</div>
</div>
<div>
<div>
<p class=MsoNormal><span lang=DE-AT style='font-size:11.0pt;font-family:"Calibri","sans-serif";
color:#1F497D'> </span><span lang=DE-AT><o:p></o:p></span></p>
</div>
</div>
<div>
<div>
<p class=MsoNormal><span lang=DE-AT style='font-size:11.0pt;font-family:"Calibri","sans-serif";
color:#1F497D'>Operations performed: 0 Read, 6312 Write, 6312 Other =
12624 Total</span><span lang=DE-AT><o:p></o:p></span></p>
</div>
</div>
<div>
<div>
<p class=MsoNormal><span lang=DE-AT style='font-size:11.0pt;font-family:"Calibri","sans-serif";
color:#1F497D'>Read 0b Written 24.656Mb Total transferred
24.656Mb (252.46Kb/sec)</span><span lang=DE-AT><o:p></o:p></span></p>
</div>
</div>
<div>
<div>
<p class=MsoNormal><span lang=DE-AT style='font-size:11.0pt;font-family:"Calibri","sans-serif";
color:#1F497D'> 63.12 Requests/sec executed</span><span lang=DE-AT><o:p></o:p></span></p>
</div>
</div>
<div>
<div>
<p class=MsoNormal><span lang=DE-AT style='font-size:11.0pt;font-family:"Calibri","sans-serif";
color:#1F497D'> </span><span lang=DE-AT><o:p></o:p></span></p>
</div>
</div>
<div>
<div>
<p class=MsoNormal><span lang=DE-AT style='font-size:11.0pt;font-family:"Calibri","sans-serif";
color:#1F497D'>Test execution summary:</span><span lang=DE-AT><o:p></o:p></span></p>
</div>
</div>
<div>
<div>
<p class=MsoNormal><span lang=DE-AT style='font-size:11.0pt;font-family:"Calibri","sans-serif";
color:#1F497D'> total
time:
100.0070s</span><span lang=DE-AT><o:p></o:p></span></p>
</div>
</div>
<div>
<div>
<p class=MsoNormal><span lang=DE-AT style='font-size:11.0pt;font-family:"Calibri","sans-serif";
color:#1F497D'> total number of
events:
6312</span><span lang=DE-AT><o:p></o:p></span></p>
</div>
</div>
<div>
<div>
<p class=MsoNormal><span lang=DE-AT style='font-size:11.0pt;font-family:"Calibri","sans-serif";
color:#1F497D'> total time taken by event execution: 99.9838</span><span
lang=DE-AT><o:p></o:p></span></p>
</div>
</div>
<div>
<div>
<p class=MsoNormal><span lang=DE-AT style='font-size:11.0pt;font-family:"Calibri","sans-serif";
color:#1F497D'> per-request statistics:</span><span
lang=DE-AT><o:p></o:p></span></p>
</div>
</div>
<div>
<div>
<p class=MsoNormal><span lang=DE-AT style='font-size:11.0pt;font-family:"Calibri","sans-serif";
color:#1F497D'>
min:
7.70ms</span><span lang=DE-AT><o:p></o:p></span></p>
</div>
</div>
<div>
<div>
<p class=MsoNormal><span lang=DE-AT style='font-size:11.0pt;font-family:"Calibri","sans-serif";
color:#1F497D'>
avg:
15.84ms</span><span lang=DE-AT><o:p></o:p></span></p>
</div>
</div>
<div>
<div>
<p class=MsoNormal><span lang=DE-AT style='font-size:11.0pt;font-family:"Calibri","sans-serif";
color:#1F497D'>
max:
260.40ms</span><span
lang=DE-AT><o:p></o:p></span></p>
</div>
</div>
<div>
<div>
<p class=MsoNormal><span lang=DE-AT style='font-size:11.0pt;font-family:"Calibri","sans-serif";
color:#1F497D'> approx.
95
percentile:
16.70ms</span><span lang=DE-AT><o:p></o:p></span></p>
</div>
</div>
<div>
<div>
<p class=MsoNormal><span lang=DE-AT style='font-size:11.0pt;font-family:"Calibri","sans-serif";
color:#1F497D'> </span><span lang=DE-AT><o:p></o:p></span></p>
</div>
</div>
<div>
<div>
<p class=MsoNormal><span lang=DE-AT style='font-size:11.0pt;font-family:"Calibri","sans-serif";
color:#1F497D'>Threads fairness:</span><span lang=DE-AT><o:p></o:p></span></p>
</div>
</div>
<div>
<div>
<p class=MsoNormal><span lang=DE-AT style='font-size:11.0pt;font-family:"Calibri","sans-serif";
color:#1F497D'> events
(avg/stddev):
6312.0000/0.00</span><span lang=DE-AT><o:p></o:p></span></p>
</div>
</div>
<div>
<div>
<p class=MsoNormal><span lang=DE-AT style='font-size:11.0pt;font-family:"Calibri","sans-serif";
color:#1F497D'> execution time (avg/stddev):
99.9838/0.00</span><span lang=DE-AT><o:p></o:p></span></p>
</div>
</div>
<div>
<div>
<p class=MsoNormal><span lang=DE-AT style='font-size:11.0pt;font-family:"Calibri","sans-serif";
color:#1F497D'>___</span><span lang=DE-AT><o:p></o:p></span></p>
</div>
</div>
<div>
<div>
<p class=MsoNormal><span lang=DE-AT style='font-size:11.0pt;font-family:"Calibri","sans-serif";
color:#1F497D'> </span><span lang=DE-AT><o:p></o:p></span></p>
</div>
</div>
<div>
<div>
<p class=MsoNormal><span lang=DE-AT style='font-size:11.0pt;font-family:"Calibri","sans-serif";
color:#1F497D'>Br, Martin</span><span lang=DE-AT><o:p></o:p></span></p>
</div>
</div>
<div>
<div>
<p class=MsoNormal><span lang=DE-AT style='font-size:11.0pt;font-family:"Calibri","sans-serif";
color:#1F497D'> </span><span lang=DE-AT><o:p></o:p></span></p>
</div>
</div>
<div style='border:none;border-left:solid windowtext 3.0pt;padding:0in 0in 0in 4.0pt;
border-width:initial;border-color:initial;border-width:initial;border-color:
initial'>
<div>
<div style='border:none;border-top:solid windowtext 3.0pt;padding:3.0pt 0in 0in 0in;
border-width:initial;border-color:initial;border-width:initial;border-color:
initial'>
<div>
<div>
<p class=MsoNormal><b><span style='font-size:10.0pt;font-family:"Tahoma","sans-serif"'>From:</span></b><span
class=apple-converted-space><span style='font-size:10.0pt;font-family:"Tahoma","sans-serif"'> </span></span><span
style='font-size:10.0pt;font-family:"Tahoma","sans-serif"'><a
href="mailto:users-bounces@openvz.org">users-bounces@openvz.org</a><span
class=apple-converted-space> </span>[mailto:users-bounces@openvz.org]<span
class=apple-converted-space> </span><b>On Behalf Of<span
class=apple-converted-space> </span></b>Dietmar Maurer<br>
<b>Sent:</b><span class=apple-converted-space> </span>Dienstag, 24. August
2010 10:36<br>
<b>To:</b><span class=apple-converted-space> </span><a
href="mailto:users@openvz.org">users@openvz.org</a><br>
<b>Subject:</b><span class=apple-converted-space> </span>[Users] slow fsync
rate</span><span lang=DE-AT><o:p></o:p></span></p>
</div>
</div>
</div>
</div>
<div>
<div>
<p class=MsoNormal><span lang=DE-AT style='font-size:11.0pt;font-family:"Calibri","sans-serif"'> </span><span
lang=DE-AT><o:p></o:p></span></p>
</div>
</div>
<div>
<div>
<p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif"'>Hi
all,</span><span lang=DE-AT><o:p></o:p></span></p>
</div>
</div>
<div>
<div>
<p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif"'> </span><span
lang=DE-AT><o:p></o:p></span></p>
</div>
</div>
<div>
<div>
<p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif"'>we
observe very slow fsync rates on newer 2.6.32 kernel with OpenVZ:</span><span
lang=DE-AT><o:p></o:p></span></p>
</div>
</div>
<div>
<div>
<p class=MsoNormal><span lang=DE-AT style='font-size:11.0pt;font-family:"Calibri","sans-serif"'> </span><span
lang=DE-AT><o:p></o:p></span></p>
</div>
</div>
<div>
<div>
<p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif"'>It
is possible to reproduce the problem with sysbench:</span><span lang=DE-AT><o:p></o:p></span></p>
</div>
</div>
<div>
<div>
<p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif"'> </span><span
lang=DE-AT><o:p></o:p></span></p>
</div>
</div>
<div>
<div>
<p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif"'>#
sysbench --test=fileio --file-num=1 --file-total-size=50G --file-fsync-all=on
--file-test-mode=seqrewr --max-time=100 --file-block-size=4096 --max-requests=0
run</span><span lang=DE-AT><o:p></o:p></span></p>
</div>
</div>
<div>
<div>
<p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif"'> </span><span
lang=DE-AT><o:p></o:p></span></p>
</div>
</div>
<div>
<div>
<p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif"'>Requests/sec
executed is considerable slower on OpenVZ kernel (factor 20 on Intel Modular
Server).</span><span lang=DE-AT><o:p></o:p></span></p>
</div>
</div>
<div>
<div>
<p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif"'> </span><span
lang=DE-AT><o:p></o:p></span></p>
</div>
</div>
<div>
<div>
<p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif"'>Can
someone reproduce that problem?</span><span lang=DE-AT><o:p></o:p></span></p>
</div>
</div>
<div>
<div>
<p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif"'> </span><span
lang=DE-AT><o:p></o:p></span></p>
</div>
</div>
<div>
<div>
<p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif"'>-
Dietmar</span><span lang=DE-AT><o:p></o:p></span></p>
</div>
</div>
<div>
<div>
<p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif"'> </span><span
lang=DE-AT><o:p></o:p></span></p>
</div>
</div>
<div>
<div>
<p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif"'> </span><span
lang=DE-AT><o:p></o:p></span></p>
</div>
</div>
</div>
<div>
<p class=MsoNormal><span lang=DE-AT style='font-size:13.5pt;font-family:"Helvetica","sans-serif"'><ATT00001..c></span><span
lang=DE-AT><o:p></o:p></span></p>
</div>
</div>
</div>
<div>
<p class=MsoNormal><span lang=DE-AT> <o:p></o:p></span></p>
</div>
</div>
</div>
</div>
<p class=MsoNormal><span lang=DE-AT style='font-size:13.5pt;font-family:"Helvetica","sans-serif"'><ATT00001..c><o:p></o:p></span></p>
</div>
</div>
<p class=MsoNormal><span lang=DE-AT><o:p> </o:p></span></p>
</div>
</div>
</div>
</div>
</div>
</body>
</html>