[Users] Re: Bug#636463: vzctl: /etc/vz/dists/scripts/postcreate.sh
randomises run-times in /etc/crontab, but not cron.d
Ola Lundqvist
ola at inguza.com
Wed Aug 10 00:47:02 EDT 2011
Hi Tim
On Tue, Aug 09, 2011 at 10:27:15AM +0100, Tim Small wrote:
> cc'ing openvz users mailing list, as this has been discussed there recently.
>
> On 04/08/11 06:36, Ola Lundqvist wrote:
>
> > This is certainly an interesting problem. The patch is a good start but
> > as we can foresee problems already now we need to find out a solution
> > to that before it is applied.
> >
>
> I agree.
>
> > There is also one other problem. It is just a very limited number of
> > files that are actually installed during the initial install when
> > postcreate.sh is executing. Actually on my computer it was only anacron
> > that hold a file in that directory (that I have not created myself or installed
> > post initial install).
> >
>
> This I suppose depends on the particular site's style of working - if
> you have "fat" VZ templates it's likely to be OK? Or maybe I've
> misunderstood when this script gets called.
Yes you are right. For "fat" VZ templates it would be more likely to
be ok.
> > All other applications will have the same problem as before.
> >
> > I can see two solutions:
> > 1) postcreate.sh go through only the files that are actually created
> > on initial install and touch them in a similar way as your patch.
> > 2) A new tool is introduced that should be run by the system administrator.
> >
> > Do you have any opinion about this?
> >
>
> Difficult to see the best answer here, and indeed it's a problem which
> is not OpenVZ-specific of course - it's equally valid across any
> virtualised instance of Debian - which is becoming more and more the
> normal way to deploy servers.
Even across any virtualize unix system using cron. :-)
> For that matter, you can definitely see when cron.daily fires off by
> default at 6.25 every morning on this traffic graph for
> ftp.uk.debian.org - http://www.hands.com/mrtg/free.eth0.html - and I've
> experienced problems with jobs like backups running all-at-the-same-time
> via default crontab setups on networks of non-virtualised servers.
I have experienced this myself so I fully trust you. I mean there is a reason
why the cron config is rewritten.
> As virtualised instances of Debian become more and more common, maybe
> it's something that needs to be solved for the general case at package
> install time? Crontabs installed by packages could have meta-info
> included to indicate whether the crontab entries should be perturbed,
> and if-so, by how much?
That would be a way. Or even the package could randomize it on itself.
I mean the same thing happens on physical servers as well if you have
many of them.
> This is obviously not a small change, but having thought about it for a
> while, other possible approaches probably have the possibility of
> breaking the packages which they alter, and not fixing things in the
> general case?
>
> I suppose it's something that could be prototyped in OpenVZ (e.g. by
> shipping the meta-data separately from the packages initially, and only
> perturbing crontabs which are "opt-in") - in our experience it was only
> a small subset of crontabs which caused the problem (mysql and logcheck
> were the biggest ones, if I remember correctly).
I'm leaning on submitting wishlist bug requests on packages that can
cause a load on external functions (network or similar) to randomize
their cron file.
Best regards,
// Ola
> Tim.
>
> p.s. a quick bit of research seems to show up the problem coming up
> again and again...
>
> https://bugs.launchpad.net/debian/+source/cron/+bug/672303
>
> http://projects.puppetlabs.com/projects/1/wiki/Cron_Patterns
>
> http://bugs.debian.org/cgi-bin/bugreport.cgi?bug=373152
>
> etc. etc.
>
>
> --
> South East Open Source Solutions Limited
> Registered in England and Wales with company number 06134732.
> Registered Office: 2 Powell Gardens, Redhill, Surrey, RH1 1TQ
> VAT number: 900 6633 53 http://seoss.co.uk/ +44-(0)1273-808309
>
>
--
--- Inguza Technology AB --- MSc in Information Technology ----
/ ola at inguza.com Annebergsslingan 37 \
| opal at debian.org 654 65 KARLSTAD |
| http://inguza.com/ Mobile: +46 (0)70-332 1551 |
\ gpg/f.p.: 7090 A92B 18FE 7994 0C36 4FE4 18A1 B1CF 0FE5 3DD9 /
---------------------------------------------------------------
More information about the Users
mailing list