[Users] virtuozzo base OS and new centos 8 orientations

Wed Mar 2 21:18:57 MSK 2022

Hi,

yes, we have added support for centos-8-stream not long ago. Not tested deeply yet, but should work in general.
________________________________
From: jehan.procaccia at tem-tsp.eu <jehan.procaccia at tem-tsp.eu>
Sent: Wednesday, March 2, 2022 8:20 PM
To: OpenVZ users <users at openvz.org>; Denis Silakov <dsilakov at virtuozzo.com>
Subject: Re: [Users] virtuozzo base OS and new centos 8 orientations

Hello

back to that thread regarding migration from centos8 and vzlinux8 (https://docs.virtuozzo.com/virtuozzo_linux_8_quick_start_guide/converting-from-centos/converting-from-centos8.html )

it did worked from centos8 base until 31/12/2021 , but will it work on centos8-stream systems ?

I have since 01/01/2022 moved some CTs to centos8-stream , will I be abled to move to vzlinux from centos8-stream latter ?

Thanks .

Le 24/04/2021 à 17:36, Denis Silakov a écrit :
I think there is no need to increase ulimit inside the CT since most operations are performed from the node side.

I've added ulimit tweak to the tool itself, will build it soon.
________________________________
From: users-bounces at openvz.org<mailto:users-bounces at openvz.org> <users-bounces at openvz.org><mailto:users-bounces at openvz.org> on behalf of Jehan PROCACCIA <jehan.procaccia at tem-tsp.eu><mailto:jehan.procaccia at tem-tsp.eu>
Sent: Saturday, April 24, 2021 12:32 PM
To: OpenVZ users <users at openvz.org><mailto:users at openvz.org>
Subject: Re: [Users] virtuozzo base OS and new centos 8 orientations

ok I increased to 10240 and it completed successfully now , thanks :

on the Hyoervisor:
# grep NUMFILE /etc/vz/conf/7ed1de35-75bc-4137-977a-b4055067fb0a.conf
NUMFILE="10240"
# ulimit -n 10240

this second command may not be needed, I wondered if the 10240 numfile ulimit needs to be set inside the container or on the hypervisor ?

# vzconvert8 convert --log /tmp/idp4mt-convovz8.logidp4mt  idp4mt
...
rdma-core              x86_64    32.0-3.vl8
zstd                   x86_64    1.4.4-1.vl8
7ed1de35-75bc-4137-977a-b4055067fb0a: Warning!
The following packages were added compared to CentOS 8:['nss.x86_64', 'nspr.x86_64', 'binutils.x86_64', 'nss-softokn-freebl.x86_64', 'nss-sysinit.x86_64', 'nss-util.x86_64', 'nss-softokn.x86_64']
7ed1de35-75bc-4137-977a-b4055067fb0a: Conversion successful at 11:19:29.385333

inside the CT
# cat /etc/redhat-release
Virtuozzo Linux release 8

________________________________
De: "Denis Silakov" <dsilakov at virtuozzo.com><mailto:dsilakov at virtuozzo.com>
À: "jehan procaccia" <jehan.procaccia at imtbs-tsp.eu><mailto:jehan.procaccia at imtbs-tsp.eu>
Cc: "OpenVZ users" <users at openvz.org><mailto:users at openvz.org>
Envoyé: Samedi 24 Avril 2021 07:16:00
Objet: Re: [Users] virtuozzo base OS and new centos 8 orientations

Yes. 'ulimit -n 10240' before the conversion could help.
________________________________
From: Jehan PROCACCIA <jehan.procaccia at imtbs-tsp.eu><mailto:jehan.procaccia at imtbs-tsp.eu>
Sent: Friday, April 23, 2021 10:37 PM
To: Denis Silakov <dsilakov at virtuozzo.com><mailto:dsilakov at virtuozzo.com>
Cc: OpenVZ users <users at openvz.org><mailto:users at openvz.org>
Subject: Re: [Users] virtuozzo base OS and new centos 8 orientations

OK, I revert to a previous snapshot, not sure I took the correct one though (anyway, tah CT is a test, I don't care to loose it ..)

# prlctl snapshot-list idp4mt
PARENT_SNAPSHOT_ID                      SNAPSHOT_ID
                                        {6a5c1dcf-776e-4011-a935-06b186c38541}
{6a5c1dcf-776e-4011-a935-06b186c38541} *{6703557b-e46c-4437-877a-ca3d8f917d79}
# prlctl snapshot-list idpmt4
PARENT_SNAPSHOT_ID                      SNAPSHOT_ID
[root at olympos ~]# prlctl snapshot-switch idp4mt --id 6a5c1dcf-776e-4011-a935-06b186c38541

so I set NUMFILE in CT this way :

# grep NUMFILE /etc/vz/conf/7ed1de35-75bc-4137-977a-b4055067fb0a.conf
NUMFILE="4096"

# vzconvert8 convert --log /tmp/idp4mt-convovz8.logidp4mt  idp4mt
7ed1de35-75bc-4137-977a-b4055067fb0a: Creating the snapshot...
The snapshot with id {e4d44103-1aa8-4040-bc1b-4161e234e0c4} has been successfully created.

Starting conversion: 7ed1de35-75bc-4137-977a-b4055067fb0a at 21:33:22.250234
...
Transaction Summary
================================================================================
Install   31 Packages
Upgrade  582 Packages

Total size: 381 M
Downloading Packages:
[SKIPPED] libmodulemd1-1.8.16-0.2.9.4.2.x86_64.rpm: Already downloaded
[SKIPPED] annobin-9.35-1.vl8.x86_64.rpm: Already downloaded
..
Running scriptlet: filesystem-3.8-3.vl8.x86_64                            1/1

Preparing        :                                                        1/1
Running scriptlet: libgcc-8.4.1-1.vl8.x86_64                              1/1Error: Cannot open file /vz/template/vzlinux/8/x86_64/pm/base0-b1ad5fe4dfeb5b55/packages/python3-six-1.15.0-8.vl8.2.noarch.rpm: [Errno 24] Too many open files: '/vz/template/vzlinux/8/x86_64/pm/base0-b1ad5fe4dfeb5b55/packages/python3-six-1.15.0-8.vl8.2.noarch.rpm'
FATAL ERROR: python callback ??? failed, aborting!
Error: /usr/share/vzyum/bin/yum failed, exitcode=1
7ed1de35-75bc-4137-977a-b4055067fb0a: Conversion successful at 21:33:41.692332

Did I miss to increase ulimit ?

thanks .

________________________________
De: "Denis Silakov" <dsilakov at virtuozzo.com><mailto:dsilakov at virtuozzo.com>
À: "jehan procaccia" <jehan.procaccia at imtbs-tsp.eu><mailto:jehan.procaccia at imtbs-tsp.eu>
Cc: "OpenVZ users" <users at openvz.org><mailto:users at openvz.org>
Envoyé: Vendredi 23 Avril 2021 21:09:47
Objet: Re: [Users] virtuozzo base OS and new centos 8 orientations

Agrh, "Too many open files" is the reason, you should increase your ulimit values. We have already discussed this in the list and likely we should change ulimits directly from script for the time of its work.

And yes, I would recommend to revert container to pre-convert state. vzconvert automatically creates snapshot every time it is launch, you can simply use "prlctl snapshot-switch" (and btw, if you performed several conversion attempts, you can already have multiple snapshots)
________________________________
From: Jehan PROCACCIA <jehan.procaccia at imtbs-tsp.eu><mailto:jehan.procaccia at imtbs-tsp.eu>
Sent: Friday, April 23, 2021 10:03 PM
To: Denis Silakov <dsilakov at virtuozzo.com><mailto:dsilakov at virtuozzo.com>
Cc: OpenVZ users <users at openvz.org><mailto:users at openvz.org>
Subject: Re: [Users] virtuozzo base OS and new centos 8 orientations

OK, indeed there was

OSTEMPLATE=".vzlinux-8-x86_64"
TECHNOLOGIES="x86_64 nptl "
DISTRIBUTION="centos"
OSRELEASE="4.18.0"

I changed OSTEMPLATE back to :
OSTEMPLATE=".centos-8-x86_64"

now it goes on :

# vzconvert8 convert --log /tmp/idp4mt-convovz8.logidp4mt  idp4mt
7ed1de35-75bc-4137-977a-b4055067fb0a: Creating the snapshot...
The snapshot with id {6703557b-e46c-4437-877a-ca3d8f917d79} has been successfully created.

Starting conversion: 7ed1de35-75bc-4137-977a-b4055067fb0a at 20:31:03.188883
base0                                           3.0 kB/s | 4.6 kB     00:01
base0                                            30 MB/s |  13 MB     00:00
base1                                            20 kB/s | 2.9 kB     00:00
Dependencies resolved.
================================================================================
Package                     Arch   Version                         Repository
Size
================================================================================
Installing:
vzlinux-logos-httpd         noarch 80.5.1-2.vl8                    base0  24 k
replacing  centos-logos-httpd.noarch 80.5-2.el8
vzlinux-release             x86_64 3:8.3-11.vl8                    base0  35 k
replacing  centos-linux-release.noarch 8.3-1.2011.el8
replacing  centos-linux-repos.noarch 8-2.el8
Upgrading:
abattis-cantarell-fonts     noarch 0.0.25-6.vl8.1                  base0 155 k
acl                         x86_64 2.2.53-1.vl8.1                  base0  80 k
...
(613/614): zip-3.0-23.vl8.x86_64.rpm            458 kB/s | 270 kB     00:00
(614/614): zlib-1.2.11-17.vl8.x86_64.rpm        160 kB/s | 102 kB     00:00
--------------------------------------------------------------------------------
Total                                           376 kB/s | 381 MB     17:17
Running transaction check
Transaction check succeeded.
Running transaction test
Transaction test succeeded.
Running transaction
Running scriptlet: filesystem-3.8-3.vl8.x86_64                            1/1

but fails here:

Preparing        :                                                        1/1
Running scriptlet: libgcc-8.4.1-1.vl8.x86_64                              1/1Error: Cannot open file /vz/template/vzlinux/8/x86_64/pm/base0-b1ad5fe4dfeb5b55/packages/libgcc-8.4.1-1.vl8.x86_64.rpm: [Errno 24] Too many open files: '/vz/template/vzlinux/8/x86_64/pm/base0-b1ad5fe4dfeb5b55/packages/libgcc-8.4.1-1.vl8.x86_64.rpm'
FATAL ERROR: python callback ??? failed, aborting!
Error: /usr/share/vzyum/bin/yum failed, exitcode=1
7ed1de35-75bc-4137-977a-b4055067fb0a: Conversion successful at 20:48:44.232772

the CT seems still beeing a centos8 !?

[root at idp4mt ~]# cat /etc/redhat-release
CentOS Linux release 8.3.2011

is it broken now ? I did before a backup of the root.hds , I can revert it to it's original centos 8 packages states, maybe I should set back that root.HDD and allow more open files to reply the process
Kevin Drysdale said on that thread :
Yes, it was just the stock ulimit default value of 1024 for open files before I changed it.  I increased that by a factor of 10 to 10240, and that did the trick.
But where/how can I change the ulimit of open files ?

thanks .

________________________________
De: "Denis Silakov" <dsilakov at virtuozzo.com><mailto:dsilakov at virtuozzo.com>
À: "Jehan PROCACCIA" <jehan.procaccia at tem-tsp.eu><mailto:jehan.procaccia at tem-tsp.eu>
Cc: "OpenVZ users" <users at openvz.org><mailto:users at openvz.org>
Envoyé: Vendredi 23 Avril 2021 20:04:58
Objet: Re: [Users] virtuozzo base OS and new centos 8 orientations

Yes, need to look into CT config (/vz/private/7ed1de35-75bc-4137-977a-b4055067fb0a/ve.conf) and turn back 'centos' as template.

________________________________
From: Jehan PROCACCIA <jehan.procaccia at tem-tsp.eu><mailto:jehan.procaccia at tem-tsp.eu>
Sent: Friday, April 23, 2021 8:19 PM
To: Denis Silakov <dsilakov at virtuozzo.com><mailto:dsilakov at virtuozzo.com>
Cc: OpenVZ users <users at openvz.org><mailto:users at openvz.org>
Subject: Re: [Users] virtuozzo base OS and new centos 8 orientations

well, it looks like I'am in the middle of the process, now it doesn't want to convert anymore

# vzconvert8 convert --log /tmp/idp4mt-convovz8.logidp4mt  idp4mt
7ed1de35-75bc-4137-977a-b4055067fb0a: Conversion aborted: Container's OS template is not supported

althought the CT seems to be keept in centos 8 :

[root at idp4mt ~]# cat /etc/redhat-release
CentOS Linux release 8.3.2011

maybe I need to revert/remove something that the conversion has started ?

thanks .

________________________________
De: "Denis Silakov" <dsilakov at virtuozzo.com><mailto:dsilakov at virtuozzo.com>
À: "Jehan PROCACCIA" <jehan.procaccia at tem-tsp.eu><mailto:jehan.procaccia at tem-tsp.eu>
Cc: "OpenVZ users" <users at openvz.org><mailto:users at openvz.org>
Envoyé: Vendredi 23 Avril 2021 16:28:45
Objet: Re: [Users] virtuozzo base OS and new centos 8 orientations

Probably the issue with gcc is caused by gcc update in VzLinux 8 which is happening right now.
Could you check again, the repos are refreshed now?

And the script considered the problem to be serious enough not to proceed with conversion.
________________________________
From: Jehan PROCACCIA <jehan.procaccia at tem-tsp.eu><mailto:jehan.procaccia at tem-tsp.eu>
Sent: Friday, April 23, 2021 5:01 PM
To: Denis Silakov <dsilakov at virtuozzo.com><mailto:dsilakov at virtuozzo.com>
Cc: OpenVZ users <users at openvz.org><mailto:users at openvz.org>
Subject: Re: [Users] virtuozzo base OS and new centos 8 orientations

yes it's better with --log option , but still no convertion and errors/warnings !? :

# vzconvert8 convert --log /tmp/idp4mt-convovz8.logidp4mt  idp4mt
7ed1de35-75bc-4137-977a-b4055067fb0a: Creating the snapshot...
The snapshot with id {6a5c1dcf-776e-4011-a935-06b186c38541} has been successfully created.

Starting conversion: 7ed1de35-75bc-4137-977a-b4055067fb0a at 15:58:13.564369
Cache was expired
0 files removed
base0                                            23 MB/s |  11 MB     00:00
base1                                           1.7 kB/s | 257  B     00:00
Metadata cache created.
Last metadata expiration check: 0:00:01 ago on Fri Apr 23 13:58:18 2021.
base0                                            31 kB/s | 4.2 kB     00:00
base1                                            38 kB/s | 2.9 kB     00:00
Error:
Problem: package annobin-9.35-1.vl8.x86_64 requires gcc >= 8, but none of the providers can be installed
- package gcc-8.3.1-5.vl8.x86_64 requires libgomp = 8.3.1-5.vl8, but none of the providers can be installed
- package redhat-rpm-config-125-1.vl8.noarch requires annobin, but none of the providers can be installed
- cannot install both libgomp-8.3.1-5.vl8.x86_64 and libgomp-8.3.1-5.1.el8.x86_64
- cannot install the best update candidate for package redhat-rpm-config-123-1.el8.noarch
- problem with installed package libgomp-8.3.1-5.1.el8.x86_64
(try to add '--allowerasing' to command line to replace conflicting packages or '--skip-broken' to skip uninstallable packages or '--nobest' to use not only best candidate packages)
Error: /usr/share/vzyum/bin/yum failed, exitcode=1
7ed1de35-75bc-4137-977a-b4055067fb0a: Conversion successful at 15:58:21.015511

back on the CT I am still on centos 8 :

[root at idp4mt ~]# cat /etc/redhat-release
CentOS Linux release 8.3.2011

________________________________
De: "Denis Silakov" <dsilakov at virtuozzo.com><mailto:dsilakov at virtuozzo.com>
À: "Jehan PROCACCIA" <jehan.procaccia at tem-tsp.eu><mailto:jehan.procaccia at tem-tsp.eu>, "OpenVZ users" <users at openvz.org><mailto:users at openvz.org>
Envoyé: Vendredi 23 Avril 2021 15:48:57
Objet: Re: [Users] virtuozzo base OS and new centos 8 orientations

Looks like we broke launch without --log option while improving logging.
Will be fixed soon, as a workaround you can use --log option.
________________________________
From: jehan Procaccia tem-tsp <jehan.procaccia at tem-tsp.eu><mailto:jehan.procaccia at tem-tsp.eu>
Sent: Friday, April 23, 2021 4:41 PM
To: OpenVZ users <users at openvz.org><mailto:users at openvz.org>; Denis Silakov <dsilakov at virtuozzo.com><mailto:dsilakov at virtuozzo.com>
Subject: Re: [Users] virtuozzo base OS and new centos 8 orientations

I tested vzconvert8 from fresly installed vzdeploy8 (vzdeploy8-1.0.30-1.vl7.x86_64)
it failed :

#  vzconvert8 convert tomcatsrv9
712c1ecb-29e8-46e9-b81b-7856fb4ab3c9: Creating the snapshot...
The snapshot with id {369834dc-cee0-4d87-807e-77f18b2f4c70} has been successfully created.

Starting conversion: 712c1ecb-29e8-46e9-b81b-7856fb4ab3c9 at 15:36:46.492202
Traceback (most recent call last):
  File "/usr/bin/vzconvert8", line 362, in <module>
    args.func()
  File "/usr/bin/vzconvert8", line 198, in process_cts
    results = pool.map(process_single_ct, args.CT)
  File "/usr/lib64/python3.6/multiprocessing/pool.py", line 266, in map
    return self._map_async(func, iterable, mapstar, chunksize).get()
  File "/usr/lib64/python3.6/multiprocessing/pool.py", line 644, in get
    raise self._value
  File "/usr/lib64/python3.6/multiprocessing/pool.py", line 119, in worker
    result = (True, func(*args, **kwds))
  File "/usr/lib64/python3.6/multiprocessing/pool.py", line 44, in mapstar
    return list(map(*args))
  File "/usr/bin/vzconvert8", line 300, in process_single_ct
    log_info(l.strip(), ct_log)
UnboundLocalError: local variable 'ct_log' referenced before assignment

did I missed something ?
thanks .

Le 22/03/2021 à 08:09, Denis Silakov a écrit :
Looks a bit strange indeed, vzdeploy was intended to just leave httpd from centos in such cases.

But now we have one more way for converting containers which will probably be more reliable. It utilizes vzpkg tool and should be launched from the server side:

# yum install vzdeploy8
# vzconvert8 convert <CTID>
________________________________
From: users-bounces at openvz.org<mailto:users-bounces at openvz.org> <users-bounces at openvz.org><mailto:users-bounces at openvz.org> on behalf of Ian <openvz_list at fishnet.co.uk><mailto:openvz_list at fishnet.co.uk>
Sent: Thursday, March 11, 2021 6:48 PM
To: OpenVZ users <users at openvz.org><mailto:users at openvz.org>
Subject: Re: [Users] virtuozzo base OS and new centos 8 orientations

On 03/03/2021 10:46, Denis Silakov wrote:
> Meanwhile, issue with kernel-headers should be fixed in the latest script.
> ------------------------------------------------------------------------

Hi,

On a brand new centos8 container I get the following error from yum
after running the vzdeloy8 script (with the ignore kernel env set) :

-----

Modular dependency problems:

  Problem 1: conflicting requests
   - nothing provides module(platform:el8) needed by module
httpd:2.4:8030020201104025655:30b713e6-0.x86_64
  Problem 2: conflicting requests
   - nothing provides module(platform:el8) needed by module
python36:3.6:8030020201104034153:24f1489c-0.x86_64
Dependencies resolved.
Nothing to do.

------

I tried removing and reinstalling httpd* but that didn't resolve the error.

Any ideas ?

I feel this is very close now !
Thanks for all your hard work.

Regards

Ian

_______________________________________________
Users mailing list
Users at openvz.org<mailto:Users at openvz.org>
https://lists.openvz.org/mailman/listinfo/users

_______________________________________________
Users mailing list
Users at openvz.org<mailto:Users at openvz.org>
https://lists.openvz.org/mailman/listinfo/users

________________________________
De: "Denis Silakov" <dsilakov at virtuozzo.com><mailto:dsilakov at virtuozzo.com>
À: "Jehan PROCACCIA" <jehan.procaccia at tem-tsp.eu><mailto:jehan.procaccia at tem-tsp.eu>, "OpenVZ users" <users at openvz.org><mailto:users at openvz.org>
Envoyé: Vendredi 23 Avril 2021 15:48:57
Objet: Re: [Users] virtuozzo base OS and new centos 8 orientations

Looks like we broke launch without --log option while improving logging.
Will be fixed soon, as a workaround you can use --log option.
________________________________
From: jehan Procaccia tem-tsp <jehan.procaccia at tem-tsp.eu><mailto:jehan.procaccia at tem-tsp.eu>
Sent: Friday, April 23, 2021 4:41 PM
To: OpenVZ users <users at openvz.org><mailto:users at openvz.org>; Denis Silakov <dsilakov at virtuozzo.com><mailto:dsilakov at virtuozzo.com>
Subject: Re: [Users] virtuozzo base OS and new centos 8 orientations