Enhance the logging on the server_setup container

[srbarrios]

By default, when installing, we are generating a big amount of logs now. Example:

Logs

oscar-server:~ # mgradm install podman  --tag 5.1.0-alpha2 --image registry.suse.de/suse/sle-15-sp7/update/products/multilinuxmanager51/containerfile/suse/manager/5.1/x86_64/server --registry registry.suse.de/suse/sle-15-sp7/update/products/multilinuxmanager51/containerfile/suse/manager/5.1/x86_64/
2:50PM INF Welcome to mgradm
2:50PM INF Executing command: podman
Password for the CA key to generate: 
Confirm the password: 
Two different passwords have been provided
Password for the CA key to generate: 
Confirm the password: 
Administrator password: 
Confirm the password: 
2:50PM INF Setting up the server with the FQDN 'oscar-server.mgr.suse.de'
2:50PM INF Registry registry.suse.de/suse/sle-15-sp7/update/products/multilinuxmanager51/containerfile/suse/manager/5.1/x86_64/ would be used instead of namespace registry.opensuse.org/uyuni
2:50PM INF Computed image name is registry.suse.de/suse/sle-15-sp7/update/products/multilinuxmanager51/containerfile/suse/manager/5.1/x86_64/server:5.1.0-alpha2
2:50PM INF Pull Policy is always. Presence of RPM image will be checked and pulled from registry if not present
2:50PM INF Cannot find RPM image for registry.suse.de/suse/sle-15-sp7/update/products/multilinuxmanager51/containerfile/suse/manager/5.1/x86_64/server:5.1.0-alpha2
2:50PM INF Running podman pull registry.suse.de/suse/sle-15-sp7/update/products/multilinuxmanager51/containerfile/suse/manager/5.1/x86_64/server:5.1.0-alpha2
2:50PM ??? Trying to pull registry.suse.de/suse/sle-15-sp7/update/products/multilinuxmanager51/containerfile/suse/manager/5.1/x86_64/server:5.1.0-alpha2...
2:50PM ??? Getting image source signatures
2:50PM ??? Checking if image destination supports signatures
2:50PM ??? Copying blob sha256:81fb11821ba473b2062d94ae03421e02aabefa2a5b5e525cb19217c386a8d8fe
2:50PM ??? Copying blob sha256:c9361dbc8cb18b8306bdb91baf185cdf65640062a395679ad8ce11ceeb68215d
2:50PM ??? Copying blob sha256:2dd7312300b362d37df0959ae550a1916ba05283eadfc6acf2b4c489b674e117
2:50PM ??? Copying blob sha256:1cbbafe8b347980314f5098d5cc06dca14f07f108da1e4fd5cce2cb76e5167a2
2:51PM ??? Copying config sha256:63df0ae3b69d40e465362a15308d9b4dd45b63448ba9410eddd1064528ab3f96
2:51PM ??? Writing manifest to image destination
2:51PM ??? Storing signatures
2:51PM ??? 63df0ae3b69d40e465362a15308d9b4dd45b63448ba9410eddd1064528ab3f96
2:51PM INF Setting up uyuni network
2:51PM INF Run setup command in the container
2:51PM ??? Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service → /usr/lib/systemd/system/postgresql.service.
2:51PM ??? Initializing PostgreSQL 16.6 at location /var/lib/pgsql/data using options "--auth=ident"
2:51PM ??? 2025-02-05 14:51:33.264 UTC   [59]LOG:  redirecting log output to logging collector process
2025-02-05 14:51:33.264 UTC   [59]HINT:  Future log output will appear in directory "log".
2:51PM ??? CREATE ROLE
2:51PM ??? Populating the database
2:51PM ???          set_config         
----------------------------
 rhn_server,"$user", public
(1 row)

2:51PM ???    set_config    
-----------------
 "$user", public
(1 row)

2:51PM ???      set_config      
---------------------
 deb,"$user", public
(1 row)

2:51PM ???    set_config    
-----------------
 "$user", public
(1 row)

2:51PM ???         set_config         
---------------------------
 rhn_cache,"$user", public
(1 row)

2:51PM ???    set_config    
-----------------
 "$user", public
(1 row)

2:51PM ???          set_config          
-----------------------------
 rhn_channel,"$user", public
(1 row)

2:51PM ???    set_config    
-----------------
 "$user", public
(1 row)

2:51PM ???          set_config         
----------------------------
 rhn_config,"$user", public
(1 row)

2:51PM ???    set_config    
-----------------
 "$user", public
(1 row)

2:51PM ???              set_config             
------------------------------------
 rhn_config_channel,"$user", public
(1 row)

2:51PM ???    set_config    
-----------------
 "$user", public
(1 row)

2:51PM ???             set_config            
----------------------------------
 rhn_entitlements,"$user", public
(1 row)

2:51PM ???    set_config    
-----------------
 "$user", public
(1 row)

2:51PM ???           set_config           
-------------------------------
 rhn_exception,"$user", public
(1 row)

2:51PM ???    set_config    
-----------------
 "$user", public
(1 row)

2:51PM ???        set_config        
-------------------------
 rhn_org,"$user", public
(1 row)

2:51PM ???    set_config    
-----------------
 "$user", public
(1 row)

2:51PM ???         set_config        
--------------------------
 rhn_user,"$user", public
(1 row)

2:51PM ???    set_config    
-----------------
 "$user", public
(1 row)

2:51PM ???      set_config      
---------------------
 rpm,"$user", public
(1 row)

2:51PM ???    set_config    
-----------------
 "$user", public
(1 row)

2:51PM ???  randomize_bunch_schedule 
--------------------------
 
(1 row)

2:51PM ???  create_varnull_constriants 
----------------------------
                          0
(1 row)

2:51PM ??? * Loading answer file: /root/spacewalk-answers.
2:51PM ??? ** Database: Setting up database connection for PostgreSQL backend.
2:51PM ??? * Performing initial configuration.
2:51PM ??? * Configuring apache SSL virtual host.
2:51PM ??? * Creating SSL certificates.
2:51PM ??? ** SSL: Generating CA certificate.
2:51PM ??? ** SSL: Generating server certificate.
2:51PM ??? ** Database: Setting up report database.
2:51PM ??? ** Database: --clear-db option used.  Clearing report database.
2:51PM ??? 2025-02-05 14:51:49.916 UTC   [732]LOG:  redirecting log output to logging collector process
2025-02-05 14:51:49.916 UTC   [732]HINT:  Future log output will appear in directory "log".
2:51PM ??? >> reload
2:51PM ??? ** Database: Installation complete.
2:51PM ??? * Report DB Configured. 
2:51PM ??? * Update configuration in database.
2:51PM ??? * Setting up Cobbler..
2:51PM ??? Created symlink /etc/systemd/system/sockets.target.wants/tftp.socket → /usr/lib/systemd/system/tftp.socket.
2:51PM ??? * Deploying configuration files.
2:51PM ??? Installation complete.
2:51PM ??? INFO: Database configuration has been changed.
INFO: Wrote new general configuration. Backup as /var/lib/pgsql/data/postgresql.2025-02-05-14-51-51.conf
INFO: Wrote new client auth configuration. Backup as /var/lib/pgsql/data/pg_hba.2025-02-05-14-51-51.conf
INFO: New configuration has been applied.
Database is online
System check finished
2:51PM ??? starting tomcat...
2:51PM ??? starting apache2...
2:51PM ??? Java virtual machine used: /usr/bin/java
2:51PM ??? classpath used: /usr/share/tomcat/bin/bootstrap.jar:/usr/share/tomcat/bin/tomcat-juli.jar:/usr/lib64/java/commons-daemon.jar
2:51PM ??? main class used: org.apache.catalina.startup.Bootstrap
2:51PM ??? flags used: -Djavax.sql.DataSource.Factory=org.apache.commons.dbcp.BasicDataSourceFactory -ea -Xms256m -Xmx1G -Djava.awt.headless=true -Dorg.xml.sax.driver=com.redhat.rhn.frontend.xmlrpc.util.RhnSAXParser -Dorg.apache.tomcat.util.http.Parameters.MAX_COUNT=1024 -Dnet.sf.ehcache.skipUpdateCheck=true --add-exports java.annotation/javax.annotation.security=ALL-UNNAMED --add-opens java.annotation/javax.annotation.security=ALL-UNNAMED 
2:51PM ??? options used: -Dcatalina.base=/usr/share/tomcat -Dcatalina.home=/usr/share/tomcat -Djava.endorsed.dirs= -Djava.io.tmpdir=/var/cache/tomcat/temp -Djava.util.logging.config.file=/usr/share/tomcat/conf/logging.properties -Djava.util.logging.manager=org.apache.juli.ClassLoaderLogManager
2:51PM ??? arguments used: start
2:51PM ??? [Wed Feb 05 14:51:51.474612 2025] [alias:warn] [pid 830:tid 830] AH00671: The Alias directive in /etc/apache2/conf.d/zz-spacewalk-www.conf at line 26 will probably never match because it overlaps an earlier Alias.
2:51PM ??? [Wed Feb 05 14:51:51.476076 2025] [alias:warn] [pid 830:tid 830] AH00671: The ScriptAlias directive in /etc/apache2/conf.d/zz-spacewalk-www.conf at line 40 will probably never match because it overlaps an earlier ScriptAlias.
2:51PM ??? AH00558: httpd-prefork: Could not reliably determine the server's fully qualified domain name, using fd90:c8b3:f68:3df3::2. Set the 'ServerName' directive globally to suppress this message
2:51PM ??? Creating first user...
2:51PM ??? WARNING: Unknown module: java.annotation specified to --add-exports
2:51PM ??? WARNING: Unknown module: java.annotation specified to --add-opens
2:51PM ??? 05-Feb-2025 14:51:52.142 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Server version name:   Apache Tomcat/9.0.98
2:51PM ??? 05-Feb-2025 14:51:52.152 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Server built:          Jan 3 2025 12:00:00 UTC
2:51PM ??? 05-Feb-2025 14:51:52.153 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Server version number: 9.0.98.0
2:51PM ??? 05-Feb-2025 14:51:52.153 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log OS Name:               Linux
2:51PM ??? 05-Feb-2025 14:51:52.153 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log OS Version:            6.4.0-19-default
2:51PM ??? 05-Feb-2025 14:51:52.154 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Architecture:          amd64
2:51PM ??? 05-Feb-2025 14:51:52.154 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Java Home:             /usr/lib64/jvm/java-17-openjdk-17
2:51PM ??? 05-Feb-2025 14:51:52.155 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log JVM Version:           17.0.13+11-suse-150400.3.48.2-x8664
2:51PM ??? 05-Feb-2025 14:51:52.156 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log JVM Vendor:            Oracle Corporation
2:51PM ??? 05-Feb-2025 14:51:52.156 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log CATALINA_BASE:         /usr/share/tomcat
2:51PM ??? 05-Feb-2025 14:51:52.157 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log CATALINA_HOME:         /usr/share/tomcat
2:51PM ??? 05-Feb-2025 14:51:52.167 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: -Djavax.sql.DataSource.Factory=org.apache.commons.dbcp.BasicDataSourceFactory
2:51PM ??? 05-Feb-2025 14:51:52.170 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: -ea
2:51PM ??? 05-Feb-2025 14:51:52.170 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: -Xms256m
2:51PM ??? 05-Feb-2025 14:51:52.170 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: -Xmx1G
2:51PM ??? 05-Feb-2025 14:51:52.171 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: -Djava.awt.headless=true
2:51PM ??? 05-Feb-2025 14:51:52.171 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: -Dorg.xml.sax.driver=com.redhat.rhn.frontend.xmlrpc.util.RhnSAXParser
2:51PM ??? 05-Feb-2025 14:51:52.171 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: -Dorg.apache.tomcat.util.http.Parameters.MAX_COUNT=1024
2:51PM ??? 05-Feb-2025 14:51:52.173 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: -Dnet.sf.ehcache.skipUpdateCheck=true
2:51PM ??? 05-Feb-2025 14:51:52.174 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: --add-exports=java.annotation/javax.annotation.security=ALL-UNNAMED
2:51PM ??? 05-Feb-2025 14:51:52.174 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: --add-opens=java.annotation/javax.annotation.security=ALL-UNNAMED
2:51PM ??? 05-Feb-2025 14:51:52.175 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: -Dcatalina.base=/usr/share/tomcat
2:51PM ??? 05-Feb-2025 14:51:52.175 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: -Dcatalina.home=/usr/share/tomcat
2:51PM ??? 05-Feb-2025 14:51:52.175 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: -Djava.endorsed.dirs=
2:51PM ??? 05-Feb-2025 14:51:52.176 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: -Djava.io.tmpdir=/var/cache/tomcat/temp
2:51PM ??? 05-Feb-2025 14:51:52.176 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: -Djava.util.logging.config.file=/usr/share/tomcat/conf/logging.properties
2:51PM ??? 05-Feb-2025 14:51:52.177 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: -Djava.util.logging.manager=org.apache.juli.ClassLoaderLogManager
2:51PM ??? 05-Feb-2025 14:51:52.184 INFO [main] org.apache.catalina.core.AprLifecycleListener.lifecycleEvent An older version [1.2.38] of the Apache Tomcat Native library is installed, while Tomcat recommends a minimum version of [1.3.0]
2:51PM ??? 05-Feb-2025 14:51:52.186 INFO [main] org.apache.catalina.core.AprLifecycleListener.lifecycleEvent Loaded Apache Tomcat Native library [1.2.38] using APR version [1.6.3].
2:51PM ??? 05-Feb-2025 14:51:52.186 INFO [main] org.apache.catalina.core.AprLifecycleListener.lifecycleEvent APR capabilities: IPv6 [true], sendfile [true], accept filters [false], random [true], UDS [true].
2:51PM ??? 05-Feb-2025 14:51:52.187 INFO [main] org.apache.catalina.core.AprLifecycleListener.lifecycleEvent APR/OpenSSL configuration: useAprConnector [false], useOpenSSL [true]
2:51PM ??? 05-Feb-2025 14:51:52.189 INFO [main] org.apache.catalina.core.AprLifecycleListener.initializeSSL OpenSSL successfully initialized [OpenSSL 1.1.1w-fips  11 Sep 2023 SUSE release 150700.9.11]
2:51PM ??? 05-Feb-2025 14:51:52.667 INFO [main] org.apache.coyote.AbstractProtocol.init Initializing ProtocolHandler ["ajp-nio-127.0.0.1-8009"]
2:51PM ??? 05-Feb-2025 14:51:52.703 INFO [main] org.apache.coyote.AbstractProtocol.init Initializing ProtocolHandler ["ajp-nio-0:0:0:0:0:0:0:1-8009"]
2:51PM ??? 05-Feb-2025 14:51:52.706 INFO [main] org.apache.coyote.AbstractProtocol.init Initializing ProtocolHandler ["http-nio-127.0.0.1-8080"]
2:51PM ??? 05-Feb-2025 14:51:52.711 INFO [main] org.apache.catalina.startup.Catalina.load Server initialization in [861] milliseconds
2:51PM ??? 05-Feb-2025 14:51:52.769 INFO [main] org.apache.catalina.core.StandardService.startInternal Starting service [Catalina]
2:51PM ??? 05-Feb-2025 14:51:52.770 INFO [main] org.apache.catalina.core.StandardEngine.startInternal Starting Servlet engine: [Apache Tomcat/9.0.98]
2:51PM ??? 05-Feb-2025 14:51:52.779 INFO [main] org.apache.catalina.startup.HostConfig.deployDirectory Deploying web application directory [/usr/share/susemanager/www/tomcat/webapps/rhn]
2:51PM ??? 05-Feb-2025 14:51:57.726 INFO [main] org.apache.jasper.servlet.TldScanner.scanJars At least one JAR was scanned for TLDs yet contained no TLDs. Enable debug logging for this logger for a complete list of JARs that were scanned but no TLDs were found in them. Skipping unneeded JARs during scanning can improve startup time and JSP compilation time.
2:52PM ??? 05-Feb-2025 14:52:13.052 INFO [main] org.apache.catalina.startup.HostConfig.deployDirectory Deployment of web application directory [/usr/share/susemanager/www/tomcat/webapps/rhn] has finished in [20,267] ms
2:52PM ??? 05-Feb-2025 14:52:13.063 INFO [main] org.apache.coyote.AbstractProtocol.start Starting ProtocolHandler ["ajp-nio-127.0.0.1-8009"]
2:52PM ??? 05-Feb-2025 14:52:13.093 INFO [main] org.apache.coyote.AbstractProtocol.start Starting ProtocolHandler ["ajp-nio-0:0:0:0:0:0:0:1-8009"]
2:52PM ??? 05-Feb-2025 14:52:13.116 INFO [main] org.apache.coyote.AbstractProtocol.start Starting ProtocolHandler ["http-nio-127.0.0.1-8080"]
2:52PM ??? 05-Feb-2025 14:52:13.153 INFO [main] org.apache.catalina.startup.Catalina.start Server startup in [20440] milliseconds
2:52PM ??? Creating administration user
2:52PM INF Server set up, login on https://oscar-server.mgr.suse.de with admin user
2:52PM INF Setting up uyuni network
2:52PM INF Reusing existing uyuni network
2:52PM INF Enabling system service
2:52PM INF Waiting for the server to start…
Error: cannot wait for system start: server didn't start within 60s. Check for the service status

Different suggestions:

• Write all the logs in a file outside the container, so the user can check it later.
• Add a new argument, so user can define the log level
• Keep the container alive, so users can read the logs through a command line like mgradm install log for instance.