Python 3.8.8 and mariadb 10.3.28 not supported by 21.04

Use this forum for questions regarding installation, upgrading and configuration of OpenEMM

Moderator: moderator

JuergenB
Posts: 72
Joined: Thu Dec 05, 2019 9:03 pm

Python 3.8.8 and mariadb 10.3.28 not supported by 21.04

Post by JuergenB » Tue Aug 24, 2021 12:25 pm

Hello,

during a clean installation with the latest runtime (openemm-runtime-21.04.097.tar.gz) on a clean CentOS8 Stream the installer fails at some parts and OpenEMM complains that mariadb is not supported.

Code: Select all

OpenEMM status:
Operating System (OS): CentOS 8
Python version: 3.8.8 (default, Aug  2 2021, 14:57:02)  [GCC 8.5.0 20210514 (Red Hat 8.5.0-3)]
The database vendor mariadb is not supported by this python installation
Postfix Version: 3.5.8
Database client version: /usr/bin/mysql  Ver 15.1 Distrib 10.3.28-MariaDB, for Linux (x86_64) using readline 5.1
Database Connection: OK
System-Time: 2021-08-24 13:15:58
System-Time-DB: 2021-08-24 13:15:58
Database version: MariaDB 10.3.28-MariaDB
OpenEMM database structure does NOT exist
Java version: 11.0.12 (Oracle)
Tomcat version: 9.0.45.0
Tomcat-Native version: 1.2.23
Wkhtml version: wkhtmltopdf 0.12.6 (with patched qt)
OpenEMM Application is NOT running
During the normal setup i install a recommend in the current setup guide ...

But i need to install the python3 mariadb module with this cmd

Code: Select all

python3 -m pip install -Iv mariadb==1.0.7
Later if i check the OpenEMM status and create the database this works fine...

Code: Select all

Changes saved.
New database and user credentials created.

Current configuration changes or updates need the OpenEMM system to be restarted.
can someone verifiy the documentation guide for CentOs8 Stream and mariadb 10.3.28.

Is Pyhton 3.8.8 wrong?

Thanks

Jürgen

maschoff
Site Admin
Posts: 2510
Joined: Thu Aug 03, 2006 10:20 am
Location: Munich, Germany
Contact:

Re: Python 3.8.8 and mariadb 10.3.28 not supported by 21.04

Post by maschoff » Wed Aug 25, 2021 1:31 pm

Any Python 3.8 or later is fine.

We do not support CentOS stream and we will recommend AlmaLinux for 21.10.
OpenEMM Maintainer

JuergenB
Posts: 72
Joined: Thu Dec 05, 2019 9:03 pm

Re: Python 3.8.8 and mariadb 10.3.28 not supported by 21.04

Post by JuergenB » Wed Aug 25, 2021 5:00 pm

Thanks,

i tried 21.04 with AlmaLinux 8.4, but 21.04 is not compatible right now...

This is what i get after running OMT.sh and configuring the environment.

Installation failed. Please install and configure the optional Apache Tomcat Native for Apache Tomcat 9 application manually.
See OpenEMM's "Admin and Install Guide" for help.
Do NOT use command 'yum install tomcat-native', because it installs Apache Tomcat Native for Apache Tomcat 7, which is not compatible with OpenEMM.


Event the supported CentOS 8 and OpenEMM 21.04 is complaining about the database (strange)

OpenEMM status:
Operating System (OS): CentOS 8
Python version: 3.8.6 (default, Jan 29 2021, 17:38:16) [GCC 8.4.1 20200928 (Red Hat 8.4.1-1)]
The database vendor mariadb is not supported by this python installation

nickw
Posts: 23
Joined: Thu Nov 04, 2021 10:15 pm

Re: Python 3.8.8 and mariadb 10.3.28 not supported by 21.04

Post by nickw » Thu Nov 11, 2021 2:27 pm

I'm also experiencing this issue. Were you able to figure this out?

maschoff
Site Admin
Posts: 2510
Joined: Thu Aug 03, 2006 10:20 am
Location: Munich, Germany
Contact:

Re: Python 3.8.8 and mariadb 10.3.28 not supported by 21.04

Post by maschoff » Thu Nov 11, 2021 2:38 pm

Since OpenEMM 21.10 is the current version now, we will publish an update of the install & admin guide later this week that goes more into detail regarding Python and MariaDB. You will find it as usual at wiki.openemm.org .
OpenEMM Maintainer

nickw
Posts: 23
Joined: Thu Nov 04, 2021 10:15 pm

Re: Python 3.8.8 and mariadb 10.3.28 not supported by 21.04

Post by nickw » Tue Nov 23, 2021 5:24 pm

Just updated with the new code, still getting this error and the URL is still not working:

OpenEMM status:
Operating System (OS): Rocky Linux 8.5
Python version: 3.8.8
The database vendor mariadb is not supported by this python installation
Postfix Version: 3.5.8
Database client version: /usr/bin/mysql Ver 15.1 Distrib 10.3.28-MariaDB, for Linux (x86_64) using readline 5.1
Database Connection: OK
System-Time: 2021-11-23 11:16:28
System-Time-DB: 2021-11-23 11:16:28
Database version: MariaDB 10.3.28-MariaDB
OpenEMM database structure exists (Version 21.10.193)
Database table emm_db_errorlog_tbl: OK
Jobqueue status: OK
DKIM keys available for domains: None
Java version: 1.8.0_312 (Oracle)
Tomcat version: 10.0.10.0
Tomcat-Native version: 1.2.24
Wkhtml version: wkhtmltopdf 0.12.6 (with patched qt)
OpenEMM Application is running (Tomcat ProcessID: 5012, started at: 11:16 0:10)
OpenEMM Backend ok: once
OpenEMM Backend stopped: mailout, update, trigger, generate, pickdist, slrtscn, direct-path, bav-update, bavd, bav
OpenEMM Backend running: mta, mlcontrol

Other issues with this (and previous releases):
/home/openemm/tomcat/logs/catalina.out - does not get created by OMT.sh, you need to create it yourself


Please, please, please release a fix for this.

maschoff
Site Admin
Posts: 2510
Joined: Thu Aug 03, 2006 10:20 am
Location: Munich, Germany
Contact:

Re: Python 3.8.8 and mariadb 10.3.28 not supported by 21.04

Post by maschoff » Tue Nov 23, 2021 5:36 pm

Looks like the libs for the MariaDB API or the pip module mariadb is missing. Please check out the latest OpenEMM Install&Admin Guide 1.0.4. We added more explanations for installation of MariaDB and modules needed by Python to access MariaDB.

There is nothing to fix in the code.
OpenEMM Maintainer

nickw
Posts: 23
Joined: Thu Nov 04, 2021 10:15 pm

Re: Python 3.8.8 and mariadb 10.3.28 not supported by 21.04

Post by nickw » Tue Nov 23, 2021 7:02 pm

While following this guide: https://wiki.openemm.org/lib/exe/fetch. ... _1.0.4.pdf

Section "3.4 MariaDB"
For whatever reason, if you try and copy out the link to mariadb-10.5.8 in your guide, a "-" will not copy over, here is a working link:

https://archive.mariadb.org/mariadb-10. ... _64.tar.gz

also,if you're installing this from the directions on a new machine, the following directory doesn't exist:
and add a file client.cnf in directory /etc/my.cnf.d:
[client]
socket=/var/lib/mysql/mysql.sock

You'll need to run:
mkdir /etc/my.cnf.d

Commands that cannot be copied from guide (I'm guessing the "." for the current directory doesn't format correctly when coverting the how-to guide to a pdf?):
chown -R mysql:mysql .
chown -R root .

now stuck at mariadb not starting. will find a way thru and update

nickw
Posts: 23
Joined: Thu Nov 04, 2021 10:15 pm

Re: Python 3.8.8 and mariadb 10.3.28 not supported by 21.04

Post by nickw » Tue Nov 23, 2021 7:40 pm

Submitted extra post in error, please see one below
Last edited by nickw on Tue Nov 23, 2021 7:42 pm, edited 1 time in total.

nickw
Posts: 23
Joined: Thu Nov 04, 2021 10:15 pm

Re: Python 3.8.8 and mariadb 10.3.28 not supported by 21.04

Post by nickw » Tue Nov 23, 2021 7:41 pm

Fixed the mariadb issue with the following:

sed -i -e 's/LimitNOFILE=16384/LimitNOFILE=100000/' /usr/lib/systemd/system/mariadb.service
echo "LimitMEMLOCK=100000" >> /usr/lib/systemd/system/mariadb.service;
mkdir /var/run/mariadb;
touch /var/run/mariadb/mariadb.pid;
chmod ug+w /var/run/mariadb/mariadb.pid;
systemctl daemon-reload;
systemctl restart mariadb;

And the command to set your initial mysql is in fact:
mysql_secure_installation

Additionally, in section "4.1 Firewall Configuration", attempting to copy the following command results in error. Again, it is the formatting of the how-to guide. I have formatted it correctly below:
firewall-cmd --zone=public --add-forward-port=port=80:proto=tcp:toport=8080 --permanent

in section " 4.5 Configuration of Operating System Logging Parameters", there is a task to modify /etc/rsyslog.conf....which doesn't exist! (if you're using SLES, the guide tells you to install it. If you're using anything else, rsyslog is not mentioned) So, install rsyslog:

yum install rsyslog

In section "5.2 Runtime Deployment"
You first need to run OMT.sh as root to have it set the system ulimit. This cannot happen as the openemm user as is listed in the guide
Last edited by nickw on Tue Nov 23, 2021 8:22 pm, edited 1 time in total.

nickw
Posts: 23
Joined: Thu Nov 04, 2021 10:15 pm

Re: Python 3.8.8 and mariadb 10.3.28 not supported by 21.04

Post by nickw » Tue Nov 23, 2021 7:47 pm

In section " 3.2 RHEL Operating System", it mentions OMT.sh will install JAVA 11. It will not. It will provide you with " java-1.8.0-openjdk java-1.8.0-openjdk-devel". The same version the guide tells you to remove, and the wrong version the guide tells you OMT.sh will install.

from the guide:
The frontend of OpenEMM needs Java 11. You should use OMT to install it, in case it is
missing on your server. See section Runtime Deployment for details.
If Java 8 is installed on your server, you should remove it with
# yum remove java-1.8.0-openjdk

Am fixing this now, will post correct steps.

nickw
Posts: 23
Joined: Thu Nov 04, 2021 10:15 pm

Re: Python 3.8.8 and mariadb 10.3.28 not supported by 21.04

Post by nickw » Tue Nov 23, 2021 7:59 pm

When OMT.sh offers you to install java-1.8.*, exit the script and run:

yum install java-11-openjdk

Alright, mariadb doesn't want to work anymore.

These were all issues following the latest guide, I will keep attacking this in the hopes it will work. In the mean time, can you please update the guide with the correct procedures?

maschoff
Site Admin
Posts: 2510
Joined: Thu Aug 03, 2006 10:20 am
Location: Munich, Germany
Contact:

Re: Python 3.8.8 and mariadb 10.3.28 not supported by 21.04

Post by maschoff » Tue Nov 23, 2021 8:31 pm

If a directory does not exist on your server, simply create it with mkdir.

I did not find mentioning of ulimit in the guide.

You should not copy commands with line breaks, the Linux shell can not handle that.

To have OMT install Java 11 instead of Java 8, please update the runtime to 21.10.041 or later.
OpenEMM Maintainer

nickw
Posts: 23
Joined: Thu Nov 04, 2021 10:15 pm

Re: Python 3.8.8 and mariadb 10.3.28 not supported by 21.04

Post by nickw » Tue Nov 23, 2021 8:57 pm

If you install mariadb correctly, and java 11 correctly, get the database installed, get tomcat installed, this issue still persists:

genrsa: Can't open "/home/console/tomcat/conf/keys/birt_private.pem" for writing, No such file or directory
Can't open /home/console/tomcat/conf/keys/birt_private.pem for reading, No such file or directory
139973591902016:error:02001002:system library:fopen:No such file or directory:crypto/bio/bss_file.c:69:fopen('/home/console/tomcat/conf/keys/birt_private.pem','r')
139973591902016:error:2006D080:BIO routines:BIO_new_file:no such file:crypto/bio/bss_file.c:76:
unable to load Private Key
Cannot generate initial Statistics PPK keys

Post Reply