Package installation fails after new release v2.2.0

[pauliuskrispis]

Describe the bug

Hi guys! I cannot seem to install mysqlclient via pip after the new release (v2.2.0).

Dropping the stack trace:

Collecting mysqlclient (from mysql==0.0.3->-r /app/requirements.txt (line 12))
  Downloading mysqlclient-2.2.0.tar.gz (89 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 89.5/89.5 kB 250.3 MB/s eta 0:00:00
  Installing build dependencies: started
  Installing build dependencies: finished with status 'done'
  Getting requirements to build wheel: started
  Getting requirements to build wheel: finished with status 'error'
  error: subprocess-exited-with-error
  
  × Getting requirements to build wheel did not run successfully.
  │ exit code: 1
  ╰─> [24 lines of output]
      /bin/sh: 1: pkg-config: not found
      /bin/sh: 1: pkg-config: not found
      Trying pkg-config --exists mysqlclient
      Command 'pkg-config --exists mysqlclient' returned non-zero exit status 127.
      Trying pkg-config --exists mariadb
      Command 'pkg-config --exists mariadb' returned non-zero exit status 127.
      Traceback (most recent call last):
        File "/usr/local/lib/python3.8/dist-packages/pip/_vendor/pyproject_hooks/_in_process/_in_process.py", line 353, in <module>
          main()
        File "/usr/local/lib/python3.8/dist-packages/pip/_vendor/pyproject_hooks/_in_process/_in_process.py", line 335, in main
          json_out['return_val'] = hook(**hook_input['kwargs'])
        File "/usr/local/lib/python3.8/dist-packages/pip/_vendor/pyproject_hooks/_in_process/_in_process.py", line 118, in get_requires_for_build_wheel
          return hook(config_settings)
        File "/tmp/pip-build-env-d4slkkxg/overlay/lib/python3.8/site-packages/setuptools/build_meta.py", line 341, in get_requires_for_build_wheel
          return self._get_build_requires(config_settings, requirements=['wheel'])
        File "/tmp/pip-build-env-d4slkkxg/overlay/lib/python3.8/site-packages/setuptools/build_meta.py", line 323, in _get_build_requires
          self.run_setup()
        File "/tmp/pip-build-env-d4slkkxg/overlay/lib/python3.8/site-packages/setuptools/build_meta.py", line 338, in run_setup
          exec(code, locals())
        File "<string>", line 154, in <module>
        File "<string>", line 48, in get_config_posix
        File "<string>", line 27, in find_package_name
      Exception: Can not find valid pkg-config name.
      Specify MYSQLCLIENT_CFLAGS and MYSQLCLIENT_LDFLAGS env vars manually
      [end of output]
  
  note: This error originates from a subprocess, and is likely not a problem with pip.
error: subprocess-exited-with-error

I just want to verify if this is related to the new release.

[eljeffeg]

I can confirm from my testing that 2.1.1 worked fine and 2.2.0 failed to build for me as seen by @pauliuskrispis

[abelayalew]

version 2.1.1 works! thanks

[methane]

As message said, you need to install pkg-config

[methane]

Read #584

[eljeffeg]

@methane Alpine Linux doesn't have a pkg-config package. It does have a pkgconfig but installing that didn't resolve the issue for me.

[methane]

You should fix it by yourself or alpine community.

[darktohka]

Same issue here, please fix this as soon as possible. Reopen the issue as it is important.

Exporting environment variables as a workaround is definitely not proper.

[methane]

You need to fix pkg-config --clfags --libs mysqlclient on your environment.
And it is your environment issue. I won't fix it in your environemnt.

[karpikpl]

for others that try to fix it - there seems to be a typo in this answer
it's pkg-config --cflags --libs mysqlclient CFL not CLF

[jgb]

@methane I've got pkg-config installed, but still mysqlclient >= 2.2.0 fails to install as follows on Ubuntu 22.04 LTS and python 3.10:

Collecting mysqlclient==2.2.0 (from -r base-requirements.txt (line 65))                                                                                                                                                                        
  Downloading mysqlclient-2.2.0.tar.gz (89 kB)                                                                                                                                                                                                 
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 89.5/89.5 kB 8.4 MB/s eta 0:00:00                                                                                                                                                                
  Installing build dependencies ... done                                                                                                                                                                                                       
  Getting requirements to build wheel ... error                                                                                                                                                                                                
  error: subprocess-exited-with-error                                                                                                                                                                                                          
                                                                                                                                                                                                                                               
  × Getting requirements to build wheel did not run successfully.                                                                                                                                                                              
  │ exit code: 1                                                                                                                                                                                                                               
  ╰─> [22 lines of output]                                                                                                                                                                                                                     
      Trying pkg-config --exists mysqlclient                                                                                                                                                                                                   
      Command 'pkg-config --exists mysqlclient' returned non-zero exit status 1.                                                                                                                                                               
      Trying pkg-config --exists mariadb                                                                                                                                                                                                       
      Command 'pkg-config --exists mariadb' returned non-zero exit status 1.                                                                                                                                                                   
      Traceback (most recent call last):                                                                                                                                                                                                       
        File "/home/quividi/.venv/vidicenter/lib/python3.10/site-packages/pip/_vendor/pyproject_hooks/_in_process/_in_process.py", line 353, in <module>                                                                                       
          main()                                                                                                                                                                                                                               
        File "/home/quividi/.venv/vidicenter/lib/python3.10/site-packages/pip/_vendor/pyproject_hooks/_in_process/_in_process.py", line 335, in main                                                                                           
          json_out['return_val'] = hook(**hook_input['kwargs'])                                                                                                                                                                                
        File "/home/quividi/.venv/vidicenter/lib/python3.10/site-packages/pip/_vendor/pyproject_hooks/_in_process/_in_process.py", line 118, in get_requires_for_build_wheel                                                                   
          return hook(config_settings)                                                                                                                                                                                                         
        File "/tmp/pip-build-env-vvrc6ll4/overlay/lib/python3.10/site-packages/setuptools/build_meta.py", line 341, in get_requires_for_build_wheel                                                                                            
          return self._get_build_requires(config_settings, requirements=['wheel'])                                                                                                                                                             
        File "/tmp/pip-build-env-vvrc6ll4/overlay/lib/python3.10/site-packages/setuptools/build_meta.py", line 323, in _get_build_requires                                                                                                     
          self.run_setup()                                                                                                                                                                                                                     
        File "/tmp/pip-build-env-vvrc6ll4/overlay/lib/python3.10/site-packages/setuptools/build_meta.py", line 338, in run_setup                                                                                                               
          exec(code, locals())                                                                                                                                                                                                                 
        File "<string>", line 154, in <module>                                                                                                                                                                                                 
        File "<string>", line 48, in get_config_posix                                                                                                                                                                                          
        File "<string>", line 27, in find_package_name                                                                                                                                                                                         
      Exception: Can not find valid pkg-config name.                                                                                                                                                                                           
      Specify MYSQLCLIENT_CFLAGS and MYSQLCLIENT_LDFLAGS env vars manually                                                                                                                                                                     
      [end of output]                                                                                                                                                                                                                          
                                                                                                                                                                                                                                               
  note: This error originates from a subprocess, and is likely not a problem with pip.                                                                                                                                                         
error: subprocess-exited-with-error                                                                                                                                                                                                            
                                                                                                                                                                                                                                               
× Getting requirements to build wheel did not run successfully.                                                                                                                                                                                
│ exit code: 1                                                                                                                                                                                                                                 
╰─> See above for output.                                                                                                                                                                                                                      
                                                                                                                                                                                                                                               
note: This error originates from a subprocess, and is likely not a problem with pip.          

[indiVar0508]

did anyone find the solution for this i am also facing same issue!

[methane]

This is not issue of mysqlclient, but issue of your libmysqlclient (or libmariadb) installation.
This error messeage says both of pkg-config --cflags --libs mysqlclient and pkg-config --cflags --libs mariadb doesn't work.

If you want to get help, you need to explain how did you install libmysqlclient.

[indiVar0508]

I didn't install it,
thanks it worked for me now after installing :)

[nickkatsios]

So you just run: sudo apt install libmysqlclient and worked ?

[indiVar0508]

i had to do this libmysqlclient-dev but yeah it worked then,
for doing same in centos 7 i had to follow steps from here and it worked
https://stackoverflow.com/questions/46495448/unable-to-install-mysqlclient-on-centos

[eljeffeg]

Got it to work using pkgconfig mariadb-dev for Alpine.

[tunecrew]

Anyone using MacPorts on macOS - this worked for me (wasn't necessary for < 2.2.0):

export PKG_CONFIG_PATH=/opt/local/lib/mysql8/pkgconfig

[Wooden-Robot]

I use brew install mysql-client pkg-config before pip install mysqlclient, after install mysql-client and pkg-config, it shows these info:

==> mysql-client
mysql-client is keg-only, which means it was not symlinked into /usr/local,
because it conflicts with mysql (which contains client libraries).

If you need to have mysql-client first in your PATH, run:
  echo 'export PATH="/usr/local/opt/mysql-client/bin:$PATH"' >> ~/.zshrc

For compilers to find mysql-client you may need to set:
  export LDFLAGS="-L/usr/local/opt/mysql-client/lib"
  export CPPFLAGS="-I/usr/local/opt/mysql-client/include"

For pkg-config to find mysql-client you may need to set:
  export PKG_CONFIG_PATH="/usr/local/opt/mysql-client/lib/pkgconfig"

And I use export PKG_CONFIG_PATH="/usr/local/opt/mysql-client/lib/pkgconfig", then pip install mysqlclient. It works for me!

[codepraycode]

This worked for me, thank you

[Mereep]

Worked for me also on Intel Mac. Even with pkg-config installed, you need to have this path set explicitely. Wasn't a problem before.

[ThucHuynhCSE]

It work for me, thank you so much!!!

[SIGBL2015]

This worked for me also

[dwt]

I think I've got the same problem on CentOS 7, installation fails with a log like this:

Collecting mysqlclient>=1.4 (from Products.ZMySQLDA->-r https://raw.githubusercontent.com/zms-publishing/ZMS/main/requirements-full.txt (line 8))
  Using cached mysqlclient-2.2.0.tar.gz (89 kB)
  Installing build dependencies ... done
  Getting requirements to build wheel ... error
  error: subprocess-exited-with-error
  
  × Getting requirements to build wheel did not run successfully.
  │ exit code: 1
  ╰─> [22 lines of output]
      Trying pkg-config --exists mysqlclient
      Command 'pkg-config --exists mysqlclient' returned non-zero exit status 1.
      Trying pkg-config --exists mariadb
      Command 'pkg-config --exists mariadb' returned non-zero exit status 1.
      Traceback (most recent call last):
        File "/home/zope/virtualenv_demo/lib64/python3.8/site-packages/pip/_vendor/pyproject_hooks/_in_process/_in_process.py", line 353, in <module>
          main()
        File "/home/zope/virtualenv_demo/lib64/python3.8/site-packages/pip/_vendor/pyproject_hooks/_in_process/_in_process.py", line 335, in main
          json_out['return_val'] = hook(**hook_input['kwargs'])
        File "/home/zope/virtualenv_demo/lib64/python3.8/site-packages/pip/_vendor/pyproject_hooks/_in_process/_in_process.py", line 118, in get_requires_for_build_wheel
          return hook(config_settings)
        File "/tmp/pip-build-env-rbe1z0nv/overlay/lib/python3.8/site-packages/setuptools/build_meta.py", line 341, in get_requires_for_build_wheel
          return self._get_build_requires(config_settings, requirements=['wheel'])
        File "/tmp/pip-build-env-rbe1z0nv/overlay/lib/python3.8/site-packages/setuptools/build_meta.py", line 323, in _get_build_requires
          self.run_setup()
        File "/tmp/pip-build-env-rbe1z0nv/overlay/lib/python3.8/site-packages/setuptools/build_meta.py", line 338, in run_setup
          exec(code, locals())
        File "<string>", line 154, in <module>
        File "<string>", line 48, in get_config_posix
        File "<string>", line 27, in find_package_name
      Exception: Can not find valid pkg-config name.
      Specify MYSQLCLIENT_CFLAGS and MYSQLCLIENT_LDFLAGS env vars manually
      [end of output]
  
  note: This error originates from a subprocess, and is likely not a problem with pip.
error: subprocess-exited-with-error

As far as I can tell, on CentOS the mariadb-devel package does not install the hooks needed to make pkg-config recognize that mariadb is installed.

If I read the other bugs correctly, you switched from mysql_config to pkg-config in this release. Any specific reason you went with pkg-config exclusively, instead of just preferring it?

Falling back to mysql_config would solve the install for me.

I'm falling back to the workaround with the environment variables for now, but I'd really like to get rid of that.

[methane]

As far as I can tell, on CentOS the mariadb-devel package does not install the hooks needed to make pkg-config recognize that mariadb is installed.

As far as I know, CentOS is dead. No one support it.

Any specific reason you went with pkg-config exclusively, instead of just preferring it?

MySQL team breaks mysql_config very often.
mysql_config outputs worng value every time. mysql_config doesn't make any output sometime.
I just gave up. If you want mysql_support, you can support it by yourself by setting envvar from mysql_config. I don't want to maintain it anymore.

[methane]

I googled "mariadb-devel centos". I found RockyLinux package.

https://rockylinux.pkgs.org/9/rockylinux-crb-x86_64/mariadb-devel-10.5.16-2.el9_0.x86_64.rpm.html

It seems mariadb-devel in Rocky contains /usr/lib64/pkgconfig/mariadb.pc. It seems supports pkg-config.

[methane]

I confirmed CentOS Stream 8 can install mysqlclient with pkg-config without manual configuration.

> docker pull quay.io/centos/centos:stream8
> docker run -delete quay.io/centos/centos:stream8
0aeaa000b2d78065e806f986f78cb21d49d3078ef9c4e637a1304b1f60910c2d

> docker exec -it 0aeaa000b2d78065e806f986f78cb21d49d3078ef9c4e637a1304b1f60910c2d bash
[root@0aeaa000b2d7 /]# dnf install pkgconfig mariadb-devel
[root@0aeaa000b2d7 /]# pkg-config mariadb --cflags --libs
-I/usr/include/mysql -lmariadb -lpthread -ldl -lm -lssl -lcrypto -lz

[root@0aeaa000b2d7 /]# dnf install python3.11-devel python3.11-pip
[root@0aeaa000b2d7 /]# python3 -m pip -v install mysqlclient gcc
[root@0aeaa000b2d7 /]# python3 -m pip -v install mysqlclient
Using pip 22.3.1 from /usr/lib/python3.11/site-packages/pip (python 3.11)
Collecting mysqlclient
  Using cached mysqlclient-2.2.0.tar.gz (89 kB)
  Running command pip subprocess to install build dependencies
  Collecting setuptools>=61
    Using cached setuptools-68.0.0-py3-none-any.whl (804 kB)
  Installing collected packages: setuptools
  Successfully installed setuptools-68.0.0
  WARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv
  Installing build dependencies ... done
  Running command Getting requirements to build wheel
  /tmp/pip-build-env-x5gws3pp/overlay/lib/python3.11/site-packages/setuptools/config/pyprojecttoml.py:66: _BetaConfiguration: Support for `[tool.setuptools]` in `pyproject.toml` is still *beta*.
    config = read_configuration(filepath, True, ignore_option_errors, dist)
  Trying pkg-config --exists mysqlclient
  Command 'pkg-config --exists mysqlclient' returned non-zero exit status 1.
  Trying pkg-config --exists mariadb
  # Options for building extention module:
    extra_compile_args: ['-I/usr/include/mysql', '-std=c99']
    extra_link_args: ['-lmariadb', '-lpthread', '-ldl', '-lm', '-lssl', '-lcrypto', '-lz']
    define_macros: [('version_info', (2, 2, 0, 'final', 0)), ('__version__', '2.2.0')]
  running egg_info
  writing src/mysqlclient.egg-info/PKG-INFO
  writing dependency_links to src/mysqlclient.egg-info/dependency_links.txt
  writing top-level names to src/mysqlclient.egg-info/top_level.txt
  reading manifest file 'src/mysqlclient.egg-info/SOURCES.txt'
  reading manifest template 'MANIFEST.in'
  adding license file 'LICENSE'
  writing manifest file 'src/mysqlclient.egg-info/SOURCES.txt'
  Getting requirements to build wheel ... done
  Running command pip subprocess to install backend dependencies
  Collecting wheel
    Using cached wheel-0.40.0-py3-none-any.whl (64 kB)
  Installing collected packages: wheel
  Successfully installed wheel-0.40.0
  WARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv
  Installing backend dependencies ... done
  Running command Preparing metadata (pyproject.toml)
  /tmp/pip-build-env-x5gws3pp/overlay/lib/python3.11/site-packages/setuptools/config/pyprojecttoml.py:66: _BetaConfiguration: Support for `[tool.setuptools]` in `pyproject.toml` is still *beta*.
    config = read_configuration(filepath, True, ignore_option_errors, dist)
  Trying pkg-config --exists mysqlclient
  Command 'pkg-config --exists mysqlclient' returned non-zero exit status 1.
  Trying pkg-config --exists mariadb
  # Options for building extention module:
    extra_compile_args: ['-I/usr/include/mysql', '-std=c99']
    extra_link_args: ['-lmariadb', '-lpthread', '-ldl', '-lm', '-lssl', '-lcrypto', '-lz']
    define_macros: [('version_info', (2, 2, 0, 'final', 0)), ('__version__', '2.2.0')]
  running dist_info
  creating /tmp/pip-modern-metadata-v626eqq7/mysqlclient.egg-info
  writing /tmp/pip-modern-metadata-v626eqq7/mysqlclient.egg-info/PKG-INFO
  writing dependency_links to /tmp/pip-modern-metadata-v626eqq7/mysqlclient.egg-info/dependency_links.txt
  writing top-level names to /tmp/pip-modern-metadata-v626eqq7/mysqlclient.egg-info/top_level.txt
  writing manifest file '/tmp/pip-modern-metadata-v626eqq7/mysqlclient.egg-info/SOURCES.txt'
  reading manifest file '/tmp/pip-modern-metadata-v626eqq7/mysqlclient.egg-info/SOURCES.txt'
  reading manifest template 'MANIFEST.in'
  adding license file 'LICENSE'
  writing manifest file '/tmp/pip-modern-metadata-v626eqq7/mysqlclient.egg-info/SOURCES.txt'
  creating '/tmp/pip-modern-metadata-v626eqq7/mysqlclient-2.2.0.dist-info'
  Preparing metadata (pyproject.toml) ... done
Building wheels for collected packages: mysqlclient
  Running command Building wheel for mysqlclient (pyproject.toml)
  /tmp/pip-build-env-x5gws3pp/overlay/lib/python3.11/site-packages/setuptools/config/pyprojecttoml.py:66: _BetaConfiguration: Support for `[tool.setuptools]` in `pyproject.toml` is still *beta*.
    config = read_configuration(filepath, True, ignore_option_errors, dist)
  Trying pkg-config --exists mysqlclient
  Command 'pkg-config --exists mysqlclient' returned non-zero exit status 1.
  Trying pkg-config --exists mariadb
  # Options for building extention module:
    extra_compile_args: ['-I/usr/include/mysql', '-std=c99']
    extra_link_args: ['-lmariadb', '-lpthread', '-ldl', '-lm', '-lssl', '-lcrypto', '-lz']
    define_macros: [('version_info', (2, 2, 0, 'final', 0)), ('__version__', '2.2.0')]
  running bdist_wheel
  running build
  running build_py
...
  copying src/MySQLdb/_mysql.c -> build/lib.linux-aarch64-cpython-311/MySQLdb
  running build_ext
  building 'MySQLdb._mysql' extension
  creating build/temp.linux-aarch64-cpython-311
  creating build/temp.linux-aarch64-cpython-311/src
  creating build/temp.linux-aarch64-cpython-311/src/MySQLdb
  gcc -pthread -Wsign-compare -DDYNAMIC_ANNOTATIONS_ENABLED=1 -DNDEBUG -O2 -g -pipe -Wall -Werror=format-security -Wp,-D_FORTIFY_SOURCE=2 -Wp,-D_GLIBCXX_ASSERTIONS -fexceptions -fstack-protector-strong -grecord-gcc-switches -fasynchronous-unwind-tables -fstack-clash-protection -D_GNU_SOURCE -fPIC -fwrapv -O2 -g -pipe -Wall -Werror=format-security -Wp,-D_FORTIFY_SOURCE=2 -Wp,-D_GLIBCXX_ASSERTIONS -fexceptions -fstack-protector-strong -grecord-gcc-switches -fasynchronous-unwind-tables -fstack-clash-protection -D_GNU_SOURCE -fPIC -fwrapv -O2 -g -pipe -Wall -Werror=format-security -Wp,-D_FORTIFY_SOURCE=2 -Wp,-D_GLIBCXX_ASSERTIONS -fexceptions -fstack-protector-strong -grecord-gcc-switches -fasynchronous-unwind-tables -fstack-clash-protection -D_GNU_SOURCE -fPIC -fwrapv -fPIC "-Dversion_info=(2, 2, 0, 'final', 0)" -D__version__=2.2.0 -I/usr/include/python3.11 -c src/MySQLdb/_mysql.c -o build/temp.linux-aarch64-cpython-311/src/MySQLdb/_mysql.o -I/usr/include/mysql -std=c99
  gcc -pthread -shared -Wl,-z,relro -Wl,-z,now -g -Wl,-z,relro -Wl,-z,now -g build/temp.linux-aarch64-cpython-311/src/MySQLdb/_mysql.o -L/usr/lib64 -o build/lib.linux-aarch64-cpython-311/MySQLdb/_mysql.cpython-311-aarch64-linux-gnu.so -lmariadb -lpthread -ldl -lm -lssl -lcrypto -lz
  installing to build/bdist.linux-aarch64/wheel
...
  Building wheel for mysqlclient (pyproject.toml) ... done
  Created wheel for mysqlclient: filename=mysqlclient-2.2.0-cp311-cp311-linux_aarch64.whl size=137933 sha256=1c1ed71800a257b86b8500ccc2d2746c0d51cbfbeecec47edf6cb2faf05b7a99
  Stored in directory: /root/.cache/pip/wheels/06/2d/91/05c415fb414ea08c63eb163e0e1ac6f05169d2f6c87efc6121
Successfully built mysqlclient
Installing collected packages: mysqlclient
Successfully installed mysqlclient-2.2.0

[codertjay]

on ubuntu 23 i fixed mine by just installing pkgconf with . sudo apt install pkgconf

[methane]

pkg-config, not pkgconfig.
https://packages.ubuntu.com/search?keywords=pkg-config

[bmarquis3500]

sudo apt-get install libmysqlclient-dev

this worked for me

[Raidm404]

The Mysql 8 / percona * doesn't provide pkgconfig file . So just create it . A sample for percona 8 is given below,
the pkgconfig file name is /usr/lib/x86_64-linux-gnu/pkgconfig/mysqlclient.pc

#Percona or Mysql8 doesn't ship pkg-config
# copy to /usr/lib/x86_64-linux-gnu/pkgconfig/mysqlclient.pc
prefix=/usr
includedir=${prefix}/include/mysql
libdir=${prefix}/lib/x86_64-linux-gnu

Name: mysqlclient
Description: Percona MySQL client library
Version: 21.2.34
Cflags: -I${includedir}
Libs: -L${libdir} -lperconaserverclient
Libs.private: -lpthread -lssl -lcrypto -lresolv -lm -lrt

Now the following works fines:

# pkg-config --libs mysqlclient
-lperconaserverclient
#pkg-config --cflags mysqlclient
-I/usr/include/mysql

[nattofriends]

this is ticketed on Percona at https://jira.percona.com/browse/PS-8838

[nattofriends]

Fixed in Percona 8.0.37

[adarshshajiarackal]

brew install mysqlclient will help

[anentropic]

Does anyone have a recipe for getting this working on Amazon Linux 2 (i.e. the base image for images like aws-lambda-python) ?

I have:

FROM public.ecr.aws/lambda/python:3.11-arm64

RUN yum update -y &&\
    yum --setopt=skip_missing_names_on_install=False install -y gcc pkgconfig mariadb-devel

RUN find / -name "*.pc"
RUN find / -name "*mariadb*"
RUN find / -name "*mysql*"

ENV PKG_CONFIG_PATH=/usr/lib64/pkgconfig

RUN \
    MYSQLCLIENT_LDFLAGS=$(pkg-config --libs mariadb) \
    MYSQLCLIENT_CFLAGS=$(pkg-config --cflags mariadb) \
    pip install mysqlclient

and I get this output:

#6 [3/5] RUN find / -name "*.pc"
#6 0.297 /usr/share/pkgconfig/shared-mime-info.pc
#6 0.297 /usr/lib64/pkgconfig/libcrypto.pc
#6 0.297 /usr/lib64/pkgconfig/mit-krb5.pc
#6 0.297 /usr/lib64/pkgconfig/libpcre16.pc
#6 0.297 /usr/lib64/pkgconfig/kadm-client.pc
#6 0.297 /usr/lib64/pkgconfig/gssrpc.pc
#6 0.297 /usr/lib64/pkgconfig/krb5.pc
#6 0.297 /usr/lib64/pkgconfig/libssl.pc
#6 0.297 /usr/lib64/pkgconfig/mit-krb5-gssapi.pc
#6 0.297 /usr/lib64/pkgconfig/kdb.pc
#6 0.297 /usr/lib64/pkgconfig/kadm-server.pc
#6 0.297 /usr/lib64/pkgconfig/libsepol.pc
#6 0.297 /usr/lib64/pkgconfig/libselinux.pc
#6 0.297 /usr/lib64/pkgconfig/libpcreposix.pc
#6 0.297 /usr/lib64/pkgconfig/zlib.pc
#6 0.297 /usr/lib64/pkgconfig/libpcre.pc
#6 0.297 /usr/lib64/pkgconfig/openssl.pc
#6 0.297 /usr/lib64/pkgconfig/libpcrecpp.pc
#6 0.297 /usr/lib64/pkgconfig/libpcre32.pc
#6 0.297 /usr/lib64/pkgconfig/krb5-gssapi.pc
#6 0.297 /usr/lib64/pkgconfig/libverto.pc
#6 0.297 /usr/lib64/pkgconfig/com_err.pc
#6 0.297 /var/lang/lib/pkgconfig/python3-embed.pc
#6 0.297 /var/lang/lib/pkgconfig/python3.pc
#6 0.297 /var/lang/lib/pkgconfig/python-3.11-embed.pc
#6 0.297 /var/lang/lib/pkgconfig/python-3.11.pc
#6 DONE 0.3s

#7 [4/5] RUN find / -name "*mariadb*"
#7 0.340 /usr/share/doc/mariadb-libs-5.5.68
#7 0.340 /etc/ld.so.conf.d/mariadb-aarch64.conf
#7 0.340 /var/lib/yum/yumdb/m/e2e13dd7e4a67b5d6902629c9e56bbc75006b79d-mariadb-devel-5.5.68-1.amzn2.0.1-aarch64
#7 0.340 /var/lib/yum/yumdb/m/e4ee6d3d8a6acf586ecb757a24cfaced11ad5454-mariadb-libs-5.5.68-1.amzn2.0.1-aarch64
#7 DONE 0.4s

#8 [5/6] RUN find / -name "*mysql*"
#8 0.283 /usr/include/mysql
#8 0.283 /usr/include/mysql/mysql_embed.h
#8 0.283 /usr/include/mysql/mysql.h
#8 0.283 /usr/include/mysql/psi/mysql_file.h
#8 0.283 /usr/include/mysql/psi/mysql_thread.h
#8 0.283 /usr/include/mysql/mysqld_error.h
#8 0.283 /usr/include/mysql/mysql_com.h
#8 0.283 /usr/include/mysql/mysqld_ername.h
#8 0.283 /usr/include/mysql/mysql_time.h
#8 0.283 /usr/include/mysql/private/mysqld_suffix.h
#8 0.283 /usr/include/mysql/private/mysqld_default_groups.h
#8 0.283 /usr/include/mysql/private/probes_mysql_nodtrace.h
#8 0.283 /usr/include/mysql/private/mysqld.h
#8 0.283 /usr/include/mysql/private/probes_mysql.h
#8 0.283 /usr/include/mysql/private/mysql_async.h
#8 0.283 /usr/include/mysql/private/probes_mysql_dtrace.h
#8 0.283 /usr/include/mysql/mysql_version.h
#8 0.283 /usr/share/man/man1/mysql_config.1.gz
#8 0.283 /usr/share/aclocal/mysql.m4
#8 0.283 /usr/share/doc/mariadb-libs-5.5.68/README.mysql-license
#8 0.283 /usr/share/mysql
#8 0.283 /usr/lib64/mysql
#8 0.283 /usr/lib64/mysql/libmysqlclient_r.so
#8 0.283 /usr/lib64/mysql/mysql_config
#8 0.283 /usr/lib64/mysql/plugin/mysql_clear_password.so
#8 0.283 /usr/lib64/mysql/libmysqlclient.so
#8 0.283 /usr/lib64/mysql/libmysqlclient.so.18
#8 0.283 /usr/lib64/mysql/libmysqlclient.so.18.0.0
#8 0.283 /usr/bin/mysql_config
#8 0.283 /etc/alternatives/mysql_config
#8 0.283 /etc/my.cnf.d/mysql-clients.cnf
#8 0.283 /var/lib/alternatives/mysql_config
#8 DONE 0.3s

#9 [5/5] RUN     MYSQLCLIENT_LDFLAGS=$(pkg-config --libs mariadb)     MYSQLCLIENT_CFLAGS=$(pkg-config --cflags mariadb)     pip install mysqlclient
#9 0.212 Package mariadb was not found in the pkg-config search path.
#9 0.212 Perhaps you should add the directory containing `mariadb.pc'
#9 0.212 to the PKG_CONFIG_PATH environment variable
#9 0.212 No package 'mariadb' found
#9 0.214 Package mariadb was not found in the pkg-config search path.
#9 0.214 Perhaps you should add the directory containing `mariadb.pc'
#9 0.214 to the PKG_CONFIG_PATH environment variable
#9 0.214 No package 'mariadb' found

So I am unable to find a path to use for pkg-config

I tried this instead:

RUN \
    MYSQLCLIENT_LDFLAGS=$(mysql_config --libs) \
    MYSQLCLIENT_CFLAGS=$(mysql_config --cflags) \
    pip install mysqlclient

but then I get a different error:

#6 7.921       gcc -pthread -Wsign-compare -DNDEBUG -g -fwrapv -O3 -Wall -fPIC "-Dversion_info=(2, 2, 0, 'final', 0)" -D__version__=2.2.0 -I/var/lang/include/python3.11 -c src/MySQLdb/_mysql.c -o build/temp.linux-aarch64-cpython-311/src/MySQLdb/_mysql.o -I/usr/include/mysql -std=c99
#6 7.921       In file included from /var/lang/include/python3.11/Python.h:12:0,
#6 7.921                        from src/MySQLdb/_mysql.c:46:
#6 7.921       /var/lang/include/python3.11/pyconfig.h:1787:0: warning: "_POSIX_C_SOURCE" redefined
#6 7.921        #define _POSIX_C_SOURCE 200809L
#6 7.921
#6 7.921       In file included from /usr/include/sys/types.h:25:0,
#6 7.921                        from /usr/include/mysql/mysql.h:49,
#6 7.921                        from src/MySQLdb/_mysql.c:29:
#6 7.921       /usr/include/features.h:289:0: note: this is the location of the previous definition
#6 7.921        # define _POSIX_C_SOURCE 199506L
#6 7.921
#6 7.921       src/MySQLdb/_mysql.c: In function ‘_mysql_ConnectionObject_Initialize’:
#6 7.921       src/MySQLdb/_mysql.c:536:13: warning: implicit declaration of function ‘mysql_optionsv’; did you mean ‘mysql_options’? [-Wimplicit-function-declaration]
#6 7.921                    mysql_optionsv(&(self->connection), MYSQL_OPT_SSL_ENFORCE, (void *)&enforce_tls);
#6 7.921                    ^~~~~~~~~~~~~~
#6 7.921                    mysql_options
#6 7.921       src/MySQLdb/_mysql.c:536:49: error: ‘MYSQL_OPT_SSL_ENFORCE’ undeclared (first use in this function); did you mean ‘MYSQL_OPT_LOCAL_INFILE’?
#6 7.921                    mysql_optionsv(&(self->connection), MYSQL_OPT_SSL_ENFORCE, (void *)&enforce_tls);
#6 7.921                                                        ^~~~~~~~~~~~~~~~~~~~~
#6 7.921                                                        MYSQL_OPT_LOCAL_INFILE
#6 7.921       src/MySQLdb/_mysql.c:536:49: note: each undeclared identifier is reported only once for each function it appears in
#6 7.921       error: command '/usr/bin/gcc' failed with exit code 1
#6 7.921       [end of output]

and FWIW the values output by mysql_config are:

#6 [3/5] RUN mysql_config --libs
#6 0.169 -L/usr/lib64/mysql -lmysqlclient -lpthread -lz -lm -ldl -lssl -lcrypto
#6 DONE 0.2s

#7 [4/5] RUN mysql_config --cflags
#7 0.229 -I/usr/include/mysql
#7 DONE 0.2s

anyone got any idea what working values here should be?

at the moment the only thing that works for me is pin to previous version pip install mysqlclient==2.1.1 ...but that's not really sustainable

[methane]

at the moment the only thing that works for me is pin to previous version pip install mysqlclient==2.1.1 ...but that's not really sustainable

You are mixing legacy MariaDB and latest mysqlclient. It is not really sustainable. Stop mixing legasy software and latest software.

FROM public.ecr.aws/lambda/python:3.11-arm64

RUN yum install -y amazon-linux-extras
RUN PYTHON=/usr/bin/python2 amazon-linux-extras enable mariadb10.5
RUN yum install -y gcc pkgconfig mariadb-devel
RUN pip install mysqlclient

[anentropic]

Thank you, that worked 👍

[adarshshajiarackal]

Thank You

…

On Wed, 8 Nov 2023 at 17:49, Paul Garner ***@***.***> wrote: Does anyone have a recipe for getting this working on Amazon Linux 2 (i.e. the base image for images like aws-lambda-python) ? I have: FROM public.ecr.aws/lambda/python:3.11-arm64 RUN yum update -y &&\ yum --setopt=skip_missing_names_on_install=False install -y gcc pkgconfig mariadb-devel RUN find / -name "*.pc"RUN find / -name "*mariadb*"RUN find / -name "*mysql*" ENV PKG_CONFIG_PATH=/usr/lib64/pkgconfig RUN \ MYSQLCLIENT_LDFLAGS=$(pkg-config --libs mariadb) \ MYSQLCLIENT_CFLAGS=$(pkg-config --cflags mariadb) \ pip install mysqlclient and I get this output: #6 [3/5] RUN find / -name "*.pc" #6 0.297 /usr/share/pkgconfig/shared-mime-info.pc #6 0.297 /usr/lib64/pkgconfig/libcrypto.pc #6 0.297 /usr/lib64/pkgconfig/mit-krb5.pc #6 0.297 /usr/lib64/pkgconfig/libpcre16.pc #6 0.297 /usr/lib64/pkgconfig/kadm-client.pc #6 0.297 /usr/lib64/pkgconfig/gssrpc.pc #6 0.297 /usr/lib64/pkgconfig/krb5.pc #6 0.297 /usr/lib64/pkgconfig/libssl.pc #6 0.297 /usr/lib64/pkgconfig/mit-krb5-gssapi.pc #6 0.297 /usr/lib64/pkgconfig/kdb.pc #6 0.297 /usr/lib64/pkgconfig/kadm-server.pc #6 0.297 /usr/lib64/pkgconfig/libsepol.pc #6 0.297 /usr/lib64/pkgconfig/libselinux.pc #6 0.297 /usr/lib64/pkgconfig/libpcreposix.pc #6 0.297 /usr/lib64/pkgconfig/zlib.pc #6 0.297 /usr/lib64/pkgconfig/libpcre.pc #6 0.297 /usr/lib64/pkgconfig/openssl.pc #6 0.297 /usr/lib64/pkgconfig/libpcrecpp.pc #6 0.297 /usr/lib64/pkgconfig/libpcre32.pc #6 0.297 /usr/lib64/pkgconfig/krb5-gssapi.pc #6 0.297 /usr/lib64/pkgconfig/libverto.pc #6 0.297 /usr/lib64/pkgconfig/com_err.pc #6 0.297 /var/lang/lib/pkgconfig/python3-embed.pc #6 0.297 /var/lang/lib/pkgconfig/python3.pc #6 0.297 /var/lang/lib/pkgconfig/python-3.11-embed.pc #6 0.297 /var/lang/lib/pkgconfig/python-3.11.pc #6 DONE 0.3s #7 [4/5] RUN find / -name "*mariadb*" #7 0.340 /usr/share/doc/mariadb-libs-5.5.68 #7 0.340 /etc/ld.so.conf.d/mariadb-aarch64.conf #7 0.340 /var/lib/yum/yumdb/m/e2e13dd7e4a67b5d6902629c9e56bbc75006b79d-mariadb-devel-5.5.68-1.amzn2.0.1-aarch64 #7 0.340 /var/lib/yum/yumdb/m/e4ee6d3d8a6acf586ecb757a24cfaced11ad5454-mariadb-libs-5.5.68-1.amzn2.0.1-aarch64 #7 DONE 0.4s #8 [5/6] RUN find / -name "*mysql*" #8 0.283 /usr/include/mysql #8 0.283 /usr/include/mysql/mysql_embed.h #8 0.283 /usr/include/mysql/mysql.h #8 0.283 /usr/include/mysql/psi/mysql_file.h #8 0.283 /usr/include/mysql/psi/mysql_thread.h #8 0.283 /usr/include/mysql/mysqld_error.h #8 0.283 /usr/include/mysql/mysql_com.h #8 0.283 /usr/include/mysql/mysqld_ername.h #8 0.283 /usr/include/mysql/mysql_time.h #8 0.283 /usr/include/mysql/private/mysqld_suffix.h #8 0.283 /usr/include/mysql/private/mysqld_default_groups.h #8 0.283 /usr/include/mysql/private/probes_mysql_nodtrace.h #8 0.283 /usr/include/mysql/private/mysqld.h #8 0.283 /usr/include/mysql/private/probes_mysql.h #8 0.283 /usr/include/mysql/private/mysql_async.h #8 0.283 /usr/include/mysql/private/probes_mysql_dtrace.h #8 0.283 /usr/include/mysql/mysql_version.h #8 0.283 /usr/share/man/man1/mysql_config.1.gz #8 0.283 /usr/share/aclocal/mysql.m4 #8 0.283 /usr/share/doc/mariadb-libs-5.5.68/README.mysql-license #8 0.283 /usr/share/mysql #8 0.283 /usr/lib64/mysql #8 0.283 /usr/lib64/mysql/libmysqlclient_r.so #8 0.283 /usr/lib64/mysql/mysql_config #8 0.283 /usr/lib64/mysql/plugin/mysql_clear_password.so #8 0.283 /usr/lib64/mysql/libmysqlclient.so #8 0.283 /usr/lib64/mysql/libmysqlclient.so.18 #8 0.283 /usr/lib64/mysql/libmysqlclient.so.18.0.0 #8 0.283 /usr/bin/mysql_config #8 0.283 /etc/alternatives/mysql_config #8 0.283 /etc/my.cnf.d/mysql-clients.cnf #8 0.283 /var/lib/alternatives/mysql_config #8 DONE 0.3s #9 [5/5] RUN MYSQLCLIENT_LDFLAGS=$(pkg-config --libs mariadb) MYSQLCLIENT_CFLAGS=$(pkg-config --cflags mariadb) pip install mysqlclient #9 0.212 Package mariadb was not found in the pkg-config search path. #9 0.212 Perhaps you should add the directory containing `mariadb.pc' #9 0.212 to the PKG_CONFIG_PATH environment variable #9 0.212 No package 'mariadb' found #9 0.214 Package mariadb was not found in the pkg-config search path. #9 0.214 Perhaps you should add the directory containing `mariadb.pc' #9 0.214 to the PKG_CONFIG_PATH environment variable #9 0.214 No package 'mariadb' found So I am unable to find a path to use for pkg-config I tried this instead: RUN \ MYSQLCLIENT_LDFLAGS=$(mysql_config --libs) \ MYSQLCLIENT_CFLAGS=$(mysql_config --cflags) \ pip install mysqlclient but then I get a different error: #6 7.921 gcc -pthread -Wsign-compare -DNDEBUG -g -fwrapv -O3 -Wall -fPIC "-Dversion_info=(2, 2, 0, 'final', 0)" -D__version__=2.2.0 -I/var/lang/include/python3.11 -c src/MySQLdb/_mysql.c -o build/temp.linux-aarch64-cpython-311/src/MySQLdb/_mysql.o -I/usr/include/mysql -std=c99 #6 7.921 In file included from /var/lang/include/python3.11/Python.h:12:0, #6 7.921 from src/MySQLdb/_mysql.c:46: #6 7.921 /var/lang/include/python3.11/pyconfig.h:1787:0: warning: "_POSIX_C_SOURCE" redefined #6 7.921 #define _POSIX_C_SOURCE 200809L #6 7.921 #6 7.921 In file included from /usr/include/sys/types.h:25:0, #6 7.921 from /usr/include/mysql/mysql.h:49, #6 7.921 from src/MySQLdb/_mysql.c:29: #6 7.921 /usr/include/features.h:289:0: note: this is the location of the previous definition #6 7.921 # define _POSIX_C_SOURCE 199506L #6 7.921 #6 7.921 src/MySQLdb/_mysql.c: In function ‘_mysql_ConnectionObject_Initialize’: #6 7.921 src/MySQLdb/_mysql.c:536:13: warning: implicit declaration of function ‘mysql_optionsv’; did you mean ‘mysql_options’? [-Wimplicit-function-declaration] #6 7.921 mysql_optionsv(&(self->connection), MYSQL_OPT_SSL_ENFORCE, (void *)&enforce_tls); #6 7.921 ^~~~~~~~~~~~~~ #6 7.921 mysql_options #6 7.921 src/MySQLdb/_mysql.c:536:49: error: ‘MYSQL_OPT_SSL_ENFORCE’ undeclared (first use in this function); did you mean ‘MYSQL_OPT_LOCAL_INFILE’? #6 7.921 mysql_optionsv(&(self->connection), MYSQL_OPT_SSL_ENFORCE, (void *)&enforce_tls); #6 7.921 ^~~~~~~~~~~~~~~~~~~~~ #6 7.921 MYSQL_OPT_LOCAL_INFILE #6 7.921 src/MySQLdb/_mysql.c:536:49: note: each undeclared identifier is reported only once for each function it appears in #6 7.921 error: command '/usr/bin/gcc' failed with exit code 1 #6 7.921 [end of output] and FWIW the values output by mysql_config are: #6 [3/5] RUN mysql_config --libs #6 0.169 -L/usr/lib64/mysql -lmysqlclient -lpthread -lz -lm -ldl -lssl -lcrypto #6 DONE 0.2s #7 [4/5] RUN mysql_config --cflags #7 0.229 -I/usr/include/mysql #7 DONE 0.2s anyone got any idea what working values here should be? — Reply to this email directly, view it on GitHub <#624 (comment)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/BABQ53ZZVMBPPV7PYZUH4EDYDN2FJAVCNFSM6AAAAAAZQKM4KSVHI2DSMVQWIX3LMV43SRDJONRXK43TNFXW4Q3PNVWWK3TUHM3TKMBZHEYTS> . You are receiving this because you commented.Message ID: ***@***.***>

[adarshshajiarackal]

You're welcome!

…

On Wed, 8 Nov 2023 at 21:34, Paul Garner ***@***.***> wrote: Thank you, that worked 👍 — Reply to this email directly, view it on GitHub <#624 (reply in thread)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/BABQ537S7XDPD5K27SN3FYDYDOUR3AVCNFSM6AAAAAAZQKM4KSVHI2DSMVQWIX3LMV43SRDJONRXK43TNFXW4Q3PNVWWK3TUHM3TKMJSGUYTA> . You are receiving this because you commented.Message ID: ***@***.***>

[Karmenzind]

Alpine version Dockerfile (if anyone needs this):

FROM python:3.12-alpine

RUN apk add --no-cache pkgconf build-base mariadb-dev \
    && pip install --no-cache-dir mysqlclient \
    && apk del build-base pkgconf