bug: target-mysql cannot add - meltano add loader target-mysql failed

[chathushka1996]

Meltano Version

3.3.1

Python Version

3.8

Bug scope

CLI (options, error messages, logging, etc.)

Operating System

Linux - Ubuntu 20.04

Description

Error while add target-mysql to my project

Code

ubuntu@ip-172-31-26-110:~/meltano/mysql-to-mysql$ meltano add loader target-mysql

error occurred after above code

2024-02-15T09:26:45.071565Z [warning  ] `kind: password` is deprecated for setting definitions in favour of `sensitive: true`, and is currently in use by the following settings of loader 'target-mysql': 'password'. Please open an issue or pull request to update the plugin definition on Meltano Hub at https://github.com/meltano/hub/blob/main/_data/meltano/loaders/target-mysql/thkwag.yml.
Loader 'target-mysql' already exists in your Meltano project
To add it to your project another time so that each can be configured differently,
add a new plugin inheriting from the existing one with its own unique name:
        meltano add loader target-mysql--new --inherit-from target-mysql

Installing loader 'target-mysql'...
2024-02-15T09:26:55.416698Z [info     ] Logged pip install output to /home/ubuntu/meltano/mysql-to-mysql/.meltano/logs/pip/loaders/target-mysql/pip.log
Loader 'target-mysql' could not be installed: Failed to install plugin 'target-mysql'.
Collecting thk-target-mysql
  Using cached thk_target_mysql-0.1.3-py3-none-any.whl.metadata (4.2 kB)
Collecting cryptography<42.0.0,>=41.0.2 (from thk-target-mysql)
  Using cached cryptography-41.0.7-cp37-abi3-manylinux_2_28_x86_64.whl.metadata (5.2 kB)
Collecting mysqlclient<3.0.0,>=2.2.0 (from thk-target-mysql)
  Using cached mysqlclient-2.2.4.tar.gz (90 kB)
  Installing build dependencies: started
  Installing build dependencies: finished with status 'done'
  Getting requirements to build wheel: started
  error: subprocess-exited-with-error
  
  Ã Getting requirements to build wheel did not run successfully.
  â exit code: 1
  â°â> See above for output.
  
  note: This error originates from a subprocess, and is likely not a problem with pip.
  Getting requirements to build wheel: finished with status 'error'
error: subprocess-exited-with-error

à Getting requirements to build wheel did not run successfully.
â exit code: 1
â°â> See above for output.

note: This error originates from a subprocess, and is likely not a problem with pip.

Need help fixing this problem? Visit http://melta.no/ for troubleshooting steps, or to
join our friendly Slack community.

Failed to install plugin(s)

[tayloramurphy]

@chathushka1996 can you try using the install command with the --clean flag? @edgarrmondragon anything else he should try?

[edgarrmondragon]

@chathushka1996 can you try using the install command with the --clean flag? @edgarrmondragon anything else he should try?

Yeah, mysqlclient doesn't publish wheels for anything other than windows¹ so it has to be built from source on all other systems, which means you need to have the right dependencies installed: https://github.com/PyMySQL/mysqlclient/blob/main/README.md#install

Linking to the Slack thread: https://meltano.slack.com/archives/C069CQNHDNF/p1708013036862019

Footnotes

1. https://pypi.org/project/mysqlclient/#files ↩

[edgarrmondragon]

I've transferred this to meltano/hub so we can keep track of linking/documenting installation troubleshooting in https://hub.meltano.com/loaders/target-mysql