ETL is a Moodle admin tool that allows to extract, transform and then load any data from a source system to a target system.
For example it is often used to slightly massage data before using it with Totara HR sync.
| Moodle version | Branch | PHP |
|---|---|---|
| Moodle 3.3 to 3.8 | master | 7.1 - 7.2+ |
| Moodle 3.9 to 3.10 | master | 7.2 - 7.4+ |
| Totara 12+ | master | 5.6 - 7.0+ |
NOTE: Moodle 3.11 is not supported. This is going to be the end of life version of the plugin.
NOTE: There is a fork of this under the MOODLE_35 branch which moves to a sub plugin architecture, and has various improvements:
https://github.com/catalyst/moodle-tool_etl/tree/MOODLE_35
At some point that branch needs to be untangled and parts of that merged into master with a proper upgrade script. Until then please consider than branch as experimental.
To install this plugin in your Moodle.
- Get the code and copy/install it to:
<moodledir>/admin/tool/etl - Run the upgrade using Moodle admin interface or command line, like
sudo -u www-data php admin/cli/upgrade.php
Note: the user may be different to www-data on your system.
- Log into your Moodle site as an administrator.
- Navigate to
Site administration ► Plugins ► Admin tools ► Extract, transform, load (ETL). - Create a new task: set Source, Target and Processor and configure each element as required. Also set a schedule for the task.
- The tasks will be executed on Moodle cron.
- You can see a history of any task execution.
- FTP - remote FTP server, login using username and password.
- SFTP - remote SFTP server, login using username and password.
- SFTP with key authentication - remote SFTP server, login using SSH key.
- Server folder - server local folder.
- Database - SQL query to export.
- URL - remote URL.
- Moodle sitedata - a folder inside Moodle sitedata directory.
- Server folder - server local folder.
- SFTP with key authentication - remote SFTP server, login using SSH key.
- Default processor - doesn't do any transformation, simply pass extracted data from a source to a target.
- Lowercase processor - transforms csv fields to lowercase
To create a new source, target or processor you'd just need to create a new class and extend a relevant base class and implement related interface. See existing elements as an example.
This plugin was developed by Catalyst IT Australia:
Issues, and pull requests using github are welcome and encouraged!
https://github.com/catalyst/moodle-tool_etl/issues
If you would like commercial support or would like to sponsor additional improvements to this plugin please contact us: