Skip Dir isn't working

[Bart0n]

Hi there,

Somehow I cannot get the skip-dir working proberly.
I have some GoPro and Drone footage that I don't want to be downloaded. So I skipped those directory's:

onedrive --confdir ~/.config/onedrive/accounts/bart/ --display-config
Reading configuration file: /home/bart/.config/onedrive/accounts/bart/config
Configuration file successfully loaded
Application version                          = onedrive v2.5.3-5-gc74e008
Compiled with                                = DMD 2109
Curl version                                 = libcurl/8.9.1 OpenSSL/3.3.1 zlib/1.3.1 brotli/1.1.0 zstd/1.5.6 libidn2/2.3.7 libpsl/0.21.2 libssh2/1.11.0 nghttp2/1.62.1 librtmp/2.3 OpenLDAP/2.6.8
User Application Config path                 = /home/bart/.config/onedrive/accounts/bart/
System Application Config path               = /etc/onedrive
Applicable Application 'config' location     = /home/bart/.config/onedrive/accounts/bart/config
Configuration file found in config location  = true - using 'config' file values to override application defaults
Applicable 'sync_list' location              = /home/bart/.config/onedrive/accounts/bart/sync_list
Applicable 'items.sqlite3' location          = /home/bart/.config/onedrive/accounts/bart/items.sqlite3
Config option 'drive_id'                     = 
Config option 'sync_dir'                     = ~/OneDrive_bart
Config option 'enable_logging'               = false
Config option 'log_dir'                      = /var/log/onedrive
Config option 'disable_notifications'        = false
Config option 'skip_dir'                     = Drone|GoPro|/Drone|/GoPro
Config option 'skip_dir_strict_match'        = false
Config option 'skip_file'                    = ~*|.~*|*.tmp|*.swp|*.partial
Config option 'skip_dotfiles'                = false
Config option 'skip_symlinks'                = false
Config option 'monitor_interval'             = 300
Config option 'monitor_log_frequency'        = 12
Config option 'monitor_fullscan_frequency'   = 12
Config option 'read_only_auth_scope'         = false
Config option 'dry_run'                      = false
Config option 'upload_only'                  = false
Config option 'download_only'                = false
Config option 'local_first'                  = false
Config option 'check_nosync'                 = false
Config option 'check_nomount'                = false
Config option 'resync'                       = true
Config option 'resync_auth'                  = false
Config option 'cleanup_local_files'          = false
Config option 'classify_as_big_delete'       = 1000
Config option 'disable_upload_validation'    = false
Config option 'disable_download_validation'  = false
Config option 'bypass_data_preservation'     = false
Config option 'no_remote_delete'             = false
Config option 'remove_source_files'          = false
Config option 'sync_dir_permissions'         = 700
Config option 'sync_file_permissions'        = 600
Config option 'space_reservation'            = 52428800
Config option 'application_id'               = d50ca740-c83f-4d1b-b616-12c519384f0c
Config option 'azure_ad_endpoint'            = 
Config option 'azure_tenant_id'              = 
Config option 'user_agent'                   = ISV|abraunegg|OneDrive Client for Linux/v2.5.3-5-gc74e008
Config option 'force_http_11'                = false
Config option 'debug_https'                  = false
Config option 'rate_limit'                   = 0
Config option 'operation_timeout'            = 3600
Config option 'dns_timeout'                  = 60
Config option 'connect_timeout'              = 10
Config option 'data_timeout'                 = 60
Config option 'ip_protocol_version'          = 0
Config option 'threads'                      = 8
Config option 'max_curl_idle'                = 120
Compile time option --enable-notifications   = false

Selective sync 'sync_list' configured        = true
sync_list config option 'sync_root_files'    = false
sync_list contents:

Config option 'sync_business_shared_items'   = false

Config option 'webhook_enabled'              = false

But when I do a resync, it still downloads the GoPro folder (and probally also the Drone folder if I leave it running):

onedrive --sync --confdir ~/.config/onedrive/accounts/bart/
Reading configuration file: /home/bart/.config/onedrive/accounts/bart/config
Configuration file successfully loaded

The usage of --resync will delete your local 'onedrive' client state, thus no record of your current 'sync status' will exist.
This has the potential to overwrite local versions of files with perhaps older versions of documents downloaded from OneDrive, resulting in local data loss.
If in doubt, backup your local data before using --resync

Are you sure you wish to proceed with --resync? [Y/N] Y

Deleting the saved application sync status ...
Using IPv4 and IPv6 (if configured) for all network operations
Attempting to contact Microsoft OneDrive Login Service
Successfully reached Microsoft OneDrive Login Service
Configuring Global Azure AD Endpoints
Fetching items from the OneDrive API for Drive ID: 696bd06f7be3124e ........................................................CAUTION:    The JSON element transmitted by the Microsoft OneDrive API includes HTML URL encoded items, which may complicate pattern matching and potentially lead to synchronisation problems for this item.
............................................................................................................Internet connectivity to Microsoft OneDrive service has been interrupted .. re-trying in the background
Retrying the respective Microsoft Graph API call for Internal Thread ID: USmNO5C6tiFVw8rh (Timestamp: 2024-Nov-22 16:49:16) ...
....................................................................................CAUTION:    The JSON element transmitted by the Microsoft OneDrive API includes HTML URL encoded items, which may complicate pattern matching and potentially lead to synchronisation problems for this item.
...................................................................................................................................................................... 
Processing 109456 applicable changes and items received from Microsoft OneDrive ..................................................... 
Number of items to download from Microsoft OneDrive: 1977
<ommited>
Downloading: GoPro/GH010786.MP4 ... 5%   |  ETA    00:00:57
Downloading: GoPro/GH010779.MP4 ... 5%   |  ETA    00:00:57
Downloading: GoPro/GH010780.MP4 ... 5%   |  ETA    00:00:57
Downloading: GoPro/GH010786.MP4 ... 10%  |  ETA    00:00:27
Downloading: GoPro/GH010779.MP4 ... 10%  |  ETA    00:00:27
Downloading: GoPro/GH010786.MP4 ... 15%  |  ETA    00:00:17
Downloading: GoPro/GH010779.MP4 ... 15%  |  ETA    00:00:17
Downloading: GoPro/GH010786.MP4 ... 20%  |  ETA    00:00:16
Downloading: GoPro/GH010779.MP4 ... 20%  |  ETA    00:00:16

What am I missing?

[abraunegg]

@Bart0n

This issue was resolved as part of v2.5.3 ...

When you installed v2.5.3 - did you uninstall / remove any package installation of 'onedrive' so that they are not conflicting?

When you run your current test, please add --verbose to double check you are actually running onedrive v2.5.3-5-gc74e008

If that all checks out, please raise a bug and complete all the details.

[Bart0n]

Hi @abraunegg,

I've uninstalled v2.5.2 as described here:
https://github.com/abraunegg/onedrive/blob/master/docs/install.md

So:

sudo make uninstall
removed onedrive folder (otherwise I couldn't git clone)
git clone https://github.com/abraunegg/onedrive.git
cd onedrive
./configure; make clean; make;
sudo make install

The display-config with verbose:

onedrive --confdir="/home/bart/.config/onedrive/accounts/bart/" --display-config --verbose
Reading configuration file: /home/bart/.config/onedrive/accounts/bart/config
Configuration file successfully loaded
Using 'user' configuration path for application config and state data: /home/bart/.config/onedrive/accounts/bart/
Application version                          = onedrive v2.5.3-5-gc74e008
Compiled with                                = DMD 2109
Curl version                                 = libcurl/8.9.1 OpenSSL/3.3.1 zlib/1.3.1 brotli/1.1.0 zstd/1.5.6 libidn2/2.3.7 libpsl/0.21.2 libssh2/1.11.0 nghttp2/1.62.1 librtmp/2.3 OpenLDAP/2.6.8
User Application Config path                 = /home/bart/.config/onedrive/accounts/bart/
System Application Config path               = /etc/onedrive
Applicable Application 'config' location     = /home/bart/.config/onedrive/accounts/bart/config
Configuration file found in config location  = true - using 'config' file values to override application defaults
Applicable 'sync_list' location              = /home/bart/.config/onedrive/accounts/bart/sync_list
Applicable 'items.sqlite3' location          = /home/bart/.config/onedrive/accounts/bart/items.sqlite3
Config option 'drive_id'                     = 
Config option 'sync_dir'                     = ~/OneDrive_bart
Config option 'enable_logging'               = false
Config option 'log_dir'                      = /var/log/onedrive
Config option 'disable_notifications'        = false
Config option 'skip_dir'                     = Drone|GoPro|/Drone|/GoPro
Config option 'skip_dir_strict_match'        = false
Config option 'skip_file'                    = ~*|.~*|*.tmp|*.swp|*.partial
Config option 'skip_dotfiles'                = false
Config option 'skip_symlinks'                = false
Config option 'monitor_interval'             = 300
Config option 'monitor_log_frequency'        = 12
Config option 'monitor_fullscan_frequency'   = 12
Config option 'read_only_auth_scope'         = false
Config option 'dry_run'                      = false
Config option 'upload_only'                  = false
Config option 'download_only'                = false
Config option 'local_first'                  = false
Config option 'check_nosync'                 = false
Config option 'check_nomount'                = false
Config option 'resync'                       = true
Config option 'resync_auth'                  = false
Config option 'cleanup_local_files'          = false
Config option 'classify_as_big_delete'       = 1000
Config option 'disable_upload_validation'    = false
Config option 'disable_download_validation'  = false
Config option 'bypass_data_preservation'     = false
Config option 'no_remote_delete'             = false
Config option 'remove_source_files'          = false
Config option 'sync_dir_permissions'         = 700
Config option 'sync_file_permissions'        = 600
Config option 'space_reservation'            = 52428800
Config option 'application_id'               = d50ca740-c83f-4d1b-b616-12c519384f0c
Config option 'azure_ad_endpoint'            = 
Config option 'azure_tenant_id'              = 
Config option 'user_agent'                   = ISV|abraunegg|OneDrive Client for Linux/v2.5.3-5-gc74e008
Config option 'force_http_11'                = false
Config option 'debug_https'                  = false
Config option 'rate_limit'                   = 0
Config option 'operation_timeout'            = 3600
Config option 'dns_timeout'                  = 60
Config option 'connect_timeout'              = 10
Config option 'data_timeout'                 = 60
Config option 'ip_protocol_version'          = 0
Config option 'threads'                      = 8
Config option 'max_curl_idle'                = 120
Compile time option --enable-notifications   = false

Selective sync 'sync_list' configured        = true
sync_list config option 'sync_root_files'    = false
sync_list contents:

Config option 'sync_business_shared_items'   = false

Config option 'webhook_enabled'              = false

The sync with verbose:

onedrive --sync --confdir ~/.config/onedrive/accounts/bart/ --verbose --resync
Reading configuration file: /home/bart/.config/onedrive/accounts/bart/config
Configuration file successfully loaded
Using 'user' configuration path for application config and state data: /home/bart/.config/onedrive/accounts/bart/

The usage of --resync will delete your local 'onedrive' client state, thus no record of your current 'sync status' will exist.
This has the potential to overwrite local versions of files with perhaps older versions of documents downloaded from OneDrive, resulting in local data loss.
If in doubt, backup your local data before using --resync

Are you sure you wish to proceed with --resync? [Y/N] Y

Deleting the saved application sync status ...
Using IPv4 and IPv6 (if configured) for all network operations
Attempting to contact Microsoft OneDrive Login Service
Successfully reached Microsoft OneDrive Login Service
Checking Application Version ...
Attempting to initialise the OneDrive API ...
Configuring Global Azure AD Endpoints
The OneDrive API was initialised successfully
Opening the item database ...
Application Version:  onedrive v2.5.3-5-gc74e008
Account Type:         personal
Default Drive ID:     696bd06f7be3124e
Default Root ID:      696BD06F7BE3124E!181
Remaining Free Space: 326.80 GB (350898828083 bytes)
Sync Engine Initialised with new Onedrive API instance
All application operations will be performed in the configured local 'sync_dir' directory: /home/bart/OneDrive_bart
Fetching /delta response from the OneDrive API for Drive ID: 696bd06f7be3124e
Processing API Response Bundle: 1 - Quantity of 'changes|items' in this bundle to process: 230
<ommited>

It looks like I'm running the v2.5.3-5.

Should I open a bug?

[abraunegg]

Yes - open a bug report please.

Also provide via email a verbose debug log as per this process for analysis: https://github.com/abraunegg/onedrive/wiki/Generate-debug-log-for-support

[abraunegg]

@Bart0n
I also notice this:

Selective sync 'sync_list' configured        = true
sync_list config option 'sync_root_files'    = false
sync_list contents:

Does this file exist: /home/bart/.config/onedrive/accounts/bart/sync_list and is it empty ?

Are you using the OneDriveGUI - if so, this might be related to this: bpozdena/OneDriveGUI#206

[abraunegg]

@Bart0n
I am unable to reproduce this issue at all with the release v2.5.3:

configuration

Application version                          = onedrive v2.5.3
Compiled with                                = DMD 2100
Curl version                                 = libcurl/7.61.1 OpenSSL/1.1.1k zlib/1.2.12 brotli/1.0.6 libidn2/2.2.0 libpsl/0.20.2 (+libidn2/2.2.0) libssh/0.9.6/openssl/zlib nghttp2/1.33.0
User Application Config path                 = /home/alex/.config/onedrive
System Application Config path               = /etc/onedrive
Applicable Application 'config' location     = /home/alex/.config/onedrive/config
Configuration file found in config location  = true - using 'config' file values to override application defaults
Applicable 'sync_list' location              = /home/alex/.config/onedrive/sync_list
Applicable 'items.sqlite3' location          = /home/alex/.config/onedrive/items.sqlite3
Config option 'drive_id'                     = 
Config option 'sync_dir'                     = ~/OneDrive
Config option 'enable_logging'               = false
Config option 'log_dir'                      = /var/log/onedrive
Config option 'disable_notifications'        = false
Config option 'skip_dir'                     = Drone|GoPro|/Drone|/GoPro
Config option 'skip_dir_strict_match'        = false
Config option 'skip_file'                    = ~*|.~*|*.tmp|*.swp|*.partial
Config option 'skip_dotfiles'                = true
Config option 'skip_symlinks'                = false
Config option 'monitor_interval'             = 300
Config option 'monitor_log_frequency'        = 12
Config option 'monitor_fullscan_frequency'   = 12
Config option 'read_only_auth_scope'         = false
Config option 'dry_run'                      = false
Config option 'upload_only'                  = false
Config option 'download_only'                = false
Config option 'local_first'                  = false
Config option 'check_nosync'                 = true
Config option 'check_nomount'                = true
Config option 'resync'                       = false
Config option 'resync_auth'                  = false
Config option 'cleanup_local_files'          = false

application run

.....
pening the item database ...
Application Version:  onedrive v2.5.3
Account Type:         personal
Default Drive ID:     66d53be8a5056eca
Default Root ID:      66D53BE8A5056ECA!101
Remaining Free Space: 4.40 GB (4724464025 bytes)
Sync Engine Initialised with new Onedrive API instance
All application operations will be performed in the configured local 'sync_dir' directory: /home/alex/OneDrive
Fetching /delta response from the OneDrive API for Drive ID: 66d53be8a5056eca
Processing API Response Bundle: 1 - Quantity of 'changes|items' in this bundle to process: 204
Skipping path - excluded by skip_dir config: /Drone
Skipping path - excluded by skip_dir config: /GoPro
Skipping file - file path is excluded by skip_dir config: ./Drone/image0.png
Skipping file - file path is excluded by skip_dir config: ./Drone/image1.png
Skipping file - file path is excluded by skip_dir config: ./Drone/image2.png
Skipping file - file path is excluded by skip_dir config: ./Drone/image3.png
Skipping file - file path is excluded by skip_dir config: ./Drone/image5.png
Skipping file - file path is excluded by skip_dir config: ./Drone/image4.png
Skipping file - file path is excluded by skip_dir config: ./Drone/image7.png
Skipping file - file path is excluded by skip_dir config: ./Drone/image8.png
Skipping file - file path is excluded by skip_dir config: ./Drone/image6.png
Skipping file - file path is excluded by skip_dir config: ./Drone/image9.png
Skipping file - file path is excluded by skip_dir config: ./GoPro/image11.png
Skipping file - file path is excluded by skip_dir config: ./GoPro/image12.png
Skipping file - file path is excluded by skip_dir config: ./GoPro/image13.png
Skipping file - file path is excluded by skip_dir config: ./GoPro/image14.png
Skipping file - file path is excluded by skip_dir config: ./GoPro/image15.png
Skipping file - file path is excluded by skip_dir config: ./GoPro/image16.png
Skipping file - file path is excluded by skip_dir config: ./GoPro/image17.png
Skipping file - file path is excluded by skip_dir config: ./GoPro/image18.png
Skipping file - file path is excluded by skip_dir config: ./GoPro/image19.png
Skipping file - file path is excluded by skip_dir config: ./GoPro/image20.png
Skipping file - file path is excluded by skip_dir config: ./GoPro/image10.png
Skipping path - excluded by skip_dir config: another folder/Drone
Skipping path - excluded by skip_dir config: another folder/GoPro
Skipping file - file path is excluded by skip_dir config: ./some folder/another folder/Drone/image21.png
Skipping file - file path is excluded by skip_dir config: ./some folder/another folder/Drone/image22.png
Skipping file - file path is excluded by skip_dir config: ./some folder/another folder/Drone/image23.png
Skipping file - file path is excluded by skip_dir config: ./some folder/another folder/Drone/image25.png
Skipping file - file path is excluded by skip_dir config: ./some folder/another folder/Drone/image26.png
Skipping file - file path is excluded by skip_dir config: ./some folder/another folder/Drone/image24.png
Skipping file - file path is excluded by skip_dir config: ./some folder/another folder/Drone/image28.png
Skipping file - file path is excluded by skip_dir config: ./some folder/another folder/Drone/image27.png
Skipping file - file path is excluded by skip_dir config: ./some folder/another folder/Drone/image29.png
Skipping file - file path is excluded by skip_dir config: ./some folder/another folder/Drone/image31.png
Skipping file - file path is excluded by skip_dir config: ./some folder/another folder/Drone/image30.png
Skipping file - file path is excluded by skip_dir config: ./some folder/another folder/Drone/image32.png
Skipping file - file path is excluded by skip_dir config: ./some folder/another folder/Drone/image34.png
Skipping file - file path is excluded by skip_dir config: ./some folder/another folder/Drone/image33.png
Skipping file - file path is excluded by skip_dir config: ./some folder/another folder/Drone/image35.png
Skipping file - file path is excluded by skip_dir config: ./some folder/another folder/Drone/image37.png
Skipping file - file path is excluded by skip_dir config: ./some folder/another folder/Drone/image36.png
Skipping file - file path is excluded by skip_dir config: ./some folder/another folder/Drone/image38.png
Skipping file - file path is excluded by skip_dir config: ./some folder/another folder/GoPro/image41.png
Skipping file - file path is excluded by skip_dir config: ./some folder/another folder/GoPro/image42.png
Skipping file - file path is excluded by skip_dir config: ./some folder/another folder/GoPro/image43.png
Skipping file - file path is excluded by skip_dir config: ./some folder/another folder/GoPro/image44.png
Skipping file - file path is excluded by skip_dir config: ./some folder/another folder/GoPro/image47.png
Skipping file - file path is excluded by skip_dir config: ./some folder/another folder/GoPro/image48.png
Skipping file - file path is excluded by skip_dir config: ./some folder/another folder/GoPro/image45.png
Skipping file - file path is excluded by skip_dir config: ./some folder/another folder/GoPro/image46.png
Skipping file - file path is excluded by skip_dir config: ./some folder/another folder/GoPro/image49.png
Skipping file - file path is excluded by skip_dir config: ./some folder/another folder/GoPro/image50.png
Skipping file - file path is excluded by skip_dir config: ./some folder/another folder/GoPro/image51.png
Processing API Response Bundle: 2 - Quantity of 'changes|items' in this bundle to process: 204
.....

application run - master

....
The OneDrive API was initialised successfully
Opening the item database ...
Application Version:  onedrive v2.5.3-6-g2caa497
Account Type:         personal
Default Drive ID:     66d53be8a5056eca
Default Root ID:      66D53BE8A5056ECA!101
Remaining Free Space: 4.40 GB (4724464025 bytes)
Sync Engine Initialised with new Onedrive API instance
All application operations will be performed in the configured local 'sync_dir' directory: /home/alex/OneDrive
Fetching /delta response from the OneDrive API for Drive ID: 66d53be8a5056eca
Processing API Response Bundle: 1 - Quantity of 'changes|items' in this bundle to process: 204
Skipping path - excluded by skip_dir config: /Drone
Skipping path - excluded by skip_dir config: /GoPro
Skipping file - file path is excluded by skip_dir config: ./Drone/image0.png
Skipping file - file path is excluded by skip_dir config: ./Drone/image1.png
Skipping file - file path is excluded by skip_dir config: ./Drone/image2.png
Skipping file - file path is excluded by skip_dir config: ./Drone/image3.png
Skipping file - file path is excluded by skip_dir config: ./Drone/image5.png
Skipping file - file path is excluded by skip_dir config: ./Drone/image4.png
Skipping file - file path is excluded by skip_dir config: ./Drone/image7.png
Skipping file - file path is excluded by skip_dir config: ./Drone/image8.png
Skipping file - file path is excluded by skip_dir config: ./Drone/image6.png
Skipping file - file path is excluded by skip_dir config: ./Drone/image9.png
Skipping file - file path is excluded by skip_dir config: ./GoPro/image11.png
Skipping file - file path is excluded by skip_dir config: ./GoPro/image12.png
Skipping file - file path is excluded by skip_dir config: ./GoPro/image13.png
Skipping file - file path is excluded by skip_dir config: ./GoPro/image14.png
Skipping file - file path is excluded by skip_dir config: ./GoPro/image15.png
Skipping file - file path is excluded by skip_dir config: ./GoPro/image16.png
Skipping file - file path is excluded by skip_dir config: ./GoPro/image17.png
Skipping file - file path is excluded by skip_dir config: ./GoPro/image18.png
Skipping file - file path is excluded by skip_dir config: ./GoPro/image19.png
Skipping file - file path is excluded by skip_dir config: ./GoPro/image20.png
Skipping file - file path is excluded by skip_dir config: ./GoPro/image10.png
Skipping path - excluded by skip_dir config: another folder/Drone
Skipping path - excluded by skip_dir config: another folder/GoPro
Skipping file - file path is excluded by skip_dir config: ./some folder/another folder/Drone/image21.png
Skipping file - file path is excluded by skip_dir config: ./some folder/another folder/Drone/image22.png
Skipping file - file path is excluded by skip_dir config: ./some folder/another folder/Drone/image23.png
Skipping file - file path is excluded by skip_dir config: ./some folder/another folder/Drone/image25.png
Skipping file - file path is excluded by skip_dir config: ./some folder/another folder/Drone/image26.png
Skipping file - file path is excluded by skip_dir config: ./some folder/another folder/Drone/image24.png
Skipping file - file path is excluded by skip_dir config: ./some folder/another folder/Drone/image28.png
Skipping file - file path is excluded by skip_dir config: ./some folder/another folder/Drone/image27.png
Skipping file - file path is excluded by skip_dir config: ./some folder/another folder/Drone/image29.png
Skipping file - file path is excluded by skip_dir config: ./some folder/another folder/Drone/image31.png
Skipping file - file path is excluded by skip_dir config: ./some folder/another folder/Drone/image30.png
Skipping file - file path is excluded by skip_dir config: ./some folder/another folder/Drone/image32.png
Skipping file - file path is excluded by skip_dir config: ./some folder/another folder/Drone/image34.png
Skipping file - file path is excluded by skip_dir config: ./some folder/another folder/Drone/image33.png
Skipping file - file path is excluded by skip_dir config: ./some folder/another folder/Drone/image35.png
Skipping file - file path is excluded by skip_dir config: ./some folder/another folder/Drone/image37.png
Skipping file - file path is excluded by skip_dir config: ./some folder/another folder/Drone/image36.png
Skipping file - file path is excluded by skip_dir config: ./some folder/another folder/Drone/image38.png
Skipping file - file path is excluded by skip_dir config: ./some folder/another folder/GoPro/image41.png
Skipping file - file path is excluded by skip_dir config: ./some folder/another folder/GoPro/image42.png
Skipping file - file path is excluded by skip_dir config: ./some folder/another folder/GoPro/image43.png
Skipping file - file path is excluded by skip_dir config: ./some folder/another folder/GoPro/image44.png
Skipping file - file path is excluded by skip_dir config: ./some folder/another folder/GoPro/image47.png
Skipping file - file path is excluded by skip_dir config: ./some folder/another folder/GoPro/image48.png
Skipping file - file path is excluded by skip_dir config: ./some folder/another folder/GoPro/image45.png
Skipping file - file path is excluded by skip_dir config: ./some folder/another folder/GoPro/image46.png
Skipping file - file path is excluded by skip_dir config: ./some folder/another folder/GoPro/image49.png
Skipping file - file path is excluded by skip_dir config: ./some folder/another folder/GoPro/image50.png
Skipping file - file path is excluded by skip_dir config: ./some folder/another folder/GoPro/image51.png
Processing API Response Bundle: 2 - Quantity of 'changes|items' in this bundle to process: 204
....

In all cases:

• Folder /Drone or /GoPro is skipped
• Folder Drone or GoPro is skipped if found anywhere

I tested this with & without an empty sync_list file and even a sync_list with spaces as lines (which is a bug that has been fixed).

In either case, the folders as specified in 'skip_dir' are skipped without issue.

Please re-validate your testing.

[Bart0n]

Hi @abraunegg,

First of all, thanks for the support and quick response. Much appreciated!

sync_list file does exist, but is empty.
Yes I use onedrivegui.

ls -lah ~/.config/onedrive/accounts/bart/
total 80K
drwxrwxr-x 2 bart bart 4,0K nov 22 20:21 .
drwxrwxr-x 3 bart bart 4,0K okt 31 09:18 ..
-rw-rw-r-- 1 bart bart  135 nov 22 16:29 config
-rw------- 1 bart bart  135 nov 22 16:29 .config.backup
-rw-rw-r-- 1 bart bart  135 nov 22 16:29 config_backup
-rw------- 1 bart bart   28 nov 22 20:21 .config.hash
-rw-r--r-- 1 bart bart  44K nov 22 20:21 items.sqlite3
-rw------- 1 bart bart  424 nov 22 20:21 refresh_token
-rw-rw-r-- 1 bart bart    0 nov 22 16:29 sync_list
-rw------- 1 bart bart   28 nov 22 20:21 .sync_list.hash

Removed the sync_list file (rm -f sync_list)

Started the sync:

onedrive --sync --confdir ~/.config/onedrive/accounts/bart/ --verbose
Reading configuration file: /home/bart/.config/onedrive/accounts/bart/config
Configuration file successfully loaded
Using 'user' configuration path for application config and state data: /home/bart/.config/onedrive/accounts/bart/

The usage of --resync will delete your local 'onedrive' client state, thus no record of your current 'sync status' will exist.
This has the potential to overwrite local versions of files with perhaps older versions of documents downloaded from OneDrive, resulting in local data loss.
If in doubt, backup your local data before using --resync

Are you sure you wish to proceed with --resync? [Y/N] Y

Deleting the saved application sync status ...
Using IPv4 and IPv6 (if configured) for all network operations
Attempting to contact Microsoft OneDrive Login Service
Successfully reached Microsoft OneDrive Login Service
Checking Application Version ...
Attempting to initialise the OneDrive API ...
Configuring Global Azure AD Endpoints
The OneDrive API was initialised successfully
Opening the item database ...
Application Version:  onedrive v2.5.3-5-gc74e008
Account Type:         personal
Default Drive ID:     696bd06f7be3124e
Default Root ID:      696BD06F7BE3124E!181
Remaining Free Space: 326.80 GB (350898828083 bytes)
Sync Engine Initialised with new Onedrive API instance
All application operations will be performed in the configured local 'sync_dir' directory: /home/bart/OneDrive_bart
Fetching /delta response from the OneDrive API for Drive ID: 696bd06f7be3124e
Processing API Response Bundle: 1 - Quantity of 'changes|items' in this bundle to process: 230
Processing API Response Bundle: 2 - Quantity of 'changes|items' in this bundle to process: 250
Processing API Response Bundle: 3 - Quantity of 'changes|items' in this bundle to process: 253
Processing API Response Bundle: 4 - Quantity of 'changes|items' in this bundle to process: 239
Processing API Response Bundle: 5 - Quantity of 'changes|items' in this bundle to process: 231
Processing API Response Bundle: 6 - Quantity of 'changes|items' in this bundle to process: 245
Processing API Response Bundle: 7 - Quantity of 'changes|items' in this bundle to process: 243
Processing API Response Bundle: 8 - Quantity of 'changes|items' in this bundle to process: 236
Processing API Response Bundle: 9 - Quantity of 'changes|items' in this bundle to process: 237
Processing API Response Bundle: 10 - Quantity of 'changes|items' in this bundle to process: 230
Processing API Response Bundle: 11 - Quantity of 'changes|items' in this bundle to process: 244
Processing API Response Bundle: 12 - Quantity of 'changes|items' in this bundle to process: 241
Processing API Response Bundle: 13 - Quantity of 'changes|items' in this bundle to process: 243
Processing API Response Bundle: 14 - Quantity of 'changes|items' in this bundle to process: 245
Processing API Response Bundle: 15 - Quantity of 'changes|items' in this bundle to process: 241
Processing API Response Bundle: 16 - Quantity of 'changes|items' in this bundle to process: 233
Processing API Response Bundle: 17 - Quantity of 'changes|items' in this bundle to process: 244
Processing API Response Bundle: 18 - Quantity of 'changes|items' in this bundle to process: 242
Processing API Response Bundle: 19 - Quantity of 'changes|items' in this bundle to process: 239
Processing API Response Bundle: 20 - Quantity of 'changes|items' in this bundle to process: 238
Processing API Response Bundle: 21 - Quantity of 'changes|items' in this bundle to process: 234
Processing API Response Bundle: 22 - Quantity of 'changes|items' in this bundle to process: 241
Processing API Response Bundle: 23 - Quantity of 'changes|items' in this bundle to process: 244
Processing API Response Bundle: 24 - Quantity of 'changes|items' in this bundle to process: 217
Processing API Response Bundle: 25 - Quantity of 'changes|items' in this bundle to process: 212
Processing API Response Bundle: 26 - Quantity of 'changes|items' in this bundle to process: 212
Processing API Response Bundle: 27 - Quantity of 'changes|items' in this bundle to process: 208
Skipping path - excluded by skip_dir config: /GoPro
Skipping file - file path is excluded by skip_dir config: ./GoPro/test.txt
Skipping file - file path is excluded by skip_dir config: ./GoPro/testvanaf

Looking at the last lines, it seemed to have some impact.
Going to sleep now, will update the results tomorrow morning.

[abraunegg]

@Bart0n

sync_list file does exist, but is empty.

Thanks for the confirmation.

If you rebuild from 'master' and use onedrive v2.5.3-7-ge7dbf8e or greater, this particular issue is solved. It will be included in the v2.5.4 release.

[abraunegg]

How do I use v2.5.3-7-ge7dbf8e?

Your 'package' from the OpenSuSE Build Service is installing to one location, and your built application is installing to another.

You must uninstall the 'package' with: sudo apt remove onedrive to remove that version, then hopefully your system will detect your installation in /usr/local/bin/onedrive as per your installation section:

....
(dmd-2.109.1)(base) ts@ts-IDEAPAD-5-Pro-16HU6:~/onedrive$ 
(dmd-2.109.1)(base) ts@ts-IDEAPAD-5-Pro-16HU6:~/onedrive$ sudo make install
/usr/bin/install -c -D onedrive /usr/local/bin/onedrive
/usr/bin/install -c -D -m 0644 onedrive.1 /usr/local/share/man/man1/onedrive.1
....

[ArtificialTruth]

Thank you, now running onedrive v2.5.3-12-g228e7db
I still can't get folder exclusion to work though, eg trying to exclude .venv and its contents no matter the location

but onedrive monitor with --verbose displays lines like:
Including file - included by sync_list config: some/path/.venv/lib/python3.10/site-packages/sklearn/svm/src/libsvm/libsvm_template.cpp

Here's my config
https://pastebin.com/r4sFJtwJ

More log snippets:
Processing API Response Bundle: 46 - Quantity of 'changes|items' in this bundle to process: 216
Including path - included by sync_list config: some/path/9th
Including path - included by sync_list config: some/path/9th/BDM
Including path - included by sync_list config: some/path/9th/BDM/exercise-7
Including path - included by sync_list config: some/path/9th/BDM/exercise-7/exercise-7-Sklearn-Pipelines
Skipping path - excluded by skip_dir config: exercise-7-Sklearn-Pipelines/.venv
Including path - included by sync_list config: some/path/9th/BDM/exercise-7/exercise-7-Sklearn-Pipelines/.venv/lib

[abraunegg]

Unable to view log.

If you believe you have an issue, please raise a bug report providing all details.

[ArtificialTruth]

Thanks again for your support 😊 I've submitted a bug report.

[abraunegg]

Wil review bug and attempt to replicate.

Whilst this is not your issue - you are using Ubuntu - please ensure you upgrade your curl version in the mean time - it will save you many issues down the track. Please read #2997 for details.

An alternate is to not use Ubuntu and use a better distribution - but that is your choice.