Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

finding outdated casks with and without appcast #55268

Closed
core-code opened this issue Nov 21, 2018 · 1,698 comments
Closed

finding outdated casks with and without appcast #55268

core-code opened this issue Nov 21, 2018 · 1,698 comments
Labels
outdated

Comments

@core-code
Copy link
Contributor

core-code commented Nov 21, 2018 •
edited
Loading

hello HBC community,

one of the 'problems' of Homebrew Cask is that it requires constant maintainance to keep working. any Cask with a version number needs to be updated every time a new version of this app is released.

for apps that have an sparkle/rss or github/atom feed from the vendor, keeping them up-to-date is relatively straightforward. @brianmorton has a great system implemented here. (his system incidentally also works for non-sparkle appcasts, but currently most of the Casks that have no sparkle, also have no appcast-stanza)

therefore i've been focusing my efforts on automatically finding outdated Casks on those without "sparkle appcast". every day i let a script run that compares the version of the Casks without appcast, to the database of app-versions that our company maintains. every day the script finds around 5 - 10 outdated Casks that should be updated e.g. using 'cask-repair'.

the design and implementation of the system is discussed here: #52837
and there was also a bit discussion about this here:
#54811

so, long story short, basically it would be great if the community could have a look at the
"cr-processed-DATE.txt"
files i place here:
http://macupdater.net/cask-repair/
each day and look through them to see which of those entries are real, official new releases of the apps and submit cask-repairs accordingly. i think this would also be a good task to get started with contributing to HBC.

for the time being, it would be best to note false positives (i.e. entries that are not real official releases of this app) here so i'll add them to the different filter-lists in the postprocessing script so that they won't appear in the next days output anymore.

UPDATE 11.dec.2018:
ok, the cask-repair system for apps without appcast has been working quite well over the past month, i guess around 80% success rate (i.e. percentage of entries in the txt files that are actually valid new releases). but, it seems like there are quite a lot of casks WITH appcast that are outdated despite the appcast. so i've implemented two new checks to try to improve the situation there:

crsparklefeed-DATE.txt
=> this checks each cask with an valid sparkle appcast each day and generates an output if the appcast has a new 'newest' entry since yesterday. since sparkle feeds should only contain valid releases, 100% of those should be valid updates to be done via 'cask-repair' (if someone else hasn't beaten you to it).

crgithub-DATE.txt
=> this checks each cask that has its releases on github (as denoted via the URL or APPCAST stanza) and checks github if a new release has been posted since yesterday. if available, it tries to query the 'Latest Release' as denoted on github by the developer, so that beta releases are not picked up. if no 'Latest Release' is marked, it falls back to just using the newest release and downgrades from error to warning.
@core-code
Copy link
Contributor Author

2018-11-21 output up

@core-code core-code mentioned this issue Nov 21, 2018
Closed
53 tasks
@ran-dall
Copy link
Contributor

@core-code Thanks! Got the PRs up as well. The output is getting better and better.

No problems today.

@vitorgalvao vitorgalvao added the good first issue Issue which is easy to tackle for first-time contributors. label Nov 21, 2018
@core-code
Copy link
Contributor Author

awesome, thanks ;)

2018-11-22 output up

@ran-dall
Copy link
Contributor

@core-code Happy Thanksgiving! 🦃

Sorry I was a little late today. Here's the work for the day...

data-dog - #54739
flash-player-debugger - I don't see the release anywhere.
parallels - #55270
prusa3d - Version is an RC
unshaky - Version is an Pre-release

Everything else was updated.

@core-code
Copy link
Contributor Author

core-code commented Nov 23, 2018 •
edited
Loading

thanks ;)

2018-11-23 output up

@ran-dall
Copy link
Contributor

ran-dall commented Nov 23, 2018 •
edited
Loading

@core-code ...done.👍

ipsecuritas-This is a build number update. It's also not on their website. http://www.lobotomo.com/products/IPSecuritas/index.html

...ipsecuritas cask: 4.9.1: 4.9.1|(null) cgi: 4.9.1 (4554)|4554

@core-code
Copy link
Contributor Author

...ipsecuritas cask: 4.9.1: 4.9.1|(null) cgi: 4.9.1 (4554)|4554

actually there was a problem 'mapping' the version number here, thanks for the heads-up, should be fixed now

@core-code
Copy link
Contributor Author

2018-11-24 output up

@ran-dall
Copy link
Contributor

ran-dall commented Nov 25, 2018 •
edited
Loading

@core-code Done. Some of them weren't merged but are now...👌

oni - Beta

@core-code
Copy link
Contributor Author

thanks ;)

2018-11-25 output up

@ran-dall
Copy link
Contributor

@core-code done.

datadog-agent - #54739

@core-code
Copy link
Contributor Author

datadog-agent - #54739

this seems to be some sort of eternal quest ^^

2018-11-26 output up - really tiny this time

@ran-dall
Copy link
Contributor

@core-code Done.

datadog-agent - #54739 (The quest continues...)
bonitastudiocommunity - 7.7.1 is the latest release on their site

@core-code
Copy link
Contributor Author

bonitastudiocommunity - 7.7.1 is the latest release on their site

it seems they changed their download URLs, and are now hosting here:
https://release.ow2.org/bonita/

i've sent a PR

@ran-dall
Copy link
Contributor

@core-code Good work! 👌

@core-code
Copy link
Contributor Author

2018-11-27 output up

@ran-dall
Copy link
Contributor

@core-code
done - no problemos today 🎉

@core-code
Copy link
Contributor Author

thanks ;)
2018-11-28 output up

@ran-dall
Copy link
Contributor

ran-dall commented Nov 29, 2018 •
edited
Loading

@core-code Done.

appgate-sdp-client - No newer version available for download.
flightgear - No newer version available for download.
android-studio - No newer version available for download.

@core-code
Copy link
Contributor Author

thanks, adjusted the postprocessing

2018-11-29 output up

@ran-dall
Copy link
Contributor

@core-code
done - no problemos today 🎉

@core-code
Copy link
Contributor Author

2018-11-30 output up

@ran-dall
Copy link
Contributor

@core-code 🙌 done.

alfred - No newer version available for download.
gray - #55526

@core-code
Copy link
Contributor Author

2018-12-01 output up

@ran-dall
Copy link
Contributor

ran-dall commented Dec 1, 2018 •
edited
Loading

@core-code done - no problemos today 🎉

@suschizu
Copy link
Contributor

suschizu commented Dec 2, 2018

2018-12-02 output is online 🙂

@ran-dall
Copy link
Contributor

ran-dall commented Dec 2, 2018 •
edited
Loading

@suschizu Thank you for the heads up! 🙏
@core-code Done. ✊

datadog-agent - #54739
cracked - No newer version available for download.
inkdrop - #55568
birdfont - I get the following error, twice...

curl: (56) Unexpected EOF                                                                                                                            
Error: Download failed on Cask 'birdfont' with message: Download failed: https://birdfont.org/download/birdfont-3.17.0-free.dmg

musescore - No newer version available for download.
gray - #55526

@core-code
Copy link
Contributor Author

core-code commented Dec 3, 2018 •
edited
Loading

2018-12-03 output up

probably a lot of things in there that already have open pull requests as things haven't been merged for a few days now. i want to include a check for open pull requests but didn't come around to it yet.

also there is something new today:
failingcasks_withoutfeed_2018-12-03.txt
lists all the casks that failed to 'brew cask fetch', which usually means either
• there is a new version and it needs a cask-repair
• there is no new version but the checksum changed which is problematic due to our checksum rules
• host is (temporary?) offline
in any case, i only checked the ~2300 casks that have no real sparkle appcasts - around 150GB. downloading the full cask set is around 400GB i think.

@vitorgalvao
Copy link
Member

new cask-repair versions shouldn't add the SHA for no_check casks, but we seen cases where this doesn't work

Should be fixed.

@suschizu
Copy link
Contributor

Thanks @ran-dall!
Todays output is online :)

@ran-dall
Copy link
Contributor

@suschizu Done ✊ | Thanks @core-code @vitorgalvao

newversion_github-2020-12-10: 14 cask updates detected / 06 cask updates sent

  • kekadefaultapp - utu
  • dteoh-devdocs - utd
  • robo-3t - su
  • milkytracker - utu
  • keka - utd
  • bitbar - utu
  • stoplight-studio - utu
  • session - utu

newversion_sparkle-2020-12-10: 16 cask updates detected / 05 cask updates sent

database-processed-2020-12-10: 32 cask updates detected / 17 cask updates sent

containsversion-2020-12-10: 21 cask updates detected / 14 cask updates sent

UPDATED

  • razorsql 9.2.6
  • pgadmin4 4.29
  • remote-desktop-manager-free 2020.3.3.0
  • studio-3t 2020.10.0

@suschizu
Copy link
Contributor

Thanks @ran-dall!
Todays output is online :)

@ran-dall
Copy link
Contributor

@suschizu Done ✊

newversion_github-2020-12-11: 16 cask updates detected / 08 cask updates sent

newversion_sparkle-2020-12-11: 26 cask updates detected / 09 cask updates sent

  • docker - utd
  • wireshark - utd
  • rectangle - utd
  • subethaedit - utd
  • transmit - utd
  • imazing - utd
  • macpilot - utd
  • soundsource - utd
  • opencore-configurator - utd
  • mweb - utd
  • get-backup-pro - utd
  • fork - utd
  • upic - utd
  • hstracker - utd
  • brave-browser - utu
  • cloudflare-warp - s
  • malus - utu

database-processed-2020-12-11: 26 cask updates detected / 12 cask updates sent

  • losslesscut - (dup)
  • azure-data-studio - utu
  • nvidia-geforce-now - utu
  • thebrain - utu
  • opera-gx - utu
  • azure-data-studio - utu
  • workflowy - Update workflowy from 1.3.5-13131 to 1.3.5-13423 #95249
  • gog-galaxy - utu
  • losslesscut - utu
  • boxcryptor - utu
  • coscreen - utu
  • anki - utu
  • snipaste - utu
  • qt-creator - utu

containsversion-2020-12-11: 20 cask updates detected / 09 cask updates sent

UPDATED

  • banking-4 7.5.2
  • jalbum 23.1

@suschizu
Copy link
Contributor

Thanks @ran-dall!
Todays output is online :)

@ran-dall
Copy link
Contributor

@suschizu Done ✊

newversion_github-2020-12-12: 17 cask updates detected / 07 cask updates sent

  • calibre - utd
  • netron - utd
  • menumeters - utd
  • aerial - utd
  • owncloud - utd
  • qownnotes - utd
  • gitify - utd
  • webcatalog - utd
  • vscodium - utu
  • zettelkasten - utu

newversion_sparkle-2020-12-12: 14 cask updates detected / 05 cask updates sent

database-processed-2020-12-12: 28 cask updates detected / 18 cask updates sent

containsversion-2020-12-12: 14 cask updates detected / 06 cask updates sent

UPDATED

  • razorsql 9.2.7
  • segger-ozone 3.22a
  • electron 11.1.0
  • jamulus 3.6.2

@suschizu
Copy link
Contributor

Thanks @ran-dall!
Todays output is online :)

@ran-dall
Copy link
Contributor

@suschizu Done ✊

newversion_github-2020-12-13: 19 cask updates detected / 11 cask updates sent

  • react-native-debugger - utd
  • vnote - su
  • prusaslicer - su
  • zettelkasten - utd
  • gitify - utd
  • fsnotes - utd
  • webcatalog - utd
  • mediaelch - utu

newversion_sparkle-2020-12-13: 06 cask updates detected / 02 cask updates sent

database-processed-2020-12-13: 06 cask updates detected / 02 cask updates sent

containsversion-2020-12-13: 09 cask updates detected / 03 cask updates sent

  • duet - utu
  • mixxx - utu
  • figma - utd
  • firestorm - utd
  • red-eye - utd
  • rowmote-helper - utu

UPDATED
none

@suschizu
Copy link
Contributor

Thanks @ran-dall!
Todays output is online :)

@ran-dall
Copy link
Contributor

@suschizu Done ✊

newversion_github-2020-12-14: 17 cask updates detected / 13 cask updates sent

newversion_sparkle-2020-12-14: 09 cask updates detected / 05 cask updates sent

  • unshaky - utd
  • marsedit - utd
  • notebooks - utd
  • clockify - utu

database-processed-2020-12-14: 02 cask updates detected / 02 cask updates sent

containsversion-2020-12-14: 19 cask updates detected / 11 cask updates sent

UPDATED

  • dcp-o-matic-batch-converter 2.14.47
  • dcp-o-matic-encode-server 2.14.47
  • dcp-o-matic 2.14.47
  • dcp-o-matic-kdm-creator 2.14.47
  • dcp-o-matic-player 2.14.47
  • rocks-n-diamonds 4.2.1.0

@ran-dall
Copy link
Contributor

ran-dall commented Dec 15, 2020 •
edited
Loading

@suschizu How we looking for today?

@suschizu
Copy link
Contributor

hey @ran-dall - sorry for being so late - Christmas is coming closer :/
I've just uploaded todays output

@ran-dall
Copy link
Contributor

@suschizu Done ✊

newversion_github-2020-12-15: 17 cask updates detected / 09 cask updates sent

  • xit - su
  • raspberry-pi-imager - utd
  • obs - utd
  • menumeters - utd
  • webots - utu
  • bitbar - utd
  • stoplight-studio - utu
  • emby-server - utu

newversion_sparkle-2020-12-15: 30 cask updates detected / 15 cask updates sent

  • origami-studio - utd
  • texshop - utd
  • menumeters - Update menumeters from 2.1.2.1 to 2.1.2.2 #95547
  • zappy - utd
  • graphicconverter - utd
  • loopback - utd
  • path-finder - utd
  • pictogram - utd
  • snagit - utd
  • altserver - utd
  • obs - utd
  • navicat-premium - utu
  • brave-browser-beta - utu
  • devonagent - utu
  • textexpander - utu

database-processed-2020-12-15: 03 cask updates detected / 03 cask updates sent

containsversion-2020-12-15: 35 cask updates detected / 25 cask updates sent

  • firefox - utu
  • macx-dvd-ripper-pro - utu
  • qiyimedia - utu
  • ocenaudio - utu
  • malus - utu
  • navicat-premium - utu
  • wechatwork - utu
  • firestorm - utu
  • berrycast - utu
  • canva - utu

UPDATED

  • bitwig-studio 3.3.1
  • sunvox 1.9.6c

@suschizu
Copy link
Contributor

Thanks @ran-dall!
Todays output is online :)

@ran-dall
Copy link
Contributor

@suschizu Done ✊

newversion_github-2020-12-16: 12 cask updates detected / 10 cask updates sent

newversion_sparkle-2020-12-16: 09 cask updates detected / 08 cask updates sent

  • iterm2 - utd

database-processed-2020-12-16: 03 cask updates detected / 01 cask updates sent

  • itrash - (dup x2)

containsversion-2020-12-16: 13 cask updates detected / 10 cask updates sent

  • evernote - utu
  • macx-dvd-ripper-pro - utu
  • affinity-designer-beta - s

UPDATED

  • lmsclients-squeezeplay 8.0.1r1310
  • gpxsee 7.38

@suschizu
Copy link
Contributor

Thanks @ran-dall!
Todays output is online :)

@ran-dall
Copy link
Contributor

ran-dall commented Dec 17, 2020 •
edited
Loading

@suschizu Done ✊ | @suschizu Can you post the output early tomorrow, please?

newversion_github-2020-12-17: 15 cask updates detected / 09 cask updates sent

  • qlcolorcode - su
  • murus - utd
  • owasp-zap - utd
  • vscodium - utu
  • pritunl - utu
  • session - utu

newversion_sparkle-2020-12-17: 15 cask updates detected / 09 cask updates sent

  • origami-studio - utd
  • airfoil - utd (dup x2)
  • blocs - utd
  • cookie - utd
  • coconutbattery - utu
  • backuploupe - utu

database-processed-2020-12-17: 03 cask updates detected / 02 cask updates sent

  • teamviewer - utd

containsversion-2020-12-17: 32 cask updates detected / 23 cask updates sent

UPDATED

  • smartgit 20.2.1
  • studio-3t 2020.10.1
  • zoc 8.01.6
  • bootstrap-studio 5.5.1

@suschizu
Copy link
Contributor

Thanks @ran-dall!
Todays output is online :)

@ran-dall
Copy link
Contributor

@suschizu Done ✊ | Thank you!

newversion_github-2020-12-18: 11 cask updates detected / 06 cask updates sent

  • signal-beta - utu
  • electorrent - utd
  • signal - utd
  • prusaslicer - su
  • abyssoft-teleport - utd

newversion_sparkle-2020-12-18: 12 cask updates detected / 07 cask updates sent

  • timemator - utd
  • moneymoney - utd
  • zeplin - utd
  • inssider - utu
  • powerphotos - utu

database-processed-2020-12-18: 04 cask updates detected / 03 cask updates sent

  • macx-dvd-ripper-pro - utd

containsversion-2020-12-18: 14 cask updates detected / 10 cask updates sent

  • duet - utu
  • realforce - utd
  • qqmusic - utu
  • garmin-basecam - utu

UPDATED

  • qt-design-studio 2.0.0
  • electrum 4.0.8

@suschizu
Copy link
Contributor

Thanks @ran-dall!
Todays output is online :)

@ran-dall
Copy link
Contributor

@suschizu Done ✊

newversion_github-2020-12-19: 17 cask updates detected / 10 cask updates sent

  • netron - utd
  • sequel-ace - utd
  • freetube - utd
  • kitty - utd
  • webcatalog - utd
  • electronmail - utu
  • prudent - utu

newversion_sparkle-2020-12-19: 14 cask updates detected / 04 cask updates sent

database-processed-2020-12-19: 02 cask updates detected / 02 cask updates sent

containsversion-2020-12-19: 14 cask updates detected / 12 cask updates sent

  • macx-dvd-ripper-pro - utu
  • sharemouse - dr 5.0.45 -> 5.0.44

UPDATED

  • postico 1.5.17
  • electrum 4.0.9
  • timing 2020.13

@suschizu
Copy link
Contributor

Thanks @ran-dall!
Todays output is online :)

@ran-dall
Copy link
Contributor

@suschizu Done ✊

newversion_github-2020-12-20: 11 cask updates detected / 07 cask updates sent

  • picgo - su
  • edex-ui - utd
  • abyssoft-teleport - utd
  • stats - utd

newversion_sparkle-2020-12-20: 09 cask updates detected / 04 cask updates sent

database-processed-2020-12-20: 05 cask updates detected / 04 cask updates sent

  • viber - utu

containsversion-2020-12-20: 03 cask updates detected / 01 cask updates sent

  • macmediakeyforwarder - utd
  • aviatrix-vpn-client - utd

UPDATED

  • flightgear 2020.3.5
  • gimp 2.10.22

@suschizu
Copy link
Contributor

Thanks @ran-dall!
Todays output is online :)

@ran-dall
Copy link
Contributor

@suschizu Done ✊

newversion_github-2020-12-21: 09 cask updates detected / 05 cask updates sent

  • dbeaver-community - utd
  • proxyman - utd
  • vnote - su
  • abyssoft-teleport - utd

newversion_sparkle-2020-12-21: 12 cask updates detected / 04 cask updates sent

database-processed-2020-12-21: 06 cask updates detected / 02 cask updates sent

  • mikogo - (dup)
  • nomad - utu
  • alinof-timer - (dup x2)

containsversion-2020-12-21: 14 cask updates detected / 11 cask updates sent

  • mockplus - utu
  • weka - utu
  • macmediakeyforwarder - utd

UPDATED

  • sauerbraten 2020.11.29,2020.12.20
  • inkdrop 5.2.0

@core-code
Copy link
Contributor Author

core-code commented Dec 21, 2020 •
edited by ran-dall
Loading

@ran-dall i wanted to let you know that we are going to stop providing the daily data upload. there have been many issues over the past year where breaking changes were introduced without giving us any kind of advance notice. today the casks were modified to remove the appcasts and add some livecheck code which breaks our system. i only learned about this after the changes had already gone live. needless to say, we cannot continue to depend on a system that just makes breaking changes like this. i think its obvious that making changes like this without discussion or advance warning can only be called hostile and there seems to be zero consideration for our system that has sent more than 25.000 PRs from our combined efforts. thanks for your help over the years and for being part of our team to move this project forward. from our side this time has now concluded and we are going stop pouring more valuable time into this.

@ran-dall
Copy link
Contributor

ran-dall commented Dec 21, 2020 •
edited
Loading

@core-code It's the end of an era, that's for sure. That said, I do agree with your point of view, and FWIW I share similar feelings that our efforts are/were somewhat undervalued... NTM that in our time here our team has become some of the more notable contributors of this repo. So yes, I feel like we should have been looped in many of conversations relating to these situations. In fact, I think we've had a similar conversation a few months ago, when I decided to deprecate V1 and start working on V2.

Regardless, I would like to maybe hear a little bit more from @vitorgalvao and @reitermarkus about what the reasoning really was. Also, I would like to get this "not looped in" situation taken care of, so that it doesn't keep happening in the future. Espcially for those of us, that will still be around.

From where I'm standing, I already started working with livecheck, but even before that, the MLv1 has had it's own system of determining versions for some time (which was based on the appcast system). Frankly, I liked the appcast system a bit more than I like the livecheck system, but I understand that appcast didn't work on brew core, so I'm guessing that was the main reason for brew moving in this direction. Anyways, the MLv1 version system broke a little while ago but maybe I can get it fixed in the coming days and replace the appcast dependacies to just use livecheck. Problem with tinkering with things right now is that I'm inundated with work, and the timing just wasn't right (which brings us back to the other point of not being looped in).

All in all though, I'd like to think we had a good run. I also think we all became great friends in the process too. So, I don't like the idea of not seeing you around anymore. I (for one) still plan on contiuning to work on cask in other areas (I've had a to-do list from @vitorgalvao for some time that needs attention) and also I plan to move forward on V2 with livecheck. That said, there maybe a pause on the updates for a little bit while I get everything ready...but V2 will be up soon.

To end this on a positive note though, I'd like to thank everyone else that has helped in the last few years, it's been really great and an outstanding experience to work with all of you and getting to know you guys. I hope that all of you (including you @core-code (and @suschizu too) 😉) are still around when MLv2 effort picks up with the MLv1 left off. I'll probably start a thread in the coming days about the MLv2 to get people's feedback and what they would like to see in the new ML. Till then though, I wish everyone happy holidays and a very happy new year (after all 2020 was a bit of a dumpster fire).

@Homebrew Homebrew locked as resolved and limited conversation to collaborators Jan 21, 2021
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Assignees
No one assigned
Labels
outdated
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
11 participants
@core-code @reitermarkus @brianbrownton @BrewTestBot @vitorgalvao @suschizu @ran-dall @hannesbraun and others