Code

Throttling on arbitrary resources.#46

Code

Closed

james-lawrence wants to merge 89 commits intoseomoz:masterseomoz/qless-core:masterfrom backupify:masterbackupify/qless-core:masterCopy head branch name to clipboard

+1,316-255

Commits

Commits on Mar 10, 2014

• simple throttle for qless

  

  James Lawrence

  committed
  a3728f0

• finished renaming resources to throttle

  

  james-lawrence

  committed
  44df91c

• throttle tests wip

  

  james-lawrence

  committed
  14d0fe3

• test fixes

  

  james-lawrence

  committed
  674353a

• wip

  

  james-lawrence

  committed
  32c795c

• general working

  

  james-lawrence

  committed
  4de319b

• throttle api

  

  james-lawrence

  committed
  493d157

• throttle changes

  

  james-lawrence

  committed
  f6b9a38

• Add Throttle locks and pending member functions

  

  Danny Guinther

  committed
  36fd0fb

• wip

  

  james-lawrence

  committed
  3599db3

• wip

  

  james-lawrence

  committed
  9f3bdb9

Commits on Mar 11, 2014

• Fix tests

  

  Danny Guinther

  committed
  623ebd9

• Switch to sorted set

  

  Danny Guinther

  committed
  b21e519

• Fix throttle locks and pending member functions

  

  Danny Guinther

  committed
  69bd3e7

• lock fixes

  

  james-lawrence

  committed
  d3fe766

• finished basic tests

  

  james-lawrence

  committed
  1e003e5

• switched to rank instead of score

  

  james-lawrence

  committed
  4df4123

• Acquire throttle on pop

  

  Danny Guinther

  committed
  7fff784

• test fixes

  

  james-lawrence

  committed
  fe776ef

• test fixes

  

  james-lawrence

  committed
  4fc8e3c

• Add tests for dependent throttling

  

  Danny Guinther

  committed
  27aebd4

• Use throttles to handle max-queue-concurrency

  

  Danny Guinther

  committed
  a3244fe

• removed commented code

  

  james-lawrence

  committed
  81e2103

• support multiple resources

  

  james-lawrence

  committed
  b4e7765

• implemented multiple throttles per job

  

  james-lawrence

  committed
  308a77e

Commits on Mar 12, 2014

• documentation

  

  james-lawrence

  committed
  5d86598

• Add job tests for multiple throttles

  

  Danny Guinther

  committed
  5141cbf

• implemeted queue throttled

  

  james-lawrence

  committed
  a27ac2e

• Merge branch 'throttle' of github.com:backupify/qless-core into throttle

  

  james-lawrence

  committed
  d230b54

• small changes

  

  james-lawrence

  committed
  b159933

• Add tests for dynamically changing throttle concurrency level

  

  Danny Guinther

  committed
  6522fe7

• Add tests to verify queue throttled

  

  Danny Guinther

  committed
  eaf6be1

• Minor optimizations and test fixes

  

  Danny Guinther

  committed
  32a1408

• Add test for queue throttled count

  

  Danny Guinther

  committed
  a70362b

• Add api methods for setting queue throttle max

  

  Danny Guinther

  committed
  fc332c9

• throttles refactor/cleanup

  

  james-lawrence

  committed
  b54298f

• Update queue.lua

  Show description for 71ac5e0
  

  james-lawrence

  committed
  71ac5e0

Commits on Mar 13, 2014

• fixed syntax error

  

  james-lawrence

  committed
  aadd902

• Simplify job#acquire_throttles

  

  Danny Guinther

  committed
  9595d5e

• Remove commented code

  

  Danny Guinther

  committed
  769d4f3

• misc fixes

  

  james-lawrence

  committed
  f7a3b6f

• Merge branch 'throttle' of github.com:backupify/qless-core into throttle

  Show description for 730c668
  

  james-lawrence

  committed
  730c668

• attempt to throttle jobs immediately

  

  james-lawrence

  committed
  7d85dc8

• added optional expiration to a throttle

  

  james-lawrence

  committed
  2d9810c

• removed printlines

  

  james-lawrence

  committed
  4728f1d

• Add API to retrieve throttle ttl

  

  Danny Guinther

  committed
  85350ea

• Set queue throttle expiration to 0

  

  Danny Guinther

  committed
  5668c32

• Update test_job.py

  Show description for 0d8290e
  

  james-lawrence

  committed
  0d8290e

• Merge pull request #1 from backupify/throttle

  Show description for 9a37225
  

  james-lawrence

  committed
  9a37225

• Catch when job has no throttles

  

  Danny Guinther

  committed
  70a2779

Commits on Mar 14, 2014

• test exposing cancel bug

  wr0ngway

  committed
  dd2d931

Commits on Mar 31, 2014

• fix for cancelled

  

  james-lawrence

  committed
  8f004dc

Commits on Apr 1, 2014

• wip

  

  james-lawrence

  committed
  a9c3b98

• Merge pull request #2 from backupify/fix_cancel

  Show description for d1b52be
  

  james-lawrence

  committed
  d1b52be

Commits on Apr 2, 2014

• removed printline statements

  

  james-lawrence

  committed
  d7372ab

• removed debugging code

  

  james-lawrence

  committed
  f1bf59f

Commits on Apr 11, 2014

• Merge pull request #3 from backupify/throttle

  Show description for 3b80d6c
  

  james-lawrence

  committed
  3b80d6c

Commits on May 12, 2014

• fixes throttle release to properly remove a job from the throttled set

  

  james-lawrence

  committed
  3108245

• small optimization

  

  james-lawrence

  committed
  d058374

• test name change

  

  james-lawrence

  committed
  ee6f039

• whitespace fix

  

  james-lawrence

  committed
  42aa9be

• Merge pull request #4 from backupify/cancel-fix

  Show description for 3bffc21
  

  james-lawrence

  committed
  3bffc21

Commits on Jun 3, 2014

• fix tags work

  

  james-lawrence

  committed
  d9903a5

• test fix

  

  james-lawrence

  committed
  56df3fc

• removed unnecessary code

  

  james-lawrence

  committed
  bd089c0

• removed unnecessary change

  

  james-lawrence

  committed
  ed4a0f8

• Merge pull request #5 from backupify/fix-tags

  Show description for 9a766e6
  

  james-lawrence

  committed
  9a766e6

Commits on Jun 4, 2014

• patches remove_tag method to be more reliable

  

  james-lawrence

  committed
  3550b9b

• Merge pull request #6 from backupify/patch-remove-tags

  Show description for d821344
  

  james-lawrence

  committed
  d821344

Commits on Aug 8, 2014

• Merge branch 'upstream-master' into merge-upstream

  Show description for 66c1ebd
  

  james-lawrence

  committed
  66c1ebd

• merged master

  

  james-lawrence

  committed
  3fe1fcd

• Merge remote-tracking branch 'upstream/master' into merge-upstream

  Show description for 6451b7c
  

  james-lawrence

  committed
  6451b7c

Commits on Aug 18, 2014

• Merge pull request #7 from backupify/merge-upstream

  Show description for 65dac2d
  james-lawrence

  committed
  65dac2d

Commits on Nov 26, 2014

• Update throttle.lua

  james-lawrence

  committed
  cda5ed8

Commits on May 4, 2015

• test fixes

  

  james-lawrence

  committed
  b6fd1aa

• Merge branch 'upstream' into merge-upstream

  

  james-lawrence

  committed
  38e2493

• Merge pull request #8 from backupify/merge-upstream

  Show description for 5dbc192
  james-lawrence

  committed
  5dbc192

• Merge branch 'upstream-master'

  

  james-lawrence

  committed
  21097aa

• Merge branch 'master' of github.com:backupify/qless-core

  

  james-lawrence

  committed
  7932ac9

Commits on Jul 23, 2015

• retry pop up to config limit when pop quantity would be unfulfilled due to throttling

  wr0ngway

  committed
  8fda126

• short circuit retry if nothing in work queue

  wr0ngway

  committed
  98b71d6

Commits on Jul 31, 2015

• verify contents of waiting jids in tests for max-pop-retry

  wr0ngway

  committed
  4718824

• Merge pull request #9 from backupify/pop_retry

  Show description for 8baa512
  

  Matt Conway

  committed
  8baa512

Commits on Sep 10, 2015

• Update api.lua

  james-lawrence

  committed
  9e5e716

• Update test_throttle.py

  james-lawrence

  committed
  e8ed50c

• tests

  

  james-lawrence

  committed
  230a777

• Merge pull request #10 from backupify/throttle-release-job-api

  Show description for e3fdb7e
  james-lawrence

  committed
  e3fdb7e

Commits on Jul 5, 2016

• Ignore ghost jids that have no real job

  

  Danny Guinther

  committed
  6dbf028

Commits on Jul 8, 2016

• Remove old queue throttle from reput job

  

  Danny Guinther

  committed
  20dc687