Code

[Active learning] Merge main#309

Code

Merged

ginihumer merged 90 commits intoactivelearningalexhernandezgarcia/gflownet:activelearningfrom activelearning-merge-mainalexhernandezgarcia/gflownet:activelearning-merge-mainCopy head branch name to clipboardMay 30, 2024

+2,936-731

Commits

Commits on Mar 19, 2024

• Use a partial instantiation of the environment and use it to create multiple instances of the env in the agent instead of copying it

  alexhernandezgarcia

  committed
  92f4d83

  Copy full SHA for 92f4d83

• Adapt common tests to new GFlowNetAgent env_maker parameter

  alexhernandezgarcia

  committed
  9d9a3d7

  Copy full SHA for 9d9a3d7

Commits on Mar 29, 2024

• WIP: progress in implementing reward-handling functionality in base proxy.

  alexhernandezgarcia

  committed
  9349497

  Copy full SHA for 9349497

Commits on Apr 1, 2024

• Basic test for base proxy and fixes.

  alexhernandezgarcia

  committed
  d0db503

  Copy full SHA for d0db503

• Remove higher_is_better parameter

  alexhernandezgarcia

  committed
  c4b6e5c

  Copy full SHA for c4b6e5c

• Add basic log_rewards()

  alexhernandezgarcia

  committed
  f1ca7ef

  Copy full SHA for f1ca7ef

• Implement power proxy2reward

  alexhernandezgarcia

  committed
  c0be4fb

  Copy full SHA for c0be4fb

• Implement exponential proxy2reward

  alexhernandezgarcia

  committed
  fb011ae

  Copy full SHA for fb011ae

• Implement shift proxy2reward; fixes and doscstring

  alexhernandezgarcia

  committed
  2c8ef54

  Copy full SHA for 2c8ef54

• Implement product proxy2reward

  alexhernandezgarcia

  committed
  8440998

  Copy full SHA for 8440998

• Add identity proxy2reward

  alexhernandezgarcia

  committed
  f23dead

  Copy full SHA for f23dead

• WIP: handle log rewards

  alexhernandezgarcia

  committed
  615e08c

  Copy full SHA for 615e08c

• Handle log rewards properly

  alexhernandezgarcia

  committed
  e239d66

  Copy full SHA for e239d66

• Implement functionality for passing callable instead of string

  alexhernandezgarcia

  committed
  fbff130

  Copy full SHA for fbff130

• log_rewards uses proxy2logreward

  alexhernandezgarcia

  committed
  c4144d0

  Copy full SHA for c4144d0

• Add min reward as attribute

  alexhernandezgarcia

  committed
  ecc9c56

  Copy full SHA for ecc9c56

• Add absolute proxy-to-reward function; integrate log_rewards() into rewards() via a log parameter; fixes

  alexhernandezgarcia

  committed
  4c53cfb

  Copy full SHA for 4c53cfb

• Make default base proxy config file and set it as default for other proxy config files

  alexhernandezgarcia

  committed
  34275f3

  Copy full SHA for 34275f3

• Adapt Batch to compute rewards from proxy and handle log rewards. Tests are WIP and everything needs further testing.

  alexhernandezgarcia

  committed
  911e0b7

  Copy full SHA for 911e0b7

Commits on Apr 2, 2024

• Implement get_min_reward() in base proxy.

  alexhernandezgarcia

  committed
  060a82e

  Copy full SHA for 060a82e

• Use get_min_reward() in batch.

  alexhernandezgarcia

  committed
  25cf127

  Copy full SHA for 25cf127

• Adapt Batch tests

  alexhernandezgarcia

  committed
  26fc8ea

  Copy full SHA for 26fc8ea

• Handle clipping of rewards

  alexhernandezgarcia

  committed
  a9174eb

  Copy full SHA for a9174eb

• Add TODO

  alexhernandezgarcia

  committed
  9906093

  Copy full SHA for 9906093

• Clip and replace nans in (log) rewards in proxy2reward and proxy2logreward instead of in rewards()

  alexhernandezgarcia

  committed
  5d44764

  Copy full SHA for 5d44764

• Adapt gflownet.py

  alexhernandezgarcia

  committed
  7ff0206

  Copy full SHA for 7ff0206

• Adapt main.py

  alexhernandezgarcia

  committed
  84dbf46

  Copy full SHA for 84dbf46

• Replace torch.equal by isclose in Batch tests of rewards

  alexhernandezgarcia

  committed
  51939bb

  Copy full SHA for 51939bb

• Adapt env common tests

  alexhernandezgarcia

  committed
  8a7f6ab

  Copy full SHA for 8a7f6ab

• Remove reward and proxy stuff from base env.

  alexhernandezgarcia

  committed
  f55e62b

  Copy full SHA for f55e62b

• Add TODOs

  alexhernandezgarcia

  committed
  729ed69

  Copy full SHA for 729ed69

• Remove old stuff

  alexhernandezgarcia

  committed
  f71d57a

  Copy full SHA for f71d57a

• Add proxy to Buffer

  alexhernandezgarcia

  committed
  f6bfaa1

  Copy full SHA for f6bfaa1

• Fixes

  alexhernandezgarcia

  committed
  1020d6c

  Copy full SHA for 1020d6c

• Adapt sanity checks config

  alexhernandezgarcia

  committed
  065fa4f

  Copy full SHA for 065fa4f

• Fix

  alexhernandezgarcia

  committed
  68be0cb

  Copy full SHA for 68be0cb

Commits on Apr 3, 2024

• Do not pass proxy to env anymore

  alexhernandezgarcia

  committed
  0553b02

  Copy full SHA for 0553b02

• Remove old variables from base env config

  alexhernandezgarcia

  committed
  146cace

  Copy full SHA for 146cace

• Fix permutation sampling in buffer select

  carriepl-mila

  committed
  9274c37

  Copy full SHA for 9274c37

Commits on Apr 4, 2024

• Merge pull request #302 from alexhernandezgarcia/fix_replay_bug

  Show description for ba8129a
  alexhernandezgarcia

  authored
  ba8129a

  Copy full SHA for ba8129a

Commits on May 1, 2024

• Fix tests minimal runs

  alexhernandezgarcia

  committed
  9a62803

  Copy full SHA for 9a62803

Commits on May 3, 2024

• WIP: reorganise plotting methods

  alexhernandezgarcia

  committed
  af904c3

  Copy full SHA for af904c3

• Adapt plot_reward_samples in GFlowNet agent and Cube

  alexhernandezgarcia

  committed
  be2be79

  Copy full SHA for be2be79

• Fix issue with inf logprobs

  alexhernandezgarcia

  committed
  0d4db56

  Copy full SHA for 0d4db56

Commits on May 5, 2024

• Adapt plot_kde

  alexhernandezgarcia

  committed
  1615a5a

  Copy full SHA for 1615a5a

• WIP: plot methods for grid (broken)

  alexhernandezgarcia

  committed
  d62cefc

  Copy full SHA for d62cefc

• WIP:: adapt plotting methods of htorus

  alexhernandezgarcia

  committed
  4f1e714

  Copy full SHA for 4f1e714

• Create mesh coordinates by reshaping samples

  alexhernandezgarcia

  committed
  b84011d

  Copy full SHA for b84011d

Commits on May 6, 2024

• Small fix

  alexhernandezgarcia

  committed
  602c133

  Copy full SHA for 602c133

• Adapt plot methods of htorus

  alexhernandezgarcia

  committed
  f87df71

  Copy full SHA for f87df71

• Change period of testing in icml ctorus config from 25 to 500

  alexhernandezgarcia

  committed
  b88b6b1

  Copy full SHA for b88b6b1

• Adapt get_grid_terminating_states so that the ordering of the dimensions matches the plotting (reshaping) ordering

  alexhernandezgarcia

  committed
  667b150

  Copy full SHA for 667b150

• Speedup batch._compute_parents() for large batches

  carriepl-mila

  committed
  c7e8f14

  Copy full SHA for c7e8f14

• black

  carriepl-mila

  committed
  788abce

  Copy full SHA for 788abce

• Adapt plotting methods of grid

  alexhernandezgarcia

  committed
  f32d999

  Copy full SHA for f32d999

• Do not start progress bar if there is only one batch

  alexhernandezgarcia

  committed
  22e5de1

  Copy full SHA for 22e5de1

• Merge pull request #305 from alexhernandezgarcia/speedup_batch

  Show description for 2167136
  alexhernandezgarcia

  authored
  2167136

  Copy full SHA for 2167136

• Improve handling of logzero in proxy and fix tests

  alexhernandezgarcia

  committed
  4ffa0bc

  Copy full SHA for 4ffa0bc

• Fix test batch

  alexhernandezgarcia

  committed
  1862d1e

  Copy full SHA for 1862d1e

• Add plot_samples_topk to Tetris and to GFN test()

  alexhernandezgarcia

  committed
  d96827e

  Copy full SHA for d96827e

Commits on May 7, 2024

• Docstring

  alexhernandezgarcia

  committed
  8d733c4

  Copy full SHA for 8d733c4

• Re-enable tests by default for Tetris

  alexhernandezgarcia

  committed
  30c6b9c

  Copy full SHA for 30c6b9c

• Remove references to reward_norm

  alexhernandezgarcia

  committed
  18f2cde

  Copy full SHA for 18f2cde

• Remove references to energies_stats

  alexhernandezgarcia

  committed
  365d22c

  Copy full SHA for 365d22c

• Update env base config

  alexhernandezgarcia

  committed
  d69950e

  Copy full SHA for d69950e

• Remove reward_beta and reward_func from config files

  alexhernandezgarcia

  committed
  7f9e136

  Copy full SHA for 7f9e136

• Update proxies: outputs are not negative by default anymore; Restore proxy2reward and beta values in configs but as proxy config

  alexhernandezgarcia

  committed
  4267acb

  Copy full SHA for 4267acb

• black

  alexhernandezgarcia

  committed
  7e9cc44

  Copy full SHA for 7e9cc44

• Fix scrabble proxy and tests

  alexhernandezgarcia

  committed
  10e5d78

  Copy full SHA for 10e5d78

Commits on May 17, 2024

• Fix sanity check runs config

  alexhernandezgarcia

  committed
  361cdc0

  Copy full SHA for 361cdc0

• Docstring of base Proxy

  alexhernandezgarcia

  committed
  4c1b1de

  Copy full SHA for 4c1b1de

Commits on May 21, 2024

• Set efault number of grid points for reward density to 40000; Fix typo

  alexhernandezgarcia

  committed
  c9879de

  Copy full SHA for c9879de

• Documentation about arguments of proxy-to-reward functions

  alexhernandezgarcia

  committed
  54ffaf1

  Copy full SHA for 54ffaf1

• Revert test period in icml torus config file and apply it in sanity checks configs

  alexhernandezgarcia

  committed
  73a8749

  Copy full SHA for 73a8749

• Extend documentation and use of rewards and sample_rewards in plotting methods

  alexhernandezgarcia

  committed
  fa40c51

  Copy full SHA for fa40c51

• Fix fixture in tests of base proxy

  alexhernandezgarcia

  committed
  a9ef286

  Copy full SHA for a9ef286

• Extend tests of identity reward_function with another value of beta

  alexhernandezgarcia

  committed
  abe50cb

  Copy full SHA for abe50cb

• Implement functionality to handle max_reward

  alexhernandezgarcia

  committed
  a1462f1

  Copy full SHA for a1462f1

Commits on May 22, 2024

• Merge pull request #299 from alexhernandezgarcia/dont-copy-envs

  Show description for bcb1443
  carriepl

  authored
  bcb1443

  Copy full SHA for bcb1443

Commits on May 28, 2024

• Resolve conflicts

  alexhernandezgarcia

  committed
  92d45b7

  Copy full SHA for 92d45b7

• Start adaptation of Braning (docstring)

  alexhernandezgarcia

  committed
  a21d42f

  Copy full SHA for a21d42f

• Adapt Branin to work on inputs in [-1, 1] x [-1, 1]; Start test script

  alexhernandezgarcia

  committed
  d9f7353

  Copy full SHA for d9f7353

Commits on May 29, 2024

• Changes in Branin proxy and test

  alexhernandezgarcia

  committed
  553d377

  Copy full SHA for 553d377

• Done adapting Branin and tests

  alexhernandezgarcia

  committed
  4c9aaca

  Copy full SHA for 4c9aaca

• Minor changes in Branin

  alexhernandezgarcia

  committed
  a1d8cd0

  Copy full SHA for a1d8cd0

• Adapt Hartmann and implement tests

  alexhernandezgarcia

  committed
  ad4229c

  Copy full SHA for ad4229c

Commits on May 30, 2024

• Add tests with environments

  alexhernandezgarcia

  committed
  1656bca

  Copy full SHA for 1656bca

• Update branin and hartmann configs

  alexhernandezgarcia

  committed
  91a5bb7

  Copy full SHA for 91a5bb7

• Fix error message formatting

  alexhernandezgarcia

  committed
  bd4ff00

  Copy full SHA for bd4ff00

• Fix call of proxy.get_max_reward()

  alexhernandezgarcia

  committed
  866c36c

  Copy full SHA for 866c36c