Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

A2C and Synchronous extension #17

Open
wants to merge 66 commits into
base: master
Choose a base branch
from
Open

A2C and Synchronous extension #17

wants to merge 66 commits into from
+4,110 −351

Commits on Mar 23, 2020

  1. CARTPOLE - create vanilla a2c and synchronous a2c

    @juice1000
    juice1000 authored Mar 23, 2020
    Configuration menu
    Copy the full SHA
    0ce32a4 View commit details
    Browse the repository at this point in the history

Commits on Mar 24, 2020

  1. CARTPOLE - test

    @juice1000
    juice1000 committed Mar 24, 2020
    Configuration menu
    Copy the full SHA
    4918b37 View commit details
    Browse the repository at this point in the history

  2. CARTPOLE - renew model and parameters, add args and plotter function,… 

    … terminate after score of 600, save and load model
    @juice1000
    juice1000 committed Mar 24, 2020
    Configuration menu
    Copy the full SHA
    63b4092 View commit details
    Browse the repository at this point in the history

Commits on Mar 25, 2020

  1. CARTPOLE - for all: terminate when score higher than 500 within range

    @juice1000
    juice1000 committed Mar 25, 2020
    Configuration menu
    Copy the full SHA
    a459f81 View commit details
    Browse the repository at this point in the history

  2. CARTPOLE - refactor a2c to without torch.mp module

    @juice1000
    juice1000 committed Mar 25, 2020
    Configuration menu
    Copy the full SHA
    2045869 View commit details
    Browse the repository at this point in the history

Commits on Mar 27, 2020

  1. CARTPOLE - stabilize algorithms: true synchronous learning for a2c_sy… 

    …nc, set upper limit for ep_length, gym make unwrapped for a2c
    @juice1000
    juice1000 committed Mar 27, 2020
    Configuration menu
    Copy the full SHA
    490767a View commit details
    Browse the repository at this point in the history

Commits on Mar 28, 2020

  1. CARTPOLE - training duration in plotter, args and plotter in utils, s… 

    …ave model if consecutive reward over 300
    @juice1000
    juice1000 committed Mar 28, 2020
    Configuration menu
    Copy the full SHA
    b7a4bf6 View commit details
    Browse the repository at this point in the history

Commits on Mar 29, 2020

  1. CARTPOLE - if load model, then check for 100 iterations of ep_r over 500

    @juice1000
    juice1000 committed Mar 29, 2020
    Configuration menu
    Copy the full SHA
    f9ace27 View commit details
    Browse the repository at this point in the history

  2. CARTPOLE - if load_model, then check for last 100 iterations of ep_r … 

    …over 500
    @juice1000
    juice1000 committed Mar 29, 2020
    Configuration menu
    Copy the full SHA
    5d78d64 View commit details
    Browse the repository at this point in the history

  3. Merge branch 'master' of https://github.com/juice1000/pytorch-A3C

    @juice1000
    juice1000 committed Mar 29, 2020
    Configuration menu
    Copy the full SHA
    ae02294 View commit details
    Browse the repository at this point in the history

  4. CARTPOLE - initialize only one process when load_model

    @juice1000
    juice1000 committed Mar 29, 2020
    Configuration menu
    Copy the full SHA
    93e6726 View commit details
    Browse the repository at this point in the history

  5. CARTPOLE - utils gets optimizer, a2c_sync NN update after done

    @juice1000
    juice1000 committed Mar 29, 2020
    Configuration menu
    Copy the full SHA
    2317cea View commit details
    Browse the repository at this point in the history

Commits on Apr 8, 2020

  1. CARTPOLE - add episode_time plotter and confidence intervall calculat… 

    …or for actions in utils, add information to plotter and merge, add functions in A2Cs and A3C, raise lr=0.005
    @juice1000
    juice1000 committed Apr 8, 2020
    Configuration menu
    Copy the full SHA
    add50a1 View commit details
    Browse the repository at this point in the history

  2. CARTPOLE - create A2Cs and A3C shared NN

    @juice1000
    juice1000 committed Apr 8, 2020
    Configuration menu
    Copy the full SHA
    b9ec460 View commit details
    Browse the repository at this point in the history

  3. CARTPOLE - fix confidence interval error in Sync_A2C and A3C, action_… 

    …queue in record function
    @juice1000
    juice1000 committed Apr 8, 2020
    Configuration menu
    Copy the full SHA
    e35afd8 View commit details
    Browse the repository at this point in the history

  4. CARTPOLE - refactor shared network algorithms, delete one confidence … 

    …intervall calculation
    @juice1000
    juice1000 committed Apr 8, 2020
    Configuration menu
    Copy the full SHA
    6d32122 View commit details
    Browse the repository at this point in the history

  5. CARTPOLE - refactor shared NNs and lr, take out time sleep in test ph… 

    …ase for Sync-A2C
    @juice1000
    juice1000 committed Apr 8, 2020
    Configuration menu
    Copy the full SHA
    211ce33 View commit details
    Browse the repository at this point in the history

  6. CARTPOLE - results and saved models

    @juice1000
    juice1000 committed Apr 8, 2020
    Configuration menu
    Copy the full SHA
    aca0f93 View commit details
    Browse the repository at this point in the history

  7. CARTPOLE - plots of results

    @juice1000
    juice1000 committed Apr 8, 2020
    Configuration menu
    Copy the full SHA
    810b960 View commit details
    Browse the repository at this point in the history

Commits on Apr 9, 2020

  1. VIZDOOM - create A2C-vizdoom for deadly corridor, create viz_utils

    @juice1000
    juice1000 committed Apr 9, 2020
    Configuration menu
    Copy the full SHA
    d943e7e View commit details
    Browse the repository at this point in the history

  2. CARTPOLE - create directory

    @juice1000
    juice1000 committed Apr 9, 2020
    Configuration menu
    Copy the full SHA
    671f057 View commit details
    Browse the repository at this point in the history

  3. VIZDOOM - create directory

    @juice1000
    juice1000 committed Apr 9, 2020
    Configuration menu
    Copy the full SHA
    019f612 View commit details
    Browse the repository at this point in the history

  4. cleanup

    @juice1000
    juice1000 committed Apr 9, 2020
    Configuration menu
    Copy the full SHA
    7104cf7 View commit details
    Browse the repository at this point in the history

Commits on Apr 10, 2020

  1. VIZDOOM - create A3C model

    @juice1000
    juice1000 committed Apr 10, 2020
    Configuration menu
    Copy the full SHA
    b6e57e6 View commit details
    Browse the repository at this point in the history

  2. VIZDOOM - create A3C part2

    @juice1000
    juice1000 committed Apr 10, 2020
    Configuration menu
    Copy the full SHA
    d3a4033 View commit details
    Browse the repository at this point in the history

  3. VIZDOOM - create synchronous a2c

    @juice1000
    juice1000 committed Apr 10, 2020
    Configuration menu
    Copy the full SHA
    06a759f View commit details
    Browse the repository at this point in the history

  4. VIZDOOM - add plotter and game replay in a2c

    @juice1000
    juice1000 committed Apr 10, 2020
    Configuration menu
    Copy the full SHA
    608e20a View commit details
    Browse the repository at this point in the history

  5. VIZDOOM - plotter and stopwatch for a2c_sync and a3c

    @juice1000
    juice1000 committed Apr 10, 2020
    Configuration menu
    Copy the full SHA
    52ac70c View commit details
    Browse the repository at this point in the history

Commits on Apr 11, 2020

  1. CARTPOLE - refactor synchronous coordinator in A2C_Sync

    @juice1000
    juice1000 committed Apr 11, 2020
    Configuration menu
    Copy the full SHA
    e139bbe View commit details
    Browse the repository at this point in the history

  2. VIZDOOM - reinitialize state within each episode, adjust plotter boun… 

    …daries
    @juice1000
    juice1000 committed Apr 11, 2020
    Configuration menu
    Copy the full SHA
    a5179b2 View commit details
    Browse the repository at this point in the history

Commits on Apr 12, 2020

  1. CARTPOLE - remove normalizing reward

    @juice1000
    juice1000 committed Apr 12, 2020
    Configuration menu
    Copy the full SHA
    e403c84 View commit details
    Browse the repository at this point in the history

  2. VIZDOOM - UPDATE_GLOBAL_ITER = 5 for A3C, correct error in push and pull

    @juice1000
    juice1000 committed Apr 12, 2020
    Configuration menu
    Copy the full SHA
    2026ba8 View commit details
    Browse the repository at this point in the history

Commits on Apr 13, 2020

  1. CARTPOLE - normalized and raw duration and reward plotting

    @juice1000
    juice1000 committed Apr 13, 2020
    Configuration menu
    Copy the full SHA
    42e27f5 View commit details
    Browse the repository at this point in the history

  2. VIZDOOM - normalized and raw reward and duration, update plotter boun… 

    …daries
    @juice1000
    juice1000 committed Apr 13, 2020
    Configuration menu
    Copy the full SHA
    b0ae642 View commit details
    Browse the repository at this point in the history

  3. CART/DOOM - turn off episode breaker for not normalized runs

    @juice1000
    juice1000 committed Apr 13, 2020
    Configuration menu
    Copy the full SHA
    51978ff View commit details
    Browse the repository at this point in the history

  4. CARTPOLE - correct coding mistakes in A3C and A2C-sync

    @juice1000
    juice1000 committed Apr 13, 2020
    Configuration menu
    Copy the full SHA
    261cd3c View commit details
    Browse the repository at this point in the history

Commits on Apr 14, 2020

  1. VIZDOOM - correct A2C and A3C, adjust plotter boundaries

    @juice1000
    juice1000 committed Apr 14, 2020
    Configuration menu
    Copy the full SHA
    53beb17 View commit details
    Browse the repository at this point in the history

  2. CARTPOLE - create save_model.py, enable save data mode for all

    @juice1000
    juice1000 committed Apr 14, 2020
    Configuration menu
    Copy the full SHA
    5dc7e25 View commit details
    Browse the repository at this point in the history

  3. CARTPOLE - correct coding mistakes with save_data

    @juice1000
    juice1000 committed Apr 14, 2020
    Configuration menu
    Copy the full SHA
    8065952 View commit details
    Browse the repository at this point in the history

  4. CARTPOLE - separate training and test data

    @juice1000
    juice1000 committed Apr 14, 2020
    Configuration menu
    Copy the full SHA
    aed3bb4 View commit details
    Browse the repository at this point in the history

Commits on Apr 16, 2020

  1. CARTPOLE - remove time stamp in plots

    @juice1000
    juice1000 committed Apr 16, 2020
    Configuration menu
    Copy the full SHA
    05b2b14 View commit details
    Browse the repository at this point in the history

  2. CARTPOLE - add new plots, add plot data, add newly trained models

    @juice1000
    juice1000 committed Apr 16, 2020
    Configuration menu
    Copy the full SHA
    6fa38cb View commit details
    Browse the repository at this point in the history

Commits on Apr 17, 2020

  1. VIZDOOM - save_data for A3C, create algo_compare for doom

    @juice1000
    juice1000 committed Apr 17, 2020
    Configuration menu
    Copy the full SHA
    534a930 View commit details
    Browse the repository at this point in the history

Commits on Apr 18, 2020

  1. VIZDOOM - new synchronous implementation, reinitialize threads and sa… 

    …ve stats everytime, create shared NN algorithms
    @juice1000
    juice1000 committed Apr 18, 2020
    Configuration menu
    Copy the full SHA
    f98f2e1 View commit details
    Browse the repository at this point in the history

  2. VIZDOOM - refactor viz_utils

    @juice1000
    juice1000 committed Apr 18, 2020
    Configuration menu
    Copy the full SHA
    439e964 View commit details
    Browse the repository at this point in the history

  3. VIZDOOM - refactor plotter

    @juice1000
    juice1000 committed Apr 18, 2020
    Configuration menu
    Copy the full SHA
    8f2e140 View commit details
    Browse the repository at this point in the history

Commits on Apr 19, 2020

  1. VIZDOOM - redefine save model condition

    @juice1000
    juice1000 committed Apr 19, 2020
    Configuration menu
    Copy the full SHA
    d71c28a View commit details
    Browse the repository at this point in the history

Commits on Apr 20, 2020

  1. VIZDOOM - refactor action_queue, take action_queue out from viz_utils

    @juice1000
    juice1000 committed Apr 20, 2020
    Configuration menu
    Copy the full SHA
    89b3e6d View commit details
    Browse the repository at this point in the history

Commits on Apr 24, 2020

  1. VIZDOOM - set ylim to 1000 in viz_utils

    @juice1000
    juice1000 committed Apr 24, 2020
    Configuration menu
    Copy the full SHA
    bd7b79e View commit details
    Browse the repository at this point in the history

Commits on Apr 25, 2020

  1. VIZDOOM - combine CSVs and plot for A2C-sync

    @juice1000
    juice1000 committed Apr 25, 2020
    Configuration menu
    Copy the full SHA
    19b5fb4 View commit details
    Browse the repository at this point in the history

  2. VIZDOOM - algo_compare with subplots of training and testing data

    @juice1000
    juice1000 committed Apr 25, 2020
    Configuration menu
    Copy the full SHA
    fbe2680 View commit details
    Browse the repository at this point in the history

  3. CARTPOLE - make subplots for training and testing data

    @juice1000
    juice1000 committed Apr 25, 2020
    Configuration menu
    Copy the full SHA
    3c8501a View commit details
    Browse the repository at this point in the history

Commits on Apr 26, 2020

  1. CART/VIZ - probabilities plot

    @juice1000
    juice1000 committed Apr 26, 2020
    Configuration menu
    Copy the full SHA
    77975c3 View commit details
    Browse the repository at this point in the history

  2. CART/VIZ - code corrections

    @juice1000
    juice1000 committed Apr 26, 2020
    Configuration menu
    Copy the full SHA
    220c2ed View commit details
    Browse the repository at this point in the history

Commits on May 1, 2020

  1. VIZDOOM - fix probabilities plot and ep-rew-time plot, fix action_que… 

    …ue in A3C
    @juice1000
    juice1000 committed May 1, 2020
    Configuration menu
    Copy the full SHA
    5bc01fc View commit details
    Browse the repository at this point in the history

Commits on May 4, 2020

  1. VIZDOOM - code grooming and refactor algo_compare

    @juice1000
    juice1000 committed May 4, 2020
    Configuration menu
    Copy the full SHA
    983bc7c View commit details
    Browse the repository at this point in the history

Commits on May 31, 2020

  1. Update README.md

    @juice1000
    juice1000 authored May 31, 2020
    Configuration menu
    Copy the full SHA
    5a1fb36 View commit details
    Browse the repository at this point in the history

  2. VIZDOOM - push plots and plot data

    Julien Look committed May 31, 2020
    Configuration menu
    Copy the full SHA
    0adf081 View commit details
    Browse the repository at this point in the history

  3. Merge branch 'master' of https://github.com/juice1000/Synchronous-vs-… 

    …Asynchronous-Learning-Pytorch-
    Julien Look committed May 31, 2020
    Configuration menu
    Copy the full SHA
    2ffe7d0 View commit details
    Browse the repository at this point in the history

  4. Update README.md

    @juice1000
    juice1000 authored May 31, 2020
    Configuration menu
    Copy the full SHA
    3a2b84c View commit details
    Browse the repository at this point in the history

  5. Update README.md

    @juice1000
    juice1000 authored May 31, 2020
    Configuration menu
    Copy the full SHA
    c106ea0 View commit details
    Browse the repository at this point in the history

  6. CARTPOLE - move results to higher directory

    Julien Look committed May 31, 2020
    Configuration menu
    Copy the full SHA
    14e4c57 View commit details
    Browse the repository at this point in the history

  7. Merge branch 'master' of https://github.com/juice1000/Synchronous-vs-… 

    …Asynchronous-Learning-Pytorch-
    Julien Look committed May 31, 2020
    Configuration menu
    Copy the full SHA
    8aef27b View commit details
    Browse the repository at this point in the history

  8. Update README.md

    @juice1000
    juice1000 authored May 31, 2020
    Configuration menu
    Copy the full SHA
    8f16737 View commit details
    Browse the repository at this point in the history

Commits on Dec 17, 2022

  1. Update README.md

    @juice1000
    juice1000 authored Dec 17, 2022
    Configuration menu
    Copy the full SHA
    72d755d View commit details
    Browse the repository at this point in the history

  2. Update README.md

    @juice1000
    juice1000 authored Dec 17, 2022
    Configuration menu
    Copy the full SHA
    e606ecf View commit details
    Browse the repository at this point in the history