notebooks
Folders and files
| Name | Name | Last commit date | ||
|---|---|---|---|---|
parent directory.. | ||||
<!DOCTYPE html>
<!--[if IE 8]><html class="no-js lt-ie9" lang="en" > <![endif]-->
<!--[if gt IE 8]><!--> <html class="no-js" lang="en" > <!--<![endif]-->
<head>
<meta charset="utf-8">
<script type="text/javascript">
var _gaq = _gaq || [];
_gaq.push(['_setAccount', 'UA-38514290-2']);
_gaq.push(['_trackPageview']);
(function() {
var ga = document.createElement('script'); ga.type = 'text/javascript'; ga.async = true;
ga.src = ('https:' == document.location.protocol ? 'https://ssl' : 'http://www') + '.google-analytics.com/ga.js';
var s = document.getElementsByTagName('script')[0]; s.parentNode.insertBefore(ga, s);
})();
</script>
<meta name="viewport" content="width=device-width, initial-scale=1.0">
<title>Jupyter Notebooks 📓 by Naereen @ GitHub — SMPyBandits 0.9.6 documentation</title>
<script type="text/javascript" src="../_static/js/modernizr.min.js"></script>
<script type="text/javascript" id="documentation_options" data-url_root="../" src="../_static/documentation_options.js"></script>
<script type="text/javascript" src="../_static/jquery.js"></script>
<script type="text/javascript" src="../_static/underscore.js"></script>
<script type="text/javascript" src="../_static/doctools.js"></script>
<script type="text/javascript" src="../_static/language_data.js"></script>
<script crossorigin="anonymous" integrity="sha256-Ae2Vz/4ePdIu6ZyI/5ZGsYnb+m0JlOmKPjt6XZ9JJkA=" type="text/javascript" src="https://cdnjs.cloudflare.com/ajax/libs/require.js/2.3.4/require.min.js"></script>
<script async="async" type="text/javascript" src="https://cdnjs.cloudflare.com/ajax/libs/mathjax/2.7.5/latest.js?config=TeX-AMS-MML_HTMLorMML"></script>
<script type="text/x-mathjax-config">MathJax.Hub.Config({"tex2jax": {"inlineMath": [["$", "$"], ["\\(", "\\)"]], "processEscapes": true, "ignoreClass": "document", "processClass": "math|output_area"}})</script>
<script type="text/javascript" src="../_static/js/theme.js"></script>
<link rel="stylesheet" href="../_static/css/theme.css" type="text/css" />
<link rel="stylesheet" href="../_static/pygments.css" type="text/css" />
<link rel="index" title="Index" href="../genindex.html" />
<link rel="search" title="Search" href="../search.html" />
<link rel="next" title="List of notebooks for SMPyBandits" href="list.html" />
<link rel="prev" title="Some illustrations for this project" href="../plots/README.html" />
</head>
<body class="wy-body-for-nav">
<div class="wy-grid-for-nav">
<nav data-toggle="wy-nav-shift" class="wy-nav-side">
<div class="wy-side-scroll">
<div class="wy-side-nav-search" >
<a href="../index.html" class="icon icon-home"> SMPyBandits
<img src="../_static/logo.png" class="logo" alt="Logo"/>
</a>
<div class="version">
0.9
</div>
<div role="search">
<form id="rtd-search-form" class="wy-form" action="../search.html" method="get">
<input type="text" name="q" placeholder="Search docs" />
<input type="hidden" name="check_keywords" value="yes" />
<input type="hidden" name="area" value="default" />
</form>
</div>
</div>
<div class="wy-menu wy-menu-vertical" data-spy="affix" role="navigation" aria-label="main navigation">
<p class="caption"><span class="caption-text">Contents:</span></p>
<ul class="current">
<li class="toctree-l1"><a class="reference internal" href="../README.html"><em>SMPyBandits</em></a></li>
<li class="toctree-l1"><a class="reference internal" href="../docs/modules.html">SMPyBandits modules</a></li>
<li class="toctree-l1"><a class="reference internal" href="../How_to_run_the_code.html">How to run the code ?</a></li>
<li class="toctree-l1"><a class="reference internal" href="../PublicationsWithSMPyBandits.html">List of research publications using Lilian Besson’s SMPyBandits project</a></li>
<li class="toctree-l1"><a class="reference internal" href="../Aggregation.html"><strong>Policy aggregation algorithms</strong></a></li>
<li class="toctree-l1"><a class="reference internal" href="../MultiPlayers.html"><strong>Multi-players simulation environment</strong></a></li>
<li class="toctree-l1"><a class="reference internal" href="../DoublingTrick.html"><strong>Doubling Trick for Multi-Armed Bandits</strong></a></li>
<li class="toctree-l1"><a class="reference internal" href="../SparseBandits.html"><strong>Structure and Sparsity of Stochastic Multi-Armed Bandits</strong></a></li>
<li class="toctree-l1"><a class="reference internal" href="../NonStationaryBandits.html"><strong>Non-Stationary Stochastic Multi-Armed Bandits</strong></a></li>
<li class="toctree-l1"><a class="reference internal" href="../API.html">Short documentation of the API</a></li>
<li class="toctree-l1"><a class="reference internal" href="../About_parallel_computations.html">About parallel computations</a></li>
<li class="toctree-l1"><a class="reference internal" href="../TODO.html">💥 TODO</a></li>
<li class="toctree-l1"><a class="reference internal" href="../plots/README.html">Some illustrations for this project</a></li>
<li class="toctree-l1 current"><a class="current reference internal" href="#">Jupyter Notebooks 📓 by Naereen @ GitHub</a><ul>
<li class="toctree-l2"><a class="reference internal" href="#list-of-experiments-presented-with-notebooks">1. List of experiments presented with notebooks</a><ul>
<li class="toctree-l3"><a class="reference internal" href="#mab-problems">MAB problems</a></li>
<li class="toctree-l3"><a class="reference internal" href="#single-player-simulations">Single-Player simulations</a></li>
<li class="toctree-l3"><a class="reference internal" href="#active-research-on-single-player-mab">Active research on Single-Player MAB</a></li>
<li class="toctree-l3"><a class="reference internal" href="#multi-player-simulations">Multi-Player simulations</a></li>
</ul>
</li>
<li class="toctree-l2"><a class="reference internal" href="#old-experiments">(Old) Experiments</a></li>
<li class="toctree-l2"><a class="reference internal" href="#question-how-to-read-these-documents">2. Question: <em>How to read these documents</em>?</a><ul>
<li class="toctree-l3"><a class="reference internal" href="#a-view-the-notebooks-statically-memo">2.a. View the <em>notebooks</em> statically 📝</a></li>
<li class="toctree-l3"><a class="reference internal" href="#b-play-with-the-notebooks-dynamically-on-mybinder-boom">2.b. Play with the <em>notebooks</em> dynamically (on MyBinder) 💥</a></li>
<li class="toctree-l3"><a class="reference internal" href="#c-play-with-the-notebooks-dynamically-on-google-colab-boom">2.c. Play with the <em>notebooks</em> dynamically (on Google Colab) 💥</a></li>
</ul>
</li>
<li class="toctree-l2"><a class="reference internal" href="#question-requirements-to-run-the-notebooks-locally">3. Question: <em>Requirements to run the notebooks locally</em>?</a><ul>
<li class="toctree-l3"><a class="reference internal" href="#a-jupyter-notebook-and-ipython">3.a. Jupyter Notebook and IPython</a></li>
<li class="toctree-l3"><a class="reference internal" href="#b-my-numerical-environment-smpybandits">3.b. My numerical environment, <code class="docutils literal notranslate"><span class="pre">SMPyBandits</span></code></a></li>
<li class="toctree-l3"><a class="reference internal" href="#information-desk-person-more-information">💁 More information?</a></li>
</ul>
</li>
<li class="toctree-l2"><a class="reference internal" href="#scroll-license-github-license">📜 License ? </a></li>
</ul>
</li>
<li class="toctree-l1"><a class="reference internal" href="list.html">List of notebooks for SMPyBandits</a></li>
<li class="toctree-l1"><a class="reference internal" href="../Profiling.html">A note on execution times, speed and profiling</a></li>
<li class="toctree-l1"><a class="reference internal" href="../uml_diagrams/README.html">UML diagrams</a></li>
<li class="toctree-l1"><a class="reference internal" href="../logs/README.html"><code class="docutils literal notranslate"><span class="pre">logs</span></code> files</a></li>
</ul>
</div>
</div>
</nav>
<section data-toggle="wy-nav-shift" class="wy-nav-content-wrap">
<nav class="wy-nav-top" aria-label="top navigation">
<i data-toggle="wy-nav-top" class="fa fa-bars"></i>
<a href="../index.html">SMPyBandits</a>
</nav>
<div class="wy-nav-content">
<div class="rst-content">
<div role="navigation" aria-label="breadcrumbs navigation">
<ul class="wy-breadcrumbs">
<li><a href="../index.html">Docs</a> »</li>
<li>Jupyter Notebooks 📓 by Naereen @ GitHub</li>
<li class="wy-breadcrumbs-aside">
<a href="../_sources/notebooks/README.md.txt" rel="nofollow"> View page source</a>
</li>
</ul>
<hr/>
</div>
<div role="main" class="document" itemscope="itemscope" itemtype="http://schema.org/Article">
<div itemprop="articleBody">
<style>
/* CSS overrides for sphinx_rtd_theme */
/* 24px margin */
.nbinput.nblast,
.nboutput.nblast {
margin-bottom: 19px; /* padding has already 5px */
}
/* ... except between code cells! */
.nblast + .nbinput {
margin-top: -19px;
}
.admonition > p:before {
margin-right: 4px; /* make room for the exclamation icon */
}
/* Fix math alignment, see readthedocs/sphinx_rtd_theme#686 */
.math {
text-align: unset;
}
</style>
<div class="section" id="jupyter-notebooks-notebook-by-naereen-github">
<h1><a class="reference external" href="https://www.jupyter.org/">Jupyter Notebooks</a> 📓 by <a class="reference external" href="https://naereen.github.io/">Naereen @ GitHub</a><a class="headerlink" href="#jupyter-notebooks-notebook-by-naereen-github" title="Permalink to this headline">¶</a></h1>
<p>This folder hosts some <a class="reference external" href="http://jupyter.org/">Jupyter Notebooks</a>, to present in a nice format some numerical experiments for <a class="reference external" href="https://github.com/SMPyBandits/SMPyBandits/">my SMPyBandits project</a>.</p>
<blockquote>
<div><p><a class="reference external" href="http://jupyter.org/">The wonderful Jupyter tools</a> is awesome to write interactive and nicely presented 🐍 Python simulations!</p>
<p><a class="reference external" href="http://jupyter.org/"><img alt="made-with-jupyter" src="https://img.shields.io/badge/Made%20with-Jupyter-1f425f.svg" /></a> <a class="reference external" href="https://www.python.org/"><img alt="made-with-python" src="https://img.shields.io/badge/Made%20with-Python-1f425f.svg" /></a></p>
</div></blockquote>
<hr class="docutils" />
<div class="section" id="list-of-experiments-presented-with-notebooks">
<h2>1. List of experiments presented with notebooks<a class="headerlink" href="#list-of-experiments-presented-with-notebooks" title="Permalink to this headline">¶</a></h2>
<div class="section" id="mab-problems">
<h3>MAB problems<a class="headerlink" href="#mab-problems" title="Permalink to this headline">¶</a></h3>
<ul class="simple">
<li><p>Easily creating various Multi-Armed Bandit problems, explains the interface of the <a class="reference external" href="docs/...Environment.MAB.html"><code class="docutils literal notranslate"><span class="pre">Environment.MAB</span></code></a> module.</p></li>
</ul>
</div>
<div class="section" id="single-player-simulations">
<h3>Single-Player simulations<a class="headerlink" href="#single-player-simulations" title="Permalink to this headline">¶</a></h3>
<ul class="simple">
<li><p>A simple example of Single-Player simulation, comparing <a class="reference external" href="https://smpybandits.github.io/docs/Policies.UCBalpha.html"><code class="docutils literal notranslate"><span class="pre">UCB1</span></code></a> (for two values of $\alpha$, 1 and 1/2), <a class="reference external" href="https://smpybandits.github.io/docs/Policies.Thompson.html"><code class="docutils literal notranslate"><span class="pre">Thompson</span> <span class="pre">Sampling</span></code></a>, <a class="reference external" href="https://smpybandits.github.io/docs/Policies.BayesUCB.html"><code class="docutils literal notranslate"><span class="pre">BayesUCB</span></code></a> and <a class="reference external" href="https://smpybandits.github.io/docs/Policies.klUCB.html"><code class="docutils literal notranslate"><span class="pre">kl-UCB</span></code></a>.</p></li>
<li><p>Do we even need UCB? demonstrates the need for an algorithm smarter than the naive <a class="reference external" href="https://smpybandits.github.io/docs/Policies.EmpiricalMeans.html"><code class="docutils literal notranslate"><span class="pre">EmpiricalMeans</span></code></a>.</p></li>
<li><p>Lai-Robbins lower-bound for doubling-tricks algorithms with full restart.</p></li>
</ul>
</div>
<div class="section" id="active-research-on-single-player-mab">
<h3>Active research on Single-Player MAB<a class="headerlink" href="#active-research-on-single-player-mab" title="Permalink to this headline">¶</a></h3>
<ul class="simple">
<li><p>Exploring different doubling tricks for different kinds of regret bounds.</p></li>
<li><p>Experiments of statistical tests for piecewise stationary bandits</p></li>
<li><p>Demonstrations of Single-Player Simulations for Non-Stationary Bandits.</p></li>
</ul>
</div>
<div class="section" id="multi-player-simulations">
<h3>Multi-Player simulations<a class="headerlink" href="#multi-player-simulations" title="Permalink to this headline">¶</a></h3>
<ul class="simple">
<li><p>A simple example of Multi-Player simulation with 4 Centralized Algorithms, comparing <a class="reference external" href="https://smpybandits.github.io/docs/PoliciesMultiPlayers.CentralizedMultiplePlay.html"><code class="docutils literal notranslate"><span class="pre">CentralizedMultiplePlay</span></code></a> and <a class="reference external" href="https://smpybandits.github.io/docs/PoliciesMultiPlayers.CentralizedIMP.html"><code class="docutils literal notranslate"><span class="pre">CentralizedIMP</span></code></a> with <a class="reference external" href="https://smpybandits.github.io/docs/Policies.UCB.html"><code class="docutils literal notranslate"><span class="pre">UCB</span></code></a> and <a class="reference external" href="https://smpybandits.github.io/docs/Policies.Thompson.html"><code class="docutils literal notranslate"><span class="pre">Thompson</span> <span class="pre">Sampling</span></code></a>.</p></li>
<li><p>A simple example of Multi-Player simulation with 2 Decentralized Algorithms, comparing <a class="reference external" href="https://smpybandits.github.io/docs/PoliciesMultiPlayers.rhoRand.html"><code class="docutils literal notranslate"><span class="pre">rhoRand</span></code></a> and <a class="reference external" href="https://smpybandits.github.io/docs/PoliciesMultiPlayers.Selfish.html"><code class="docutils literal notranslate"><span class="pre">Selfish</span></code></a> (for the “collision avoidance” part) combined with <a class="reference external" href="https://smpybandits.github.io/docs/Policies.UCB.html"><code class="docutils literal notranslate"><span class="pre">UCB</span></code></a> and <a class="reference external" href="https://smpybandits.github.io/docs/Policies.Thompson.html"><code class="docutils literal notranslate"><span class="pre">Thompson</span> <span class="pre">Sampling</span></code></a> for learning the arms. Spoiler: <code class="docutils literal notranslate"><span class="pre">Selfish</span></code> beats <code class="docutils literal notranslate"><span class="pre">rhoRand</span></code>!</p></li>
</ul>
</div>
</div>
<div class="section" id="old-experiments">
<h2>(Old) Experiments<a class="headerlink" href="#old-experiments" title="Permalink to this headline">¶</a></h2>
<ul class="simple">
<li><p>Can we use a (non-online) Unsupervised Learning algorithm for (online) Bandit problem ?</p></li>
<li><p>Can we use a computationally expensive Black-Box Bayesian optimization algorithm for (online) Bandit problem ?</p></li>
</ul>
</div>
<hr class="docutils" />
<div class="section" id="question-how-to-read-these-documents">
<h2>2. Question: <em>How to read these documents</em>?<a class="headerlink" href="#question-how-to-read-these-documents" title="Permalink to this headline">¶</a></h2>
<div class="section" id="a-view-the-notebooks-statically-memo">
<h3>2.a. View the <em>notebooks</em> statically 📝<a class="headerlink" href="#a-view-the-notebooks-statically-memo" title="Permalink to this headline">¶</a></h3>
<ul class="simple">
<li><p>Either directly in GitHub: <a class="reference external" href="https://github.com/SMPyBandits/SMPyBandits/search?l=jupyter-notebook">see the list of notebooks</a>;</p></li>
<li><p>Or on <a class="reference external" href="https://nbviewer.jupiter.org/">nbviewer.jupiter.org</a>: <a class="reference external" href="https://nbviewer.jupyter.org/github/SMPyBandits/SMPyBandits/">list of notebooks</a>.</p></li>
</ul>
</div>
<div class="section" id="b-play-with-the-notebooks-dynamically-on-mybinder-boom">
<h3>2.b. Play with the <em>notebooks</em> dynamically (on MyBinder) 💥<a class="headerlink" href="#b-play-with-the-notebooks-dynamically-on-mybinder-boom" title="Permalink to this headline">¶</a></h3>
<p><a class="reference external" href="http://mybinder.org/v2/gh/SMPyBandits/SMPyBandits/master?filepath=notebooks"><img alt="Binder" src="https://mybinder.org/badge_logo.svg" /></a></p>
<p>Anyone can use the <a class="reference external" href="http://mybinder.org/">mybinder.org</a> website (by <a class="reference external" href="http://mybinder.org/v2/gh/SMPyBandits/SMPyBandits/master?filepath=notebooks">clicking</a> on the icon above) to run the notebook in her/his web-browser.
You can then play with it as long as you like, for instance by modifying the values or experimenting with the code.</p>
<p><a class="reference external" href="https://mybinder.org/v2/gh/SMPyBandits/SMPyBandits/master?filepath=notebooks%2FDo_we_even_need_UCB.ipynb"><img alt="Binder" src="https://mybinder.org/badge_logo.svg" /></a></p>
<ul class="simple">
<li><p><a class="reference external" href="https://mybinder.org/v2/gh/SMPyBandits/SMPyBandits/master?filepath=notebooks%2FDo_we_even_need_UCB.ipynb">Do_we_even_need_UCB.ipynb</a> <a class="reference external" href="https://mybinder.org/v2/gh/SMPyBandits/SMPyBandits/master?filepath=notebooks%2FDo_we_even_need_UCB.ipynb"><img alt="Binder" src="https://mybinder.org/badge_logo.svg" /></a></p></li>
<li><p><a class="reference external" href="https://mybinder.org/v2/gh/SMPyBandits/SMPyBandits/master?filepath=notebooks%2FEasily_creating_MAB_problems.ipynb">Easily_creating_MAB_problems.ipynb</a> <a class="reference external" href="https://mybinder.org/v2/gh/SMPyBandits/SMPyBandits/master?filepath=notebooks%2FEasily_creating_MAB_problems.ipynb"><img alt="Binder" src="https://mybinder.org/badge_logo.svg" /></a></p></li>
<li><p><a class="reference external" href="https://mybinder.org/v2/gh/SMPyBandits/SMPyBandits/master?filepath=notebooks%2FExample_of_a_small_Single-Player_Simulation.ipynb">Example_of_a_small_Single-Player_Simulation.ipynb</a> <a class="reference external" href="https://mybinder.org/v2/gh/SMPyBandits/SMPyBandits/master?filepath=notebooks%2FExample_of_a_small_Single-Player_Simulation.ipynb"><img alt="Binder" src="https://mybinder.org/badge_logo.svg" /></a></p></li>
<li><p><a class="reference external" href="https://mybinder.org/v2/gh/SMPyBandits/SMPyBandits/master?filepath=notebooks%2FExample_of_a_small_Multi-Player_Simulation__with_Centralized_Algorithms.ipynb">Example_of_a_small_Multi-Player_Simulation__with_Centralized_Algorithms.ipynb</a> <a class="reference external" href="https://mybinder.org/v2/gh/SMPyBandits/SMPyBandits/master?filepath=notebooks%2FExample_of_a_small_Multi-Player_Simulation__with_Centralized_Algorithms.ipynb"><img alt="Binder" src="https://mybinder.org/badge_logo.svg" /></a></p></li>
<li><p><a class="reference external" href="https://mybinder.org/v2/gh/SMPyBandits/SMPyBandits/master?filepath=notebooks%2FExample_of_a_small_Multi-Player_Simulation__with_rhoRand_and_Selfish_Algorithms.ipynb">Example_of_a_small_Multi-Player_Simulation__with_rhoRand_and_Selfish_Algorithms.ipynb</a> <a class="reference external" href="https://mybinder.org/v2/gh/SMPyBandits/SMPyBandits/master?filepath=notebooks%2FExample_of_a_small_Multi-Player_Simulation__with_rhoRand_and_Selfish_Algorithms.ipynb"><img alt="Binder" src="https://mybinder.org/badge_logo.svg" /></a></p></li>
<li><p><a class="reference external" href="https://mybinder.org/v2/gh/SMPyBandits/SMPyBandits/master?filepath=notebooks%2FLai_Robbins_Lower_Bound_for_Doubling_Trick_with_Restarting_Algorithms.ipynb">Lai_Robbins_Lower_Bound_for_Doubling_Trick_with_Restarting_Algorithms.ipynb</a> <a class="reference external" href="https://mybinder.org/v2/gh/SMPyBandits/SMPyBandits/master?filepath=notebooks%2FLai_Robbins_Lower_Bound_for_Doubling_Trick_with_Restarting_Algorithms.ipynb"><img alt="Binder" src="https://mybinder.org/badge_logo.svg" /></a></p></li>
<li><p><a class="reference external" href="https://mybinder.org/v2/gh/SMPyBandits/SMPyBandits/master?filepath=notebooks%2FExploring_different_doubling_tricks_for_different_kinds_of_regret_bounds.ipynb">Exploring different doubling tricks for different kinds of regret bounds.ipynb</a> <a class="reference external" href="https://mybinder.org/v2/gh/SMPyBandits/SMPyBandits/master?filepath=notebooks%2FExploring_different_doubling_tricks_for_different_kinds_of_regret_bounds.ipynb"><img alt="Binder" src="https://mybinder.org/badge_logo.svg" /></a></p></li>
<li><p><a class="reference external" href="https://mybinder.org/v2/gh/SMPyBandits/SMPyBandits/master?filepath=notebooks%2FExperiments_of_statistical_tests_for_piecewise_stationary_bandit.ipynb.ipynb">Experiments of statistical tests for piecewise stationary bandits.ipynb</a> <a class="reference external" href="https://mybinder.org/v2/gh/SMPyBandits/SMPyBandits/master?filepath=notebooks%2FExperiments_of_statistical_tests_for_piecewise_stationary_bandit.ipynb.ipynb"><img alt="Binder" src="https://mybinder.org/badge_logo.svg" /></a></p></li>
<li><p><a class="reference external" href="https://mybinder.org/v2/gh/SMPyBandits/SMPyBandits/master?filepath=notebooks%2FDemonstrations_of_Single-Player_Simulations_for_Non-Stationary-Bandits.ipynb">Demonstrations of Single-Player Simulations for Non-Stationary-Bandits.ipynb</a> <a class="reference external" href="https://mybinder.org/v2/gh/SMPyBandits/SMPyBandits/master?filepath=notebooks%2FDemonstrations_of_Single-Player_Simulations_for_Non-Stationary-Bandits.ipynb"><img alt="Binder" src="https://mybinder.org/badge_logo.svg" /></a></p></li>
</ul>
</div>
<div class="section" id="c-play-with-the-notebooks-dynamically-on-google-colab-boom">
<h3>2.c. Play with the <em>notebooks</em> dynamically (on Google Colab) 💥<a class="headerlink" href="#c-play-with-the-notebooks-dynamically-on-google-colab-boom" title="Permalink to this headline">¶</a></h3>
<p>Anyone can use the <a class="reference external" href="https://colab.research.google.com/notebook">colab.research.google.com/notebook</a> website (by <a class="reference external" href="XXX">clicking</a> on the icon above) to run the notebook in her/his web-browser.
You can then play with it as long as you like, for instance by modifying the values or experimenting with the code.</p>
<ul class="simple">
<li><p><a class="reference external" href="https://colab.research.google.com/github/SMPyBandits/SMPyBandits/blob/master/notebooks/Do_we_even_need_UCB.ipynb">Do_we_even_need_UCB.ipynb</a> <a class="reference external" href="https://colab.research.google.com/github/SMPyBandits/SMPyBandits/blob/master/notebooks/Do_we_even_need_UCB.ipynb"><img alt="Google Colab" src="https://badgen.net/badge/Launch/on%20Google%20Colab/blue?icon=terminal" /></a></p></li>
<li><p><a class="reference external" href="https://colab.research.google.com/github/SMPyBandits/SMPyBandits/blob/master/notebooks/Easily_creating_MAB_problems.ipynb">Easily_creating_MAB_problems.ipynb</a> <a class="reference external" href="https://colab.research.google.com/github/SMPyBandits/SMPyBandits/blob/master/notebooks/Easily_creating_MAB_problems.ipynb"><img alt="Google Colab" src="https://badgen.net/badge/Launch/on%20Google%20Colab/blue?icon=terminal" /></a></p></li>
<li><p><a class="reference external" href="https://colab.research.google.com/github/SMPyBandits/SMPyBandits/blob/master/notebooks/Example_of_a_small_Single-Player_Simulation.ipynb">Example_of_a_small_Single-Player_Simulation.ipynb</a> <a class="reference external" href="https://colab.research.google.com/github/SMPyBandits/SMPyBandits/blob/master/notebooks/Example_of_a_small_Single-Player_Simulation.ipynb"><img alt="Google Colab" src="https://badgen.net/badge/Launch/on%20Google%20Colab/blue?icon=terminal" /></a></p></li>
<li><p><a class="reference external" href="https://colab.research.google.com/github/SMPyBandits/SMPyBandits/blob/master/notebooks/Example_of_a_small_Multi-Player_Simulation__with_Centralized_Algorithms.ipynb">Example_of_a_small_Multi-Player_Simulation__with_Centralized_Algorithms.ipynb</a> <a class="reference external" href="https://colab.research.google.com/github/SMPyBandits/SMPyBandits/blob/master/notebooks/Example_of_a_small_Multi-Player_Simulation__with_Centralized_Algorithms.ipynb"><img alt="Google Colab" src="https://badgen.net/badge/Launch/on%20Google%20Colab/blue?icon=terminal" /></a></p></li>
<li><p><a class="reference external" href="https://colab.research.google.com/github/SMPyBandits/SMPyBandits/blob/master/notebooks/Example_of_a_small_Multi-Player_Simulation__with_rhoRand_and_Selfish_Algorithms.ipynb">Example_of_a_small_Multi-Player_Simulation__with_rhoRand_and_Selfish_Algorithms.ipynb</a> <a class="reference external" href="https://colab.research.google.com/github/SMPyBandits/SMPyBandits/blob/master/notebooks/Example_of_a_small_Multi-Player_Simulation__with_rhoRand_and_Selfish_Algorithms.ipynb"><img alt="Google Colab" src="https://badgen.net/badge/Launch/on%20Google%20Colab/blue?icon=terminal" /></a></p></li>
<li><p><a class="reference external" href="https://colab.research.google.com/github/SMPyBandits/SMPyBandits/blob/master/notebooks/Lai_Robbins_Lower_Bound_for_Doubling_Trick_with_Restarting_Algorithms.ipynb">Lai_Robbins_Lower_Bound_for_Doubling_Trick_with_Restarting_Algorithms.ipynb</a> <a class="reference external" href="https://colab.research.google.com/github/SMPyBandits/SMPyBandits/blob/master/notebooks/Lai_Robbins_Lower_Bound_for_Doubling_Trick_with_Restarting_Algorithms.ipynb"><img alt="Google Colab" src="https://badgen.net/badge/Launch/on%20Google%20Colab/blue?icon=terminal" /></a></p></li>
<li><p><a class="reference external" href="https://colab.research.google.com/github/SMPyBandits/SMPyBandits/blob/master/notebooks/Exploring_different_doubling_tricks_for_different_kinds_of_regret_bounds.ipynb">Exploring different doubling tricks for different kinds of regret bounds.ipynb</a> <a class="reference external" href="https://colab.research.google.com/github/SMPyBandits/SMPyBandits/blob/master/notebooks/Exploring_different_doubling_tricks_for_different_kinds_of_regret_bounds.ipynb"><img alt="Google Colab" src="https://badgen.net/badge/Launch/on%20Google%20Colab/blue?icon=terminal" /></a></p></li>
<li><p><a class="reference external" href="https://colab.research.google.com/github/SMPyBandits/SMPyBandits/blob/master/notebooks/Experiments_of_statistical_tests_for_piecewise_stationary_bandit.ipynb.ipynb">Experiments of statistical tests for piecewise stationary bandits.ipynb</a> <a class="reference external" href="https://colab.research.google.com/github/SMPyBandits/SMPyBandits/blob/master/notebooks/Experiments_of_statistical_tests_for_piecewise_stationary_bandit.ipynb.ipynb"><img alt="Google Colab" src="https://badgen.net/badge/Launch/on%20Google%20Colab/blue?icon=terminal" /></a></p></li>
<li><p><a class="reference external" href="https://colab.research.google.com/github/SMPyBandits/SMPyBandits/blob/master/notebooks/Demonstrations_of_Single-Player_Simulations_for_Non-Stationary-Bandits.ipynb">Demonstrations of Single-Player Simulations for Non-Stationary-Bandits.ipynb</a> <a class="reference external" href="https://colab.research.google.com/github/SMPyBandits/SMPyBandits/blob/master/notebooks/Demonstrations_of_Single-Player_Simulations_for_Non-Stationary-Bandits.ipynb"><img alt="Google Colab" src="https://badgen.net/badge/Launch/on%20Google%20Colab/blue?icon=terminal" /></a></p></li>
</ul>
</div>
</div>
<hr class="docutils" />
<div class="section" id="question-requirements-to-run-the-notebooks-locally">
<h2>3. Question: <em>Requirements to run the notebooks locally</em>?<a class="headerlink" href="#question-requirements-to-run-the-notebooks-locally" title="Permalink to this headline">¶</a></h2>
<p>All <a class="reference external" href="requirements.txt">the requirements</a> can be installed with <a class="reference external" href="https://pip.readthedocs.io/"><code class="docutils literal notranslate"><span class="pre">pip</span></code></a>.</p>
<blockquote>
<div><p>Note: if you use <a class="reference external" href="https://docs.python.org/3/">Python 3</a> instead of <a class="reference external" href="https://docs.python.org/2/">Python 2</a>, you <em>might</em> have to <em>replace</em> <code class="docutils literal notranslate"><span class="pre">pip</span></code> and <code class="docutils literal notranslate"><span class="pre">python</span></code> by <code class="docutils literal notranslate"><span class="pre">pip3</span></code> and <code class="docutils literal notranslate"><span class="pre">python3</span></code> in the next commands (if both <code class="docutils literal notranslate"><span class="pre">pip</span></code> and <code class="docutils literal notranslate"><span class="pre">pip3</span></code> are installed).</p>
</div></blockquote>
<div class="section" id="a-jupyter-notebook-and-ipython">
<h3>3.a. <a class="reference external" href="http://jupyter.readthedocs.org/en/latest/install.html">Jupyter Notebook</a> and <a class="reference external" href="http://ipython.org/">IPython</a><a class="headerlink" href="#a-jupyter-notebook-and-ipython" title="Permalink to this headline">¶</a></h3>
<div class="highlight-bash notranslate"><div class="highlight"><pre><span></span>sudo pip install jupyter ipython
</pre></div>
</div>
<p>It will also install all the dependencies, afterward you should have a <code class="docutils literal notranslate"><span class="pre">jupyter-notebook</span></code> command (or a <code class="docutils literal notranslate"><span class="pre">jupyter</span></code> command, to be ran as <code class="docutils literal notranslate"><span class="pre">jupyter</span> <span class="pre">notebook</span></code>) available in your <code class="docutils literal notranslate"><span class="pre">PATH</span></code>:</p>
<div class="highlight-bash notranslate"><div class="highlight"><pre><span></span>$ whereis jupyter-notebook
jupyter-notebook: /usr/local/bin/jupyter-notebook
$ jupyter-notebook --version <span class="c1"># version >= 4 is recommended</span>
<span class="m">4</span>.4.1
</pre></div>
</div>
</div>
<div class="section" id="b-my-numerical-environment-smpybandits">
<h3>3.b. My numerical environment, <a class="reference external" href="https://github.com/SMPyBandits/SMPyBandits/"><code class="docutils literal notranslate"><span class="pre">SMPyBandits</span></code></a><a class="headerlink" href="#b-my-numerical-environment-smpybandits" title="Permalink to this headline">¶</a></h3>
<ul class="simple">
<li><p>First, install its dependencies (<code class="docutils literal notranslate"><span class="pre">pip</span> <span class="pre">install</span> <span class="pre">-r</span> <span class="pre">requirements</span></code>).</p></li>
<li><p>Then, either install it (<em>not yet</em>), or be sure to work in the main folder.</p></li>
</ul>
<blockquote>
<div><p><em>Note:</em> it’s probably better to use <a class="reference external" href="https://virtualenv.pypa.io/"><em>virtualenv</em></a>, if you like it.
I never really understood how and why virtualenv are useful, but if you know why, you should know how to use it.</p>
</div></blockquote>
</div>
<hr class="docutils" />
<div class="section" id="information-desk-person-more-information">
<h3>💁 More information?<a class="headerlink" href="#information-desk-person-more-information" title="Permalink to this headline">¶</a></h3>
<blockquote>
<div><ul class="simple">
<li><p>More information about <a class="reference external" href="https://nbviewer.jupiter.org/github/ipython/ipython/blob/3.x/examples/Notebook/Index.ipynb">notebooks (on the documentation of IPython)</a> or <a class="reference external" href="https://nbviewer.jupyter.org/faq">on the FAQ on Jupyter’s website</a>.</p></li>
<li><p>More information about <a class="reference external" href="http://mybinder.org/">mybinder.org</a>: on <a class="reference external" href="https://github.com/binder-project/example-requirements">this example repository</a>.</p></li>
</ul>
</div></blockquote>
</div>
</div>
<div class="section" id="scroll-license-github-license">
<h2>📜 License ? <a class="reference external" href="https://github.com/SMPyBandits/SMPyBandits/blob/master/LICENSE"><img alt="GitHub license" src="https://img.shields.io/github/license/Naereen/notebooks.svg" /></a><a class="headerlink" href="#scroll-license-github-license" title="Permalink to this headline">¶</a></h2>
<p>All the notebooks in this folder are published under the terms of the <a class="reference external" href="https://lbesson.mit-license.org/">MIT License</a> (file <a class="reference external" href="../LICENSE.txt">LICENSE.txt</a>).
© <a class="reference external" href="https://GitHub.com/Naereen">Lilian Besson</a>, 2016-18.</p>
<p><a class="reference external" href="https://GitHub.com/SMPyBandits/SMPyBandits/graphs/commit-activity"><img alt="Maintenance" src="https://img.shields.io/badge/Maintained%3F-yes-green.svg" /></a>
<a class="reference external" href="https://GitHub.com/Naereen/ama"><img alt="Ask Me Anything !" src="https://img.shields.io/badge/Ask%20me-anything-1abc9c.svg" /></a>
<a class="reference external" href="https://GitHub.com/SMPyBandits/SMPyBandits/"><img alt="Analytics" src="https://ga-beacon.appspot.com/UA-38514290-17/github.com/SMPyBandits/SMPyBandits/README.md?pixel" /></a>
<a class="reference external" href="http://jupyter.org/"><img alt="made-with-jupyter" src="https://img.shields.io/badge/Made%20with-Jupyter-1f425f.svg" /></a> <a class="reference external" href="https://www.python.org/"><img alt="made-with-python" src="https://img.shields.io/badge/Made%20with-Python-1f425f.svg" /></a>
<a class="reference external" href="http://ForTheBadge.com"><img alt="ForTheBadge uses-badges" src="http://ForTheBadge.com/images/badges/uses-badges.svg" /></a>
<a class="reference external" href="https://GitHub.com/"><img alt="ForTheBadge uses-git" src="http://ForTheBadge.com/images/badges/uses-git.svg" /></a></p>
<p><a class="reference external" href="https://GitHub.com/Naereen/"><img alt="ForTheBadge built-with-science" src="http://ForTheBadge.com/images/badges/built-with-science.svg" /></a></p>
</div>
</div>
</div>
</div>
<footer>
<div class="rst-footer-buttons" role="navigation" aria-label="footer navigation">
<a href="list.html" class="btn btn-neutral float-right" title="List of notebooks for SMPyBandits" accesskey="n" rel="next">Next <span class="fa fa-arrow-circle-right"></span></a>
<a href="../plots/README.html" class="btn btn-neutral float-left" title="Some illustrations for this project" accesskey="p" rel="prev"><span class="fa fa-arrow-circle-left"></span> Previous</a>
</div>
<hr/>
<div role="contentinfo">
<p>
© Copyright 2016-2018, Lilian Besson (Naereen)
<span class="lastupdated">
Last updated on 25 Feb 2020, 14h.
</span>
</p>
</div>
Built with <a href="http://sphinx-doc.org/">Sphinx</a> using a <a href="https://github.com/rtfd/sphinx_rtd_theme">theme</a> provided by <a href="https://readthedocs.org">Read the Docs</a>.
</footer>
</div>
</div>
</section>
</div>
<script type="text/javascript">
jQuery(function () {
SphinxRtdTheme.Navigation.enable(true);
});
</script>
</body>
</html>
