mt3195_hw1.ipynb

{
 "cells": [
  {
   "cell_type": "markdown",
   "metadata": {
    "colab_type": "text",
    "id": "-PZihj-d_tEt"
   },
   "source": [
    "**Assignment 1, Due 9/26**\n",
    "\n",
    "## About\n",
    "In this assignment, you will gain experience implementing a linear model, a neural network, and a deep neural network using TensorFlow 2.0. \n",
    "\n",
    "* You will use two different development styles. I thought it’d be helpful for you to see both of these early (if you’re familiar with them, you can branch out to any major framework that exist today). \n",
    "\n",
    "* Along the way, you'll add code to visualize the weights of a linear model, and provide your own implementation of softmax (so you learn to extend the built-in functionality right off the bat).\n",
    "\n",
    "This assignment has several parts, plan ahead and get started early (and come to office hours if you’re stuck, the TAs and I are happy to help). Most concepts will be covered in lecture two, just posting it early.\n",
    "\n",
    "## Instructions\n",
    "\n",
    "Complete the code in this notebook by searching for the text **\"TODO\"**.\n",
    "\n",
    "## Submission instructions\n",
    "\n",
    "Please submit this assignment on CourseWorks by uploading a Jupyter notebook that includes saved output. If you are working in Colab, you can prepare your notebook for submission by ensuring that runs end-to-end, then saving and downloading it:\n",
    "\n",
    "1. ```Runtime -> Restart and run all```\n",
    "1. ```File -> Save```\n",
    "1. ```File -> Download.ipynb```\n",
    "\n",
    "## Resources\n",
    "\n",
    "You can find all the latest tutorials for TensorFlow 2.0 [here](https://www.tensorflow.org/beta). Code examples that will help you with each part of the assignment are linked below.\n",
    "\n",
    "\n",
    "\n",
    "---\n",
    "\n"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "colab_type": "text",
    "id": "KZ5ssDBBl9n6"
   },
   "source": [
    "## Setup"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "colab_type": "text",
    "id": "MDj1_w6v-mYW"
   },
   "source": [
    "### Install TensorFlow 2.0\n",
    "\n",
    "If you are running this notebook in Colab, the magic command below will install the most recent version. If you prefer working in Jupyter locally, you will need to install TensorFlow 2.0 on your system, using ```!pip install tensorflow==2.0.0-rc0```."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 0,
   "metadata": {
    "colab": {},
    "colab_type": "code",
    "id": "m1wARst_UkEi"
   },
   "outputs": [],
   "source": [
    "try:\n",
    "  %tensorflow_version 2.x\n",
    "except Exception:\n",
    "  pass"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "colab_type": "text",
    "id": "QYSALG-y-_7b"
   },
   "source": [
    "### Check which TF version is installed\n",
    "TensorFlow 2.0 is currently under development. It's good practice to check which version you have installed. All the code you'll write in this course will be for version 2.0 (currently in beta)."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 2,
   "metadata": {
    "colab": {},
    "colab_type": "code",
    "id": "21RQ0x71Ut_t"
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "2.0.0-rc0\n"
     ]
    }
   ],
   "source": [
    "import tensorflow as tf\n",
    "print(tf.__version__)\n",
    "assert tf.__version__.startswith('2')"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 3,
   "metadata": {
    "colab": {},
    "colab_type": "code",
    "id": "JQPA61YHUvht"
   },
   "outputs": [],
   "source": [
    "from tensorflow.keras.layers import Dense, Flatten \n",
    "from tensorflow.keras import Model\n",
    "import matplotlib.pyplot as plt"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "colab_type": "text",
    "id": "9vfWS0eYvzae"
   },
   "source": [
    "## Part 1: First steps with Sequential models\n",
    "\n",
    "You will work with the Sequential API in this section. This is the easiest way to develop models with TF 2.0, and is the most common in practice. \n",
    "\n",
    "Here are a few code examples that will help you with this part of the assignment:\n",
    "\n",
    "* [Get started for beginners](https://www.tensorflow.org/beta/tutorials/quickstart/beginner)\n",
    "* [Classify images](https://www.tensorflow.org/beta/tutorials/keras/basic_classification)\n",
    "* [Explore overfitting and underfitting](https://www.tensorflow.org/beta/tutorials/keras/overfit_and_underfit)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "colab_type": "text",
    "id": "6X5681LTm0jC"
   },
   "source": [
    "### Download and prepare a dataset"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 4,
   "metadata": {
    "colab": {},
    "colab_type": "code",
    "id": "KHL51OKlmwyw"
   },
   "outputs": [],
   "source": [
    "mnist = tf.keras.datasets.mnist\n",
    "\n",
    "(x_train, y_train), (x_test, y_test) = mnist.load_data()\n",
    "x_train, x_test = x_train / 255.0, x_test / 255.0"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "colab_type": "text",
    "id": "daw-THC6m4u6"
   },
   "source": [
    "### Define, train, and evaluate a linear model"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 5,
   "metadata": {
    "colab": {},
    "colab_type": "code",
    "id": "MHWcSJEQm8jB"
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Train on 60000 samples\n",
      "Epoch 1/5\n",
      "WARNING:tensorflow:Entity <function Function._initialize_uninitialized_variables.<locals>.initialize_variables at 0x101870950> could not be transformed and will be executed as-is. Please report this to the AutoGraph team. When filing the bug, set the verbosity to 10 (on Linux, `export AUTOGRAPH_VERBOSITY=10`) and attach the full output. Cause: module 'gast' has no attribute 'Num'\n",
      "WARNING: Entity <function Function._initialize_uninitialized_variables.<locals>.initialize_variables at 0x101870950> could not be transformed and will be executed as-is. Please report this to the AutoGraph team. When filing the bug, set the verbosity to 10 (on Linux, `export AUTOGRAPH_VERBOSITY=10`) and attach the full output. Cause: module 'gast' has no attribute 'Num'\n",
      "60000/60000 [==============================] - 6s 93us/sample - loss: 0.4762 - accuracy: 0.8749\n",
      "Epoch 2/5\n",
      "60000/60000 [==============================] - 5s 89us/sample - loss: 0.3053 - accuracy: 0.9150s - los\n",
      "Epoch 3/5\n",
      "60000/60000 [==============================] - 5s 88us/sample - loss: 0.2836 - accuracy: 0.9212\n",
      "Epoch 4/5\n",
      "60000/60000 [==============================] - 5s 88us/sample - loss: 0.2734 - accuracy: 0.9230\n",
      "Epoch 5/5\n",
      "60000/60000 [==============================] - 5s 90us/sample - loss: 0.2666 - accuracy: 0.9254\n",
      "10000/1 [================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================] - 1s 52us/sample - loss: 0.1950 - accuracy: 0.9259\n"
     ]
    },
    {
     "data": {
      "text/plain": [
       "[0.26635380264222625, 0.9259]"
      ]
     },
     "execution_count": 5,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "model = tf.keras.models.Sequential([\n",
    "  tf.keras.layers.Flatten(input_shape=(28, 28)),\n",
    "  tf.keras.layers.Dense(10, activation='softmax')\n",
    "])\n",
    "\n",
    "model.compile(optimizer='adam',\n",
    "              loss='sparse_categorical_crossentropy',\n",
    "              metrics=['accuracy'])\n",
    "\n",
    "model.fit(x_train, y_train, epochs=5)\n",
    "model.evaluate(x_test, y_test)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "colab_type": "text",
    "id": "KyLE9HJbwRDp"
   },
   "source": [
    "### 1a: Plot loss and accuracy\n",
    "\n",
    "**TODO**\n",
    "\n",
    "Modify the code below to produce plots showing loss and accuracy as a function of epochs on training and validation data (it's fine to use x_test and y_test as validation data for this assignment). To do so, you will need to add validation data to the call for ```model.fit```, and capture the results in a history object. Code for plotting is provided for you, you can pass your history object to this.\n",
    "\n",
    "![Plot 1](https://storage.googleapis.com/applied-dl/im/a1-1.png)\n",
    "![Plot 2](https://storage.googleapis.com/applied-dl/im/a1-2.png)\n"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 6,
   "metadata": {
    "colab": {},
    "colab_type": "code",
    "id": "xGFjRexynN11"
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Train on 60000 samples, validate on 10000 samples\n",
      "Epoch 1/10\n",
      "WARNING:tensorflow:Entity <function Function._initialize_uninitialized_variables.<locals>.initialize_variables at 0xb2776e048> could not be transformed and will be executed as-is. Please report this to the AutoGraph team. When filing the bug, set the verbosity to 10 (on Linux, `export AUTOGRAPH_VERBOSITY=10`) and attach the full output. Cause: module 'gast' has no attribute 'Num'\n",
      "WARNING: Entity <function Function._initialize_uninitialized_variables.<locals>.initialize_variables at 0xb2776e048> could not be transformed and will be executed as-is. Please report this to the AutoGraph team. When filing the bug, set the verbosity to 10 (on Linux, `export AUTOGRAPH_VERBOSITY=10`) and attach the full output. Cause: module 'gast' has no attribute 'Num'\n",
      "60000/60000 [==============================] - 8s 130us/sample - loss: 0.4714 - accuracy: 0.8751 - val_loss: 0.3098 - val_accuracy: 0.9156\n",
      "Epoch 2/10\n",
      "60000/60000 [==============================] - 6s 105us/sample - loss: 0.3040 - accuracy: 0.9158 - val_loss: 0.2839 - val_accuracy: 0.9205\n",
      "Epoch 3/10\n",
      "60000/60000 [==============================] - 7s 118us/sample - loss: 0.2835 - accuracy: 0.9206 - val_loss: 0.2705 - val_accuracy: 0.9242\n",
      "Epoch 4/10\n",
      "60000/60000 [==============================] - 6s 103us/sample - loss: 0.2733 - accuracy: 0.9238 - val_loss: 0.2706 - val_accuracy: 0.9234\n",
      "Epoch 5/10\n",
      "60000/60000 [==============================] - 6s 97us/sample - loss: 0.2668 - accuracy: 0.9265 - val_loss: 0.2689 - val_accuracy: 0.9249\n",
      "Epoch 6/10\n",
      "60000/60000 [==============================] - 6s 101us/sample - loss: 0.2618 - accuracy: 0.9277 - val_loss: 0.2704 - val_accuracy: 0.9246\n",
      "Epoch 7/10\n",
      "60000/60000 [==============================] - 7s 115us/sample - loss: 0.2582 - accuracy: 0.9288 - val_loss: 0.2684 - val_accuracy: 0.9263\n",
      "Epoch 8/10\n",
      "60000/60000 [==============================] - 7s 116us/sample - loss: 0.2553 - accuracy: 0.9297 - val_loss: 0.2649 - val_accuracy: 0.9259\n",
      "Epoch 9/10\n",
      "60000/60000 [==============================] - 7s 109us/sample - loss: 0.2529 - accuracy: 0.9296 - val_loss: 0.2633 - val_accuracy: 0.9281\n",
      "Epoch 10/10\n",
      "60000/60000 [==============================] - 7s 111us/sample - loss: 0.2506 - accuracy: 0.9304 - val_loss: 0.2677 - val_accuracy: 0.9242\n"
     ]
    },
    {
     "data": {
      "image/png": "iVBORw0KGgoAAAANSUhEUgAAAYsAAAEWCAYAAACXGLsWAAAABHNCSVQICAgIfAhkiAAAAAlwSFlzAAALEgAACxIB0t1+/AAAADl0RVh0U29mdHdhcmUAbWF0cGxvdGxpYiB2ZXJzaW9uIDMuMC4yLCBodHRwOi8vbWF0cGxvdGxpYi5vcmcvOIA7rQAAIABJREFUeJzt3X2clHW9//HXh93l/n65lQW5EQUERF0RhY4mlpg3mFqG2clMrU52KjOPdszUzKw8nTTNMsPSSjRPlr+OyTHSdNc7QAW5Se4EXQFZ7mHlZpf9/P74XuPODrs7A+zMtTv7fj4e85hrrrlm5jPDMu+5vt/r+n7N3REREWlKu7gLEBGRlk9hISIiaSksREQkLYWFiIikpbAQEZG0FBYiIpKWwkIyZmYFZrbTzIY057ZxMrMjzKzZjx83s9PNbHXS7TfN7EOZbHsQr3W/mX3rYB8vkonCuAuQ7DGznUk3OwN7gH3R7S+4++8O5PncfR/Qtbm3bQvc/ajmeB4zuxy4xN1PTXruy5vjuUWaorDIY+7+wZd19Mv1cnf/W2Pbm1mhu9fkojaRdPT32LKoGaoNM7NbzewRM3vYzHYAl5jZSWb2kpltNbN1ZnaXmRVF2xeamZvZ0Oj2b6P7/2pmO8zsRTMbdqDbRvefaWbLzGybmf3UzMrN7NJG6s6kxi+Y2Qoz22JmdyU9tsDM/tvMNpnZSmBaE5/PDWY2K2XdPWb242j5cjNbGr2fldGv/saeq8LMTo2WO5vZQ1Fti4HjG3jdVdHzLjazc6P144C7gQ9FTXwbkz7bm5Ie/8XovW8ysz+Z2cBMPpsD+ZwT9ZjZ38xss5mtN7Nrk17n29Fnst3M5pnZYQ01+ZlZWeLfOfo8n4teZzNwg5mNNLNnoveyMfrceiQ9/vDoPVZG999pZh2jmkcnbTfQzN43s+LG3q+k4e66tIELsBo4PWXdrcBe4BzCD4dOwAnAiYS9zuHAMuCqaPtCwIGh0e3fAhuBUqAIeAT47UFs2w/YAUyP7rsaqAYubeS9ZFLjn4EewFBgc+K9A1cBi4ESoBh4Lvw3aPB1hgM7gS5Jz70BKI1unxNtY8BpwC5gfHTf6cDqpOeqAE6Nlu8AngV6AYcDS1K2/SQwMPo3uTiqoX903+XAsyl1/ha4KVr+aFTjBKAj8DPg75l8Ngf4OfcA3gO+CnQAugMTo/uuBxYAI6P3MAHoDRyR+lkDZYl/5+i91QBfAgoIf49HAlOB9tHfSTlwR9L7WRR9nl2i7SdH990HfC/pdb4BPB73/8PWfIm9AF1y9A/deFj8Pc3jrgH+EC03FAA/T9r2XGDRQWx7GfB80n0GrKORsMiwxklJ9/8RuCZafo7QHJe472OpX2Apz/0ScHG0fCawrIlt/wJ8OVpuKizeTv63AP4tedsGnncRcFa0nC4sfgPclnRfd0I/VUm6z+YAP+fPAPMa2W5lot6U9ZmExao0NVwIzI2WPwSsBwoa2G4y8BZg0e3XgfOb+/9VW7qoGUreSb5hZqPM7H+jZoXtwC1AnyYevz5p+X2a7tRubNvDkuvw8L+7orEnybDGjF4LWNNEvQC/B2ZEyxcDHxwUYGZnm9nLUTPMVsKv+qY+q4SBTdVgZpea2YKoKWUrMCrD54Xw/j54PnffDmwBBiVtk9G/WZrPeTCwopEaBhMC42Ck/j0OMLNHzezdqIZfp9Sw2sPBFPW4ezlhL2WKmY0FhgD/e5A1CeqzkPBLM9kvCL9kj3D37sCNhF/62bSO8MsXADMz6n+5pTqUGtcRvmQS0h3a+whwupmVEJrJfh/V2Al4DPg+oYmoJ/B/GdaxvrEazGw4cC+hKaY4et5/Jj1vusN81xKathLP143Q3PVuBnWlaupzfgcY0cjjGruvKqqpc9K6ASnbpL6/HxCO4hsX1XBpSg2Hm1lBI3U8CFxC2At61N33NLKdZEBhIam6AduAqqiD8As5eM2/AMeZ2TlmVkhoB++bpRofBb5mZoOizs7/aGpjd3+P0FTyAPCmuy+P7upAaEevBPaZ2dmEtvVMa/iWmfW0cB7KVUn3dSV8YVYScvNywp5FwntASXJHc4qHgc+b2Xgz60AIs+fdvdE9tSY09Tk/AQwxs6vMrL2ZdTezidF99wO3mtkICyaYWW9CSK4nHEhRYGZXkhRsTdRQBWwzs8GEprCEF4FNwG0WDhroZGaTk+5/iNBsdTEhOOQQKCwk1TeAzxI6nH9B+GWdVdEX8kXAjwn/+UcArxF+UTZ3jfcCc4A3gLmEvYN0fk/og/h9Us1bga8DjxM6iS8khF4mvkPYw1kN/JWkLzJ3XwjcBbwSbTMKeDnpsU8Dy4H3zCy5OSnx+KcIzUWPR48fAnw6w7pSNfo5u/s24CPABYQO9WXAKdHdPwL+RPictxM6mztGzYtXAN8iHOxwRMp7a8h3gImE0HoC+J+kGmqAs4HRhL2Mtwn/Don7VxP+nfe6+wsH+N4lRaLzR6TFiJoV1gIXuvvzcdcjrZeZPUjoNL8p7lpaO52UJy2CmU0jNCvsJhx6WUP4dS1yUKL+n+nAuLhryQdqhpKWYgqwitA8MQ04Tx2ScrDM7PuEcz1uc/e3464nH6gZSkRE0tKehYiIpJU3fRZ9+vTxoUOHxl2GiEirMn/+/I3u3tSh6kAehcXQoUOZN29e3GWIiLQqZpZuFANAzVAiIpIBhYWIiKSlsBARkbTyps+iIdXV1VRUVLB79+64S8mZjh07UlJSQlFRY0MHiYgcuLwOi4qKCrp168bQoUMJA5nmN3dn06ZNVFRUMGzYsPQPEBHJUF43Q+3evZvi4uI2ERQAZkZxcXGb2pMSkdzIaliY2TQzezOa7/e6Bu4/3MzmmNlCM3s2mjMgsX6+mb1uYQ7iLx5CDYfyFlqdtvZ+RSQ3stYMFY0ceg9hGOMKYK6ZPeHuS5I2uwN40N1/Y2anEcbe/wxhaOWT3X2PmXUFFkWPXZutekVEWrLaWti6FSorYePGcEks9+4NV16Z3dfPZp/FRGCFu68CMLNZhBEgk8NiDGFOAIBnCGPg4+57k7bpQCttLtu0aRNTp4b5cNavX09BQQF9+4YTJV955RXat2+f9jk+97nPcd1113HUUUdltVYRya2qqrov/eQv/saWN20KgdGQSZNad1gMov58uhXAiSnbLCBMnnIn8HGgm5kVu/umaFas/yVMkPLN1rhXUVxczOuvvw7ATTfdRNeuXbnmmmvqbfPBZOjtGs7DBx54IOt1isihqakJX+apX/RNhcCuXQ0/V0EBFBdDnz7Qty+MGROWE7cbWu7cueHnak7ZDIuGGs9Th7i9BrjbzC4FniPME1wD4O7vAOPN7DDgT2b2WDSjWt0LhGkZrwQYMiTdVMotx4oVKzjvvPOYMmUKL7/8Mn/5y1+4+eabefXVV9m1axcXXXQRN954IwBTpkzh7rvvZuzYsfTp04cvfvGL/PWvf6Vz5878+c9/pl+/fjG/G5Hm8/77sH49vPde3XXycuJ60yZwB7P6F9h/XTa32bs31LJlS+PvqXv3ui/2ww6D8eMb/9Lv0wd69oRGfjvGKpthUUH9SelLCLOffSDaWzgfIOqbuCCarrHeNma2GPgQKVNguvt9hCkbKS0tbXKs9a99DaIf+c1mwgT4yU8O7rFLlizhgQce4Oc//zkAt99+O71796ampoYPf/jDXHjhhYwZM6beY7Zt28Ypp5zC7bffztVXX83MmTO57rr9jhsQaVF27274C7+h6507G36OPn2gf38YMCA0uRQXhy9U97oL1L/d0KW5tykqqv9FnxoCxcWQQWtzq5DNsJgLjDSzYYQ9hk8RJk7/gJn1ATa7ey1hdrSZ0foSYJO77zKzXsBkwvzMeWPEiBGccMIJH9x++OGH+dWvfkVNTQ1r165lyZIl+4VFp06dOPPMMwE4/vjjef55zTgq8dizBzZsaPyLP3l527aGn6N377oAKC0N14nbydd9+4YvZYlX1sLC3WvM7CpgNlAAzHT3xWZ2CzDP3Z8ATgW+b2ZOaIb6cvTw0cB/ResNuMPd3ziUeg52DyBbunTp8sHy8uXLufPOO3nllVfo2bMnl1xySYPnSiR3iBcUFFBTU5OTWqXtcA9f7hUV8M474Tp1ef36xptdevas+6KfMKHhL/8BA6Bfv/z5xd1WZPUMbnd/EngyZd2NScuPkdK0FK1/Ghifzdpaku3bt9OtWze6d+/OunXrmD17NtOmTYu7LMkzDQVBQ4GQ2hRkBgMHwuDBMHo0nHZa4wHQsWM8702yL6+H+2gtjjvuOMaMGcPYsWMZPnw4kydPjrskaWWaCoLkQGgqCI4+GqZNg5KScBk8OFwPHKhmoP3UVMGmV6B6Jww8Awryfzcpb+bgLi0t9dTJj5YuXcro0aNjqig+bfV957Nt28KX/sEGQfKXf+JaQXAAdq2HynKoLAvXW14F3xfu69gfRlwOR1wJXVrPUZkJZjbf3UvTbac9C5EWYN++8IW/ahWsXBmuE5eVK2Hz5vrbN7ZHkBwIAwYoCA6KO2z/Z10wVJbBzpXhvoKOUHwijPkP6DslbLvi57Dk++Fy2Nkw8t9g4EfAWuDxr4dAYSGSIzt27B8CieXVq6G6um7bwkI4/HAYMQI++UkYPjzcVhBkwb49sHl+FA5lsPEF2LMp3NehL/SdDCO/FK57Hbd/k9Ogj0HVGlhxH6y8H959ArqOgJFfhOGfgw7FuX9PWaCwEGkmtbXw7ruNB0JlZf3te/UKIXDssXDBBWF5xIhwXVISAkOyYM/mEAiJPYdNc6F2T7iv25EwaHrYa+g7GbqNrDsDryldDodjvgdjvwPv/BGW/wxe+yYsuAEOvyjsbRRPzOy5Wij9OYocgKoqeOut+iGQWH7rrXBGb0JBAQwZEr78zzuvLggSl1694nsfbYY7VL0FG8pgY9SktC0anq5dEfQ6Ho76CvSZDH1Pho6HOCJCQXsY+qlw2boIlt8Lbz0YLr2ODaExdAYUdkn/XC2MwkKkAe7wxhswezYsXFgXCO+9V3+77t1DCIwdC+eeWz8QhgxRU1HO1dbA1gUhHCqjgNi1LtxX1CPsLQz9dNhz6H0CFHbKXi09x8IJ98CE22H178LexitXwGvXwLDPhqatHqOy9/rNTGEhEtm8GZ5+OgTEU0/Buug7ZsiQEAJnn12/qWj48HAWcituWWja3q2w9Q3YujBctiwMHb/tCqCgCxR2Dr+QC7tEt5MvnRtYl9i2c8Pr23U48A+zegdsfCmpSemlcFgrQJeh0P+0uialHkfH0+lc1C30XxzxhVDj8nthxb2w7C7o/+Gwt1EyPezptGAKiyw79dRTuf766znjjDM+WPeTn/yEZcuW8bOf/azBx3Tt2pWdjQ2SI81m3z6YO7cuHF55JfQ79OoFH/lIOMLoox+FQYPirjTLamtgx/L6obB1Ibz/dt027XtBz2NCEwoWvpATl31VsKcSqlbX3a6pgn0HOGOjtds/SApSAiixzqtDSGxdAF4bHtvzGBh+WQiGvpOhc0lzfkqHzgz6TQmX3f8NK38FK34BZZ+ATgNhxBVwxBUtr+6IwiLLZsyYwaxZs+qFxaxZs/jRj34UY1Vt17p1deHw9NNhb8IMJk6Eb387BMQJJ4T+hry0e2NdKGxdCFsWwLbFdR28VgDdR4Uv255fgl7HQM/x0OmwA//VX7sP9u2qHyA1VVDzfv2gSV2fum5fFby/qX5AAfQuhaO/HWrtMyn8gm8tOvaDo6+H0dfCur+GvY1F34XF3wt7GSO/FPaKWtDhtwqLLLvwwgu54YYb2LNnDx06dGD16tWsXbuWCRMmMHXqVLZs2UJ1dTW33nor06dPj7vcvLN3L5SXh3B46qnQ/wDh0NNzzw3hcPrpYXTQvLJvb2gySg6GrQvr2u8hnEzWczwceVW47jUeuo+Ggg7NU0O7AmjXFYq6Ns/z5aN2BTDo7HDZuQqW/wJW/SocUdXtyOjw20vDnl3M2k5YzP8abGnmMcp7TYDjmx6hsLi4mIkTJ/LUU08xffp0Zs2axUUXXUSnTp14/PHH6d69Oxs3bmTSpEmce+65mkO7GaxaVRcOf/97OIKpqAimTIEf/CAExLhxedLX4B4CIDUUti0FjwaabNc+tNcP+GhdKPQYB536x1u71Nd1OBz7Axh/M7z9WOgQf/VqWPCfcPiMsLdRnPZE66xpO2ERo0RTVCIsZs6cibvzrW99i+eee4527drx7rvv8t577zFgwIC4y211qqrg2WdDOMyeDcuXh/XDhsFnPwtnnAEf/jB0a6qVwh12rw+/xrctDdfbo+vqneHM3XqXTuG6Xer6pu7rVP92uzT3tUtpC6vZBduXRH0KC+qCIXECGUDnwSEQDju7Lhi6jWzxnaeSpKAjDLskXLa8Hh1++1tYNTMcwTXyS+HcjcIcTI+XpO2ERZo9gGw677zzuPrqqz+YCe+4447j17/+NZWVlcyfP5+ioiKGDh3a4LDksj93WLy4Lhyeey40N3XuHELhK18Jew9HHNHA3kNtDex8qy4Iti+FbdF1ddLEC4VdQ5NMvw9D+56hs3bfbqjdXbe8bzdUVzZ+nx/iEPJWWBck7YpCmHk0CXNBZ+g5DkrOrwuFnuNaRHOFNKNeE2DiL2DCD+Gth8LexsuXwWvfCGeHH/FF6D4yJ6W0nbCIUdeuXTn11FO57LLLmDFjBhBmvevXrx9FRUU888wzrFmzJuYqI1sWhMMQ2/cOnXAd+kbXfaBdfH8uW7bA3/5WFxDvvhvWjx1bFw5TpiQNkV1TBVuW1YXCtqVhecdyqE06c67jAOgxOhx7331UWO4++uA6dFPV1jQeJPXW7dr/vv3u3xP2GnqND+HQdXiL6vyULGvfA466Co78Mmx4LoTGm3fBP38MAz4S9jZKzstq26rCIkdmzJjB+eefz6xZswD49Kc/zTnnnENpaSkTJkxg1KgYT86p3g6rHw7j2mye1/h2iQCpFyL9oGPKcod+0KH3IX2Z1dbCvHl1Ry699FJY17Nn6JCeNi00L5X0qawLhMVJewtVSeFr7cJYPd1HwWFnRYEwKlza9zzoGtNqV6gOXmleZtD/lHDZta7u8Nt//hgGfzy7L60hyvNPRu/bPYyPs/J+WPMo7Hs/NGOMuAJKzg2HLO7eAHs2wO7K+st7NkS3K+u3lyezdmFvpENKuDS2XNSDWjdeegkeeQT+8IdwmKsZnFBay0XnrGHaSUs5auA/Kdi5tC4gkl+/oFNdCHQfXRcK3UY23xE+Ii1NbU34/9j5sIN6uIYol4btrgxtnyvvD1+4hV1DE8yIy6H4hPq7sT0yCNraGtizMQTH7qQQSV3ePD8sVzc8IXNNbREbd/Sl05Z+nN2lH+d/pS+HD9lHSfelFL7/ZmiO2UC4dOgTwmDwBfWDofNgNc1I29Ou8KCD4kAoLNoCr4X1c2DlL6HiT1BbDX1OghN/BUM+eWjNJO0KodOAcMnEvj347kqWv1FJ+d83sGjeBnx3JQN7bWDCqA2MHl7J+F4bKKheBhh0HQWDpoZASOw1dOxz8PWKyEHJ+7Bw9zZ17kK9ZsX3K2DlA+Ekn6o1oc9h5JdhxOfDIGc5tmQJPPJIBx55pIQ33yyhoACmToWLLoKPf1yjsIq0ZHkdFh07dmTTpk0UFxe3icBwdzZt3EhH3wrPngXrngp7FQNOhwk/CEdL5LjtfsWK0AcxaxYsWhRauU49Fb7+dTj/fOjbN6fliMhByuuwKCkpoaKigsrUWWfyUW011OykY9UblLxzPbTvBGOuhxGXhcMsc2j1anj00RASr74a1k2eDHfdBRdeGKYDFZHWJa/DoqioiGHDhsVdRvbU7ApjyKz8JWz4RxgE7rCzYMqDMHBaTs+LqKgIRzA98gi8/HJYN3Ei/Nd/wSc+EaYCFZHWK6/DIm9tWRgC4q3fQvXWsOdwzG1hQpUcHBWR8N578NhjoYmprCysmzABbr89zBudzzkt0tYoLFqL6u2wZhasuB82zw2Dww2+IIx/3++UnB0yunEj/PGPYQ/i2WfDiXJHHw233BI6qo88MidliEiOKSxaMvcwwcvKX8KaR8KJcz3GwvF3hnMjOuRmXO2tW+Hxx0NA/O1vYdKgI4+E//zPEBBHH52TMkQkRgqLlmj3RlgdnTi3bUmYHWzoxeHs6tQT57Jkxw544onQxDR7NlRXw9Ch8M1vhoA45pg8GeJbRDKS1bAws2nAnUABcL+7355y/+HATKAvsBm4xN0rzGwCcC/QHdgHfM/dH8lmrbFzh/fmwIrEiXN7oXgSnHh/dOJcbmYB+8c/wlFLTz4Ju3dDSUkYqO+ii8IMcgoIkbYpa2FhZgXAPcBHgApgrpk94e5Lkja7A3jQ3X9jZqcB3wc+A7wP/Ku7Lzezw4D5Zjbb3bdmq97YuMP6p2HBDaEvon3vMILkiMtzeuLcCy/AjTfCnDnQrx9ccUUIiJNOgnYaQUOkzcvmnsVEYIW7rwIws1nAdCA5LMYAX4+WnwH+BODuyxIbuPtaM9tA2PvIr7DY8HyYBavyeeg8JOxFDP10mMMgR+bNC3NPP/VUCIn//m/4whegU6eclSAirUA2fzMOAt5Jul0RrUu2ALggWv440M3M6vXamtlEoD2wMvUFzOxKM5tnZvNa1Yl3m+bCM9Pgb/8S5lcovRvOWRaG4chRUCxYANOnh6aluXPDdKOrVsHXvqagEJH9ZTMsGmrdTh0P/RrgFDN7DTgFeBf4YHoxMxsIPAR8zj0xRVjSk7nf5+6l7l7atzWMG7F1ETz3cZg9MQTGhB/CuSvDhCY5GoZj8eJwktyECWGGue9+N4TEtddCly45KUFEWqFsNkNVAMnn7ZYAa5M3cPe1wPkAZtYVuMDdt0W3uwP/C9zg7i9lsc7s274c3vhOOE+iqBuMuxlGfQ2KuueshGXL4Oab4eGHoWvX0PR09dVhMiERkXSyGRZzgZFmNoywx/Ap4OLkDcysD7A52mu4nnBkFGbWHnic0Pn9hyzWmF1Va2DRd2HVr8NJdGOuhdHfzNn5ERD2Gr77XXjwwTDl6LXXhsNfi3NXgojkgayFhbvXmNlVwGzCobMz3X2xmd0CzHP3J4BTge+bmQPPAV+OHv5J4F+AYjO7NFp3qbu/nq16m9Wu9bD4e7DivnB75Jfh6Oszn/OhGbz9Ntx6KzzwABQWhr6Ia6+F/v1zVoKI5JG8nlY15/ZsgiU/hGU/DedJDL8Mxt4AXYbkrIS1a+G22+CXvwy3r7wSrr8eDsvdkFEi0opoWtVcqt4OS38cJk2v2RnOth53E3Q7ImclbNgQBvC7916oqYHLLgvDcQzJXU6JSB5TWByKmipYdg8s+QHs3QyDz4dxt0DP3A2WtGkT/OhH8NOfhjOu//VfQ+f18NxOYSEieU5hcTD27Qn9EYu/B7vfg4FnwjHfhd7H56yErVvhxz8OJ9FVVcHFF4czsDXqq4hkg8LiQNRWw6rfwKJb4P13wtDgUx6DflNyVsL27XDnnWFSoW3bwjkTN90EY8bkrAQRaYMUFpmo3QdvPwILvwM7V0DxRJg0E/pPzdnIelVVcPfd8MMfwubN4ezrm28Oo7+KiGSbwqIp7mEE2IXfhm2Loed4+Jc/w6BzchYSu3bBz38eOq83bIAzzwwTDZWmPXZBRKT5KCwa4g7rZsPCG2DzfOh2JEyeBUM+kbMZ6fbsgfvvD4fBrl0LU6eGk+tOOiknLy8iUo/CItWG58Jw4ZXPQ5fD4cSZMOwz0C43H1V1dTiR7tZb4Z134EMfgt//Hk45JScvLyLSIIVFwqa5ISTW/x90Ggil94Q5JQra5+Tl3eGhh0Jn9VtvwaRJMHNm2KPQhEMiEjeFxftrYd6/QcWfw5hNx94RJh8q7JzTMubMgc9+Fo47LnRkn3mmQkJEWg6FRVH3MM/1uFuikWBzM31pqjlzwhhOzz8PnXObUyIiaSksirrCWUuhXUGsZZSXh70KBYWItESaXRliD4o9e+CVV2BK7s7tExE5IAqLFuDVV0NgTJ4cdyUiIg1TWLQAZWXhWmEhIi2VwqIFKC+HI47QxEQi0nIpLGLmHsJC/RUi0pIpLGK2bBls3KgmKBFp2RQWMUv0V2jPQkRaMoVFzMrLobgYjjoq7kpERBqnsIhZWVlogtLQHiLSkiksYrRhAyxfrv4KEWn5FBYxKi8P1+qvEJGWTmERo/Jy6NABjj8+7kpERJqmsIhRWRmccEIIDBGRlkxhEZP33w9jQqkJSkRaA4VFTObODVOoqnNbRFqDrIaFmU0zszfNbIWZXdfA/Yeb2RwzW2hmz5pZSdJ9T5nZVjP7SzZrjEviZLyTT463DhGRTGQtLMysALgHOBMYA8wwszEpm90BPOju44FbgO8n3fcj4DPZqi9u5eUwZgz07h13JSIi6WVzz2IisMLdV7n7XmAWMD1lmzHAnGj5meT73X0OsCOL9cWmthZeeEH9FSLSemQzLAYB7yTdrojWJVsAXBAtfxzoZmbFmb6AmV1pZvPMbF5lZeUhFZtLixfDtm3qrxCR1iObYdHQABaecvsa4BQzew04BXgXqMn0Bdz9PncvdffSvn37HnylOabBA0WktSnM4nNXAIOTbpcAa5M3cPe1wPkAZtYVuMDdt2WxphahvBwGDIBhw+KuREQkM9ncs5gLjDSzYWbWHvgU8ETyBmbWx8wSNVwPzMxiPS1GWVnYq9DggSLSWmQtLNy9BrgKmA0sBR5198VmdouZnRttdirwppktA/oD30s83syeB/4ATDWzCjM7I1u15lJFBaxZo/4KEWldstkMhbs/CTyZsu7GpOXHgMcaeeyHsllbXDR4oIi0Rmn3LMzsKjPrlYti2oLycujcGY45Ju5KREQyl0kz1ABgrpk9Gp2RrZb2Q1BWBpMmQVFR3JWIiGQubVi4+w3ASOBXwKXAcjO7zcxGZLm2vLNjByxYoP4KEWl9MurgdncH1keXGqAX8JiZ/TCLteWdl14KZ2+rv0JEWpu0Hdxm9u/AZ4GNwP3AN929OjrkdTlwbXZLzB/l5dCuXWiGEhFpTTI5GqoPcL67r0le6e61ZnZ2dsrKT2VlMH48dO8edyUiIgcmk2aoJ4FPB4ySAAARSklEQVTNiRtm1s3MTgRw96XZKizf1NSEZij1V4hIa5RJWNwL7Ey6XRWtkwOwYAFUVam/QkRap0zCwqIObiA0P5Hlk/nyUeJkPO1ZiEhrlElYrDKzfzezoujyVWBVtgvLN2VlMGQIDB6cflsRkZYmk7D4InAyYfjwCuBE4MpsFpVv3MOehZqgRKS1Stuc5O4bCCPGykFavRrWrlUTlIi0XpmcZ9ER+DxwNNAxsd7dL8tiXXlFgweKSGuXSTPUQ4Txoc4A/kGYxCgv58bOlrKycG7F0UfHXYmIyMHJJCyOcPdvA1Xu/hvgLGBcdsvKL+XlcPLJUFAQdyUiIgcnk7Cojq63mtlYoAcwNGsV5ZktW2DRIvVXiEjrlsn5EvdF81ncQJgWtSvw7axWlUdeeCFcq79CRFqzJsMiGixwu7tvAZ4DhuekqjxSXg6FhTBxYtyViIgcvCaboaKzta/KUS15qawMjjsuzI4nItJaZdJn8bSZXWNmg82sd+KS9crywJ49MHeu+itEpPXLpM8icT7Fl5PWOWqSSuvVV2H3bvVXiEjrl8kZ3MNyUUg+0uCBIpIvMjmD+18bWu/uDzZ/OfmlrAyOOAL694+7EhGRQ5NJM9QJScsdganAq4DCogmJwQPPOivuSkREDl0mzVBfSb5tZj0IQ4BIE5Ytg40b1V8hIvkhk6OhUr0PjGzuQvKN+itEJJ9k0mfx/whHP0EIlzHAo9ksKh+UlUFxMYwaFXclIiKHLpM+izuSlmuANe5ekcmTm9k04E6gALjf3W9Puf9wYCbQF9gMXJJ4bjP7LGGIEYBbo0EMW43E4IFmcVciInLoMmmGeht42d3/4e7lwCYzG5ruQWZWANwDnEnYG5lhZmNSNrsDeNDdxwO3AN+PHtsb+A5hVr6JwHei8alahQ0bQp+F+itEJF9kEhZ/AGqTbu+L1qUzEVjh7qvcfS8wC5iess0YYE60/EzS/WcAT7v75mhcqqeBaRm8ZouQGDxQ/RUiki8yCYvC6MsegGi5fQaPGwS8k3S7IlqXbAFwQbT8caCbmRVn+FjM7Eozm2dm8yorKzMoKTfKyqBDBygtjbsSEZHmkUlYVJrZuYkbZjYd2JjB4xpqrfeU29cAp5jZa8ApwLuEfpFMHou73+fupe5e2rdv3wxKyo3y8hAUHTrEXYmISPPIJCy+CHzLzN42s7eB/wC+kMHjKoDBSbdLgLXJG7j7Wnc/392PBf4zWrctk8e2VLt2wfz56q8QkfySyUl5K4FJZtYVMHfPdP7tucBIMxtG2GP4FHBx8gZm1gfYHA2Ffj3hyCiA2cBtSZ3aH43ub/HmzoXqaoWFiOSXtHsWZnabmfV0953uvsPMepnZreke5+41hLkwZgNLgUfdfbGZ3ZLUrHUq8KaZLQP6A9+LHrsZ+C4hcOYCt0TrWryysnB98snx1iEi0pzMfb+ugPobmL0WNRMlr3vV3Y/LamUHqLS01OfNmxd3GZx1FqxeDYsXx12JiEh6Zjbf3dMejpNJn0WBmX3QVWtmnQB13TagtjYcNqtDZkUk32RyBvdvgTlm9kB0+3NAqzqbOleWLIGtW9VfISL5J5MO7h+a2ULgdMIhrU8Bh2e7sNYo0V+hPQsRyTeZjjq7nnAW9wWE+SyWZq2iVqy8HAYMgOGacFZE8kyjexZmdiThcNcZwCbgEUKH+IdzVFurU1YW9io0eKCI5Jum9iz+SdiLOMfdp7j7TwnjQkkD3n03HAWl/goRyUdNhcUFhOanZ8zsl2Y2lYaH4RA02ZGI5LdGw8LdH3f3i4BRwLPA14H+ZnavmX00R/W1GmVl0LkzTJgQdyUiIs0vbQe3u1e5++/c/WzCGE2vA9dlvbJWprwcTjwRiorirkREpPkd0Bzc0fwSv3D307JVUGu0Ywe8/rr6K0Qkfx1QWEjDXn45nL2t/goRyVcKi2ZQVgbt2sFJJ8VdiYhIdigsmkF5OYwbB927x12JiEh2KCwOUU0NvPii+itEJL8pLA7RwoVQVaX+ChHJbwqLQ5QYPFB7FiKSzxQWh6i8HAYPDhcRkXylsDgE7mHPQnsVIpLvFBaHYM0aWLtW/RUikv8UFodA/RUi0lYoLA5BeXk4t2Ls2LgrERHJLoXFISgrC2dtFxTEXYmISHYpLA7Sli2weLGaoESkbVBYHKQXXwxHQ6lzW0TaAoXFQSovh8JCmDgx7kpERLJPYXGQysrg2GOhS5e4KxERyT6FxUHYuxdeeUX9FSLSdmQ1LMxsmpm9aWYrzGy/qVjNbIiZPWNmr5nZQjP7WLS+vZk9YGZvmNkCMzs1m3UeqFdfhd271V8hIm1H1sLCzAqAe4AzgTHADDMbk7LZDcCj7n4s8CngZ9H6KwDcfRzwEeC/zKzF7AUlTsZTWIhIW5HNL+CJwAp3X+Xue4FZwPSUbRxITBnUA1gbLY8B5gC4+wZgK1CaxVoPSHk5jBgBAwbEXYmISG5kMywGAe8k3a6I1iW7CbjEzCqAJ4GvROsXANPNrNDMhgHHA/uN62pmV5rZPDObV1lZ2dz1N8g9hIX6K0SkLclmWFgD6zzl9gzg1+5eAnwMeChqbppJCJd5wE+AF4Ca/Z7M/T53L3X30r59+zZr8Y1ZvhwqK9UEJSJtS2EWn7uC+nsDJdQ1MyV8HpgG4O4vmllHoE/U9PT1xEZm9gKwPIu1ZkyDB4pIW5TNPYu5wEgzG2Zm7Qkd2E+kbPM2MBXAzEYDHYFKM+tsZl2i9R8Batx9SRZrzVh5OfTuDUcdFXclIiK5k7U9C3evMbOrgNlAATDT3Reb2S3APHd/AvgG8Esz+zqhiepSd3cz6wfMNrNa4F3gM9mq80CVlYUmqHYt5tgsEZHsy2YzFO7+JKHjOnndjUnLS4D9Wv/dfTXQ4n67V1bCsmVw2WVxVyIiklv6fXwAysvDtforRKStUVgcgPJyaN8ejj8+7kpERHJLYXEAysrghBOgY8e4KxERyS2FRYZ27YL583V+hYi0TQqLDM2dC9XV6q8QkbZJYZGhROf2ySfHW4eISBwUFhkqK4PRo6G4OO5KRERyT2GRgdpaeOEFNUGJSNulsMjAkiWwdas6t0Wk7VJYZEAn44lIW6ewyEBZGfTvD8OHx12JiEg8FBYZSEx2ZA3N0CEi0gYoLNJYuxbeekv9FSLStiks0lB/hYiIwiKtsjLo3BkmTIi7EhGR+Cgs0igvhxNPhKKiuCsREYmPwqIJO3bAa6+pv0JERGHRhJdfDmdvq79CRNo6hUUTysvD4bKTJsVdiYhIvBQWTSgrg/HjoUePuCsREYmXwqIRNTXw0kvqrxARAYVFoxYuhJ071V8hIgIKi0YlTsbTnoWIiMKiUWVlMHgwDBkSdyUiIvFTWDTAPYSF9ipERAKFRQPWrAkDCKq/QkQkyGpYmNk0M3vTzFaY2XUN3D/EzJ4xs9fMbKGZfSxaX2RmvzGzN8xsqZldn806U6m/QkSkvqyFhZkVAPcAZwJjgBlmNiZlsxuAR939WOBTwM+i9Z8AOrj7OOB44AtmNjRbtaYqK4Nu3WDcuFy9oohIy5bNPYuJwAp3X+Xue4FZwPSUbRzoHi33ANYmre9iZoVAJ2AvsD2LtdZTXg4nnwwFBbl6RRGRli2bYTEIeCfpdkW0LtlNwCVmVgE8CXwlWv8YUAWsA94G7nD3zakvYGZXmtk8M5tXWVnZLEVv3QqLFqkJSkQkWTbDoqFJSD3l9gzg1+5eAnwMeMjM2hH2SvYBhwHDgG+Y2X4zYLv7fe5e6u6lffv2bZaiX3wxHA2lzm0RkTrZDIsKYHDS7RLqmpkSPg88CuDuLwIdgT7AxcBT7l7t7huAcqA0i7V+oKwsND9NnJiLVxMRaR2yGRZzgZFmNszM2hM6sJ9I2eZtYCqAmY0mhEVltP40C7oAk4B/ZrHWD5SXw3HHQZcuuXg1EZHWIWth4e41wFXAbGAp4ainxWZ2i5mdG232DeAKM1sAPAxc6u5OOIqqK7CIEDoPuPvCbNWasHdvmMNC/RUiIvUVZvPJ3f1JQsd18robk5aXAPt9Nbv7TsLhszn12muwe7f6K0REUukM7iRlZeFaexYiIvUpLJKUl8OIETBgQNyViIi0LAqLiAYPFBFpnMIismIFVFaqv0JEpCEKi4j6K0REGqewiJSXQ+/eMGpU3JWIiLQ8CotIWVkYPLCdPhERkf3oq5HQV/Hmm+qvEBFpjMICeOGFcK3+ChGRhiksCE1Q7dtDaU6GKhQRaX0UFoTO7dJS6Ngx7kpERFqmNh8Wu3bBvHnqrxARaUqbD4vt2+ETn4CPfjTuSkREWq6sjjrbGvTvD7/7XdxViIi0bG1+z0JERNJTWIiISFoKCxERSUthISIiaSksREQkLYWFiIikpbAQEZG0FBYiIpKWuXvcNTQLM6sE1hzCU/QBNjZTOa2dPov69HnUp8+jTj58Foe7e990G+VNWBwqM5vn7hp3Fn0WqfR51KfPo05b+izUDCUiImkpLEREJC2FRZ374i6gBdFnUZ8+j/r0edRpM5+F+ixERCQt7VmIiEhaCgsREUmrzYeFmU0zszfNbIWZXRd3PXEys8Fm9oyZLTWzxWb21bhripuZFZjZa2b2l7hriZuZ9TSzx8zsn9HfyElx1xQnM/t69P9kkZk9bGYd464pm9p0WJhZAXAPcCYwBphhZmPirSpWNcA33H00MAn4chv/PAC+CiyNu4gW4k7gKXcfBRxDG/5czGwQ8O9AqbuPBQqAT8VbVXa16bAAJgIr3H2Vu+8FZgHTY64pNu6+zt1fjZZ3EL4MBsVbVXzMrAQ4C7g/7lriZmbdgX8BfgXg7nvdfWu8VcWuEOhkZoVAZ2BtzPVkVVsPi0HAO0m3K2jDX47JzGwocCzwcryVxOonwLVAbdyFtADDgUrggahZ7n4z6xJ3UXFx93eBO4C3gXXANnf/v3iryq62HhbWwLo2fyyxmXUF/gf4mrtvj7ueOJjZ2cAGd58fdy0tRCFwHHCvux8LVAFtto/PzHoRWiGGAYcBXczskniryq62HhYVwOCk2yXk+a5kOmZWRAiK37n7H+OuJ0aTgXPNbDWhefI0M/ttvCXFqgKocPfEnuZjhPBoq04H3nL3SnevBv4InBxzTVnV1sNiLjDSzIaZWXtCB9UTMdcUGzMzQpv0Unf/cdz1xMndr3f3EncfSvi7+Lu75/Uvx6a4+3rgHTM7Klo1FVgSY0lxexuYZGado/83U8nzDv/CuAuIk7vXmNlVwGzC0Qwz3X1xzGXFaTLwGeANM3s9Wvctd38yxpqk5fgK8Lvoh9Uq4HMx1xMbd3/ZzB4DXiUcRfgaeT70h4b7EBGRtNp6M5SIiGRAYSEiImkpLEREJC2FhYiIpKWwEBGRtBQWIgfAzPaZ2etJl2Y7i9nMhprZouZ6PpHm1KbPsxA5CLvcfULcRYjkmvYsRJqBma02sx+Y2SvR5Yho/eFmNsfMFkbXQ6L1/c3scTNbEF0SQ0UUmNkvo3kS/s/MOsX2pkSSKCxEDkynlGaoi5Lu2+7uE4G7CSPWEi0/6O7jgd8Bd0Xr7wL+4e7HEMZYSowcMBK4x92PBrYCF2T5/YhkRGdwixwAM9vp7l0bWL8aOM3dV0WDMa5392Iz2wgMdPfqaP06d+9jZpVAibvvSXqOocDT7j4yuv0fQJG735r9dybSNO1ZiDQfb2S5sW0asidpeR/qV5QWQmEh0nwuSrp+MVp+gbrpNj8NlEXLc4AvwQfzfHfPVZEiB0O/WkQOTKekEXkhzEmdOHy2g5m9TPgRNiNa9+/ATDP7JmGmucRIrV8F7jOzzxP2IL5EmHFNpEVSn4VIM4j6LErdfWPctYhkg5qhREQkLe1ZiIhIWtqzEBGRtBQWIiKSlsJCRETSUliIiEhaCgsREUnr/wOS8etIccPD/AAAAABJRU5ErkJggg==\n",
      "text/plain": [
       "<Figure size 432x288 with 1 Axes>"
      ]
     },
     "metadata": {
      "needs_background": "light"
     },
     "output_type": "display_data"
    },
    {
     "data": {
      "image/png": "iVBORw0KGgoAAAANSUhEUgAAAYsAAAEWCAYAAACXGLsWAAAABHNCSVQICAgIfAhkiAAAAAlwSFlzAAALEgAACxIB0t1+/AAAADl0RVh0U29mdHdhcmUAbWF0cGxvdGxpYiB2ZXJzaW9uIDMuMC4yLCBodHRwOi8vbWF0cGxvdGxpYi5vcmcvOIA7rQAAIABJREFUeJzt3Xt8XHWd//HXJ0nTtEkvkLZceqFXpDcIJdBmVKiIWgRb3EVphf2pLIsoLLro/kTWdflVd2VdFy8/8cIq8PDHpSIuWlmkslxEBFrS0lra0qWUtqT3lt7vST6/P74nzTQkmUkyMyeZeT8fj3nMmTPnzPnMpJ33fL/fczF3R0REpD1FcRcgIiLdn8JCRERSUliIiEhKCgsREUlJYSEiIikpLEREJCWFheSEmRWb2X4zG5HJZeNkZmPNLOP7npvZJWa2LunxajN7bzrLdmJbPzWz2zq7fjuv+w0zuy/TryvxKYm7AOmezGx/0sO+wBGgIXr8GXd/oCOv5+4NQEWmly0E7v6uTLyOmV0HXOPu05Ne+7pMvLbkP4WFtMrdj39ZR79cr3P3/25reTMrcff6XNQmIrmnbijplKib4Rdm9pCZ7QOuMbMaM3vJzHab2WYz+76Z9YqWLzEzN7OR0eP7o+d/Z2b7zOxFMxvV0WWj5y81s/8xsz1m9n/N7E9m9qk26k6nxs+Y2Roz22Vm309at9jMvmNmO83sDWBGO5/PV81sXot5d5nZndH0dWa2Kno/b0S/+tt6rTozmx5N9zWz/xfVtgI4r5Xtro1ed4WZzYzmTwZ+ALw36uLbkfTZ3p60/g3Re99pZr82s9PS+WxSMbMronp2m9nTZvaupOduM7NNZrbXzF5Leq/TzGxJNH+rmf1butuTLHB33XRr9wasAy5pMe8bwFHgI4QfHX2A84GphBbraOB/gJui5UsAB0ZGj+8HdgDVQC/gF8D9nVh2CLAPmBU9dwtwDPhUG+8lnRp/AwwARgJvN7134CZgBTAMqASeC/+FWt3OaGA/UJ702tuA6ujxR6JlDLgYOAScHT13CbAu6bXqgOnR9LeBZ4GTgDOAlS2W/ThwWvQ3+URUwynRc9cBz7ao837g9mj6g1GNVUAZ8EPg6XQ+m1be/zeA+6Lp8VEdF0d/o9uiz70XMBFYD5waLTsKGB1NvwzMiab7AVPj/r9QyDe1LKQrnnf337p7o7sfcveX3X2hu9e7+1rgbuCidtZ/xN1r3f0Y8ADhS6qjy14OLHX330TPfYcQLK1Ks8Zvuvsed19H+GJu2tbHge+4e5277wTuaGc7a4FXCSEG8AFgt7vXRs//1t3XevA08BTQ6iB2Cx8HvuHuu9x9PaG1kLzdh919c/Q3eZAQ9NVpvC7A1cBP3X2pux8GbgUuMrNhScu09dm0ZzYw392fjv5GdwD9CaFdTwimiVFX5pvRZwch9MeZWaW773P3hWm+D8kChYV0xVvJD8zsLDP7LzPbYmZ7gbnAoHbW35I0fZD2B7XbWvb05Drc3Qm/xFuVZo1pbYvwi7g9DwJzoulPEEKuqY7LzWyhmb1tZrsJv+rb+6yanNZeDWb2KTNbFnX37AbOSvN1Iby/46/n7nuBXcDQpGU68jdr63UbCX+joe6+Gvgi4e+wLerWPDVa9NPABGC1mS0ysw+n+T4kCxQW0hUtdxv9CeHX9Fh37w98jdDNkk2bCd1CAJiZceKXW0tdqXEzMDzpcapde38BXBL9Mp9FCA/MrA/wCPBNQhfRQOD3adaxpa0azGw08CPgs0Bl9LqvJb1uqt18NxG6tpperx+hu2tjGnV15HWLCH+zjQDufr+7v5vQBVVM+Fxw99XuPpvQ1fjvwK/MrKyLtUgnKSwkk/oBe4ADZjYe+EwOtvkYMMXMPmJmJcDngcFZqvFh4AtmNtTMKoEvt7ewu28FngfuBVa7++vRU72BUmA70GBmlwPv70ANt5nZQAvHodyU9FwFIRC2E3LzOkLLoslWYFjTgH4rHgL+2szONrPehC/tP7p7my21DtQ808ymR9v+e8I400IzG29m74u2dyi6NRDewF+Z2aCoJbInem+NXaxFOklhIZn0ReCThC+CnxB+WWdV9IV8FXAnsBMYA7xCOC4k0zX+iDC2sJww+PpIGus8SBiwfjCp5t3A3wGPEgaJrySEXjr+idDCWQf8Dvh50uv+Gfg+sCha5iwguZ//SeB1YKuZJXcnNa3/BKE76NFo/RGEcYwucfcVhM/8R4QgmwHMjMYvegPfIowzbSG0ZL4arfphYJWFve2+DVzl7ke7Wo90joUuXpH8YGbFhG6PK939j3HXI5Iv1LKQHs/MZpjZgKgr4x8Je9gsirkskbyisJB88B5gLaErYwZwhbu31Q0lIp2gbigREUlJLQsREUkpb04kOGjQIB85cmTcZYiI9CiLFy/e4e7t7W4O5FFYjBw5ktra2rjLEBHpUcws1ZkIAHVDiYhIGhQWIiKSksJCRERSypsxCxGRjjh27Bh1dXUcPnw47lJyoqysjGHDhtGrV1unBmufwkJEClJdXR39+vVj5MiRhJMV5y93Z+fOndTV1TFq1KjUK7RC3VAiUpAOHz5MZWVl3gcFgJlRWVnZpVaUwkJEClYhBEWTrr7Xgg+Lt9+GuXNhyZK4KxER6b4KPiyKi+H22+GxdK8mICKSATt37qSqqoqqqipOPfVUhg4devzx0aPpXbbj05/+NKtXr85ypUHBD3APGACTJsELL8RdiYgUksrKSpYuXQrA7bffTkVFBV/60pdOWMbdcXeKilr/XX/vvfdmvc4mBd+yAEgk4MUXoVEXbBSRmK1Zs4ZJkyZxww03MGXKFDZv3sz1119PdXU1EydOZO7cuceXfc973sPSpUupr69n4MCB3HrrrZxzzjnU1NSwbdu2jNZV8C0LgJoa+MlPYOXK0MoQkcLyhS9A9CM/Y6qq4Lvf7dy6K1eu5N577+XHP/4xAHfccQcnn3wy9fX1vO997+PKK69kwoQJJ6yzZ88eLrroIu644w5uueUW7rnnHm699dauvo3j1LIgtCwgtC5EROI2ZswYzj///OOPH3roIaZMmcKUKVNYtWoVK1eufMc6ffr04dJLLwXgvPPOY926dRmtSS0LYOxYGDQojFv8zd/EXY2I5FpnWwDZUl5efnz69ddf53vf+x6LFi1i4MCBXHPNNa0eL1FaWnp8uri4mPr6+ozWpJYFYBZaFxrkFpHuZu/evfTr14/+/fuzefNmFixYEEsdallEampg/nzYsSO0MkREuoMpU6YwYcIEJk2axOjRo3n3u98dSx15cw3u6upq78rFj557Di66CH77W7j88gwWJiLd0qpVqxg/fnzcZeRUa+/ZzBa7e3WqddUNFamuhpISdUWJiLRGYRHp2xfOPVdhISLSGoVFkkQCFi2CY8firkREpHtRWCSpqYFDh2DZsrgrERHpXhQWSXRwnohI6xQWSYYPh2HDNG4hItKSwqIFHZwnIrkwffr0dxxg993vfpfPfe5zba5TUVGR7bLalNWwMLMZZrbazNaYWZtntDKzK83Mzaw6ejzSzA6Z2dLo9uNs1pkskYANG6CuLldbFJFCNGfOHObNm3fCvHnz5jFnzpyYKmpf1sLCzIqBu4BLgQnAHDOb0Mpy/YCbgYUtnnrD3aui2w3ZqrOlmppwr3ELEcmmK6+8kscee4wjR44AsG7dOjZt2kRVVRXvf//7mTJlCpMnT+Y3v/lNzJUG2TzdxwXAGndfC2Bm84BZQMvTJX4d+BbwJbqBqiooKwth8bGPxV2NiOTE4i/Argyfo/ykKjiv7TMUVlZWcsEFF/DEE08wa9Ys5s2bx1VXXUWfPn149NFH6d+/Pzt27GDatGnMnDkz9uuFZ7MbaijwVtLjumjecWZ2LjDc3Vu7qOkoM3vFzP5gZu9tbQNmdr2Z1ZpZ7fbt2zNSdGkpnH++xi1EJPuSu6KauqDcndtuu42zzz6bSy65hI0bN7J169aYK81uy6K1GDx+IiozKwK+A3yqleU2AyPcfaeZnQf82swmuvveE17M/W7gbgjnhspU4YkE3HlnOOaiT59MvaqIdFvttACy6YorruCWW25hyZIlHDp0iClTpnDfffexfft2Fi9eTK9evRg5cmSrpyTPtWy2LOqA4UmPhwGbkh73AyYBz5rZOmAaMN/Mqt39iLvvBHD3xcAbwJlZrPUENTXhKO7Fi3O1RREpRBUVFUyfPp1rr732+MD2nj17GDJkCL169eKZZ55h/fr1MVcZZDMsXgbGmdkoMysFZgPzm5509z3uPsjdR7r7SOAlYKa715rZ4GiAHDMbDYwD1max1hNokFtEcmXOnDksW7aM2bNnA3D11VdTW1tLdXU1DzzwAGeddVbMFQZZ64Zy93ozuwlYABQD97j7CjObC9S6+/x2Vr8QmGtm9UADcIO7v52tWlsaMiRcPU/jFiKSbR/96EdJvlTEoEGDeLGNX6r79+/PVVnvkNWLH7n748DjLeZ9rY1lpydN/wr4VTZrSyWRgCeeAPdwJT0RkUKmI7jbkEjAtm2wNmedXyIi3ZfCog1N4xbqihLJX/lypdB0dPW9KizaMHEi9OunQW6RfFVWVsbOnTsLIjDcnZ07d1JWVtbp18jqmEVPVlwM06apZSGSr4YNG0ZdXR2ZOqC3uysrK2PYsGGdXl9h0Y5EAr7+ddi7F/r3j7saEcmkXr16MWrUqLjL6DHUDdWOmhpobAyXWhURKWQKi3ZMnRp2m1VXlIgUOoVFOwYODAPdGuQWkUKnsEghkQhh0dgYdyUiIvFRWKSQSMCePbBqVdyViIjER2GRgg7OExFRWKQ0bhxUVmrcQkQKm8IiBbPQFaWWhYgUMoVFGhIJWL0aduyIuxIRkXgoLNKQSIT7l16Ktw4RkbgoLNJQXQ0lJeqKEpHCpbBIQ9++UFWlQW4RKVwKizQlEuEcUceOxV2JiEjuKSzSlEjAwYPw5z/HXYmISO4pLNKkg/NEpJApLNI0fDgMHaqwEJHCpLBIU9PBeRrkFpFCpLDogEQC1q+HjRvjrkREJLcUFh3QdHCeWhciUmgUFh1QVQVlZRq3EJHCo7DogNLScDS3WhYiUmgUFh2USMDixXD4cNyViIjkjsKigxKJcBT34sVxVyIikjsKiw7SwXkiUogUFh00ZAiMGaOwEJHCorDohKaD89zjrkREJDcUFp2QSMDWrfDmm3FXIiKSGwqLTmg6OE9dUSJSKBQWnTBxIvTrp7AQkcKhsOiE4mKYOlUH54lI4VBYdFIiES6EtG9f3JWIiGRfVsPCzGaY2WozW2Nmt7az3JVm5mZWnTTvK9F6q83sQ9msszMSCWhsDJdaFRHJd1kLCzMrBu4CLgUmAHPMbEIry/UDbgYWJs2bAMwGJgIzgB9Gr9dtTJ0a7jVuISKFIJstiwuANe6+1t2PAvOAWa0s93XgW0Dy2ZZmAfPc/Yi7vwmsiV6v2xg4MAx0KyxEpBBkMyyGAm8lPa6L5h1nZucCw939sY6uG61/vZnVmlnt9u3bM1N1ByQS8NJLoTtKRCSfZTMsrJV5x495NrMi4DvAFzu67vEZ7ne7e7W7Vw8ePLjThXZWIgG7d8Nrr+V80yIiOZXNsKgDhic9HgZsSnrcD5gEPGtm64BpwPxokDvVut2CDs4TkUKRzbB4GRhnZqPMrJQwYD2/6Ul33+Pug9x9pLuPBF4CZrp7bbTcbDPrbWajgHFAt9vvaNw4qKxUWIhI/ivJ1gu7e72Z3QQsAIqBe9x9hZnNBWrdfX47664ws4eBlUA9cKO7N2Sr1s4yC6csV1iISL7LWlgAuPvjwOMt5n2tjWWnt3j8z8A/Z624DEkk4LHHYOfO0MoQEclHOoK7i5rGLV56Kd46RESySWHRReefH84Vpa4oEclnCosu6tsXqqoUFiKS3xQWGZBIhHNE1dfHXYmISHYoLDIgkYCDB8NZaEVE8pHCIgN0cJ6I5DuFRQYMHw6nn66wEJH8pbDIALPQulBYiEi+UlhkSCIB69fDpm53BisRka5TWGRI07iFrsstIvlIYZEh554LvXurK0pE8pPCIkNKS6G6WmEhIvlJYZFBiQQsXgyHD6deVkSkJ1FYZFAiAceOwZIlcVciIpJZCosMqqkJ9+qKEpF8o7DIoFNOgdGjFRYikn8UFhnWdHCee9yViIhkjsIiwxIJ2LoV1q2LuxIRkcxRWGSYTiooIvlIYZFhkyZBRYXCQkTyi8Iiw4qLYepUhYWI5Je0wsLMxphZ72h6upndbGYDs1taz5VIhAsh7dsXdyUiIpmRbsviV0CDmY0FfgaMAh7MWlU9XCIBjY3w8stxVyIikhnphkWju9cDHwW+6+5/B5yWvbJ6tmnTwr26okQkX6QbFsfMbA7wSeCxaF6v7JTU8w0cCBMnKixEJH+kGxafBmqAf3b3N81sFHB/9srq+WpqwrUtGhvjrkREpOvSCgt3X+nuN7v7Q2Z2EtDP3e/Icm09WiIBu3fDa6/FXYmISNeluzfUs2bW38xOBpYB95rZndktrWfTlfNEJJ+k2w01wN33An8B3Ovu5wGXZK+snu/MM+HkkzVuISL5Id2wKDGz04CP0zzALe0wC+MWCgsRyQfphsVcYAHwhru/bGajgdezV1Z+SCTCmMXbb8ddiYhI16Q7wP1Ldz/b3T8bPV7r7n+Z3dJ6vqZxi5deircOEZGuSneAe5iZPWpm28xsq5n9ysyGZbu4nu7888O5otQVJSI9XbrdUPcC84HTgaHAb6N50o7ycqiqUliISM+XblgMdvd73b0+ut0HDM5iXXmjpgYWLoT6+rgrERHpvHTDYoeZXWNmxdHtGmBnNgvLF4kEHDwYzkIrItJTpRsW1xJ2m90CbAauJJwCpF1mNsPMVpvZGjO7tZXnbzCz5Wa21MyeN7MJ0fyRZnYomr/UzH6c/lvqXnRwnojkg3T3htrg7jPdfbC7D3H3KwgH6LXJzIqBu4BLgQnAnKYwSPKgu0929yrgW0DyUeFvuHtVdLsh7XfUzYwYAaefrnELEenZunKlvFtSPH8BsCbazfYoMA+YlbxAdFR4k3LAu1BPt6SD80QkH3QlLCzF80OBt5Ie10XzTnwRsxvN7A1Cy+LmpKdGmdkrZvYHM3tvqwWYXW9mtWZWu3379g6WnzuJBKxbB5s3x12JiEjndCUsUrUCWguTd6zj7ne5+xjgy8BXo9mbgRHufi6hBfOgmfVvZd273b3a3asHD+6+O2dp3EJEerp2w8LM9pnZ3lZu+wjHXLSnDhie9HgYsKmd5ecBVwC4+xF33xlNLwbeAM5Msb1u69xzoXdvdUWJSM9V0t6T7t6vC6/9MjAuulDSRmA28InkBcxsnLs3nWPqMqLzTZnZYOBtd2+IzkM1DljbhVpi1bs3VFcrLESk5+pKN1S7omt230Q4AeEq4GF3X2Fmc81sZrTYTWa2wsyWErqbPhnNvxD4s5ktAx4BbnD3Hn06vpoaWLwYDh+OuxIRkY4z9/zYAam6utpra2vjLqNNjz4Kf/EX8Kc/NY9hiIjEzcwWu3t1quWy1rKQE9XUhHsNcotIT6SwyJFTT4XRozVuISI9k8Iih5oOzsuTnj8RKSAKixxKJGDLlnCAnohIT6KwyKGmgW11RYlIT6OwyKFJk6CiQoPcItLzKCxyqKQEpk5Vy0JEeh6FRY7V1MCyZbB/f9yViIikT2GRY4kENDbCokVxVyIikj6FRY5NmxbuNW4hIj2JwiLHTjoJJkzQuIWI9CwKixgkEqFl0dgYdyUiIulRWMSgpgZ27YLVq+OuREQkPQqLGOjgPBHpaRQWMTjzTDj5ZA1yi0jPobCIQVFR80kFRUR6AoVFTGpqYNUqeLtHX/9PRAqFwiImTeMWL70Ubx0iIulQWMTk/POhuFhdUSLSMygsYlJRAeeco0FuEekZFBYxSiRg4UKor4+7EhGR9iksYlRTAwcOwPLlcVciItI+hUWMdHCeiPQUCosYnXEGnHaaxi1EpPtTWMTILLQu1LIQke5OYRGzmhp4803YvDnuSkRE2qawiFnTuIW6okSkO1NYxGzKFCgtVVeUiHRvCguAhiOxbbp3b6iuVstCRLo3hcWRnfDYWbDq36GxIZYSEgmorYUj8WWWiEi7FBbucNI58MqX4OmLYf+bOS+hpgaOHoUlS3K+aRGRtCgsygbBex+FaffBrqXw+Nmw5qchRHKkpibca9xCRLorhQWEAx5GfxI+vBwqL4BFfwN/+Agcys3+rKedBqNGKSxEpPtSWCQrHwEXPwnnfQ+2PgX/NQk2/DInm246OC+HDRoRkbQpLFqyInjXzTDjFagYA89/HP50NRzdldXNJhKwZQv8939ndTMiIp2isGjLgLPggy/A5Lmw4eHQyti0IGubmzkThg6FD34QrrgCXnsta5sSEemwrIaFmc0ws9VmtsbMbm3l+RvMbLmZLTWz581sQtJzX4nWW21mH8pmnW0qKoHJ/wgfeglKB8KzM+Dlz0H9gYxvatgwWL0avvENePppmDQJPvMZnQZERLqHrIWFmRUDdwGXAhOAOclhEHnQ3Se7exXwLeDOaN0JwGxgIjAD+GH0evE4+TyYsRjO+iK8/mN4/BzY/qeMb6a8HP7hH+CNN+Bzn4N77oGxY+Gf/gn27cv45kRE0pbNlsUFwBp3X+vuR4F5wKzkBdx9b9LDcqBpeHcWMM/dj7j7m8Ca6PXiU1wGU74NlzwL3gD/fSEsvTUrR38PHgzf/z6sWgWXXw5z54bQ+OEP4dixjG9ORCSlbIbFUOCtpMd10bwTmNmNZvYGoWVxcwfXvd7Mas2sdvv27RkrvF1DLoQP/xlGXwsr/xUWnA+7lmVlU2PHwi9+ES69On483HgjTJwIjzyivaZEJLeyGRbWyrx3fMW5+13uPgb4MvDVDq57t7tXu3v14MGDu1Rsh/TqB1P/Ay56DA5vC4Gx4pvQmJ2LaV9wATzzDDz2WDjp4Mc+Fvae+uMfs7I5EZF3yGZY1AHDkx4PAza1s/w84IpOrhuPoZfBh1+FobNg2W2ha2rv61nZlBlcdhksWwY/+xls2AAXXgizZoXuKhGRbMpmWLwMjDOzUWZWShiwnp+8gJmNS3p4GdD0TTsfmG1mvc1sFDAOWJTFWjuvbBC852FIPAB7VsHvquB/fpi1fqLiYrj2Wnj9dfiXf4Fnnw17Tl1/PWzqfnEqInkia2Hh7vXATcACYBXwsLuvMLO5ZjYzWuwmM1thZkuBW4BPRuuuAB4GVgJPADe6ezynhE2HGYz8BFz2Kgx5L9TeCM/MgIN1Wdtk377wla+EPaf+9m/hvvvCGMdXvwp796ZcXUSkQ8zzZKS0urraa2tr4y4jtCjW/ASWfBGKSqH6ByFIrLVhmMxZuzbsdjtvHgwaBF/7WjhOo7Q0q5sVkR7OzBa7e3Wq5XQEd6aZwbgb4MPLYMAEePEaeP5jcHhHVjc7ejQ89BC8/DJMngw33wwTJsDDD2vPKRHpOoVFtvQbC5c8B1V3wMb58PgkqPtt1jdbXQ1PPQWPPw59+sBVV8G0afCHP2R90yKSxxQW2VRUDBO+DB+qhbJT4LmZsPA6OJbdQQUzuPRSWLoU7r0XNm6E6dPhIx+BFSuyumkRyVMKi1w46Wz40CKY8BVYe2+4wNLW7P/ULy6GT30q7Dn1zW/Cc8/B2WfDddeFABERSZfCIleKe0PVv8Alz4P1gqfeFwbBGw5nfdN9+sCtt4ZB8M9/Hn7+cxg3LgyI79mT9c2LSB5QWOTa4Br48FIY91l47U743RR4e3FONl1ZCXfeGc5u+9GPhuM0xowJ56E6ejQnJYhID6WwiENJOZx/F7xvQRi/WDANlv8faMzNWQJHjYIHHoDaWjjnnNDaGD8+nIeqsTEnJYhID6OwiNNpH4TLlsMZV8Hy2+H3NbDuIag/mJPNn3deuDLf734HFRUwezZMnQoLFujstiJyIoVF3EpPgsT98J5fhpMSvvAJ+M9T4IX/Fa7Ml6WTEzYxgxkzYMmScBT41q3hcWVlOO/UD34Quq10rIZIYdMR3N2JN8K2P8K6B2DDL+HYbigbAiNmw8irofL8rB8JfuhQOEbjySfDbe3aMH/4cPjAB8LtkkvCUeIi0vOlewS3wqK7ajgCmx4PwbHxMWg8AhVjQ2iMvBr6j0v9Ghmwdm1zcDz1FOzeHeafe25zeLznPVBWlpNyRCTDFBb55OgeeOtXITi2PgM4nHx+CI0zZkOfU3JSRkMDLF4Mv/99CI8XXwxjG2Vl4XTpTeExeTIUqYNTpEdQWOSrgxth/bwQHLteASuCUy4JwTH8o+HCTDmyf384jUhTy2PlyjB/yJDQVdUUHkPfcY1DEekuFBaFYM+qEBrrHoAD66C4DwydGYLjtA9BcW5PObtxY9i76sknw/3WrWH++PHNwXHRRdAvd3kmIikoLAqJO+x4MRoY/wUc2Qm9K2H4x0JwDE6EFkiOS1q+vLnV8dxzYfC8pARqaprDo7o6zBOReCgsClXjMdi8IARH3W+g4RCUn9E8MD5gQixlHT4ML7zQHB5LloRAGTAALr64OTzGjMn6Dl8ikkRhIXBsH9T9OgTHlifDrrknVUUD43Ogb3yDCTt2wNNPN4fH+vVh/siRJ3ZZDRkSW4kiBUFhISc6tDV0Ua17AHYuAgxOmR4NjP8llA6MrTR3WLOmeS+rZ55pvjTskCHhGuPJt4kToX//2MoVySsKC2nb3tdh/YMhOPa9DkW9YehlIThOvyycITdG9fWwaBEsXAivvhpuK1bAgQPNy4wY8c4QOeuscIZdEUmfwkJSc4e3a0NorJ8Hh7dCrwHhnFVFvQGPzvPh7UzT9nMp121tmubHVhJOulhSgRdXsPdQOVt3VrBpWznrN1bwxvoKXn+znN0HKth/uIJDR8upPKWC4aMrGH1mOWeOL2fi5BLGjoVevXLzkaalsQEaDoZzgDUcSppu6/5QuC/uDSX9oFf/6JY03TS/pCJcdEskTQoL6ZjGetj6dAiO7c+HL24zILpZi/tWp2nnuXamW30e8HqoPwDH9kNDdF+/n+aQSu3Q0TIOHCnnSGMFjUUVFJeW06tvBX37V9C3Xzl8htBQAAALOUlEQVTWqyJ8wZaUQ/J08j2880u86Qu83S/6NoKgsTPng7f033dJ+YkB0hQsJS1CJmXwlGtvgwKQblhop0UJikpCi+K0D8ZdSfvcwwWj6veHIKnff+J0FCzHDu1nx5b9vL3tAHv37ufg3v0cOXiAoob9lPc+QEXZBvr12c+A8gNUlO2nrHg/Zp354WRQ0heK+7a47xO+cPuc2spzfaGkTxvzo/viPmG66XFRadjTrX5f2HHh2N5oem90a2/eXti/o/n5o3tCEKfz3loLlt6Dw/sqOwXKovs+0XTvQeHfkuSGOxx9O/zbLz8jq5vSX1V6FrPwRVvSBxjc5mK9gNMmw2kt5u/dG440X/zqieMhW7Y4Zb0OU1G2n6Gn7OecCQeYeNZ+zhqzn+HDjVOH9WXwaX0pKU0Kg5K+obsuV7++i0uhuDIcQ9MV7uFcY8eSguV4yLQ2L3n+Hti3JnRZNrR2Kn0LgXE8TJIDpcW83oPUZZZKw1E4VAcHNoTbwQ1wYH3S9IbwdxiUgA/+KaulqBtKhLAr74oVzQHy6qvhoMLky86WlMAZZ8Do0a3fBsa3Q1k8ju2Hw1tCcBzeCoeapqP7Q0nTDYfeub4VhcAoSwqRli2WpnmllfkXLE2tggNRABzccGIIHNwQPtOW3Y9lp0DfEVA+ovm+/3g4/UOdKkNjFiJd5B5OYbJmTTj77htvhPum244dJy5/0kltB8nw4d1skD2X3EM3yaGkYDkeKK3Ma+269FYUur+Oh8iQpHGl8hbTKeYV5egP0XAEDtY1f/m3DIKmVkGy4rLmACg/452h0HdYWCaDFBYiWbZ3L7z55okB0nR7880TrzZYXBx2920ZImPGhPuTTorvfXQr7qH761BrLZakQDm8vXmsqtXusHYU9YLiNEKlrXnJ69IIB956ZwgcWB9qbans1BZf/k3BEE33HpTznQoUFiIxamiATZuaw6Nlq2T79hOXHziw7VbJiBEF3CpJhzeGPc3qD4S95pL3oKtPvu1P/3HTuq21ctpS3Kf1IMhiqyATtDeUSIyKi0PX0/Dh4bQlLe3b13qrZPlymD8fjibtXVtUFAJj6FA49dS2b0OGQGluTzTcPVhR2O25V0XmX7uxoUXotAgYLKlVUJnXuxorLERi0K8fnH12uLXU2Hhiq6SpZbJ5c9iT6+mnYdeu1l+3srL9QGm6nXyyLlCVlqJiKIp2GS5wCguRbqaoCIYNC7cLL2x9mcOHYds22LKl7dsLL4SAOdxKT0pJCZxySnN4JE+3vFVU5PUPZkmTwkKkByorC11TI0a0v5x76PJqL1Q2bQqnjN+2LYy1tNS374nhMWhQ862y8p3T/fsrXPKRwkIkj5mFL+/+/eHMM9tftqEBdu4MVzhsK1heey3sMrxzZ+vBAqHV0lqItDetgOn+FBYiAoRB+SFDwm3y5PaXbWwMuw7v2NEcHm1NdzRg0g2a/v017pJLCgsR6bCiorC778CBMHZseuu4hyPiU4XLjh0hYJqm2woYs3ClxYEDw3EqyfdtTSfP69NHrZmOUFiISE6YdS5g2mrB7N7dfNu1K9yvXt08L/n6J60pLe14wDRNDxhQeMe+ZDUszGwG8D2gGPipu9/R4vlbgOuAemA7cK27r4+eawCWR4tucPeZ2axVRLqfptbDgAHhaPeOOHo0tGSSw6TpvrXpXbvCbspNj+tTnJi3oqI5RJpaOB2ZLut+x+e1K2thYWbFwF3AB4A64GUzm+/uK5MWewWodveDZvZZ4FvAVdFzh9y9Klv1iUh+Ky2FwYPDraPc4eDB9AJmz55w27wZVq1qDqi2us+a9O59Yoh0NHByvUtzNlsWFwBr3H0tgJnNA2YBx8PC3Z9JWv4l4Jos1iMikhYzKC8Pt6FDO75+ctjs3t0cIKmm33qrefpQKyfqTVZU1Bwe06bBgw927r2mK5thMRR4K+lxHTC1neX/Gvhd0uMyM6sldFHd4e6/brmCmV0PXA8wItUO5yIiOdLVsAE4cqS51ZIqZIYPz2z9rclmWLTWQGr1rIVmdg1QDSSfRWeEu28ys9HA02a23N3fOOHF3O8G7oZwIsHMlC0iEr/evZt3Ze4OsrmXch2QnHfDgE0tFzKzS4B/AGa6+5Gm+e6+KbpfCzwLnJvFWkVEpB3ZDIuXgXFmNsrMSoHZwPzkBczsXOAnhKDYljT/JDPrHU0PAt5N0liHiIjkVta6ody93sxuAhYQdp29x91XmNlcoNbd5wP/BlQAv7QwrN+0i+x44Cdm1kgItDta7EUlIiI5pIsfiYgUsHQvfqQzq4iISEoKCxERSUlhISIiKSksREQkpbwZ4Daz7cD6LrzEIGBHhsrp6fRZnEifx4n0eTTLh8/iDHdPeQatvAmLrjKz2nT2CCgE+ixOpM/jRPo8mhXSZ6FuKBERSUlhISIiKSksmt0ddwHdiD6LE+nzOJE+j2YF81lozEJERFJSy0JERFJSWIiISEoFHxZmNsPMVpvZGjO7Ne564mRmw83sGTNbZWYrzOzzcdcUNzMrNrNXzOyxuGuJm5kNNLNHzOy16N9ITdw1xcnM/i76f/KqmT1kZmVx15RNBR0WZlYM3AVcCkwA5pjZhHirilU98EV3Hw9MA24s8M8D4PPAqriL6Ca+Bzzh7mcB51DAn4uZDQVuBqrdfRLhMgyz460quwo6LIALgDXuvtbdjwLzgFkx1xQbd9/s7kui6X2EL4NOXkG45zOzYcBlwE/jriVuZtYfuBD4GYC7H3X33fFWFbsSoI+ZlQB9aeVKoPmk0MNiKPBW0uM6CvjLMZmZjSRcynZhvJXE6rvA/wYa4y6kGxgNbAfujbrlfmpm5XEXFRd33wh8G9gAbAb2uPvv460quwo9LKyVeQW/L7GZVQC/Ar7g7nvjricOZnY5sM3dF8ddSzdRAkwBfuTu5wIHgIId4zOzkwi9EKOA04FyM7sm3qqyq9DDog4YnvR4GHnelEzFzHoRguIBd//PuOuJ0buBmWa2jtA9ebGZ3R9vSbGqA+rcvaml+QghPArVJcCb7r7d3Y8B/wkkYq4pqwo9LF4GxpnZKDMrJQxQzY+5pthYuBD6z4BV7n5n3PXEyd2/4u7D3H0k4d/F0+6e178c2+PuW4C3zOxd0az3AytjLCluG4BpZtY3+n/zfvJ8wL8k7gLi5O71ZnYTsICwN8M97r4i5rLi9G7gr4DlZrY0mnebuz8eY03Sffwt8ED0w2ot8OmY64mNuy80s0eAJYS9CF8hz0/9odN9iIhISoXeDSUiImlQWIiISEoKCxERSUlhISIiKSksREQkJYWFSAeYWYOZLU26ZewoZjMbaWavZur1RDKpoI+zEOmEQ+5eFXcRIrmmloVIBpjZOjP7VzNbFN3GRvPPMLOnzOzP0f2IaP4pZvaomS2Lbk2niig2s/+IrpPwezPrE9ubEkmisBDpmD4tuqGuSnpur7tfAPyAcMZaoumfu/vZwAPA96P53wf+4O7nEM6x1HTmgHHAXe4+EdgN/GWW349IWnQEt0gHmNl+d69oZf464GJ3XxudjHGLu1ea2Q7gNHc/Fs3f7O6DzGw7MMzdjyS9xkjgSXcfFz3+MtDL3b+R/Xcm0j61LEQyx9uYbmuZ1hxJmm5A44rSTSgsRDLnqqT7F6PpF2i+3ObVwPPR9FPAZ+H4db7756pIkc7QrxaRjumTdEZeCNekbtp9treZLST8CJsTzbsZuMfM/p5wpbmmM7V+HrjbzP6a0IL4LOGKayLdksYsRDIgGrOodvcdcdcikg3qhhIRkZTUshARkZTUshARkZQUFiIikpLCQkREUlJYiIhISgoLERFJ6f8DSrI3fBVU2v0AAAAASUVORK5CYII=\n",
      "text/plain": [
       "<Figure size 432x288 with 1 Axes>"
      ]
     },
     "metadata": {
      "needs_background": "light"
     },
     "output_type": "display_data"
    }
   ],
   "source": [
    "model = tf.keras.models.Sequential([\n",
    "  tf.keras.layers.Flatten(input_shape=(28, 28)),\n",
    "  tf.keras.layers.Dense(10, activation='softmax')\n",
    "])\n",
    "\n",
    "model.compile(optimizer='adam',\n",
    "              loss='sparse_categorical_crossentropy',\n",
    "              metrics=['accuracy'])\n",
    "\n",
    "\n",
    "# 1. create a history object to store the results of model.fit\n",
    "# history = model.fit(x_train, y_train, epochs=10)\n",
    "# 2. add another parameter to model.fit for validation data\n",
    "# https://keras.io/models/sequential/\n",
    "history = model.fit(x_train, y_train, epochs=10, validation_data=(x_test, y_test))\n",
    "\n",
    "# A plotting function you can reuse\n",
    "def plot(history):\n",
    "  \n",
    "  # The history object contains results on the training and test\n",
    "  # sets for each epoch\n",
    "  acc = history.history['accuracy']\n",
    "  val_acc = history.history['val_accuracy']\n",
    "  loss = history.history['loss']\n",
    "  val_loss = history.history['val_loss']\n",
    "\n",
    "  # Get the number of epochs\n",
    "  epochs = range(len(acc))\n",
    "\n",
    "  plt.title('Training and validation accuracy')\n",
    "  plt.plot(epochs, acc, color='blue', label='Train')\n",
    "  plt.plot(epochs, val_acc, color='orange', label='Val')\n",
    "  plt.xlabel('Epoch')\n",
    "  plt.ylabel('Accuracy')\n",
    "  plt.legend()\n",
    "\n",
    "  _ = plt.figure()\n",
    "  plt.title('Training and validation loss')\n",
    "  plt.plot(epochs, loss, color='blue', label='Train')\n",
    "  plt.plot(epochs, val_loss, color='orange', label='Val')\n",
    "  plt.xlabel('Epoch')\n",
    "  plt.ylabel('Loss')\n",
    "  plt.legend()\n",
    "  \n",
    "plot(history)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "colab_type": "text",
    "id": "4EhrKNT8wfgD"
   },
   "source": [
    "### 1b: Implement a neural network \n",
    "\n",
    "**TODO**\n",
    "\n",
    "Modify the code below to create a neural network (with a single hidden layer). Add a Dense layer with 128 units and ReLU activation. Train and evaluate your model. How does the accuracy compare with the linear model above? It is not necessary to produce plots for this section."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 7,
   "metadata": {
    "colab": {},
    "colab_type": "code",
    "id": "FYUgpSwPq-HF"
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Train on 60000 samples\n",
      "Epoch 1/6\n",
      "WARNING:tensorflow:Entity <function Function._initialize_uninitialized_variables.<locals>.initialize_variables at 0xb27b836a8> could not be transformed and will be executed as-is. Please report this to the AutoGraph team. When filing the bug, set the verbosity to 10 (on Linux, `export AUTOGRAPH_VERBOSITY=10`) and attach the full output. Cause: module 'gast' has no attribute 'Num'\n",
      "WARNING: Entity <function Function._initialize_uninitialized_variables.<locals>.initialize_variables at 0xb27b836a8> could not be transformed and will be executed as-is. Please report this to the AutoGraph team. When filing the bug, set the verbosity to 10 (on Linux, `export AUTOGRAPH_VERBOSITY=10`) and attach the full output. Cause: module 'gast' has no attribute 'Num'\n",
      "60000/60000 [==============================] - 10s 164us/sample - loss: 0.2611 - accuracy: 0.9248\n",
      "Epoch 2/6\n",
      "60000/60000 [==============================] - 9s 151us/sample - loss: 0.1114 - accuracy: 0.9678\n",
      "Epoch 3/6\n",
      "60000/60000 [==============================] - 9s 143us/sample - loss: 0.0765 - accuracy: 0.9772\n",
      "Epoch 4/6\n",
      "60000/60000 [==============================] - 8s 141us/sample - loss: 0.0589 - accuracy: 0.9823\n",
      "Epoch 5/6\n",
      "60000/60000 [==============================] - 9s 152us/sample - loss: 0.0447 - accuracy: 0.9863\n",
      "Epoch 6/6\n",
      "60000/60000 [==============================] - 12s 200us/sample - loss: 0.0348 - accuracy: 0.9894\n",
      "10000/1 [================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================] - 1s 113us/sample - loss: 0.0372 - accuracy: 0.9781\n"
     ]
    },
    {
     "data": {
      "text/plain": [
       "[0.07412979038484627, 0.9781]"
      ]
     },
     "execution_count": 7,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "model = tf.keras.models.Sequential([\n",
    "  tf.keras.layers.Flatten(input_shape=(28, 28)),\n",
    "  # Modify me\n",
    "  tf.keras.layers.Dense(128, activation=\"relu\"),\n",
    "  tf.keras.layers.Dense(10, activation='softmax')\n",
    "])\n",
    "\n",
    "model.compile(optimizer='adam',\n",
    "              loss='sparse_categorical_crossentropy',\n",
    "              metrics=['accuracy'])\n",
    "\n",
    "model.fit(x_train, y_train, epochs=6)\n",
    "model.evaluate(x_test, y_test)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Answer  \n",
    "The accuracy in the neural network model above is much higher than the linear model.  "
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "colab_type": "text",
    "id": "V18pDvPzwh6l"
   },
   "source": [
    "### 1c: Implement a deep neural network \n",
    "\n",
    "**TODO**\n",
    "\n",
    "Modify the code below to create and train a deep neural network with at least two hidden layers."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 14,
   "metadata": {
    "colab": {},
    "colab_type": "code",
    "id": "K0odgGhmrNNh"
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Train on 60000 samples\n",
      "Epoch 1/5\n",
      "WARNING:tensorflow:Entity <function Function._initialize_uninitialized_variables.<locals>.initialize_variables at 0xb2a9d8c80> could not be transformed and will be executed as-is. Please report this to the AutoGraph team. When filing the bug, set the verbosity to 10 (on Linux, `export AUTOGRAPH_VERBOSITY=10`) and attach the full output. Cause: module 'gast' has no attribute 'Num'\n",
      "WARNING: Entity <function Function._initialize_uninitialized_variables.<locals>.initialize_variables at 0xb2a9d8c80> could not be transformed and will be executed as-is. Please report this to the AutoGraph team. When filing the bug, set the verbosity to 10 (on Linux, `export AUTOGRAPH_VERBOSITY=10`) and attach the full output. Cause: module 'gast' has no attribute 'Num'\n",
      "60000/60000 [==============================] - 11s 176us/sample - loss: 0.2052 - accuracy: 0.9394\n",
      "Epoch 2/5\n",
      "60000/60000 [==============================] - 10s 174us/sample - loss: 0.0860 - accuracy: 0.9732\n",
      "Epoch 3/5\n",
      "60000/60000 [==============================] - 11s 182us/sample - loss: 0.0598 - accuracy: 0.9811\n",
      "Epoch 4/5\n",
      "60000/60000 [==============================] - 15s 257us/sample - loss: 0.0426 - accuracy: 0.9863\n",
      "Epoch 5/5\n",
      "60000/60000 [==============================] - 15s 255us/sample - loss: 0.0361 - accuracy: 0.9883\n"
     ]
    },
    {
     "data": {
      "text/plain": [
       "<tensorflow.python.keras.callbacks.History at 0xb45e6ed68>"
      ]
     },
     "execution_count": 14,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "model = tf.keras.models.Sequential([\n",
    "  tf.keras.layers.Flatten(input_shape=(28, 28)),\n",
    "  # Modify me\n",
    "  tf.keras.layers.Dense(256, activation=\"relu\"),\n",
    "  tf.keras.layers.Dense(128, activation=\"relu\"),\n",
    "  tf.keras.layers.Dense(10, activation='softmax')\n",
    "])\n",
    "\n",
    "model.compile(optimizer='adam',\n",
    "              loss='sparse_categorical_crossentropy',\n",
    "              metrics=['accuracy'])\n",
    "\n",
    "model.fit(x_train, y_train, epochs=5)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "colab_type": "text",
    "id": "NkmnVGG-wnyw"
   },
   "source": [
    "### 1d: Display predictions and their confidence \n",
    "\n",
    "**TODO**\n",
    "\n",
    "1. Choose one of your models above. Use it to make predictions on the entire test set using ```model.predict```\n",
    "\n",
    "2. Next, identify one image from the testing set the model classifies correctly, and another that it classifies incorrectly. Add code to display these images below, the correct labels, the predicted labels, and the confidence scores."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 16,
   "metadata": {
    "colab": {},
    "colab_type": "code",
    "id": "BPd5NvaV1XEx"
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Correctly Classified\n"
     ]
    },
    {
     "data": {
      "image/png": "iVBORw0KGgoAAAANSUhEUgAAAP8AAAD8CAYAAAC4nHJkAAAABHNCSVQICAgIfAhkiAAAAAlwSFlzAAALEgAACxIB0t1+/AAAADl0RVh0U29mdHdhcmUAbWF0cGxvdGxpYiB2ZXJzaW9uIDMuMC4yLCBodHRwOi8vbWF0cGxvdGxpYi5vcmcvOIA7rQAADlJJREFUeJzt3X+MHPV5x/HPk/P5DkyaQsFwsd0aIkNDLOGEk4OgTU0RFlS0Nk1wcdvISWmPJFA1UqqUWKRAlTQWbQhJk5BcgmWnIsRpDbEj0TToGuREqTCHS21j88OiDhx2bZBRbaJwPvue/nFjcpib7+7tzuzs3fN+SdbtzjOz89zC52Z3vzvzNXcXgHjeUnUDAKpB+IGgCD8QFOEHgiL8QFCEHwiK8ANBEX4gKMIPBDWjlTubaV3erVmt3CUQymv6uY76sNWzblPhN7OrJH1RUoekb7r7mtT63Zql99oVzewSQMKjPlD3ug2/7DezDklfkXS1pAslrTSzCxt9PACt1cx7/sWS9rj7c+5+VNJ3JC0rpi0AZWsm/HMkvTDu/lC27A3MrM/MBs1scETDTewOQJGaCf9EHyq86fxgd+9391537+1UVxO7A1CkZsI/JGneuPtzJe1rrh0ArdJM+B+TtMDMzjWzmZKul7S5mLYAlK3hoT53P2ZmN0v6d40N9a119ycL6wxAqZoa53f3hyQ9VFAvAFqIr/cCQRF+ICjCDwRF+IGgCD8QFOEHgiL8QFCEHwiK8ANBEX4gKMIPBEX4gaAIPxAU4QeCIvxAUIQfCIrwA0ERfiAowg8ERfiBoAg/EFRLp+hG63X86tuS9ae/fF6y/tTl30zWbz14cbK+40/Oz60d3/VMcluUiyM/EBThB4Ii/EBQhB8IivADQRF+ICjCDwTV1Di/me2VdETScUnH3L23iKZQnNFz5ybrO5Z8PVkf8fTjf2b248n6Rddemlubxzh/pYr4ks/l7v5yAY8DoIV42Q8E1Wz4XdIPzexxM+sroiEArdHsy/7L3H2fmc2W9LCZPeXuW8avkP1R6JOkbp3a5O4AFKWpI7+778t+HpT0oKTFE6zT7+697t7bqa5mdgegQA2H38xmmdlbT9yWtFTSzqIaA1CuZl72ny3pQTM78TjfdvcfFNIVgNI1HH53f07SRQX2ggbNmJc/ln9u/54WdoKphKE+ICjCDwRF+IGgCD8QFOEHgiL8QFBcunsKeP5v80+LlaSLr9qVW7uz58dFtzMpp136Um7thU+nf68ztx9L1k/ZtLWhnjCGIz8QFOEHgiL8QFCEHwiK8ANBEX4gKMIPBMU4/xSw/cZ/StZH/HiLOpm8Ry66L79Y44TwB3/ek6yvPbI8WZ/xH+nLikfHkR8IivADQRF+ICjCDwRF+IGgCD8QFOEHgmKcvw10PpIez+60jhZ1Mnn/dXQ0Wd87clZu7dpZh5LbrjjtYLr+z/3J+jVzLk7Wo+PIDwRF+IGgCD8QFOEHgiL8QFCEHwiK8ANB1RznN7O1kq6RdNDdF2bLzpC0QdJ8SXslrXD3V8prc2r7xfLFyfqHe/4lWa91vn6Z5/MvHPhIsn7WQFey3vV/+b19akn62LPjui8l67UMfSp/XoC5n/tpU489HdRz5F8n6aqTlt0iacDdF0gayO4DmEJqht/dt0g6+atYyyStz26vl5S+pAqAttPoe/6z3X2/JGU/ZxfXEoBWKP27/WbWJ6lPkrp1atm7A1CnRo/8B8ysR5Kyn7lnYLh7v7v3untvp9IfDgFonUbDv1nSquz2KkmbimkHQKvUDL+Z3S/pPyVdYGZDZnaDpDWSrjSzZyVdmd0HMIXUfM/v7itzSlcU3MuU1fGuC5L1z9yVPu+8d+bRWnuYZEe/VOva97f+6P3J+js/+VSyfvzw4Un3dMIFz56frG/9g+5kfXHXa8n6v330ztza0u5PJred//fpa/778HCyPhXwDT8gKMIPBEX4gaAIPxAU4QeCIvxAUFy6uwCjM9NPY+2hvOb82c9OPunyl4780SnJbc8f2pqslzn59/FdzyTrH1uXPp148Ma7k/WejvzffdsN6W3f/8CqZN3/e3eyPhVw5AeCIvxAUIQfCIrwA0ERfiAowg8ERfiBoBjnnwJWH+hN1g//+a/l1o4PPVt0Oy0zf+PLyfqnl1+SrK8557Ei25l2OPIDQRF+ICjCDwRF+IGgCD8QFOEHgiL8QFCM87dApzV+6W1J2v4er7HG1B3LTzJLlme8ZTRZb+Z533dHun7ONJialiM/EBThB4Ii/EBQhB8IivADQRF+ICjCDwRVc5zfzNZKukbSQXdfmC27XdJfSHopW221uz9UVpPt7umPnpqsj3iZV7+fvvb+Yf51CiTpX89Kzzkw4vnj/LX+m7z9tmRZ6W8YTA31HPnXSZpoVogvuPui7F/Y4ANTVc3wu/sWSYda0AuAFmrmPf/NZrbdzNaa2emFdQSgJRoN/z2S3iFpkaT9kj6ft6KZ9ZnZoJkNjmi4wd0BKFpD4Xf3A+5+3N1HJX1D0uLEuv3u3uvuvZ3qarRPAAVrKPxm1jPu7rWSdhbTDoBWqWeo735JSySdaWZDkm6TtMTMFklySXsl3VhijwBKUDP87r5ygsX3ltDLlHXrb3+/6hba1ox5c3NrRy5+e3Lbr334q0W387qtw93Juh09Vtq+2wXf8AOCIvxAUIQfCIrwA0ERfiAowg8ExaW7Uapdd5yTW3ty6ZdL3ffGV8/Mrd3z19clt+3enT5deDrgyA8ERfiBoAg/EBThB4Ii/EBQhB8IivADQTHOj6Z0PtKTrH+uZ2OLOnmzdS9emlvr/v70H8evhSM/EBThB4Ii/EBQhB8IivADQRF+ICjCDwTFOH8BOiw9YXOn5U8VXY/Df3xJw9ve8Xfpq6xffsprDT+2VPt3S0+F3dzzUov/7oulPv5Ux5EfCIrwA0ERfiAowg8ERfiBoAg/EBThB4KqOc5vZvMkfUvSOZJGJfW7+xfN7AxJGyTNl7RX0gp3f6W8VtvXmg0fSNZX3HB3U4+/5R++kqynx9LTRrzhTet8/MZ7q2XhwEeS9QXaVtq+p4N6jvzHJH3C3d8p6RJJN5nZhZJukTTg7gskDWT3AUwRNcPv7vvdfVt2+4ik3ZLmSFomaX222npJy8tqEkDxJvWe38zmS3q3pEclne3u+6WxPxCSZhfdHIDy1B1+MztN0kZJH3f3w5PYrs/MBs1scETDjfQIoAR1hd/MOjUW/Pvc/YFs8QEz68nqPZIOTrStu/e7e6+793aqq4ieARSgZvjNzCTdK2m3u981rrRZ0qrs9ipJm4pvD0BZ6jml9zJJH5S0w8yeyJatlrRG0nfN7AZJz0tKz3k8jZ234eVkfeufdifri7uaO622nW0dzv/d+//3d5LbvvKx/Om9Jek3/2dPsl7eIOP0UDP87v4TSZZTvqLYdgC0Ct/wA4Ii/EBQhB8IivADQRF+ICjCDwRl7iWf0znOr9gZ/l6LNzr4i2WLk/UXfj996e9nrv56sl7mabO11Lp090Vf/cvc2rzP/rTodsJ71Ad02A/lDc2/AUd+ICjCDwRF+IGgCD8QFOEHgiL8QFCEHwiKKbpb4JRNW5P182tcBuV9K29K1js/dCC39oN3bUhuu3Tn9cn66Lr0pRm9xojy/Cdeyq1xvn21OPIDQRF+ICjCDwRF+IGgCD8QFOEHgiL8QFCczw9MI5zPD6Amwg8ERfiBoAg/EBThB4Ii/EBQhB8Iqmb4zWyemf3IzHab2ZNm9lfZ8tvN7EUzeyL793vltwugKPVczOOYpE+4+zYze6ukx83s4az2BXf/x/LaA1CWmuF39/2S9me3j5jZbklzym4MQLkm9Z7fzOZLerekR7NFN5vZdjNba2an52zTZ2aDZjY4ouGmmgVQnLrDb2anSdoo6ePufljSPZLeIWmRxl4ZfH6i7dy939173b23U10FtAygCHWF38w6NRb8+9z9AUly9wPuftzdRyV9Q1J6NkoAbaWeT/tN0r2Sdrv7XeOW94xb7VpJO4tvD0BZ6vm0/zJJH5S0w8yeyJatlrTSzBZJckl7Jd1YSocASlHPp/0/kTTR+cEPFd8OgFbhG35AUIQfCIrwA0ERfiAowg8ERfiBoAg/EBThB4Ii/EBQhB8IivADQRF+ICjCDwRF+IGgWjpFt5m9JOln4xadKenlljUwOe3aW7v2JdFbo4rs7Tfc/ax6Vmxp+N+0c7NBd++trIGEdu2tXfuS6K1RVfXGy34gKMIPBFV1+Psr3n9Ku/bWrn1J9NaoSnqr9D0/gOpUfeQHUJFKwm9mV5nZ02a2x8xuqaKHPGa218x2ZDMPD1bcy1ozO2hmO8ctO8PMHjazZ7OfE06TVlFvbTFzc2Jm6Uqfu3ab8brlL/vNrEPSM5KulDQk6TFJK919V0sbyWFmeyX1unvlY8Jm9j5Jr0r6lrsvzJbdKemQu6/J/nCe7u5/0ya93S7p1apnbs4mlOkZP7O0pOWSPqQKn7tEXytUwfNWxZF/saQ97v6cux+V9B1Jyyroo+25+xZJh05avEzS+uz2eo39z9NyOb21BXff7+7bsttHJJ2YWbrS5y7RVyWqCP8cSS+Muz+k9pry2yX90MweN7O+qpuZwNnZtOknpk+fXXE/J6s5c3MrnTSzdNs8d43MeF20KsI/0ew/7TTkcJm7v0fS1ZJuyl7eoj51zdzcKhPMLN0WGp3xumhVhH9I0rxx9+dK2ldBHxNy933Zz4OSHlT7zT584MQkqdnPgxX387p2mrl5opml1QbPXTvNeF1F+B+TtMDMzjWzmZKul7S5gj7exMxmZR/EyMxmSVqq9pt9eLOkVdntVZI2VdjLG7TLzM15M0ur4ueu3Wa8ruRLPtlQxt2SOiStdffPtryJCZjZeRo72ktjk5h+u8rezOx+SUs0dtbXAUm3SfqepO9K+nVJz0u6zt1b/sFbTm9LNPbS9fWZm0+8x25xb78l6ceSdkgazRav1tj768qeu0RfK1XB88Y3/ICg+IYfEBThB4Ii/EBQhB8IivADQRF+ICjCDwRF+IGg/h9YF/1+epKp7QAAAABJRU5ErkJggg==\n",
      "text/plain": [
       "<Figure size 432x288 with 1 Axes>"
      ]
     },
     "metadata": {
      "needs_background": "light"
     },
     "output_type": "display_data"
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Correct Label: 0\n",
      "Predicted Label: 0\n",
      "Label : Confidence Score\n",
      "0 :  0.9998058677\n",
      "1 :  0.0000000295\n",
      "2 :  0.0000214258\n",
      "3 :  0.0000235248\n",
      "4 :  0.0000000300\n",
      "5 :  0.0000175726\n",
      "6 :  0.0001226896\n",
      "7 :  0.0000002640\n",
      "8 :  0.0000016808\n",
      "9 :  0.0000069882\n",
      "\n",
      "\n",
      "Incorrectly Classified\n"
     ]
    },
    {
     "data": {
      "image/png": "iVBORw0KGgoAAAANSUhEUgAAAP8AAAD8CAYAAAC4nHJkAAAABHNCSVQICAgIfAhkiAAAAAlwSFlzAAALEgAACxIB0t1+/AAAADl0RVh0U29mdHdhcmUAbWF0cGxvdGxpYiB2ZXJzaW9uIDMuMC4yLCBodHRwOi8vbWF0cGxvdGxpYi5vcmcvOIA7rQAADdRJREFUeJzt3X2MHHUdx/HPt+e1lQLSWopNKbbWIhKilawtsT4UCVgetBADoSGkKvFAxYDyh9hoaEw0BBXFhxAPPC2JICSCrdIoUMHiE3CtldIHS60n1Ja2pgjVSB/uvv5xUz3KzW+X3dmd7X3fr4Tc7nxndr5Z+rnZvd/M/MzdBSCeUWU3AKAchB8IivADQRF+ICjCDwRF+IGgCD8QFOEHgiL8QFCvaeXORtsYH6txrdwlEMpL+rf2+z6rZd2Gwm9m8yXdIqlD0u3ufmNq/bEapzl2ViO7BJDwmK+sed26P/abWYek70o6V9Kpkhaa2an1vh6A1mrkO/9sSVvcfau775f0Y0kLimkLQLM1Ev4pkp4d8nxbtuxlzKzLzHrNrPeA9jWwOwBFaiT8w/1R4RXXB7t7t7tX3L3SqTEN7A5AkRoJ/zZJU4c8P1HS9sbaAdAqjYT/CUkzzWy6mY2WdKmk5cW0BaDZ6h7qc/eDZna1pF9qcKivx93XF9YZgKZqaJzf3VdIWlFQLwBaiNN7gaAIPxAU4QeCIvxAUIQfCIrwA0ERfiAowg8ERfiBoAg/EBThB4Ii/EBQhB8IivADQRF+ICjCDwRF+IGgCD8QFOEHgiL8QFCEHwiK8ANBEX4gKMIPBEX4gaAIPxAU4QeCIvxAUIQfCKqhWXrNrE/SXkn9kg66e6WIpgA0X0Phz5zp7v8o4HUAtBAf+4GgGg2/S3rAzFabWVcRDQFojUY/9s919+1mNknSg2a2yd1XDV0h+6XQJUljdVSDuwNQlIaO/O6+Pfu5S9J9kmYPs063u1fcvdKpMY3sDkCB6g6/mY0zs2MOPZZ0jqSnimoMQHM18rH/BEn3mdmh17nT3X9RSFcAmq7u8Lv7VklvL7CXsDomvj5Z33jT9GR9ywe681/b0h/u+n0gWa9m/qYFyXrnp1+bv+8NmxvaNxrDUB8QFOEHgiL8QFCEHwiK8ANBEX4gqCKu6kMV+85/Z7L+4ZseSNaXHZeupwbrBrw/ue012+cm61dMXJWsrzjlp8n6H+/P727J6eckt+1//vlkHY3hyA8ERfiBoAg/EBThB4Ii/EBQhB8IivADQTHOX4CXPviKGxi9TM93bk7WT3pN/mWvkvTblzqT9c9+7crc2nFP709uO/rX65L1z829Klnv+OKuZP3npyzLrT136SnJbY+/9ffJOhrDkR8IivADQRF+ICjCDwRF+IGgCD8QFOEHgmKcv0Yd48fn1s77ysPJbauN41//XPp6/w1XVBkPX1v/eLhXqXc8siZd3z4jWV+dmMnh/s9/NbntZU9fk6x3PrQ6WUcaR34gKMIPBEX4gaAIPxAU4QeCIvxAUIQfCKrqOL+Z9Ui6QNIudz8tWzZB0t2Spknqk3SJu4/om6xv+tLJubVlEx5Kbnugyr3zH/3WnGR9fAPj+M3Wv/kvyfqX5szPrW36QvocgSnHps9CSN/lANXUcuT/oaTD/w9eL2mlu8+UtDJ7DuAIUjX87r5K0p7DFi+QtDR7vFTShQX3BaDJ6v3Of4K775Ck7Oek4loC0ApNP7ffzLokdUnSWB3V7N0BqFG9R/6dZjZZkrKfuXdxdPdud6+4e6VTY+rcHYCi1Rv+5ZIWZY8XScq/RSuAtlQ1/GZ2l6TfS3qLmW0zsysk3SjpbDN7WtLZ2XMARxBzr3ZFd3GOtQk+x85q2f6KdMH6/NMYrjpua3Lb63ackaz/uXKgrp6Awz3mK/Wi77Fa1uUMPyAowg8ERfiBoAg/EBThB4Ii/EBQ3Lq7Rhcdsz5RTd+ae8XDlWR9htr3kl2MXBz5gaAIPxAU4QeCIvxAUIQfCIrwA0ERfiAowg8ERfiBoAg/EBThB4Ii/EBQhB8IivADQRF+ICiu56/R+3/3ydza+vf8ILntVxbcmazfsPeyZH3SmoPJ+tifP55b6z/z9OS2f3/P2GR9/8z/JOvXnv6rZL2Zvv2z85L1123Or03o4R4KHPmBoAg/EBThB4Ii/EBQhB8IivADQRF+IKiqU3SbWY+kCyTtcvfTsmVLJH1c0u5stcXuvqLazo7kKbo7jj8+t3buI4kBZVWfwruaFwZeStbn/u4TubV753wvue3JnaPr6ulIsPI/R+XWvn3WOcltD/7t2aLbaYmip+j+oaT5wyz/hrvPyv6rGnwA7aVq+N19laQ9LegFQAs18p3/ajN70sx6zGx8YR0BaIl6w3+rpBmSZknaIenreSuaWZeZ9ZpZ7wHtq3N3AIpWV/jdfae797v7gKTbJM1OrNvt7hV3r3RqTL19AihYXeE3s8lDnl4k6ali2gHQKlUv6TWzuyTNkzTRzLZJukHSPDObJckl9Um6sok9AmiCquP8RTqSx/lTXlx4RrL+ts/8KVl/eOvMIttpqRNv70zWbaB5++77WPrFN515e27tQ+dfntx2YO2GunoqW9Hj/ABGIMIPBEX4gaAIPxAU4QeCIvxAUNy6uwDH3vWHZL3v7o5kffrAk0W2E8Z3uzfWve2mq45O1k++qu6XPmJw5AeCIvxAUIQfCIrwA0ERfiAowg8ERfiBoBjnb4WB/rI7GJFGqYHrha11l7K3K478QFCEHwiK8ANBEX4gKMIPBEX4gaAIPxAU4/xoWy9clr4l+vte+0SVV8g/tk1YzT99jvxAUIQfCIrwA0ERfiAowg8ERfiBoAg/EFTVwU4zmyrpDklvkDQgqdvdbzGzCZLuljRNUp+kS9z9+ea1imheeHP62DSqgWPXpMdfSNabOLN426jl3Tso6Tp3f6ukMyR9ysxOlXS9pJXuPlPSyuw5gCNE1fC7+w53X5M93itpo6QpkhZIWpqttlTShc1qEkDxXtXnJjObJukdkh6TdIK775AGf0FImlR0cwCap+bwm9nRkn4i6Vp3f/FVbNdlZr1m1ntA++rpEUAT1BR+M+vUYPB/5O73Zot3mtnkrD5Z0q7htnX3bnevuHulU2OK6BlAAaqG38xM0vclbXT3m4eUlktalD1eJGlZ8e0BaJZarmucK+lySevMbG22bLGkGyXdY2ZXSHpG0sXNaRFRzTjzrw1t3/XsvNyar9/S0GuPBFXD7+6/kWQ55bOKbQdAq3CGHxAU4QeCIvxAUIQfCIrwA0ERfiAo7l+MEWvvgfwzSv3A3hZ20p448gNBEX4gKMIPBEX4gaAIPxAU4QeCIvxAUIzzY8QaPao/vziqI73xQGLbEYIjPxAU4QeCIvxAUIQfCIrwA0ERfiAowg8ExTg/2tZfdk9MrzAzXV467aHc2ofednly24G1G9IvPgJw5AeCIvxAUIQfCIrwA0ERfiAowg8ERfiBoKqO85vZVEl3SHqDpAFJ3e5+i5ktkfRxSbuzVRe7+4pmNYp4pn/yuWT9o8vSM8Q//sxJubUZm7fU1dNIUstJPgclXefua8zsGEmrzezBrPYNd/9a89oD0CxVw+/uOyTtyB7vNbONkqY0uzEAzfWqvvOb2TRJ75D0WLboajN70sx6zGx8zjZdZtZrZr0HtK+hZgEUp+bwm9nRkn4i6Vp3f1HSrZJmSJqlwU8GXx9uO3fvdveKu1c6lT93GoDWqin8ZtapweD/yN3vlSR33+nu/e4+IOk2SbOb1yaAolUNv5mZpO9L2ujuNw9ZPnnIahdJeqr49gA0Sy1/7Z8r6XJJ68xsbbZssaSFZjZLkkvqk3RlUzpEWP27dyfru9+V3n66/plbG6inoRGmlr/2/0aSDVNiTB84gnGGHxAU4QeCIvxAUIQfCIrwA0ERfiAowg8ERfiBoAg/EBThB4Ii/EBQhB8IivADQRF+IChz99btzGy3pL8NWTRR0j9a1sCr0669tWtfEr3Vq8je3ujux9eyYkvD/4qdm/W6e6W0BhLatbd27Uuit3qV1Rsf+4GgCD8QVNnh7y55/ynt2lu79iXRW71K6a3U7/wAylP2kR9ASUoJv5nNN7M/m9kWM7u+jB7ymFmfma0zs7Vm1ltyLz1mtsvMnhqybIKZPWhmT2c/h50mraTelpjZ37P3bq2ZnVdSb1PN7GEz22hm683smmx5qe9doq9S3reWf+w3sw5JmyWdLWmbpCckLXT3DS1tJIeZ9UmquHvpY8Jm9l5J/5J0h7ufli27SdIed78x+8U53t0/1ya9LZH0r7Jnbs4mlJk8dGZpSRdK+ohKfO8SfV2iEt63Mo78syVtcfet7r5f0o8lLSihj7bn7qsk7Tls8QJJS7PHSzX4j6flcnprC+6+w93XZI/3Sjo0s3Sp712ir1KUEf4pkp4d8nyb2mvKb5f0gJmtNrOuspsZxgnZtOmHpk+fVHI/h6s6c3MrHTazdNu8d/XMeF20MsI/3Ow/7TTkMNfdT5d0rqRPZR9vUZuaZm5ulWFmlm4L9c54XbQywr9N0tQhz0+UtL2EPobl7tuzn7sk3af2m31456FJUrOfu0ru53/aaebm4WaWVhu8d+0043UZ4X9C0kwzm25moyVdKml5CX28gpmNy/4QIzMbJ+kctd/sw8slLcoeL5K0rMReXqZdZm7Om1laJb937TbjdSkn+WRDGd+U1CGpx92/3PImhmFmb9Lg0V4anMT0zjJ7M7O7JM3T4FVfOyXdIOmnku6RdJKkZyRd7O4t/8NbTm/zNPjR9X8zNx/6jt3i3t4t6VFJ6/T/CXkXa/D7dWnvXaKvhSrhfeMMPyAozvADgiL8QFCEHwiK8ANBEX4gKMIPBEX4gaAIPxDUfwHXeuW5QTmIJgAAAABJRU5ErkJggg==\n",
      "text/plain": [
       "<Figure size 432x288 with 1 Axes>"
      ]
     },
     "metadata": {
      "needs_background": "light"
     },
     "output_type": "display_data"
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Correct Label: 9\n",
      "Predicted Label: 5\n",
      "Label : Confidence Score\n",
      "0 :  0.0000000077\n",
      "1 :  0.0000000000\n",
      "2 :  0.0000000009\n",
      "3 :  0.0028524487\n",
      "4 :  0.0000001411\n",
      "5 :  0.7430792451\n",
      "6 :  0.0000000029\n",
      "7 :  0.0000000082\n",
      "8 :  0.0301246010\n",
      "9 :  0.2239435762\n"
     ]
    }
   ],
   "source": [
    "# TODO: add your code here.\n",
    "prediction = model.predict(x_test)\n",
    "print(\"Correctly Classified\")\n",
    "plt.imshow(x_test[3], interpolation='nearest')\n",
    "plt.show()\n",
    "print(\"Correct Label:\", y_test[3])\n",
    "print(\"Predicted Label:\", tf.math.argmax(prediction[3]).numpy())\n",
    "print(\"Label : Confidence Score\")\n",
    "for i in range(0,10):\n",
    "    print(i,\": \",'{:.10f}'.format(prediction[3][i]))\n",
    "\n",
    "#find incorrect label\n",
    "#for i in range(0,9999):\n",
    "#    if(y_test[i]!=tf.math.argmax(prediction[i]).numpy()):\n",
    "#        print(i)\n",
    "#        break\n",
    "print(\"\\n\\nIncorrectly Classified\")\n",
    "plt.imshow(x_test[104], interpolation='nearest')\n",
    "plt.show()\n",
    "print(\"Correct Label:\", y_test[104])\n",
    "print(\"Predicted Label:\", tf.math.argmax(prediction[104]).numpy())\n",
    "print(\"Label : Confidence Score\")\n",
    "for i in range(0,10):\n",
    "    print(i,\": \",'{:.10f}'.format(prediction[104][i]))"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Answer\n",
    "The correctly classified test had a very high confidence score.  The incorrect one had two high confidence scores where the label 5 was higher than the correct label 9, but 9 had the next highest.  I would also question the number actually being 9 as well so it did a good job."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "colab_type": "text",
    "id": "ca0nFGJdv3H2"
   },
   "source": [
    "## Part 2: Subclassed models\n",
    "\n",
    "In this part of the assignment, you'll work with the Keras Subclassing API. Instead of using a built-in method (```model.fit```) you will train models using a GradientTape.\n",
    "\n",
    "Here are a few code examples that will help you with this part of the assignment:\n",
    "\n",
    "* [Get started for experts](https://www.tensorflow.org/beta/tutorials/quickstart/advanced)\n",
    "* [Tensors and operations](https://www.tensorflow.org/beta/tutorials/eager/basics)\n",
    "* [Keras overview](https://www.tensorflow.org/beta/guide/keras/overview)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "colab_type": "text",
    "id": "xB6r75B5teHv"
   },
   "source": [
    "### Download and prepare a dataset\n",
    "This is similar to the above, except now we'll use ```tf.data``` to batch and shuffle the data, instead of the utilities baked into ```model.fit```. It's not necessary for this assignment, but if you wish, you can learn how to use tf.data [here](https://www.tensorflow.org/beta/tutorials/load_data/images)."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 17,
   "metadata": {
    "colab": {},
    "colab_type": "code",
    "id": "kYbkeJJqtm0h"
   },
   "outputs": [],
   "source": [
    "# Download a dataset\n",
    "(x_train, y_train), (x_test, y_test) = tf.keras.datasets.mnist.load_data()\n",
    "\n",
    "# Batch and shuffle the data\n",
    "train_ds = tf.data.Dataset.from_tensor_slices(\n",
    "    (x_train.astype('float32') / 255, y_train)).shuffle(1024).batch(32)\n",
    "\n",
    "test_ds = tf.data.Dataset.from_tensor_slices(\n",
    "    (x_test.astype('float32') / 255, y_test)).batch(32)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 23,
   "metadata": {
    "colab": {},
    "colab_type": "code",
    "id": "_JlSs-3qvCgi"
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "tf.Tensor(3, shape=(), dtype=uint8)\n"
     ]
    },
    {
     "data": {
      "image/png": "iVBORw0KGgoAAAANSUhEUgAAAP8AAAD8CAYAAAC4nHJkAAAABHNCSVQICAgIfAhkiAAAAAlwSFlzAAALEgAACxIB0t1+/AAAADl0RVh0U29mdHdhcmUAbWF0cGxvdGxpYiB2ZXJzaW9uIDMuMC4yLCBodHRwOi8vbWF0cGxvdGxpYi5vcmcvOIA7rQAADVBJREFUeJzt3W+MVfWdx/HPZ13AKMR/DUIoXdlqzG78Q3FiVmmImwbiLiSIsaY+wn8dTGqyNdUsMTHggzW6Vro8MMQhJcWkpa2xrZg0u0XdxGo2BjSVP2XbYsPSWfnTBmLBJ2Xwuw/msJni3N8d7px7z4Xv+5WQufd8zzn3mxs+c86d3zn354gQgHz+oukGADSD8ANJEX4gKcIPJEX4gaQIP5AU4QeSIvxAUoQfSOove/litrmcEOiyiPBE1pvUkd/27bZ/ZXuf7dWT2ReA3nKn1/bbvkDSryUtljQsabukeyLil4VtOPIDXdaLI//NkvZFxG8j4k+Svi9p+ST2B6CHJhP+OZJ+N+b5cLXsz9getL3D9o5JvBaAmk3mD37jnVp86rQ+IoYkDUmc9gP9ZDJH/mFJc8c8/6ykDyfXDoBemUz4t0u6xvY821MlfUXS1nraAtBtHZ/2R8SI7Ycl/YekCyRtiog9tXUGoKs6Hurr6MX4zA90XU8u8gFw7iL8QFKEH0iK8ANJEX4gKcIPJEX4gaQIP5AU4QeSIvxAUoQfSIrwA0kRfiApwg8kRfiBpAg/kBThB5Ii/EBShB9IivADSRF+ICnCDyRF+IGkCD+QFOEHkiL8QFKEH0iK8ANJEX4gqY6n6JYk2/slHZd0StJIRAzU0RSA7ptU+Ct/HxF/qGE/AHqI034gqcmGPyT9zPa7tgfraAhAb0z2tH9hRHxoe6akbbb/OyLeHLtC9UuBXwxAn3FE1LMje62kExHxzcI69bwYgJYiwhNZr+PTftsX255x+rGkJZJ2d7o/AL01mdP+KyX92Pbp/XwvIv69lq4AdF1tp/0TejFO+8d11113Fes33nhjx/ueM2dOsT5lypRiff/+/cX6/fffX6wfP368Ze3JJ58sbvvSSy8V6yMjI8V6Vl0/7QdwbiP8QFKEH0iK8ANJEX4gKcIPJMVQXx9YunRpsb5q1apifd++fS1rDz74YEc99cJFF11UrO/du7dYX7RoUbF+7Nixs+7pfMBQH4Aiwg8kRfiBpAg/kBThB5Ii/EBShB9IinF+dNXUqVNb1t5///3itvPmzSvWr7766mJ9eHi4WD9fMc4PoIjwA0kRfiApwg8kRfiBpAg/kBThB5KqY5ZeJHbhhRcW6xs2bGhZu/baa4vbPv/888V61nH8unDkB5Ii/EBShB9IivADSRF+ICnCDyRF+IGk2t7Pb3uTpGWSjkTEddWyyyX9QNJVkvZLujsi2n5JOvfzn3tmzZpVrD/11FPF+r333tuytn379uK2S5YsKdY/+uijYj2rOu/n/46k289YtlrS6xFxjaTXq+cAziFtwx8Rb0o6esbi5ZI2V483S7qj5r4AdFmnn/mvjIiDklT9nFlfSwB6oevX9tselDTY7dcBcHY6PfIftj1bkqqfR1qtGBFDETEQEQMdvhaALug0/Fslrawer5T0Sj3tAOiVtuG3vUXSf0m61vaw7QckPS1pse3fSFpcPQdwDmn7mT8i7mlR+lLNvaBDpXvqb7nlluK29913X7Hebqx95szy33oPHDjQsvb00+VjBuP43cUVfkBShB9IivADSRF+ICnCDyRF+IGkmKK7D0ybNq1YX726fNPkrbfe2rK2ePHijno67eOPPy7Wt23bVqw/8MADLWvHjrW9CxwdYIpuAEWEH0iK8ANJEX4gKcIPJEX4gaQIP5AUU3T3gccee6xYX7NmTcf7nuw4/XPPPVesv/3222fdE/oDR34gKcIPJEX4gaQIP5AU4QeSIvxAUoQfSIpx/j7Qbqx8586dxfoNN9zQsnby5MnitocOHSrWd+3aVazj3MWRH0iK8ANJEX4gKcIPJEX4gaQIP5AU4QeSavu9/bY3SVom6UhEXFctWyvpq5J+X632eET8tO2L8b39HZk+fXqxvmLFipa10vfmS+VrBCTpgw8+KNbXrVtXrL/66qstaydOnChui87U+b3935F0+zjLvxUR86t/bYMPoL+0DX9EvCnpaA96AdBDk/nM/7DtnbY32b6sto4A9ESn4d8g6fOS5ks6KKnlF73ZHrS9w/aODl8LQBd0FP6IOBwRpyLiE0kbJd1cWHcoIgYiYqDTJgHUr6Pw25495ukKSbvraQdAr7S9pdf2Fkm3SfqM7WFJayTdZnu+pJC0X9KqLvYIoAvajvPX+mKM8/edZcuWFetr164t1hcsWFCsb9mypWVt1aryMYPrADpT5zg/gPMQ4QeSIvxAUoQfSIrwA0kRfiAphvpQNH/+/GL9jTfeKNYvvfTSlrXrr7++uO2ePXuKdYyPoT4ARYQfSIrwA0kRfiApwg8kRfiBpAg/kBTj/JiUdl8NvnHjxpa19evXF7d95JFHOuopO8b5ARQRfiApwg8kRfiBpAg/kBThB5Ii/EBSbb+3Hyi54oorOt521qxZNXaCs8WRH0iK8ANJEX4gKcIPJEX4gaQIP5AU4QeSans/v+25kl6UNEvSJ5KGImK97csl/UDSVZL2S7o7Io612Rf3859jFi5cWKy/9tprxfq0adNa1hYtWlTc9q233irWMb467+cfkfSNiPgbSX8n6Wu2/1bSakmvR8Q1kl6vngM4R7QNf0QcjIj3qsfHJe2VNEfSckmbq9U2S7qjW00CqN9Zfea3fZWkL0h6R9KVEXFQGv0FIWlm3c0B6J4JX9tve7qklyV9PSL+aE/oY4VsD0oa7Kw9AN0yoSO/7SkaDf53I+JH1eLDtmdX9dmSjoy3bUQMRcRARAzU0TCAerQNv0cP8d+WtDci1o0pbZW0snq8UtIr9bcHoFsmMtT3RUk/l7RLo0N9kvS4Rj/3/1DS5yQdkPTliDjaZl8M9fWZ2bNnF+tbt24t1m+66aZifenSpS1r7YYJT548WaxjfBMd6mv7mT8i3pLUamdfOpumAPQPrvADkiL8QFKEH0iK8ANJEX4gKcIPJMVXd5/n2n099mTH8V9++eVifffu3S1rjOM3iyM/kBThB5Ii/EBShB9IivADSRF+ICnCDyTFOP95YHCw9bekPfvss8VtZ8yYUaw/88wzxfoTTzxRrI+MjBTraA5HfiApwg8kRfiBpAg/kBThB5Ii/EBShB9IinH+HrjkkkuK9YceeqhYv/POO4v1BQsWtKwdOnSouO3q1eXJlYeGhor1U6dOFevoXxz5gaQIP5AU4QeSIvxAUoQfSIrwA0kRfiApR0R5BXuupBclzZL0iaShiFhve62kr0r6fbXq4xHx0zb7Kr/YeeqFF14o1kv340/E+vXrW9YeffTR4rbcb3/+iQhPZL2JXOQzIukbEfGe7RmS3rW9rap9KyK+2WmTAJrTNvwRcVDSwerxcdt7Jc3pdmMAuuusPvPbvkrSFyS9Uy162PZO25tsX9Zim0HbO2zvmFSnAGo14fDbni7pZUlfj4g/Stog6fOS5mv0zOC58baLiKGIGIiIgRr6BVCTCYXf9hSNBv+7EfEjSYqIwxFxKiI+kbRR0s3daxNA3dqG37YlfVvS3ohYN2b57DGrrZDUejpWAH1nIkN9X5T0c0m7NDrUJ0mPS7pHo6f8IWm/pFXVHwdL+0o51Af00kSH+tqGv06EH+i+iYafK/yApAg/kBThB5Ii/EBShB9IivADSRF+ICnCDyRF+IGkCD+QFOEHkiL8QFKEH0iK8ANJ9XqK7j9I+p8xzz9TLetH/dpbv/Yl0Vun6uztrya6Yk/v5//Ui9s7+vW7/fq1t37tS6K3TjXVG6f9QFKEH0iq6fAPNfz6Jf3aW7/2JdFbpxrprdHP/ACa0/SRH0BDGgm/7dtt/8r2Pturm+ihFdv7be+y/YumpxirpkE7Ynv3mGWX295m+zfVz3GnSWuot7W2/7d6735h+x8b6m2u7f+0vdf2Htv/VC1v9L0r9NXI+9bz037bF0j6taTFkoYlbZd0T0T8sqeNtGB7v6SBiGh8TNj2IkknJL0YEddVy/5V0tGIeLr6xXlZRPxzn/S2VtKJpmduriaUmT12ZmlJd0i6Vw2+d4W+7lYD71sTR/6bJe2LiN9GxJ8kfV/S8gb66HsR8aako2csXi5pc/V4s0b/8/Rci976QkQcjIj3qsfHJZ2eWbrR967QVyOaCP8cSb8b83xY/TXld0j6me13bQ823cw4rjw9M1L1c2bD/Zyp7czNvXTGzNJ98951MuN13ZoI/3izifTTkMPCiFgg6R8kfa06vcXETGjm5l4ZZ2bpvtDpjNd1ayL8w5Lmjnn+WUkfNtDHuCLiw+rnEUk/Vv/NPnz49CSp1c8jDffz//pp5ubxZpZWH7x3/TTjdRPh3y7pGtvzbE+V9BVJWxvo41NsX1z9IUa2L5a0RP03+/BWSSurxyslvdJgL3+mX2ZubjWztBp+7/ptxutGLvKphjL+TdIFkjZFxL/0vIlx2P5rjR7tpdE7Hr/XZG+2t0i6TaN3fR2WtEbSTyT9UNLnJB2Q9OWI6Pkf3lr0dpvOcubmLvXWambpd9Tge1fnjNe19MMVfkBOXOEHJEX4gaQIP5AU4QeSIvxAUoQfSIrwA0kRfiCp/wN+UhMAZ/PQrgAAAABJRU5ErkJggg==\n",
      "text/plain": [
       "<Figure size 432x288 with 1 Axes>"
      ]
     },
     "metadata": {
      "needs_background": "light"
     },
     "output_type": "display_data"
    }
   ],
   "source": [
    "# A quick example of iterating over a dataset object\n",
    "for image, label in train_ds.take(1):\n",
    "  plt.imshow(image[0], plt.get_cmap('gray'))\n",
    "  print(label[0])"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "colab_type": "text",
    "id": "0Nmw1h6stTg5"
   },
   "source": [
    "### Define and train a linear model\n",
    "\n",
    "You may see some warnings running the below code (that's okay, just a matter of TF 2.0 being under active development)."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 24,
   "metadata": {
    "colab": {},
    "colab_type": "code",
    "id": "BWGJoufMtbHA"
   },
   "outputs": [],
   "source": [
    "class MyLinearModel(Model):\n",
    "  def __init__(self):\n",
    "    super(MyLinearModel, self).__init__()\n",
    "    self.flatten = Flatten()\n",
    "    self.d1 = Dense(10, activation='softmax', name=\"dense1\")\n",
    "\n",
    "  def call(self, x):\n",
    "    x = self.flatten(x)\n",
    "    return self.d1(x)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 25,
   "metadata": {
    "colab": {},
    "colab_type": "code",
    "id": "35tIz37EttdP"
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "WARNING:tensorflow:From /Users/Muf/anaconda3/lib/python3.7/site-packages/tensorflow_core/python/ops/math_grad.py:1394: where (from tensorflow.python.ops.array_ops) is deprecated and will be removed in a future version.\n",
      "Instructions for updating:\n",
      "Use tf.where in 2.0, which has the same broadcast rule as np.where\n",
      "Epoch 0, Loss: 0.26419585943222046\n",
      "Epoch 1, Loss: 0.1068180650472641\n",
      "Epoch 2, Loss: 0.06901909410953522\n",
      "Epoch 3, Loss: 0.10137681663036346\n",
      "Epoch 4, Loss: 0.3517175316810608\n"
     ]
    }
   ],
   "source": [
    "model = MyLinearModel()\n",
    "\n",
    "loss_fn = tf.keras.losses.SparseCategoricalCrossentropy()\n",
    "optimizer = tf.keras.optimizers.Adam()\n",
    "\n",
    "# For each epoch\n",
    "for epoch in range(5):\n",
    "\n",
    "  # For each batch of images and labels\n",
    "  for images, labels in train_ds:\n",
    "\n",
    "    # Open a GradientTape.\n",
    "    with tf.GradientTape() as tape:\n",
    "\n",
    "      # Forward pass\n",
    "      predictions = model(images)\n",
    "\n",
    "      # Calculate loss\n",
    "      loss = loss_fn(labels, predictions)\n",
    "\n",
    "    # Backprop to calculate gradients\n",
    "    gradients = tape.gradient(loss, model.trainable_variables)\n",
    "\n",
    "    # Gradient descent step\n",
    "    optimizer.apply_gradients(zip(gradients, model.trainable_variables))\n",
    "    \n",
    "  print(\"Epoch {}, Loss: {}\".format(epoch, loss))"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "colab_type": "text",
    "id": "mEO51Mvi1jOT"
   },
   "source": [
    "Note: you may have noticed that the above code runs slowly (it's executing eagerly). Later in this notebook, you will compile your code (to run it in graph mode) using ```@tf.function```. The general workflow is to write your code without using tf.function (as shown above, which makes for easier debugging). Once you've finished debugging your model, you can add ```@tf.function``` for performance if necessary."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "colab_type": "text",
    "id": "dj7Y8JWgwv9Z"
   },
   "source": [
    "### 2a: Visualize the learned weights\n",
    "\n",
    "We can interpret a linear model by looking at the weights of the fully connected layer. Modify the below code to create a plot similar to the following:\n",
    "\n",
    "![Plot of weights](https://storage.googleapis.com/applied-dl/im/a1-3.png)\n",
    "\n",
    "If you find this section tricky, it is not necessary to complete it to continue with the rest of the assignment.\n",
    "\n",
    "\n",
    "**TODO**\n",
    "\n",
    "Modify the below code to retrieve the learned weights. You can use either the public API of a model ```model.get_layer(name)``` then retrieve the weights from that, or (because our model is defined using the Subclassing API), you can access the dense layer directly ```model.d1```."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 26,
   "metadata": {
    "colab": {},
    "colab_type": "code",
    "id": "JiQZV03RuWHM"
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "(784, 10)\n"
     ]
    }
   ],
   "source": [
    "# There are two ways to retrieve the weights. You can use the public API\n",
    "# (model.get_layer(name).get_weights()), or, you can access the dense layer \n",
    "# directly (model.dl) then find the accessor method, or again, access the\n",
    "# variable directly.\n",
    "# Python tip: try ```dir(model.d1)```\n",
    "\n",
    "# Modify me\n",
    "#model.summary()\n",
    "weights, bias = model.get_layer(\"dense1\").get_weights()\n",
    "#dir(model.d1)\n",
    "print(weights.shape)\n",
    "#print(weights[:,0])"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 27,
   "metadata": {
    "colab": {},
    "colab_type": "code",
    "id": "oz3VV2EiuY7X"
   },
   "outputs": [
    {
     "data": {
      "image/png": "iVBORw0KGgoAAAANSUhEUgAABH4AAACNCAYAAADB/L29AAAABHNCSVQICAgIfAhkiAAAAAlwSFlzAAALEgAACxIB0t1+/AAAADl0RVh0U29mdHdhcmUAbWF0cGxvdGxpYiB2ZXJzaW9uIDMuMC4yLCBodHRwOi8vbWF0cGxvdGxpYi5vcmcvOIA7rQAAIABJREFUeJzsnXl8VdXV/p8T0xhijAEjwRgxUoyIgIgTToioiKioOOE8lNZqHftqq9X6osWh6ltxqtQ64DxWra2zAlJaJwoUERARIyKTEWKMMaYx9/cH9K5nPeGmBS/kZ7q+n48f98ne99xzzt577X0u61krSaVSCIIgCIIgCIIgCIIgCNofOW19AUEQBEEQBEEQBEEQBMG6IX74CYIgCIIgCIIgCIIgaKfEDz9BEARBEARBEARBEATtlPjhJwiCIAiCIAiCIAiCoJ0SP/wEQRAEQRAEQRAEQRC0U+KHnyAIgiAIgiAIgiAIgnZK/PATBEEQBEEQBEEQBEHQTokffv4NSZJ0SpLkqSRJvkyS5KMkSY5v62sK1owkSc5OkmRKkiRfJ0kyrq2vJ1hzkiTZMEmSu1bNwS+SJJmWJMlBbX1dwZqTJMkDSZIsTpKkNkmSuUmSjGzrawrWjiRJtkmSpCFJkgfa+lqCNSdJkomr+q9u1X/vtfU1BWtOkiQjkiSZvWqf+kGSJHu39TUF/zk0//713zdJktzS1tcVrBlJklQkSfJckiQrkiRZkiTJrUmS5Lb1dQX/OUmSbJckyfgkST5PkmRekiRHtPU1ZZv44effcxuARgClAE4AcHuSJNu37SUFa8giAKMB3N3WFxKsNbkAPgawD4BNAPwSwGNJklS04TUFa8c1ACpSqVQRgGEARidJslMbX1OwdtwG4O22vojgW3F2KpUqXPXftm19McGakSTJAQB+DeA0ABsDGABgfpteVLBG0PwrxMp3ja8APN7GlxWsOb8FsAzA5gD6YuV+9aw2vaLgP2bVj3R/BPBnAJ0A/AjAA0mSVLbphWWZ+OGnFZIk2QjAkQB+mUql6lKp1GQAzwA4qW2vLFgTUqnUk6lU6mkAn7X1tQRrRyqV+jKVSo1KpVJVqVSqOZVK/RnAhwDiB4PvGKlU6t1UKvX1vw5X/ff9NrykYC1IkmQEgBoAr7b1tQTBfzFXALgylUq9sWpt/CSVSn3S1hcVrDVHYeWPB39p6wsJ1pitATyWSqUaUqnUEgAvAAhHge8OPQCUAbgxlUp9k0qlxgP4K9rZO3/88NM6lQC+SaVSc+lv/0BM5CBoU5IkKcXK+fluW19LsOYkSfLbJEnqAcwBsBjAc218ScEakCRJEYArAfxPW19L8K25JkmS6iRJ/pokycC2vpjgPydJkg0A7Axgs1WyhIWr5CUd2vragrXmFAD3pVKpVFtfSLDG3ARgRJIkBUmSbAHgIKz88Sf4bpBk+Fuv9X0h65L44ad1CgF8Ln/7HCvdaYMgaAOSJPkegAcB3JtKpea09fUEa04qlToLK+3o3gCeBPB1658I/j/jVwDuSqVSH7f1hQTfip8D6AZgCwB3APhTkiThfffdoRTA97DSS2RvrJSX7Ajgsra8qGDtSJKkK1bKg+5t62sJ1orXsNIxoBbAQgBTADzdplcUrAlzsNLb7qIkSb6XJMlgrJyPBW17WdklfvhpnToARfK3IgBftMG1BMF/PUmS5AC4Hyvjbp3dxpcTfAtWudJOBlAO4My2vp7gPyNJkr4A9gdwY1tfS/DtSKVSb6ZSqS9SqdTXqVTqXqx0ax/a1tcV/Md8ter/t6RSqcWpVKoawG8Qffhd5WQAk1Op1IdtfSHBmrFqb/oiVv5D1kYASgB0xMr4W8F3gFQq9U8AhwM4GMASrPRofgwrf8RrN8QPP60zF0BukiTb0N92QMhLgmC9kyRJAuAurPxXziNXGengu08uIsbPd4mBACoALEiSZAmACwEcmSTJ1La8qCArpLB6d/fg/0NSqdQKrHwpCVlQ++BkhLfPd5VOALYEcOuqH9I/A3AP4kfY7xSpVGpGKpXaJ5VKbZpKpQ7ESo/Yt9r6urJJ/PDTCqlU6kus/PX2yiRJNkqSZE8Ah2Glx0HwHSFJktwkSfIBbABggyRJ8iPF4neS2wFsB+DQVCr11b9rHPz/R5IknVelHi5MkmSDJEkOBHAcgPFtfW3Bf8wdWPlDXd9V/40F8CyAA9vyooI1I0mS4iRJDvzXepgkyQlYmRHqxba+tmCNuAfAOatsa0cA52NlVprgO0SSJHtgpeQysnl9B1nlbfchgDNX2dNirIzX9I+2vbJgTUiSpM+qNbEgSZILsTJD27g2vqysEj/8/HvOAtABK3V/DwM4M5VKhcfPd4vLsNIl+mIAJ64qhwb+O0SSJFsBOAMrXzSXJElSt+q/E9r40oI1I4WVsq6FAFYAuAHA+alU6o9telXBf0wqlapPpVJL/vUfVkqiG1Kp1KdtfW3BGvE9AKMBfAqgGsA5AA5PpVLvtelVBWvKrwC8jZUe6rMBTANwVZteUbA2nALgyVQqFaEkvrsMBzAEK23qPABNAC5o0ysK1pSTsDLhyDIA+wE4gLLQtguSCBwfBEEQBEEQBEEQBEHQPgmPnyAIgiAIgiAIgiAIgnZK/PATBEEQBEEQBEEQBEHQTokffoIgCIIgCIIgCIIgCNop8cNPEARBEARBEARBEARBO2X9prQePNgiSe+8s6+75x4rH3SQr3v++dXXNTT4doWFVi4u9nV1dVaePNnKeh18ju7drfxnyY45fbqVDzkk8/VWVFi5qsq3O/RQK+fn+7qmptV/js8NANtsk/k6+D7feitBNrj5ZuvDV17xdb16WblHD1/38cdW3nxzK38lWbm537780tctXGjlkhIrb7qpb/faa1bm58rPFPB9r/07YoSVP6VkNUuX+nZ8HdXVma93v/2srPfF/aTjgLnjjuz0IQA8+6z1I/cH4Mc9j3MAmDfPyvz8+DkALZ81w33Mz6imxrfr33/11zFlim/Hz0znPR/zXPzLX3y77baz8uzZvm7ffa3M9uGNNzJf7wsvZK7r2jU7/dixo/Uh3xsAzJmTLjaJneRf+3P42fXt69rV0/3pvxDkb7xxulz3hSUh0QUln+3TP/9pZf47ALz9tpW1D8n+8ajKFRtTR/dcyM9baNB+I/g+8/SZ8rxdtix7czEvz/qRnxHgx7ZeD88Xep5NOraJ3M0283/YYIPM52f23tvKM2emi42yHvHzy+V5A6BuwoR02fWP2sONNrJyhw6uqpnOkdOli1VsuaU/B4953SewPV+xIiv9OGMG0n2oZmzbba38nuTL4iWTh6VeMi/tuuzyY2DzpMsRX9eSJVbW6cZdQ10NwA+RXJrsNPUAAPvvb2VdWvkcXOZr12vUZYgZNgzZm4tXXWVzkfcRADBkiJV5zQb8msnrk86p3Fa23Nxh3Cm6b3z99dV//rjj/DHbDh1QvD7zwNDv0sHBcAeVl1tZB96pp1pZbe/771t52rTs9CPvbT75xNfx5OH+BHy/cX8qG25o5c8+83X8HHhS7LOPb/fmm1bmyaJ7GzYQvEYCwEcf/fvvBfx9qnHivso0hhXt3xMoserBB2dvLnbunHl/QwahSddMIpfH7/e+5yv5c/rOOW1authAzzO/d2/fjg0zz7cbb/TtjjgiXWzkd134fUYzzb8cvedvvkEmaun9Ko/+ns/rNuDns44FnvsLFmSnH3fc0fpQnn8Djed8XsQA1JBtKaa9Zot3Pb5mOX899S8/E903YpddVnPhaPmOwPZOvquZ9sD19PdCvnb4vXKh7lno/Dymc9UG036pVsa+6/tUKmMfhsdPEARBEARBEARBEARBOyV++AmCIAiCIAiCIAiCIGinJKlU6t+3yhZ9+tiXqespuyyp3IVdsdg9TV2g2FdYz8GSkrPPtvLIkb4du5mTS9XSv8x1zUr7b73adi145BErL17s61591crsqgn4+5w40coqqeH7GjjQ17Fr2jPPZMd17xe/sD5UP/DDD7eyuvRm6ht1fWa3VJbnAWgcODhdznv6Matgd1jA+b4vauiULpeNGODb0RiccedbroqHVtclVKeu0Nw322/v6z74wMrcTypD4TqR2zjJ0EMPZc+NdtaszP3I7qt8bUDrckripckF6fLg7vNd3ZufdkuXWfHz+9/7c/z971Zmz+P5r/jz8fUvP+wwV9XprrvS5TPfPn213wt4b2v14j/xRCvzcC2YMsk3bE2mx3V9+mSnH7fbLt2H9eLeXcA3qP3EtpY/p2OP5W9sSwBgzz2tzB2lLvJsE8h9Gn/4g2/Htos7A/B24NZbrczyUQBgGRPPSwDNdM85dJ/NoiHJIdfcJnLLBYBcdkdevDh7czFJ0v1YJ1X8LzMF2o/sssx9xdIKwPfxXntlvg5y4V9Q4W0lKyS4iwe8cZ1rt3zkz9Jl6QJn9soKa+3g6ad9Q14D1DaxPaIvaBb3+RweC7I+NJJcLK8Vd+g1ob7epF5qMnnJVlUCbx14iqlag82HbgF4SeJtlXry83Xp9ovh7tCpmEnp25qs7PzzfR0PW75PNZ9sa1UGxsd9+mRR6jVggK2L+qV886ec4qqaLrssXa6iv4vVBJ9RutHJWHm32UfasXKujMpDjz7atVvw+OPpclcOKwBgzp/+ZO0ynA8AeJio+IllBQUsfVCJCsszSPICwBuJ557LTj8OH259yIs34PdTOgl4/eMBrJIw+lzzwEGuKmfJonR5RrU9TR3bPO55HpW9cLdvWFpqZZXp8vXyfenEZznvs8/6Og5p8M47qz+38vXX/pg3Z1dfnb252KGD9WMmOQ7QQgdaT+u2WzNVzsXzW8Nk8Fzn9UM7kvcEbLDUSJNxX7pJpav6xz+sPDh3/OqvDwBGj179dwG+v8jQ18umuoDkoLUPP+zqig44wA5eeik7/VhUlO7DBtlP5fN4VgkXy9r43VhDg/A+V595Jlkbj3nAT0Bup78NHHmklbnT9Bq5L/j9X79r3DhfxxskNhDyztnM81TIYTvc2BhSryAIgiAIgiAIgiAIgv824oefIAiCIAiCIAiCIAiCdkr88BMEQRAEQRAEQRAEQdBOWb8xfn72M/syjRlBcRxmPvWUq3IK/QcesDLHNQC8nk50uc/UmRaXNecaQkC19f9C5X7Tpl2VLt9006Wu7tprrbx4scXx2WWX/Vy7t9+2ODgnneTjvrAMceheFA/hxz/2F8Lies15yvGKPvwwO5rNc8+1PtR4Hqyp1AfLetWddrJyx46+HeuuRSte38Viw3AcAg1tVDaHdLKXUt9Iar2al19Ol5v9KdDp0UftgGOMqMaUdLHN3b12N2cKxQbi+5LUhS6l6W23+TrW8mYrThMAzJ9v/SjX05hboK3T8KNgef7w/Wtdu7/NLEqX9yhf4OpcmkTW6Krmlecwjx+J/eQmbStpWJfuOTxd5rA0AMDyYxkmLlzVlSPpXiiuAwA//jU4But3O3fOSj82UGyYfNWea9pRhrXQ/Fw1zhjPP9YmA3ipbo90efDPd7SKzTf35+DAInw+HvMAcNNNVtaYL9zf/Iw5T7Z+t8aZ4HExapSVn3jCt6OB0CyxEty/kmQpNgwAoLLSYvzIcynk2AYcqwEAKH4VKG4NJI36ouKe6bLG3eFlmKXkt9xyrW8Iiw1wySVbpcscLg/wS5CGmjj+cEt0mldsNuZXv/LtOOX53aPEdvAXcLAY3U+MGWNlji0FoJ5utGAdxPjhcBuAnzqaiXvpUitrqDqGb08zLc+ebWXO3qvX8Ze/cC55HvcrXLuNN74hXR471p+DwxdwV4h5cKG4NDRVpj2WwqaJpyzgn8Hw4VmM8XPddbYuapxCDf5GNH36abo8lf6uoZRoZ4JuUsfdz10s4ZNczB+OyaP/isuruEaf42gYHJJKdiaYReV6qeMdXgWVh515pm/I6/g11/g6HrDXXZedfrz8cuvD1oJPcfw5ADjqKCvzAJa4aPU9+qXLGs+rsqIxXe5cblGQbrjBt/szBWpim3zLLb4dZ4vXsDt7dF9mB/zuo3GNeP3U+CAcr4cnlcaQ4RT2GtOUH8J992VvLm69tfWjfifHhKG4NQB8HB4uf//7vh3HmGlqclVXvmL7Gw7NOnbsZ/DwRpKfrcSAcTY2z9X87ncW7/BHW1gMpuQQ/77Yu7fdy8UX+7Pzlm6TTay82+cv+YbcV7LPqqW4X0VZWhdraY9apAsBv3foppv3y/SeBk2BzrHW3n3X122xRbo494CfpMv8EwLg9z382qprGm8pNfwSTxd+d++UL1aT1xB9X+f9DMeY0v0wBQpskjUql/eLb70VMX6CIAiCIAiCIAiCIAj+24gffoIgCIIgCIIgCIIgCNop61fqxTIhdV9iNOcpp04j16a5PYa5ZivIm05d3Bb0sFTgXQuXWwW7dAJeN8Tp8/bZx7djH0xN8U2ygjePtHS3mkKa0VOwMohdPAum/803ZH9uTWfHKW6nTcu+1Evd69klT9KHsoznyaft90Z1X+VTqnvshRdamV1l1SObu7RnDxJxqat2JskR4Pzu5+aaVEIVbOz+p17FrFjs0MHKqlS642JKT64utnxzxxyTPTfau++2flStHI2jJ18pclU8Tn96Irkac99rQ5GeuLSI7Oqt6VX5QbGe4aKLfDseNOznCrgUnrPyM7to81dzBlUAYNUfK4PUhPVbbG66Uzc/2NeVkGSla9es9GMjudHmqbSJ3Z913NOkqyLfct/TPrW4SgX4uIjcqedIH3JaYvacFQGP++5OUreIyiyPaJJ2fM5+nJoUwKwxth70rCD3W85TDvhnJalQnWvy7NlZm4s11I/Fct1uYPJ6BHhtELsNq1ElfdHy3f245KYsZ2b7CgBvv82iD5v3u+8+0LU77DAra9ZflljzYx76xuW+IadpZxsNIIf7gJ/Vscf6c/CXq76NbVWW+vGll0zqpUpeRl3EWWHAS7l6gfPzUrU3KzRY0ahDm13QeZnRvQfL93S943vr18tkLfVNXr5QMIcET6yVANx68NJkEySp0pQ933Oql7m656Z0TpeHDs2i1Iv3N9pZvM7w3gpeKs4pdZ+TvSzbrwr5apbrzqd531na8Q6BP7NQbC/b0QJeZwHXkUso7XsXkWM0kjRqPjLDqk5NBJ5/7712wNIMwO8Nxo/Pfjp3lUAz13o566LcrukyP8q33/Yf+8MfkJHHH+exTimp4cdB795bp8vvvGNfduih/nrZVKnc8YMPrMw2QbeQvNdR+SdnMR+8kFLJ60nYsOhJuO7kk7M3F4cOtX788ENfd9ppVtaNNy00M6pNDKmvK61ElXDyVC4XNS137f42x2YZ26+uJSLxIWNcO9C/txZVzbAD2u8vOuRHrl1ZIYVTUA0uvSyx7DRXZXAsITrvPF/HA/vJJ7PTj5tvbn2oUi+W5rOxB/z44wGsix+PPRkHD83bNV3mvfrjj8tYcmJatnK10u4ZKvs9y5ZbmsRqwRMW4uO56l1dOx4jOuZ4fFbeeq4dqAacX0JEoui05F99FVKvIAiCIAiCIAiCIAiC/zbih58gCIIgCIIgCIIgCIJ2SvzwEwRBEARBEARBEARB0E5ZvzF+dt/dvmzrrX0di98kCErjmN+my6x13357f4rS1x6zAxXJcxpHFq6rjpuvg0WgKkDnC1EdMeeG5lhAqmPk2Coan+fjj61M8QrqL77SNStYSFE0VDTI99mvX3Y0m8ccY33IKfcAHxOD08oBvk/5uWogH9YsaupJHjMkiFw+cLhr1mnmJDtgHbf2IYu3L7jA1/G44Pvk+DSAD96j/cv6U0o9Pb6Dj7PBkmmVc548MPuxYQAAkyZZP8rYe2mhxTTSR8Zdcuznd9iBxsrigEyqQ+UAInzDGjSHA5Dw2NYgSTvtZGXOjwz4fqS0rM09erpmLH3mzKh6WdOmWeyKCy7o59r9Zq8n0+X76vyY5NSQPXtmJyZFM8WG0VS7bNWqpI7DG3FUCLFAYEW2noPruHclg7dLKcxlUXu769A6jnHBCvsSDaZCsTVcQBnA2f/L4W0oc+XZFEtE835yrJhnnsnaXHSxmjQ+T+/eVpY0vdMPPDBd5hTPOX/8oz8HX7emMCabNavanrQuJQVVFOOH9fdiO5qLLeZBzsMP+pP89a9WplSriy67zDXjbN86FjhmVEUr7Xpwql5Jx+yM2s03Z6Ufx4+3GD8UYgGAz0SscSYuvdT2B9/7nqUo1i3FCSdY+c03fR2b0NaWqmctBJmzdxrijc9X1qXZV/LaTbEXlm5S6Zq9+qqVjz/cW6cZ88wS9KmjmIUarI8HoVzkjy62cXbHHesoxo8GP+I4UrzuA36fwXF9NA01x7jRQFodO1qZ41qMGePbcbw7vQ7mq6+s/N57vo4XNbajMkCX0T60M88pAG/QQOfYRZ11L8Vp0mWNX3L99XYZWUoh7eIXanw7HkeyZ5n7gMXm4Hih//d//hSPP052DJrem+OCUHBA/I9r1bu3XQcPF17CAOCddzgN+G99JbhPG6l8mLQbYp94r6Or4fhg/Ip01shG166RUpDr9qvTPHtu2HXXrM1F3t/k8DoI+LkpY/bXt5h94ThId4xa5Nq5z4l9aaJ3uFze1/MJAdd5HClGHpGPASZ1FTyv+Lv4PRJANb3TlnCMI8DHz2ED/pOfuGZ/I/ut+71KtgOLF2enH7feOt2HTWJP3XPV3wN4j8F7FnkheQkWu1dDT914o+3lXn3V9jaD9vJj230XrUGzivdwzfjx6HdtsIGVOfSgmh9+FTrySB9jbOONL06X+dW9a90s185NVA38xZuPVuL6hsdPEARBEARBEARBEARBOyV++AmCIAiCIAiCIAiCIGin5P77JlmE3blqRBRA6b6d/yG8Rx57/5ZOeRYZG7bm4snuYhMm+HbkK938v/+bLmv64YpM+f4A1JBLG/+yVqTp7PgaNZX1tGnp4vJ3LUXkFLmtAw+0c952m0+pelbDRDvo52Upaw37oKuEh/xUm++/P+MpXEreU0/1leT2f983J7iqXvTV/fY3l9rCVjJ2OjdjTfvIfvGt5ZKlvnD5LwHgk0+s/PDDvm7jja1McoNBI7179pAxg9JlVvgBAJbSPOnaFVmDJ5L04+AGSltYPtDV9ZxDOYJZQqH50XkOq26EPzeHhB3cV4DXI7B0U/VwLO/SHMY87596Kl3MOdPLhCrrqtLly6WLzz/f5s7o0Va+/nqfYviQQ0zeVS5TnR9HT68yywqF4iO+nFyQ1e2YHaPzkBl2T9aRx6mCWX6lt+akWVQWa+fsZKPWkd0sYemE6mHYZVo1NeTOe+WPzZo3l/s7mzTZXIIHqAxYbXSWcGIadSXndKySwrWMytzHRZyPG/CSSUlhzHO/J0tTVebC52DbKFLdHLaplCYagOufpvffT5cLfCsMov5ukn0CW2lKaorj5RzuelX2tw7gR6Kq7dZU4TzyeXugKmpGu5DPyUP2888zXyPL5FmBB/ipU1Li/21w4EDrrQL6Ml4GAeD4ITTza/y86VNOxzVkhzWFNEuhRF9y/vknY51QWmpl6awGklrOf9eHSOj5sUkq5r5m+7XKR0RWuvvuVv7oI1/H6zCN36nFg1yzfpvTnOC1lHN/A63r+biTadNRKxuQzryH2XRTV9efZAUs5mu88UbXLu/737cDknYBQBfWRawLVO/4DaVY1/0GsdujP02XH4PsbX5IE1V14T//uZX7UurpHb0UEg2UNprm0ZOTO7tmJSUmzVq48FJ/CppGbGPUdE+Y8FK6vO22O7m6/Hzr04YGkxROn+5tJtsVXiYA4KxyWWuzhLM8GkaBn7OE9ejQwSQ6zhbrOydL/SRNeC6fc4hJ5XDxxa4dJWKHCM8d+RnKADA/g2QSG23k2pWwPdJ9Ll8jr30iCau5/fZ0ucUboUiuswK96+VuuaWvY1nSwT78Be8VpnY/Jl0eOdI3o9txQwIAfnMU2b9bbTwv28+/p7GNayR5Xc+jj/YnpHgNx6tknvvmzxPTxWE6Wahd6lWf6v239Cq01Vb3pstbb32Ka8fbwMG619PwBBkIj58gCIIgCIIgCIIgCIJ2SvzwEwRBEARBEARBEARB0E5Zv1IvltOoTIgyQr25s49EvpS87obN+40dqJyLpTwsHQO82yu7FKsL4RPmQM5XqJKIenIbzBMXQo4dzy6wO0u6jwbKKlULD3932WhzOx0x7jfS8gfp0g03/MnVnDVH3MCyQQZ3ZADOnThHs6qNHm1lzlKhsh3yKd1ZPDO92qcoXc5bIkI89ktlF0h1JSc/0PET/W+gXei7e+5IFerTzu7ae+/t69i9mp+baAH++U/ztS/dbHdXh681X02WoOj1c/se46oqC6vsQOUtPI/4OasbLd87ZxcBvC8y98+GG/p2++9vZU6z8e67vh0/W3XB1Iw+/0Luq76HOb7qrbxBXrV33sk1PkMGmxwd/pr0LBvkkNvodLmfvgcdlC4veP55V8cWj92T58DDs1vlVyzhYhundoztJp9Ds3/xzFRBVQndWy1J2Ioky4xzHf6Tt4VOMkXu+TmiqbnhhgHp8oBHfBYtqFvtuoBlEYBf48TeNpB0kfugUOQaTXScR+MCgJd8sFuyZANx2YNIull/lJfcFORSL6vrOOkdc+leirUd2Zhc0S0soj5mJ2qVizkbe5hkuVkHk5GVSK2p5Pbc04/uLbc0G8KmUCVh7OKuKkY1m/9CvczZhLIylL9Xv1szlLH5Ly01sWG/ci97RaGtW5zpDQBymmiM8IPT/ZxK44meTSyy6JOx3RrD41y+P/+HP0yXn3jCVeHye801vzKXZDyqTaA522IPzGsVyQr6OUEJMu9lNTPO5ptbWQfUDjtYmfZmRbpwsdyO5JkAgHPOSRcLOCObah0pK22LlHSSqTAr8DPRbFBbbZUu6jpTyem1+L5lwrEcRHoQBbw3+d3v0sVmsck5V1xhB9Q3w3nPA/j58YYMOto7n87L2EjZU1fQ8QRJR0TPZ7tjTQ7DQwwAJkyw7GUnneQlf2ddWIF1Aq/Zuinbd990cfycMlfFW88+FbQjGSPPj58tp1ECRLpDY0HlV3RdThZJWSsB4BXatRsjAAAgAElEQVQKaTAAnk78OVr/F0iWQ7ZGeTKe8nnR4Qcg8kyemfmaefm116ys6//awvNB3xfPPNPK/AwAzOhh7yRjSE0uUWCQM5Ns43syRs47z8ok8dQfPepoPrOlrROpehkd14qujIMC8F7ESffgwxa48Q3gLFKelv/R5F36itwt195331w8zNXt1nAn/hPC4ycIgiAIgiAIgiAIgqCdEj/8BEEQBEEQBEEQBEEQtFPih58gCIIgCIIgCIIgCIJ2yvqN8cOpD18QrSkFyNjtUB+z5dwHLeXuMFRZhaT4dHFkNIU0B+doLeWZCuhXUaap6IhFordkvR+rDheK+L+cdI35LfO8pqmj9JjLb/UxIJKzj0iXFy+GR2PaZAPOA6vxX1qLtULXcneNpb0eKJdYTI9Bu4ll6Xkzp9qBakcnTrQyjxHRCTcOMX1kF8nF2LM7xSGoonNoP3Hcqn328XUcD4jSRQ4+qsi3w7Pp0vwq/1tstyoSW2cznTv1h2Zir5w92w5U7M3PltHnwlpWDULB2lYeoxqXhXW/nHP4EMm33krssEX5prItazK70ljideEFCy0uQ4HovYc32Ti/sNi0xytW+HgI5eWmmdbHwVnrB6jIe22hZ5yvdovqNM0ox+FhS1sm7TjNeL3U8QjuwgFDJEbNArpxHtkaX4FtZoXUNZCdYf10PcVIA4CCbbaxA0lv7+wApfGd0eQT0LvwFJKqHBdeiHWBm/Eak4JjYEjcOr5UnqU5Yg9dvDWNv/Hhh1bmoDCS47t59NV2vhqL8KRLwDvvW1Snjh29vapsopgFTz9tZV3HOe6STKRyCjrDkWNa/AsW3wuncAaAI45AtmEzySHsAM0aPcHVffyxPcCGBruuESP8OXjp0szcHLunI4Udy6nzEbd22cVmLWcDpnAyAPzWjE0rAOxI8e74e5XldTYOOHQKAJR+j/qb7ZbG8fjLX6wsaZQz7dO+NRxEgvc6gAuGdMae8rkX6Xp476kLAce70VTjfP+8jumay/FDOC7Qtdf6dlyneyTudHqWS/fx8f5Kea3VDRkPUu4rjRPEQaT0HLpPzwb8vMRm8pom4UKw16uv2gHF2lnEOaPh7U6BxIjDBJvfdfRcW8Qg4/cRDuKhk+Uzi62j86P+jDPs/LxuaGwstvlqa2lf+u67FitLp1uXLhYrZo4GA+RYj9mE5s6Csc+5qpk0xLQLOj3/oB1ca3vrFgFiqH84bhMA5GV635O1o4z7hI0qxSACgL3ooeXpXKT1qZ7i+nTV+LP0PtEk17vw5ZfTZY6/WCDtdj3ppHS5+f77XR3HnG0xXrMBv58L88v9pvgyCzflTFfOQonnyi9uGk9tu+2sTLHVfMQ5gHf7vKpovEqK3AbZRYGXUN5HawywXBovOWoLaZ4OO99uen6Nv+LaYttXfSPvbi1iFmcgPH6CIAiCIAiCIAiCIAjaKfHDTxAEQRAEQRAEQRAEQTtlvUq9ZpIkqpe63bHPuKRgvvRtcu/6I7lFqtsiu9pxCj4AGDvWypySj93BANTQNRaTG9kskXOxM+V4/00uhRs7u7f4lY3cOlu4GpKb41v090GaDhPmJtjQoL7XF+g3fnsoRWjzIT6VnHMtV39Q8hnvQZ6hqiRit011aXew/5+mRa2uXv0XiOQoj9wqe2ru2xsotSyncZb0iM7dmb8XwIxqc/obTV6IL7/8ITw2HtWDvZumQs8SM7qb3G5Q1TO+ktNkS/pKN+f4ftXdlyVcX37p63iesmvzRx/5djw32TVdBw3bEnGjLelvs3FRtc3Gsuuv8udgF17xHV6e2zldZjNy4IFXunbXXLMtHXm31h/8ILOUc60haVMPTdNNLp9FDz/sqthhnO2TOmyzvKtY/ampT5vfeSddzhFpQ1c6ZsmWpodn26giDnZ0rctQBoACltKKhGDJ9deny10offgOm7zn2m28sfXh3a9Inutjj7Xy1VcjW+SR+3WLlPEsNxM7V0Du6N14fWJ5gKK2kl3VW3l+ObffZgckJejE8joAvXvvatc3ZZL/LpaA8PrcmtZI09HyOGRj+ctf+nOw7IXkDAB8mvnf/AbZgB+XZmQeNYqP1DfbxCdsMtXEbbKJlbULWRHLJrlMJjQ/Lv6u3//et2OVpCoD2XQzO+3U2R2X1pBjvF4w68dIitNMcgUAyGG5BcuPASzd+WD7rtVf0trB67mkU+brfvFFX3UydxjtG+vLK127Al4nJYWxSyXPtJLW3s2pU091VUs3NRnr12IsnxjHp7BVQPdchx9uoo8le/3I1eXTWBv1qPVHly4Hu3bXb292/9prvd38+a1zkXVIUjJL0mrzk9T1bhHJtMpIx1jG+yEANSQ3bZQxUkT7j0LqtzrZDxfyvofffe6917Vb/v77dm65XpbjuDVY4xbwscrkKT5EzjW2J3rnnUtdMx7vqqip72J7rKxKhMhIdc1d5KpOvNb21pP+ubv/3AEHWJn2hkvoWQJAF+of3Y/kUR/XUv8Uvf66azeD+pUlPiXS3/nnnGMHvIkE3H6zgGyCjhm2ovqcedfF+6VqaVdD8i5ZnZFHZdn5rD0slxU7NgMmLazy0RVcVJiCp0i6d/4ffEMezyqr5XcVDi8hoRx60bt3V3rmqmhkmWhPqeNnl8d2XWV9fHzLLb6O14bnn08X8/c9wTXjNV5/AmmxYGcgPH6CIAiCIAiCIAiCIAjaKfHDTxAEQRAEQRAEQRAEQTslfvgJgiAIgiAIgiAIgiBop6zXGD+9WHsp8VBceleJc1D66M12wHpY0TS7lJIqkuf04qzLlfRnxaRDrKUUcJokLYfiMhwuafEoOoyLp5GHzOTxswHcvfCvc8vku4CfUdnr+5bX2Cc7aQ67tYU0ii7uA4DmM3+SLn+61a6urrRwVro8hx7/wV4OjqKqGeny4BIfG+C5Jf3sgAMWcGpMwGslKW6Fpi+cQeW+qsXce28rs65XYqnUNliv1jT5hNhPPGFlHo69e2/t2r3zjqlJJZQUsOM2WNc8+pWP1XT00VbOGe3j2DiNKmtqVTuuMZMYTtv+wQdW9nmPW2hx0+SK2eKHu8EGriqP+r+MNdNDRMVM55xb4+NVVFb/LV3u338PqtG4PRYf5o9/9HWcxTdrcGwUiZlWc889GT/G454j92jMA/eU//53X0lx2NgWtojXQuSTjW+Y4NNaV1HZR8UAllGZzZguXnM5Zpro+V2P8sTEU67d2LE0NjU1psZRyhYcg0GDfNF61/y0j8WVM31qulzI+XflunM5xsq0af78rLvnecRrKeADv1DMnOeqvZ0fynF9NF0pwzEuFi7MXCfxNdzzoZS5zaee7prN6W/HPQslBWymQDXfgtZu1Ye46Sa1u6RLPIW33da34nMU5PqIFI20syhbYmNCYx6U8brYw+K6UBZfAD4btoaj2G8/K3MGaQ4PBQC9etl9SshG5EymMUL7QInKiGZaDA9/8EFXV8rjcfBgZA2KlaIBFJbSnmbO0/AMtJucVW7X03PCs74dx2Bwdgh+DeUU37oOUiygxr0Gpct5k320yb/OsUgUrW23OQyHTg1eJnt2We7qZiw0a/wT2/pJTCsAsFgW//d/F7magQPN2u+mH1tbTjwxXayQKo6L1iybLbd7oxTbGu+smONAaVwR7l/aUxRKIK1GTu9NsQyrZN3iGHwz4KFIWS7+T57GjuLrl9T02J3i49B71+7fICN37HWf/8OPadDcJ3XfBt5LSMzWBx6geFP3y96T4yTReqHhUHht1biCjfyeSZRL3J0KKhfxc2dDCQBnnmlljdnFBpf2r615ZWj8GW7LY6EvG2kAoNhFlbLX6MFxiLIFv0eJcZm9hcX4OXZHifVVRQsexSxsfsrv13LYRkucXH7Pr6U9RZHMZ3zyidVR33Tj+Ifw++N8jaPFz5nnMO9lAB+/UPeTvAGgPZyGT731VivrdnHwCHmPzUB4/ARBEARBEARBEARBELRT4oefIAiCIAiCIAiCIAiCdsp6lXo5v1FNlclpF9UFlj/HLniaEp6R9J8uNTS71Grad4JTM6JjR1954IHpYqG4e3Yjt052L1QJw3y6l2JJZbosQ7kcCqfHXOxqOj19tx2c7l3h1xpOH/raa64q59BD02VNsbqg0NyO2S1eh8Gpp5r73x6F3rmVvZ+dLEFTTbM7JkkW1Bufn2s3vi8ARXQvYCmL9HUueSR2LfSu0J9+aq7Q06ZxSvMLXLtXX70jXVZ1CQbSWJ2bvdSnfBucyRwAcjhxoXvo8BIunqdPi+87+Xs3y+/LSyg9YTV5SPYp8Sk7JzWYaz1LCU4e4aUOtYefnC4XVc93dW68sou2uOyyhK2yzl/H0k1M3vWeGyZ3uXZDhpiT7bBe/jouH2fShwEDkB3Y3VQkVsV03+PFBZadQbuyi6q6N7NLrKbEJhvKUhNNL9lpjsnk2EdV05GybdR/jeBFik9fL+346jXdprsszhUKL2U8/pBaO1B9xOTJWCewdJGlJoBzv8+Zp+7QVVbeZx8r81oHAJTK3kkY9Bw8J0QusIBTnlLfj3nENcPQs809ulnkDfRkUUzjrknWvlxKx9wibzbN00knmt2sEuPOQ/mLHbq6ut20X7MAm8VWsoBjxQovgT3ppKLVtttGFL7D96LVarKX/uSxdIClJrKm8XguI+n7BRd4HTh3vSp2+ZSvvmplVXjy8iwe86ioMAPYZx8b7/mPP+7akeXAHg8/7Oo6jxmDdQJLj8WYlX5j60J+vpd1s0u/k0SV7+3bsZxZHy4vyjwHVJZMgztv9OX2dwl9MH2clVnOBXjFNvedKhjKGmwdayzxMsU++WSPXrF99LPP/tS122ADW68//fRLV7fbNqyBzlI8AkpRXiAS/ik0gHUNqqJyBdth3SCxnTzsMF9HMjz3fnLJJa5ZHkvSL7wwXfQic+AlKmuiZranrAZpELlYLtn/XN1g0jVOqrNQCird5GzYLbQnKp3JFmxE9t/fVbH6sSvHJgDQfNll6XIO2UZ9d5pC80hms0vvzlZARMkuxXevTTe1A7YjgHtmzaP8nsNJX085xf4uhrOYDHOO7On4uty4Pv98127pwfYe2OO0of4adb3IBvz+IGEYSGEF7Cif473WNdeki8ulWQnJ5JaJrKoz2dN6qmuQwc1vdEUUcqVEF3Ieg/r7Aj275SSn66T7Lb5GDUfDtookYTNLfCgO3orfcIM/hZOStSKBDo+fIAiCIAiCIAiCIAiCdkr88BMEQRAEQRAEQRAEQdBOWb9SL3JtqhG33uLf/c4OSrxT4zO5w9PlYe9cZRXqj8ipL7b2mZOcHIhdozVjArtuUuaIxlN/5JptsomVjzvuBFd39x/INZdlBZIppYxCci9DZthFUfMIPfiguc9VVYkz4+LFyDrsDqgu85StaelRP3FVXb9nTnoPPGAuveyZ1gJxS+2aS46VdTRG9DrYNfp//zddbPat3HNtlDo3Rjjqfrl/xgXsru3Tt4DVYscdt1G6vM8+/tnwKcu6+KtsJrfdbP5KW5lvmW5mzfNSiHnz6Jto7gHAsHJytiTXxLm9fLuRA60sjwUrVlh5zhweo5r6ihqS4/8pp3jXd/bEHjXKu6PPoyw6w4spu89GG7l2ro/Ftb60zu753SYbu6++WuTaDXqdbNNC7+JfUaHZfLIAZ0kQCWItuQJrNgtnXUeOtLK6nrYmSyAX8TySKnVS6Sw/VxrLKtNihYHOxeUZ2unixTMnVzJUFPO9kQxxyzk+KxUOtyw5IJdxAC3HTLbg9U40M8/VmSxm6PuSIYizYT36qJXF1Z9tWa2kgeAe5+ecL67k7HRed5TJS3bW5Cfkqq5ZaNh+FZNtz5X13qXAUxkvaVFYcSAe7S6Jpyb/xLwtkG34MlVF6pMQ+pX+xBO3SpfZK76sZpZrhwa72fr+g1xVQY2XpqYZONAfs+s6SacWHuTXI1VyMOyNztm6VHn1xRcfpss33qgCFrNVjzxi333sD//hW5FUsLNqkDQzTrbgOUUSHAAuLMDOO/v9IJrIpZ8zJ6mrP4911cWed56VN9/cypq6hfeRO5JGQp4JK0VUOsgKX1aolH7wN99wImWfqhPbTuNpHo2n7jKAhgy5NF1+4QUv9XL3lqXUs800AXUtYXuneUfdzuuHP7SyyIzcHvhLuR/KQOT6WtP+8dpCct4CTtkDoA89H7EIThjHI6mEMpcB8HsDNU40EDiT4Lhxvtk999iY2+sDv9frpll1swVvjEWy18QqHBlvLIFbQpNARxeL8fW9qorK/Vppx+Lrt+h9dJlkVT2EriNHMwjzBpk2s/kyFnjtWybrM49zvqacH/zAtSu9wN53Fz7/vKsr31tkqdmA1xwJF9AloQORe3MW2elq/4gGkk5J7k7UkZSPl2BttxdnDuXvEgljHfWprrg85nicNUjmQLauneW+ymjf1p3ki9//vv8u/tnj5jHyVntUFf4TwuMnCIIgCIIgCIIgCIKgnRI//ARBEARBEARBEARBELRT4oefIAiCIAiCIAiCIAiCdsr6jfFDOkdO5wrAx5D46itXNWxrUrfe+Wa6uJBiygBAOWsnJeaF026zPjJXHgGn0fz1r9NFlZg3NPyVTr2nr2RtL4v/5bvyp01Ll7tK+r/ppF1kbe9L8Ix6xFK9LRr7jFzkccg6HIiA0voCcDF5Su+8ytdR3IaGUy2d4el9p/p23G+TRdtJY+Tqpy1hs2aTPL6HxVFgjW+VbwZOVF5CafxaQFrRxl79XFXeElKMcswVAEM5CAJx0UU7uGOWej7xhP8t9hc68LJEc7nF9SmXUAM8TK+91te98YYpWG+91bTeX3zh4zMAd1N5lNRRylNY3JSOHTd3rThGQUXFwemyxgzidpxBFfD3Mr/J7rnbl5KqkW2HfMEzk+2eOYP9fYc85trVk25fteCnX3QRHV2HrMPzEkARxQ0Yduyxvi2PdY4DorEMOMaWxgbgPJIcY0vicjVQPAoe2dKFLhV7J9ZcAyimDua0nJ132cW168zPQNPPk+2YW2Xp5zWMT90ZE9LlQo09o3HjsgUHOpOYNs62Nfj54aD7WyQp4eeTgVFteqaYSa8gM4eMsfgmV0twl2XXWF+9JZ/j0dVAMf5abEImWB9o+lbWz/f7h51x+RMS583F8ZOTrIN+5Omh4bA4BMXZZ/sxyyGdXPZe2SvUFpvtqpFbnTfPkhHzkpM3U9ZWDg5Ac6dB4jRxaEC1p5mWoxN8mEM8+KA94y++eFRaW7yTESNsjo2Aj1Hz7rspO3jjbld38kibw/fdt/prWit4MdY9JMV+22lD+dwHmmx7FZJvt5H2nnli51yqXx6jTz/tmtVTumBO3dxc7KOY8Fa26JUn/Xexzea1T2MnsQ2UQFp/o3vhuBnFZ5zh2j3/3sB0efDZla5ubq7t43zN2pNDNnS6pGTmCFsa68NFzpJ4nA6OT6oxfnjdoaA5yx/xO/cRI6z88sv2/pD63MemK6Pnnyvpqtk2llCqbxe3D/BBQihuKQAX45RPoeHBxp9tYw43nOUryzVRepZg4yN76cJCixu2bAsfs40jimWIfgYAoAiGLu07AHQjY1xwwQUZz9H3xhvT5Tvo78drQ55vFA8LgLczNO81PflCigEzHx5eLaZnKAPAqXS9LUy5vs9lA95Ly96whF/vSnwQsqm0f+Vl0UfVBPKorDFcue/ZMu6lc4CDANLcniExhPkZ+xo/F3kk1Ug7tte6B+ZzVNN1/HWEb3fkkW+nyx984PcT3UZI4wyEx08QBEEQBEEQBEEQBEE7JX74CYIgCIIgCIIgCIIgaKesX6kX+a1Xi7tbCbsoaf7Ve++1MrlfaarGakqzWKIp89glnfNXquRsu+3SxTsaTk6XV6yo9e1g/tCqCHB/4HTG2vA4kmKJS3BncvNjEUcBBEoXJ5njUFY92w66ZSmd9OTJVtb7uf9+K5NMDoCTMHT7MTnhaSp29iWfPdvX0ff95S/m+s6PGACOP8qc7dh9Tp+Ac4yuEac8lm3R2NH0892723X0FLnNXHJeZg9gvV72YpVM4sAQSeGcJXLmWdLHIunHorqqdPnEE720bb/92LWZdE8Ql2eYu/fmm3d0NZz9s6bG3FzV05Q9LdlLVDww3ZBU73z2cmZv3tohx7h2/Lm8Bj/XWapx8cVUceE4147FUJqAcqjqKbIBp+1WvSM/MNVn8CDjNOeqUeGOEpd5l4qYPyfzmRcYnmF58HTia5QUyLVkC92/VKg/Og2g+oqermo6eY3v0TQpXa7sJUvgFVes9nwAWk7cLNFAqUzzJZ17z+40qlQ6ettt6WINpWaVhMzOzmmmbnaHZumD/ouQG0E8WcglG/BphbvCU5WhnSb7nttKHUs1enG6W7kOlz5ZxzVf/x57IBvwKTVL9+uvW1lVA6xAZzszP9cLX5oyZ7TFoL1oJ8R2RtdWtvO0Vs2RNe2vpmJvIavl62VFiS6fLDOaONFLTZ96ikUWr1LZpxfm5XTOnNNdXe5krBtYpqTyVhpTS8++w1WVsv2ivc9bknZ513NIyqObCZaZUep4te0FPNhOPDFd1L4qupgkOWznAa9x5e/VTeSbFloBci9lVGabo13Tk/ZBL7/s19ZNNlHxRhagZ9JN1y1CbVwFH/AzVvnbmWdaWR86D3z6blHJ4eWXr6cjs5TPTfZzZSitQZ2lDzvzfOa5rnuBu+6yssqyjrK5yLcy/loR6t5JY5XvEWg5T7IFb/Qk9figMyvsYBsvE8KFF6aLPbn/2RADAKe9lzWigPf/vA84+GDXjtdMtti625tD0kFNK9+ZFwWKJSCjzu2l+p12mqtrpFTjh3Nadk2Fzv2vcRzWNSJZrehLe/DDznN1mWRa+oMFv99VtPLVbtTrPorXTHpeukflVwv97UH79F9oH/J1qNSL25bQnJ0pUvVrrzV5VwuV5Riyvsccg0yEx08QBEEQBEEQBEEQBEE7JX74CYIgCIIgCIIgCIIgaKesX6kX+QmXHH20r9vBMh09ud2lrmp4w7l2Cop2rW5U7AbeMN3HM2c3LY6Av4Dc7AGgK7lJeq97lXqZcOjhh33dQ0NIV0Bupy38oUmjUidutOySX0/lFo6xO+6YLt50k696aGQHZB3275ZrxkcfWVki0js/dio/WTfYNcsnV/Khr45ydVN3/0m6zO7oEizeuRS2FvXdyQhUtjZ2bLr42z+bKy6rXwBJ5FWVeTqNH0dOoSr7YbdiyZLTwkc4WxSzHM47Knbqa3WTxat3330tC9eECeYmvOOOG7l27KleVuIdI+ubrFcK6mjWLvTShD5TyE33FZs7leLKXD7CsoupDKxQtS2rUA9tl/2r2s8y9gLumktOqNKPPJ6WQXjkESvffPPqL2pN4axWv/+9ryMX51pxxS7ih0Su3i1cxPkhTdf8EAQ/PJmM/Jj5Xxnkm/yz5PQiAIrUlftfqBs/+cQW5Hrp7B7srs19odpAlkCo1HQdubTn77uvHaht4AFMWWIAYBKVeY3QdZHdpsukjm0iW2KVazjnaO5vykwJADyD1d5yjqkhGf4OeEmurnfOSrPuSLNz0rhu7Lurq8q70PYTOPlkZIOhA60H5s1rIchOo+ornnKsJFQXbl6eVLnZSKtc3jzyC9csfbT/mDTFrlFtJCtbJGEOPvvMyjxUdRqxGdCuufDCDdLlF16wUVcne4Ebb3wvXd52W5/R7qST1oFECPB7GF0kCB56AHD42TZq55O+eFd+YIC3ISzVBfyDp/3TJGk3gKUcHWyPl3ftla6dk3fpXo2/i8Mi8H4V8ANU7HIenZPnswgrkT/ZMrJdcomX7JV25L2BiivWErrmzrJ2zKdn2SJCA2dU5HvVZ8JyuI5exr50Bd3DtgPSRVaersTG85ZbmrxLogV4WbauwSRdWkiZHGtPOcU1q6BygYbAoHMWgda+UaNcs7v7m7SxQqQngwZmyGj3beH+0ExM/C7Fm00Ak5aY6GoAzwGWcQMYX2JSmEG5k1yd24eTjHi5rM/8KNgst7Zu5fP8BbxNoH1Knhj6TmxURX5YdbHNMZ6yeTV+J9pcWpouv9Hk18U95lF6xF193Vqz1VZWlvHb0COzFImfXx8qq4XgN2rd6hewlI8yIbZYXDk7OIV+6fr2267ZjAzXB/g9F/ea7gR4L6azppy+e9EQs5NjxCawwj3vkbVLaRkeP0EQBEEQBEEQBEEQBO2U+OEnCIIgCIIgCIIgCIKgnRI//ARBEARBEARBEARBELRT2iydewvh9yWXWNlnfcPCW25Jl1l13UlSsU8hnatmOXNReEjn23WzzXxDij3ks/lOlDOaLveqq0R/yuniODW9pAduovTnqgXkxI0c80CiBDm9YolW6jPOBhwfQ9Ncsv6V9ZXS9tHnTSGpGZJvv2i+HfzgB66O4yNwRsljfQZM4GgTQXK6P02558aI5FG/+xWL6zNunP1dsyNy/Jdx43zq86++svID79r5VGLKoQTO0hSLGhcqS8yqtog0Gp+hqsp+D778+w+6usv7kvb9fyxWQ4vrLD7CylO8treAtcscYELjLPExB1XQ1JtTTJ/dU0XyfHM0H5bXebUwp0zs073e1T35gs3OrvvT9U72kVBa66kG0hjnt9JujSDN9yypWkS2cJB+juypyz3dWmARjgUESHArgtKRKvzE66WugDX8mm6T+56eYwOlSAV8ik3JqI181nG3ch3XdX8uXb557EBfua7ibR1+uJV//nNXtezGG9NlTRHL185rhOrgWfu+SOr4mbFuXRX+LnITj/tPPnHt2N5qRCTW6vP3aoi2bgccYAc0jgF4OzNwYLr40sKertngLqbIz9u5j6vjz2UNWvvy8/1qvnRp5o9xmCp+rJoSntcInR4ukz3ZhAUL/b/rFRbaCrh4sf39xRczX9/nn/tjDjPBIYSmTPHtOGwFh+rQup9Y2D68955vN3myxRjWHlwAACAASURBVLTSdbeV8Dvfjh//2Moa0I++VEw/PvyQ0k0ft52V9cI5boQsvI00tnmeqi1zgew4vommbOcglYcd5uu4LQeg0T0jL4wSt7GM9nhlG9BeQOOUXW+py9/Y3Mf4cfGpkCXuvdfKsufuP2GCHejen9c/tvWyzuCkk9LFGVU+2kf1u1bmbtIwQU8/bX+g7OMttlFd+UBSic+4/fZ0mceIxljid58lEmelG6+79K7SfPhw1+5tmqcaOsyt+a2kkF5jeO688IKv4/cqYQpNiQ2PvC5d1jBBg4rpXaNKDArvw+k6Okl8nkoaGxwDRuPbuXCxsn917x58nxJ8bdFe9mzLavyOr7LOIuWNn2zvIQsXukimOJnes1vY0BYBprLA119bWcZen8toByPBOTlODlsk3a91pneJJrW1bF851hfFCQbgf5egvUGB7BN6kh3TvQ2vtLz6616/J8fY2m47X0n7bd56r1jxjWs2ZAjZ2idaiQnZCuHxEwRBEARBEARBEARB0E6JH36CIAiCIAiCIAiCIAjaKetX6sXu9pSGHACW19hvUJoqczj56M0nd9Ml4gbO7mE+gbR3v2IPt0Wc5g1A1eHmGrj4+g+pxssgjjvOrunii+XLzqdUgOwbLemAc9ntS1zmu9F15XJqSZ9jHlMPpxSe4+Q6zjvPypJ2d63ha1ZXaE5zqXXkvl9l6gUdBnhujokWhh7gn/ngJZYSfTA7220mvqckl+hCrpgqxSk+7TQ7YBdvAD/Y0MbZ1ltbX4sizKk0hvX3qROfeWP1cip1+3VerOLrW19o58icJHjN6Vloz/K5mc6h2KcLdjoCALvvbmV2C9dU1+QS27jzHq4qbyG52LKOTmHXTfat13zGfKzGg13ayXWzk7iW/nMLkulJ7tXhLGkcR9ck1/EEjX+5wnUDPROVtrLTa63UzaQxtjNJifIPOsg3ZHdqlXWyLyr7DIt8IZ/caBvpmedJ2neW2LaQR9A4W0DjTN2p8zKUAaCKyuwurDIK7tLmBr+K5Fz8M6wTniZts6Tb7XzRRXYgbrxd2VaQZraeJACAlwFqClF2Oi+jPun25ZeuXQON7VySq4jCx0mUVZrWOUNZ08/PefnldFnnUXGGPOEs7QKAufkm76pkLQWwTnRCvxmnQmKDp4SqWVkxyZ72MyVlMkupVNHDcrG+fW2VUEUbf47NtSpzeA6ImXTbD56mKj/TczLHj6CZS33xZbmftWzKFy/+yNXNm7cV1gncIbqWkGzoEdnz7b032c4eJOeSfdcymrM6F9kukaq9pdSLO4g3JKx/B/z6rLKmTJ2sWiNux2s/4KVRbLfYngFucMyUbeE6ge9b05erZJnhMAb8bvGPf/h2JF/pI/vGBcU2/3hfp/OZs6Wfewjth9RAXEa6JdF/9mH5Ck84WT+b6J0pV/VOPGbo2WgXjh1rcpOvv97A1d09RjbF2YLHpcRzmDTHVpAB79zm6pYsMV1ahw729z6P/MKfn5+nyvk++8zKJGOsF4PInhP8Zlape1QOfaHvYrxAsMRMZJdlTcsy1i2vsP3roNuvsgrePwB4aeLV6fKdt7oqDNiB5Kr9fNiKtYbHoixcjbk2V/L4XQxA5cMP2wHtPfO33tqfn87Z4scM2is00W8PLfaN/H7NMjyJQ8Krk35XhX73KvKPO87/4UP6TUE10PSseOk56SQ/33gvMFjtmy7YGQiPnyAIgiAIgiAIgiAIgnZK/PATBEEQBEEQBEEQBEHQTokffoIgCIIgCIIgCIIgCNop6zfGD+v9dtrJVbGmTcLYANtvny52oZRwBRJPooB0rkWcog3ARNK+cTSAo0Rn14UON9vM9ISffuqjaHAIm5zLRDvK98nxBJ5/3jVrpuvNOeIIV9fw1FPpcuEWW1iFCPf7wdL45Y4UXebjEisjG3BHaV5Hvk4W1wJOT/vrX1s8BJU0c/yboT1EYz97tpU7drSyBj2gdJ6cXtgnNoTTqN8xzscXoIydLovmsQf5iCnNhZTOc061qxtWZZrxvX58brpc0OTPUVdH5+D0rAAKnCbdpw79VpBGWEMZDG140g40CBPrk1ljrrGAKHZPnqRUxeuvW5nF7xysAvBpFjmegKbD5Pg/GqOA08zyjYrtKO1I8Vwkba0T1XJ/SHwwHl+V/gwufkPW0rnT/cyXKk7vPV7qOGmnG/U6Gfm+VTtM6W6bc+0sOZpmlccBxyEQ+49XX7UypzwGUEU2v4L6bYEEEuHnvxyZKaNyt333dXVTqaxxSgo0LlG20NzdDAWQGz92rqsaVPySHVBMgQK5p0pKYawrQhnH/uAblkU4j2L88FjzCVp9XJ8KqWPrxRuPAk7fDqAH2YHqL77wJ9EAaf9C4h8trLJypdqE/KzNwDQ8NPSSX3/d7P0OO0j6Z1oyjj+KbJCMiStvtTWTzSfgzSZvNzhkCeBvmx9JuQQIY1OuoSq6lds1Lq+zea9rSJ9eFklh6nT/74tvvm3Hm21m59DrWLyY1/VNXZ2GHMsaHONHU6DTw+DYfoCkd+e4OzLWOlNMtTqJxcIRAjmdu8ZocwGaOJU27ZP1elukaefYLjxoNP4Ix33TdM888Hj+aefQeq2n4Mc9dCiyw557WlnjaPB+Q+t4H8l2RlJ4u+cqe8+app7pMne9hA1Ez+pJdjCdjIBO2gMPtLLEAcVGG1mZ189rrnHNcv/+dzvQNYz2OrUltmsY3suvNalLxtnBFIns1iTXnC14HH3kY3z1p9A188t/4upGUfcU5JJN1feVE05IFxfKXOToft0oBoyEanJpvV2kI3n/BMfM03iYvKfkPZgOGt73yl7ZxazkMSnxqQ583FKSv/iixEkr9utwVuC4voce6qqcSdK4e7dSAKIPPrCyLjQUM0fDyuVT3CZegTT+r9sD8/uXjAl+u9P9PV99Me9n9L44Tpq+t1IswskT7c/ymuEfwft+r9wiplkGwuMnCIIgCIIgCIIgCIKgnRI//ARBEARBEARBEARBELRT1q/U68EHrSypJ5t2N3c99Xbcg+QmBbvsYhWSc7CQXNWnizSBE1azE3WjuMzlVZvDba9eJh7o39+nQSyY+ZYdaK5G9vFkvyyRc+WwO6CkP3epu9ndVt0sySW1T4k4BZPkKWuwK+I99/i6X/4yXVzed5CrYg809mJfseIp165/f3pGkk6Pv7u5v6UIz5k8ybcjf+Jejz+eLrfIMEtyhr1EPfSjgeTqyu56M71sIIfdMdWNllJ9duIU5uJ2fXI+5f0c94Src67czz2HbNFYYoIXdb+eWzI8Xa7cb7av5PHMrpDqvspujPpcOKUou6+q1IifLcvFNNcoy4tUB8Fuot9YStIWcjEaJy71JuDSt+K889LFeaIF4jk7wJ8BuTL3s8KIEelil1/9ylUtoLJPdO3dVFm2U3T//a5d59bc/KlvcjiXs8qWSBLm5GI6XkgGO1XqWMI1h565Ll4s71JJE7dlqZe7PgAb0HBvkfWbdQmnn46swcaRpHEA3NwZVDzV102nuchSC7Ev3c8808qyzmBTktDccIOV//AH14x7lVcZdXmuoLLa2248B9iOqH2g9bNE9XY8JvmaSrq549EjrTzoEOlIXa+zAKkRW3hw9+5t8i42RwBwfA/q08m0tsz2dveyy2x/pAoAlm3xFBsyxLfjR85qFVUl8LhnNQng5V081dWczp1n/6bYr69PoFvfYHV87XlLFrh2W25pJ1V39xbhALIF2zmZAyxPvfBCb+F5G9m8867pco7aOZI7FMo61oVukuUHi+CZRVrCCpLFFugawxfF6xvgHzzvV3Uw8NzU/Z6mVv4XZ5zhj6+4Il0cP1r0fG7ud0VWYHmLruVjxlh57FhfR+spT5D7JvrrYpPUpUtPV8emhW9N1aZunLHUR2XxvGfRCc2TgPutd29kRKT7k6rt+s/Yzf4+apS37MeOJIMqISvcTQ/Qnc+3gMfRe++5qrwq259/f9uNXd0nn2yeLhc8QpIhfZ84+mgr33KLq+IVYyrNNxUJsxnqzKm71SCysVTJGaeO57GgkklenzW0QosBlunvJg+vrv6hr3qBXrx33RVZgff68vxz6F1b76e5Vx9rd+vNVnH77f78ZE/z1dbSRF1AdlIsEHDKKVZ+9127BpapwUvVC1VSxSnhRXbu4Pc51QsTvD6r0vT0E0ms9oLYN94/HnNMxvOHx08QBEEQBEEQBEEQBEE7JX74CYIgCIIgCIIgCIIgaKesX6kXu9WLC3e/JywzVvH5V/vPTSQpAbsyqf8vIY52GbM7afaXgtLSdHk8+1Sz3APw4d058j4AvPaalTlzgLr/sX+4+C43kjtlPrtSiv7g9NHm4u4SQAEYOoVcfQcPRlZgqRlHKAecL7kERHcqno8/NrfKV189x7UbVP2YHajWglJn5FCWmRbuvEQuueQVSrYbTqnSc+JPM57D+cirzIizE6mLH6dsefhhK3OEf8C7gao7r7ovZgn2AlePUr6NN/e/1NXtxi6NnDFLM06w3ETlifwF/GxV1sESIv6Muq+yC6nW8bPluhUrfDt2SVWtBrsBkztvd56/8NIvEeVg13WQSYjHYhdJv1NME7BKPsbCC85U0MLRnuUm+kzYrvFz4D4DvPbkhRdW/3cAjTTOvWhH5GhU1n+1yCjnkrb5/Kzeece1u+m2Yenyz4+WXGmaGSdb8JqmOh6eOyxFALyLMmuI1IYw8tznN9iTYjvQiTP2ASiic/YjO7xQXOT5CWk/OnuoGZMyIc/87umWuZIT7+TKUuGWWlrTAQDXXmvlm29GNuDlW002T48Wnvf5pAfhe5X7zlligp+TN/WZl+qPsrSTPE11Deb9AXeFqnvYJJPnOwA/7dmk6XdVllsew7nznHDdZe8qyzV3/+Yu3gJdbwlo8Mc/Yv3Q2lpMrvlPSDgCHoucGGaYSgJ4TyODoYiy0CynB+pzhXrpF+84yp56CpnQzGCdeL1jTZKu42wvdP/Emzpen1XPSBLZn432We2uq6MMol2zJPViKc3Pf+6qamhyFlO2Q6W+xK5F1eOszDnySF/HdoDnos4xJ/ngwaP7S8rqqO8ItQ0mCHzia8tQdXq5f6t5pspkMw+M8qfnecvbUk3mOp+sed293v70aXgL6wQ2PvLu9Mwck6JpRIuyQhrtbOt1D0Zrf/nGXi7WTPIu3vlUSmYqZ+x5Dmy4oW/HsiGVSFJmKje49P2W56nIpqbS+wWLD/M5OxYAvHxqutgiM+J++yHbNNN7Wo7ubdh+yL6EXwUKeMFQOSsvZJqlj+xAhS5QmaA+zOHUzgCKWmj/iUxrt94zy7u23dbX0b0MLrbrHdxLrv1pejia5UzfoTIQHj9BEARBEARBEARBEATtlPjhJwiCIAiCIAiCIAiCoJ0SP/wEQRAEQRAEQRAEQRC0U9ZvjB8WFUp8DE5p2y3Xp/V0+d1ZqydpC3NIs1koes4c0r5NpL+r9plV10ddcokdaF7TzS1lIFTHzfdGKb1biCpbiRmRf9ppdnDhhRnbnWFSVOx271m+kvWFl1+e8RxrBD9X1s8CLnCMapqnTrQn/bPRFtfHxfSRc7SI8cN9z3GPNLYOf/k5FENI0/iynl8DM5Cwu5a0+EV6YxwLQ+OgsP60Qwcrf/SRb8fjQu9ZtK/ZYkDu39Llh2bu4eqOX3hdulymeXNJ++y0/Jrum/ukWqIUsC6Vx5MGwOBzclwWTf/M/ajfxYEteGxpqt7W+oDTdHIAB46TAGAw2ZgcThUKoHHcQ+lyHrIEP69ddnFV+RQvIk+eKyWDBEcG0mhS5TT2VDlcxjG2uG80nfvAgVbm+fvyy65ZHj3L6n/+09Vx5Ie5VJYRB1Y7a3yZfNJ/N9M4yOF5CQnrwbYbWGfxthrpfvM4ZTyA2t//Pl0uuugi/0FO9ctafulvjuPTJN1T2d0iPtXW0b8DaTwE1o7Telcua18Tr326LvKY4cAMHMdCkXhop55qZR5qugTccf4sO2jYzldqyuQswMuCLhFswssll2xtg8W/KaqmfY/YuKkLLTJhv339PqIAFk+nosLO16d7vWtXD6tjE6fLInf1oJ1lh5RvD7qxycaL3vNzL9h36TAomEkxQSjOw5Kmzq4dh3P4+9/9OXgcZBWymy32XTS2//xnHzORw3RxKDPsJR3OMbs4xgXg1qBOZCs18g33CO84qqRdJVqBxxfHUtEYbWyPNE07r3G8F+SYNcJ1p87yf3iCBt/w4Rk/t0awnb7pJleV09/6bZhcpgtZRNnD77rLt+Nl4fPPfR3HxtlhByuzqQYA8BrHz1jjutD+a1G13znwUOIt1dSqTq4dhzni5RgAHn/cRtABB1gcncqZT7p2Uyusb/o1SUyfVmKtfis4dbfEqplH/cNzDwBOPpEWAxqLzTfe6NrxW2aFvktS/1SyQdS9JxtSXjM1VhafX/e5PDj4/Pq+SPvtBnl/ZivDe6Q+EqRt441tn6Vbdlz7rJUPPhjZIEf2yAzvN/S9quCVZ+yA32N1MeHnpYur2rJVvPmOjzm329aUVp73qPouwftc/f0i0zXpQsUbFe1f/j6yCQs42B2ArvxML7vMn4NiA7dGePwEQRAEQRAEQRAEQRC0U+KHnyAIgiAIgiAIgiAIgnZKkkql1t+3de5sXzZ6tK9j10dNd82p/EaNsjKnkwa89ELS9HLK74Xvv58uL/KtwM637D3emeUegJd8qEvZmDFWptS3LVy72Cf47bd93d57W5nlNpwODsCbsy09Zsf+iaurPOggO3juOV+5tnAfav74s8+2MvcT4PpjEbnilkkaamy2mZVVbsAudOwWp+501K6xh6WyzLv+Kt/uH/+wssp7SEfQRLKUXHU15GsUt8pFc8wpm71Fu52wuz8Hp6PP4J4IADj33Oz0IYDly5Hux04NMgumUbpOvjbAp5Hk9IksowK8O6v2I9dx/2s7lldyCkyVSPLnVPPBuVhZXqJ+rptuamWR/7h5ylIAcQ9296Ju/GPHWjkvLzv9eMwx6T6sf/xxV8Up2/8GD6f75DSmC1jGB2//9F8Iitm2sFZEpYHc162kMm4m++AFKl4axzKHRmlXxilZt9/eV7I7NfX9jPPvds3YZX7oGyKP/dWvrJxKZW0uoqjIbKpqZth9+YQTfN12JGGi9MC/Lb/aNeOUw6VTnnV1bqzzmFUZL2vgeB3T9MOcIpltOeD7nOVWrFkA/Dxyuhn4NYDnva43rGng9M56jVnqx9pas6eqJOPtCy+RANAPU9Pl+h6Wql4fyYC9aEarpJjGyKIac2N3aY0BLKixvQKbyU7w6Z+5f+fO8zOfhydL7VTh2ZWFFFrJ7vS83knK3Rk1JnLSaTF7tpV32w3Zm4tnnWVzsZX9x2/qfuSq2G7wlk+XmbtPnWQH2sksH6A9xzx5Lvw0Z1BZbfQgKhdJHZ+DP9dZ9zcsZWftEgC8R3oblhzoXoqPef0EvOR6/Pjs9ONjj6X7cOk+x7iqZ8n8jRzpP8bb9taiUrAp1OWO6bSEZG26H+BBwvZO98M8RqRvaruYmI/Nn6qR+Ks0cgAff/yxpRVPfb2Fazd/oa3C3SqaXR2uucbKl16avbl48802F8XmPTnw5nSZI4EAwGMVP7MDWj/myjshC37K9aGxXJDf/XTvyesT7yE5DALgB5RKIbmP+Rp1783rp8jhq8lGlNC93H3RbNeOX1tZAggAu52zqx289VZW+rEpSdJ9mMt7RsBNwNr9vcyz6OyT7YAnoM4PnoC6zvAix4uw9iHbJ+4L/S5+x1mxwtfxws57TdVR85qy4Ya+7s03V9tupuztex166OrPB6CR2ua1srcJj58gCIIgCIIgCIIgCIJ2SvzwEwRBEARBEARBEARB0E6JH36CIAiCIAiCIAiCIAjaKes3nTvruSkmAQAfK0C0er8YY2k+rx5COjvVSC9ebKdo8AmICynlIKttNbUyx5eoonKnhx927fgKizWuCMdHYD2hxho47DArq26fNcGkN20u9Grt3TqYyrsKnnpK7VaALMG6R3nG7lieSSPdA6nc0Vf06z1YC6vBElhIT5ryRRU+HTkPi9KvrLybpLx2OWIl5kgTxYHgmhLV7jKScpLlv6d3p7uWVN9OaM16acDri7OI6zodv19/bWWdp/xBvkFNfcjHqvnn7+P5oZpX1rSTlnd5jf+9mk9RNH0SMsLxUlR7yxrg1mISnXOOlUV7y2Nyfq9h/qupnLV07qQ51nNy1A6JLAZRQqfRtMGs5M/ReC2cgpb05k2cshtALs851qWL7eCj1p4P35fGrWiiGEW5m28ulauPL8TdDgB9biBtucajUM19tmgtVhaPxQMOcFXPTbF1cegoCybSX4a2C1mlebH5ubAt1hhJHNuL1yaNjcDxwcS2c8yuJkqtW+VbgbtkodSV87jhteJ//sc33N3iqM3kmD7waa6zNRd5zdHYIRyCTrOvosTu9oYb7M8aDjA312xely4+UfdGFJqLl5Kyvn5717WBEv2W01NuEvtPtruyi7eFc6ts1m2yCZ27i4+4Vdtg1qRazP9G21uUsdIquiaZjNW0JerTw5+/Q4esWVEP7zG0E2gP+dNDZ7iqg35usQR56bvnnitdu5EjLW7YHqXeVrp4FbRf6s6xvAA3x/rSOHfXDh83LUfmaSHHQxsxwsq6jvPnZL896+L70uXRo+zvGo+Jt7m7XSF74NaC5KwttCEoffE+qTL7rrafu/vkLi9ZuUeVb/gKDcx82aOyvWbbyjFjABekqvEQi2+SN3m8b8f7bemb2SvMDpx/vv1dX4t4+6JZujnm0ccfW6zH3965tWvHW/EZM/3+q4+uKdmCYw5KZ/H1DIdPPY8KGs9kpCo1zpLuARmOR0P9WCXvgbxnmk/2QRKLI4fq8njvBPh9Ka9vGm+L9wYSfyaf11qKh3n6UT7O24knmv3OmznV1bWYuFkgd9997UDsE9930Yl+v+zeEXjR5H0I4CftPfdkvhCel7qXpZi/OO00K+uc5TGoY4fju3JsUt0facxChsZIE/V1s7bjeMBXXOGq8vT5ZCA8foIgCIIgCIIgCIIgCNop8cNPEARBEARBEARBEARBO2X9Sr3YPYrdqwCX3n3GCJ+Olj3jrn6C0qbdf78/x4svpovOlRXATHKPYsdmdfZjFz2W+IgDPvbi1PHqns8p10netaCvd2fjxzF0jMgIMuRNzamR1Kvk1lrxwAO+roVfeRbgFO7ielrb3dLRFnFuTAB59Ex2Jt9fdYlkF/0Wkht11VxFGXw68mEV1atth+36+2MeWOLWt4zP/8MfZr4GlmlwCmEAA+kynpw+IF3ef+QA167oL+Zv23DLLa4uX93Ns0TZG+QeKzI3djFdsLNPs8gepnnV9twbS8pcu7zpb9mBujdyjlt2cyVXRwAZ5TmdRJq2dIW5/ef39882b2cSbz76qJU1pSO72Kq7Oz8fdqlV6SDJ4or38nM9bw5JA/r0QVbYwlKuNorEihLJtrBx7CTcQO7UKgHjtO+50jcszepEZRlJKCE730jPMa+/n4sF/Pw32MCf5JNP0sVikoupNcjh1MPKgQdamSRTBRef69uRO+8CWV+6ss3PJpzCVSVWRxxhZdYCARg46rp0eepMmwP9RonbNM83dVHmucQyLc37y3qN116zss5ttldiV5aQjWWhjv7rE49DWQG8jd1tNyvTGAGAZspVK87W6+Rfu3ipUgkJyzC6Yb6vrDE7dPnZZu/ufrqTa8bLk2aZLe1oMqjSfO5fuXPq60VLWDrmZVOfpkxCWFroHc15+WN1fm6uPwdPb81865bQr+3BNTb5nnHPUWzywoW23mTLnLb4Ul0jWOope62rrrK5yOmzzzvvKNduzz1NJvSHP5zg6v5ZauWJO5ldYqkgAOz2zd/sgB/uX//q2uWccYYd7LijPwmHU+B72XZb347Wu6WX3uyqem5sa+vMmRZMgNOdA8Bu25HcRHVIGv4gG/C9iaxmYQ+Tev3qV/5jx/4fpbMm+7dE1r4uvA6orpPtKdtQDVtA9+32Bvp8OJX1CX68bLM7VotuX5gHH/THXt1jMqBy2ZjzrQzoJe8gGfbl35qbbrKy7IPzWCIoBre5lxmEeYX2TlJ5ySX+/Lffbp/hdNwAcnjtor1JhVzHG9SOw4Qsg4ctSZ6kle9Bx/nUITWy/yhm+yPnKKQU39P/9Kd0uWe+F8SzuSiFwBKibMEhTFgCBXhDqbDR4z237BvdwvjZZ76O5ybPKx2v3KcsR1OpP4foUAkX3ydfL++95HrnSB/y+OGdUwsxbGv7XHonaI3w+AmCIAiCIAiCIAiCIGinxA8/QRAEQRAEQRAEQRAE7ZQklUqtv2/bfXf7MpFiOVfITTf1dexaya5TrUhUWsiv2J2VJSTi0l5F7l0V7L+tsiM+vvPOjNc7tWRwuqxe8eyFOmHCN67urrtM7sCXPn6UZC1iv07NwMTuZ2+9lSAbDBtmfXjssb6OXOYW9PbpA9gjb/D7t9nBRx/5c9A4WFDhZTvs4s6eexr8nuv4M5pkZkB/c5E//lTvqv7QKMo2wh2gJ2GXvx//2FXVNpn7Mw9Vl10FaN3dmSVzw4dnpw8B4I47rB/F9fHX75u8S5OYsSczecq2SHjE8gb1zmTP3EcesTKrSQAvYXDzVFxEa486PV0uqlngT8Kum2wTWI4J+GwBpeIEq7KXVdSLe3ABj4W99/aNuY+POSYr/diQJOk+zBf7tJDck/8GD3uC88gTEQo4H0Q3qaugMjmjt5Dm8OeqW2nH2TFULtaZyjk8mDhjBODtnUjfXH+wMVIdBWWGdK7mgJcnp1LZm4t9+qT7sUbcf4s5i5zIUZc/YplnOv34GKtQF2WWi7GcC/Du0bTuNsn6mctyV57AkuUE39A6xlncAG8kyK28VtZxFnLmaKYR3gvQGG+u8vM+pwuNGlkgal9+OV0uylI/KCJM7gAADihJREFULl2KdB++956v4yHGyg3ArwusdtSEmZQEyKmhAc3WRRoN1XxkkqG0knVxfn5PV9WtokWOEQBAfYP/N0S+T52KxxZSKqGOHdPFWcU+Oyeb6Isv9ufg7ESlpcjeXNxxR1sXVdrJtkflAqxvoj64+QkvgT7vPJ4TanFZHs8ZcPwC2rHjpekyq9FUYshLzpWjfL9NnW79xUoHTbJ14olWvuWWia7uiisGpsucsFcZVEzZg3Ss8RfMnZudfrz5ZutDlcqzVJQ3KYDbVzzUSoYm7o08PT+vSfyuorIW3ivwXFSNFe9fVENH87R+hO2BdIvK6t5hh/hx8IvLbBxcc42tfa+95rNisp0a1vAYMpKlvQ0A/7745Ze+jvde8lwGj7TdBNvR66/3p2AJYhOnKIRko6KskG/Bw1aA1y2VzS/PUAaAwWRXptC62yjtWPzb48wzfSXbdnrpeajLT10zVtEfu53PTNi0ww7pcm6W1kW3R9XQCOedZ2V9gTjllHRxEc0Pb00BHuqigAZ697Yy791UKsV7DDaiKtNSbSjRRNeYS89/kUxGPtK8lLxacxbuXTWzM09GXYd4/zhtWsY+DI+fIAiCIAiCIAiCIAiCdkr88BMEQRAEQRAEQRAEQdBOiR9+giAIgiAIgiAIgiAI2inrN8bPuefal6nWl4XwpMEHAFB8gYNOMe2+ygJZ+vb44yKSB8eS4Tg5x0s7Svnskha3kiMRkgITHHuiI5V9CvtttjH9vMoJKRstbqOQOKpTLb3EtL0t4hBxsJtsxfj52c+sD1WPTDEoGsf81lVxLBcOmSNhK/Dxx/bMr73W3w/HTrjnHooTgLGuXe/els6Qx4Rq4CdMoJgg8GnUAY65ZLGMevf2sVtYHjpqlD9Dv3JK6shC6zpRALNOU/vw+eetfOml2dNP33fff6SDv+MRnw5yLD3qadNMu7/LLv1cu7ff5tSKD8mXc7JLjutQJO1M+3zccSZOHj3at+pWYlrtGVX+HCyxZZm9mh+W0mumRk5bzLEMNDTT0BWUK1WDI3GQiry8rPRjHemnJfEwOOJJJaUvB+Bufj7p11V7zhZPksy672PdtUYAYQvKsXrE3DmtvMb/KSBDz2nrVSPtFoSjfBplvP66lTlejaY353gLTz3l63ierFiRvbnYoUO6H2sluEvRFVfYAcehAvxg5FgZck/z+1rMLh33lV0okhOnj5UYArPm2L8R9cyn2CSafpgM4vLuu7oqNm08L1tcUx3FBNEAbhyXg9PPajymW2+1ssb74xiCr7+elX5ctMhi/HCoKcDbluOH+Fk2a4lFbuC1qrWUzFrH8W46dLBykaRid4F3+KG3lppWU5pTXfPhNq50SeO+zlsosWwyxVP7+mvX7NF/2vk328yfgmPRFBVlMcbPL35h66LaBl6ndVxyzJH/1969hehVnWEcfzsk4zANwQmSDiaOGnWoUSZVQUzESjxEPGsHo1KRBgSDQZB4uBKUeDMJEsSpILX1ECQxB3Ix2lICxkA6oaA02CSFzkUbQhImoToxyjjEceiN7PW8z8yXq20utv/f1fpm7fkOe++19tqb9b4rr3Oft5M2u3PPvFSlYyRN2fHII/ktVlx9vCr/bIEmjrRkeqH5hPyE0nGpZhPJverwcLmu+3BPj/ni88t3mtYAdH9ojp2InB9zaKie43iW+4x/ri7j0nlL8sfpXlikJ5xd6L/xvGZCMzP9UhrBqPXrelZcILlPpmxJ7TbPFai0PWuD8LwfOvbwa4hc06Z+V+4l2j6zbDbaR+jxjMjJSjdtqq8t9vRUx3HSEoXN2ir3aZZEcv2WkuNn/fryd0/VOHeijENHTs1Pdb2XyNmgA07v6LQf0E5Pb+Ai4qB8+NXWmY1KPqluzX3rid6uuqoqbn4+5+rTQ7Lt5X9FS3oxevXVXKfnzebNP3oeynH5fZ2HDuV/vPXWqvhXGSzYmZ0/y173SVlz6/Ta/c4pzxX8g6P2WvNVWibR1Lvqu/t76EhkjtVJlsaUr6hdx6sRuX/1BKoynj/b2IYZPwAAAAAAAA3Fgx8AAAAAAICGOrehXvPnlw/z6VUyjW2aJ54oZZmmdXz5b9NmOqPbl07XugMHxqry7NldabvvvvtYXpVpVF1dP0/bjY3Jsr82AW1goCwDqtEHHlFz1+VlGdb/zOpNdYsODpUXOp3Ql6DU5YePHct1Oq22rimYupy7r/2p85O9TqY87xwt4T0+Y1pnN/qs1IGBUtaf5uFin36qx1DnJ+ephm+8cXFV9lC7J58sZV1R2U9bnb249hmbWq9zS/WHeQiJLhvry37ecUcpr1lT3zTaoaFyHH2ZUJ03avFxOw+Xqd8a5eFLiKrzzsuv33xTJ2WW+L1Vq5ak7d55R+MadSruHvuE56WcQ72uuaYc//37S3hgR8fdaTsNkTjbSr3aFfUttOAoPd5+omjbuP76eo5jV1fr5U513c577811erD0vPRYSJ1S6tOONcxIwxl8mr/uvB07Zv7/iNyI/T10X8p3P2PLhbdrO/L31/WwdZlPX2taO2nrWCbke3TUuZy7Xhe7u3Od/kaPd9FjonEYq1enzR5/f8WM/xIRsX37cFV++ukbq/LgoIVHxXVSltjj+Ni2k9C0actV69Lgev28MW2lU8KHh1NVaps9A0+VF34RkDCdSZlKH5GnhM+p6Tju2lVCvTwaQC+Fvpy7Rkno9c7HCvoTTpzIdXrtWrOmlB96KG+nzUj7br/kPPdcKXtYmV4adIzlfeaLL5by4oWnc6XsoK17S6BoVx6KhawuPK1OP/u++2oM9errK21R0w9E5DAJD3G8555S1uuAxzHq1Hw/yN9+O3OdLi0dEesHy2K/et3yt9OP9nGWnqPafXvkQNtRCWqYY8EJOiDTE8BPcu3PPdRL9+Pu3fUcx7ffLsfQwzzvv7+Uly5NVX/YMW/GzX5xaHd+j2efLWW77n4py0br4WjzEH4N6fn666o4YR304WhNj4aGqXk4zFwNe/WQGr0m6+DGQ6U13lCX4Y7IHUuN6QgmNZTdxzB6jlk7nXp5XVXWoY6mKYiIWHebpPyw9rzpgrIMuqZz8PuEd98tZW0ePh5+6aXH5dXsVHfRRX+qytqv+Wc98EAp7/zAFnuXDndc8oF0vvde3k5ubPxc01kg7XWNb3p7W9/zy0XNg9M0GcSIlI/bdtqqeqxOe15ti56OQEfxevfg38kDaZX+nx76a207DaBcZnX6Htq2x227Tg3D93tJ7VdGRgj1AgAAAAAA+KnhwQ8AAAAAAEBD8eAHAAAAAACgoc5tjp+1a8uHadxpxPQAZaXBjRpLrOuCR+TgdF+iVJdJfPTRUvYYbI0JlmUcp7ovTJvpSp99k/9IdSmWUQM1db3OiJyXwdeGbvWdXnst1+n312BU/7zTp+uJ2Vy5shzDm2/OdV98ES1pAKwGlUt8c0TkGGSPM/Zj9YMjN6xMr3v+J8dD9vGRibxkY8+Oja0/S7+vnpsa1BuRc0t4QgQNmNdj4+eBniOeIEJPtG3bfpzl3D2viOZH8WRZ2q70/yxe+PSc0l7mhuV4kFwJWw+UvB9XXpk307BrDZH3PAS6nPuuv+ccPx99VMraPXi4saZX8Lwimh9Bf/Li//45b3jppaXsOUf0HLrlllqO45TEwHvLaNfP+/77XKk70HMgKM1b4TkKLruslB98sJR9+WI5n08sKBHPnrPDc88o/YorfiXR377csiZJ8XakB063O+oLbgrNkxQR30hegbpyw0REnNIlT62u44orqvKE5I+IiOiQBHJTkquozXKCpBNYlkmNiBwTLn3lmYWL0mbtoyXXx18Olmh6T+ehKwd7d90qjdNvjr6eN9Q8IJpHJCL3o7qdLqcdEeOyrzr9uqhtY//+Wo7jvn0hy9bmOk35smBBrtOv9vnnpbwkpzuLf5dUaCmtX0S+ZGoqDl9+W9NcaTrA/v7cBpYvL//4ySd+TS/7btWq0j68/Xo6mPQOsvu1u7DUVOl3fvVVrtMurNbl3HWM6n3Z3r2lrO0mIl8X9QTwPqpVzjP/PP2BPpbVnasJ9PzCpe/nv0XHHNrB+kmjyUr8e+jJq43bk0ZpJ+GJS7Rf3rixnuOo+Qt9vKZ57PykfeutUtYEWX6N6O8vZb+Puf32qjg+OFiVO2XJ9oi8bPs6+ftTkWlXMmJ1e6Ssdw+eE2TZnXeWF2NjuVKOzRHZHz16jxSRzx/fb3oebNhQX1uUfKITH36YqjpkP08ba+n9oo+1lQ4I/ZzVdiCd6kj3r9NmvYd3zfjWm0ZXpNePPVbKbZM5P8++z9qr8rLLy/jmy1n5fmXeHzdU5TPPvJDq2v8meaj0wvvww/mLad/k435NSDs0VM9xXLq0tEW7Pzyl+bC8b9HjKxeMyVdeSZvpEKM9onXdTTeVF/a7J7dvr8onj5Wve2F/zgEWMhZL+bAi4sgl5bzo+b0cG78n3LKllD0Jn7Yrfc5xtpywTt/j5Ely/AAAAAAAAPzU8OAHAAAAAACgoc5tqBcAAAAAAADOGWb8AAAAAAAANBQPfgAAAAAAABqKBz8AAAAAAAANxYMfAAAAAACAhuLBDwAAAAAAQEPx4AcAAAAAAKChePADAAAAAADQUDz4AQAAAAAAaCge/AAAAAAAADQUD34AAAAAAAAaigc/AAAAAAAADcWDHwAAAAAAgIbiwQ8AAAAAAEBD8eAHAAAAAACgoXjwAwAAAAAA0FA8+AEAAAAAAGgoHvwAAAAAAAA0FA9+AAAAAAAAGooHPwAAAAAAAA3Fgx8AAAAAAICG4sEPAAAAAABAQ/HgBwAAAAAAoKF48AMAAAAAANBQ/weXe1UlWAKzpAAAAABJRU5ErkJggg==\n",
      "text/plain": [
       "<Figure size 1440x1440 with 10 Axes>"
      ]
     },
     "metadata": {
      "needs_background": "light"
     },
     "output_type": "display_data"
    }
   ],
   "source": [
    "fig, axs = plt.subplots(1,10, figsize=(20,20))\n",
    "for i in range(10):\n",
    "  subplot = axs[i]\n",
    "  subplot.set_title(i)\n",
    "  subplot.axis('off')\n",
    "  # Modify me\n",
    "  i_weights = weights[:,i] # Select the weights for the i'th output\n",
    "  img = tf.reshape(i_weights, [28,28]) # Reshape the weights into a 28x28 array\n",
    "  subplot.imshow(img, plt.get_cmap('seismic'))\n",
    "plt.show()"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "colab_type": "text",
    "id": "HNBCIqzdw2GS"
   },
   "source": [
    "### 2b: Implement a deep neural network\n",
    "\n",
    "**TODO**\n",
    "\n",
    "Modify this code to create a deep neural network. Train your model using the code below, and compare the accuracy to the linear model above. \n",
    "\n",
    "Note: you do not need to modify any sections other than the model definition. \n",
    "\n",
    "The code below uses compiled versions of the training and evaluation loops (remove the ```@tf.function``` annotations if you need to debug)."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 38,
   "metadata": {
    "colab": {},
    "colab_type": "code",
    "id": "rxoIfq91xDRZ"
   },
   "outputs": [],
   "source": [
    "class MyDNN(Model):\n",
    "  def __init__(self):\n",
    "    super(MyDNN, self).__init__()\n",
    "    self.flatten = Flatten()\n",
    "    # Modify me\n",
    "    self.dense1 = Dense(128, activation=\"relu\")\n",
    "    self.dense2 =Dense(128, activation=\"relu\")\n",
    "    self.d1 = Dense(10, activation='softmax')\n",
    "\n",
    "  def call(self, x):\n",
    "    x = self.flatten(x)\n",
    "    x = self.dense1(x)\n",
    "    x = self.dense2(x)\n",
    "    x = self.d1(x)\n",
    "    #return self.d1(x)\n",
    "    return x\n",
    "\n",
    "model = MyDNN()"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 39,
   "metadata": {
    "colab": {},
    "colab_type": "code",
    "id": "hVDDq2orxPBR"
   },
   "outputs": [],
   "source": [
    "loss_object = tf.keras.losses.SparseCategoricalCrossentropy()\n",
    "optimizer = tf.keras.optimizers.Adam()"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "colab_type": "text",
    "id": "WNC0K6JPxy-g"
   },
   "source": [
    "These are helper functions we'll use to record loss and accuracy while your model is trained."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 40,
   "metadata": {
    "colab": {},
    "colab_type": "code",
    "id": "duYKrACkxRHw"
   },
   "outputs": [],
   "source": [
    "train_loss = tf.keras.metrics.Mean(name='train_loss')\n",
    "train_accuracy = tf.keras.metrics.SparseCategoricalAccuracy(name='train_accuracy')\n",
    "\n",
    "test_loss = tf.keras.metrics.Mean(name='test_loss')\n",
    "test_accuracy = tf.keras.metrics.SparseCategoricalAccuracy(name='test_accuracy')"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "colab_type": "text",
    "id": "C_oUQki5x0lD"
   },
   "source": [
    "This method trains the model on a batch of data."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 41,
   "metadata": {
    "colab": {},
    "colab_type": "code",
    "id": "yTQAnrOAxUAu"
   },
   "outputs": [],
   "source": [
    "@tf.function\n",
    "def train_step(images, labels):\n",
    "  with tf.GradientTape() as tape:\n",
    "    predictions = model(images)\n",
    "    loss = loss_object(labels, predictions)\n",
    "  gradients = tape.gradient(loss, model.trainable_variables)\n",
    "  optimizer.apply_gradients(zip(gradients, model.trainable_variables))\n",
    "\n",
    "  train_loss(loss)\n",
    "  train_accuracy(labels, predictions)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "colab_type": "text",
    "id": "-lUJFkfux44o"
   },
   "source": [
    "This method evaluates the model on a batch of data."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 42,
   "metadata": {
    "colab": {},
    "colab_type": "code",
    "id": "BTMp9PwZxV5h"
   },
   "outputs": [],
   "source": [
    "@tf.function\n",
    "def test_step(images, labels):\n",
    "  predictions = model(images)\n",
    "  t_loss = loss_object(labels, predictions)\n",
    "\n",
    "  test_loss(t_loss)\n",
    "  test_accuracy(labels, predictions)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "colab_type": "text",
    "id": "AR0_bNd-x6OE"
   },
   "source": [
    "Training and evaluation loop."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 43,
   "metadata": {
    "colab": {},
    "colab_type": "code",
    "id": "enHqlaCfxXq3"
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "WARNING:tensorflow:Entity <function train_step at 0xb2aaedd90> could not be transformed and will be executed as-is. Please report this to the AutoGraph team. When filing the bug, set the verbosity to 10 (on Linux, `export AUTOGRAPH_VERBOSITY=10`) and attach the full output. Cause: module 'gast' has no attribute 'Str'\n",
      "WARNING: Entity <function train_step at 0xb2aaedd90> could not be transformed and will be executed as-is. Please report this to the AutoGraph team. When filing the bug, set the verbosity to 10 (on Linux, `export AUTOGRAPH_VERBOSITY=10`) and attach the full output. Cause: module 'gast' has no attribute 'Str'\n",
      "WARNING:tensorflow:Entity <bound method MyDNN.call of <__main__.MyDNN object at 0xb2d7ee940>> could not be transformed and will be executed as-is. Please report this to the AutoGraph team. When filing the bug, set the verbosity to 10 (on Linux, `export AUTOGRAPH_VERBOSITY=10`) and attach the full output. Cause: Bad argument number for Name: 3, expecting 4\n",
      "WARNING: Entity <bound method MyDNN.call of <__main__.MyDNN object at 0xb2d7ee940>> could not be transformed and will be executed as-is. Please report this to the AutoGraph team. When filing the bug, set the verbosity to 10 (on Linux, `export AUTOGRAPH_VERBOSITY=10`) and attach the full output. Cause: Bad argument number for Name: 3, expecting 4\n",
      "WARNING:tensorflow:Entity <function Function._initialize_uninitialized_variables.<locals>.initialize_variables at 0xb2aaeda60> could not be transformed and will be executed as-is. Please report this to the AutoGraph team. When filing the bug, set the verbosity to 10 (on Linux, `export AUTOGRAPH_VERBOSITY=10`) and attach the full output. Cause: module 'gast' has no attribute 'Num'\n",
      "WARNING: Entity <function Function._initialize_uninitialized_variables.<locals>.initialize_variables at 0xb2aaeda60> could not be transformed and will be executed as-is. Please report this to the AutoGraph team. When filing the bug, set the verbosity to 10 (on Linux, `export AUTOGRAPH_VERBOSITY=10`) and attach the full output. Cause: module 'gast' has no attribute 'Num'\n",
      "WARNING:tensorflow:Entity <bound method MyDNN.call of <__main__.MyDNN object at 0xb2d7ee940>> could not be transformed and will be executed as-is. Please report this to the AutoGraph team. When filing the bug, set the verbosity to 10 (on Linux, `export AUTOGRAPH_VERBOSITY=10`) and attach the full output. Cause: Bad argument number for Name: 3, expecting 4\n",
      "WARNING: Entity <bound method MyDNN.call of <__main__.MyDNN object at 0xb2d7ee940>> could not be transformed and will be executed as-is. Please report this to the AutoGraph team. When filing the bug, set the verbosity to 10 (on Linux, `export AUTOGRAPH_VERBOSITY=10`) and attach the full output. Cause: Bad argument number for Name: 3, expecting 4\n",
      "WARNING:tensorflow:Entity <function test_step at 0xb575860d0> could not be transformed and will be executed as-is. Please report this to the AutoGraph team. When filing the bug, set the verbosity to 10 (on Linux, `export AUTOGRAPH_VERBOSITY=10`) and attach the full output. Cause: module 'gast' has no attribute 'Str'\n",
      "WARNING: Entity <function test_step at 0xb575860d0> could not be transformed and will be executed as-is. Please report this to the AutoGraph team. When filing the bug, set the verbosity to 10 (on Linux, `export AUTOGRAPH_VERBOSITY=10`) and attach the full output. Cause: module 'gast' has no attribute 'Str'\n",
      "WARNING:tensorflow:Entity <bound method MyDNN.call of <__main__.MyDNN object at 0xb2d7ee940>> could not be transformed and will be executed as-is. Please report this to the AutoGraph team. When filing the bug, set the verbosity to 10 (on Linux, `export AUTOGRAPH_VERBOSITY=10`) and attach the full output. Cause: Bad argument number for Name: 3, expecting 4\n",
      "WARNING: Entity <bound method MyDNN.call of <__main__.MyDNN object at 0xb2d7ee940>> could not be transformed and will be executed as-is. Please report this to the AutoGraph team. When filing the bug, set the verbosity to 10 (on Linux, `export AUTOGRAPH_VERBOSITY=10`) and attach the full output. Cause: Bad argument number for Name: 3, expecting 4\n",
      "WARNING:tensorflow:Entity <bound method MyDNN.call of <__main__.MyDNN object at 0xb2d7ee940>> could not be transformed and will be executed as-is. Please report this to the AutoGraph team. When filing the bug, set the verbosity to 10 (on Linux, `export AUTOGRAPH_VERBOSITY=10`) and attach the full output. Cause: Bad argument number for Name: 3, expecting 4\n",
      "WARNING: Entity <bound method MyDNN.call of <__main__.MyDNN object at 0xb2d7ee940>> could not be transformed and will be executed as-is. Please report this to the AutoGraph team. When filing the bug, set the verbosity to 10 (on Linux, `export AUTOGRAPH_VERBOSITY=10`) and attach the full output. Cause: Bad argument number for Name: 3, expecting 4\n",
      "Epoch 1, Loss: 0.22527889907360077, Accuracy: 93.33499908447266, Test Loss: 0.18664677441120148, Test Accuracy: 93.58999633789062\n",
      "Epoch 2, Loss: 0.09531109035015106, Accuracy: 97.1199951171875, Test Loss: 0.10547540336847305, Test Accuracy: 96.73999786376953\n",
      "Epoch 3, Loss: 0.06637126952409744, Accuracy: 97.90499877929688, Test Loss: 0.08935525268316269, Test Accuracy: 97.15999603271484\n",
      "Epoch 4, Loss: 0.04881635680794716, Accuracy: 98.45832824707031, Test Loss: 0.0855206623673439, Test Accuracy: 97.5199966430664\n",
      "Epoch 5, Loss: 0.03946308419108391, Accuracy: 98.72833251953125, Test Loss: 0.08748962730169296, Test Accuracy: 97.48999786376953\n"
     ]
    }
   ],
   "source": [
    "EPOCHS = 5\n",
    "\n",
    "for epoch in range(EPOCHS):\n",
    "  for images, labels in train_ds:\n",
    "    train_step(images, labels)\n",
    "\n",
    "  for test_images, test_labels in test_ds:\n",
    "    test_step(test_images, test_labels)\n",
    "\n",
    "  template = 'Epoch {}, Loss: {}, Accuracy: {}, Test Loss: {}, Test Accuracy: {}'\n",
    "  print(template.format(epoch+1,\n",
    "                        train_loss.result(),\n",
    "                        train_accuracy.result()*100,\n",
    "                        test_loss.result(),\n",
    "                        test_accuracy.result()*100))\n",
    "\n",
    "  # Reset the metrics for the next epoch\n",
    "  train_loss.reset_states()\n",
    "  train_accuracy.reset_states()\n",
    "  test_loss.reset_states()\n",
    "  test_accuracy.reset_states()"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "colab_type": "text",
    "id": "ZxjIFiyBPorB"
   },
   "source": [
    "### 2c: Provide your own implementation of softmax and use it to train a model\n",
    "\n",
    "In your linear model above, the starter code looked similar to: \n",
    "\n",
    "\n",
    "```\n",
    "class LinearModel(Model):\n",
    "  def __init__(self):\n",
    "    super(LinearModel, self).__init__()\n",
    "    self.flatten = Flatten()\n",
    "    self.d1 = Dense(10, activation='softmax')\n",
    "\n",
    "  def call(self, x):\n",
    "    x = self.flatten(x)\n",
    "    return self.d1(x)\n",
    "``` \n",
    "\n",
    "Now, create a function:\n",
    "\n",
    "\n",
    "```\n",
    "def my_softmax(logits):\n",
    "  # ...\n",
    "```\n",
    "\n",
    "and use it in your model as follows:\n",
    "\n",
    "\n",
    "```\n",
    "class LinearModel(Model):\n",
    "  def __init__(self):\n",
    "    super(LinearModel, self).__init__()\n",
    "    self.flatten = Flatten()\n",
    "    self.d1 = Dense(10)\n",
    "\n",
    "  def call(self, x):\n",
    "    x = self.flatten(x)\n",
    "    x = self.d1(x)\n",
    "    return my_softmax(x)\n",
    "``` \n",
    "\n",
    "Notice, we've removed the built-in activation method on the Dense layer, and added our own to the call method.\n",
    "\n",
    "Tip: You can implement softmax first using NumPy, if you like, the gradually convert your code to use TensorFlow ops (which begin with tf.\\* instead of np.\\*).\n",
    "\n",
    "Notes: \n",
    "\n",
    "- Your softmax implementation should be numerically stable. \n",
    "- You will need to use tf.* ops in order to use your code to train a model (TF cannot backprop through NumPy operations)."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 44,
   "metadata": {
    "colab": {},
    "colab_type": "code",
    "id": "SiLj-uFrRAn-"
   },
   "outputs": [],
   "source": [
    "# TODO: your code here\n",
    "\n",
    "def my_softmax(x):\n",
    "    # Modify me\n",
    "    x = tf.cast(x, tf.float64)\n",
    "    z = x - tf.reduce_max(x)\n",
    "    num = tf.exp(z)\n",
    "    denom = tf.reduce_sum(num)\n",
    "    softmax = num/denom\n",
    "    return softmax\n",
    "\n",
    "#arr = tf.constant([1, 2, 3, 4, 5])\n",
    "#print(my_softmax(arr))\n",
    "\n",
    "class MyModel(Model):\n",
    "  def __init__(self):\n",
    "    super(MyModel, self).__init__()\n",
    "    self.flatten = Flatten()\n",
    "    self.d1 = Dense(10)\n",
    "\n",
    "  def call(self, x):\n",
    "    x = self.flatten(x)\n",
    "    x = self.d1(x)\n",
    "    return my_softmax(x)\n",
    "  \n",
    "model = MyModel()\n",
    "\n",
    "# TODO\n",
    "# Add code to train you model, your accuracy should be similar \n",
    "# to the linear model."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 45,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Epoch 0, Loss: 0.13802742958068848, Accuracy: 0.9375\n",
      "Epoch 1, Loss: 0.30212098360061646, Accuracy: 0.921875\n",
      "Epoch 2, Loss: 0.14324718713760376, Accuracy: 0.9270833134651184\n",
      "Epoch 3, Loss: 0.06991830468177795, Accuracy: 0.9375\n",
      "Epoch 4, Loss: 0.14896783232688904, Accuracy: 0.9375\n"
     ]
    }
   ],
   "source": [
    "loss_fn = tf.keras.losses.SparseCategoricalCrossentropy()\n",
    "optimizer = tf.keras.optimizers.Adam()\n",
    "t_accuracy = tf.keras.metrics.SparseCategoricalAccuracy(name='test_accuracy')\n",
    "\n",
    "# For each epoch\n",
    "for epoch in range(5):\n",
    "\n",
    "  # For each batch of images and labels\n",
    "  for images, labels in train_ds:\n",
    "\n",
    "    # Open a GradientTape.\n",
    "    with tf.GradientTape() as tape:\n",
    "\n",
    "      # Forward pass\n",
    "      predictions = model(images)\n",
    "\n",
    "      # Calculate loss\n",
    "      loss = loss_fn(labels, predictions)\n",
    "\n",
    "    # Backprop to calculate gradients\n",
    "    gradients = tape.gradient(loss, model.trainable_variables)\n",
    "\n",
    "    # Gradient descent step\n",
    "    optimizer.apply_gradients(zip(gradients, model.trainable_variables))\n",
    "  accuracy1 = t_accuracy(labels, predictions)\n",
    "    \n",
    "  print(\"Epoch {}, Loss: {}, Accuracy: {}\".format(epoch, loss,accuracy1))\n",
    "  test_accuracy.reset_states()"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 47,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "image/png": "iVBORw0KGgoAAAANSUhEUgAABH4AAACNCAYAAADB/L29AAAABHNCSVQICAgIfAhkiAAAAAlwSFlzAAALEgAACxIB0t1+/AAAADl0RVh0U29mdHdhcmUAbWF0cGxvdGxpYiB2ZXJzaW9uIDMuMC4yLCBodHRwOi8vbWF0cGxvdGxpYi5vcmcvOIA7rQAAIABJREFUeJzsnXl4VeXV9u8dY4wx5g0xQoxIMSJSioiIglQRFWdEtFhtRStKrVq1jq1t0eJQRevQVqtoHailta28SsWpjog4W0RERUohRcSAiDHGGNKY8/0B3etedzh5BQ/kM12/6+rVdXie7PPs/Yz7uO61kkwmgyAIgiAIgiAIgiAIgqDjkdfeDQiCIAiCIAiCIAiCIAg2DPHDTxAEQRAEQRAEQRAEQQclfvgJgiAIgiAIgiAIgiDooMQPP0EQBEEQBEEQBEEQBB2U+OEnCIIgCIIgCIIgCIKggxI//ARBEARBEARBEARBEHRQ4oefIAiCIAiCIAiCIAiCDkr88PN/kCRJWZIk9yVJ8kmSJP9KkuTb7d2mYN1IkuSMJEleSZJkVZIkk9q7PcG6kyTJZkmS3L5mDn6cJMmrSZIc0t7tCtadJEkmJ0nyXpIkdUmSzE+SZGx7tylYP5Ik2TFJksYkSSa3d1uCdSdJkulr+q9+zf/ebu82BetOkiTHJkny1ppz6j+TJNm7vdsUfH5o/v3nf58lSXJDe7crWDeSJOmeJMlDSZJ8mCRJTZIkNyZJkt/e7Qo+P0mSfDVJkieTJPkoSZIFSZIc2d5tyjXxw8//zW8ANAHoAuA4ADcnSfK19m1SsI4sBXA5gDvauyHBepMP4B0A+wD4HwAXAfhLkiTd27FNwfpxJYDumUymBMAIAJcnSbJbO7cpWD9+A+Dl9m5E8IU4I5PJFK/5307t3Zhg3UiS5AAAVwEYA2BLAEMALGzXRgXrBM2/Yqx+1/gUwD3t3Kxg3bkJwHIA2wDoh9Xn1dPbtUXB52bNj3R/BfAAgDIApwCYnCRJz3ZtWI6JH37aIEmSLQB8A8BFmUymPpPJzARwP4Dj27dlwbqQyWTuzWQyUwF80N5tCdaPTCbzSSaTGZ/JZKozmUxLJpN5AMAiAPGDwZeMTCbzRiaTWfWfj2v+t0M7NilYD5IkORZALYAn2rstQfBfzCUALs1kMi+s2RvfzWQy77Z3o4L1ZhRW/3jwTHs3JFhntgfwl0wm05jJZGoAPAIgHAW+PPQCUAng+kwm81kmk3kSwLPoYO/88cNP2/QE8Fkmk5lP//YaYiIHQbuSJEkXrJ6fb7R3W4J1J0mSm5IkaQAwD8B7AB5q5yYF60CSJCUALgVwXnu3JfjCXJkkyYokSZ5NkmRoezcm+PwkSbIJgAEAtl4jS1iyRl6yeXu3LVhvvgPgrkwmk2nvhgTrzK8AHJskSVGSJNsCOASrf/wJvhwkWf6tz8ZuyIYkfvhpm2IAH8m/fYTV7rRBELQDSZJsCuAPAH6XyWTmtXd7gnUnk8mcjtXr6N4A7gWwqu2/CP4/4zIAt2cymXfauyHBF+JHAKoAbAvgVgDTkiQJ77svD10AbIrVXiJ7Y7W8ZFcA49qzUcH6kSRJN6yWB/2uvdsSrBdPY7VjQB2AJQBeATC1XVsUrAvzsNrb7oIkSTZNkuRArJ6PRe3brNwSP/y0TT2AEvm3EgAft0NbguC/niRJ8gD8Hqvjbp3Rzs0JvgBrXGlnAugK4LT2bk/w+UiSpB+AYQCub++2BF+MTCbzYiaT+TiTyazKZDK/w2q39kPbu13B5+bTNf9/QyaTeS+TyawAcB2iD7+snABgZiaTWdTeDQnWjTVn079h9X/I2gJAOYBOWB1/K/gSkMlk/g1gJIDDANRgtUfzX7D6R7wOQ/zw0zbzAeQnSbIj/dsuCHlJEGx0kiRJANyO1f+V8xtrFungy08+IsbPl4mhALoDWJwkSQ2A8wF8I0mSWe3ZqCAnZLB2d/fg/0MymcyHWP1SErKgjsEJCG+fLytlALYDcOOaH9I/AHAn4kfYLxWZTGZOJpPZJ5PJbJXJZA7Cao/Yl9q7Xbkkfvhpg0wm8wlW/3p7aZIkWyRJ8nUAR2C1x0HwJSFJkvwkSQoBbAJgkyRJCiPF4peSmwF8FcDhmUzm0/+rcvD/H0mSdF6Terg4SZJNkiQ5CMC3ADzZ3m0LPje3YvUPdf3W/G8igAcBHNSejQrWjSRJSpMkOeg/+2GSJMdhdUaov7V324J14k4AZ65ZWzsBOBurs9IEXyKSJBmM1ZLLyOb1JWSNt90iAKetWU9LsTpe02vt27JgXUiSpO+aPbEoSZLzsTpD26R2blZOiR9+/m9OB7A5Vuv+7gZwWiaTCY+fLxfjsNol+kIAo9fYoYH/EpEkyVcAfA+rXzRrkiSpX/O/49q5acG6kcFqWdcSAB8CuAbA2ZlM5q/t2qrgc5PJZBoymUzNf/6H1ZLoxkwm8357ty1YJzYFcDmA9wGsAHAmgJGZTObtdm1VsK5cBuBlrPZQfwvAqwB+3q4tCtaH7wC4N5PJRCiJLy9HATgYq9fUBQCaAZzTri0K1pXjsTrhyHIA+wM4gLLQdgiSCBwfBEEQBEEQBEEQBEHQMQmPnyAIgiAIgiAIgiAIgg5K/PATBEEQBEEQBEEQBEHQQYkffoIgCIIgCIIgCIIgCDoo8cNPEARBEARBEARBEARBB2XjprTeb780kvSKp55yReVkN8qfFW69tX3497+tXm2tr1dYaB92391fhP6u5oUXUlt/+eo8aJB92HJLsz+WQPvbbWd2fb0ran744dTO13YQNS+/nNoVO+/sC8vpiXxqmauXU9sBoPO++9oHvn8AWLDA7Pnzk6wNWRdOOcWigffq5cuKi83eYgtf9ldK2lNaara2eehQs+W5YsUKs/k5cJ8BwGabmf3JJ2Z/7Wu+3oMPmj1ypC+bPn3tbXrkEV+vpsbsAQN8GbexTx+z9Z6rq83We2mk2XDKKbnpQwC47jrrR/1Ofu6NMht5XM6caXaPHr4ez03ub8DfL5fxcwaAJUvMbm5e+99rmT5bLuM+kLXDwX0K+GdQUWF29+7Z/06v37Wr2YMH56Yf+/a1PvzHP1xRA7W5iNdPAE3vW/KlAipreN8nZSqivmmS+yno188+cJk+u8MPN5vHyLx5vt6rr5qt4+UNS6LYSOu4bl75e+9tH555xhdyGbeXxzOABtqXinR94+c4Y0bu5mJJifWjzgF+ntI/bo977DGzeU8AgMcfN5v7DfBr+Ouvmz17tq935JFmcxt5DQD8fNN+zNYObjsAbLqp2Qcf7MvuoUzHRx9tto6nd94xW+fprruafdNNOenHhQuR9mFV8XJfVt85tasqGrJeo6WwKLXzapb6Qt5bZY1bXFOQ2jyc82WC8HGAl9Zhw3w9Xu50+S+rX2zt7drN2tso90V/uLi+zBV1g12D72V+bWdXj5daOgIBALpsupIaVZa7uXjSSTYX+SEBfo3lsyHg59G0aWYfcoivxx3EHQIAixaZzXP4vvt8PZ4ffM7SNvF5hM6kAPx6yOcqbRNfX/c0nt+0FrX8/veuWh53pJ5z6QyMDz/MTT8++qj14aRJvkzXV4bXWp5vfG4A/PlDJ9krr5jNZ0pdT2kfc2vr5Mm+Hq+T+l08Pvms2da5RPY7N275etrek082+21J+jd3rtl33JG7uditm/Xjttv6sg8+SM1mOfvk0z7NZ50WuXyhnIscPGb57Pbee74evwfSs2z4xS9ctSLqk2Y5v+bzvN1hB7O1D3bc0WzdWxnuY32Hoj2+XuZzEdl5mUxu+rFnT+tDfT8iWu6+23127+W8Furz57Vwk038Nen55XE/6TvC6NFm89w54wxfj/tGr9GpU2q6939fy/22UajntOefX3s7aKyvvohdpVl+l8jn59HUlLUPw+MnCIIgCIIgCIIgCIKggxI//ARBEARBEARBEARBEHRQkkwm83/XyhHLkyT9ss7qKsWupyJncrCLpPohs+veqaf6sl/+0mxyba1jWRC8OyC7vhX87nf+eiwFUvdYls585Stmb765rzdlSmo2iSsu3xn/OieOe6jg56ZunPx8HnooN657P/+5DRh1LWY3f3U3ZZdDdi3u0sXX2357s3WMsPsll6lLJLnpzi/dI7V7jurr6/Hz4f4E8GZtZWr3nvsXK1ApC7sX6vNg+QG7Zmo/sVxC3Xn5uf3xj7lzo/3Nb6wf1W10zz3NZnkG4N2X6fm9Wd/NVetdSlIFdn+W75uBIamtnuR/+pPZ7CV67sFvZq942WW+7PLLU/OK5KeprYq9Cy80+9A+i30h9UFD996pXfSnO3w9lqXoc2OZU66kXgUF1ocqY+SxzXJHbQuj0gbukL328mXsCq/SO4Y7juesjjmeV/pd7P7O80P3CZb3iHyxieoWHHBAajeLzCif1y1df/jzq6/mbi6OGGH9qGtDW7LLLNLFlhtvctXyVpD0SO532bDjUrvLKhv398/28/nGG81mz+gTqi919eYfe3Fq8zIPAIMHNKX2n+8zeRIrtgAgj3dhnUe81rMM4kc/8vU++8xsfW7cx48+mpN+XLbMpF7sbQ0AZSBZkoz7+Qtsd+/ZQ8UIRl291dN1kr3k+Tggnu9uGeCtSa/HQ063O+7TUaPM1iX+6183mxUKANC/wvYGt89293KxpbV2AquESN/4rNGtW+7m4uab21zU+c8P6vjjXVGDyJv+w0vyme+ip5RVk81TZ7DUm052d7JHyJlrAa3LPURWMIckrXPo3/W/BPMTGCpl1APgnaM/n9MAgNbbVhsv6wxzdb75y1+sD3WP4LbpAsWf99/fbJUE0TXmF/ozJQ8Z3qoqS/3YvvcRG9v8N4eWy4gh+VAdSrJ+V8Erz9kHnYw8LqZO9WW8hnJfTJzo6w0caPbf/ubLuCG33pq7udi5c9qPLSJz5vegEpbxAG6NbSRpU6GGNOBFkOV2gJcE6nmE4f2JZZEqaeRxr2c1nps8aOSdxF1D+5jPYNwOXcAZXd94nM+Zk5t+pD5slD4s5LGn7fzqV83mealyMT4Dqeycz7nU9y0jj3LV8prtXDJnnp1LVOGZt2C+fbjmGl94xBFmr1pltr7PMXyoAvw443Gl5xd+jnq2599H2pDOhsdPEARBEARBEARBEARBByV++AmCIAiCIAiCIAiCIOigxA8/QRAEQRAEQRAEQRAEHZSNGuMHBx5oX8apYwE0k8ZvlvwZq+T6X3utfdB0a22kaOaUqieeaP/+wAO+HmcmZDm+ftVTT52f2mee6fV+HEaBMx+qLJAliZq1ljMIskS39y9P8RVJkN8kKfEKWNP6/PO50WyecIL1oaYK5LgfGkdkt93MZv2r9Blrpj/8MHsz+LkOH+7Lym6kuBOkhW3kNKsACrmDdez87/+mJmtC8yZJXBd6xgsLeyMbVYWk7tfUw/zdHLsA8BrRo47KnX763nuzp6099lizJebIm/Pst+LevSwmxeIl/jdkzro48KNH/fU5Jg+PGdXc88BvK30ll6mGnSZWw9izUrsIXnPflG+ae20Gz/17z3jSPlD8IAA+NaouGKzZPeus3PTjnnumfdgssQzyNc4Cw+PttNPM5kUH8H0vaSNn7Pz91B4ylqJVqFabdeS8yOnawTHZdC7yNdvKQ81/pwJtXtj5erJm4t13s7eDg6bkKvUw4OOKKBy0RfXt48aZrZp/4slmi6Ol4ejOt23MdfeiRYfLVa5PrSSxtZ2bAPilTacAT3XegzlWDODDM2mouJ7VtpbMqTgwa72S2TPsww9+4At5/7nrrpz0Y0ODxfiRqYIunSyGwIwXClwZrzW8fOgaxMsHh0YAfBgTfnYs9weAq64y+9VXeU2uc/X23ts6hGOfAcChQ23drGu2NVO3LV7itW/43MNjQpd4vuYxx/gyDm1QVYXczUVOPyxr2XLq2M4Sw+MlOc+ml5DPHJ1OIje4eD0UFUp6ByjL8jcaIYofZ5WU8WrBJzVtL0cBkUiK7r8ac/efzTF9AH9A05g7HL/i3ntzn85d46RwLBRehACsHGDrSdmEH1rB+PGu3p+n2bjXUC481vnyGqqMQ+bwEq9rJm+f+uiGVFDMEU5pro1iNK4ILxgc71TjZvK+qLFhOB7OiBG5m4scw1AXEf7MiwiQPdYiB6cD/H4q++dNS0astUk6nO655zX6xIv2n+UvOQ25f0+46CJbmC+tPze1z8V1rh4faXQfv2I4xXjis5W+a/Dm9KtfuaI6ih1Tkqt07ttsY33IcXsA4NNPzdZAf9wffC7VmDm8aQorh5+Q2jw9fv5zX4+Xp1dfNfvBB329s882e9ttfdmyZWbzOerbx8qqzOdXjjsM+MnPMbZ00PHG3tZ5e9GiiPETBEEQBEEQBEEQBEHw30b88BMEQRAEQRAEQRAEQdBB2bhSL3JpXykpyso4BZ+42BeySxq5MjWM9rIndn/r+7h3k3P+XOxrrNIQhtuovswspVA/TnIhfPL8h1J7vx4+TfSyzSxl7j//6S/Bbs8uzanKD9jn7JZbfBnr2O6/Pzeue3fcYQNG28LPVZ/X2LGp2TLc3CjVfZXd2MUT10nlWKKg12Bv1hHD7NnNmlfk6vVfQGna5SINl9v44e5VL9dddjFb0/iymzx7GKt34q8nUP/qWGLXzOOOy50b7a23Wj9qukpyo33yBf/MmP36UJroSZN8IbsKq+yI3R3ZZVflPzy+pkwxW/2huf2aWpzGYcMZ5r6trrJtZRPnfrzhBtMYvPvuFq5e5eSr7YPKcnhC9++fm37s1Cn74s0Srjbkg29eeWVqSyJxJzdQGUFv6tN6enjyWNFENl9DhXssgCmRMl5lirLY+l2dNT0ru87yONOBwONWpHwtNBfzcuUKDQDf/Kb1o6Rbx3e/azatoQCwMN8kdlVTbb1adty5rl6XTa0nv31GmSvjLYJdydnlGQAaG1lwwvPvdl8R5r7dq5fvyQsuMJu98SsfuNVfgtdilaHy4plNRgj4tUNTSPP1c5W2tqUl7cOlNf6/p1VW2MhvVVZvco0nl1h/SuZb/OEPZuvyx57gfMxR9R/vrbxMapZjXi622sqX8R5XVrvQPqgLPl/krbeyXmRxL5PXdCsVURMvyipDZYqKcjcXR4ywuajjhnz9l//iF74JZLPzvezm4EfdhnjZpavWdZlPznwc0cTBPNPzVCpDz3Y+nXM7+1pgEc1cKePekmORY48xY1J76Z13urJKnsOffpqbfvz1r60P50qr+fvkgLmwtH9qV1XYmezWyX6n4aOIKoqvv/5++sRP08ct2HPPQ1L7+edNLlRYuIur19j4r9Q++uivuDJe4kaONFu3ND56iHLfKayZvHE/WXsB0HpN5oted92GkV3q/GfdjcrSqFOWDrIwDXp2Lyu1dfnJ6X5d5veLWTNtLCxe4ccCq+O6fGbhHOqKK109Jz3WTmD4JUelQNyxDz/sy/72t9RsfuaZ1M7n0ChAm+9oDRQKoyhH55vGJEn7sFDXoD33NFtT3B9i8wO33Wa2yC4bim2OqeqJH9eECWY/9dQH0kpepXlsq8iWg9B4ffqmm34ntZvm2p7OZzTAD1WVc59SSu+jvFnrPsR9qDfNsseHHgqpVxAEQRAEQRAEQRAEwX8b8cNPEARBEARBEARBEARBByV++AmCIAiCIAiCIAiCIOigtF86d03Bx4JV1etz2l7WJUqcICegu/lmV1RPae2KOd2h5l7demuzWRSq9VgkL6no6n/7W/uub33LClTr/tlnZrOoFAAo9gbOOcdsSWFcV26JOksWzHJl+L6lXM5ZOndOA676aRZValwR0lO/2dV0/ZoF9a9/NfuPk5p8Ifc3Ca3rRp3kqmVN5atBeDiPsAY64O/iGDUSZ8P9nd4zl9GYfm6BV9KzlFczVJ8ynNLAV1bmTj9NOvimU89yRRzfY+DOPu35m9Wmce59IaW81Pg8fFOkOQYAPP202TzvVfvMIlh+thqEh+NLqOie43nw30m9pYU2jzQ2BseMeuwx0+pfcEEnV+/qYZYi+Y8rDnRl3z6YIuaUleWmHyndabXkbuYnuRAenlUUpalVzAleoWUmupgOHJ9npdTjuBP8Xxn0ehz2StMcc4QolkWX63zmtLL77OPLaK09YcHFyMZd4+lpcRwBwAdLyFEacAA+VhPn9gWAgw4ye5ttXNHSb3wjtfkZ5WnK3n9ZnAgN6jC/2cY9S8c1tfZRIy0ewspa60mdK7xlDumx1BdycAzWsPM9AniJ1t7sEcb8WNDYJL2PP94+tBUU54c/zEk/1tUh60GKb1sZN85sDl+kyxhvQZqhl5c1voaGxeAlmjPpbrmlr9e7B81ODUTAMQX4ghK/YWGzxS+sqnnOlbm6fIZ4+WVfj1NIcxATANfNtfX13HNzmM790EOtH3VPk3HquOSS1KyhtbhAqpXRWbH5nntcWT7PfT7LcowLLeMzl7aXn5muCTyIdtjBLieDi+efXB0csZLvc4jGmmwjVuby885L7c65ipt2113WhxpfkINn/fjHvowCns2o7ZvaGmLjyis59oecbRw88XeSMophgjfJlgOx+7yJlHEMNW7T6VLPTgNvvNHflUyebHaPHmZv4cMX4oADzNbXrsopv7YPZ521YWL8aDxRPlvrPk19ftU0S53+ozHLfT1ee3SO3X232XzzEnxtMc1Fjurzkr+a2581Fhf/XT6/m77zjq/Iz0DPPvzOTO+SK+UcxGc6iQ7jzoy5ivHj4hdyTnUA+IBi7cj63uoA8h/kt4GbZg/O+tXf//4T9Mn6qVev81w9fn3ncf/ii/56/Po+b97b8m12Njv+eJuXv//9aVJviyw2sOWWtofwcn3CaImwyb89cEwoAHj+ebNffTVi/ARBEARBEARBEARBEPy3ET/8BEEQBEEQBEEQBEEQdFA2qtSrgVK7FWlqN3YPldSg99fvl9rsKXrU5KNcPfaPbrzsMldUyK7fJP9YIe5n5eRqV0M6JJUw9Kb2L5AU0lyXva3F6RR5LOESaZqTnFHKeU45CXj3TFY6AMCThYfahzZSu60Tjz5qA0ZTj7PbseYD3n57szmNpjR6RrW5iNNtA/AqhQ8pO+bAr0raPdYbsJ+uuq3TZ071DQBFheRex+krNcUif5e6i3IuXO5P9u8HkBy0b2qvWuVdOPmrq6py6NI+a1b2fuS5qWnJWQ/CbtQq0+JnoWUsF2BNA+eWXtvfZft39j3WPmZJKU8W1VLwNVUjQW6nV/3WkuRqpszlc82VeHGjF590KyQ3486dc9KPzbSe5oteYzlJU3XtYmd+dhZXWU0bCZR9O8jW/5LAT6GQ5kqt+IuzC7I4ZKOS743n1Cef+IokWXDu2YDr75XDvpnaqo7gIV3wy6t9IWt2Xnopd3Oxc2ebiypj3G03s0WuUUPzqIIbrvfON6ku8/x3vC6r7IZdr4880uz77vP1WJ4jqZtdilZKR9siKUnz2N1d2jub3N9ZaiIKWRRdfrl9+O53fSGv2SUluenHurqssoRbH7E9TZUno0ebzVshL1WAHxaskgN815TxbBdZzdJmm43cRF0yOUWxqAvRLZ/keywL0n2Cx5ycj1yD+cygGz7LLbQPWXLdt2/u5uKuu1o/ys3X0ZgtYfkk4OcOjz22AeC448z+1a+yt4PWq5bb7nBFeQ9QynBeR1UDyGulzntay5aTXEXE6i7d+kpZs/kTixG6bredvwjdS4OkoeaTW0Wu5CW33mp9qFrUXShdushlnutzSmoPPvmrVrDvvq6eez8RuZ4bp8OHmy1nisXNJvDhKaCZyXmp0szNfFzi4feDH2i6aj6oHCNlW621XmHh9a7W4YebrVvUMXTJLl1yd0atpfNNqe5pRxxhNu9HAJ6rtmfLa9uIFX4eubO8vo9yR/BZUd5rZvMeTP+uci7+3CBlLJNk+foSke+76+++u78In3NZ+ibrz720rx/F7ySA1zktWpSbfmQZuz5jPr/puxPt8w1H2pq5xRYvuGqXXGKSP92CuNu6zbMwDM0i2XXyOn7mMq54g145wIdy4KV3cA86weqk1fcO4pRT7fT829/SbwPwoTieftrepYeUv+nK3BnxpptC6hUEQRAEQRAEQRAEQfDfRvzwEwRBEARBEARBEARB0EHZqFKvJnLdKxgzxhdSVO+lA0a4IvZiK7mQItarNIRTImnoeXZ54ywfWo9c+RaSe6zkJ0FvslWawFfkjDrive2iuYvDlsugcCj5WQ6pvd/Ve+YZe2577+1dpWcMJ6lCjrKXOKmXurHx8+d0AYDLpPLQGQ+lNruyAj4JkwZ2Z9kTd2Hl43e5ei2jT0ht9nYvWOF7cWWh9YB6QrOi6YReFKNfs9Gx1EHDwLNfP7s7j/Wue1tsYe6Xn33mXTjz7v6DfTjuuA0j9VLtAD807WN2j+WHtv/+vh5LPjjVDOAfLs8/jezPfrrsgvm3v/l6AweazZnyAD/A2BdUM7BRXzWUd3NFRfmW5SbZzDJrdOrks2ywC7RKNcaPN7ukJEfu0JT1ok4kqzxKdW3hKcdPQTNtdc1STz+zq7JMZ+fWzHIAEWe672orgxh/b7G6O3MWDC3jxYTG2cJ+Xi7MnrLXjZJsRDw+ly/fMJmEVAvEn6WsjjMWEiUqi2G5q/rpsySHXaDZ/RnAsp2GpHaXTtZD86t93iKesqrI7NlMI5Hnpe4VvNDLPH2T5GO8ZA/WzeKqq8xWuQ1Livr3z0k/LltmWb2efdaXtSXh4qXrzDPN1myXXKbwo+QluaxUsoGwtLnYZF9FKxa7anNqbf3TPqzMp9MOS15UzsV9qPsL+8Xz+j9xoq/HMh0d6zw+R4zI3VzcfHObi7qGUEafFyf5DK0DH//52tumHc5yUd2D+FmwdkdlEPx3rH/nfRXInoEN8B3Lc0fP1CzP0PRWtCcvp/7XfDwFnNlW4xHw3J8xI/dSL5FW1H/966mt/9W7iNtJMkPNflSC7LhrsIR+E8nIxfIxzejLqFSN4XnFGapUUsPP/MILfRlJJoeM7ZnaOpQyGZOP7b77Vq6MbzNnZxvAy4RkP2p63DL36iMaXD7fPvC6xNkcATc/mkWWnM/9SOtm3WOPuXp8NuFzi6yJGUtmAAAgAElEQVS8oNWwVQZK3kFL6Ky8XKSbbY27QpJXLqdzUGc5M0ylex6p6zJvHrmSeh11lPWhvgdw2ySd8Wk32Bv2xIn29H7zGy+Z5ORu/XuJiI5l8nvumZorpa/5rMx5qjWLIW+FekblMAn8/t9X75lDnmgZvdReOtmyrbL0GvBnAd5mAaDnbRSy5OqrQ+oVBEEQBEEQBEEQBEHw30b88BMEQRAEQRAEQRAEQdBBiR9+giAIgiAIgiAIgiAIOiiadW6DUsDaU045Bzjdd+Vtl7qiO7penNonsaBT44+w5py1zwCaKNUvt2OxaNNZ78dxKPbw3+T0fxqvghPOkQSxlS6Qv2uIptYjTfAr06al9oynZ7hqyT4+rZxDA+jkAhb0crpKAC0VFjMn72tf83+37bapyd2m2TCZVav85+99z2wXe0D0oXmTLeZPAafRFE0lS9Y1FeCoUfRhBWlRVSf8AaXOVK02afHnd90vtY+VMBuA5fOcONHHFTh9wI5aOTeQrr+u3v/+WzKWcgyrDpXTsZJuFv/8p6/HfaKCcRbm8oO/5hpfj2OOLFu29r/Rdrz3niuas91hqd23kLTf+bL0UV8VvfCkL3PzyNLBfvihBOKg2a6hoD791OyStsTa6wKlbNc4PoMoVXAPiY/BccdYj6yJJnmdXCnrJD+REtJq18ma3JnSk66gmBDyeFycNIly49pYSuO2XlKOF3McgDb6l+M+cMgqQPpN0yNr7IRcwfND1jIXk0Hul++Qo5eVqPCb44xIOlrsuqvZnL5aYt/xMvfZZxaVgFMRA15zruGE3MPleAIa64TXB8lv3Jv6YC6PSc43DLi+a+TYTwAauvdP7TLkhi23XOtXA/ChOD780J8WHnnE1pDdd7f4I8ce66/Bj6hktj8D8Hgu44qvVPt6tGl+nLFIE4VdfUwzDp5UWbjSl/Go47ku6apd3BjtX67Lm7CMzaUUU6dS555+X644+mizdQ0ZbfviwK/Kqe/nFN+PO1zPYDzXtYxjXnDMFt1MeNLx9ThAIuDj7vEeCfjYJ3yY4rkH+GegAZ8ohkZnns8cgBHwZ30Odge4uEk5g9sscYl4JM6SP9uPx/MFF6RmhVyjiQJwFUhssSaKDcTvCBr3KI9jPfFY/p//8RX5XMVjAvBrI8cQ0tgtX6XU9DqW6Mw1deqtqa3rT22txfXR9a1kCZ0+evdGrqijMVVCsYgA4E9/MluHJebN/HwV6XlqPJci6scCmhMleh6mPdNFu5Pv6k3vcC2yt+bRuaWBxpbeFv+Vxp2qonnE57t6OY9xXJ9a2VtLDzkEGxTpw/nNFsdG4zRNnGhnxR13tPnBYXsAieujsfx4zXv++dQs480awFw6R/MMk4hBrn9XSBlHinTnaD44AX7Nl3cVHHxwal54oT0bfX3i26Q/AQD03GUXfB7C4ycIgiAIgiAIgiAIgqCDEj/8BEEQBEEQBEEQBEEQdFA2qtTrFXIvHbDPPq6sltz6StVV8UyTerG7bSu3RXaFFx/0ApIccKrpSmSHHaDFu9G5Bs6XMnZCZqf7nlKPnYULxe13Bbmn8/X7ynMDzO/rmWd+7kpapv80tTfIL3ySKjBvHrl8cto6wMkkupNHMnuhAr7b1Lv7o4/MZklBVbmMA24XX5DT+AL4Nrs7D5eUwlOobjZpEnzqePGcRP9+ltRxAnk5vvqql2wAe6dWK3XehpKXkPt9yZQ7fBn7+WqaXnYdJflkq3ZyPU1py6llWR6nKZn5uzm1rkhenJ+ouKr3xRz6XnL0ZldrwGv72pAtPPHEFqm9//5eJzRtmjmDTp9+lysTL9fcQGvaoB1FEkjuxK3S1pLN65+KOipoMJZpmnF2Vya7lSs0+YWX0/XqxN2ZU3PrpsTtraZ9QmU6jeQm3SqtPJXVXP7H1L7hhmdcvaOPtrmIr0kezQ0hSwC8v6762HOKa9774FMH9+DxrPsiSx9UhvEiSVQ4F7vICnqP4jlBcrsefgflr9Yhg6kkE+Z1eYstfD12gX7G9w/GjEnNPuwDLdJuTJqUmoXiAl44m6Sc++2HXKNKVK9q/0RqL8faIO9zAF5he8z2Mrp5LrEOQ9dk6pBl9PjfeCP75RYs8LOMs2P36GVleTVLXT23Gap8iL+A0ocvV+k+8/bb/rOeL3KFyrsYOnSccr7X697KewZLTjUFug4OhlKNOymkSlR22slslmdK6nIn+ZH7mlNvUgJWw6h0gOdzf1mbZtTYifZ5Wi5WnXOcq/cKTb9Tz3jIlR266DfIOSwtnDDBFZXSWOyv0ri33jKb5k79617SzTO26hM/n1keXUznlzxKtw0A9XS+L+a1UKW4PCc++8yXkXS6juwSHhOA78QTT/RlLIGZ/OvU7tr1LFftscfszDVmjA9H4PaNHFLCZxo5Q9bT8nLCZAl3wRsP7R9L5czBq2iZHLy5biGNkyJ4mmi95XHRgyWjALDvvqmZR88cgJPp8fVrfS2Xzl2FrrOpvZwuXuWM3WldflTKqmiTaWOVWjd4Lsp9v/CZrUGT5fXr9tvtbHvSIHqvVJ3hZ9TXkqad5ZruXULmYh/SpPf42c9Se7G/mnvn7y+hWVrobJh35JH0RyIi5L2QF17AaboKaC1vbvZnLB7etTpINt8cn4fw+AmCIAiCIAiCIAiCIOigxA8/QRAEQRAEQRAEQRAEHZT44ScIgiAIgiAIgiAIgqCDslFj/Awgfb6LDwJgwbhxVk/SrZ00m/SmpN13NuBz86q+nbR2tRQjpPT44121lt//PrVZ49cZnr70dz3obwBgOtkcx0dTBrLitLPkvs2ndIKs55SEjgA4PoLXLOc9cL99GDGi1V+uF6wX1qA2rDEXvf7SUkvzyKEZRIKNAkp6P7/aJUjkcABesq46etYDU/r5phtucNW4hd1UR89aaNJl1nX16SqnU5v0Eg89Yr+r3nnnv6hEU17aeHz/fa/eXUZpd7sgh5A4dOHQk1xRVSHFa9CYBxxrh2JltYLjHHCqUfluhwYYYA0+rwmc2l2vp5pajr1AOvhWcYfoPlt6+GhcefU2i334MU24eUxqaXpKDV+UEzhwkMZ1obGuizyvIUPauPwKjs+j6ynrmBkf0AR47DGzn3giNZvuu89V41hoLfDwKsBx13Q95WuUSlwGVvBXTb2OPj3l6p13HsX42XxnVwaKqZNTeO3X8UspmReX93dF3VgYz9pxHQu84P79776MNfgcOE2vceONZlM8rBunev05hxAqu1vid/A85b1Dv4vjLeg449hD1KabHvdztuvwwcjGiPr7s5atLxymQ0PV+KnjY4JsvbXdH/+dhA7x2ernyYzmPuT1WhchKus7dGhq3zXbx/HhruEhAfihyktoaakfBwOGW4LbgnlzXJmL20Rtl1pufo/8xS984bBh2CDQeQH0jACgZfyl1h45cmC6jeGWrrZK5WnMLo5pp3Od+5Hns8ac4z7ma0i9umaLGPKWXw5x1VVmDxyYvUlD9qLVuLm7K9uL+n8zCoemy+SiRa+l9rRp/iSdeUKCPOYCiuXIsW8AoITie5RK/MI6moD5FC+k+LTTXL3ibbe1D3/9q/9uisNWwBNa9rtijhFCi0edtIkjmlTBw7E/B9Mi0yjfVcjxZk4+2V+E3mMWjzo3tfeSJXnqVDv3aZgg3Hab2UPaOlGsIzwHPvzQFZ1+LEUkLJcAirTfcSxB/zbh4+nMl/g/fFzj84hEMnP04IVe45rxxqixXW6+2Wy6RpOMBVodWqUTZ3h3GKWB9mhjGSCB5Kpuv72Nq64nHPNRNrXZNLh1WPLrg4shdeGFviLH9tOAsbwO0J5TsvferlozxfUppFhM3Z7yZ0OHxLLM4/2IA/Idcoj/Oz6/0PcCcDE759fbfqoZ2nkL0f155YqRWZvMhMdPEARBEARBEARBEARBByV++AmCIAiCIAiCIAiCIOigbFSpl3NRldSEA9glTdzunIToa18zm1PdAt73mHVBgHOhK2X3cZYiAMijFIL9ttrKCtR/m9rUmdzDAKA3uYhxUnlN5853uZykXQDAIip2gfaiHAAYnlrbbCMyi8dJIpcrqRe71unzH2luZi9+7OVMu5Iqhj33VOrVvbs5ZKoahxUA3RY8iaxwxXvuSc2XpFo12SPFJbj4K19J7boK67lPP/XXYJWCZrL2GYbZzfEMqTcttZ1LP4Au36V+uz+HEgVyK6/Kl8SFteTvLak6mx6wJJAFw8itV+Ua5Oq6Mt+7d/Mly0faiJYuwCf9TC7glgTJNdm7h8kDneYCyJ7eWNNCUnrVPHGPnVNj7edLbLnlja4e93fPRi9ceG5u39QenF2Fsm60kdexkdyE5U7BotISckUt0VSyvK4ddpgvozV0/hJzmpasqOi2Lzko33JLaqqcqy/ZKuFiF22WzmoibP6vGOrW7Vzr3SS+xNUb+AmtKzs6XV/rm8sVvLdISuZZpZZuvFAfDI/1z6slVN9gllNyWnXZn5spXWk+yVc0I/Kvj33OPjz4YPbvZtdodanm9OtPP+3L9tknNa+6z9bljz7y1aZPN1tViiOKaXfN0b7IHtycbRvwWWyTxG9q551nNmcv1r2kqJZEBpzuHvCparmMXMcB+PMX/c0JI/0xsLzcEgfrMsnqMVYQqqKAh+bw4X1dWf7x9rmEpIeLWQIGL7XfQ86ElXo4yBV8XZGL5l1zdWoPGvtD/3fNtqo6ib2uGXyPBxzgy7guSytVQ84p4XkCisx2Rb7ND1V4klrT7a2tljiW8UgnNx9sc2dgJxMevfKKP+lutZVJ0DbddCtXhlcoTMJ++yEn0A21+i/b9Lxa5ExfwjfP96rpyvnvOLwE4KWCfA2Rlzj9Bq2TK2XM8RPX0x+LOhbSfO4u9RroDFykE5Um9HQaZief7Bf2c86x85wesYb0k30yV7D0Udcy0iQ2jfym/7NjTHJfQov/YpFOkVis1Tjhmrw6lkg93nUb6PpFunCyfnb4cF/Gmwf1R560l9HzU+9sZb/7na9IWt0q/4KCZtJb5Z/U+k1zvWD5KS86ABacaPb48f7PSqrp/HzEEam5Qs65ZbSBqgyvK535Smj8LJR9hsMH8PpfqPOe5Xp8wAD8ZshoWAvu67fe8mV0Fu9J57kfPn6gq8av3Wf4V0m/H7TxohEeP0EQBEEQBEEQBEEQBB2U+OEnCIIgCIIgCIIgCIKgg7JxpV6//W1qNklRAWf8Ehe0ul57pHYJuZxjyhR/kX/8w2x2Wwd8hgb2o2Y/bK1HblPXnbnIVTvvPBMdHH64d/u9//Kfp3YfynzUxNHb4V2ZV8LDDpkslNEOy7xrMotbRd2GLQYi56hUgCEX/U6jL3VFBdXmCjxokLkCs2cs4L3RB4ikhwPlz4K5Bfcb6uvlLaB8B+Qu+Zyv5nIyiVAJoOwPJZN+bbb44HchacZK+Mwm7EK9zTbmjPnee9919W6+YCE1Sty6s2XA+qJQloSVvbxLYA1JSv5U7SV736fkCl3IDfzJJd69++w2kq7wc/nHP9ileEepyWPtTbK96+OZZ5r7+Pnn+/a+Qk6wRzXOsAKSdgHw0hORFXCXsIenenv2f4+kLeW7+kKV6eQCbqe4mhbS+K2Te3V3xxIuWXdX7pVdBlNKXvE9/0H3/eyz2dtI7s+qKOD9oEKyOi6X7BP/oVI+N5BdotmguBPp2YwZ4zNlYfrFZqukRrPT5QpyL24Z6uUOxeRW37NQJJkV3c3mwaipeTjLi0jCltCzzSNbs4aw+/hL80ziqapszlgyj7NbwPdXCWfw21Hm/RtvmK3Zm0hWsIpcnq+80utE99zTXLs1EQiaJXtgDmAvdk3awsM5k6lzZUOHmnigUyf798oFM1w9JzfRLE8MPy/KagLAazTYlnm/YoW1SZUhfDxiJYIqG77zHRsYW27pZ/vHH1tf3X77Hal9kgymJ0n+XqkaJB3jGwLNEkM3qcpm96A4zICel/g+dAPhNYrXHpVxXnml2bSWqU6Lx6EmWyxqpnHIMhTN1MrfTZl3AaCAZE5zSa7ZRyRsxx9v8nC9fCtNYy4gybJ+XSHthbrG9aLx1/2cc6xApUysS9H+5XnKtg4YXvNoLewu7yM1dP7rLu3llYSvniftLeIFSHWvdH2/rPj7uv56yzz79tu7uzKcP93sc89FzuCwHrLmzag2gc6Q2V4EV0CynpW0SOm7E526W2Vt5rNEjyz/DvhjHYeS6EfvugBQyQskSdEA+BcdkiGpeJu9NHT54e/m7F/dDzrI1etOEtI3JRs1P2GVtK03JF1rGHuWK+IpodOo9zQLf9FAY1TfhvhcIqcjLGd5Ov27/vZQxWscN0rX3e99LzUl8Atmkc0nyvlyBuLxo2OuF42RIgoz06ePf99huTUndgUA3Ej/EFKvIAiCIAiCIAiCIAiC/z7ih58gCIIgCIIgCIIgCIIOSvzwEwRBEARBEARBEARB0EHZuDF+SPtb8PLLvmyHHcyWMhdX5bXXUnOBCIZ7UDq0VjkHOc0Za99V88q660ceSc0bW8UsMW36tGnf9kWTzzSbNJYFkpKwH8WMmCP6dtZpsp5Qk8adQfrgsbN9CmmMewM5h9NXqvaZdLg9b5N0pxSg5+CDLR7Mt4+VxIT8HDSdXlfTXM5aYCpUjakwcqRdn5+q6nPdE9eYIAyNkUclvkwFNbFvtdca3z+V0jZSTIL9RvrYKT+kWBW77ea/+pgNoYEHXHrMsud92uUySj3aq5dX+3KG5pNPphTZuFa+gGPy/EbK/kW2jaHWsSA2pTJLf6rDjoeMZlflmBTzKyw2Sc9+a48bA6CV4LiaEj5yKJ2rB93r6q34xjdSW39RH3wtPZ/BOdLB8xqn6xhpuYdQCmwALnZFw5jvp7aL+wCgbC5FxdJgLhzHgtNxb7+9r0dlK/5tsT00Ulg/XhslVkVnjq3zySdmc9AvAMX0eeGpV7syDgnC3SsSeOBC0r1rjI9WgT1yxKRJqZkngc0KSy31dVOFSzyKgtmk7Oe9UOJEzCGNfL3EDOMQLrx7SMgWp/8/pfonqT10yhWuXvNON6S2xtBwrWehOsUbUxp+9CP3uYjWw4tffNHsY0V1z2NI46Y9rgr9Lw7fTr6cqngJv/Zav55yqI+yRkpIq7HdaFy0dPXjgLNLV/Kc1ZhUXbqYTfELdFzxVH9A4gby2stN1G1qm23s+b/33n2+ENNT6+STLdLGyfD99Ne/ZuzDVJ9e+Nbptsef4sPLfTF4LTv8cF9GY0qXwwJefzmeB50hAWAFxdFqhsfFNqO1slYCKPHfle+5p33g+JcAjj3W7KJTT/BfxnFGnnjCbIn35OLZcAxNADMo9TjH12h+7DFX765P7OT1w/FFrqxVHI1ccKadv3tedpkr+gvZuj6Vkd2dz54SK6uZxki+nlH5wMGBv+Q+k1140Nrq+sknPg5KxVabp3Ztq4BqhltyOD6RokGWRo9OTV4md9/dp95+aRydbSf9xJVtsH2R4qNqPNfi4RSLb5hvKy9GeTRG9Uw2lGyNOcgnoZLjj7cPdD0AaKHnyTNdY+RU0nzGNdf4Qko7zu9Q2tu8Py/X65PN8X6mS73xv/pVavfWM+OPf4yc02yrFb+CAy60FXo3znJlSyieGMfk0T7kGEttrSS86pRp4dNPm03r4lJZd9s6NXC7OGytfpe+gzI8Zirp/sdt91NX7513fpfazz77HX8RXb+zEB4/QRAEQRAEQRAEQRAEHZT44ScIgiAIgiAIgiAIgqCDslGlXuwCWi1lPa66yj5ojrKRI80mt0J1m3qcUqeJGgTllDK3mlxWK8R9tYDs6dVVqb1okaT2xdtkS+r46eQ6y3KBzTf39YabFKiv5Jx9iFwDq+nfvymtaCDXw6IV4gC47bbIOayT0LSyJ55otqT+ZPfLshqSAZWKjzj7yVN6eADORZKULKCsrwCAb+9ljsfsLqkOqW6MaLpYzlVLfTPpRF/t/PPpg/i73/+A/a76wAPmyNcsPt6kEMKqVb5s2WW3pnYX5BBuq8oiqYHqxXvccTwPuI/V+dRcEI8/3j/bQYN2Sm1296zKl4SM3Cf15lJdV17lqrE68623/CXY85qHVlP3w1y9gvqVqd0ySNIgkouqG5J9/JxlF1tdm0axy3muUp6yC7rm62Vtk45tuomifHKkrRYBFne+uiez6zrLDTTN8mefpSY/E03F7qS+KnNhF3e+F801TZOxu6h7eIzwmMtbImNu553NpvSdAAByk84pfE+33eaKutE6urLeJwAtY0n04+ZgPFP2NHZzVnkDjwzuH3Uzd99Mz73nRD+WeQRJF7h9LJ/kEj1Fu7n4nnusnlyj6IMP7AOvW63kXORwvddevoz1miO87HZ9GTzIJMv19f6/p7GL+047uSKUlZLUuZnugc4GAFrnuyUqK+gar1APsywS8JsLpQFXtQpPYZ2KLCs7+eTsX8VHgUmTvIx64kT7/P77LJ3wOl2+xvTpd7iyQs3TnSvGjDFbzze05pXkywrPD4bseR97SXEvTnUu6dxbqC5fXWUo7pt57WBpDICqW2hsU5poAH587b+/2RMm+Ho0GBpEasRnZR6dfneGk77Nm9ffl/UgOcWQIcgJvMCL1KuVzIPYgz9w38g4yN93X/ugUjXeh+nvvn1iga+HU8i2k920ab69x1D4il5z5/pL8P7HE5XProC/F5J2AXDt5+3+pZmS9HoSjW+W/wGtF5BcwZJlOcP053sXyTfOOCM1S1nSqPVYZysH3RJ+1nSIbJQU6Hx6YPFeX3gW0CagZ58iDlFC777F3D4AfWlfL2Z5GABw+m9OCy5y1UZKk154yy3+GvNU4J0DSE62X+FzruiKJXTOnjnRlbEqrDyLDfi1Uc8sfcgu4PFz9NG+Ij3zBnoG2YWVwFL5zHV5/dP087ySqBywO9n5b9vvC+/stMjVu+gie7dStR6mTDe7r45CIzx+giAIgiAIgiAIgiAIOijxw08QBEEQBEEQBEEQBEEHZaNKvfLJtawHa3UAp915cTPv8jlwL0uZMZtcNzXfEbuHieAAw0gGxo6J6kbLmRW8F6f4MoPc8yBSGXZDZBdCdTk/77y1tgkA+AlwhPlWLvgk2TnkO14K8PAZ3ZFz2O1VJSTkYgmS1gEAfvtbs8l18rTv+98er73WXGKL5Borm8057s477akUForTHLnrcSR2jfruFFfi6ll3tmUNmDDe/l2VLCz9ufdsH/d9xAC75ohh9u11zT6zBT/GgrNP91/A/u5d9kDOIHfgNyv282V0G5qhplOnbVL7ww9/ndpjxni5IyuDdJgUzaMI/vnkvKlh/7ega/7tb6lZIu7Kw4fbc9Epxh67g/uZk/zKet8HxcXmBF7Q6N34m6m/CmY+aQUiz6wg7cMr8LSQK3bOfm0nP8+ltJYAQCV91jWjkCRiLf3M9b6mtLe/Rg31E2vmAODOO81mOatIbppIvsDzr9XG889/mk1uy6sbTAOI5as6GSmlW56U7deHHH8nUIYQXad4vqnORQdyruBBqzpQ+s6ycT7jy5IbLIMW7xE6vtgdXV2lOaciuyjrnbLbtJun8ky4X0VE5/Y4EmNgpmSa4V2su1yDsx3hPZOdLq3wEpJKymB171yf9ukolYXlAjpfdN3ey0iHUUZQVWsse99667XXVA5i9OhhmbeqmkWGwf3B40dTbfFnku28807Wr3XTAfAqkmXLzP70U1+PXdBVXXLp+TZafz3JpJVLltzu6rFaj9U7QGslec7g8SzZqVgep9Lakr3Mrb5umI0vWV3QQNfUNZDlA9zDOo/cbs3nFh1cLN3QscDZA1kr34a2T0adk3pRMIbWaztlZBo6VKRebWSqWm/o4N75W99yRb3pXlut5iwB4f1D9nlXJvtHXaGtXtX0+O++W6Xwdo7adNNLUvuYvUVEsi9JYFxcAbjJuICzV0nmqSqejHJO4OyuVfTeMmeyzxD86S4mTXtDInEcfLCJl1pJuL8InE1LZJFOWilpfVcWWivK/kwFmg62rbnDCw7Jr1f6Wu7Nj+eHiqa6k13EcnLAz9OxY+ni/r2y+Prr7YNkT23qYWe32XT4HNzLt7iQF3QOoQK0zviWC/jeRGrnuuNxf6+8SlS1ce5aTutHK4kpk2XvA+Bk1EUkoessWRL5rzQjI58o+LShIR/4TVWvkU+Sv4sn81W8XK9fP5PrVaroTMdxFsLjJwiCIAiCIAiCIAiCoIMSP/wEQRAEQRAEQRAEQRB0UOKHnyAIgiAIgiAIgiAIgg7KRo3x41LVSuq4lX0sqo1PYgc0UFwf1hXrr1YcQ0L1fjPI5mguqrNj4aGX1E6RipYCc8KEXXzRZIrFQKlpNY0cqxrbai8nZWuReth119S8YKyULfkAOWfUKLMfeMCXsShfIVH+VffY3XKcAEDiv0hwAM5o+/Ofm1pS4xDgsB+lJg9wHexDOCWipOXk2D2/+MVrVKI6WNOtzhnvY1PNpGzbLJ3nRwh4Ke+gy29yZWVLvNY6Z9D99q7wOuAX/2Hxbg5d8GtXtvJxikfCDVcN9kzSSGvcEuYVEiRz3AHAjy++hsReyKOBUSYpvgfT56W1Nu4qi+tcvZX1Np7Kan2spq5daXY20vWPO87V47npo+UAeTvqqpYD6N5UBf0Q2a2S5FJf5Z1ta1WlBkjiz5o3kgfx5pubTXFnAP9MWO/sI2rBx3OSFKQuXexbb5m9yKe5XExxVvT6HF+GZ3qRjKWzGm3+3VFzqL+I9HfOYA27rKG1//M/qa3pP3nWcgQP1ZXzjNB4ITwzOY6PflclxYJwWn2OOwBgPtma8pT7hPtA50rZmWfaB43jxP3/4oup+cunfVyd0aPt81HV9/tr1Pj5nRNoL9GQBI88YvbXvubLfvUrs3kJ1anIy+Tw4T4WUF9eN3mu6LpLsQ3m1FrMIA6vBfjHI8upC/E3op+Nphff6+bq8d9pM2YtsMxRtzwAACAASURBVNF11igbJU3lPkIIt0PDc2jG6pzx9a+bLTE2OIZhQ6M/fX78MZ0R6CHlU8xIAMinmGfz4eEn+CbZdVKPo8VUcDzDl1929TheJTbZxF+E4qG5hymxDlvomnre7k9niJV0wCnjWEgAcN991qaLrnBFDSNt//FR974AfHgb6w/F/fhMoecNvnf+O40JQvc9p8bH1eQh45cuHwMR+GFqnXqq/euMBX4ODJlMad8lntAMSi3OY8TFYwMwj/pX3x/420p32CHbV7k4ZfJIUfn4XfbhhBOQMzjmjC4AHHeJF1gAU2pGpPbYsd/Mevm8uXS2plTpAIDXaD5TfJhKqVedJf23pvHuzAuibhB8b7x+6/jkWIr8MgSgYMmjqV1ccaAVyHzmjr34Rj92Lx2uUVBzAN+rxGIqHGv9pDHIip96yj589pnZEv+xjDaJPB0j/Lx43nfq5OvxM6c1vljeCSt+8IPUlp3BrV1lWf4dAIr23psuKJsrffcWz3OB7ycXopDWVgCfOw5lePwEQRAEQRAEQRAEQRB0UOKHnyAIgiAIgiAIgiAIgg7KxpV6sf+guE+WTb/XPgwf7spY7MIusOrOz26MKpBhJzB2hddkksvuMZHVUxWcC3BTV+/ww3dP7VZSozHkCEYSj0aRQbAnqHfc8677zmVXJBcNt/0xtd+fBs+VV5qdKxdMdotTf1Du05kzfRn5p+1OKr+PPvLVzppkifx+fbl3cu47z1Jpl462pKaVjQv9Rc45JzWbvvMdsyFQx6288GpX9IuteKSxy593mb722p2sfT28yKJXL3P0O+II+/efXOgdbidMsN9f1cV/fqEJ/XxS4i8Iuf8+WtPXFR3Yj5zJT7zZ/x2nC+S0oeLS7twYNX0yu6myrXIx/szXaOt6mn+e2lvJ7qTiAtvI6aAn+3ylVTyuyZ20WiQjLM9U9/y+5CKsMpr1htI46/exc6hKboqeeSa1u7JrqMpqWNfRRxzI2aed67ErK4BCGmcV/F177umvt79JZ1stCvSca8m1Wu+L5bKaPJcdYNlNV13fd9qJym57yJXlzZyBDQK7IXO6cgClJGfSVMt9+bmTa3QLuQwDfpPX/Y73xWKS2PXWeUSp01ne9YpobviTHi72IJv7rlVy9ammkW2UXOOFLAOjOTxa5LO8TbXapzj9eY54rtnurlQeMi+ZKvNlmRUfe3QqTqSszpqxddgw22c47bt6+XOX8pKpyjfeg7SMH2VThX3XwFK/AtU12yqnQ6l/OQkOi21vLcj3s7G+3vbF++7zsvUzz/Qu/znjwQfNVrd5kmH+cqYX0O66K8n9ufNI2gV4CYiO++lks0RA1zn3d7QGlIrUy50Vx4/3ZZttZvZpp1ED/RqTt7udc0vkXliCUcZhDGj+AnB75oQJvohVo1Vt5mNeB0jy2+oL+UyhKe6PPTY1W4aZXCbvWJEL0dmm++VeCs/zZdIks3fc0Uu96Ktw6bhWJ1PjRuoPkYbwesozp0hk5c109shXecktt6RmwzCT3rBaDgCef57fULq6sqGT7d0iV10IwG/Gb7/ty3iB5wcNoOJEuw+WmRa8IPs3x/JQKeQbb5hN60CLpPjmnuMn68U58Odj2dNcmAlOsS77FkthC1pvAqnZd8LF9u8y7+/d67rUfvm30sZhejrIAbwWinTN3Z5ooN2WwRIumbP5JAdskHT0RSz14mf86qu+jWPGmM1SMpb7ASijeTVIJH+8auZRXxdJuBL37sL6ScCNad6GgCNctRtvNHunG77vyro8/gd8HsLjJwiCIAiCIAiCIAiCoIMSP/wEQRAEQRAEQRAEQRB0UOKHnyAIgiAIgiAIgiAIgg7KRo3x03L33amdt+++ruyPjUeldvdXXBEGk8avO+n4fFJTn8ZQ06ixFpOVnudrmuWEo0OYSH777c9z1Vir3+Wcb7uy5aQx7vzd76a2Jlpzyeckvf0S1pKS7rCF46oAKGo2bf0220j0kM+Z2m2d4OAAEgsF11xjtgr7KeAA65vff9/HtBgzxmIptRT7+8mj4APdHrCYUAv7HeXqVS2YZNegfx8EgfTxGvbh4IMtyTBnq548+SuuXtHs5+xDjddPF1Cco4evNX1rU7NPYMzS15JqH52qhDWyPQcjZ5D+f0BXKZtJD0Pz5nK8Gx5frKcF/AOVFIxYtcpsjm+i+nPWMW+7rdkas4MfIKeBBFyMLTfHRF9bWTPLPmiAjV0ofgON/+6D/Iiqo3vWnuLoTzmL8UMBBTRBNYf3WCllHDOiK8c84LyygJ/fPGkBLBx5bmqzjr6nBjE5+2yzOVW5PDtQ3CFQmloAWEr3yeu69JJLTa7/RYMjFLhU4tKOWTTXNQ11AccSGOJjfHwheDxr/CoSdC8cf5crqiqmvWrXXVOzkPYcACj5rYn5D4Qnj9O083yWWHL8MKppnMtWDZnBDr4z3pnyKCYbABc/qlBjL/AYXbQoNTUWDceo2G+KPFMdezmAQw9I1lq3hPbt5eN5lJfbKaaymvYSWQsrKix6hm67H35oNofH0mzAcsRI0fBdHFJBp3NZDcW+W0EzSWI2Fne3VS6vxkepaelqsYHyVtAYdoGZgBde4IghPrWuDs+cwQNJzzC0L9RKOAx31PrGN8zWQEsU51Hji/EdctTCSqnHI6iR0vkW63mPxxCvvYB/1hRzRJY85HP7dS5uvfXar6cDjybHcBlrutXmBI4zp+up9ilDa1zeLy0Wik64hmabszUSnPPAYdarY8faLnTbbVJvEMXE+iUF8NLYmBxwSx5W4Y9/bB84RgrHhQOQzxNc4r/x8ynKt5F1RfdJrtoVt9NzmzLFlTVU+Fh4OePZZ80+7DBfRs9izvh7XdGIZjrL5dNiJu9OHM+qXmK28IrVk9a2+dJEPtfx/C2X91t8+mlqNst35fPc4fEp466AN5KhQ/31+RzNY0ji5X7jYXuPvfba/V2Z2yBydb7hmGESl6hbV1oB5cxSdsgh9oHvW+cHxTUr0mdO47SWYieW8roF+HcG3sgl5uhc6jeJDobOvPbyNfSdhvdJjZlGc30A3eYzz/h3Tt77WsX02WYbfB7C4ycIgiAIgiAIgiAIgqCDEj/8BEEQBEEQBEEQBEEQdFA2qtTLuXSLazBn873qKv93g999N7VLyAVsCadthHczXwwPu+ixt2mDuN0VkcvWvvuae6F6iJ7QeKt9EOlJZ3b14hRz6irLLmz9nPALXVn6QKno8g44wF+D3OeGDBIX21/9CjmHXffU35pdfMUt9cBR5vr9/vvscnm3qzdq1BWpnfewy2nnUyKSq2OVilmojdwzrZJmkhtk9SO+iLMgDtyGRlO1+CZzulCWtQCuT5eWmryrsto7jJ7elVwsr/FutM5VeXDupF5zYCnc+zb75NczSi0d5hCW7wHeZ5nSubZyqeaxzam/Ae9+2pYckSVi221ntrpPshu7yAWyah/UZZTnX1fRvtH6w+63s1R2SfaB6nb6/PPIOdQX5d/5jiuqJnsWPJxgcim5wFZyzmjAj212JQZQNdrWpDfzbSzV1fv/lvDptv1Tu8v59Ixvvtl/Fz3XxaLb4SuyPKKnv0KrVOUMz/3e7Or7B+8qu2KS2QUrJJGy6olyBc8dXvcBL+HSqcKbEl+DpYkASi+5xD5IylNkkwGImzNILlZG/zxUmsTyaxG5oIhTsfN8U70Hrxdjx/oympvz821NbRQZk1tytN947o8YgVzA00O/zt2CnHsqa8j9ndcukayedeSRqT1woJcK//3va2+TfJV75KwM6dTJ1+tZTvupDjoec3QuWVrrxfWVM0lQL9K6PJ7FfM+yrvNzW7DAn51UnpYz+Eyj45LG3tnHZi3Co5vaufHALn6+lVInNMtc5PTcfNzUVYcEgXAnPk1PTtKNxscec0V8Z+Uk98zXFMP8DD75xJfxWXDnnc1WjSytaVdc4GU5KOSO1BV9PWF52hLRYvHZQ/X9lN572df2S+3vitxRjzr+q2234vkmSzIa8u08XLSFT/XuoP25VfpnHqt8n9wXAFr62P6cN+9NV3bFVFtLfrrLe6l99NGnuHqsci76xS9cWdGf7rAPJ52EnMH9+MEHvowm3C5b+HAR775rZ47Ka662Al2Y6XxZLGna62hsL6Y+0DNGf7Ir2jpDUv/kX3SRL9tsM7PHjTNbJcm8ycj7otvTeE393vd8vYd3T0159QU+oWuccgpyQQvN/bwLLnBlS2tsrkyZ4gO3FBebzPek4TQOHpEXtT33NFs3PApPUMrnmVIvGwafS/i9Rd5ve9ADy2c5KeAXBb6+7iHcN/w+C2DGvM6p7bfdTV09NyyKRbbGe8p++yEb4fETBEEQBEEQBEEQBEHQQYkffoIgCIIgCIIgCIIgCDooG1XqxZKMuSKT6ENufWPHXu3KsIB8m8hlqyvLPwDMpuwEkvfHRV9nYYvGox9FcpAnL7zQCjSK+gTKZ8KR9wGf7YD9sl6RHCjkmtYkrrjstFbCmVfE3fPP75j855h+Da7MSWByFaWdJSssgQFcOpNHh/k+9GqfJ1LrkkuucPUOHUC9M3OVK3NueOwyp763nKmA3PWc1ABwY+n0Zi9lweZDzT6RJFwUnR8AsP32ZmsGD3Jdr6ynPB0im3HueerCOXUqNgTsifpmTWdX5prQ/XD/h5wxgl0h1ff+Zz8zW90ieVzyNSTqP3Y3t1T3jDTTGLuW77STL2N3dEYlDDw3NQMKPyySdfYX6eYCauMskWr0v+WWtbfji0AyvB6H+37qQWP7JckewAImdkQt/bd3mXYu3SrrJBfW3uzOOnq0q1bC1+Q+FNftZpIlaGYoXq+5N8Vh12WkUVXUEFqTW8itO0/6+rLL7DleOlJcwzl9Ui7hOU5ZvAC4NaryDJ+9ECeeaDbPAXVl5gwZvKcBeOhxcrGmKXCoZAOp+5fde8k0k8cVSn8XsMxAs+9xZjjKyNVKwsCSTK4HYI9hJpHgW9ElgVWKrVz8dZ3JASeMsr334gle9nT6qSRt0ixG7J7Oe5qcbXi+DVzg5YkDR5n8e2G9reWqIOnSyQSPLfnW73n1da7esk9NzLelTKTmCpPjlBTafVXme7mwkx1p5/Day+uzuMUPG2biJ72XDZGwFIAfGz/4gS+jc5gqMnnPdMeRuZv7iiTVzxfpFGcW4pOcZtrijF+c96xQpGNtrZVO9s4PUyXQLL/TUAXcfu5vnfd0Bn5ogZdzHTr7L/ahZ46kXnRWb5LzAD/XVf8uc2VdaNH4+9kmk+CEogAwcaLd90UX+YHJQ5jHASeoAoCj3vuNfXjjDbP1HHX00ampzy6f5K333WeZ8m6+YKGrxzKtmTO9TPTOO3lPM3lmv37HuHp8PBryv//r26gpy3IFr4077OCKnnzB1lhV7DmuvNJskcC5UAUyF7uTzaOkm57PeW/51rfM1j2YM2ZRZj8ATs7tXpQ0PACfo/m+ACynNZbl8BWtzr92z/o4UD4cuSaP14WDD3ZlnP3yuOP837njMp9tdG3hz5pNkCcg70F6DV7jeCzL+1whS+b1ufJ98vdKBjy3QIgccEipSayH9LCxP368n7MFlNEaNW3I5NsgPH6CIAiCIAiCIAiCIAg6KPHDTxAEQRAEQRAEQRAEQQclfvgJgiAIgiAIgiAIgiDooGzcGD8Ug6e7llEsg967eA07x4aopXgVpaL77EfX9wmzvU6zmuyFUu8vpLMefPLJqS3J+QBK19xMqW4BSfXGMX40PR9pAev22ccVuSgBoyifpFzjEJacXn65vz7HGbn0UuQE0hy3uh/SRB5Y7lMhT51amdpTpljMnIsLJZ7Tn0hvrvpI1kRyzBGN4cDjgp+JpiNlPb9q2ymt4goac+UaXIA0+63i8dB3NxRb7IUijZeSLQ4NsMGCGZQ9cJfZI0f6wl/+0mzR5bo4FKxj1jTR/KxVhM16WJqzrdIxssaW26GpMlmjq8+SnzW3kTXXek3VZ7PWmud2vl8+v8nXP+00fw2NEZYLOPCFptAlOsvn4iy2pg3uRvOqVuZYAfVpCceQ0fhV/FyfftpsSReev+OOqb1c8oxyPAruXR+hAaAk1OitfUg43bmMlwkTtqEPEuND149cweOehe+AT9Mr6+3CPiPWWk1DqqygZUmztH/962a7sDISb6VkJqVRpb4qOP54f0GOVScxo1xQHtrTGsq7uWpFfDP0XQAwbZrZf/2r2ecOm+Pq3bvAUhi7IBcbCpp/ury7zuH1E/BrCI9LjSXBSOph7vAq/m5dCz+x78qjedlSXOKqbUpLSREkbuBcWuP4Gl19H3ITu5TLMZPXSWrjyqE+htVONHx0ex7S/CR9yp62dp3h564TiVIHbyfb8uABtko1NFv8pIZTz3X1isbRZz7XASi+887UrqT11veOX6c5WtWjUo8jT+ru0JXus4b6o0IDf/BazKmTAR/bks9Suj/Tczy0WHaZKbSufPObyDUFEjOt4MgjU7vvAb5unz72BGssfB6eesqnL+/Vy9JS67bORx0Ok6ZhRTCdUjnzXqXxx+hZ6iUoxJ/7s1MmVLl6HJ/nrbfkIi6aqO0v++/va/35z2YPOVXmc4VG5csR/DBlP+81wYLCcAZ0ALjjWJoJHCdSzqFL6VxfKam1y+m82UibTiGNHwA+HuT115t9gAwuDgqmZ8P77jOb49S8917WazTLWZnfY3txwVe/6urtvXen1OYQgQCAUZPM3gBz0e2D8CH/OMwVAFy8FcXAuuafZsua6ZB1544H7OTbvbvtT1MnuGpuHhXwOffss31FLtNzLo9PPgDoOZRuuqHCz9Oix++3D/TeVzDOv5+tfPnl1C7jMzXg49LddBOyER4/QRAEQRAEQRAEQRAEHZT44ScIgiAIgiAIgiAIgqCDsnGlXuQqX6z+0OwGru5R5CdZutVW9u+c5hw+jV0lPPwLFyce1eRnLItwScK1Ta++mpr56urI6WnZlVvvmdJHlus12KWQ3e5ZGgOgpBfdDfusAaghV/ucOWNyimdOXwj4PpS29CU3xao2XDidG6Sm+WXZE19f5BFNe5nrd0Etp4cXf3G+nronkwt6eTZpEuDdwSWt/Lnn26hj1dKljSJ94r7Xdmiq+lzB96S5aVmOoLICdoXnsa1pSNm3ebPNfNntt5vN7uMqg2BXcv4u/nfASxpEJuR8SLOlTgb881Ao3WYTpeIs0DT1fA2VkvH35SptLaUjbXr4YVfEsqf+8mfs9t+H2rxC2sxPyCe2BIr53tmXXCRCbn7w85d530T95pNhe0kXyx5083I9KBIhN2ZoMs4a9kNXbWdWInzQ3V9D5Yy5gjUBOm544Rg/3hVNJhUrSw7OP99fgtWu909p8oXcd+yKPVOeLq9DLCuUdMluLqq+gZ8fpR0tGvttX49vRlyqu1A/nsLXL/Trz1HD6T5nSzsmTkTOoX4Sj3b8ZKK5mV9xqvwdp19lKZ+uT/z8t946ezv471TqxfsMzdM8+a4ynqciZ822TuY1eklYlxcfX2s9AP6eaY8vmzvDVWsaNCS1+WgBAMvetz2+S/ZvWnfuucfsMWN8GUnPS8/w8rJTzjB5F08P3RbP3W03+/DEE76Qzsd8DpXh5M5ydWSrKLyA7JVStpLmIp84Wl5/3dXL43Oo7rs8N0ePNlvPdKxD4ucLtJaP5QKS6Sxs9hLESTT1X3/9X66svv4rqc1Hz6FDL3D1eH7rEsdHysFdF9sH3Tt4kPCzU2k/zcWexX4+jxxpbzm8POgWwt2h2+Lrr/P3WWr3Vat8PRcNQNcVDbWQK/hdT84VvJQddJD8HUlh+PmtJGkX4M80LVKWR2fiQn6Ad9/tv2sbkobzc1BNNcueVUL67rtrba+OhRoqq5D3xb703UW0jyzs5+WzLO8qmv2cb4e+H+UCfj6bbOKKKmtmmb2XLJTVm5vNz0TTlbM0bvJkV3QSn52qbR/bb7yEtqilucjvXzpnuR2S6t29d3C/sZ4NcOOiSENgsO6ewoYs5/EMoDOHW9F3N3pXaYvw+AmCIAiCIAiCIAiCIOigxA8/QRAEQRAEQRAEQRAEHZT44ScIgiAIgiAIgiAIgqCDsnFj/LBwVmOXkIh0aY3/ParxNtNTV004JbVrJY06x/gpgIdV7BzlQONfcPQNjhxTLrpWVrr3UOHsbbeZzfpdjqcAeL0ipYdvVcapbwd5bXnRUw/an0j63A2SZDFLnAAAXvur/UvxmCiBJ4bKcy3n9Iiqd2Y9JwWuWNzDP5PHSepZUWFq+UO1TSyGltg6zZRikcdLkcZ14fgInAYdQD3FJbhutOlZUSFpAimNa8sxx7iiPI6Hk0soVs/8aj9benLsLLmnrOmHNW4G66JVE/6hacmd3lljYPFnijXU0sPHyMmbS6mcdS6yWJ3i87g0n9oO1ayTkL/gu99FVlgD/MgjvozTXOcKalez6IA5pkMLPByBoZbmgK6ZXC9f0/ySPrmR1p0CiQnlUqdzylTW7wMo4NT0ooHntZtn8EJ4ODlmnsajYP067UMajqL/nyjmj6ZW1/heuYLXOY3tQuvtylq/L3LbOdaExngoK6URMFXSkPIf8nqu+nYO8sDPRdOO8/6gOvgswTEaJG5CEfXVCnnm5dnSS+tzI2ouu8w3sa1U6esJn1l4mwJ8fJpx4yR1PT3zF1+36FYffeTr8VLYs604cLw+a8yGbGnlJTWw60OdIHSNhh59U7uodqmvx2c97RuOZcQxX2SN4T+rzF/uyrbcsjM2CBQ3zaVZBoDttkvN3rU+PkZ5+eDU5tA3d97p48gMf9vSUPf84AN/fYqFU0KTeKjsi0spDg/3jq7zTLGepThO1Lbbmq0xInjvllTjK6c8mdo81DTuTT6F7+h83nmurLSteFXrC52zq2QuDh1q82ru3K+4sh/9yOyB21B8Hj23z7NYT7jN32y3UymI11MUf0PSarvBzX2jaaK5jGIXAX5N4G7SFPN8NNMl+fXXee6brUuHi1V1sKyf2uZcwfE+5UzGx51jVt3l/47XLFrryySmSi2dW/L0XM/nGHq4LbK5LqTP7j1B9i0Xp/D555EVXntlPazgeDlyDRcXkc7vVbWzXL3afvTGu0TW5bZSpa8vPM452CCAptfeSu2CsSf4v+PYgfx3+uwo1i4el7hyHEeL+0POAy5WMJ9zZL1z+5bCZwruJ42Jx7FpdR8/5xyzaWx21jWS3y322ceX6Tt5FsLjJwiCIAiCIAiCIAiCoIMSP/wEQRAEQRAEQRAEQRB0UDau1KutdHHkIjl31K2uiL2jHr18bGqXqlsTXX+5uNrxjbLToKbAnE42/yqmjsXOY1LdaFlyRa5jMxr3cNVml1+6tmoAgG6Xm6SN5V3qxt+fpC09OM0bAEybhpxzwAFmqxsbu1ieLXImSmvX8yvexdbBfvLql8ryDXKt61buU8me1M8eUkMvcm1cIG7r7L8qaUZZKtOZXS41ve2ECal5x9QyV8S3cshPrR0P/867rfNzy9OxpDKpXEFSwp7qik/P9sWfPeSKBu5Mz5pdfHUAP/WU2ew+D/i0juzGqM+WZR0khcyrleS0PE7Uz5xddjt1MlvTbVKbmmWS5b/3nn3g/tG+ISnT4hovnOq2IVzaSXZRJNK1OvKF1iTk3bld/DdSj9e8cknzyz3Fs08dTbuznIFtkYTxHCgQuV4FSVGqaV2XnkbeIYfYB5XrcapPkpJVjZNU4uRqvVT2kMoNIBEC4N1zVU5G+VfLFrzkigYOtP2E1QgjVtzhr8HSOR2zLEtm7YCuCexGfdhhZj/4ILLRLC7VLBdkmbZzU5c2tio7/HCzd9nFbJWo0HmilQRGN9EcUFlh31LZz4+9Pg9Y2uWiJfP9H5Kr+sDt7JnPqRjiqvGy01JR6cryXiDZEbu+t5Uqm93M9RzVhmyupY/Ju1aQcqy83LepaIHJb2c193Vl/ftRj9B5oqGrl/BuwhmWRaZdU212VRU2DJxmGQCOP95snjcArrjGzkLDh9s5YOhQf9a58UazBww4y5WVj7fPvKUN6b7Y1avkOUxpf520AfCSgLFjfRn3Oc8H3YM55ACddQCgrNHkfX/6k/X/EUf4SxyzJ7Wf56+2I1fwfs3PB0CPkWt/xgAw8MGL7QOdD6olZTILNPKffdZfhO+HJR/6XPm8xPNN5R9vmRxGUzf33n771J5XaFJDVd3fd5+dvw44wKfUPucca+P117+Z2pJ52zdfpW8b6ozKe7Z8x0Dei1WOSs9w4SHfT+0qeScp5fH8+9/7a9CC29jG/bHAlfcZaRE4CXmxSNn5VNFIcrQCkaaxlKyUZKcA3HlqDo2TvnJm6b+C3j1q/QSop5ATxXfIGWJ94WcnkuKCGloXNAwHrxP8A4C+Z9xyi9k8VwCA5Xv8LPUcx++BPBd1zvI4UxnY00+bzQsLL/iAO4stlvfzarK5Z/zuCeRz+A+9F9mXshEeP0EQBEEQBEEQBEEQBB2U+OEnCIIgCIIgCIIgCIKgg5JkMpmN9mUNSZJ+mbpfF7NMSdNicGYsduFXN1F2e1LXPXaB+uST1GxmOQm8DIwd/HpLe122mksuQTbuL/xmaj/8sC/75z/Nfuwxn/1h++3NRZhvSz25yi4/N7Vbrr/et5Gz6NTVJVkbuS6ce64NGHVLpc9L9/qmKxo/3uxbm0+yD7vt5q9BkfwbGv3vkkUkKpnxiokA1HOfvQbZ01BVVPxcxYsZd51N0fDZrU/dPnmsiov8rK4jUpsTZyhdjj/QPqh74ffNVRWHHZabPgSAxYutH0XG8+TmJuXQhA3cPB6LqrDiQPycqEDrtqW66F9orsfOfVLn9pFHmq1jkrOSsVyFU3gALmNLK/dM9l2nbEeLx41z1VgaVfitb/lrsDzmuONy0o9NtJ4WiMtnNbVTHLNd9i52I50u9XgkavZDFhWwcFGevnN55tmh/8WB1RqSY8jJcQtZaqoDT9xLuQAADvlJREFUiye4lvFewZJRHbjsfqtu/OxKvGhR7uZi5842F3fYwZfxONLJwuOP/fs1I1cba5TL9MR7Gks1AeDaa9de9i+/b7nnru3lZ83XeOMNX4/7kbO9AX795WejCzjfs7pD8/OZPz83/bh8uZ1tyr0wnLvpirE+F11duY38knzb35Z97EVuXTo1ISssZ+Hnr2shn52433Vj/Jg0VjzfAC8nor9rKfUy57xGu5eVjf5eyu7+jX3gc59INn44zlYqVSqxKrGgALmbi5062VxUqRw/M322LBcgWfuTtX7l5C1IkwYuWjSdPtF8ww9dve22MwkDTyn6WgB+KGiSw2yKBkm8g802M3vixA9d2cEHm3SalRmn93rS1XNjZtIkX8YZ/TKZ3PTjUUdZHw4f7sv4cCj7/FzKvEknj1bhIDjAQU8Nd8DyEn6wKsNj2Qu3SfctlqTrJKB1bNZICxuhEjZWFukrEy+Fl11mZ96LLvLjlpt41rzT/UX4C6++OndzcY890n6sk6ylJa+9lv3PxtqphhOh6WvliMJHU7vxoINcGZ9PCmidqxa5EsvceZyoRHl+lnoAsAftT3O4T6Uei5xKddzxXkjr6JvDvJy0dy9689Zz7s03m/3WWznpx0Y6o2pcmfy337YPOmipbSuuvDK1RRDmnr/MMJRkk+ZrRl+ep/w3Kj/jfVbOUQ30cl9Ez79F3hc52I2Gj+Gpyfc1hN9vAH9O4z0J8JK2Ns424fETBEEQBEEQBEEQBEHQQYkffoIgCIIgCIIgCIIgCDoo8cNPEARBEARBEARBEARBB2WjpnPnlMPLRbNZzKLtKVP8H5JA+ahrLG2hhkNhCXt19fdd2TvvnEKfWMh8MTwXkU3pGPGerzaP4qIcs5Vcg+NGcAwEn8Z7553teRQW+rSfLOdlmWBZzZuuHsef0cSYJSpqzQWsw9d4ESQgXiESVNYZ5z1uqQJHizDz92fYcz766G1c2VZbmXJ24sTTqKQTPGeSbTEi9tyzxNV6/nnum5/4dvx+EH0yvfPWW3/d1eP4DSon706PqqyQVJsa+4J1pZyiGPCBoHIJx/VZtcoVDaWs2BrSiGWuH35oMVB2280/F8qmjEWL7pMv/4Rsvt8urtaOO1pkrQsvtH/f6+ifuno9Cy0t5KMv+D6u72Pzu3yo2ZqRtP7vZvcYeqsre+APZg8YYLF6zv3oTFfPpZrU2DHLliHXFHA8AVlPOSLIqNNOc2UcaKKOYpx187VcTJ6/SBlH9OBleKnU42vwkqCp2Asp3X2zpHov5PskDXyD1Cvi+Aj/r737jc2qPOM4fg1rUxvTuQ7XwbABE5SRgKvbwv4QrIjE4HRxwUH2guGf9I24wHQmmgyn8c9EY9CMYZAsBtQs0cxkiYlRqASNaObEEIKElIHQUBCorJhKSu32Ystz/65f02bJnvHi7Pt5dT+ew9P23Oe+zx/v67puuSX/AM3TpTnjPOeE5p6xeH7NDVdXmtfHS0jrxOl5dzQhhyZRs1L2G6Sc+Jcvz1+RSi1L6ebuBY+k/d7dVtr3rZL5ymPMpQ/e2Z3HYkrhIl3g0+GCBaXt43T+qT+VD3L9GYj8s1q0j/1L7PjUheQo8DwaK1bIh909aVuL5I/Yc6r0k6eQeW9nyXdz8mTetkjnGm1733wqOVr0GCxfnvfTMuBvvz32tquuqjUn6BiNSMej9X37Ds3PoX+M3gNGxNKly2rty6bmHEdDKVNZHWm+I+9InQ8+zfluUm4WmV/nn8iJfOZLx879Xc6/cfRoZ63d21vaq39k2T52b6o1v/TzktvjzTfHzgPV0ZFzZel1XW8//LKl08r6VXm+jc8OSFvLw+dzPA1wP5/8vKkHTexi59TAd+bX2k1Wd17/L/hPtT8tJ8iA5oGzyesD+Xyl/Ox+K+Hdev75tfbQ2bO1dqPn29Lj489FMl9f+fjj5b/btW/q2t+X7//tg2nbTyQzSufWsi3NsxGWe8hu7nusv/8HWjRfaUSeh6yPV6woOX70kD34G8ssu7eMxaG/51y3mm9N7xem2s9KN/2aj8lzzkkf5ytVxB65p5kt54WX8dZEoUe2fmSbyrPlP947WGv7eE4Pltdck7dNm+Y/8b/W9D15jrL7qYOXl5uRkf35+F8q9zp61nvWHv1Gv39tkuOqM3mrX//lGnRG+snvZfWS7PmENIdTr0yulrkotAi854GaJ+30d3quITVnTv7sD2xjYMUPAAAAAABARfHiBwAAAAAAoKLOaTl3LT/sYUmpFJ6XW9PllLK8/YO5eamslsz26IZXXhmQT2WB2KRJuahaX9822dZZa2voSkQOefHKerqiTaOt7lueF48dibK0+6238ncs+a6UfdWYNi/pqOXobZnoGTluTfUqlblhw9gnjC6D9DWG+rvJ0rUXX85LtrUq6kd5NWOskyqweki05GhExGuvadiLhoudTfs99VRZ2ugrOFeuLG0therVhb8iUWYaXRARMXOKnHO6NFXDTiLyH+01XrXM4aZN9SuVuW5d6UcfbxqTYUuZ980oJep1xaRXK9UV3R7KoX23eXMJObv33llpv0cf1UWeurTeC10ukXYOlZsxo3TQ3r1lYE6blseKhpf4ymUNM1u4QJYLe617/Yfap//6RUq7vb0+/ThpUikhbctXJ8iS4VEn91clNPWLL8bcb+Sll8r3eXl6jUXxDlZ6YLV8qIbFReRl0r4UV2IRdJm9B3s06e9vpaHT3ynLj4eefTbt1nj11eWDhwjpZN7dXb+xuGhRGYvjLev1Ur864ci2F7fka9rmzaXtldMPH3611u7oKGGMO3daSHEKz9wq7b/afjJxhpfc1fDZMpFefHGOPzt+vIz1hx/OYbw6z6weljBtj416/vnS9rKuGqpx4EBd+vHQoaj1oV+P9NTzSA69FGhla69WrH+eRY1EZ2dp33VXabe9/2reUcqT7zlagjX9+xZdJ3OcTeyvbyujTivHWjXkmDO9v3zwkEkfm/+2qycvfvcuVSl0urm5fmOxq6uMRQ9l19C58ZbUa6iR39jpvHz33XmbdoTeaNjcO3JR6bsJH5Zr4bFv5BLcqm3/O/k/aL/qgfZQLJ1z/L5FL+RaF9z7V4+Vz+0aMrdjR336sbu79OGOHXmbhBR7iKOe23pIZk4dTPtpeM+ghd/KXXvobG1BRvG1Sy6ptQcOH661PfxDr6yttk1/1tA4+31r1arywcei9rect0MPrUm7NV7xzfLhscfyd+h90IYNdRuLI/K8OEGvyxFxSo77RTffnP/h2rWlLffPTz+Xg6x+cbv0q4Vm9a8sYW96C954ZiDtt6e3fKfO7Xq7HxFxxx1L5dO307abbvpVra2PTc88k79Dh5U/JvzgTHetfUJCuCZ6KXAZi/127urRaajX82JLSxmLGvYVke75Bs7mZ7Nt0j4obV+pojP0TNumgc562b3U9usZYz8LlI6F0v6bbdPv1Kd8Dz+Tq+Kov2XhtdfW2qfeeKPWHrD92mfJc5LfUMhcEn19lHMHAAAAAAD4f8OLHwAAAAAAgIrixQ8AAAAAAEBFndMcP8MSs9kg8WwREZ9ITJuXQGvWUn4ac+yx+5prwmOwNWlLm5SN9qQHmjdB4qB3WXG92R+WkpqjgtE3biztH0qZ648/zvtpQKcnFlm8uLQ1odD69Xk/Lffo5Uc//7y06xU/fc895YTx+ELNgeF/j+au0Hwefuw0BlnKxbojko/ivPPytraTkp9C4tD7J16W9mt97snyQY9VRAyuKiXDm98t8bOj8n4oz6WiOQE054ufm5qn6YIL8jYNMO7qql8ugzVrSj8uXZq3aQ4ML2Gt56X2vx8XzSFgSbBGZpRoXE0NoO2IiFuvK9Gy23tKPiwPU9fTzodA+5QSXf/6lvKe+4qcCihVW/ecF1oxUaei5i1/zjtqTgjPD6FlP2fOrE8/zp49dm4YOf5DlmeiUfNMaNy1/+EWd51IXP3AQ0/X2i0Hd+X9JBHIsR931dr6K0TkdBEtZz7JG3UMaE4CH0f6JZqAJCLPR319pe3zvyfxUpqfol4x8BER7e2lHz0/hs6PPt/qvtp3t92W99MkMz7f6tjU4+cDSTzyxxLR7qeMpnHy1E+as00vW5N7tucddYD7l2h+Ki0/+8QTeT89Z/w80c/bt9enHwcHa3041JAzdTSeKufzkeGcf2ny18v8dORomZ8mN+QxMHhh+XeehkX7oGtxySIw2JSzfTR/Vr5Tv09zBEXkS9V4Fc21TL1f7vXw+3ytU5Vu+1lnzoF4aLjM+e0Tc56VY6fLMW5ri/qNxRtvLGPRL0g6H3oZcp1jb7ihtP381RwMs3JOu3TNPCCl0js68n7aKfo7eg4NHeue60bHzlj5fiLy7+/3Nzof6py6f3+MaYz8ThERsW9fffpx9er/6Lo47kmrg8qTeOpzhw9G+ft677+/1p7iuVbk3208frzWnpf3CpmRR+X/0RQw2vP+/DRXz1U7pw+dPl1r62xx4QMP5C/Rc06TXkbk+XTZsvqNxXnzSj/qPXJEKsE9bPcpDXqsNY+N5DiLiJx/0Cc6nRSl/7t35/l7fq88B8q1qf/716f9WodlPrcEPYO3l1y1zScOlQ3jjUU/d/Uh6IUXas1hTRwX+XyK6dPz7yHHuLle9zfah07Hm9/baKl5nXc0X1VEvl/z+VrPex3Dfj/wl5IT9g+/LvPurS8vyvvps/ydd6ZNT24sGZJ+2VDuh0flZdS+97lQnxc1/9uSJWm3Efn9J/i8snNnaY+Tv5AVPwAAAAAAABXFix8AAAAAAICKOqehXgAAAAAAADh3WPEDAAAAAABQUbz4AQAAAAAAqChe/AAAAAAAAFQUL34AAAAAAAAqihc/AAAAAAAAFcWLHwAAAAAAgIrixQ8AAAAAAEBF8eIHAAAAAACgonjxAwAAAAAAUFG8+AEAAAAAAKgoXvwAAAAAAABUFC9+AAAAAAAAKooXPwAAAAAAABXFix8AAAAAAICK4sUPAAAAAABARfHiBwAAAAAAoKJ48QMAAAAAAFBRvPgBAAAAAACoKF78AAAAAAAAVBQvfgAAAAAAACqKFz8AAAAAAAAVxYsfAAAAAACAiuLFDwAAAAAAQEX9E3KEMu6mNyvtAAAAAElFTkSuQmCC\n",
      "text/plain": [
       "<Figure size 1440x1440 with 10 Axes>"
      ]
     },
     "metadata": {
      "needs_background": "light"
     },
     "output_type": "display_data"
    }
   ],
   "source": [
    "#model.summary()\n",
    "weights, bias = model.get_layer(\"dense_20\").get_weights()\n",
    "fig2, axs2 = plt.subplots(1,10, figsize=(20,20))\n",
    "for i in range(10):\n",
    "  subplot = axs2[i]\n",
    "  subplot.set_title(i)\n",
    "  subplot.axis('off')\n",
    "  # Modify me\n",
    "  i_weights = weights[:,i] # Select the weights for the i'th output\n",
    "  img = tf.reshape(i_weights, [28,28]) # Reshape the weights into a 28x28 array\n",
    "  subplot.imshow(img, plt.get_cmap('seismic'))\n",
    "plt.show()"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Answer\n",
    "The trained model using my softmax appears to be very similar to the linear model as mentioned in the TODO"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {},
   "outputs": [],
   "source": []
  }
 ],
 "metadata": {
  "accelerator": "GPU",
  "colab": {
   "collapsed_sections": [],
   "name": "a1.ipynb",
   "provenance": [],
   "toc_visible": true,
   "version": "0.3.2"
  },
  "kernelspec": {
   "display_name": "Python 3",
   "language": "python",
   "name": "python3"
  },
  "language_info": {
   "codemirror_mode": {
    "name": "ipython",
    "version": 3
   },
   "file_extension": ".py",
   "mimetype": "text/x-python",
   "name": "python",
   "nbconvert_exporter": "python",
   "pygments_lexer": "ipython3",
   "version": "3.7.1"
  }
 },
 "nbformat": 4,
 "nbformat_minor": 1
}