E9-Sound-and-music-description-Oriol-Colomé.ipynb

{
 "cells": [
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "# Exercise 9: Sound and music description\n",
    "\n",
    "With this exercise you will learn to describe sounds with simple machine learning methods. You will learn to use the Freesound API to load pre-computed sound descriptors from Freesound and to perform sound clustering and classification with them. You will work with instrumental sounds, thus learning what audio features are useful for characterizing them.\n",
    "\n",
    "There are four parts in this exercise: 1) Download sounds and descriptors from Freesound, 2) Select two descriptors for a good sound clustering, 3) Cluster sounds using k-means, and 4) Classify sounds using k-NN.\n",
    "\n",
    "We provide the code for each task, thus no need to get involved in much programming. \n",
    "\n",
    "### Relevant Concepts\n",
    "\n",
    "#### Freesound API\n",
    "With the Freesound API you can browse, search, and retrieve information from Freesound, such as automatically extracted features from audio files. You can also perform advanced queries combining content analysis features and other metadata (tags, etc...). With the API you can do text searches similar to what you can do from the advance searches in the website http://freesound.org/search/?q, but implementing the the queries in software. If you are interested in knowing more about the Freesound API, you can see examples of using it with python in: https://github.com/MTG/freesound-python/blob/master/examples.py and you can read the API documentation, http://www.freesound.org/docs/api/\n",
    "\n",
    "#### Sound descriptors\n",
    "In this exercise, you will use sound descriptors that have been pre-computed with Essentia, https://essentia.upf.edu and are stored in the Freesound database together with the corresponding sounds. Many sound descriptors can be extracted using Essentia (http://essentia.upf.edu/documentation/algorithms_reference.html) and in Freesound, a number of them are used. In the Freesound API documentation there is specifc information of the descriptors available in Freesound, https://freesound.org/docs/api/analysis_index.html.\n",
    "\n",
    "### Euclidian distance\n",
    "The Euclidian distance is the straight-line distance between two points in an n-dimensional space, thus the distance between points $p$ and $q$ is the length of the line segment connecting them. If $p = (p_1, p_2,..., p_n)$ and $q = (q_1, q_2,..., q_n)$ are two points in Euclidean n-space, then the distance, $d$, from $p$ to $q$, or from $q$ to $p$ is given by the Pythagorean formula:\n",
    "\n",
    "$ d(p,q) = \\sqrt{\\sum^n_{i=1} (q_i - p_i)^2} $\n",
    "\n",
    "\n",
    "### K-means clustering (k-means)\n",
    "K-means clustering is a method of vector quantization that is popular for cluster analysis in data mining. K-means clustering aims to partition $n$ observations into $k$ clusters in which each observation belongs to the cluster with the nearest mean, serving as a prototype of the cluster. The problem is computationally difficult (NP-hard), however, efficient heuristic algorithms converge quickly to a local optimum. \n",
    "\n",
    "Given a set of observations $(x_1, x_2, …, x_n)$, where each observation is a d-dimensional real vector, k-means clustering aims to partition the $n$ observations into $k (≤ n)$ sets $S = {S_1, S_2, …, S_k}$ so as to minimize the within-cluster sum of squares (WCSS) (i.e. variance). Formally, the objective is to find:\n",
    "\n",
    "$\\underset{\\mathbf{S}} {\\operatorname{arg\\,min}}  \\sum_{i=1}^{k} \\sum_{\\mathbf x \\in S_i} \\left\\| \\mathbf x - \\boldsymbol\\mu_i \\right\\|^2 = \\underset{\\mathbf{S}} {\\operatorname{arg\\,min}}  \\sum_{i=1}^k |S_i| \\operatorname{Var} S_i$, where $μ_i$ is the mean of points in $S_i$.\n",
    "\n",
    "\n",
    "### K-nearest neighbours classifier (k-NN)\n",
    "K-nearest neighbours classification (k-NN) is a non-parametric method in which the input consists of the $k$ closest training examples in the feature space. The output is a class membership. An object is classified by a plurality vote of its neighbors, with the object being assigned to the class most common among its $k$ nearest neighbors ($k$ is a positive integer, typically small). If $k = 1$, then the object is simply assigned to the class of that single nearest neighbor.\n"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Part 1: Download sounds and descriptors from Freesound\n",
    "\n",
    "Download a collection of intrumental sounds and their descriptors from Freesound using the Freesound API.\n",
    "\n",
    "First get a Freesound API key from http://www.freesound.org/apiv2/apply/ and create a directory in the workspace with the name `testDownload` to store the sounds and descriptors. You also need to install the python client for the freesound API. Do this by cloning the repository https://github.com/MTG/freesound-python, into a folder and installing it following the instructions. You will have to import the freesound module in the code.\n",
    "\n",
    "You will be calling the function `download_sounds_freesound()` whose input parameters are:\n",
    "1. `queryText` (string): A single word or a string of words without spaces (use hyphens), typically the name of the instrument. e.g. (eg. \"violin\", \"trumpet\", \"cello\", \"bassoon\", etc.)\n",
    "2. `tag` (string): tag to be used for filtering the searched sounds (e.g., \"multisample\", \"single-note\", \"velocity\", \"tenuto\", etc.).\n",
    "3. `duration` (2 floating point numbers): min and max duration (seconds) of the sound to filter, e.g., (0.2,15).\n",
    "4. `API_Key` (string): your api key.\n",
    "5. `outputDir` (string): path to the directory where you want to store the sounds and their descriptors.\n",
    "6. `topNResults` (integer): number of results (sounds) that you want to download.\n",
    "7. `featureExt` (file extension): file extension for storing sound descriptor (.json, typically).\n",
    "\n",
    "In the call to `download_sounds_freesound()` you will have to choose the appropriate queryText, tag, and duration, to return single notes/strokes of instrumental sounds. The first twenty results of the query should be \"good\". Note that the tag can be empty. Example of a query to obtain single notes of violin could be: `download_sounds_freesound(queryText='violin', API_Key=<your key>, outputDir='testDownload/', topNResults=20, duration=(0,8.5), tag='single-note')`. This returns 20 single notes of violin sounds and the script stores them in the testDownload directory (the directory has to be created beforehand).\n",
    "\n",
    "Download and store twenty sound examples of each instrument using the `download_sounds_freesound()` function given below. The examples need to be representative of the instrument, single notes (melodic instruments) or single strokes (percussion instruments), and shorter than 10 seconds. Specify a good query text, tag, and duration to query for the chosen instruments. Refine your search parameters until you get twenty good samples for each instrument. Select three instruments to be used out of this set: violin, guitar, bassoon, trumpet, clarinet, cello, naobo (cymbals used in Beijing Opera). Listen to the sounds downloaded and look at the descriptor .json files.\n",
    "\n",
    "Before using the API to download the sounds, we recommend to do the same query using the Freesound website and checking that the top 20 results are good."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 2,
   "metadata": {},
   "outputs": [],
   "source": [
    "import os, sys\n",
    "import json\n",
    "sys.path.append('../../freesound-python/')  # directory were you installed the freesound-python repository\n",
    "import freesound as fs\n",
    "import matplotlib.pyplot as plt\n",
    "\n",
    "descriptors = [ 'lowlevel.spectral_centroid.mean',\n",
    "                'lowlevel.spectral_contrast.mean',\n",
    "                'lowlevel.dissonance.mean',\n",
    "                'lowlevel.hfc.mean',\n",
    "                'lowlevel.mfcc.mean',\n",
    "                'sfx.logattacktime.mean',\n",
    "                'sfx.inharmonicity.mean']"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 3,
   "metadata": {},
   "outputs": [],
   "source": [
    "def download_sounds_freesound(queryText = \"\", tag=None, duration=None, API_Key = \"\", outputDir = \"\", topNResults = 5, featureExt = '.json'):\n",
    "  \"\"\"\n",
    "  This function downloads sounds and their descriptors from freesound using the queryText and the \n",
    "  tag specified in the input. Additionally, you can also specify the duration range to filter sounds \n",
    "  based on duration.\n",
    "  \n",
    "  Inputs:\n",
    "        (Input parameters marked with a * are optional)\n",
    "        queryText (string): query text for the sounds (eg. \"violin\", \"trumpet\", \"cello\", \"bassoon\" etc.)\n",
    "        tag* (string): tag to be used for filtering the searched sounds. (eg. \"multisample\",  \n",
    "                       \"single-note\" etc.)\n",
    "        duration* (tuple): min and the max duration (seconds) of the sound to filter, eg. (0.2,15)\n",
    "        API_Key (string): your api key, which you can obtain from : www.freesound.org/apiv2/apply/\n",
    "        outputDir (string): path to the directory where you want to store the sounds and their \n",
    "                            descriptors\n",
    "        topNResults (integer): number of results(sounds) that you want to download \n",
    "        featureExt (string): file extension for storing sound descriptors\n",
    "  output:\n",
    "        This function downloads sounds and descriptors, and then stores them in outputDir. In \n",
    "        outputDir it creates a directory of the same name as that of the queryText. In this \n",
    "        directory outputDir/queryText it creates a directory for every sound with the name \n",
    "        of the directory as the sound id. Additionally, this function also dumps a text file \n",
    "        containing sound-ids and freesound links for all the downloaded sounds in the outputDir. \n",
    "        NOTE: If the directory outputDir/queryText exists, it deletes the existing contents \n",
    "        and stores only the sounds from the current query. \n",
    "  \"\"\" \n",
    "  \n",
    "  # Checking for the compulsory input parameters\n",
    "  if queryText == \"\":\n",
    "    print(\"\\n\")\n",
    "    print(\"Provide a query text to search for sounds\")\n",
    "    return -1\n",
    "    \n",
    "  if API_Key == \"\":\n",
    "    print(\"\\n\")\n",
    "    print(\"You need a valid freesound API key to be able to download sounds.\")\n",
    "    print(\"Please apply for one here: www.freesound.org/apiv2/apply/\")\n",
    "    print(\"\\n\")\n",
    "    return -1\n",
    "    \n",
    "  if outputDir == \"\" or not os.path.exists(outputDir):\n",
    "    print(\"\\n\")\n",
    "    print(\"Please provide a valid output directory. This will be the root directory for storing sounds and descriptors\")\n",
    "    return -1    \n",
    "  \n",
    "  # Setting up the Freesound client and the authentication key\n",
    "  fsClnt = fs.FreesoundClient()\n",
    "  fsClnt.set_token(API_Key,\"token\")  \n",
    "  \n",
    "  # Creating a duration filter string that the Freesound API understands\n",
    "  if duration and type(duration) == tuple:\n",
    "    flt_dur = \" duration:[\" + str(duration[0])+ \" TO \" +str(duration[1]) + \"]\"\n",
    "  else:\n",
    "    flt_dur = \"\"\n",
    " \n",
    "  if tag and type(tag) == str:\n",
    "    flt_tag = \"tag:\"+tag\n",
    "  else:\n",
    "    flt_tag = \"\"\n",
    "\n",
    "  # Querying Freesound\n",
    "  page_size = 30\n",
    "  if not flt_tag + flt_dur == \"\":\n",
    "    qRes = fsClnt.text_search(query=queryText ,filter = flt_tag + flt_dur,sort=\"score\", fields=\"id,name,previews,username,url,analysis\", descriptors=','.join(descriptors), page_size=page_size, normalized=1)\n",
    "  else:\n",
    "    qRes = fsClnt.text_search(query=queryText ,sort=\"score\",fields=\"id,name,previews,username,url,analysis\", descriptors=','.join(descriptors), page_size=page_size, normalized=1)\n",
    "  \n",
    "  outDir2 = os.path.join(outputDir, queryText)\n",
    "  if os.path.exists(outDir2):             # If the directory exists, it deletes it and starts fresh\n",
    "      os.system(\"rm -r \" + outDir2)\n",
    "  os.mkdir(outDir2)\n",
    "\n",
    "  pageNo = 1\n",
    "  sndCnt = 0\n",
    "  indCnt = 0\n",
    "  totalSnds = min(qRes.count,200)   # System quits after trying to download after 200 times\n",
    "  \n",
    "  # Creating directories to store output and downloading sounds and their descriptors\n",
    "  downloadedSounds = []\n",
    "  while(1):\n",
    "    if indCnt >= totalSnds:\n",
    "      print(\"Not able to download required number of sounds. Either there are not enough search results on freesound for your search query and filtering constraints or something is wrong with this script.\")\n",
    "      break\n",
    "    sound = qRes[indCnt - ((pageNo-1)*page_size)]\n",
    "    print(\"Downloading mp3 preview and descriptors for sound with id: %s\"%str(sound.id))\n",
    "    outDir1 = os.path.join(outputDir, queryText, str(sound.id))\n",
    "    if os.path.exists(outDir1):\n",
    "      os.system(\"rm -r \" + outDir1)\n",
    "    os.system(\"mkdir \" + outDir1)\n",
    "    \n",
    "    mp3Path = os.path.join(outDir1,  str(sound.previews.preview_lq_mp3.split(\"/\")[-1]))\n",
    "    ftrPath = mp3Path.replace('.mp3', featureExt)\n",
    "    \n",
    "    try:\n",
    "      \n",
    "      fs.FSRequest.retrieve(sound.previews.preview_lq_mp3, fsClnt, mp3Path)\n",
    "      # Initialize a dictionary to store descriptors\n",
    "      features = {}\n",
    "      # Obtaining all the descriptors\n",
    "      for desc in descriptors:\n",
    "        features[desc]=[]\n",
    "        features[desc].append(eval(\"sound.analysis.\"+desc))\n",
    "      \n",
    "      # Once we have all the descriptors, store them in a json file\n",
    "      json.dump(features, open(ftrPath,'w'))\n",
    "      sndCnt+=1\n",
    "      downloadedSounds.append([str(sound.id), sound.url])\n",
    "\n",
    "    except:\n",
    "      if os.path.exists(outDir1):\n",
    "        os.system(\"rm -r \" + outDir1)\n",
    "    \n",
    "    indCnt +=1\n",
    "    \n",
    "    if indCnt%page_size==0:\n",
    "      qRes = qRes.next_page()\n",
    "      pageNo+=1\n",
    "      \n",
    "    if sndCnt>=topNResults:\n",
    "      break\n",
    "  # Dump the list of files and Freesound links\n",
    "  fid = open(os.path.join(outDir2, queryText+'_SoundList.txt'), 'w')\n",
    "  for elem in downloadedSounds:\n",
    "    fid.write('\\t'.join(elem)+'\\n')\n",
    "  fid.close()"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 9,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Downloading mp3 preview and descriptors for sound with id: 355777\n",
      "Downloading mp3 preview and descriptors for sound with id: 355786\n",
      "Downloading mp3 preview and descriptors for sound with id: 355787\n",
      "Downloading mp3 preview and descriptors for sound with id: 355791\n",
      "Downloading mp3 preview and descriptors for sound with id: 355796\n",
      "Downloading mp3 preview and descriptors for sound with id: 355800\n",
      "Downloading mp3 preview and descriptors for sound with id: 355807\n",
      "Downloading mp3 preview and descriptors for sound with id: 355812\n",
      "Downloading mp3 preview and descriptors for sound with id: 355813\n",
      "Downloading mp3 preview and descriptors for sound with id: 355814\n",
      "Downloading mp3 preview and descriptors for sound with id: 355820\n",
      "Downloading mp3 preview and descriptors for sound with id: 355821\n",
      "Downloading mp3 preview and descriptors for sound with id: 355822\n",
      "Downloading mp3 preview and descriptors for sound with id: 355823\n",
      "Downloading mp3 preview and descriptors for sound with id: 355824\n",
      "Downloading mp3 preview and descriptors for sound with id: 355825\n",
      "Downloading mp3 preview and descriptors for sound with id: 355826\n",
      "Downloading mp3 preview and descriptors for sound with id: 355827\n",
      "Downloading mp3 preview and descriptors for sound with id: 355828\n",
      "Downloading mp3 preview and descriptors for sound with id: 355829\n",
      "Downloading mp3 preview and descriptors for sound with id: 249068\n",
      "Downloading mp3 preview and descriptors for sound with id: 249069\n",
      "Downloading mp3 preview and descriptors for sound with id: 249070\n",
      "Downloading mp3 preview and descriptors for sound with id: 249075\n",
      "Downloading mp3 preview and descriptors for sound with id: 249076\n",
      "Downloading mp3 preview and descriptors for sound with id: 249077\n",
      "Downloading mp3 preview and descriptors for sound with id: 249078\n",
      "Downloading mp3 preview and descriptors for sound with id: 249079\n",
      "Downloading mp3 preview and descriptors for sound with id: 249080\n",
      "Downloading mp3 preview and descriptors for sound with id: 249081\n",
      "Downloading mp3 preview and descriptors for sound with id: 249082\n",
      "Downloading mp3 preview and descriptors for sound with id: 249087\n",
      "Downloading mp3 preview and descriptors for sound with id: 249088\n",
      "Downloading mp3 preview and descriptors for sound with id: 249089\n",
      "Downloading mp3 preview and descriptors for sound with id: 249090\n",
      "Downloading mp3 preview and descriptors for sound with id: 249091\n",
      "Downloading mp3 preview and descriptors for sound with id: 249092\n",
      "Downloading mp3 preview and descriptors for sound with id: 249093\n",
      "Downloading mp3 preview and descriptors for sound with id: 249094\n",
      "Downloading mp3 preview and descriptors for sound with id: 249099\n",
      "Downloading mp3 preview and descriptors for sound with id: 373947\n",
      "Downloading mp3 preview and descriptors for sound with id: 373948\n",
      "Downloading mp3 preview and descriptors for sound with id: 373949\n",
      "Downloading mp3 preview and descriptors for sound with id: 373950\n",
      "Downloading mp3 preview and descriptors for sound with id: 373954\n",
      "Downloading mp3 preview and descriptors for sound with id: 373955\n",
      "Downloading mp3 preview and descriptors for sound with id: 373956\n",
      "Downloading mp3 preview and descriptors for sound with id: 373957\n",
      "Downloading mp3 preview and descriptors for sound with id: 373961\n",
      "Downloading mp3 preview and descriptors for sound with id: 373962\n",
      "Downloading mp3 preview and descriptors for sound with id: 373963\n",
      "Downloading mp3 preview and descriptors for sound with id: 373964\n",
      "Downloading mp3 preview and descriptors for sound with id: 373968\n",
      "Downloading mp3 preview and descriptors for sound with id: 373969\n",
      "Downloading mp3 preview and descriptors for sound with id: 373970\n",
      "Downloading mp3 preview and descriptors for sound with id: 373971\n",
      "Downloading mp3 preview and descriptors for sound with id: 373975\n",
      "Downloading mp3 preview and descriptors for sound with id: 373976\n",
      "Downloading mp3 preview and descriptors for sound with id: 373977\n",
      "Downloading mp3 preview and descriptors for sound with id: 373978\n"
     ]
    }
   ],
   "source": [
    "# call download_sounds_freesound for 3 instruments\n",
    "### your code here\n",
    "download_sounds_freesound(queryText='violin', API_Key=\"Cua7Jqu2Vb0gmOFX02kDjA1JQ2xyFDHb8p8wIJge\", outputDir='testDownload/', topNResults=20, duration=(0,8.5), tag='single-note')\n",
    "download_sounds_freesound(queryText='clarinet', API_Key=\"Cua7Jqu2Vb0gmOFX02kDjA1JQ2xyFDHb8p8wIJge\", outputDir='testDownload/', topNResults=20, duration=(0,8.5), tag='single-note')\n",
    "download_sounds_freesound(queryText='trombone', API_Key=\"Cua7Jqu2Vb0gmOFX02kDjA1JQ2xyFDHb8p8wIJge\", outputDir='testDownload/', topNResults=20, duration=(0,8.5), tag='single-note')"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Part 2: Select two descriptors for a good sound clustering\n",
    "\n",
    "Select two of the sound descriptors obtained from Task 1 in order to obtain a good clustering of the sounds of three instruments in a two dimensional space. By visualizing the descriptor values of the sounds in a 2D plot you can choose the features that can help to better cluster these instruments. \n",
    "\n",
    "You take as inputs the downloaded sounds folder (`targetDir`) and the descriptor pair indices (`descInput`) (see mapping) to create a 2-D scatter plot of the descriptor pair. The data points, sounds, from different instruments are shown with different colors. In addition, you can also plot the Freesound ID of the sounds with the points. Only plot the sounds of the 3 instruments chosen. Make sure that in `targetDir` you only have the 3 instruments chosen.\n",
    "\n",
    "Choose a good pair of descriptors for the sounds of the 3 instruments you downloaded in Part 1. A good pair of descriptors leads to a point distribution where all the sounds of an instrument cluster together, with a good separation from the other instrument clusters. Try out different combinations of descriptor pairs. Write a short paragraph on the descriptor pairs you tried out, justifying your choices for selecting those particular descriptors. Based on the spectral and temporal features of the instruments and sounds, give an explanation of why (or why not) a good clustering is (or is not) achieved with the chosen pairs of descriptors.\n",
    "\n",
    "From the code given you can generate a 2-D scatter plot of all sounds for the chosen descriptor pairs. "
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 4,
   "metadata": {},
   "outputs": [],
   "source": [
    "import os, sys\n",
    "import numpy as np\n",
    "import matplotlib.pyplot as plt\n",
    "from matplotlib.lines import Line2D\n",
    "from scipy.cluster.vq import vq, kmeans, whiten\n",
    "\n",
    "# Mapping of descriptors\n",
    "descriptorMapping = { 0: 'lowlevel.spectral_centroid.mean',\n",
    "                      1: 'lowlevel.dissonance.mean',\n",
    "                      2: 'lowlevel.hfc.mean',\n",
    "                      3: 'sfx.logattacktime.mean',\n",
    "                      4: 'sfx.inharmonicity.mean',\n",
    "                      5: 'lowlevel.spectral_contrast.mean.0',\n",
    "                      6: 'lowlevel.spectral_contrast.mean.1',\n",
    "                      7: 'lowlevel.spectral_contrast.mean.2',\n",
    "                      8: 'lowlevel.spectral_contrast.mean.3',\n",
    "                      9: 'lowlevel.spectral_contrast.mean.4',\n",
    "                      10: 'lowlevel.spectral_contrast.mean.5',\n",
    "                      11: 'lowlevel.mfcc.mean.0',\n",
    "                      12: 'lowlevel.mfcc.mean.1',\n",
    "                      13: 'lowlevel.mfcc.mean.2',\n",
    "                      14: 'lowlevel.mfcc.mean.3',\n",
    "                      15: 'lowlevel.mfcc.mean.4',\n",
    "                      16: 'lowlevel.mfcc.mean.5'\n",
    "                    }"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 5,
   "metadata": {},
   "outputs": [],
   "source": [
    "def convFtrDict2List(ftrDict):\n",
    "  \"\"\"\n",
    "  This function converts descriptor dictionary to an np.array. The order in the numpy array (indices) \n",
    "  are same as those mentioned in descriptorMapping dictionary.\n",
    "  \n",
    "  Input: \n",
    "    ftrDict (dict): dictionary containing descriptors downloaded from the freesound\n",
    "  Output: \n",
    "    ftr (np.ndarray): Numpy array containing the descriptors for processing later on\n",
    "  \"\"\"\n",
    "  ftr = []\n",
    "  for key in range(len(descriptorMapping.keys())):\n",
    "    try:\n",
    "      ftrName, ind = '.'.join(descriptorMapping[key].split('.')[:-1]), int(descriptorMapping[key].split('.')[-1])\n",
    "      ftr.append(ftrDict[ftrName][0][ind])\n",
    "    except:\n",
    "      ftr.append(ftrDict[descriptorMapping[key]][0])\n",
    "  return np.array(ftr)\n",
    "\n",
    "def fetchDataDetails(inputDir, descExt = '.json'):\n",
    "  \"\"\"\n",
    "  This function is used by other functions to obtain the information regarding the directory structure \n",
    "  and the location of descriptor files for each sound \n",
    "  \"\"\"\n",
    "  dataDetails = {}\n",
    "  for path, dname, fnames  in os.walk(inputDir):\n",
    "    for fname in fnames:\n",
    "      if descExt in fname.lower():\n",
    "        remain, rname, cname, sname = path.split('/')[:-3], path.split('/')[-3], path.split('/')[-2], path.split('/')[-1]\n",
    "        if cname not in dataDetails:\n",
    "          dataDetails[cname]={}\n",
    "        fDict = json.load(open(os.path.join('/'.join(remain), rname, cname, sname, fname),'r'))\n",
    "        dataDetails[cname][sname]={'file': fname, 'feature':fDict}\n",
    "  return dataDetails"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 6,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "<matplotlib.legend.Legend at 0x7febfc730dc0>"
      ]
     },
     "execution_count": 6,
     "metadata": {},
     "output_type": "execute_result"
    },
    {
     "data": {
      "image/png": "iVBORw0KGgoAAAANSUhEUgAAA3gAAAJqCAYAAAB5B+JqAAAAOXRFWHRTb2Z0d2FyZQBNYXRwbG90bGliIHZlcnNpb24zLjMuNCwgaHR0cHM6Ly9tYXRwbG90bGliLm9yZy8QVMy6AAAACXBIWXMAAAsTAAALEwEAmpwYAABz+0lEQVR4nO39e3yb93nf/7+vGwAlkjJBgZJCxY7PlinZDumasdOj1IxOnH6dtHGSNnbprGI7j+3aLa3WNv32uHXrmrX12vQwOk3Z9Bc1ybrYXVIvsaNuJb1v0yWWYzKxRZpVEruRLUYmaYIWDyJw35/fHzdAUTQPAAkQp9fz8eBDInDf4EWAJHDhc32uy5xzAgAAAABUPq/UAQAAAAAACoMEDwAAAACqBAkeAAAAAFQJEjwAAAAAqBIkeAAAAABQJaKlDiBfTz311L5oNPpRSTeLBBUAAABA7QgkPZNOp3/itttuO7faARWX4EWj0Y+2trYe3Lt37yue5zHjAQAAAEBNCILAXn755UPj4+MflfTO1Y6pxBWwm/fu3TtDcgcAAACglnie5/bu3ZtUWM24+jHbGE+heCR3AAAAAGpRJhdaM4+ruBLNfJx5ZS722S99c/eXnjqdOH8hHdm1I+rfcdv1U++845pXrtjdkCp1fACAjZ15ZS72V099c/djp04nZi+kI407ov5dh66f+uHb+FsOALXszCtzsb/6ypndj/3juYvPDzfsm/rh77iipp8fKnEFLydf/PpE4y//weeuj//ZQ3s+9Ngfur96/HdSH3rsD138zx7a88t/8Lnrv/j1icZCfa3nn38+dtddd1273jGPPvroZd///d9/vST95V/+Zfz//X//39ZCfX0AqFZf/PpE4/0f+9z1H//aQ3um6v7QpZp/JzVV94fu4197aM/9H9v83/KJiYnIb//2b+8tdLySdPvtt9/4xBNPNBTjtgEAoS9+faLx/k+evP7jU+f2TN1U51LftSs1dVOd+/jUuT33f/JkQV/rS9LP/dzPvf7Xfu3XXpfPOVt5zb+V56mqTPDOvDIXe+jjA1f+0hN/4X70n76Ubl181UXk1Lr4qvvRf/pS+pee+Av30McHrjzzylysEF/v6quvTj322GPfyPX4H/3RH03+1m/91nghvjYAVKszr8zFfvmzA1cm6/7C1V32pXQk+qozc4pEX3V1l30pnaz7C/fLn93c3/LJycnIn/3Zn+1beXk6nS5M8ACAojnzylzslx8/dWWyrc7VXVufjjREnHmmSEPE1V1bn0621blffvxUwV7rb0YqldrSa/61nqdyUZUJ3me/9M3db332CWubPResdn3b7LngzmefsL/58vO7873tn/zJn7x8eTb9cz/3c6//9V//9dfdcMMNN0nS3Nycvec977n6wIEDhw4ePHjob/7mby5beRsf/vCHW97//vdfKUnvfve7r/6xH/uxN9x6661tV1xxxS1//ud/nndMAFCN/uqpb+6e1hMW27H63/LYjnPBtJ6wTz+V/9/yY8eOXfGtb31rR1tb26Gbb7754B133HHgHe94xzU33njjTWv9Hf/whz/c0tXVdd1b3vKW6y+//PJbfuu3fmvvb/zGb7zu4MGDh9rb29u+/e1vR7K3/7GPfazl1ltvbbvhhhtu+ru/+7sGSfr2t78d6erquu7AgQOH2tvb2770pS/VS+HzyHvf+96rb7/99huvuOKKW/7Df/gPS0/of/Inf5K45ZZbDra1tR267777riIBBQDpr75yZvf0Xs9i8djqzw/xWDC917NPP31m06+r/+iP/qjlwIEDh2688cZDP/RDP3TN8ut+7/d+b8/NN9988MYbbzz0tre97bpXX33Vk8LX9T/xEz9xxR133HHgp37qp67I9TX/r/7qr77u5ptvPnjgwIFDP/uzP/t66dLnqX/5L//lFfnEXpUJ3peeOp34Z+On/PWO6Ro/5X/pqX/M+0Hv7u6eevjhhxPZzz/zmc/sfvOb3zyb/fxDH/rQPkkaGxs79YlPfOIbDzzwwNVzc3O23m1++9vfjp08eXL0M5/5zD/++q//+uX5xgQA1eixU6cTkfr1/5ZH6k/5nz+V/9/y3/u93zvzhje84cLo6Oip3/7t3z7z1a9+tfF3fud3Xvz617/+7Hp/x8fGxuoffvjhbzz55JMj/+k//afLGxoagpGRkVOdnZ2zDz30UEv29ufm5rynn3569MMf/vALDzzwwDWS9Au/8Auvb29vnxsbGzv1m7/5my/+83/+z5deMJw+fXrn4ODg2JNPPjnyu7/7u6+/cOGCfeUrX9n56U9/OnHy5MnR0dHRU57nub6+vpaV3wsA1JrH/vFcItJat/7zQ2ud//mxc5tK8E6ePLnzd3/3d/cPDg6OPffcc6ceeuihf1p+/Y/+6I++8swzz4w899xzp2688cb5D3/4w3uy133961/f+fd///djf/qnf3pm5e2u9pr/kUceaTp9+vTOr371qyMjIyOnhoaGGj7/+c/vWv489dBDD73mttZTlU1Wzl9IR/Yunl93Y+We1Kw7fyGd97Ltd3/3d89PTk5Gn3/++djZs2ej8Xjcv/baaxez13/xi1/c9TM/8zPnJOnWW29deP3rX7/4ta99bed6t/nOd75zOhKJ6LbbbluYnJws2VIyAJST2QvpiFe//t9yL7K5v+UrvfGNb5xta2tblNb/O/5d3/Vdr+7evTvYvXt3sGvXLv+9733vtCTdcsstc1/96leX9t3dd999U5L09re//fz58+e9iYmJyJe//OXLHn744dOS9M53vvPVBx54IDo5ORmRpLe+9a3T9fX1rr6+Pp1IJFJnzpyJPvbYY5c988wzDe3t7QclaWFhwdu3bx9LeABq3uyFdMTbuXP954ed3qafHx5//PGmd7zjHa/s378/LUmve93rLkkmn3rqqfpf+7Vfu/zVV1+NzM7ORg4fPpzMXnfPPfe8Eo2unmKt9pr/sccea3riiSeaDh06dEgK3yAcHR3duTy/yFdVJni7dkT9l+t2Weviq2uOU5iINdquHdFNPVG+4x3veOX48eO7x8fHY+9+97unll/nXP4THHbu3Ll00mbOB4Bq1Lgj6k/5uywSXftveeBv/m/5cg0NDUtlPuv9Ha6rq1u60vO8pb/fnucpnU4vVWuYXVq4YWar3q6ZOUnasWPH0pWRSETpdNqcc/be97538o//+I9f3NQ3BQBVqnFH1J9aCCzSEFn7+WEh2PTzg3Nu6e/zah544IFrPv3pT5/+zu/8zvkPf/jDLYODg0tbsnbt2rVq2ai0+mt+55w+8IEPnP35n//5ieXHPvfcc3WbiV2q0hLNO267fup/tR6KrHfM37Yeitxx2w2vbOb277///qmHH3448eijj+7u7u6+5Da+53u+5/zx48cTkvTVr351x9mzZ+ve+MY3Lmzm6wBALbvr0PVT/vz6f8v9+UORtx/K/295PB73Z2dnV30OLMTf8U9+8pO7Jenxxx/fddlll/ktLS3+m9/85lf//M//vEUKOyvv3r07nUgk1nwhcNddd808+uiju1988cWoFO7hGxsb2/QTPgBUi7tu2Dfljy+u//wwvhh5+4F9m3qtf9ddd8189rOfTYyPj0ek8O/v8uvn5ua8K6+8MnXhwgX71Kc+lVj9VnLz9re/febjH//4nmQy6UnSN7/5zdiLL74YXe95aiNVuYL3zjuueeWX/+/3tdw2+U1vtUYro437vBM3fZ/7j7dfvakHvbOzc2F2dtZ73etet3jVVVellmfYv/ALv3Du/vvvv+rAgQOHIpGIHnrooefr6+tZlgOAPP3wbde88jdf+76W5IVveqs1Wkld2Oc16/vce27L/295a2urf9ttt52/4YYbbtqxY0ewd+/epVKfQvwd3717t3/rrbe2nT9/PvKRj3zkm5L0oQ996KX77rvv6gMHDhyqr68PPvaxj31zvdu47bbbFn7lV37lxX/2z/7ZgSAIFIvF3Ic//OF/OnDgwKbLdgCgGvzwd1zxyt98crwl2ZLyVmu0kkqmvOaXA/eeris2/Vr/2LFjZ7/3e7+3zfM8d/PNN89dddVVS397P/jBD750++23H7z88ssXDx48OHf+/Pl1k8313HPPPTPPPvvszje96U1tUlhR8pd/+ZffvOmmmy5kn6fe8pa3JPPZh2eVVhI4PDz8fHt7+8RGx33x6xOND3184Mo7n33CusZP+XtSs24i1mh/23oocuKm73P/8v4j//Rd1+2Z3eh2AACl88WvTzT+8mcHrpzWExapP+V7kVkX+I3mzx+KNOv73H98J3/LAaAWffHrE42//PipK6f3ehZprfO9nZ4LFgLzxxcjzS8H7j++7VBVPz8MDw/vaW9vv3q166o2wZPCGRl/8+Xnd3/pqX/cff5COrprRzR9x203vPKO26+u6en2AFBJzrwyF/v0U8/v/vypi3/L337ohlfecxt/ywGglp15ZS726afP7P782LmLzw8H9r3ynluvqPrnh5pN8AAAAACg2qyX4FVik5UgCIJ158oBAAAAQDXK5EJrNumqxATvmZdffjlOkgcAAACglgRBYC+//HJc0jNrHVNxXTTT6fRPjI+Pf3R8fPxmVWaCCgAAAACbEUh6Jp1O/8RaB1TcHjwAAAAAwOpYAQMAAACAKkGCBwAAAABVggQPAAAAAKoECR4AAAAAVAkSPAAAAACoEiR4AAAAAFAlSPAAAAAAoEqQ4AEAAABAlSDBAwAAAIAqES11APnas2ePu/rqq0sdBgAAAACUxFNPPTXhnNu72nUVl+BdffXVOnnyZKnDAAAAAICSMLMX1rqOEk0AAAAAqBIkeAAAAABQJUjwAAAAAKBKkOABAAAAQJUgwQMAAACAKkGCBwAAAABVggQPAAAAAKoECR4AAAAAVAkSPAAAAACoEiR4AAAAAFAlSPAAAAAAoEqQ4AEAAABAlSDBAwAAAIAqQYIHAAAAAFWCBA8AAAAAqgQJHjbP96XZWSkISh0JAAAAAEnRUgeACpNKSQMDUn+/NDwseV6Y4HV0SEePSkeOSLFYiYMEAAAAahMJHnI3Oir19kpTU1IkIu3bJ5lJzkkjI9KxY1IiIfX1SW1tpY4WAAAAqDmUaCI3o6NSd7c0MyO1tEjNzWFyJ4X/NjeHl8/MhMeNjpYyWgAAAKAmkeBhY6lUuHIXBFI8vv6x8Xh4XG9veB4AAACAbUOCh40NDIRlmRsld1nxuDQ5KQ0OFjUsAAAAAJciwcPG+vvDPXf5iEbD8wAAAABsGxI8rC8Iwm6Zua7eZcXj0tAQIxQAAACAbUSCh/XNz4ejELINVXJlFn7MzxcnLgAAAACvQYKH9dXXh6twQRAONncut/OcCz/q64sbHwAAAIAlzMHD2rJDzWdnpW984+I+vF27pNbWcDSCt8Z7BMlkOPx8resBAAAAFBwJHla3fKh5LBYmd3V14arc3Jx0+nR4+YEDUmPja8/3famnZ/vjBgAAAGoYyyt4rZVDza+4Ikzm0ulwX100GiZ7vi+NjIQrfMslk1IiIR0+XJr4AQAAgBpFgodLrTbU3Ey68cbw/+n0xWOjmQXgsbGL3TKTybAss68vTAoBAAAAbBsSPFxqraHmDQ3SoUNhqWYqFSZ6zoVJXiolvfhiONy8qUk6flxqaytJ+AAAAEAtYw8eLrXeUPOGhrBxyvS0dPasdP58eLnvhwnfgw+GZZms3AEAAAAlQYKHi7JDzfftW/sYM2n37vBDCpM7z5POnZPe8ha6ZqIwfF9aWAjHbPAzBQAAkDMSPFy0maHm2dW+7FDz1TpqArnIjuXo7w/faPC88E2Hjg7p6FHpyBFWhwEAADZAgoeLskPNncsvyWOoObZq+ViOSCRcRTYLf65GRqRjx8LOrH197O8EAABYB7VPuMjzpPb2sBNmPhhqjq1YOZajufniGwxm4ectLeH13d3h8QAAAFgVr8hxqZ6ecP9TPhhqjs1abSzHWuLx8Lje3vA8AAAAvAYJHi515EhYCpfrKh5DzbEVa43lWEs8Ho7jGBwsalgAAACVigQPl4rFwn1OnrdxksdQc2zVemM51hKNhucBAADgNUjw8FptbeGw8qamcLVkejpsdiGF/05PM9QcW5cdy5Hr6l1WPC4NDYXnAwAA4BJ00cTq2tqkEyfCUrj+/vAFdbarYUdHuOeOoebYis2M5ZDC4xnLAQAAsCoSPKwtFpO6usKPIAhfUDN4GoXCWA4AAICC45U6cuN54WoJyR0KhbEcAAAABccrJAClw1gOAACAgiLBA1A6jOUAAAAoKBI8AKXDWA4AAICCIsEDUFqM5QAAACgYumgCKD3GcgAAABQECR6A8sBYDgAAgC0jwQNQfrJjOQAAAJAX3hoHAAAAgCpBggcAAAAAVYIEDwAAAACqBAkeAAAAAFSJoiZ4ZnaXmT1nZqfN7INrHHPEzIbM7FkzGyxmPAAAAABQzYrWRdPMIpL+WNKdks5IetLMPuucO7XsmGZJfyLpLufcP5nZvmLFAwAAAADVrpgreLdLOu2c+4ZzblHSpyT94Ipj7pP0iHPunyTJOXeuiPEAAAAAQFUrZoJ3uaRvLfv8TOay5Q5I2m1mA2b2lJm9f7UbMrMHzOykmZ18+eWXixQuAAAAAFS2YiZ4tsplbsXnUUm3Sfp/JL1N0q+a2YHXnOTcR5xznc65zr179xY+UgAAAACoAkXbg6dwxe4Nyz6/QtJLqxwz4ZyblTRrZk9Iapc0VsS4AAAAAKAqFXMF70lJN5jZNWZWJ+l9kj674pjPSPpeM4uaWYOkOySNFDEmAAAAAKhaRVvBc86lzeynJT0uKSKp3zn3rJn1Zq7vc86NmNljkr4qKZD0UefcM8WKCQAAAACqmTm3cltceevs7HQnT54sdRgAAAAAUBJm9pRzrnO164o66BwAAAAAsH1I8AAAAACgSpDgAQAAAECVIMEDAAAAgCpBggcAAAAAVYIEDwAAAACqBAkeAAAAAFQJEjwAAAAAqBIkeAAAAABQJUjwAAAAAKBKkOABAAAAQJUgwQMAAACAKkGCBwAAAABVggQPAAAAAKoECR4AAAAAVAkSPGwP35dmZ6UgKHUkAAAAQNWKljoAVLFUShoYkPr7peFhyfPCBK+jQzp6VDpyRIrFShwkAAAAUD1I8FAco6NSb680NSVFItK+fZKZ5Jw0MiIdOyYlElJfn9TWVupoAQAAgKpAiSYKb3RU6u6WZmaklhapuTlM7qTw3+bm8PKZmfC40dFSRgsAAABUDRI8FFYqFa7cBYEUj69/bDweHtfbG54HAAAAYEtI8FBYAwNhWeZGyV1WPC5NTkqDg0UNCwAAAKgFJHgorP7+cM9dPqLR8DwAAAAAW0KCh8IJgrBbZq6rd1nxuDQ0xAgFAAAAYItI8FA48/PhKIRsQ5VcmYUf8/PFiQsAAACoESR4KJz6+nAVzrn8znMu/KivL05cAAAAQI0gwUPheJ7U3i4lk/mdl0yGw889fhwBAACAreAVNQqrp0fy/fzO8f3wPAAAAABbQoKHwjpyREokcl/FSybD4w8fLmpYAAAAQC0gwUNhxWJSX19YbrlRkpdMhsf19YXnAQAAANgSErxC8H1pdpY2/1ltbdLx41JTUzjEfHr6YuMV58LPJyfD648fD48HAAAAsGXRUgdQsVIpaWAgHNA9PByuRAVB2Czk6NGwVLGWV6Xa2qQTJ6TBwfA+GhoKRyE4F95HPT1hWWYt30cAAABAgZnLt6V9iXV2drqTJ0+WNojRUam3V5qakiKRcFB3NnlJJsMVvUQiLD1kdSoUBOGcu/p6umUCAAAAW2BmTznnOle7jlfa+Rodlbq7pZkZqaVFam6+ONjbLPy8pSW8vrs7PB5hUtfYSHK3Gkp8AQAAUCC82s5HKhWu3AVBuGq3nng8PK63NzwPWC6VCktY771XuuUW6Y47pJtvlu67L7ycnxkAAABsAnvw8jEwEJZltrTkdnw8Lk1MhPvQurqKGhoqyMoS3337Lpb4joxIx45R4gsAAIBNYQUvH/394QvyfESj4XmARIkvAAAAiooEL1dBEHbL3Kg0c6V4POwgyf4qUOILAACAIiPBy9X8fNggJLvakiuz8GN+vjhxoXJkS3xzfZMgHg/nBQ4OFjUsAAAAVA8SvFzV14crKvmOlXAu/KivL05cqByU+AIAAKDISPBy5XlSe3s45y4fyWQ42JvxALWNEl8AAABsA7KOfPT0hDPL8uH74XmobZT4AgAAYBuQ4OXjyJGwfX2uq3jJZHj84cNFDQsVgBJfAAAAbAMSvHzEYuFsMs/bOMlLJsPj+vrC81DbKPEFAADANuBVY77a2qTjx6WmprDD4fT0xVUZ58LPJyfD648fZ1A1LqLEFwAAAEUWLXUAFamtTTpxImxf398fNsEwCxO8jo7wBfnhw6zc4VLLS3xzabZCiS8AAADyRIK3WbGY1NUVfgRB2ASjvp5SOqwtW+Lb3b1xkkeJLwAAADaBbKQQPE9qbCS5w8Yo8QUAAEARsYIHbDdKfAEAAFAkJHhAKVDiCwAAgCIgwQNKLVviCwAAAGwRywV4Ld+XZmfDlSUAAAAAFYMVPIRSKWlgINwTNjwcrioFQbgn7OjRsMU/e8IAAACAskaCB2l0VOrtlaampEhE2rfvYtOPkRHp2LFwHltfH10dAQAAgDJGiWatGx0N57LNzEgtLVJzc5jcSeG/zc3h5TMz4XGjo6WMFihflDYDAIAyQIJXy1KpcOUuCNYfui2F1wdBeHwqtT3xAeUulQpHXtx7r3TLLdIdd0g33yzdd194Ob8rAABgm1GiWcsGBsKyzJaW3I6Px6WJiXB+W1dXUUMDyh6lzQAAoAyxglfL+vvDF6b5iEbD84BaRmkzAAAoUyR4tSoIwm6ZG5VmrhSPS0ND7DNC7aK0GQAAlDESvFo1Px+OQsiuOuTKLPyYny9OXEC5y5Y25/rmSDwuTU6Gpc0AAABFRoJXq+rrw5UF5/I7z7nwo76+OHEB5Y7SZgAAUMZI8GqV50nt7VIymd95yWQ4/NzjRwc1iNJmAABQ5niVXst6esLZXfnw/fA8oBZR2gwAAMocCV4tO3IkbOOe6ypeMhkef/hwUcMCyhalzQAAoMyR4NWyWCyc0eV5Gyd5yWR4XF9feB5QiyhtBgAAZY5XG7WurU06flxqago7/U1PX1ydcC78fHIyvP74cQY2A5Q2AwCAMhYtdQAoA21t0okTYRv3/v6wGYRZmOB1dIQvTA8fZuUOkC4tbc6l2QqlzQAAYBuR4CEUi0ldXeFHEITNIOrrKSkDVsqWNnd3b5zkUdoMAAC2Ga/e8VqeJzU2ktwBa6G0GQAAlClW8ABgMyhtBgAAZYgEDwA2i9JmAABQZkjwAKAQsqXNAAAAJcTbzAAAAABQJUjwAAAAAKBKkOABAAAAQJUgwQMAAACAKkGCBwAAAABVggQPAAAAAKpEURM8M7vLzJ4zs9Nm9sFVrj9iZkkzG8p8/Fox4wEAlIjvS7Oz4bxAAABQNEWbg2dmEUl/LOlOSWckPWlmn3XOnVpx6P9xzt1drDgAACWSSkkDA1J/vzQ8HM4KDAKpo0M6elQ6ciQcFg8AAAqmmIPOb5d02jn3DUkys09J+kFJKxM8AEC1GR2VenulqSkpEpH27ZPMJOekkRHp2DEpkZD6+qS2tlJHCwBA1Shmieblkr617PMzmctW+k4zGzazz5vZTUWMBwCwHUZHpe5uaWZGammRmpvD5E4K/21uDi+fmQmPGx0tZbQAAFSVYiZ4tsplbsXnX5F0lXOuXdIfSvofq96Q2QNmdtLMTr788suFjRIAUDipVLhyFwRSPL7+sfF4eFxvb3geAADYsmImeGckvWHZ51dIemn5Ac65Gefc+cz/PycpZmZ7Vt6Qc+4jzrlO51zn3r17ixgyAGBLBgbCssyNkruseFyanJQGB4saFgAAtaKYCd6Tkm4ws2vMrE7S+yR9dvkBZtZqFtbtmNntmXgmixgTAKCY+vvDPXf5iEbD8wAAwJYVrcmKcy5tZj8t6XFJEUn9zrlnzaw3c32fpPdI+kkzS0ual/Q+59zKMk4AqD2+Ly0sSPX1YffJShAEYbfMffvyOy8el4aGwvMr5XsFAKBMFbOLZrbs8nMrLutb9v8/kvRHxYwBACpGpY8VmJ8PY7bVtmCvwyz8mJ+XGhuLExsAADWiqAkeACBH1TBWoL4+TEidyy/Jcy78qK8vXmwAANQIamEAoNSqZayA50nt7VIymd95yWS4Skl5JgAAW8azKQCUUrWNFejpCfcP5sP3w/MAAMCWkeABQClV21iBI0fCUtJcV/GSyfD4w4eLGhYAALWCBA8ASqnaxgrEYuE+Qc/bOMlLJsPj+vrKu3kMAAAVhAQPAEolO1Yg19W7rOVjBcpRW5t0/LjU1BSuNk5Ph01UpPDf6enw8qam8LhybRoDAEAFoosmsB0qcaYZiq+axwq0tUknToSlpP39YUKa7Qra0RHuuTt8mJU7AAAKjAQPKJZKn2mG4qv2sQKxmNTVFX4EQZiQ8iYHAABFRYKH8lapK1/VMNMMxZcdKzA6Go5CyFUljhXwvPJdbQQAoIpU0KsD1IxUKiztuvde6ZZbpDvukG6+WbrvvvDycm0Pn1UtM82wPRgrAAAACshcduN7hejs7HQnT54sdRgolpUrX/H4xZWvZDJ8YVvOK1+plHTnnWHylkvjjGQybDRx4gTlmrWKnxkAAJAnM3vKOde52nWs4KF8VMPKV7XNNEPx1eJYAd+XZmfLtwsoAAAVjAQP5SGVClfugmDj5CgeD4/r7S2/cs1qm2mG3Gw1YamFsQKVXnoNAECFoMkKykN25aulJbfj43FpYiJc+erqKmpoOcvONNu3L7/zls80q6SmGbVuvS6p73+/9OY3hwlZro9pNY8VoOkQAADbhj14KA/33pt/J8HpaengQekTnyhWVPmZnQ1XJfbuzf/cc+ekL3+ZLoOVYrW9os5Jr7wifetb4TiASERqbQ1/JjYzFqNaxgpkS683Wp3Plp9W6golAADbiD14KG/Zla9c961lLV/5KgfLZ5rlo1JmmiG02l7RubnwZ/jrX5fSaWnnzjBZ+fa3w5/RY8fCRir57BvNjhWo5OSuWkqvAQCoIBX8ygFVY34+fBGbz6BnKTzeLDy/HGRnmm3UKGOlSpxpVqtWS1hmZ8MyQ9+X6urCPZVmF/996aWw/LCcmwMVS75Nh5qapJdflv7u74oaFgAA1YxXlCi9alr5YqZZdVuZsASBNDYW/j+6ypbmaDRc0Zuers0VqlyaDgVBeJ8++6z05JPSN74hvfe9NF8BAGCTSPBQetW08nXkSLhak+v3kkyGxx8+XNSwUCArE5bp6TABWS25yzKTzp4N/19LYzFyKb2enQ2POX06XImPxaQdO8L7NNt8Jd/SVgAAalwZvTJGTauWla9anGlWK1ZLWM6e3fgNhkhEOn/+4ue1MhZjo9LrtUpbsx+XXVb+cy8BAChDJHgoD9W08lULM81q0cqExbkwSdmoBDF7fPYNjHJrDlQs65Ver1famj0+e7/WYmkrAABbQIKH8lBtK1/ZmWYPPhiOcjh37uLHwYPh5SdOkNxVkpUJSzZB26g50MqEpdyaAxXLeqXX65W2+r60a9ell9VSaSsAAFtEgofyUW0rX7FYOIT9E5+QnnkmnHP3zDPh511d5ZucYnUrE5ZsaeZGzYFWJizl2ByoWNYqvV6vtNU5af/+115eK6WtAABsEQkeyku1rnxVw0wzXJqwmIWP6UZ7R1cmLOXYHKhYViu9Xq+0NZ0OE7nm5tdeVyulrQAAbNE6rd+AEsmufHV1hS/m5ufD1Y5aeEGM8rY8YYnHw8Tt9Om1j18tYSnH5kDFki297u6+eJ+tVdqaTof/3njj6mWvy0tbGxuLGzcAABWMV8wob6x8oZys3Cva3Bxelk1OllstYSnn5kDFsrL0emYmvDxbqppOh/vxIhHp0CGpoWH126ml0lYAALaAV80AkI/lCcsrr1wsv0yn109YKqE5ULEsL70+dCi8bxYWwvupoUG6/vqwbHWt5E6qrdJWAAC2gBJNAMhXNmEZHAwbfywuSuPj4b8NDdKVV0q7d4fHTk+HZZmJRJjcVdr+0UJZXnr9+OPhEPO9e3M/v5ZKWwEA2AISPADYjJV7RWdmwk6pH/tY2Azk5ZfDFb2OjjAxOXy49lbu1vKWt0h79lzcl7eRWixtBQBgk8xt1OK7zHR2drqTJ0+WOgwAWBvNgTY2Oho2XwmC9ZO8bGlrJYxGAQBgm5jZU865ztWu45UHABQazYE2Vm1zLwEAKBOUaAIASmPlXsahobDjKKWtAABsGgkeAKB0mHsJAEBBkeABAMpDtrQVAABsGm+RAgDKi+9Ls7Phih4AAMgLK3gAgNJLpaSBgXAv3vBwuJoXBOFevKNHpSNH2IsHAEAOSPAAAKU1Oir19kpTU1IkIu3bd7HZyshIOBS91gfFAwCQI0o0AQClk52HNzMjtbRIzc1hcieF/zY3h5fPzITHjY6WMloAAMoeCR4AoDRSqXDlbqNh51J4fRCEx6dS2xMfAAAViAQPAFAaAwNhWeZGyV1WPB4OPx8cLGpYAABUMhI8AEBp9PeHe+7yEY2G5wEAgFWR4AEAtl8QhN0yc129y4rHpaEhRigAALAGEjwAwPabnw9HIWQbquTKLPyYny9OXAAAVDgSPADA9quvD1fhnMvvPOfCj/r64sQFAECFI8EDAGw/z5Pa26VkMr/zkslw+LnH0xcAAKvhGRIAUBo9PZLv53eO74fnAQCAVZHgAQBK48gRKZHIfRUvmQyPP3y4qGEBAFDJSPAAAKURi0l9fWG55UZJXjIZHtfXF54HAABWRYIHACidtjbp+HGpqSkcYj49fbHxinPh55OT4fXHj4fHAwCANUVLHQAKzPelhYWwwxxNCABUgrY26cQJaXAwHGI+NBSOQnAubKjS0xOWZbJyBwDAhkjwqkEqJQ0MhC+MhofDxC4IwhdGR4+G+1x4YQSgnMViUldX+BEE4Zw73qgCACBvJHiVbnRU6u2VpqakSETat+/iO98jI9KxY2FTgr4+SpsAVAbPkxobSx0FAAAVibdGK9noqNTdLc3MSC0tUnNzmNxJ4b/NzeHlMzPhcaOjpYwWAAAAQJGR4FWqVCpcuQsC+c3Nmo3FFKx1bDweljz19obnAQCAyuL70uxs+HwOAOugRLNCpQYGNLB3r/rf/W4Nt7bKc06BmTrGx3V0aEhHnn9eseVPAvG4NDERNjHo6ipd4AAAIDfssQewCeay7agrRGdnpzt58mSpwyip0dlZ9X7mM5qSFJEUv3BBJslJSu7YIT8SUWJ+Xn2PPqq2ycmLJ05PSwcPSp/4REniBgAAOVq5xz4ev7jHPpkMV/TYYw/ULDN7yjnXudp1lGhWmNHZWXWPjGgmnVbLhQtqziR3kmSSmi9cUMvcnGbq6tR9zz0abWm5eHI8HrYfp7wDAIDyxR57AFtAgldBUkGg3rExBUGg+MLCusfGL1xQIKn37ruVyrYZNws/5ueLHywAAMjfsj32isfXP5Y99gBWQYJXQQampzWVSimeY719/MIFTdbXa/Cqq8ILnAs/6uuLGCUAANi0gYGwLHOj5C4rHpcmJ8M99gAgEryK0n/2rCKeF67CNTZK6fSG50R9X/233hp+kkyGG7MZHAyUHzrkAZDChiqRSH7nRKPheQAgEryKETin4dlZxbN/9Pfvz+m8+IULGmptDUco+L7U01O0GAHkKZWSTpyQ7r1XuuUW6Y47pJtvlu67L7yckiugtgRB2C0z19W7LPbYA1iGMQkVYj4I5Emy7Cbr5ubwHTvfX/edPpNkzml+fl6NiYR0+PB2hAtgIys75O3bd7FD3siIdOwYHfKAWjM/H1bZZJ/rc7V8j31jY3FiA1AxWMGrEPWep0DS0lgLz5NuvDH8v++veZ6T5IJA9b4fvlBkXg5QenTIA7Ca+vpwFS7fEVbssQewDAlehfDM1N7YqOTyZK6hQTp0KHz3P51+7Z68dFrJaFQd587J+/jHWQUAygEd8gCsxfOk9vZwz3w+2GMPYBn+ElSQnv375a+sr29oCJ8MrrsuLMtIpS5+NDbKv+IK9dx7L8kdUC7okAdgPT0961bmrIo99gCWYQ9eBTnS3KxELKZkOq14dNlD53nhXp1EIizRCALJ85T0fSUiER1ePuwcQGltpUNeV1dxYgJQPo4cCZ/Pk8nc3ghKJsPj2WMPIIMVvAoS8zz1HTggT1JyrREJZlIkoqTvy5PUd+CAYpRsAOWBDnkANhKLhXvmPW/jUs1kMjyOPfYAluGVf4Vpa2zU8YMH1RSJaHJxUdPp9FLjFeecptNpTaZSaopEdPzgQbXRTQsoH4XokAeg+rW1ScePS01NYYn29PTFxivOhZ9PTobXHz/ONgwAl6BEswK1NTbqRHu7Bqen1T8+rqHz52UKO2Z27NqlntZWHW5uZuUOKDfLO+Tlk+TRIQ+oPW1t4TzMwcGwRHto6OIolY6OcM/d4cOs3AF4DRK8ChXzPHUlEupKJBQ4p/kgUL3nyct3ZQDA9sl2yBsdDUch5IoOeUBtisXCvbddXeGbQ/Pz4Rs9/C0AsA7+QlQBz0yNkQjJHVAJ6JAHYDM8L+yWTXIHYAMbruCZ2dsk/ZCkyxVWAb4k6TPOuceKGxoAVCE65AEAgCJa920gM/t9Sf9G0qCk/yzpdzL//9dm9gdFjw4Aqg0d8gAAQBFttIL3A865AysvNLP/JmlMYfIHAMhHtkNeb2/YCS8SCVfzsg0UksmwLDORCJM7OuQBAIAcbZTgLZjZ7c65L6+4/E2SFooUEwBUPzrkAQCAItgowfsxSf/VzC6TdCZz2RskzWSuAwBsFh3yAABAga2b4DnnviLpDjNrVdhkxSSdcc6Nb0dwAFAzsh3yAAAAtiCnOXiZhI6kDgAAAADK2KbrgMzsKzkcc5eZPWdmp83sg+sc9yYz883sPZuNBwAAAABq3aYTPOfcd6x3vZlFJP2xpLdLOiTpXjM7tMZxH5L0+GZjAQAAAABsIcHLwe2STjvnvuGcW5T0KUk/uMpxPyPpYUnnihhLTfKd06zvK3Cu1KEAAAAA2AY57cEzs3sUrrLtU9hoxSQ551zTOqddLulbyz4/I+mOFbd7uaR3SXqLwtELa339ByQ9IElXXnllLiHXrFQQaGB6Wv1nz2p4dlaepEBSx65dOtraqiPNzYrRoQ8AAACoSjkleJL+s6R3OOdG8rhtW+WylUtJvy/pF51zvtlqh2dOcu4jkj4iSZ2dnSxHrWF0dla9Y2OaSqUU8Tzti8VkZnLOaWRuTsdOn1YiFlPfgQNqo1sfAAAAUHVyTfC+nWdyJ4Urdm9Y9vkVkl5acUynpE9lkrs9kn7AzNLOuf+R59eqeaOzs+oeGVEgqaWu7pLrzEzN0fChTqbT6h4Z0fGDB0nyUFV857QQBKr3PHnrvGEEAABQzXJN8E6a2X+T9D8kXche6Jx7ZJ1znpR0g5ldI+lFSe+TdN/yA5xz12T/b2Yfk/QoyV3+UkGg3rExBZLi0fUf0ng0qmQ6rd6xMZ1ob6dcExWNkmQAAIBL5ZrgNUmak/TWZZc5SWsmeM65tJn9tMLumBFJ/c65Z82sN3N93+ZCxkoD09OaSqVes3K3lng0qonFRQ1OT6srkShydEBxUJIMAADwWuYqrMNiZ2enO3nyZKnDKCv3PvusRufnl8owN+Kc01Q6rZsaGvTJm24qcnRA4S0vSV5v1TqZTsuTKEkGAABVxcyecs51rnZdrl00d0r6cUk3SdqZvdw511OQCLFpgXManp3Vvlhsw+Om02mdXVzUrO9Lkp6bm9O9zz6rnv37KWVDxaAkGQAAYG25vtr5uKRWSW+TNKiwYcqrxQoKuZsPAnkKG6msZdb3NXz+vE7Pz2s+CBQzU53nKSLpVKaU7c7hYY3Ozm5b3MBmZUuSN0rusuLRqCZTKQ1OTxc3MAAAgDKQa4J3vXPuVyXNOuf+QtL/I+mW4oWFXNV7ngKFZZermfV9jczNyZdU53mKmi3tUzIzJaJRtdTVacb31T0yQpKHstd/9qwiea7ERT1P/ePjRYoIAACgfOT6KimV+XfazG6WFJd0dVEiQl48M7U3NiqZKbtcLnBOY3NzkqToihU+X9KuSETKXB6PRhVI6h0bUyoIih02sCnZkuR4JJLXefFIREPnzyuosD3HAAAA+co1wfuIme2W9KuSPivplMLh5ygDPfv3y18lKZtOp5Vy7jXJnRSu+O1f0XWTUjaUu1xKkldjZrLM+QAAANUsp00szrmPZv47KOna4oWDzTjS3KxELKZkOn3JvqSzi4urDnxOZ5K+1bpuZkvZGJ+AcrS8JDmfJM85J5c5HwAAoJrl9GrHzF5nZn9mZp/PfH7IzH68uKEhVzHPU9+BA/IUtoWXwhe0s76vlYVs6UyJ2o0NDau+QKaUDeVsvZLk9SR9Xx27dq36hgcAAEA1yfXt7I8pHFj++sznY5I+UIR4sEltjY06fvCgmiIRTS4uaiqT6GUbqqSdUyoIFJF0qKFBDWvsYaKUDeVurZLk9fjOqae1tUgRAQAAlI9cE7w9zrm/khRIknMurbBPB8pIW2OjTrS368Hrr9dNDQ1KO6cLvq+Uc2rwPF1fX6+OXbvWTO4kStlQ/paXJOcimU4rEY3qcHNzcQMDAAAoA7m+ip81sxZJTpLM7M2SkkWLCpsW8zx1JRL65E036V179uiGhgbdftllOtTYqN2x2Ib7lihlQ7lbrSR5Lcl0Wp6kvgMHGHIOAABqQq6veH5OYffM68zs7yX9/yT9TNGiQkH8+P794Xy8PJI1StlQCVaWJE+n00uzIJ1zmk6nNZlKqSkS0fGDB9XW2FjiiAEAALZHrl00v2JmhyXdKMkkPeecS21wGkpsre6aa6GUDZUkW5I8OD2t/vFxDZ0/L1NYZtCxa5d6Wlt1uLmZlTsAAFBTckrwzCwi6QcUDjePSnprpnnHg0WMDVuULWXrHhnZMMmjlA2VKFuS3JVIKHBO80Gges+jxBgAANSsXF/J/42kH5PUIumyZR8oc5SyoVZ4ZmqMREjuAABATctpBU/SFc65NxY1EhQNpWwAAABAbcg1wfu8mb3VOfeFokaDoqGUDQAAAKh+uSZ4/1fSX5uZJymlsNGKc841FS0yFE22lK0S+c5pgeQUAAAAWFWuCd7vSfpOSV9z2Q1cwDZJBYEGpqfVf/ashmdn5UkKFJaXHm1t1RHKSwEAAABJuSd4/yjpGZI7bLfR2Vn1jo1pKpVSxPO0LzOs3Tmnkbk5HTt9WolYTH0HDtAgBgAAADUv1wTvrKQBM/u8pAvZCxmTgGIanZ1V98iIAkktdXWXXGdmas6MfUim0+oeGaELKAAAAGpernVt35T0vyTViTEJ2AapIFDv2JgCacMh7fFoVIGk3rExpYJgW+IDAAAAylFOK3jOuX9X7ECA5QampzWVSr1m5W4t8WhUE4uLGpyeVlciUeToAAAAgPK06c4UZvZAIQMBlus/e1aRPBunRD1P/ePjRYoIAAAAKH9baT1Ij3oUReCchmdnFc9zlEM8EtHQ+fMK6AUEAACAGrXpBM8591AhAwGy5oNAnsJGKvkwM1nmfAAAAKAW5ZTgmdlvmVnzss93m9l/KFpUqGn1nqdAUr5TOZxzcpnzAQAAgFqU6yvhtzvnprOfOOdekfQDRYkINc8zU3tjo5K+n9d5Sd9Xx65d8vJc+QMAAACqRa4JXsTMdmQ/MbN6STvWOR458J3TrO+zZ2wVPfv3y8+z1NJ3Tj2trUWKCAAAACh/uQ46Py7pf5nZn0tyknok/UXRoqpiqSDQwPS0+s+e1fDsrDxJgaSOXbt0tLVVR5qbFaPEUEeam5WIxZRMpzecgyeFw84T0agONzcXPzgAAACgTFmu+5zM7C5JXQq7Z37BOfd4MQNbS2dnpzt58mQpvvSWjc7OqndsTFOplCKep3gkIjOTc05J35cfBErEYuo7cEBtjY2lDrfkRmdn1T0ysuGw82Q6LU/S8YMHud8AAABQ9czsKedc56rX5ZLgmdk1ks465xYyn9dLep1z7vlCBpqLSk3wSFY2Z8Ok2DklolGSYgAAANSM9RK8XGsB/7vCSsIsP3MZcpAKAvWOjW2Y3ClzfSCpd2xMKdr9q62xUSfa2/Xg9dfrYEODzqVSOre4qHOplA42NOjB667TifZ2kjsAAABAue/BizrnFrOfOOcWzayuSDFVnYHpaU2lUmqpy+0ui0ejmlhc1OD0tLoSiSJHV/5inqeuREJdiYQC5zQfBKr3PLplAgAAACvkuoL3spm9M/uJmf2gpInihFR9+s+eVSTPxilRz1P/+HiRIqpcnpkaIxGSOwAAAGAVua7g9Ur6SzP7o8znZyTdX5yQqkvgnIZnZ7UvFsvrvHgkoqHz5xU4RzIDAAAAICfrJnhm9m+cc38gqdU592Yz26WwMcur2xNe5ZsPAnmSLM8kzcxkmfMbI5GixAYAAACgumxUN3g08+8fSpJz7jzJXX7qPU+BpFzHUWQ55+Qy5wMAAABALjYq0Rwxs+cl7TWzry673CQ559wbixZZlfDM1N7YqNH5eTXnMLA7K+n76ti1a6k803dOCzQXAQAAALCOdTMO59y9ZtYq6XFJ71zvWKytZ/9+HTt9Oq9zfOf0/te9TiemptR/9qyGZ2flKZxV0bFrl462tupIc7NirPABAAAAyMhp0Hk5qcRB56kg0J3Dw5rx/Q3n4EnhsPOopJ2ep+l0evUB30GgRCzGgG8AAACgxmx50LmZ3W1mT5vZlJnNmNmrZjZT2DCrV8zz1HfggDyFydt6kum0FoNAc0Gg80Gglro6NUejS01azEzN0aha6uo04/vqHhnR6OzsNnwXAAAAAMpdrvV9vy/pn0tqcc41Oecuc841FS+s6tPW2KjjBw+qKRLR5OKiptPppcYrzjlNp9OaTKV0WSSiBs9TnedtuNoXj0YVSOodG1MqCLbhuwAAAABQznJN8L4l6RlXafWcZaatsVEn2tv14PXX62BDg86lUjq3uKhzqZQONjToweuu0wevvFILQZBTKacUJnmTqZQGp6eLGzwAAACAspdrW8dfkPQ5MxuUdCF7oXPuwaJEVcVinqeuREJdiYQC5zS/ojPmvc8+q0iejVOinqf+8XF1JRLFCBkAAABAhcg1wfuPks5L2imprnjh1BbP7JIh5oFzGp6d1b5YLK/biUciGjp/XoFzjFAAAAAAaliuCV7COffWokYCzQeBPGmpoUquzEyWOX95wojKwqxDAAAAbFWuCd7fmtlbnXNfKGo0Na7e8xQobLqST5LnnJPLnI/KkgoCDUxPM+sQAAAABZFrgvevJP2CmV2QlJJkkhydNAvLM1N7Y6NG5+fVnGOTFUlK+r46du1aWvVhJagyjM7OqndsTFOplCKep32x2NKsw5G5OR07fZpZhwAAAMhLTlmEc+6yYgeCUM/+/Tp2+nRe5/jO6f2ve51OTE2xElQhRmdn1T0yokBSS92l21qzsw6lcC5i98iIjh88SJIHAACADVmlTT7o7Ox0J0+eLHUYRZMKAt05PKwZ389pVEIynVZUUn0kolcyK0HxSGRpJSjp+/KDgJWgMrKZx7gpEtGJ9naSdAAAAMjMnnLOda523aZfLZrZVzYfEtYS8zz1HTggT+EL+/Uk02ktBoHmgkCv+r5a6urUHI0u7d/LrgS11NVpxvfVPTKi0dnZbfgusJ6B6WlNpVLMOgQAAEDBbTrBc859RyEDwUVtjY06fvCgmiIRTS4uajqdVnal1Tmn6XRak6mUdnmeGjxPdZ63YbIQj0YVSOodG1MqCLbhu8Ba+s+e3fSsQwAAAGA91HuVqbbGRp1ob9eD11+vgw0NOpdK6dzios6lUjrY0KAHr7tOv3TVVVoIAlaCKkh21mE8z3EWy2cdAgAAAGtZNzMws1clZV9RZtsxOtFFc1vEPE9diYS6EgkFzml+RWfMe599dtMrQV2JRDFCxgaYdQgAAIBiWjfBo3tm+fDMLnlhn10J2heL5XU7y1eCGKGw/Zh1CAAAgGLK+dWimX2PmR3N/H+PmV1TvLCwkUKsBGH7ZWcdJn0/r/NWzjoEAAAAVpNTgmdmvy7pFyX9UuaiOknHixUUNrZ8JSgftbYS5DunWd8vq71rPfv3y88zwfadU09ra5EiAgAAQLXIrTuH9C5Jt0r6iiQ5514yM8o3Syi7EjQ6P780FDsXtbASlAoCDUxPl+3Q9yPNzUrEYkqm0znPwUtEozrc3Fz84AAAAFDRcn2Vu+jCpSInSWbGtOwywErQa43OzurO4WEdO31ao/Pz2heLaW9dnfbFYhqZm9Ox06d15/BwSecBrjbr0Dkn37nXrMgm02l5kvoOHNgwKS3H1UoAAABsr1yXfv7KzB6S1Gxm/0JSj6Q/LV5YyAUrQZcanZ1V98iIAkktdXWXXJcd+i6F90P3yIiOHzyotsbSvFfR1tioP7/xRv3oyIiefvVVLQSBIplV1cZIRE2RiOo9Ty2xmPoOHFgzznJfrQQAAMD2slz3cJnZnZLeqnBEwuPOuRPFDGwtnZ2d7uTJk6X40mVpeVKzXpKXXQkqZVJTTKkg0J3Dw5rx/ZyT3aZIRCfa20uSAI3Ozqp3bEyTqZTmg0Az6bRmg0DOOQWSdnqertq5U8cPHtQtu3atextTqZQinqd4JCIzk3NOSd+XHwRKbJAgAgAAoPKY2VPOuc7VrstpBc/MflbSfy9VUoe1tTU26vjBg2GysLi4+gt955SIRqv6hf7A9LSmUqnXrNytJR6NamJxUYPT0+vOBPSd08KK+YNbtTwp37M8XufkS4pIkpmS6bSOjo6umpRX0molAAAAtk+uJZpNkh43sylJn5L0aefct4sXFvLR1tioE+3tGpyeVv/4uIbOnw8n0Sss1etpbdXhKi/V6z97tmBD33Mpe/TMNpX4pYJAvWNjq6+4mmn5CPN4NKpkOq3esbFLVhrXvY0V1roNAAAAVKecEjzn3L+T9O/M7I2SfkTSoJmdcc51FTU65CzmeepKJNSVSChwTvMFXnUqZ4Uc+r6y7HFfLLa0GnpqdlYPPPecZoNAl2X2yOW7360QK43FWq0EAABA5cv37fxzksYlTUraV/hwUAiemRojkZpI7qTCDX3Plj3O+L5a6urUHI0u3eZcEOj5hQWdS6V03vf17cVFNUYieXfn3MpKYyFvAwAAANUp10HnP2lmA5L+l6Q9kv6Fc+6NxQwMyFUhhr6vV/Y46/samZuTL6nO87TD82Rmem5uTpLUHI2qpa5OM76v7pGRNZO87EpjPBJZ9fq1LF9pLMRtAAAAoHrlugxwlaQPOOducs79unPuVDGDAvKRHfqe9P28zls+9D1b9rgyuQuc01gmkYsuWyGMmintnKYzc+ykMDEMJPWOjSm1ynzCQqw0Fmq1EgAAANUppwTPOfdBSbvM7KgkmdleM7umqJEBedjq0Pe1yh6n02mlnLskucsyM51dXLzksng0qslUSoPT0685vhArjYW4DQAAAFSvXEs0f13SL0r6pcxFMUnHixUUkK/lQ99zsXzo+3plj2cXF9fcyxiRdN73pRXJ1lr73Qqx0liI2wAAAED1yvXt/HdJeqekWUlyzr0k6bJiBQXkK+Z56jtwQJ60YZKXHfred+CAYp63Ztmjc06zvq+1drtlj1+Zaq23322rK42Fug0AAABUp1wTvEUX1oQ5STIzJiaj7GSHvjdFIppcXNR0Or1Uyugy++UmUyk1RSKXDP5eq+wxm0Kttd8te/zKBHC9/W5bWWks5G0AAACgOuWa4P2VmT0kqdnM/oWkv5X0p8ULC9ic7ND3B6+/XgcbGnQuldK5xUWdS6V0sKFBD153nU60ty8ld9LapZPZX4619rv5knZFItIqK39r7XfbykpjIW8DAAAA1clybdZgZndKeqskk/S4c+5EMQNbS2dnpzt58mQpvjQqUK5D309MTenY6dOvGR7+7Oys5oNg1SYrqSDQ9fX12r1iwPp0Oq2DDQ36xKFDa369lQPV45HI0kD1pO/Ld06JaFR9Bw5ckowW+jYAAABQeczsKedc52rXRVe7cDWZhK4kSR2wWdmh7xtZXva4fFTC/ro6nZ6ff80qXTrTWbM5+tpfoVz2u2VXGgenp9U/Pq6h8+dlCmugO3btUk9rqw43N6+76laI2wAAAEB1WXcFz8xeVfh6Mfu6cekqSc4511Tc8F6LFTwUy+jsrLpHRi4Zdh44p+Hz5+Xr4hy8dOZ35lBDgxpWJI/JdFpNkYhOtLfnlVjlutJY7NsAAABA+VtvBW/dV6DOucucc03L/m1a/nlxwkWt8jNdK1frPrkdVmvSYpIONDRIzulCECgVBIpo7eRus/vdsiuNW0nMCnEbAAAAqGw5lWia2b+X9ISkf3DOzRY3JNSSVBBoYHpa/WfPanh2Vp7C7pUdu3bpaGurjmxzieFaZY/76up03vfV4HmKR6NLDVTY7wYAAIByklOTFTPrkfQ9kr5T0quS/o+kJ5xzn9ngvLsk/YHCTvIfdc799orrf1DSbyp8TZ+W9AHn3P+33m1Solk9NmwSEgRKxGIlTZqWlz36zrHfDQAAACW3Xolmzl00MzfUKumHJf1bSbudc2sOOzeziKQxSXdKOiPpSUn3OudOLTtml6RZ55wzszdK+ivnXNt6MZDgVYfV9rutJlv2uHxuXTlgvxsAAABKZdN78JbdwEfN7IuS/qvCss73SNq9wWm3SzrtnPuGc25R0qck/eDyA5xz593FDLNRlzZyQZVKBYF6x8Y2TO6UuT6Q1Ds2ptQqg8NLhf1uAAAAKEe51pO1KCyznJY0JWnCObf+hGXpcknfWvb5mcxllzCzd5nZqKT/Kaknx3hQwQampzWVSm2Y3GXFo1FNplIanJ4ubmAAAABAhcspwXPOvcs5d4ek/yypWdLfmdmZDU5bbWnjNSt0zrm/zpRl/pDC/XivvSGzB8zspJmdfPnll3MJGWWs/+xZRfLcqxb1PPWPjxcpIgAAAKA65NpF825J3yvp+xSWZv5vhY1W1nNG0huWfX6FpJfWOtg594SZXWdme5xzEyuu+4ikj0jhHrxcYkZ5CpzT8Oys9sVieZ0Xj0Q0dP68AucoiwQAAADWkFuNnPR2hWMS/sA5t2aStsKTkm4ws2skvSjpfZLuW36AmV0v6euZJivfIalO0mSOt48KNB8E8iRZnkmamcky5zeumD8HAAAAIJRTguec+1dm9jpJb8okYl92zp3b4Jy0mf20pMcV7t/rd849a2a9mev7JL1b0vvNLCVpXtKPuHzaemJdvnNaKLNOj/Wep0Dh/Lh8kjznnFzmfAAAAACry7VE872SflfSgMK9dX9oZj/vnPv0euc55z4n6XMrLutb9v8PSfpQnjFjHeU2OHwlz0ztjY0anZ9Xc45NViQp6fvq2LWrbBJVAAAAoBzl+gr7VyS9KbtqZ2Z7Jf2tpHUTPGyvlYPD98ViS4PDR+bmdOz06ZIPDpeknv37dez06bzO8Z1TT2trkSICAAAAqkOuSzneipLMyTzOxTbIDg6f8X211NWpORpdKoE0MzVHo2qpq9OM76t7ZESjs7Mli/VIc7MSsZiS6Y0mbYSS6bQS0agONzcXNzAAAACgwuWapD1mZo+b2Y+Z2Y8pnFn3uQ3OwTaptMHhMc9T34ED8qQNk7xkOi1PUt+BAyUtLQUAAAAqQa5z8H5e4ZiCN0pql/QR59wvFjMw5K4SB4e3NTbq+MGDaopENLm4qOl0Wtn+Os45TafTmkyl1BSJ6PjBgyUtKS1nvnOa9X0F9CYCAACAct+DJ+fcw5IeLmIs2KStDA7vSiSKFNXG2hobdaK9XYPT0+ofH9fQ+fMySU5hU5ie1lYdLnFTmHJU7o10AAAAUDrrJnhm9qrC19uvuUqSc841FSUq5KzSB4fHPE9diYS6EgkFzmm+zMY6lJtKaaQDAACA0lg3wXPOXbZdgWBz1hsc7pxToHAIoVZcX46Dwz2zsomlHGUb6QSSWurqLrku20hHCvctdo+MUNoKAABQg3IfRIaytHJweHb/2tnFRZ33/aXjdkUi2r+su2aug8PLcVh6Lcq3kU4ynVbv2JhOtLdTrgkAAFBDSPAq3PLB4XVmem5uTulMshczW0rm5oJAp+fnFTXTjQ0NWnRuzcHh7PEqP9lGOitX7tYSj0Y1sbiowenpku6zBAAAwPbiVXoV6Nm/X7O+r1Nzc/IV7muLZpI7KSzfi5op5nnyJZ2am9Os7686OHx0dlZ3Dg/r2OnTGp2f175YTHvr6rQvFlva43Xn8HBJ5+jVoq000gEAAEDtIMGrAt/d1KRzi4vynVN0gzLKqJl853RucVHf1XRpj5xKGpZeS7KNdOJ57k9c3kgHAAAAtYEErwr8/cyM9sViipgpvcGL+bRziphpXyymL87MLF1eacPSa8l6jXTWs7yRDgAAAGoDCV4V6D97Vo3RqA42NCgiaTEIlHbuksHhaeeUCgJFJB1saFBjNHpJ+V4lDkuvFcsb6eQj10Y6AAAAqB688qtwy8v3GiMRte/apevr69XgeUo5p8UgUMo5NXierquvV/uuXWqMRF5Tvscer/KVbaSTXNYVNRdJ31+zkQ4AAACqE100K9zK8j3PTIlYTIlYbGkO3mrlfcvL9+o9r6KHpdeCnv37dez06bzO8Z1btZEOAAAAqhcreBVuvfI9M1NkWTfN5ZaX77HHq/wdaW5WIhZTMp3O6fhkOq1ENKrDzc3FDQwAAABlhQSvwhWifI89XuUv5nnqO3BAnrRhkpdMp+VJ6jtwgHmFAAAANYZXf1WgZ/9++Xmuoi0v32OPV2Voa2zU8YMH1RSJaHJxUdPp9CWNdKbTaU2mUmqKRHT84EG1NTaWOGIAAABsNxK8KlCI8r2tJonYHm2NjTrR3q4Hr79eBxsadC6V0rnFRZ1LpXSwoUEPXnedTrS3k9wBAADUKJqsVIFs+V73yIiS6fS6ow7WKt9bniTmMiqBPV6lE/M8dSUS6kokFDi31CiHlVQAAACwglcltlq+xx6vyuSZqTESIbkDAACAJFbwqkq2fG9welr94+MaOn9eJslJ6ti1Sz2trTrc3LxmUpZNEnvHxjS5uKiI5ykeicjM5JxT0vflO6dENKq+AwcoAwQAAADKjOXbObHUOjs73cmTJ0sdRkXYbPleKgg2nSQCAAAAKC4ze8o517nadazgVbFs+V6+2OMFAAAAVCYSPKxrs0kiAAAAgO1HnV0V8Z3TrO8rqLCyWwAAAACFwQpehUsFgQamp9V/9qyGZ2flSQoU7pc72tqqI+yXAwAAAGoGCV4FG52dVe/YmKZSKUU8T/tisaWOlyNzczp2+rQSsRgdLwEAAIAawdJOhRqdnVX3yIhmfF8tdXVqjkZlmSYoZqbmaFQtdXWa8X11j4xodHa2xBEDAAAAKDYSvAqUCgL1jo0pkBSPrr8IG49GFUjqHRtTKgi2JT4AAAAApUGCV4EGpqc1lUptmNxlxaNRTaZSGpyeLm5gAAAAAEqKBK8C9Z89q0iejVOinqf+8fEiRQQAAACgHJDgVZjAOQ3Pziqe52y6eCSiofPnGaEAAAAAVDESvAozHwTypKWGKrkyM1nmfAAAAADViQSvwtR7ngJJLs+VOOecXOZ8AAAAANWJV/sVxjNTe2Ojkr6f13lJ31fHrl3y8lz5AwAAAFA5SPAqUM/+/fLzLLX0nVNPa2uRIgIAAABQDkjwKtCR5mYlYjEl0+mcjk+m00pEozrc3FzcwAAAAACUFAleBYp5nvoOHJAnbZjkJdNpeZL6DhxQjP13AAAAQFXjFX+Famts1PGDB9UUiWhycVHT6fRS4xXnnKbTaU2mUmqKRHT84EG1NTaWOGIAAAAAxRYtdQDYvLbGRp1ob9fg9LT6x8c1dP68TJKT1LFrl3paW3W4uZmVOwAAAKBGkOBVuJjnqSuRUFciocA5zQeB6j2PbpkAAABADSLBqyKemRojkVKHAQAAAKBEqN0DAAAAgCpBggcAAAAAVYIEDwAAAACqBAkeAAAAAFQJEjwAAAAAqBIkeAAAAABQJUjwAAAAAKBKkOABAAAAQJUgwQMAAACAKkGCBwAAAABVggQPAAAAAKoECR4AAAAAVAkSPAAAAACoEiR4AAAAAFAlSPAAAMC28QNfs4uzClxQ6lAAoCpFSx0AAACobik/pYHnB9Q/1K/h8WF55ilwgTpaO3S046iOXH1EsUis1GECQFUgwQMAAEUzOjGq3kd7NTU/pYgX0b7GfTIzOec0MjGiY184pkR9Qn1396ltT1upwwWAikeJJgAAKIrRiVF1P9KtmQszamloUfPOZpmZJMnM1LyzWS0NLZq5MKPuR7o1OjFa4ogBoPKR4AEAgIJL+Sn1PtqrwAWK74yve2x8Z1yBC9T7aK9SfmqbIgSA6kSCBwAACm7g+QFNzU9tmNxlxXfGNTk/qcEXBoscGQBUNxI8AABQcP1D/Yp4kbzOiXpR9T/dX6SIAKA2kOABAICCClyg4fFhxXfktnqXFd8R19D4ECMUAGALSPAAAEBBzafm5Zm31FAlV2YmM9N8ar5IkQFA9SPBAwAABVUfq1fgAjnn8jrPOSfnnOpj9UWKDACqHwkeAAAoKM88tbe2K3khmdd5yQtJdbR2yDNengDAZvEXFAAAFFxPR4/8wM/rHD/w1XNrT5EiAoDaQIIHAAAK7sjVR5SoTyi5kNsqXnIhqUR9QoevOlzkyACgupHgAQCAgotFYuq7u0+eeRsmecmFpDzz1Hd3n2KR2DZFCADViQQPAAAURdueNh2/57iadjRpcm5S0wvTS41XnHOaXpjW5NykmnY06fg9x9W2p63EEQNA5YuWOgAAAFC92va06cT9JzT4wqD6n+7X0PiQzEzOOXW0dqjn1h4dvuowK3cAUCAkeAAAoKhikZi6ru1S17VdClyg+dS86mP1dMsEgCIgwQMAANvGM0+NdY2lDgMAqhZvnQEAAABAlSDBAwAAAIAqQYIHAAAAAFWiqAmemd1lZs+Z2Wkz++Aq1/+omX018/FFM2svZjwAAAAAUM2KluCZWUTSH0t6u6RDku41s0MrDvumpMPOuTdK+k1JHylWPAAAAABQ7Yq5gne7pNPOuW845xYlfUrSDy4/wDn3RefcK5lP/6+kK4oYDwAAAABUtWImeJdL+tayz89kLlvLj0v6/GpXmNkDZnbSzE6+/PLLBQwRAAAAAKpHMRM8W+Uyt+qBZt+vMMH7xdWud859xDnX6Zzr3Lt3bwFDBAAAAIDqUcxB52ckvWHZ51dIemnlQWb2RkkflfR259xkEeMBAAAAgKpWzBW8JyXdYGbXmFmdpPdJ+uzyA8zsSkmPSLrfOTdWxFgAAAAAoOoVbQXPOZc2s5+W9LikiKR+59yzZtabub5P0q9JapH0J2YmSWnnXGexYgIAAACAambOrbotrmx1dna6kydPljoMAAAAACgJM3tqrYWxog46BwAAAABsHxI8AAAAAKgSJHgAAAAAUCVI8AAAAACgSpDgAQAAAECVIMEDAAAAgCpBggcAAAAAVYIEDwCKxA98zS7OKnBBqUMBAAA1IlrqAACgmqT8lAaeH1D/UL+Gx4flmafABepo7dDRjqM6cvURxSKxUocJAACqFAkeABTI6MSoeh/t1dT8lCJeRPsa98nM5JzTyMSIjn3hmBL1CfXd3ae2PW2lDhcAAFQhSjQBoABGJ0bV/Ui3Zi7MqKWhRc07m2VmkiQzU/POZrU0tGjmwoy6H+nW6MRoiSMGAADViAQPALYo5afU+2ivAhcovjO+7rHxnXEFLlDvo71K+altihAAANQKEjwA2KKB5wc0NT+1YXKXFd8Z1+T8pAZfGCxyZAAAoNaQ4AHAFvUP9SviRfI6J+pF1f90f5EiAgAAtYoEDwC2IHCBhseHFd+R2+pdVnxHXEPjQ4xQAAAABUWCBwBbMJ+al2feUkOVXJmZzEzzqfkiRQYAAGoRCR4AbEF9rF6BC+Scy+s855ycc6qP1RcpMgAAUItI8ABgCzzz1N7aruSFZF7nJS8k1dHaIc/4MwwAAAqHVxYAsEU9HT3yAz+vc/zAV8+tPUWKCAAA1CoSPADYoiNXH1GiPqHkQm6reMmFpBL1CR2+6nCRIwMAALWGBA8AtigWianv7j555m2Y5CUXkvLMU9/dfYpFYtsUIQCszQ98zS7O0tUXqBLRUgcAANWgbU+bjt9zXL2P9mpyblIRL6L4jrjMTM45JS8k5Qe+EvUJ9d3dp7Y9baUOGUANS/kpDTw/oP6hfg2PD8szT4EL1NHaoaMdR3Xk6iO8CQVUKMu381updXZ2upMnT5Y6DABYVcpPafCFQfU/3a+h8aGlBK+jtUM9t/bo8FWHedEEoKRGJ0bV+2ivpuaneDMKqFBm9pRzrnPV60jwAKA4AhdoPjWv+lg93TIBlIXRiVF1P9KtwAWK74yveVy2nPz4PcdJ8oAytF6CxysOACgSzzw11jWS3AEoCyk/pd5HezdM7iQpvjOuwAXqfbRXKT+1TRECKARedQAAANSAgecHNDU/tWFylxXfGdfk/KQGXxgscmQACokEDwAAVCW6Q16qf6hfES+S1zlRL6r+p/uLFBGAYqCLJgAAqBp0h1xd4AINjw9rX+O+vM6L74hraHxIgQsoNwcqBAkeAACoCiu7Q+5r3LfUHXJkYkTHvnCsZrtDzqfm5ZknM8vrPDOTmWk+Na/GusYiRQegkHgrBgAAVLxsd8iZCzNqaWhR887mpWTGzNS8s1ktDS2auTCj7ke6NToxWuKIt1d9rF6BC5Rv93TnnJxzqo/VFykyAIVGggcAACoa3SE35pmn9tZ2JS8k8zoveSGpjtYOyjOBCsJvKwAAqGh0h8xNT0eP/MDP6xw/8NVza0+RIgJQDCR4AACgotEdMjdHrj6iRH1CyYXcVvGSC0kl6hM6fNXhIkcGoJBI8AAAQMXKdoeM78ht9S5reXfIWhGLxNR3d5888zZM8pILSXnmqe/uvprsOgpUMhI8AABQsQrRHbKWtO1p0/F7jqtpR5Mm5yY1vTC91HjFOafphWlNzk2qaUeTjt9zvOa6jQLVgDEJAACgYi3vDplPklfL3SHb9rTpxP0nNPjCoPqf7tfQ+NDSOImO1g713Nqjw1cdZuUOqFAkeAAAoGJlu0OOToyqeWdzzufVenfIWCSmrmu71HVtlwIXaD41r/pYfc3eH0A14bcYAABUNLpDbo1nnhrrGoue3PmBr9nF2Zra9wiUAit4AACgoi3vDpnLqAS6Q26flJ/SwPMD6h/q1/D4sDzzFLhAHa0dOtpxVEeuPkIpKFBglt1YWyk6OzvdyZMnSx0GAAAoI6MTo+p+pHvDYefZ7pA0ECm+0YlR9T7aq6n5KUW8iOI74kt7/ZIXkvIDX4n6hPru7uOxAPJkZk855zpXu44STQAAUPHoDllesgn3zIUZtTS0qHln81ITHDNT885mtTS0aObCjLof6dboxGiJIwaqByt4AACgaqT8FN0hSyzlp3Tnx+/UzIWZnEtmm3Y06cT9J3hsgBytt4LHHjwAAFA16A5ZegPPD2hqfkotDS05HR/fGdfE3IQGXxhU17VdRY4OqH78tQMAlCU67mGrtqs7JC7VP9SviBfJ65yoF1X/0/1FigioLazgAQDKBh33gMoWuEDD48Pa17gvr/PiO+IaGh9S4AIScmCLSPAAAGVhZce9fY37lvZPjUyM6NgXjtFxDyhz86l5eeYtNVTJlZnJzDSfmldjXWORogNqA2+RAABKjo57QHWoj9UrcIHybeLnnJNzTvWx+iJFBtQOEjwAQEml/JR6H+3dcH6ZFDZjCFyg3kd7lfJT2xQhgFx55qm9tV3JC8m8zkteSKqjtYPyTKAA+C0CAJRUtuNeLu3UpTDJm5yf1OALg0WODMBm9HT0yA/8vM7xA189t/YUKSKgtpDgAQBKio57QHU5cvURJeoTSi7ktoqXXEgqUZ/Q4asOFzkyoDaQ4AEASibbcS++I7fVu6zlHfcAlJdYJKa+u/vkmbdhkpdcSMozT31399EhFygQEjwAQMkUouMegPLTtqdNx+85rqYdTZqcm9T0wvRS4xXnnKYXpjU5N6mmHU06fs9xOuMCBcSYBABAySzvuJdPkkfHPaD8te1p04n7T2jwhUH1P92vofGhpdEnHa0d6rm1R4evOszKHVBgJHgAgJLJdtwbnRhV887mnM+j4x5QGWKRmLqu7VLXtV0KXKD51LzqY/X87gJFxG8XAKCk6LgH1AbPPDXWNZLcAUXGbxgAoKTouAcAQOGQ4AEASoqOewAAFA4JHgCg5Oi4BwBAYdBkBQBQFui4BwDA1pHgAQDKBh33AADYGhI8AEBZynbcAwAAueMtUQAAAEDhCJbZxVkFLih1KMCmsYIHAACAmpXyUxp4fkD9Q/0aHh+WZ54CF6ijtUNHO47qyNVH2PuLikKCBwAAgJo0OjGq3kd7NTU/pYgX0b7GfUvNnUYmRnTsC8eUqE+o7+4+uveiYlCiCQAAUKYoGSye0YlRdT/SrZkLM2ppaFHzzmaZmSTJzNS8s1ktDS2auTCj7ke6NToxWuKIgdywggcAAFBGKBksvpSfUu+jvQpcoPjO+LrHxnfGlVxIqvfRXp24/wT3PcoeCR4AAECZoGRweww8P6Cp+Sm1NLTkdHx8Z1wTcxMafGFQXdd2FTk6YGso0QQAACgDlAxun/6hfkW8SF7nRL2o+p/uL1JEQOGQ4AEAAJRYviWDgQvU+2ivUn5qmyKsHoELNDw+rPiO9e/nleI74hoaH2I/JMoeCR4AAECJZUsGN0rusuI745qcn9TgC4NFjqz6zKfm5Zm3tDqaKzOTmWk+NV+kyIDCIMEDAAAoMUoGt099rF6BC+Scy+s855ycc6qP1RcpMqAwSPAAAABKiJLB7eWZp/bWdiUvJPM6L3khqY7WDnnGy2eUN35CAQAASoiSwe3X09EjP/DzOscPfPXc2lOkiIDCIcEDAAAoIUoGt9+Rq48oUZ9QciG3VbzkQlKJ+oQOX3W4yJEBW0eCBwAAUELFLhn0A1+zi7OUci4Ti8TUd3efPPM2TPKSC0l55qnv7j6GnKMikOABAACUWKFLBlN+Sie+fkL3Pnyvbvmvt+iOj96hm//kZt338H068fUTjFeQ1LanTcfvOa6mHU2anJvU9ML00iqqc07TC9OanJtU044mHb/nOIPlUTEs33KAUuvs7HQnT54sdRgAAAAFk/JTuvPjd2rmwkxOoxKSC0k17WjSiftPvGZVaXRiVL2P9mpqfkoRL6L4jrjMTM45JS8k5Qe+EvUJ9d3dR9Ki8L4ffGFQ/U/3a2h8aOm+6mjtUM+tPTp81WFW7lB2zOwp51znqteR4AEAAJTe6MSouh/p3nDYebZkcLVVpULcRi0LXKD51LzqY/V0y0RZWy/BK+pPrpndZWbPmdlpM/vgKte3mdk/mNkFM/u3xYwFAACUDvvAVrf8ftlqyWDKT6n30d4NkzspHJQeuEC9j/ZSrrmMZ54a6xpJ7lDRosW6YTOLSPpjSXdKOiPpSTP7rHPu1LLDpiT9a0k/VKw4AABAaaT8lAaeH1D/UL+Gx4flmafABepo7dDRjqM6cvWRmix92+h++dx9n9MXz3wx75LBgecHNDU/pZaGlpziiO+Ma2JuQoMvDKrr2q5Cf5tAxfMDXwvphYpb0S1aiaaZfaek33DOvS3z+S9JknPuP61y7G9IOu+c+92NbpcSTQDYvEp9skLlYR/Y6vK9X/IpGbz34Xs1OjGq5p3NOcczvTCtg3sO6hPv/sQWvzOgOlTKG1PrlWgWbQVP0uWSvrXs8zOS7tjMDZnZA5IekKQrr7xy65EBQA2plCcrVI/l+8BWriaZ2VICklxIqvuR7prZB7bZ+6WxrnHD2w5coOHxYe1r3JdXTPEdcQ2NDylwAW/6oOatfANmX+O+pTdgRiZGdOwLxyrijali/ibbKpdtarnQOfcR51ync65z7969WwwLAGrH6MSo7vz4nTr2hWManRjVvsZ92tu4V/sa9y09Wd358Ts1OjFa6lBRJdgHtrpi3y/zqXl55slstZdfazMzmZnmU/N5nQdUm+wbMDMXZtTS0KLmnc1Lv0/ZN2BaGlo0c2FG3Y90l/XzZjETvDOS3rDs8yskvVTErwcAWKaanqxQObL7wLJJjHMunO+2xlu88Z1xTc5PavCFwW2McvutvF82ku/9Uh+rV+AC5bv1xjkn55zqY/V5nQdUk2p7Y6qYCd6Tkm4ws2vMrE7S+yR9tohfDwCQUW1PVqgc/UP9ilhEr8y/olMvn9KTLz2pp84+pS+/9GWdevmUXpl/5TVJSNSLqv/p/hJFvD36h/oV8SJ5nZPP/eKZp/bWdiUXkusm1CslLyTV0dpBeSZqWrHfgNluRduD55xLm9lPS3pcUkRSv3PuWTPrzVzfZ2atkk5KapIUmNkHJB1yzs0UKy4AqAV000MpBC7Ql1/8siZmJ+Q7X2ammBdb2sMyl5rT6anTinpR3bjnRjXEGiRV/z6wYu+Py+6zHT8/rlMTpxT1wpd3u+p2af+u/Zes3q/kB756bu3JKy6g2mzlDZhyfM4sZpMVOec+J+lzKy7rW/b/cYWlmwCAAqq2JytUhqHxIb306kuKetHXNO4xM0UtfNmRDtI69fIpHdp7SA2xhkv2geXSUKTSFGJ/3Fr3y/KmEJ55qo/Wy3e+IhZZM6HOSi4klahP6PBVhzf9vQGVrhobFJVXNACALcs+WcV35FZqkrX8yQrIV8pP6Wcf+1k55xSx9d9cyK4wPTfx3NIesGreB5bdHxcEgfzAz3mf3Eb3y8p9trvrd+tAywFJku/8pUTbd75OvXxKc6m5pXOTC0l55qnv7j666KKmVWODoqKu4AEAtl8xVwuAtQw8P6BXFl5R044mzafnl1br1hL1okr5KU0vTMvMqnYfWLZ8cjY1q2+8+I1wZd2F5ZOtl7WqeWfzmt/3evvj1tpn21jXqIN7DmpsckyL/qI88xSxiHzna/TlUV2z+xoFLlCiPqE//oE/1hua3lCWKxDAdlneoCif581yfmOKBA8Aqkw1Plmh/GXLgvdftl+np07ndI6Z6ez5s3pd4+uqch/Y8vLJmBdTxCKqi9SF+xHTYflkzIvpQMuBVd9UWW9/3Hr7bBvrGtXe2q7phWmNvzqu84vnJZNSQUrNO5v19uvfrq+c/Yre+9/fy1xM1Lxsg6LRidGlWZS5KOcGRSR4AFBlqvHJCuVt+R4WJ6eYF1M6SC+VYq4lYhElF5Jq29NWdfvAVg41T7iEJuYmlu6X5fsRRyZGdHDPwUuSvI32x220z9YzT4n6hBL1CTnnFLhA52bPaeTlkYof4gwUWk9Hj4594Vhe55RzgyKexQGgCvV09ISt0vNQzk9WKG/Ly4I985b2gaWD9LrnZTtt/pe3/ZeqWjVarXzSzHTjnhslXXq/ZJPgscmxpf2vG+2Py3efrZlpIb2gF199UckLSbXUMxcTWO7I1UeUqE8ouZDM6fhyb1BEggcAVajanqxQ3lYO2c7uA4tYRIv+otJBeuk655zSQVopP6WIRfT6Xa9XR2tHCaMvvLVmajXEGnRo7yFFLKKUn1q6X6JeVKkgpRdnXtTk3KSadjTp+D3H11xFy3efbeACjU2OSZIiXrgfby3MxUQtikVi6ru7T555Gz5vVkKDIhI8AKhC1fZkhfK2NGT7wsWftew+sOsT16sh2qCUn9Kiv6iUn1JDtEHXJa7T1c1X644r7qi6suD1yicbYg3qaO0I75dYg1JBeL/4ga90kNaDb3tQJ+4/sW6J5MqEeiPTC9NKBaml7qYbdTkt9yHOQDG07WnT8XuOq2lHkybnJjW9MH3JG1PTC9M5vQFTDtiDBwBVKvtk1ftorybnJhXxIorviC/tuUleSMoPfPbcoCBW28Oy2j6w5StPk3OTVVcWnMtMLTPT7vrd2l2/W3JhqaonT+fmzukt17xlw4Q33322Z189K888+c7XrrpdUg4Lf8zFRC1q29OmE/ef0OALg+p/ul9D40NLz5kdrR3qubVHh686XPZvhpLgAUAVq5YnK5S/5WXBK0sTpTCpWb5yVK1lwXmPKbGLK2r5jCnJtSmEc06zi7OKRcLGN/t37c8prHIe4gwUUywSU9e1Xeq6tkuBCzSfmld9rL6ifg9I8ACgylXDkxXKX7YsuPuR7jWTvKxqLgverjElGyXUWYELJLs4+DzXzrrMxQTC1fJK/Pnn2R0Aakj2yYrkDsVQTXtYNmu1/Yi5yHdMSa77bD3z5Ae+nHO6cc+NOSedzMUEKhfP8AAAoGCyZcEPvu1BHdxzUOdmzy19HNxzMKcmIpVuu8aU5JJQT81PqWlHk66MX6mGWEPOt81czNz5ga/ZxdmlMRdAqVGiCQAACqrWy4JzLZ/M2sp+xFz22ab8lH7xb38xr9tlLub6Un5KA88PqH+oX8Pjw/LMU+ACdbR26GjHUR25+kjJyo/9wNdCeqGmfudwKcu1xW656OzsdCdPnix1GAAAAGsanRhV9yPdlww7X012P2KhSlZXS6hTfkp3fvxOzVyYyTnhbNrRpBP3n6i6PZKFMDoxqt5HezU1P1U23YnLOeFEcZjZU865zlWvI8EDAAB4ra2uhJRTIlCqhLPalOP9WE4/Z9g+JHgAAAA5KPRKSMpPlc2YEhKBrSnHldByTDixPUjwAAAANlDsBKgc9iOWU8JZaU58/YSOfeGYWhpacj5nYm5C/+Vt/6UoA+PLMeHE9lkvwaPJCgAAqHnLV0JWvoA3s6X5ccmFpLof6d7USkg5zNSq9QY4W9E/1K+IF8nrnKgXVf/T/UVJ8AaeH9DU/FTOCWd8Z1wTcxMafGGwKPGgfPDbDAAAalrKT6n30d4Ny9yk8EVy4AL1PtqrlJ/apgiLg7mYuQtcoOHxYcV3bLxStlx8R1xD40NFGaGwlYQT1Y3faAAAUNOyKyG5lLlJYZI3OT+pwRcGixwZysV8al6eeTkPis8yM5mZ5lPzBY2nHBNOlA8SPAAAUNNYCcFG6mP1ClygfHtXOOfknFN9rL6g8ZRbwonyQoIHAABqFishyIVnntpb25W8kMzrvOSFpDpaOwpeBltuCSfKCwkeAACoWayEIFc9HT3yAz+vc/zAV8+tPQWPpdwSTpQXHl0AAFCzWAlBro5cfUSJ+oSSC7klVcmFpBL1CR2+6nBR4imnhBPlhQQPAADULFZCkKtYJKa+u/vkmbdhkpcdLN53d1/RZs6VW8KJ8sFfJQAAUNNYCUGu2va06fg9x9W0o0mTc5OaXpheWv11zml6YVqTc5Nq2tG0qVmJ+Si3hBPlw/ItSSi1zs5Od/LkyVKHAQAAqkTKT+nOj9+pmQszOY1KSC4k1bSjSSfuP8GL5RqV8lMafGFQ/U/3a2h8SGYm55w6WjvUc2uPDl91eNt+NkYnRtX7aK+m5qcU8SKK74gvxZO8kJQf+ErUJ9R3d19RE05sLzN7yjnXuep1JHgAAKDWjU6MqvuR7g2HnWdXQoq9OoPKEbhA86l51cfqS1ayW04JJ7YHCR4AAMAGWAlBNSiHhBPFt16CF93uYAAAAMpR2542nbj/BCshqGieeWqsayx1GCghEjwAAICMWCSmrmu71HVtFyshACoSCR4AAMAqWAkBUIl4OwoAAAAAqgQJHgAAAABUCRI8AAAAAKgSJHgAAAAAUCVI8AAAAACgSpDgAQAAAECVIMEDAAAAgCpBggcAAAAAVYIEDwAAAACqBAkeAAAAAFQJEjwAAAAAqBIkeAAAAABQJUjwAAAAAKBKkOABAAAAQJUgwQMAAACAKmHOuVLHkBcze1nSC6WOo8bskTRR6iAgiceinPBYlAceh/LBY1E+eCzKB49FeajGx+Eq59ze1a6ouAQP28/MTjrnOksdB3gsygmPRXngcSgfPBblg8eifPBYlIdaexwo0QQAAACAKkGCBwAAAABVggQPufhIqQPAEh6L8sFjUR54HMoHj0X54LEoHzwW5aGmHgf24AEAAABAlWAFDwAAAACqBAkeAAAAAFQJErwaZmZ3mdlzZnbazD64yvU/aGZfNbMhMztpZt+z7Lrnzexr2eu2N/Lqs9Fjsey4N5mZb2bvyfdc5GaLjwW/FwWUw9+oI2aWzNzfQ2b2a7mei/xs8bHg96JAcvm5zjwWQ2b2rJkN5nMucrfFx4LfiQLK4e/Tzy/72/RM5rk7kcu5Fcs5x0cNfkiKSPq6pGsl1UkalnRoxTG7dHGf5hsljS677nlJe0r9fVTDRy6PxbLj/rekz0l6Tz7n8lH8xyJzOb8X2/hYSDoi6dHNPo58FP+xyFzH78X2PQ7Nkk5JujLz+b5cz+Vjex6LzP/5ndjGx2LF8e+Q9L83c24lfbCCV7tul3TaOfcN59yipE9J+sHlBzjnzrvMb4CkRkl05CmODR+LjJ+R9LCkc5s4F7nZymOBwtrKzza/F4XF/Vkecnkc7pP0iHPunyTJOXcuj3ORu608FiisfH+275X0yU2eWzFI8GrX5ZK+tezzM5nLLmFm7zKzUUn/U1LPsqucpC+Y2VNm9kBRI61+Gz4WZna5pHdJ6sv3XORlK4+FxO9FIeX6s/2dZjZsZp83s5vyPBe52cpjIfF7USi5PA4HJO02s4HM/f3+PM5F7rbyWEj8ThRSzj/bZtYg6S6Fb9DmdW6liZY6AJSMrXLZa1bonHN/Lemvzez7JP2mpK7MVd/tnHvJzPZJOmFmo865J4oXblXL5bH4fUm/6JzzzS45PKfHETnbymMh8XtRSLk8Fl+RdJVz7ryZ/YCk/yHphhzPRe628lhI/F4USi6PQ1TSbZL+maR6Sf9gZv83x3ORu00/Fs65MfE7UUj5/Gy/Q9LfO+emNnFuRWEFr3adkfSGZZ9fIemltQ7O/OG5zsz2ZD5/KfPvOUl/rXCZG5uTy2PRKelTZva8pPdI+hMz+6Ecz0XutvJY8HtRWBs+Fs65Gefc+cz/Pycplvkbxe9FYW3lseD3onBy+bk+I+kx59ysc25C0hOS2nM8F7nbymPB70Rh5fOz/T5dLM/M99yKQoJXu56UdIOZXWNmdQp/6D+7/AAzu94ySxRm9h0KN6BOmlmjmV2WubxR0lslPbOt0VeXDR8L59w1zrmrnXNXS/q0pJ9yzv2PXM5FXjb9WPB7UXC5/I1qXfY36naFz2mTuZyLvGz6seD3oqBy+bn+jKTvNbNophztDkkjOZ6L3G36seB3ouBy+tk2s7ikwwofl7zOrUSUaNYo51zazH5a0uMKuwj1O+eeNbPezPV9kt4t6f1mlpI0L+lHnHPOzF6nsGxTCn+GPuGce6wk30gVyPGxyOvc7Yi7Gm3lsZDE70UB5fhYvEfST5pZWuHfqPdlGkPxe1FAW3kseL4onFweB+fciJk9JumrkgJJH3XOPSNJ/E4UzlYeCzO7VvxOFEwez9vvkvQF59zsRudu73dQHNkW+AAAAACACkeJJgAAAABUCRI8AAAAAKgSJHgAAAAAUCVI8AAAAACgSpDgAQAAAECVIMEDAAAAgCpBggcANcjMzpfDbWzHbebwNT+QGUSc73kfM7P3FCOmFV9ns/F9cY3LtyVuAEBpkOABAGrdByStmkCZWWR7Q1nVB7SJ+Jxz31WsgAAA5YsEDwBqmIV+x8yeMbOvmdmPZC7/EzN7Z+b/f21m/Zn//7iZ/YdVbufnzexJM/uqmf27zGUfMrOfWnbMb5jZsbWOXyfGSGbVKRvjz2YuHzCz3zezL2auuz1zeaOZ9Wdu/2kz+8Flt/O7mdv4qpn9jJn9a0mvl/R3ZvZ3mePOm9m/N7MvSfpOM/u1zG09Y2YfMTPL8b59Uya2YTP7spldlonhd5Z97/8yc+yRzPfzaTMbNbO/zDw2ucT3c5nYnjGzDyz7+ueXPcZ/ZGanzOx/Stq3RrwfM7P/amZ/Z2bfMLPDmftxxMw+tuy4t5rZP5jZV8zsv5vZrszlq95Pme/rQ5n7YMzMvjeX+w8AsDkkeABQ2+6R1CGpXVKXpN8xs/2SnpCUfSF+uaRDmf9/j6T/s/wGzOytkm6QdHvmtm4zs++T9ClJP7Ls0B+W9N/XOX4tHZIud87d7Jy7RdKfL7uuMbNS9VOS+jOX/bKk/+2ce5Ok7898T42SHpB0jaRbnXNvlPSXzrkPS3pJ0vc7574/e5uSnnHO3eGc+/8k/ZFz7k3OuZsl1Uu6e51Ys/dJnaT/JunfOOey9+28pB+XlMzE9iZJ/8LMrsmcdqvC1bpDkq6V9N0bxZe5zaOS7pD05szt3boinHdJulHSLZL+haT1VvZ2S3qLpJ+V9DeS/oukmyTdYmYdZrZH0q9I6nLOfYekk5J+LnPuevdT1Dl3e+b7+/X17jsAwNaQ4AFAbfseSZ90zvnOuW9LGlSYePwfSd9rZocknZL07Uzi952SVu7temvm42lJX5HUJukG59zTkvaZ2evNrF3SK865f1rr+HVi/Iaka83sD83sLkkzy677pCQ5556Q1GRmzZnb/qCZDUkakLRT0pUKk6w+51w6c87UGl/Pl/Twss+/38y+ZGZfU5j83LROrFk3SjrrnHsy87VmMl/3rZLen4ntS5Jaln3vX3bOnXHOBZKGJF2dQ3zfI+mvnXOzzrnzkh7RxcQ86/t08TF+SdL/Xifuv3HOOUlfk/Rt59zXMvE8m4nnzQoT0L/PfA//XNJVmXPXu58eyfz71DrfFwCgAKKlDgAAUFKrlhs65140s92S7lK4mpdQuAJ33jn36iq38Z+ccw+tclOflvQeSa0KV/Q2On61WF7JJIhvk/SvMnH0ZK9eeXjm9t/tnHvukiDDksGVx69mwTnnZ87ZKelPJHU6575lZr+hMGHcyFpfyyT9jHPu8RWxHZF0YdlFvtZ+jl6KT2s8fqvI5fvWshiCFfEEmXh8SSecc/cuPymH+yl7W+t9XwCAAmAFDwBq2xOSfiSzN2yvwtWeL2eu+weFJXVPKFzR+7daUZ6Z8biknmV7sS43s+w+r09Jep/CJO/TORz/GpmyQM8597CkX5X0Hcuuzu4Z/B6FpY/JzO3/zLI9YNmSxS9I6jWzaObyRObyVyVdtsaXzyYpE5l4c+0+OSrp9Wb2pszXuizzdR+X9JNmFstcfiBTPrqe9eJ7QtIPmVlD5nbepdc+Rk9Iel/mMd6vsGx1s/6vpO82s+slKfN1D2jz9xMAoMB4Fw0AattfKyy7HFa4yvMLzrnxzHX/R9JbnXOnzewFhat4r0nwnHNfMLODkv4hk1Odl9Qt6Zxz7lkzu0zSi865sxsdv/x2zWzIOdehcA/gn5tZ9k3JX1p22CsWjgNo0sVVvd+U9PuSvppJ8p5XuB/so5IOZC5PSfpTSX8k6SOSPm9mZ5ftc8t+b9Nm9qcKSxafl/Tk+nfn0nmLFjas+UMzq1e4V64rE8PVkr6Sie1lST+0wc2tF99XMg1Qskn5RzOlscv9tcKSya9JGlNYhitJMrN/L+mkc+6zOX5fL5vZj0n6pJntyFz8K865sc3cTwCAwrOw1B4AgMpiZgOS/q1z7mSpYwEAoFxQogkAAAAAVYIVPAAAtsDM/lrh+IXlfnFlIxUAALYDCR4AAAAAVAlKNAEAAACgSpDgAQAAAECVIMEDAAAAgCpBggcAAAAAVeL/DwCZswkYbZ6bAAAAAElFTkSuQmCC\n",
      "text/plain": [
       "<Figure size 1080x720 with 1 Axes>"
      ]
     },
     "metadata": {
      "needs_background": "light"
     },
     "output_type": "display_data"
    }
   ],
   "source": [
    "# code to select the descriptors to plot\n",
    "inputDir = \"testDownload/\"\n",
    "\n",
    "### this is the main line to modify, select two descriptors, change the XX by a number from 0 to 16\n",
    "\n",
    "descInput = (0,11)\n",
    "\n",
    "\n",
    "# no need to change the code from here\n",
    "anotOn = 0\n",
    "dataDetails = fetchDataDetails(inputDir)\n",
    "colors = ['r', 'g', 'c', 'b', 'k', 'm', 'y']\n",
    "\n",
    "plt.figure(figsize=(15, 10))\n",
    "\n",
    "legArray = []\n",
    "catArray = []\n",
    "for ii, category in enumerate(dataDetails.keys()):\n",
    "    catArray.append(category)\n",
    "    for soundId in dataDetails[category].keys():\n",
    "        filepath = os.path.join(inputDir, category, soundId, dataDetails[category][soundId]['file'])\n",
    "        descSound = convFtrDict2List(json.load(open(filepath, 'r')))\n",
    "        x_cord = descSound[descInput[0]]\n",
    "        y_cord = descSound[descInput[1]]\n",
    "        plt.scatter(x_cord, y_cord, c = colors[ii], s=200, alpha=0.75)\n",
    "        if anotOn==1:\n",
    "            plt.annotate(soundId, xy=(x_cord, y_cord), xytext=(x_cord, y_cord))\n",
    "    circ = Line2D([0], [0], linestyle=\"none\", marker=\"o\", alpha=0.75, markersize=10, markerfacecolor=colors[ii])\n",
    "    legArray.append(circ)\n",
    "  \n",
    "plt.ylabel(descriptorMapping[descInput[1]])\n",
    "plt.xlabel(descriptorMapping[descInput[0]])\n",
    "plt.legend(legArray,catArray,numpoints=1,bbox_to_anchor=(0.,1.02,1.,.102),loc=3,ncol=len(catArray),mode=\"expand\",borderaxespad=0.)\n"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Part 3: Cluster sounds using k-means\n",
    "\n",
    "After visualizing the sound descriptors, you will now cluster the sounds using more than two descriptors. You can use as many descriptors as you need for the best clustering. Use the same set of sounds obtain in Task 1, starting from the descriptors that you found were good in Part 2, and then adding other descriptors that you feel can improve the kmeans clustering of sounds. The function `cluster_sounds()` takes the sounds folder (targetDir), number of clusters (nCluster) and the descriptor indices (descInput) as input. It then performs a kmeans clustering using the selected descriptors. Make sure that in targetDir you only have the 3 instruments chosen.\n",
    "\n",
    "For this part, you can use as many descriptors as you need to achieve good clustering and classification performance. However it is best to use as few descriptors as possible in order to make it easier to explain the contribution of each descriptor. Choose the number of clusters to be the same as the number of instruments (i.e., 3). Ideally in such a case, all the sounds of an instrument should go into a single cluster. In reality however, there might be sounds that are outliers and can go into a different cluster. The algorithm takes a majority vote on the sounds in each of the three clusters and assigns each cluster to an instrument. We compute the performance of the clustering by checking the number of points (sounds), that have been wrongly assigned to a cluster. The function clusterSounds() prints the clusters and the sounds assigned to each one. The function also prints the resulting classification obtained with the choice of descriptors you made.\n",
    "\n",
    "Write a short paragraph explaining the descriptors you used, the resulting classification accuracy you obtained, and your observations on why you obtained (or not) those errors in clustering. Comment if you see any systematic errors (such as a consistent mix up of sounds from two instruments) and possible reasons for that. You should also try to cluster with different subsets of descriptors and mention the classification accuracy you obtain in each case.\n",
    "\n",
    "Note: Since the cluster centers are randomly initialized every time in k-means, you might see different results every time you run the function. You can report the best result you obtained."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 6,
   "metadata": {},
   "outputs": [],
   "source": [
    "def cluster_sounds(targetDir, nCluster = -1, descInput=[]):\n",
    "  \"\"\"\n",
    "  This function clusters all the sounds in targetDir using kmeans clustering.\n",
    "  \n",
    "  Input:\n",
    "    targetDir (string): Directory where sound descriptors are stored (all the sounds in this \n",
    "                        directory will be used for clustering)\n",
    "    nCluster (int): Number of clusters to be used for kmeans clustering.\n",
    "    descInput (list) : List of indices of the descriptors to be used for similarity/distance \n",
    "                       computation (see descriptorMapping)\n",
    "  Output:\n",
    "    Prints the class of each cluster (computed by a majority vote), number of sounds in each \n",
    "    cluster and information (sound-id, sound-class and classification decision) of the sounds \n",
    "    in each cluster. Optionally, you can uncomment the return statement to return the same data.\n",
    "  \"\"\"\n",
    "  \n",
    "  dataDetails = fetchDataDetails(targetDir)\n",
    "  \n",
    "  ftrArr = []\n",
    "  infoArr = []\n",
    "  \n",
    "  if nCluster ==-1:\n",
    "    nCluster = len(dataDetails.keys())\n",
    "  for cname in dataDetails.keys():\n",
    "    #iterating over sounds\n",
    "    for sname in dataDetails[cname].keys():\n",
    "      ftrArr.append(convFtrDict2List(dataDetails[cname][sname]['feature'])[descInput])\n",
    "      infoArr.append([sname, cname])\n",
    "  \n",
    "  ftrArr = np.array(ftrArr)\n",
    "  infoArr = np.array(infoArr)\n",
    "  \n",
    "  ftrArrWhite = whiten(ftrArr)\n",
    "  centroids, distortion = kmeans(ftrArrWhite, nCluster)\n",
    "  clusResults = -1*np.ones(ftrArrWhite.shape[0])\n",
    "  \n",
    "  for ii in range(ftrArrWhite.shape[0]):\n",
    "    diff = centroids - ftrArrWhite[ii,:]\n",
    "    diff = np.sum(np.power(diff,2), axis = 1)\n",
    "    indMin = np.argmin(diff)\n",
    "    clusResults[ii] = indMin\n",
    "  \n",
    "  ClusterOut = []\n",
    "  classCluster = []\n",
    "  globalDecisions = []  \n",
    "  for ii in range(nCluster):\n",
    "    ind = np.where(clusResults==ii)[0]\n",
    "    freqCnt = []\n",
    "    for elem in infoArr[ind,1]:\n",
    "      freqCnt.append(infoArr[ind,1].tolist().count(elem))\n",
    "    indMax = np.argmax(freqCnt)\n",
    "    classCluster.append(infoArr[ind,1][indMax])\n",
    "    \n",
    "    print(\"\\n(Cluster: \" + str(ii) + \") Using majority voting as a criterion this cluster belongs to \" + \n",
    "          \"class: \" + classCluster[-1])\n",
    "    print (\"Number of sounds in this cluster are: \" + str(len(ind)))\n",
    "    decisions = []\n",
    "    for jj in ind:\n",
    "        if infoArr[jj,1] == classCluster[-1]:\n",
    "            decisions.append(1)\n",
    "        else:\n",
    "            decisions.append(0)\n",
    "    globalDecisions.extend(decisions)\n",
    "    print (\"sound-id, sound-class, classification decision\")\n",
    "    ClusterOut.append(np.hstack((infoArr[ind],np.array([decisions]).T)))\n",
    "    print (ClusterOut[-1])\n",
    "  globalDecisions = np.array(globalDecisions)\n",
    "  totalSounds = len(globalDecisions)\n",
    "  nIncorrectClassified = len(np.where(globalDecisions==0)[0])\n",
    "  print(\"Out of %d sounds, %d sounds are incorrectly classified considering that one cluster should \"\n",
    "        \"ideally contain sounds from only a single class\"%(totalSounds, nIncorrectClassified))\n",
    "  print(\"You obtain a classification (based on obtained clusters and majority voting) accuracy \"\n",
    "         \"of %.2f percentage\"%round(float(100.0*float(totalSounds-nIncorrectClassified)/totalSounds),2))\n",
    "  # return ClusterOut"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 10,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "\n",
      "(Cluster: 0) Using majority voting as a criterion this cluster belongs to class: violin\n",
      "Number of sounds in this cluster are: 20\n",
      "sound-id, sound-class, classification decision\n",
      "[['355791' 'violin' '1']\n",
      " ['355828' 'violin' '1']\n",
      " ['355826' 'violin' '1']\n",
      " ['355821' 'violin' '1']\n",
      " ['355820' 'violin' '1']\n",
      " ['355827' 'violin' '1']\n",
      " ['355829' 'violin' '1']\n",
      " ['355777' 'violin' '1']\n",
      " ['355813' 'violin' '1']\n",
      " ['355814' 'violin' '1']\n",
      " ['355822' 'violin' '1']\n",
      " ['355825' 'violin' '1']\n",
      " ['355824' 'violin' '1']\n",
      " ['355823' 'violin' '1']\n",
      " ['355812' 'violin' '1']\n",
      " ['355807' 'violin' '1']\n",
      " ['355800' 'violin' '1']\n",
      " ['355787' 'violin' '1']\n",
      " ['355786' 'violin' '1']\n",
      " ['249099' 'clarinet' '0']]\n",
      "\n",
      "(Cluster: 1) Using majority voting as a criterion this cluster belongs to class: trombone\n",
      "Number of sounds in this cluster are: 19\n",
      "sound-id, sound-class, classification decision\n",
      "[['373975' 'trombone' '1']\n",
      " ['373961' 'trombone' '1']\n",
      " ['373957' 'trombone' '1']\n",
      " ['373950' 'trombone' '1']\n",
      " ['373969' 'trombone' '1']\n",
      " ['373956' 'trombone' '1']\n",
      " ['373970' 'trombone' '1']\n",
      " ['373977' 'trombone' '1']\n",
      " ['373948' 'trombone' '1']\n",
      " ['373976' 'trombone' '1']\n",
      " ['373949' 'trombone' '1']\n",
      " ['373971' 'trombone' '1']\n",
      " ['373947' 'trombone' '1']\n",
      " ['373978' 'trombone' '1']\n",
      " ['373962' 'trombone' '1']\n",
      " ['373954' 'trombone' '1']\n",
      " ['373955' 'trombone' '1']\n",
      " ['373964' 'trombone' '1']\n",
      " ['373963' 'trombone' '1']]\n",
      "\n",
      "(Cluster: 2) Using majority voting as a criterion this cluster belongs to class: clarinet\n",
      "Number of sounds in this cluster are: 21\n",
      "sound-id, sound-class, classification decision\n",
      "[['355796' 'violin' '0']\n",
      " ['373968' 'trombone' '0']\n",
      " ['249087' 'clarinet' '1']\n",
      " ['249080' 'clarinet' '1']\n",
      " ['249089' 'clarinet' '1']\n",
      " ['249088' 'clarinet' '1']\n",
      " ['249075' 'clarinet' '1']\n",
      " ['249081' 'clarinet' '1']\n",
      " ['249068' 'clarinet' '1']\n",
      " ['249092' 'clarinet' '1']\n",
      " ['249093' 'clarinet' '1']\n",
      " ['249094' 'clarinet' '1']\n",
      " ['249069' 'clarinet' '1']\n",
      " ['249077' 'clarinet' '1']\n",
      " ['249070' 'clarinet' '1']\n",
      " ['249079' 'clarinet' '1']\n",
      " ['249078' 'clarinet' '1']\n",
      " ['249076' 'clarinet' '1']\n",
      " ['249082' 'clarinet' '1']\n",
      " ['249091' 'clarinet' '1']\n",
      " ['249090' 'clarinet' '1']]\n",
      "Out of 60 sounds, 3 sounds are incorrectly classified considering that one cluster should ideally contain sounds from only a single class\n",
      "You obtain a classification (based on obtained clusters and majority voting) accuracy of 95.00 percentage\n"
     ]
    }
   ],
   "source": [
    "# run the function clusterSounds \n",
    "### your code here\n",
    "cluster_sounds(\"testDownload/\", nCluster = -1, descInput=[0,11])"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Part 4: Classify sounds with k-NN\n",
    "\n",
    "Assign a sound different from the sounds of the 3 instruments chosen to one of the 3 instrumental classes you chose in Part 1, using the k-nearest neighbours classifier (k-NN). \n",
    "\n",
    "Given a new sound (query sound) and its descriptors, use the function `classify_sound_kNN()` for doing a k-NN classification. It uses a distance measure based on Euclidian distance which is implemented in `compute_similar_sounds()`. `classify_sound_kNN()` returns the instrument class that the query sound is classified into. \n",
    "\n",
    "The goal of the exercise is to experiment with the k-NN classifier and be able to understand the result by being able to explain why a particular query sound, that is not from any of the defined classes, is actually classified to one of those classes.\n",
    "\n",
    "4.1 Get query sounds from Freesound. To get query sounds and their descriptors, you can use `download_sounds_freesound()` function using different query texts (as you did in Part 1). Get sounds that are not from the 3 instruments you chose in Part 1, or at least that is none of the sounds you used to define the classes. If you use a sound from one of the three instruments make sure that is different enough from the existing sounds in your collections.\n",
    "\n",
    "4.2 Perform 5 classifications. You can use as many descriptors as you need (the fewer you use, the easier it will be, to explain the result). k is usually chosen to be an odd positive integer. Try out with different query sounds, different subsets of descriptors, and different values of k. Explain the reason for choosing the descriptors you used and the value of k you selected. Include cases where you think the classification is incorrect, and cases with a query sound of an instrument different from the starting classes. By trying out a sound from a different instrument, you are classifying the sound into the closest instrument class, which can tell you about similarity between instruments."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 7,
   "metadata": {},
   "outputs": [],
   "source": [
    "def compute_similar_sounds(queryFile, targetDir, descInput = []):\n",
    "  \"\"\"\n",
    "  This function returns similar sounds for a specific queryFile. Given a queryFile this function \n",
    "  computes the distance of the query to all the sounds found in the targetDir and sorts them in \n",
    "  the increasing order of the distance. This way we can obtain similar sounds to a query sound.\n",
    "  \n",
    "  Input:\n",
    "    queryFile (string): Descriptor file (.json, unless changed)\n",
    "    targetDir (string): Target directory to search for similar sounds (using their descriptor files)\n",
    "    descInput (list) : list of indices of the descriptors to be used for similarity/distance computation \n",
    "                       (see descriptorMapping)\n",
    "  Output: \n",
    "    List containing an ordered list of similar sounds. \n",
    "  \"\"\"\n",
    "  \n",
    "  dataDetails = fetchDataDetails(targetDir)\n",
    "  \n",
    "  #reading query feature dictionary\n",
    "  qFtr = json.load(open(queryFile, 'r'))\n",
    "  dist = []\n",
    "  # Iterating over classes\n",
    "  for cname in dataDetails.keys():\n",
    "    # Iterating over sounds\n",
    "    for sname in dataDetails[cname].keys():\n",
    "      f1 =  convFtrDict2List(qFtr)\n",
    "      f2 =  convFtrDict2List(dataDetails[cname][sname]['feature'])\n",
    "      eucDist = np.sqrt(np.sum(np.power(np.array(f1[descInput]) - np.array(f2[descInput]), 2)))\n",
    "      dist.append([eucDist, sname, cname])\n",
    "  \n",
    "  # Sorting the array based on the distance\n",
    "  indSort = np.argsort(np.array(dist)[:,0])\n",
    "  return (np.array(dist)[indSort,:]).tolist()\n",
    "\n",
    "        \n",
    "def classify_sound_kNN(queryFile, targetDir, K, descInput = []):\n",
    "  \"\"\"\n",
    "  This function performs the KNN classification of a sound. The nearest neighbors are chosen from \n",
    "  the sounds in the targetDir.\n",
    "   \n",
    "  Input:\n",
    "    queryFile (string): Descriptor file (.json, unless changed)\n",
    "    targetDir (string): Target directory to search for similar sounds (using their descriptor files)\n",
    "    K (int) : Number of nearest neighbors to consider for KNN classification.\n",
    "    descInput (list) : List of indices of the descriptors to be used for similarity/distance computation \n",
    "                      (see descriptorMapping)\n",
    "  Output:\n",
    "    predClass (string): Predicted class of the query sound\n",
    "  \"\"\"\n",
    "  distances = compute_similar_sounds(queryFile, targetDir, descInput)\n",
    "  if len(np.where((np.array(distances)[:,0].astype(np.float64))==0)[0])>0:\n",
    "    print(\"Warning: We found an exact copy of the query file in the target directory. \"\n",
    "          \"Beware of duplicates while doing KNN classification.\")\n",
    "  \n",
    "  classes = (np.array(distances)[:K,2]).tolist()\n",
    "  freqCnt = []\n",
    "  for ii in range(K):\n",
    "    freqCnt.append(classes.count(classes[ii]))\n",
    "  indMax = np.argmax(freqCnt)\n",
    "  predClass =  classes[indMax]\n",
    "  print (\"This sample belongs to class: \" + str(predClass))\n",
    "  return predClass"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 35,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Downloading mp3 preview and descriptors for sound with id: 357328\n",
      "Downloading mp3 preview and descriptors for sound with id: 523866\n",
      "Downloading mp3 preview and descriptors for sound with id: 52048\n",
      "Downloading mp3 preview and descriptors for sound with id: 328727\n",
      "Downloading mp3 preview and descriptors for sound with id: 508792\n"
     ]
    }
   ],
   "source": [
    "# 4.1 download one sound \n",
    "### your code here\n",
    "download_sounds_freesound(queryText='trumpet', API_Key=\"Cua7Jqu2Vb0gmOFX02kDjA1JQ2xyFDHb8p8wIJge\", outputDir='../sounds/', topNResults=1, duration=(0,8.5), tag='single-note')\n",
    "download_sounds_freesound(queryText='organ', API_Key=\"Cua7Jqu2Vb0gmOFX02kDjA1JQ2xyFDHb8p8wIJge\", outputDir='../sounds/', topNResults=1, duration=(0,8.5), tag='single-note')\n",
    "download_sounds_freesound(queryText='guitar', API_Key=\"Cua7Jqu2Vb0gmOFX02kDjA1JQ2xyFDHb8p8wIJge\", outputDir='../sounds/', topNResults=1, duration=(0,8.5), tag='single-note')\n",
    "download_sounds_freesound(queryText='flute', API_Key=\"Cua7Jqu2Vb0gmOFX02kDjA1JQ2xyFDHb8p8wIJge\", outputDir='../sounds/', topNResults=1, duration=(0,8.5), tag='single-note')\n",
    "download_sounds_freesound(queryText='piano', API_Key=\"Cua7Jqu2Vb0gmOFX02kDjA1JQ2xyFDHb8p8wIJge\", outputDir='../sounds/', topNResults=1, duration=(0,8.5), tag='single-note')"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 14,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "1) Classification 1, trumpet sound:\n",
      "This sample belongs to class: trombone\n",
      "2) Classification 2, organ sound:\n",
      "This sample belongs to class: violin\n",
      "3) Classification 3, guitar sound:\n",
      "This sample belongs to class: violin\n",
      "4) Classification 4, flute sound:\n",
      "This sample belongs to class: violin\n",
      "5) Classification 5, piano sound:\n",
      "This sample belongs to class: clarinet\n"
     ]
    },
    {
     "data": {
      "text/plain": [
       "'\\nI decided to use 4 parameters for all the first analysis: \\n\\n- The \"low-level descriptor\" that refered to the \"Spectral Centroid\" [0].\\n- The \"low-level descriptor\" for the attack [3].\\n- The first \"low-level descriptor\" for the \"Spectral Contrast\" [5].\\n- The first \"low-level descriptor\" for the \"MFCC\" (the mel-frequency cepstrum coefficients of a spectrum) [11].\\n\\nAll of them presented a very balanced and reliable clustering in the previous exercice. \\n\\nIn addition, K has been set to 21 as it is a close odd positive integer of nearest neighbors to consider for KNN classification\\n\\nI am including case 4 as a case where I think the classification is incorrect as a flute sound should be \\nclassified as a clarinet class.\\n\\n'"
      ]
     },
     "execution_count": 14,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "# 4.2 classify the donwloaded sound\n",
    "### your code here (1)\n",
    "print('1) Classification 1, trumpet sound:')\n",
    "classify_sound_kNN(\"../sounds/trumpet/357328/357328_6552981-lq.json\", 'testDownload', 21, descInput = [0,3,5,11])\n",
    "\n",
    "print('2) Classification 2, organ sound:')\n",
    "classify_sound_kNN(\"../sounds/organ/523866/523866_5450487-lq.json\", 'testDownload', 21, descInput = [0,3,5,11])\n",
    "\n",
    "print('3) Classification 3, guitar sound:')\n",
    "classify_sound_kNN(\"../sounds/guitar/52048/52048_533680-lq.json\", 'testDownload', 21, descInput = [0,3,5,11])\n",
    "\n",
    "print('4) Classification 4, flute sound:')\n",
    "classify_sound_kNN(\"../sounds/flute/328727/328727_113801-lq.json\", 'testDownload', 21, descInput = [0,3,5,11])\n",
    "\n",
    "print('5) Classification 5, piano sound:')\n",
    "classify_sound_kNN(\"../sounds/piano/508792/508792_1690102-lq.json\", 'testDownload', 21, descInput = [0,3,5,11])\n",
    "\n",
    "### explain the classification\n",
    "\"\"\"\n",
    "I decided to use 4 parameters for all the first analysis: \n",
    "\n",
    "- The \"low-level descriptor\" that refered to the \"Spectral Centroid\" [0].\n",
    "- The \"low-level descriptor\" for the attack [3].\n",
    "- The first \"low-level descriptor\" for the \"Spectral Contrast\" [5].\n",
    "- The first \"low-level descriptor\" for the \"MFCC\" (the mel-frequency cepstrum coefficients of a spectrum) [11].\n",
    "\n",
    "All of them presented a very balanced and reliable clustering in the previous exercice. \n",
    "\n",
    "In addition, K has been set to 21 as it is a close odd positive integer of nearest neighbors to consider for KNN classification\n",
    "\n",
    "I am including case 4 as a case where I think the classification is incorrect as a flute sound should be \n",
    "classified as a clarinet class.\n",
    "\n",
    "\"\"\""
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {},
   "outputs": [],
   "source": []
  }
 ],
 "metadata": {
  "kernelspec": {
   "display_name": "Python 3",
   "language": "python",
   "name": "python3"
  },
  "language_info": {
   "codemirror_mode": {
    "name": "ipython",
    "version": 3
   },
   "file_extension": ".py",
   "mimetype": "text/x-python",
   "name": "python",
   "nbconvert_exporter": "python",
   "pygments_lexer": "ipython3",
   "version": "3.8.8"
  }
 },
 "nbformat": 4,
 "nbformat_minor": 2
}