Irish-poem-generator.ipynb

{
 "cells": [
  {
   "cell_type": "markdown",
   "metadata": {
    "id": "SqIxQYm8h06Z"
   },
   "source": [
    "# Ungraded Lab: Generating Text from Irish Lyrics\n",
    "\n",
    "In the previous lab, you trained a model on just a single song. You might have found that the output text can quickly become gibberish or repetitive. Even if you tweak the hyperparameters, the model will still be limited by its vocabulary of only 263 words. The model will be more flexible if you train it on a much larger corpus and that's what you'll be doing in this lab. You will use lyrics from more Irish songs then see how the generated text looks like. You will also see how this impacts the process from data preparation to model training. Let's get started!"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "id": "wb1mfOvch4Sv"
   },
   "source": [
    "## Imports"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 1,
   "metadata": {
    "id": "BOwsuGQQY9OL"
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "WARNING:tensorflow:From c:\\Users\\DELL\\AppData\\Local\\Programs\\Python\\Python311\\Lib\\site-packages\\keras\\src\\losses.py:2976: The name tf.losses.sparse_softmax_cross_entropy is deprecated. Please use tf.compat.v1.losses.sparse_softmax_cross_entropy instead.\n",
      "\n"
     ]
    }
   ],
   "source": [
    "import tensorflow as tf\n",
    "import numpy as np \n",
    "\n",
    "from tensorflow.keras.preprocessing.sequence import pad_sequences\n",
    "from tensorflow.keras.layers import Embedding, LSTM, Dense, Bidirectional\n",
    "from tensorflow.keras.preprocessing.text import Tokenizer\n",
    "from tensorflow.keras.models import Sequential\n",
    "from tensorflow.keras.optimizers import Adam"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "id": "jmBFI788pOXx"
   },
   "source": [
    "## Building the Word Vocabulary\n",
    "\n",
    "You will first download the lyrics dataset. These will be from a compilation of traditional Irish songs and you can see them [here](https://github.com/https-deeplearning-ai/tensorflow-1-public/blob/main/C3/W4/misc/Laurences_generated_poetry.txt). "
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 2,
   "metadata": {},
   "outputs": [],
   "source": [
    "#!pip install gdown==5.1.0"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 3,
   "metadata": {
    "id": "pylt5qZYsWPh"
   },
   "outputs": [],
   "source": [
    "# Download the dataset\n",
    "#!gdown --id 15UqmiIm0xwh9mt0IYq2z3jHaauxQSTQT"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "id": "-v6JYQGNPXCW"
   },
   "source": [
    "Next, you will lowercase and split the plain text into a list of sentences:"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 4,
   "metadata": {
    "id": "LKOO7DFCPX3L"
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "['come all ye maidens young and fair', 'and you that are blooming in your prime', 'always beware and keep your garden fair', 'let no man steal away your thyme', 'for thyme it is a precious thing', 'and thyme brings all things to my mind', 'nlyme with all its flavours, along with all its joys', 'thyme, brings all things to my mind', 'once i and a bunch of thyme', 'i thought it never would decay', 'then came a lusty sailor', 'who chanced to pass my way', 'and stole my bunch of thyme away', 'the sailor gave to me a rose', 'a rose that never would decay', 'he gave it to me to keep me reminded', 'of when he stole my thyme away', 'sleep, my child, and peace attend thee', 'all through the night', 'guardian angels god will send thee', 'soft the drowsy hours are creeping', 'hill and dale in slumber sleeping', 'i my loving vigil keeping', 'while the moon her watch is keeping', 'while the weary world is sleeping', 'oer thy spirit gently stealing', 'visions of delight revealing', 'breathes a pure and holy feeling', 'though i roam a minstrel lonely', 'my true harp shall praise sing only', 'loves young dream, alas, is over', 'yet my strains of love shall hover', 'near the presence of my lover', 'hark, a solemn bell is ringing', 'clear through the night', 'thou, my love, art heavenward winging', 'home through the night', 'earthly dust from off thee shaken', 'soul immortal shalt thou awaken', 'with thy last dim journey taken', 'oh please neer forget me though waves now lie oer me', 'i was once young and pretty and my spirit ran free', 'but destiny tore me from country and loved ones', 'and from the new land i was never to see.', 'a poor emigrants daughter too frightened to know', 'i was leaving forever the land of my soul', 'amid struggle and fear my parents did pray', 'to place courage to leave oer the longing to stay.', 'they spoke of a new land far away cross the sea', 'and of peace and good fortune for my brothers and me', 'so we parted from townland with much weeping and pain', 'kissed the loved ones and the friends we would neer see again.', 'the vessel was crowded with disquieted folk', 'the escape from past hardship sustaining their hope', 'but as the last glimpse of ireland faded into the mist', 'each one fought back tears and felt strangely alone.', 'the seas roared in anger, making desperate our plight', 'and a fever came oer me that worsened next night', 'then delirium possessed me and clouded my mind', 'and i for a moment saw that land left behind.', 'i could hear in the distance my dear mothers wailing', 'and the prayers of three brothers that id see no more', 'and i felt fathers tears as he begged for forgiveness', 'for seeking a new life on the still distant shore.', 'over in killarney', 'many years ago,', 'me mither sang a song to me', 'in tones so sweet and low.', 'just a simple little ditty,', 'in her good ould irish way,', 'and ld give the world if she could sing', 'that song to me this day.', 'too-ra-loo-ra-loo-ral, too-ra-loo-ra-li,', 'too-ra-loo-ra-loo-ral, hush now, dont you cry!', 'too-ra-loo-ra-loo-ral, thats an irish lullaby.', 'oft in dreams i wander', 'to that cot again,', 'i feel her arms a-huggin me', 'as when she held me then.', 'and i hear her voice a -hummin', 'to me as in days of yore,', 'when she used to rock me fast asleep', 'outside the cabin door.', 'and who are you, me pretty fair maid', 'and who are you, me honey?', 'she answered me quite modestly:', 'i am me mothers darling.', 'with me too-ry-ay', 'fol-de-diddle-day', 'di-re fol-de-diddle', 'dai-rie oh.', 'and will you come to me mothers house,', 'when the sun is shining clearly', 'ill open the door and ill let you in', 'and divil o one would hear us.', 'so i went to her house in the middle of the night', 'when the moon was shining clearly', 'shc opened the door and she let me in', 'and divil the one did hear us.', 'she took me horse by the bridle and the bit', 'and she led him to the stable', 'saying theres plenty of oats for a soldiers horse,', 'to eat it if hes able.', 'then she took me by the lily-white hand', 'and she led me to the table', 'saying: theres plenty of wine for a soldier boy,', 'to drink it if youre able.', 'then i got up and made the bed', 'and i made it nice and aisy', 'then i got up and laid her down', 'saying: lassie, are you able?', 'and there we lay till the break of day', 'and divil a one did hear us', 'then i arose and put on me clothes', 'saying: lassie, i must leave you.', 'and when will you return again', 'and when will we get married', 'when broken shells make christmas bells', 'we might well get married', 'in 1803 we sailed out to sea', 'out from the sweet town of derry', 'for australia bound if we didnt all drown', 'and the marks of our fetters we carried.', 'in the rusty iron chains we sighed for our wains', 'as our good wives we left in sorrow.', 'as the mainsails unfurled our curses we hurled', 'on the english and thoughts of tomorrow.', 'oh oh oh oh i wish i was back home in derry.', 'i cursed them to hell as our bow fought the swell.', 'our ship danced like a moth in the firelights.', 'white horses rode high as the devil passed by', 'taking souls to hades by twilight.', 'five weeks out to sea we were now forty-three', 'our comrades we buried each morning.', 'in our own slime we were lost in a time.', 'endless night without dawning.', 'van diemans land is a hell for a man', 'to live out his life in slavery.', 'when the climate is raw and the gun makes the law.', 'neither wind nor rain cares for bravery.', 'twenty years have gone by and ive ended me bond', 'and comrades ghosts are behind me.', 'a rebel i came and iii die the same.', 'on the cold winds of night you will find me', 'on the banks of the roses, my love and i sat down', 'and i took out my violin to play my love a tune', 'in the middle of the tune, o she sighed and she said', 'o johnny, lovely johnny, would you leave me', 'o when i was a young man, i heard my father say', 'that hed rather see me dead and buried in the clay', 'sooner than be married to any runaway', 'by the lovely sweet banks of the roses', 'o then i am no runaway and soon ill let them know', 'i can take a good glass or leave it alone', 'and the man that doesnt like me, he can keep', 'his daughter home', 'and young johnny will go roving with another', 'and if ever i get married, twill be in the month of may', 'when the leaves they are green and the meadows', 'they are gay', 'and i and my true love can sit and sport and play', 'on the lovely sweet banks of the roses', 'but black is the colour of my true loves hair.', 'his face is like some rosy fair,', 'the prettiest face and the neatest hands,', 'i love the ground whereon he stands.', 'i love my love and well he knows', 'i love the ground whereon he goes', 'if you no more on earth i see,', 'i cant serve you as you have me.', 'the winters passed and the leaves are green', 'the time is passed that we have seen,', 'but still i hope the time will come', 'when you and i shall be as one.', 'i go to the clyde for to mourn and weep,', 'but satisfied i never could sleep,', 'ill write to you a few short lines', 'ill suffer death ten thousand times.', 'so fare you well, my own true love', 'the time has passed, but i wish you well.', 'when you and i will be as one.', 'i love the ground whereon he goes,', 'the prettiest face, the neatest hands', 'her eyes they shone like the diamonds', 'youd think she was queen of the land', 'and her hair hung over her shoulder', 'tied up with a black velvet band.', 'in a neat little town they call belfast', 'apprenticed to trade i was bound', 'and many an hours sweet happiness', 'i spent in that neat little town.', 'till bad misfortune came oer me', 'that caused me to stray from the land', 'far away from my friends and relations', 'to follow the black velvet band.', 'well, i was out strolling one evening', 'not meaning to go very far', 'when i met with a pretty young damsel', 'who was selling her trade in the bar.', 'when i watched, she took from a customer', 'and slipped it right into my hand', 'then the watch came and put me in prison', 'bad luck to the black velvet band.', 'next morning before judge and jury', 'for a trial i had to appear', 'and the judge, he said, you young fellows...', 'the case against you is quite clear', 'and seven long years is your sentence', 'youre going to van diemans land', 'far away from your friends and relations', 'so come all you jolly young fellows', 'id have you take warning by me', 'whenever youre out on the liquor, me lads,', 'beware of the pretty colleen.', 'shell fill you with whiskey and porter', 'until youre not able to stand', 'and the very next thing that youll know, me lads,', 'youre landed in van diemans land.', 'heres a health to you, bonnie kellswater', 'for its there youll find the pleasures of life', 'and its there youll find a fishing and farming', 'and a bonnie wee girl for your wife', 'on the hills and the glens and the valleys', 'grows the softest of women so fine', 'and the flowers are all dripping with honey', 'there lives martha, a true love of mine', 'bonnie martha, youre the first girl i courted', 'youre the one put my heart in a snare', 'and if ever i should lose you to another', 'i will leave my kellswater so fair', 'for this one and that one may court her', 'but no other can take her from me', 'for i love her as i love my kellswater', 'like the primrose is loved by the bee', 'oh bridgit omalley, you left my heart shaken', 'with a hopeless desolation, id have you to know', 'its the wonders of admiration your quiet face has taken', 'and your beauty will haunt me wherever i go.', 'the white moon above the pale sands, the pale stars above the thorn tree', 'are cold beside my darling, but no purer than she', 'i gaze upon the cold moon till the stars drown in the warm sea', 'and the bright eyes of my darling are never on me.', 'my sunday it is weary, my sunday it is grey now', 'my heart is a cold thing, my heart is a stone', 'all joy is dead within me, my life has gone away now', 'for another has taken my love for his own.', 'the day it is approaching when we were to be married', 'and its rather i would die than live only to grieve', 'oh meet me, my darling, eer the sun sets oer the barley', 'and ill meet you there on the road to drumslieve.', 'oh bridgit omalley, youve left my heart shaken', 'i wish i was in carrigfergus', 'only for nights in ballygrant', 'i would swim over the deepest ocean', 'for my love to find', 'but the sea is wide and i cannot cross over', 'and neither have i the wings to fly', 'i wish i could meet a handsome boatsman', 'to ferry me over, to my love and die.', 'my childhood days bring back sad reflections', 'of happy times i spent so long ago', 'my boyhood friends and my own relations', 'have all passed on now like melting snow.', 'but ill spend my days in endless roaming', 'soft is the grass, my bed is free.', 'ah, to be back now in carrigfergus', 'on that long road down to the sea.', 'but in kilkenny, it is reported', 'on marble stones there as black as ink', 'with gold and silver i would support her', 'but ill sing no more till i get a drink.', 'for im drunk today, and im seldom sober', 'a handsome rover from town to town', 'ah, but im sick now, my days are numbered', 'you may travel far far from your own native land', 'far away oer the mountains, far away oer the foam', 'but of all the fine places that ive ever been', 'sure theres none can compare with the cliffs of doneen.', 'take a view oer the mountains, fine sights youll see there', 'youll see the high rocky mountains oer the west coast of clare', 'oh the town of kilkee and kilrush can be seen', 'from the high rocky slopes round the cliffs of doneen.', 'its a nice place to be on a fine summers day', 'watching all the wild flowers that neer do decay', 'oh the hares and lofty pheasants are plain to be seen', 'making homes for their young round the cliffs of doneen.', 'fare thee well to doneen, fare thee well for a while', 'and to all the kind people im leaving behind', 'to the streams and the meadows where late i have been', 'and the high rocky slopes round the cliffs of doneen.', 'in dublins fair city, where the girls are so pretty', 'i first set my eyes on sweet molly malone', 'as she wheeled her wheel-barrow', 'through streets broad and narrow', 'crying cockles and mussels, alive, alive-o!', 'alive, alive-o! alive, alive-o!', 'she was a fish-monger, but sure twas no wonder', 'for so were her father and mother before', 'and they each wheeled their barrow', 'she died of a fever, and no one could save her', 'and that was the end of sweet molly malone', 'but her ghost wheels her barrow', 'the garden of eden has vanished, they say', 'but i know the lie of it still;', 'just turn to the left at the bridge of finea', 'and stop when halfway to cootehill.', 'tis there i will find it,', 'i know sure enough', 'when fortune has come to me call,', 'oh the grass it is green around ballyjamesduff', 'and the blue sky is over it all.', 'and tones that are tender and tones that are gruff', 'are whispering over the sea,', 'come back, paddy reilly to ballyjamesduff', 'come home, paddy reilly, to me.', 'my mother once told me that when i was born', 'the day that i first saw the light,', 'i looked down the street on that very first morn', 'and gave a great crow of delight.', 'now most newborn babies appear in a huff,', 'and start with a sorrowful squall,', 'but i knew i was born in ballyjamesduff', 'and thats why i smiled on them all.', 'the babys a man, now hes toil-worn and tough', 'still, whispers come over the sea,', 'the night that we danced by the light of the moon,', 'wid phil to the fore wid his flute,', 'when phil threw his lip over come again soon,', 'hes dance the foot out o yer boot!', 'the day that i took long magee by the scruff', 'for slanderin rosie kilrain,', 'then, marchin him straight out of ballyjamesduff,', 'assisted him into a drain.', 'oh, sweet are the dreams, as the dudeen i puff,', 'of whisperings over the sea,', 'ive loved the young women of every land,', 'that always came easy to me;', 'just barrin the belles of the black-a-moor brand', 'and the chocolate shapes of feegee.', 'but that sort of love is a moonshiny stuff,', 'and never will addle me brain,', 'for the bells will be ringin in ballyjamesduff', 'for me and me rosie kilrain!', 'and through all their glamour, their gas and their guff', 'a whisper comes over the sea,', 'ive struck oil at last!', 'ive struck work, and i vow', 'ive struck some remarkable clothes,', 'ive struck a policeman for sayin that now,', 'id go back to my beautiful rose.', 'the belles they may blarney,', 'the boys they may bluff', 'but this i will always maintain,', 'no place in the world like ballyjamesduff', 'no guril (sic) like rosie kilrain.', 'ive paid for my passage, the sea may be rough', 'but borne on each breeze there will be,', 'will you come to the bower oer the free boundless ocean', 'where the stupendous waves roll in thundering motion,', 'where the mermaids are seen and the fierce tempest gathers,', 'to loved erin the green, the dear land of our fathers.', 'will you come, will you, will you, will you come to the bower?', 'will you come to the land of oneill and odonnell', 'of lord lucan of old and immortal oconnell.', 'where brian drove the danes and saint patrick the vermin', 'and whose valleys remain still most beautiful and charming?', 'you can visit benburb and the storied blackwater,', 'where owen roe met munroe and his chieftains did slaughter', 'where the lambs skip and play on the mossy all over,', 'from those bright golden views to enchanting rostrevor.', 'you can see dublin city, and the fine groves of blarney', 'the bann, boyne, and liffey and the lakes of killarney,', 'you may ride on the tide on the broad majestic shannon', 'you may sail round loch neagh and see storied dungannon.', 'you can visit new ross, gallant wexford, and gorey,', 'where the green was last seen by proud saxon and tory,', 'where the soil is sanctified by the blood of each true man', 'where they died satisfied that their enemies they would not run from.', 'will you come and awake our lost land from its slumber', 'and her fetters well break, links that long are encumbered.', 'and the air will resound with hosannahs to greet you', 'on the shore will be found gallant irishmen to greet you.', 'oh danny boy, the pipes, the pipes are calling', 'from glen to glen, and down the mountain side', 'the summers gone, and all the flowers are dying', 'tis you, tis you must go and i must bide.', 'but come ye back when summers in the meadow', 'or when the valleys hushed and white with snow', 'tis ill be here in sunshine or in shadow', 'oh danny boy, oh danny boy, i love you so.', 'and if you come, when all the flowers are dying', 'and i am dead, as dead i well may be', 'youll come and find the place where i am lying', 'and kneel and say an ave there for me.', 'and i shall hear, tho soft you tread above me', 'and all my dreams will warm and sweeter be', 'if youll not fail to tell me that you love me', 'ill simply sleep in peace until you come to me.', 'i found my love by the gasworks croft', 'dreamed a dream by the old canal', 'kissed my girl by the factory wall', 'dirty old town, dirty old town.', 'clouds are drifting across the moon', 'cats are prowling on their beat', 'springs a girl in the street at night', 'i heard a siren from the docks', 'saw a train set the night on fire', 'smelled the spring in the smokey wind', 'im going to make a good sharp axe', 'shining steel tempered in the fire', 'well chop you down like an old dead tree', 't was down by the salley gardens, my love and i did meet.', 'she crossed the salley gardens with little snow-white feet.', 'she bid me take love easy, as the leaves grow on the tree,', 'but i was young and foolish, and with her did not agree.', 'in a field down by the river, my love and i did stand', 'and on my leaning shoulder, she laid her snow-white hand.', 'she bid me take life easy , as the grass grows on the weirs', 'but i was young and foolish, and now am full of tears.', 'down by the salley gardens, my love and i did meet.', 'when, like the dawning day', 'eileen aroon', 'love sends his early ray', 'eileen aroon.', 'what makes his dawning glow', 'changeless through joy and woe', 'only the constant know', 'were she no longer true', 'what would her lover do', 'fly with a broken chain', 'far oer the bounding main', 'never to love again', 'youth must in time decay', 'beauty must fade away', 'castles are sacked in war', 'chieftains are scattered far', 'truth is a fixed star', 'believe me, if all those endearing young charms', 'which i gaze on so fondly today', 'were to change by tomorrow and fleet in my arms', 'like fairy gifts fading away.', 'thou wouldst still be adored as this moment thou art', 'let thy loveliness fade as it will', 'and around the dear ruin each wish of my heart', 'would entwine itself verdantly still.', 'it is not while beauty and youth are thine own', 'and thy cheeks unprofaned by a tear', 'that the fervor and faith of a soul can be known', 'to which time will but make thee more dear.', 'no, the heart that has truly loved never forgets', 'but as truly loves on to the close', 'as the sunflower turns to her god when he sets', 'the same look which she turned when she rose.', 'ill tell you a story of a row in the town,', 'when the green flag went up and the crown rag came down,', 'twas the neatest and sweetest thing ever you saw,', 'and they played the best games played in erin go bragh.', 'one of our comrades was down at rings end,', 'for the honor of ireland to hold and defend,', 'he had no veteran soldiers but volunteers raw,', 'playing sweet mauser music for erin go bragh.', 'now heres to pat pearse and our comrades who died', 'tom clark, macdonagh, macdiarmada, mcbryde,', 'and heres to james connolly who gave one hurrah,', 'and placed the machine guns for erin go bragh.', 'one brave english captain was ranting that day,', 'saying, give me one hour and ill blow you away,', 'but a big mauser bullet got stuck in his craw,', 'and he died of lead poisoning in erin go bragh.', 'old ceannt and his comrades like lions at bay,', 'from the south dublin union poured death and dismay,', 'and what was their horror when the englishmen saw', 'all the dead khaki soldiers in erin go bragh.', 'now heres to old dublin, and heres her renown,', 'in the long generation her fame will go down,', 'and our children will tell how their forefathers saw,', 'the red blaze of freedom in erin go bragh.', 'of priests we can offer a charmin variety,', 'far renownd for learnin and piety;', 'still, id advance ye widout impropriety,', 'father oflynn as the flowr of them all.', 'cho: heres a health to you, father oflynn,', 'slainte and slainte and slainte agin;', 'powrfulest preacher, and tenderest teacher,', 'and kindliest creature in ould donegal.', 'dont talk of your provost and fellows of trinity,', 'famous forever at greek and latinity,', 'dad and the divils and all at divinity', 'father oflynn d make hares of them all!', 'come, i venture to give ye my word,', 'never the likes of his logic was heard,', 'down from mythology into thayology,', 'truth! and conchology if hed the call.', 'och father oflynn, youve a wonderful way wid you,', 'all ould sinners are wishful to pray wid you,', 'all the young childer are wild for to play wid you,', 'youve such a way wid you, father avick.', 'still for all youve so gentle a soul,', 'gad, youve your flock in the grandest control,', 'checking the crazy ones, coaxin onaisy ones,', 'lifting the lazy ones on wid the stick.', 'and tho quite avoidin all foolish frivolity;', 'still at all seasons of innocent jollity,', 'where was the playboy could claim an equality,', 'at comicality, father, wid you?', 'once the bishop looked grave at your jest,', 'till this remark set him off wid the rest:', 'is it lave gaiety all to the laity?', 'cannot the clergy be irishmen, too?', 'what did i have, said the fine old woman', 'what did i have, this proud old woman did say', 'i had four green fields, each one was a jewel', 'but strangers came and tried to take them from me', 'i had fine strong sons, who fought to save my jewels', 'they fought and they died, and that was my grief said she', 'long time ago, said the fine old woman', 'long time ago, this proud old woman did say', 'there was war and death, plundering and pillage', 'my children starved, by mountain, valley and sea', 'and their wailing cries, they shook the very heavens', 'my four green fields ran red with their blood, said she', 'what have i now, said the fine old woman', 'what have i now, this proud old woman did say', 'i have four green fields, one of thems in bondage', 'in strangers hands, that tried to take it from me', 'but my sons had sons, as brave as were their fathers', 'my fourth green field will bloom once again said she', 'just give me your hand,', 'tabhair dom do lã¡mh.', 'just give me your hand', 'and ill walk with you,', 'through the streets of our land,', 'through the mountains so grand.', 'if you give me your hand.', 'and come along with me.', 'will you give me your hand,', 'and the world it can see,', 'that we can be free,', 'in peace and harmony?', 'from the north to the south.', 'from the east to the west.', 'every mountain, every valley,', 'every bush and birds nest!', 'for the world it is ours.', 'all the sea and the land,', 'to destroy or command,', 'in a gesture of peace.', 'will you give me your hand', 'and all troubles will cease,', 'for the strong and the weak,', 'for the rich and the poor?', 'all peoples and creeds,', 'lets meet their needs.', 'with a passion, we can fashion,', 'a new world of love!', 'by day and night,', 'through all struggle and strife,', 'and beside you, to guide you,', 'forever, my love.', 'for loves not for one,', 'but for both of us to share.', 'for our country so fair,', 'for our world and whats there.', 'green grow the lilacs, all sparkling with dew', 'im lonely, my darling, since parting with you;', 'but by our next meeting iull hope to prove true', 'and change the green lilacs to the red, white and blue.', 'i once had a sweetheart, but now i have none', 'shes gone and shes left me, i care not for one', 'since shes gone and left me, contented ill be,', 'for she loves another one better than me.', 'i passed my loves window, both early and late', 'the look that she gave me, it makes my heart ache;', 'oh, the look that she gave me was painful to see,', 'i wrote my love letters in rosy red lines,', 'she sent me an answer all twisted and twined;', 'saying,keep your love letters and i will keep mine', 'just you write to your love and ill write to mine.', 'oh haste to the wedding, the pipes, the pipes are calling', 'oh haste to the wedding, oh haste to the wedding, i love you so.', 'ill take you home again, kathleen', 'across the ocean wild and wide', 'to where your heart has ever been', 'since you were first my bonnie bride.', 'the roses all have left your cheek.', 'ive watched them fade away and die', 'your voice is sad when eer you speak', 'and tears bedim your loving eyes.', 'oh! i will take you back, kathleen', 'to where your heart will feel no pain', 'and when the fields are fresh and green', 'ill take you to your home again!', 'i know you love me, kathleen, dear', 'your heart was ever fond and true.', 'i always feel when you are near', 'that life holds nothing, dear, but you.', 'the smiles that once you gave to me', 'i scarcely ever see them now', 'though many, many times i see', 'a darkning shadow on your brow.', 'to that dear home beyond the sea', 'my kathleen shall again return.', 'and when thy old friends welcome thee', 'thy loving heart will cease to yearn.', 'where laughs the little silver stream', 'beside your mothers humble cot', 'and brightest rays of sunshine gleam', 'there all your grief will be forgot.', 'ill tell my ma when i go home', 'the boys wont leave the girls alone', 'they pulled my hair, they stole my comb', 'but thats all right till i go home.', 'she is handsome, she is pretty', 'she is the bell of belfast city', 'she is counting one, two, three', 'please wont you tell me who is she.', 'albert mooney says he loves her', 'all the boys are fighting for her', 'they knock at the door and they ring at the bell', 'sayin oh my true love, are you well?', 'out she comes as white as snow', 'rings on her fingers and bells on her toes', 'old john murray says shell die', 'if she doesnt get the fellow with the roving eye.', 'let the wind and rain and the hail blow high', 'and the snow come tumblin from the sky', 'shes as nice as apple pie', 'shell get her own lad by and by.', 'when she gets a lad of her own', 'she wont tell her ma when she goes home', 'let them all come as they will', 'for its albert mooney she loves still.', 'while goin the road to sweet athy, ', 'hurroo, hurroo', 'while goin the road to sweet athy', 'a stick in me hand and a drop in me eye', 'a doleful damsel i heard cry,', 'johnny i hardly knew ye.', 'with your drums and guns and drums and guns', 'the enemy nearly slew ye', 'oh my darling dear, ye look so queer', 'where are your eyes that were so mild', 'when my heart you so beguiled', 'why did ye run from me and the child', 'oh johnny, i hardly knew ye.', 'where are your legs that used to run', 'when you went for to carry a gun', 'indeed your dancing days are done', 'im happy for to see ye home', 'all from the island of sulloon', 'so low in flesh, so high in bone', 'oh johnny i hardly knew ye.', 'ye havent an arm, ye havent a leg', 'yere an armless, boneless, chickenless egg', 'yell have to put with a bowl out to beg', 'theyre rolling out the guns again', 'but they never will take our sons again', 'no they never will take our sons again', 'johnny im swearing to ye.', 'as i was a-walkin round kilgary mountain', 'i met with captain pepper as his money he was countin', 'i rattled my pistols and i drew forth my saber', 'sayin, stand and deliver, for i am the bold deceiver.', 'musha rig um du rum da', 'whack fol the daddy o', 'theres whiskey in the jar.', 'the shinin golden coins did look so bright and jolly', 'i took em with me home and i gave em to my molly', 'she promised and she vowed that she never would deceive me', 'but the devils in the women and they never can be easy.', 'when i was awakened between six and seven', 'the guards were all around me in numbers odd and even', 'i flew to my pistols, but alas i was mistaken', 'for mollys drawn my pistols and a prisoner i was taken.', 'they put me into jail without judge or writin', 'for robbing colonel pepper on kilgary mountain', 'but they didnt take my fists so i knocked the sentry down', 'and bid a fond farewell to the jail in sligo town.', 'now some take delight in fishin and in bowlin', 'and others take delight in carriages a-rollin', 'but i take delight in the juice of the barley', 'and courtin pretty girls in the morning so early.', 'oer railroad ties and crossings', 'i made my weary way,', 'through swamps and elevations', 'my tired feet did stray', 'until i resolved at sunset', 'some higher ground to win.', 'twas there i met with a creole girl', 'by the lake of ponchartrain.', 'good evening, fair maiden,', 'my money does me no good.', 'if it want for the allegators', 'id stay out in the wood.', 'youre welcome, welcome, stranger.', 'at home it is quite plain', 'for we never turn a stranger', 'from the lake of ponchartrain.', 'she took me to her mothers home', 'and she treated me quite well;', 'her long black hair in ringlets', 'upon her shoulders fell.', 'i tried to paint her picture', 'but, alas, it was in vain', 'so handsome was that creole girl', 'i asked her if shed marry me', 'she said that neer could be;', 'she said she had a lover,', 'and he was on the sea,', 'she said she had a lover', 'it was true she would remain,', 'until he returned for the creole girl', 'adieu, adieu, fair maiden,', 'you neer shall see me more', 'and when you are thinking of the old times', 'and the cottage by the shore', 'and when i meet a sociable', 'with a glass of the foaming main', 'ill drink good health to the creole girl', 'n the town of athy one jeremy lanigan', 'battered away til he hadnt a pound.', 'his father died and made him a man again', 'left him a farm and ten acres of ground.', 'he gave a grand party for friends and relations', 'who didnt forget him when come to the wall,', 'and if youll but listen ill make your eyes glisten', 'of the rows and the ructions of lanigans ball.', 'myself to be sure got free invitation,', 'for all the nice girls and boys i might ask,', 'and just in a minute both friends and relations', 'were dancing round merry as bees round a cask.', 'judy odaly, that nice little milliner,', 'she tipped me a wink for to give her a call,', 'and i soon arrived with peggy mcgilligan', 'just in time for lanigans ball.', 'there were lashings of punch and wine for the ladies,', 'potatoes and cakes; there was bacon and tea,', 'there were the nolans, dolans, ogradys', 'courting the girls and dancing away.', 'songs they went round as plenty as water,', 'the harp that once sounded in taras old hall,', 'sweet nelly gray and the rat catchers daughter,', 'all singing together at lanigans ball.', 'they were doing all kinds of nonsensical polkas', 'all round the room in a whirligig.', 'julia and i, we banished their nonsense', 'and tipped them the twist of a reel and a jig.', '&och mavrone, how the girls got all mad at me', 'danced til youd think the ceiling would fall.', 'for i spent three weeks at brooks academy', 'learning new steps for lanigans ball.', 'three long weeks i spent up in dublin,', 'three long weeks to learn nothing at all,', 'she stepped out and i stepped in again,', 'i stepped out and she stepped in again,', 'boys were all merry and the girls they were hearty', 'and danced all around in couples and groups,', 'til an accident happened, young terrance mccarthy', 'put his right leg through miss finnertys hoops.', 'poor creature fainted and cried: meelia murther,', 'called for her brothers and gathered them all.', 'carmody swore that hed go no further', 'til he had satisfaction at lanigans ball.', 'in the midst of the row miss kerrigan fainted,', 'her cheeks at the same time as red as a rose.', 'some of the lads declared she was painted,', 'she took a small drop too much, i suppose.', 'her sweetheart, ned morgan, so powerful and able,', 'when he saw his fair colleen stretched out by the wall,', 'tore the left leg from under the table', 'and smashed all the chaneys at lanigans ball.', 'boys, oh boys, twas then there were runctions.', 'myself got a lick from big phelim mchugh.', 'i soon replied to his introduction', 'and kicked up a terrible hullabaloo.', 'old casey, the piper, was near being strangled.', 'they squeezed up his pipes, bellows, chanters and all.', 'the girls, in their ribbons, they got all entangled', 'and that put an end to lanigans ball.', 'step we gaily, on we go', 'heel for heel and toe for toe,', 'arm in arm and row on row', 'all for mairis wedding.', 'over hillways up and down', 'myrtle green and bracken brown,', 'past the sheilings through the town', 'all for sake of mairi.', 'red her cheeks as rowans are', 'bright her eyes as any star,', 'fairest o them all by far', 'is our darlin mairi.', 'plenty herring, plenty meal', 'plenty peat to fill her creel,', 'plenty bonny bairns as weel', 'thats the toast for mairi.', 'i have seen the lark soar high at morn', 'heard his song up in the blue', 'i have heard the blackbird pipe his note', 'the thrush and the linnet too', 'but theres none of them can sing so sweet', 'my singing bird as you.', 'if i could lure my singing bird', 'from his own cozy nest', 'if i could catch my singing bird', 'i would warm him on my breast', 'for theres none of them can sing so sweet', 'of all the money that eer i spent', 'ive spent it in good company', 'and all the harm that ever i did', 'alas it was to none but me', 'and all ive done for want of wit', 'to memory now i cant recall', 'so fill to me the parting glass', 'good night and joy be with you all', 'if i had money enough to spend', 'and leisure to sit awhile', 'there is a fair maid in the town', 'that sorely has my heart beguiled', 'her rosy cheeks and ruby lips', 'i own she has my heart enthralled', 'oh, all the comrades that eer i had', 'theyre sorry for my going away', 'and all the sweethearts that eer i had', 'theyd wish me one more day to stay', 'but since it falls unto my lot', 'that i should rise and you should not', 'ill gently rise and softly call', 'it was on a fine summers morning,', 'when the birds sweetly tuned on each bough;', 'i heard a fair maid sing most charming', 'as she sat a-milking her cow;', 'her voice, it was chanting melodious,', 'she left me scarce able to go;', 'my heart it is soothed in solace,', 'my cailã\\xadn deas crãºite na mbã³.', 'with courtesy i did salute her,', 'good-morrow, most amiable maid,', 'im your captive slave for the future.', 'kind sir, do not banter, she said,', 'im not such a precious rare jewel,', 'that i should enamour you so;', 'i am but a plain country girl,', 'says cailã\\xadn deas crãºite na mbã³.', 'the indies afford no such jewel,', 'so precious and transparently fair,', 'oh! do not to my flame add fuel,', 'but consent for to love me, my dear;', 'take pity and grant my desire,', 'and leave me no longer in woe;', 'oh! love me or else ill expire,', 'sweet cailã\\xadn deas crãºite na mbã³.', 'or had i the wealth of great damer,', 'or all on the african shore,', 'or had i great devonshire treasure,', 'or had i ten thousand times more,', 'or had i the lamp of alladin,', 'or had i his genie also,', 'id rather live poor on a mountain,', 'with cailã\\xadn deas crãºite na mbã³.', 'i beg youll withdraw and dont tease me;', 'i cannot consent unto thee.', 'i like to live single and airy,', 'till more of the world i do see.', 'new cares they would me embarrass,', 'besides, sir, my fortune is low,', 'until i get rich ill not marry,', 'an old maid is like an old almanack,', 'quite useless when once out of date;', 'if her ware is not sold in the morning', 'at noon it must fall to low rate.', 'the fragrance of may is soon over,', 'the rose loses its beauty, you know;', 'all bloom is consumed in october,', 'a young maid is like a ship sailing,', 'theres no knowing how long she may steer,', 'for with every blast shes in danger;', 'oh! consent, love, and banish all care.', 'for riches i care not a farthing,', 'your affection i want and no more;', 'in comfort id wish to enjoy you,', 'red is the rose that in yonder garden grows', 'fair is the lily of the valley', 'clear is the water that flows from the boyne', 'but my love is fairer than any.', 'come over the hills, my bonnie irish lass', 'come over the hills to your darling', 'you choose the rose, love, and ill make the vow', 'and ill be your true love forever.', 'twas down by killarneys green woods that we strayed', 'when the moon and the stars they were shining', 'the moon shone its rays on her locks of golden hair', 'and she swore shed be my love forever.', 'its not for the parting that my sister pains', 'its not for the grief of my mother', 'tis all for the loss of my bonny irish lass', 'that my heart is breaking forever.', 'in the merry month of june from me home i started,', 'left the girls of tuam so sad and broken hearted,', 'saluted father dear, kissed me darling mother,', 'drank a pint of beer, me grief and tears to smother,', 'then off to reap the corn, leave where i was born,', 'cut a stout black thorn to banish ghosts and goblins;', 'bought a pair of brogues rattling oer the bogs', 'and frightning all the dogs on the rocky road to dublin.', 'one, two, three four, five, hunt the hare and turn her down the rocky', 'road and all the way to dublin, whack follol de rah !', 'in mullingar that night i rested limbs so weary, started by daylight', 'next morning blithe and early, took a drop of pure to keep me heartfrom sinking;', 'thats a paddys cure whenever hes on drinking. see the lassies smile, laughing', 'all the while at me curious style, twould set your heart a bubblin', 'asked me was i hired, wages i required, i was almost tired of the', 'rocky road to dublin.', 'in dublin next arrived, i thought it be a pity', 'to be soon deprived a view of that fine city.', 'so then i took a stroll, all among the quality;', 'me bundle it was stole, all in a neat locality.', 'something crossed me mind, when i looked behind,', 'no bundle could i find upon me stick a wobblin', 'enquiring for the rogue, they said me connaught brogue', 'wasnt much in vogue on the rocky road to dublin.', 'from there i got away, me spirits never falling,', 'landed on the quay, just as the ship was sailing.', 'the captain at me roared, said that no room had he;', 'when i jumped aboard, a cabin found for paddy.', 'down among the pigs, played some hearty rigs,', 'danced some hearty jigs, the water round me bubbling;', 'when off holyhead wished meself was dead,', 'or better for instead on the rocky road to dublin.', 'well the bouys of liverpool, when we safely landed,', 'called meself a fool, i could no longer stand it.', 'blood began to boil, temper i was losing;', 'poor old erins isle they began abusing.', 'hurrah me soul says i, me shillelagh i let fly.', 'some galway boys were nigh and saw i was a hobble in,', 'with a load hurray ! joined in the affray.', 'we quitely cleared the way for the rocky road to dublin.', 'road and all the way to dublin, whack fol all the ra !', 'o see the fleet-foot host of men, who march with faces drawn,', 'from farmstead and from fishers cot, along the banks of ban;', 'they come with vengeance in their eyes. too late! too late are they,', 'for young roddy mccorley goes to die on the bridge of toome today.', 'oh ireland, mother ireland, you love them still the best', 'the fearless brave who fighting fall upon your hapless breast,', 'but never a one of all your dead more bravely fell in fray,', 'than he who marches to his fate on the bridge of toome today.', 'up the narrow street he stepped, so smiling, proud and young.', 'about the hemp-rope on his neck, the golden ringlets clung;', 'theres neer a tear in his blue eyes, fearless and brave are they,', 'as young roddy mccorley goes to die on the bridge of toome today.', 'when last this narrow street he trod, his shining pike in hand', 'behind him marched, in grim array, a earnest stalwart band.', 'to antrim town! to antrim town, he led them to the fray,', 'but young roddy mccorley goes to die on the bridge of toome today.', 'the grey coat and its sash of green were brave and stainless then,', 'a banner flashed beneath the sun over the marching men;', 'the coat hath many a rent this noon, the sash is torn away,', 'and roddy mccorley goes to die on the bridge of toome today.', 'oh, how his pike flashed in the sun! then found a foemans heart,', 'through furious fight, and heavy odds he bore a true mans part', 'and many a red-coat bit the dust before his keen pike-play,', 'but roddy mccorley goes to die on the bridge of toome today.', 'theres never a one of all your dead more bravely died in fray', 'than he who marches to his fate in toomebridge town today;', 'true to the last! true to the last, he treads the upwards way,', 'and young roddy mccorley goes to die on the bridge of toome today.', 'ive traveled all over this world', 'and now to another i go', 'and i know that good quarters are waiting', 'to welcome old rosin the bow', 'to welcome old rosin the bow.', 'when im dead and laid out on the counter', 'a voice you will hear from below', 'saying send down a hogshead of whiskey', 'to drink with old rosin the bow', 'to drink with old rosin the bow.', 'then get a half dozen stout fellows', 'and stack them all up in a row', 'let them drink out of half gallon bottles', 'to the memory of rosin the bow', 'to the memory of rosin the bow.', 'then get this half dozen stout fellows', 'and let them all stagger and go', 'and dig a great hole in the meadow', 'and in it put rosin the bow', 'and in it put rosin the bow.', 'then get ye a couple of bottles', 'put one at me head and me toe', 'with a diamond ring scratch upon them', 'the name of old rosin the bow', 'the name of old rosin the bow.', 'ive only this one consolation', 'as out of this world i go', 'i know that the next generation', 'will resemble old rosin the bow', 'will resemble old rosin the bow.', 'i fear that old tyrant approaching', 'that cruel remorseless old foe', 'and i lift up me glass in his honor', 'take a drink with old rosin the bow', 'take a drink with old rosin the bow.', 'he was stranded in a tiny town on fair prince edward isle', 'waiting for a ship to come and find him', 'a one horse place, a friendly face, some coffee and a tiny trace', 'of fiddlin in the distance far behind him', 'a dime across the counter then, a shy hello, a brand new friend', 'a walk along the street in the wintry weather', 'a yellow light, an open door, and a welcome friend, theres room for more', 'and then theyre standing there inside together', 'he said, ive heard that tune before somewhere but i cant remember when,', 'was it on some other friendly shore, did i hear it on the wind', 'was it written on the sky above, i think i heard it from someone i love', 'but i never heard a sound so sweet since then', 'and now his feet begin to tap, a little boy says, ill take your hat.', 'hes caught up in the magic of her smile', 'leap, the heart inside him went, and off across the floor he sent', 'his clumsy body, graceful as a child', 'he said, theres magic in the fiddlers arms and theres magic in this town', 'theres magic in the dancers feet and the way they put them down', 'people smiling everywhere, boots and ribbons, locks of hair', 'laughtcr, old blue suits and easter gowns', 'the sailors gone, the room is bare, the old pianos setting there', 'someones hats left hanging on the rack', 'the empty chair, the wooden floor that feels the touch of shoes no more', 'awaitin for the dancers to come back', 'and thc fiddles in the closet of some daughter of the town', 'the strings are broke, tbe bow is gone and the covers buttoned down', 'but sometimes on december nights, when the air is cold and the wind is right', 'theres a melody that passes through the town.', 'my young love said to me, my mother wont mind', 'and my father wont slight you for your lack of kind.', 'and she stepped away from me and this she did say', 'it will not be long, love, till our wedding day.', 'as she stepped away from me and she moved through the fair', 'and fondly i watched her move here and move there', 'and then she turned homeward with one star awake', 'like the swan in the evening moves over the lake.', 'the people were saying, no two eer were wed', 'but one had a sorrow that never was said', 'and i smiled as she passed with her goods and her gear', 'and that was the last that i saw of my dear.', 'last night she came to me, my dead love came in', 'so softly she came that her feet made no din', 'as she laid her hand on me and this she did say:', 'it will not be long, love, til our wedding day.', 'oh father dear, i oft-times hear you speak of erins isle', 'her lofty hills, her valleys green, her mountains rude and wild', 'they say she is a lovely land wherein a saint might dwell', 'so why did you abandon her, the reason to me tell.', 'oh son, i loved my native land with energy and pride', 'till a blight came oer the praties; my sheep, my cattle died', 'my rent and taxes went unpaid, i could not them redeem', 'and thats the cruel reason why i left old skibbereen.', 'oh well do i remember that bleak december day', 'the landlord and the sheriff came to take us all away', 'they set my roof on fire with their cursed english spleen', 'i heaved a sigh and bade goodbye to dear old skibbereen.', 'your mother too, god rest her soul, fell on the stony ground', 'she fainted in her anguish seeing desolation round', 'she never rose but passed away from life to immortal dream', 'she found a quiet grave, me boy, in dear old skibbereen.', 'and you were only two years old and feeble was your frame', 'i could not leave you with my friends for you bore your fathers name', 'i wrapped you in my cï¿½ta mï¿½r in the dead of night unseen', 'oh father dear, the day will come when in answer to the call', 'all irish men of freedom stern will rally one and all', 'ill be the man to lead the band beneath the flag of green', 'and loud and clear well raise the cheer, revenge for skibbereen!', 'be thou my vision, o lord of my heart', 'naught be all else to me save that thou art', 'thou my best thought by day or by night', 'waking or sleeping thy presence my light.', 'be thou my wisdom, thou my true word', 'i ever with thee, thou with me, lord', 'thou my great father, i thy true son', 'thou in me dwelling, and i with thee one.', 'be thou my battleshield, sword for the fight', 'be thou my dignity, thou my delight', 'thou my souls shelter, thou my high tower', 'raise thou me heavenward, o power of my power.', 'riches i heed not, nor mans empty praise', 'thou mine inheritance, now and always', 'thou and thou only, first in my heart', 'high king of heavem, my treasure thou art.', 'high king of heaven, after victory won', 'may i reach heavens joys, o bright heavens sun', 'heart of my own heart, whatever befall', 'still be my vision, o ruler of all.', 'last night as i lay dreaming of pleasant days gone by', 'my mind being bent on rambling to ireland i did fly', 'i stepped on board a vision and i followed with the wind', 'and i shortly came to anchor at the cross of spancil hill', 'it being the 23rd june the day before the fair', 'when lrelands sons and daughters in crowds assembled there', 'the young and the old, the brave and the bold their journey to fulfill', 'there were jovial conversations at the fair of spancil hill', 'i went to see my neighbors to hear what they might say', 'the old ones were all dead and gone and the young ones turning grey', 'i met with the tailor quigley, hes a bould as ever still', 'sure he used to make my britches when i lived in spancil hill', 'i paid a flying visit to my first and only love', 'shes as white as any lily and as gentle as a dove', 'she threw her arms around me saying johnny i love you still', 'oh shes ned the farmers daughter and the flower of spancil hiii', 'i dreamt i held and kissed her as in the days of yore', 'she said, johnny youre only joking like manys the time before', 'the cock he crew in the morning he crew both loud and shrill', 'and i awoke in california, many miles from spancil hill.', 'near banbridge town, in the county down', 'one morning in july', 'down a boreen green came a sweet colleen', 'and she smiled as she passed me by.', 'she looked so sweet from her two white feet', 'to the sheen of her nut-brown hair', 'such a coaxing elf, id to shake myself', 'to make sure i was standing there.', 'from bantry bay up to derry quay', 'and from galway to dublin town', 'no maid ive seen like the sweet colleen', 'that i met in the county down.', 'as she onward sped i shook my head', 'and i gazed with a feeling rare', 'and i said, says i, to a passerby', 'whos the maid with the nut-brown hair?', 'he smiled at me, and with pride says he,', 'thats the gem of irelands crown.', 'shes young rosie mccann from the banks of the bann', 'shes the star of the county down.', 'ive travelled a bit, but never was hit', 'since my roving career began', 'but fair and square i surrendered there', 'to the charms of young rose mccann.', 'id a heart to let and no tenant yet', 'did i meet with in shawl or gown', 'but in she went and i asked no rent', 'from the star of the county down.', 'at the crossroads fair ill be surely there', 'and ill dress in my sunday clothes', 'and ill try sheeps eyes, and deludhering lies', 'on the heart of the nut-brown rose.', 'no pipe ill smoke, no horse ill yoke', 'though with rust my plow turns brown', 'till a smiling bride by my own fireside', 'sits the star of the county down.', 'it was early, early in the spring', 'the birds did whistle and sweetly sing', 'changing their notes from tree to tree', 'and the song they sang was old ireland free.', 'it was early early in the night,', 'the yeoman cavalry gave me a fright', 'the yeoman cavalry was my downfall', 'and i was taken by lord cornwall.', 'twas in the guard-house where i was laid,', 'and in a parlour where i was tried', 'my sentence passed and my courage low', 'when to dungannon i was forced to go.', 'as i was passing my fathers door', 'my brother william stood at the door', 'my aged father stood at the door', 'and my tender mother her hair she tore.', 'as i was going up wexford street', 'my own first cousin i chanced to meet;', 'my own first cousin did me betray', 'and for one bare guinea swore my life away.', 'as i was walking up wexford hill', 'who could blame me to cry my fill?', 'i looked behind, and i looked before', 'but my aged mother i shall see no more.', 'and as i mounted the platform high', 'my aged father was standing by;', 'my aged father did me deny', 'and the name he gave me was the croppy boy.', 'it was in dungannon this young man died', 'and in dungannon his body lies.', 'and you good people that do pass by', 'oh shed a tear for the croppy boy.', 'one morning early i walked forth', 'by the margin of lough leane', 'the sunshine dressed the trees in green', 'and summer bloomed again', 'i left the town and wandered on', 'through fields all green and gay', 'and whom should i meet but a colleen sweet', 'at the dawning of the day.', 'no cap or cloak this maiden wore', 'her neck and feet were bare', 'down to the grass in ringlets fell', 'her glossy golden hair', 'a milking pail was in her hand', 'she was lovely, young and gay', 'she wore the palm from venus bright', 'by the dawning of the day.', 'on a mossy bank i sat me down', 'with the maiden by my side', 'with gentle words i courted her', 'and asked her to be my bride', 'she said, young man dont bring me blame', 'and swiftly turned away', 'and the morning light was shining bright', 'by a lonely prison wall', 'i heard a sweet voice calling,', 'danny, they have taken you away.', 'for you stole travelians corn,', 'that your babes might see the morn,', 'now a prison ship lies waiting in the bay.', 'fair lie the fields of athenry', 'where once we watched the small freebirds fly.', 'our love grew with the spring,', 'we had dreams and songs to sing', 'as we wandered through the fields of athenry.', 'i heard a young man calling', 'nothing matters, jenny, when youre free', 'against the famine and the crown,', 'i rebelled, they ran me down,', 'now you must raise our children without me.', 'on the windswept harbour wall,', 'she watched the last star rising', 'as the prison ship sailed out across the sky', 'but shell watch and hope and pray,', 'for her love in botany bay', 'whilst she is lonely in the fields of athenry.', 'oh, a wan cloud was drawn oer the dim weeping dawn', 'as to shannons side i returnd at last', 'and the heart in my breast for the girl i lovd best', 'was beating, ah, beating, loud and fast!', 'while the doubts and the fears of the long aching years', 'seemd mingling their voices with the moaning flood', 'till full in my path, like a wild water wrath', 'my true loves shadow lamenting stood.', 'but the sudden sun kissd the cold, cruel mist', 'into dancing showrs of diamond dew', 'and the dark flowing stream laughd back to his beam', 'and the lark soared aloft in the blue', 'while no phantom of night but a form of delight', 'ran with arms outspread to her darling boy', 'and the girl i love best on my wild throbbing breast', 'hid her thousand treasures with cry of joy.', 'gather up the pots and the old tin cans', 'the mash, the corn, the barley and the bran.', 'run like the devil from the excise man', 'keep the smoke from rising, barney.', 'keep your eyes well peeled today', 'the excise men are on their way', 'searching for the mountain tay', 'in the hills of connemara.', 'swinging to the left, swinging to the right', 'the excise men will dance all night', 'drinkin up the tay till the broad daylight', 'a gallon for the butcher and a quart for john', 'and a bottle for poor old father tom', 'just to help the poor old dear along', 'stand your ground, for its too late', 'the excise men are at the gate.', 'glory be to paddy, but theyre drinkin it straight', 'im sitting on the stile, mary, where we once sat side by side', 'on a bright may morning long ago, when first you were my bride', 'the corn was springing fresh and green, and the lark sang loud and high', 'and the red was on your lips, mary, and the love light in your eyes.', 'tis but a step down yonder lane, the village church stands near', 'the place where we were wed, mary, i can see the spire from here', 'but the graveyard lies between, mary, and my step might break your rest', 'where i laid you darling down to sleep with a baby on your breast.', 'im very lonely now, mary, for the poor make no new friends', 'but oh they love the better still the few our father sends', 'for you were all i had, mary, my blessing and my pride', 'and ive nothing left to care for now since my poor mary died.', 'yours was the good brave heart, mary, that still kept hoping on', 'when the trust in god had left my soul and my arms young strength had gone', 'there was comfort ever on your lip and a kind look on your brow', 'and i thank you mary for the same though you cannot hear me now.', 'im bidding you a long farewell, my mary kind and true', 'but ill not forget you, darling, in the land im going to', 'they say theres bread and work for all, and the sun shines always there', 'but ill neer forget old ireland, were it fifty times as fair.', 'and often in those grand old woods ill sit and shut my eyes', 'and my heart will wander back again to the place where mary lies', 'and i think ill see that little stile where we sat side by side', 'in the springing corn and the bright may morn when first you were my bride.', 'when i was at home i was merry and frisky,', 'my dad kept a pig and my mother sold whisky,', 'my uncle was rich, but never would by aisey', 'till i was enlisted by corporal casey.', 'och! rub a dub, row de dow, corporal casey,', 'my dear little shelah, i thought would run crazy,', 'when i trudged away with tough corporal casey.', 'i marched from kilkenny, and, as i was thinking', 'on shelah, my heart in my bosom was sinking,', 'but soon i was forced to look fresh as a daisy,', 'for fear of a drubbing from corporal casey.', 'och! rub a dub, row de dow, corporal casey!', 'the devil go with him, i neer could be lazy,', 'he struck my shirts so, ould corporal casey.', 'we went into battle, i took the blows fairly', 'that fell on my pate, but they bothered me rarely,', 'and who should the first be that dropped, why, and please ye,', 'it was my good friend, honest corporal casey.', 'thinks i you are quiet, and i shall be aisey,', 'so eight years i fought without corporal casey.', 'i am a little beggarman, a begging i have been', 'for three score years in this little isle of green', 'im known along the liffey from the basin to the zoo', 'and everybody calls me by the name of johnny dhu.', 'of all the trades a going, sure the begging is the best', 'for when a man is tired he can sit him down and rest', 'he can beg for his dinner, he has nothing else to do', 'but to slip around the corner with his old rigadoo.', 'i slept in a barn one night in currabawn', 'a shocking wet night it was, but i slept until the dawn', 'there was holes in the roof and the raindrops coming thru', 'and the rats and the cats were a playing peek a boo.', 'who did i waken but the woman of the house', 'with her white spotted apron and her calico blouse', 'she began to frighten and i said boo', 'sure, dont be afraid at all, its only johnny dhu.', 'i met a little girl while a walkin out one day', 'good morrow little flaxen haired girl, i did say', 'good morrow little beggarman and how do you do', 'with your rags and your tags and your auld rigadoo.', 'ill buy a pair of leggins and a collar and a tie', 'and a nice young lady ill go courting by and by', 'ill buy a pair of goggles and ill color them with blue', 'and an old fashioned lady i will make her too.', 'so all along the high road with my bag upon my back', 'over the fields with my bulging heavy sack', 'with holes in my shoes and my toes a peeping thru', 'singing, skin a ma rink a doodle with my auld rigadoo.', 'o i must be going to bed for its getting late at night', 'the fire is all raked and now tis out of light', 'for now youve heard the story of my auld rigadoo', 'so good and god be with you, from auld johnny dhu.', 'oh, the days of the kerry dancing', 'oh, the ring of the pipers tune', 'oh, for one of those hours of gladness', 'gone, alas, like our youth, too soon!', 'when the boys began to gather', 'in the glen of a summers night', 'and the kerry pipers tuning', 'made us long with wild delight!', 'oh, to think of it', 'oh, to dream of it', 'fills my heart with tears!', 'was there ever a sweeter colleen', 'in the dance than eily more', 'or a prouder lad than thady', 'as he boldly took the floor.', 'lads and lasses to your places', 'up the middle and down again', 'ah, the merry hearted laughter', 'ringing through the happy glen!', 'time goes on, and the happy years are dead', 'and one by one the merry hearts are fled', 'silent now is the wild and lonely glen', 'where the bright glad laugh will echo neer again', 'only dreaming of days gone by in my heart i hear.', 'loving voices of old companions', 'stealing out of the past once more', 'and the sound of the dear old music', 'soft and sweet as in days of yore.', 'dear thoughts are in my mind', 'and my soul soars enchanted,', 'as i hear the sweet lark sing', 'in the clear air of the day.', 'for a tender beaming smile', 'to my hope has been granted,', 'and tomorrow she shall hear', 'all my fond heart would say.', 'i shall tell her all my love,', 'all my souls adoration,', 'and i think she will hear', 'and will not say me nay.', 'it is this that gives my soul', 'all its joyous elation,', 'its cold and raw, the north winds blow', 'black in the morning early', 'when all the hills were covered with snow', 'oh then it was winter fairly.', 'as i was riding oer the moor', 'i met a farmers daughter', 'her cherry cheeks and coal-black hair', 'they caused my heart to falter.', 'i bowed my bonnet very low', 'to let her know my meaning.', 'she answered with a courteous smile', 'her looks they were engaging.', 'where are you bound my pretty maid', 'its now in the morning early?', 'the answer that she gave to me', 'kind sir, to sell my barley.', 'now twenty guineas ive in my purse', 'and twenty more thats yearly.', 'you need not go to the market town', 'for ill buy all your barley.', 'if twenty guineas would gain the heart', 'of the maid i love so dearly', 'all for to tarry with me one night', 'and go home in the morning early.', 'the very evening after', 'it was my fortune for to meet', 'the farmers only daughter.', 'although the weather being cold and raw', 'with her i thought to parlay', 'the answer that she gave to me:', 'kind sir, ive sold my barley.', 'the minstrel boy to the war is gone', 'in the ranks of death you will find him', 'his fathers sword he hath girded on', 'and his wild harp slung behind him', 'land of song! said the warrior bard', 'tho all the world betrays thee', 'one sword, at least, thy rights shall guard', 'one faithful harp shall praise thee!', 'the minstrel fell! but the foemans chain', 'could not bring that proud soul under', 'the harp he lovd neer spoke again', 'for he tore its chords asunder', 'and said no chains shall sully thee', 'thou soul of love and bravry!', 'thy songs were made for the pure and free,', 'they shall never sound in slavery!', 'oh mary this londons a wonderful sight', 'with people here workin by day and by night', 'they dont sow potatoes, nor barley, nor wheat', 'but theres gangs of them diggin for gold in the street', 'at least when i asked them thats what i was told', 'so i just took a hand at this diggin for gold', 'but for all that i found there i might as well be', 'where the mountains of mourne sweep down to the sea.', 'i believe that when writin a wish you expressed', 'as to how the fine ladies in london were dressed', 'well if youll believe me, when asked to a ball', 'they dont wear no top to their dresses at all', 'oh ive seen them meself and you could not in truth', 'say that if they were bound for a ball or a bath', 'dont be startin them fashions, now mary mccree', 'theres beautiful girls here, oh never you mind', 'with beautiful shapes nature never designed', 'and lovely complexions all roses and cream', 'but let me remark with regard to the same', 'that if that those roses you venture to sip', 'the colors might all come away on your lip', 'so ill wait for the wild rose thats waitin for me', 'in the place where the dark mourne sweeps down to the sea.', 'beauing, belling, dancing, drinking,', 'breaking windows, cursing, sinking', 'every raking, never thinking,', 'live the rakes of mallow,', 'spending faster than it comes,', 'beating waiters bailiffs, duns,', 'bacchus true begotten sons,', 'live the rakes of mallow.', 'one time naught but claret drinking,', 'then like politicians, thinking', 'to raise the sinking funds when sinking.', 'when at home, with da-da dying,', 'still for mellow water crying,', 'but, where theres good claret plying', 'live the rakes of mallow.  ', 'when at home with dadda dying,', 'still for mallow-water crying,', 'but where there is good claret plying', 'living short but merry lives,', 'going where the devil drives,', 'having sweethearts, but no wives,', 'racking tenants stewards teasing,', 'swiftly spending, slowly raising,', 'wishing to spend all their days in', 'raking as at mallow.', 'then to end this raking life,', 'they get sober, take a wife,', 'ever after live in strife,', 'and wish again for mallow.', 'how sweet is to roam by the sunny shure stream', 'and hear the doves coo neath the morning sunbeam', 'where the thrush and the robin their sweet notes entwine', 'on the banks of the shure that flows down by mooncoin.', 'flow on, lovely river, flow gently along', 'by your waters so sweet sounds the larks merry song', 'on your green banks i wander where first i did join', 'with you, lovely molly, the rose of mooncoin.', 'oh molly, dear molly, it breaks my fond heart', 'to know that we two forever must part', 'ill think of you molly while sun and moon shine', 'then heres to the shure with its valley so fair', 'as oftimes we wandered in the cool morning air', 'where the roses are blooming and lilies entwine', 'the pale moon was rising above the green mountain', 'the sun was declining beneath the blue sea', 'when i strayed with my love to the pure crystal fountain', 'that stands in beautiful vale of tralee.', 'she was lovely and fair as the rose of the summer', 'yet, twas not her beauty alone that won me', 'oh no! twas the the truth in her eye ever beaming', 'that made me love mary, the rose of tralee.', 'the cool shades of evening their mantle were spreading', 'and mary all smiling was listening to me', 'the moon through the valley her pale rays was shedding', 'when i won the heart of the rose of tralee.', 'though lovely and fair as the rose of the summer', 'mellow the moonlight to shine is beginning', 'close by the window young eileen is spinning', 'bent oer the fire her blind grandmother sitting', 'crooning and moaning and drowsily knitting.', 'merrily cheerily noiselessly whirring', 'spins the wheel, rings the wheel while the foots stirring', 'sprightly and lightly and merrily ringing', 'sounds the sweet voice of the young maiden singing.', 'eileen, a chara, i hear someone tapping', 'tis the ivy dear mother against the glass flapping', 'eileen, i surely hear somebody sighing', 'tis the sound mother dear of the autumn winds dying.', 'whats the noise i hear at the window i wonder?', 'tis the little birds chirping, the holly-bush under', 'what makes you shoving and moving your stool on', 'and singing all wrong the old song of the coolin?', 'theres a form at the casement, the form of her true love', 'and he whispers with face bent, im waiting for you love', 'get up from the stool, through the lattice step lightly', 'and well rove in the grove while the moons shining brightly.', 'the maid shakes her head, on her lips lays her fingers', 'steps up from the stool, longs to go and yet lingers', 'a frightened glance turns to her drowsy grandmother', 'puts her foot on the stool spins the wheel with the other', 'lazily, easily, now swings the wheel round', 'slowly and lowly is heard now the reels sound', 'noiseless and light to the lattice above her', 'the maid steps, then leaps to the arms of her lover.', 'slower... and slower... and slower the wheel swings', 'lower... and lower... and lower the reel rings', 'ere the reel and the wheel stop their ringing and moving', 'through the grove the young lovers by moonlight are roving.', 'as i roved out one morning', 'near the verdant braes of skreen', 'i put my back to the mossy tree', 'to view the dew on the west countrie', 'the dew on the foreign strand.', 'o sit ye down on the grass, he said', 'on the dewy grass so green', 'for the wee birds all have come and gone', 'since i my true love seen, he said', 'since i my true love seen.', 'o ill not sit on the grass, she said', 'no lover ill be of thine', 'for i hear you love a connaught maid', 'and your hearts no longer mine, she said', 'and your hearts no longer mine.', 'o i will climb a high high tree', 'and ill rob a wild birds nest', 'and back ill bring what i find there', 'to the arms that i love best, he said', 'to the arms that i love best.', 'the water is wide, i cannot get oer', 'neither have i wings to fly', 'give me a boat that can carry two', 'and both shall row, my love and i', 'a ship there is and she sails the sea', 'shes loaded deep as deep can be', 'but not so deep as the love im in', 'i know not if i sink or swim', 'i leaned my back against an oak', 'thinking it was a trusty tree', 'but first it bent and then it broke', 'so did my love prove false to me', 'i reached my finger into some soft bush', 'thinking the fairest flower to find', 'i pricked my finger to the bone', 'and left the fairest flower behind', 'oh love be handsome and love be kind', 'gay as a jewel when first it is new', 'but love grows old and waxes cold', 'and fades away like the morning dew', 'must i go bound while you go free', 'must i love a man who doesnt love me', 'must i be born with so little art', 'as to love a man wholl break my heart', 'when cockle shells turn silver bells', 'then will my love come back to me', 'when roses bloom in winters gloom', 'then will my love return to me', 'o paddy dear, and did ye hear the news thats goin round?', 'the shamrock is by law forbid to grow on irish ground!', 'no more saint patricks day well keep, his color cant be seen', 'for theres a cruel law agin the wearin o the green.', 'i met with napper tandy, and he took me by the hand', 'and he said, hows poor old ireland, and how does she stand?', 'shes the most distressful country that ever yet was seen', 'for theyre hanging men and women there for the wearin o the green.', 'so if the color we must wear be englands cruel red', 'let it remind us of the blood that irishmen have shed', 'and pull the shamrock from your hat, and throw it on the sod', 'but never fear, twill take root there, though underfoot tis trod.', 'when laws can stop the blades of grass from growin as they grow', 'and when the leaves in summer-time their color dare not show', 'then i will change the color too i wear in my caubeen', 'but till that day, please god, ill stick to the wearin o the green.', 'ive been a wild rover for many a year', 'and i spent all my money on whiskey and beer,', 'and now im returning with gold in great store', 'and i never will play the wild rover no more.', 'and its no, nay, never,', 'no nay never no more,', 'will i play the wild rover', 'no never no more.', 'i went to an ale-house i used to frequent', 'and i told the landlady my money was spent.', 'i asked her for credit, she answered me nay', 'such a custom as yours i could have any day.', 'i took from my pocket ten sovereigns bright', 'and the landladys eyes opened wide with delight.', 'she said i have whiskey and wines of the best', 'and the words that i spoke sure were only in jest.', 'ill go home to my parents, confess what ive done', 'and ill ask them to pardon their prodigal son.', 'and if they caress (forgive) me as ofttimes before', 'sure i never will play the wild rover no more.', 'theres a tear in your eye,', 'and im wondering why,', 'for it never should be there at all.', 'with such powr in your smile,', 'sure a stone youd beguile,', 'so theres never a teardrop should fall.', 'when your sweet lilting laughters', 'like some fairy song,', 'and your eyes twinkle bright as can be;', 'you should laugh all the while', 'and all other times smile,', 'and now, smile a smile for me.', 'when irish eyes are smiling,', 'sure, tis like the morn in spring.', 'in the lilt of irish laughter', 'you can hear the angels sing.', 'when irish hearts are happy,', 'all the world seems bright and gay.', 'and when irish eyes are smiling,', 'sure, they steal your heart away.', 'for your smile is a part', 'of the love in your heart,', 'and it makes even sunshine more bright.', 'like the linnets sweet song,', 'crooning all the day long,', 'comes your laughter and light.', 'for the springtime of life', 'is the sweetest of all', 'there is neer a real care or regret;', 'and while springtime is ours', 'throughout all of youths hours,', 'let us smile each chance we get.', 'as i was a-goin over gilgarra mountain', 'i spied colonel farrell, and his money he was countin.', 'first i drew my pistols and then i drew my rapier,', 'sayin stand and deliver, for i am your bold receiver.', 'musha ringum duram da,', 'whack fol the daddy-o,', 'he counted out his money and it made a pretty penny;', 'i put it in my pocket to take home to darlin jenny.', 'she sighed and swore she loved me and never would deceive me,', 'bu the devil take the women, for they always lie so easy!', 'musha rungum duram da', 'i went into me chamber all for to take a slumber,', 'to dream of gold and girls, and of course it was no wonder:', 'me jenny took me charges and she filled them up with water,', 'called on colonel farrell to get ready for the slaughter.', 'next mornin early, before i rose for travel,', 'a-came a band of footmen and likewise colonel farrell.', 'i goes to draw my pistol, for shed stole away my rapier,', 'but a prisoner i was taken, i couldnt shoot the water.', 'they put me into jail with a judge all a-writin:', 'for robbin colonel farrell on gilgarra mountain.', 'but they didnt take me fists and i knocked the jailer down', 'and bid a farewell to this tight-fisted town.', 'musha ringum duram da', 'id like to find me brother, the one whos in the army;', 'i dont know where hes stationed, be it cork or in killarney.', 'together wed go roamin oer the mountains of kilkenny,', 'and i swear hed treat me fairer than my darlin sportin jenny!', 'theres some takes delight in the carriages and rollin,', 'some takes delight in the hurley or the bollin,', 'but i takes delight in the juice of the barley,', 'courtin pretty maids in the mornin, o so early!', 'oh the summertime is coming', 'and the trees are sweetly blooming', 'and the wild mountain thyme', 'grows around the blooming heather', 'will ye go, lassie go?', 'and well all go together', 'to pluck wild mountain thyme', 'all around the blooming heather', 'i will build my love a tower', 'near yon pure crystal fountain', 'and on it i will build', 'all the flowers of the mountain', 'if my true love she were gone', 'i would surely find another', 'where wild mountain thyme', '']\n"
     ]
    }
   ],
   "source": [
    "# Load the dataset\n",
    "data = open('./irish-lyrics-eof.txt').read()\n",
    "\n",
    "# Lowercase and split the text\n",
    "corpus = data.lower().split(\"\\n\")\n",
    "\n",
    "# Preview the result\n",
    "print(corpus)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "id": "EkP2CP0qP8RD"
   },
   "source": [
    "From here, you can initialize the `Tokenizer` class and generate the word index dictionary:"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 5,
   "metadata": {
    "id": "PRnDnCW-Z7qv"
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "word index dictionary: {'the': 1, 'and': 2, 'i': 3, 'to': 4, 'a': 5, 'of': 6, 'my': 7, 'in': 8, 'me': 9, 'for': 10, 'you': 11, 'all': 12, 'was': 13, 'she': 14, 'that': 15, 'on': 16, 'with': 17, 'her': 18, 'but': 19, 'as': 20, 'when': 21, 'love': 22, 'is': 23, 'your': 24, 'it': 25, 'will': 26, 'from': 27, 'by': 28, 'they': 29, 'be': 30, 'are': 31, 'so': 32, 'he': 33, 'old': 34, 'no': 35, 'oh': 36, 'ill': 37, 'at': 38, 'one': 39, 'his': 40, 'there': 41, 'were': 42, 'heart': 43, 'down': 44, 'now': 45, 'we': 46, 'where': 47, 'young': 48, 'never': 49, 'go': 50, 'come': 51, 'then': 52, 'did': 53, 'not': 54, 'said': 55, 'away': 56, 'their': 57, 'sweet': 58, 'them': 59, 'green': 60, 'if': 61, 'take': 62, 'our': 63, 'like': 64, 'night': 65, 'day': 66, 'o': 67, 'out': 68, 'fair': 69, 'this': 70, 'town': 71, 'have': 72, 'can': 73, 'true': 74, 'its': 75, 'thou': 76, 'see': 77, 'dear': 78, 'more': 79, 'theres': 80, 'or': 81, 'had': 82, 'would': 83, 'over': 84, 'hear': 85, 'up': 86, 'ive': 87, 'through': 88, 'home': 89, 'again': 90, 'well': 91, 'oer': 92, 'land': 93, 'good': 94, 'im': 95, 'ye': 96, 'sea': 97, 'left': 98, 'still': 99, 'father': 100, 'long': 101, 'rose': 102, 'could': 103, 'morning': 104, 'wild': 105, 'who': 106, 'eyes': 107, 'came': 108, 'while': 109, 'too': 110, 'back': 111, 'little': 112, 'an': 113, 'took': 114, 'him': 115, 'bow': 116, 'first': 117, 'let': 118, 'man': 119, 'shall': 120, 'know': 121, 'get': 122, 'high': 123, 'gone': 124, 'say': 125, 'ever': 126, 'some': 127, 'mary': 128, 'hand': 129, 'till': 130, 'put': 131, 'own': 132, 'time': 133, 'heard': 134, 'dead': 135, 'may': 136, 'bright': 137, 'mountain': 138, 'early': 139, 'rosin': 140, 'gave': 141, 'thee': 142, 'only': 143, 'far': 144, 'maid': 145, 'must': 146, 'find': 147, 'girl': 148, 'sure': 149, 'round': 150, 'dublin': 151, 'once': 152, 'world': 153, 'delight': 154, 'last': 155, 'johnny': 156, 'seen': 157, 'has': 158, 'fine': 159, 'road': 160, 'mother': 161, 'tis': 162, 'what': 163, 'way': 164, 'moon': 165, 'soul': 166, 'neer': 167, 'id': 168, 'just': 169, 'thats': 170, 'days': 171, 'darling': 172, 'went': 173, 'white': 174, 'die': 175, 'than': 176, 'hair': 177, 'goes': 178, 'meet': 179, 'today': 180, 'do': 181, 'girls': 182, 'shes': 183, 'thyme': 184, 'thy': 185, 'sing': 186, 'pretty': 187, 'new': 188, 'poor': 189, 'into': 190, 'life': 191, 'irish': 192, 'give': 193, 'boy': 194, 'youre': 195, 'make': 196, 'passed': 197, 'lovely': 198, 'black': 199, 'youll': 200, 'died': 201, 'red': 202, 'smile': 203, 'keep': 204, 'loves': 205, 'free': 206, 'leave': 207, 'friends': 208, 'each': 209, 'saw': 210, 'behind': 211, 'song': 212, 'ra': 213, 'dont': 214, 'arms': 215, 'am': 216, 'sun': 217, 'saying': 218, 'made': 219, 'wish': 220, 'cold': 221, 'met': 222, 'before': 223, 'should': 224, 'rocky': 225, 'light': 226, 'wid': 227, 'boys': 228, 'best': 229, 'fields': 230, 'since': 231, 'ball': 232, 'water': 233, 'casey': 234, 'mind': 235, 'along': 236, 'loved': 237, 'place': 238, 'ireland': 239, 'next': 240, 'three': 241, 'many': 242, 'years': 243, 'door': 244, 'us': 245, 'drink': 246, 'got': 247, 'might': 248, 'live': 249, 'roses': 250, 'play': 251, 'soon': 252, 'ground': 253, 'times': 254, 'spent': 255, 'going': 256, 'tree': 257, 'barley': 258, 'grass': 259, 'kind': 260, 'twas': 261, 'bridge': 262, 'around': 263, 'blue': 264, 'tell': 265, 'row': 266, 'how': 267, 'money': 268, 'merry': 269, 'stepped': 270, 'corporal': 271, 'always': 272, 'though': 273, 'near': 274, 'taken': 275, 'ones': 276, 'daughter': 277, 'forever': 278, 'loo': 279, 'shining': 280, 'plenty': 281, 'hes': 282, 'ship': 283, 'banks': 284, 'think': 285, 'very': 286, 'stand': 287, 'heres': 288, 'snow': 289, 'mountains': 290, 'molly': 291, 'wheel': 292, 'street': 293, 'erin': 294, 'side': 295, 'feet': 296, 'star': 297, 'look': 298, 'brave': 299, 'woman': 300, 'sons': 301, 'two': 302, 'says': 303, 'asked': 304, 'lanigans': 305, 'singing': 306, 'men': 307, 'toome': 308, 'stole': 309, 'god': 310, 'hill': 311, 'lonely': 312, 'lover': 313, 'tears': 314, 'fathers': 315, 'low': 316, 'voice': 317, 'quite': 318, 'able': 319, 'nice': 320, 'laid': 321, 'comrades': 322, 'wind': 323, 'another': 324, 'sit': 325, 'face': 326, 'band': 327, 'call': 328, 'colleen': 329, 'until': 330, 'hills': 331, 'mine': 332, 'above': 333, 'upon': 334, 'eer': 335, 'youve': 336, 'fly': 337, 'been': 338, 'late': 339, 'alive': 340, 'ballyjamesduff': 341, 'looked': 342, 'great': 343, 'why': 344, 'every': 345, 'proud': 346, 'found': 347, 'bragh': 348, 'such': 349, 'birds': 350, 'wedding': 351, 'welcome': 352, 'dancing': 353, 'da': 354, 'fell': 355, 'thinking': 356, 'roddy': 357, 'mccorley': 358, 'smiling': 359, 'mallow': 360, 'blooming': 361, 'thought': 362, 'peace': 363, 'soft': 364, 'pure': 365, 'harp': 366, 'dream': 367, 'alas': 368, 'yet': 369, 'clear': 370, 'art': 371, 'off': 372, 'hope': 373, 'fought': 374, 'mothers': 375, 'shore': 376, 'ago': 377, 'fol': 378, 'de': 379, 'house': 380, 'married': 381, 'bound': 382, 'danced': 383, 'devil': 384, 'dawning': 385, 'makes': 386, 'same': 387, 'sat': 388, 'any': 389, 'glass': 390, 'gay': 391, 'relations': 392, 'evening': 393, 'watched': 394, 'right': 395, 'fellows': 396, 'whiskey': 397, 'bonnie': 398, 'grows': 399, 'women': 400, 'flowers': 401, 'beauty': 402, 'cannot': 403, 'handsome': 404, 'happy': 405, 'gold': 406, 'rover': 407, 'none': 408, 'doneen': 409, 'summers': 410, 'people': 411, 'set': 412, 'paddy': 413, 'morn': 414, 'most': 415, 'easy': 416, 'struck': 417, 'beautiful': 418, 'those': 419, 'golden': 420, 'run': 421, 'pipes': 422, 'glen': 423, 'dying': 424, 'here': 425, 'wall': 426, 'across': 427, 'fire': 428, 'eileen': 429, 'longer': 430, 'cheeks': 431, 'valley': 432, 'both': 433, 'dew': 434, 'care': 435, 'bride': 436, 'nothing': 437, 'wont': 438, 'theyre': 439, 'colonel': 440, 'maiden': 441, 'shed': 442, 'til': 443, 'brown': 444, 'breast': 445, 'corn': 446, 'sinking': 447, 'began': 448, 'name': 449, 'cruel': 450, 'sound': 451, 'spancil': 452, 'county': 453, 'lies': 454, 'color': 455, 'thing': 456, 'decay': 457, 'sleep': 458, 'hours': 459, 'loving': 460, 'weary': 461, 'ringing': 462, 'please': 463, 'forget': 464, 'lie': 465, 'ran': 466, 'tore': 467, 'country': 468, 'fear': 469, 'fortune': 470, 'kissed': 471, 'alone': 472, 'ould': 473, 'cry': 474, 'dreams': 475, 'used': 476, 'horse': 477, 'break': 478, 'bells': 479, 'didnt': 480, 'weeks': 481, 'without': 482, 'raw': 483, 'nor': 484, 'twenty': 485, 'tune': 486, 'hed': 487, 'roving': 488, 'leaves': 489, 'cant': 490, 'death': 491, 'ten': 492, 'prison': 493, 'judge': 494, 'against': 495, 'lads': 496, 'shell': 497, 'fill': 498, 'valleys': 499, 'other': 500, 'pale': 501, 'joy': 502, 'wide': 503, 'bring': 504, 'ah': 505, 'cliffs': 506, 'city': 507, 'end': 508, 'turn': 509, 'sky': 510, 'born': 511, 'knew': 512, 'smiled': 513, 'rosie': 514, 'comes': 515, 'sayin': 516, 'lord': 517, 'dungannon': 518, 'blood': 519, 'air': 520, 'danny': 521, 'calling': 522, 'sunshine': 523, 'spring': 524, 'bid': 525, 'grow': 526, 'truth': 527, 'tear': 528, 'rings': 529, 'guns': 530, 'bay': 531, 'oflynn': 532, 'och': 533, 'stick': 534, 'rest': 535, 'four': 536, 'jewel': 537, 'tried': 538, 'grief': 539, 'answer': 540, 'kathleen': 541, 'fond': 542, 'eye': 543, 'goin': 544, 'pistols': 545, 'musha': 546, 'whack': 547, 'creole': 548, 'together': 549, 'room': 550, 'fall': 551, 'swore': 552, 'being': 553, 'step': 554, 'lark': 555, 'cailã\\xadn': 556, 'deas': 557, 'crãºite': 558, 'na': 559, 'mbã³': 560, 'sir': 561, 'isle': 562, 'waiting': 563, 'magic': 564, 'skibbereen': 565, 'loud': 566, 'raise': 567, 'bent': 568, 'aged': 569, 'summer': 570, 'jenny': 571, 'excise': 572, 'rigadoo': 573, 'auld': 574, 'hearts': 575, 'nay': 576, 'stool': 577, 'farrell': 578, 'garden': 579, 'precious': 580, 'child': 581, 'slumber': 582, 'sleeping': 583, 'watch': 584, 'gently': 585, 'minstrel': 586, 'praise': 587, 'bell': 588, 'shaken': 589, 'immortal': 590, 'pray': 591, 'stay': 592, 'spoke': 593, 'cross': 594, 'brothers': 595, 'much': 596, 'past': 597, 'killarney': 598, 'sang': 599, 'tones': 600, 'ral': 601, 'wander': 602, 'cot': 603, 'feel': 604, 'yore': 605, 'answered': 606, 'divil': 607, 'middle': 608, 'bit': 609, 'led': 610, 'soldiers': 611, 'lily': 612, 'bed': 613, 'lassie': 614, 'clothes': 615, 'return': 616, 'broken': 617, 'derry': 618, 'sighed': 619, 'english': 620, 'tomorrow': 621, 'souls': 622, 'van': 623, 'diemans': 624, 'law': 625, 'neither': 626, 'winds': 627, 'rather': 628, 'doesnt': 629, 'rosy': 630, 'neatest': 631, 'hands': 632, 'whereon': 633, 'stands': 634, 'write': 635, 'thousand': 636, 'fare': 637, 'youd': 638, 'velvet': 639, 'neat': 640, 'landed': 641, 'health': 642, 'kellswater': 643, 'quiet': 644, 'stars': 645, 'beside': 646, 'warm': 647, 'sunday': 648, 'grey': 649, 'ocean': 650, 'sad': 651, 'spend': 652, 'kilkenny': 653, 'silver': 654, 'view': 655, 'west': 656, 'plain': 657, 'barrow': 658, 'broad': 659, 'narrow': 660, 'crying': 661, 'wonder': 662, 'save': 663, 'stop': 664, 'tender': 665, 'told': 666, 'lip': 667, 'dance': 668, 'foot': 669, 'kilrain': 670, 'saint': 671, 'visit': 672, 'mossy': 673, 'wexford': 674, 'irishmen': 675, 'shadow': 676, 'tho': 677, 'salley': 678, 'gardens': 679, 'foolish': 680, 'youth': 681, 'fade': 682, 'war': 683, 'believe': 684, 'which': 685, 'change': 686, 'entwine': 687, 'turns': 688, 'turned': 689, 'crown': 690, 'played': 691, 'captain': 692, 'blow': 693, 'children': 694, 'slainte': 695, 'gentle': 696, 'heavens': 697, 'bloom': 698, 'grand': 699, 'bush': 700, 'nest': 701, 'rich': 702, 'parting': 703, 'better': 704, 'window': 705, 'haste': 706, 'fresh': 707, 'stream': 708, 'rays': 709, 'ma': 710, 'ring': 711, 'lad': 712, 'athy': 713, 'drop': 714, 'hardly': 715, 'done': 716, 'arm': 717, 'leg': 718, 'beg': 719, 'drew': 720, 'bold': 721, 'drawn': 722, 'jail': 723, 'writin': 724, 'farewell': 725, 'tired': 726, 'lake': 727, 'want': 728, 'ringlets': 729, 'myself': 730, 'songs': 731, 'reel': 732, 'steps': 733, 'hearty': 734, 'fainted': 735, 'called': 736, 'under': 737, 'toe': 738, 'mairi': 739, 'fairest': 740, 'darlin': 741, 'bird': 742, 'memory': 743, 'lips': 744, 'sweetly': 745, 'morrow': 746, 'consent': 747, 'else': 748, 'sold': 749, 'stout': 750, 'pair': 751, 'drinking': 752, 'meself': 753, 'fray': 754, 'pike': 755, 'coat': 756, 'beneath': 757, 'rent': 758, 'part': 759, 'half': 760, 'head': 761, 'friend': 762, 'standing': 763, 'floor': 764, 'bare': 765, 'wed': 766, 'son': 767, 'pride': 768, 'vision': 769, 'sword': 770, 'after': 771, 'won': 772, 'farmers': 773, 'flower': 774, 'nut': 775, 'surely': 776, 'stood': 777, 'wandered': 778, 'athenry': 779, 'rising': 780, 'beating': 781, 'form': 782, 'dhu': 783, 'buy': 784, 'laughter': 785, 'wear': 786, 'raking': 787, 'rakes': 788, 'claret': 789, 'shure': 790, 'tralee': 791, 'slower': 792, 'lower': 793, 'deep': 794, 'wearin': 795, 'duram': 796, 'takes': 797, 'beware': 798, 'steal': 799, 'brings': 800, 'things': 801, 'joys': 802, 'bunch': 803, 'sailor': 804, 'chanced': 805, 'pass': 806, 'angels': 807, 'send': 808, 'drowsy': 809, 'keeping': 810, 'spirit': 811, 'stealing': 812, 'feeling': 813, 'roam': 814, 'presence': 815, 'heavenward': 816, 'dust': 817, 'dim': 818, 'journey': 819, 'waves': 820, 'frightened': 821, 'leaving': 822, 'struggle': 823, 'parents': 824, 'courage': 825, 'weeping': 826, 'pain': 827, 'mist': 828, 'felt': 829, 'roared': 830, 'making': 831, 'fever': 832, 'moment': 833, 'distance': 834, 'wailing': 835, 'oft': 836, 'held': 837, 'fast': 838, 'cabin': 839, 'honey': 840, 'diddle': 841, 'clearly': 842, 'open': 843, 'opened': 844, 'table': 845, 'wine': 846, 'lay': 847, 'shells': 848, 'sailed': 849, 'drown': 850, 'fetters': 851, 'chains': 852, 'wives': 853, 'sorrow': 854, 'thoughts': 855, 'cursed': 856, 'hell': 857, 'five': 858, 'buried': 859, 'lost': 860, 'endless': 861, 'slavery': 862, 'gun': 863, 'rain': 864, 'cares': 865, 'ghosts': 866, 'runaway': 867, 'twill': 868, 'month': 869, 'meadows': 870, 'prettiest': 871, 'winters': 872, 'satisfied': 873, 'few': 874, 'short': 875, 'lines': 876, 'shone': 877, 'shoulder': 878, 'belfast': 879, 'trade': 880, 'bad': 881, 'caused': 882, 'stray': 883, 'meaning': 884, 'damsel': 885, 'appear': 886, 'seven': 887, 'sentence': 888, 'jolly': 889, 'whenever': 890, 'wee': 891, 'wife': 892, 'lives': 893, 'martha': 894, 'courted': 895, 'bridgit': 896, 'omalley': 897, 'desolation': 898, 'thorn': 899, 'gaze': 900, 'stone': 901, 'approaching': 902, 'sets': 903, 'carrigfergus': 904, 'nights': 905, 'swim': 906, 'wings': 907, 'sober': 908, 'travel': 909, 'native': 910, 'places': 911, 'slopes': 912, 'hares': 913, 'lofty': 914, 'malone': 915, 'wheeled': 916, 'streets': 917, 'enough': 918, 'reilly': 919, 'tough': 920, 'whispers': 921, 'phil': 922, 'threw': 923, 'straight': 924, 'belles': 925, 'moor': 926, 'brand': 927, 'shapes': 928, 'work': 929, 'vow': 930, 'blarney': 931, 'paid': 932, 'bower': 933, 'remain': 934, 'charming': 935, 'storied': 936, 'chieftains': 937, 'slaughter': 938, 'bann': 939, 'boyne': 940, 'liffey': 941, 'gallant': 942, 'awake': 943, 'greet': 944, 'meadow': 945, 'sweeter': 946, 'dirty': 947, 'cats': 948, 'crossed': 949, 'field': 950, 'river': 951, 'full': 952, 'aroon': 953, 'sends': 954, 'woe': 955, 'chain': 956, 'main': 957, 'charms': 958, 'fondly': 959, 'fleet': 960, 'fairy': 961, 'thine': 962, 'known': 963, 'truly': 964, 'close': 965, 'story': 966, 'flag': 967, 'sweetest': 968, 'honor': 969, 'playing': 970, 'mauser': 971, 'music': 972, 'tom': 973, 'hurrah': 974, 'big': 975, 'lead': 976, 'south': 977, 'generation': 978, 'freedom': 979, 'agin': 980, 'creature': 981, 'dad': 982, 'venture': 983, 'word': 984, 'wonderful': 985, 'crazy': 986, 'lazy': 987, 'grave': 988, 'jest': 989, 'remark': 990, 'strangers': 991, 'strong': 992, 'shook': 993, 'walk': 994, 'north': 995, 'ours': 996, 'cease': 997, 'strife': 998, 'whats': 999, 'lilacs': 1000, 'prove': 1001, 'sweetheart': 1002, 'letters': 1003, 'sent': 1004, 'speak': 1005, 'brow': 1006, 'albert': 1007, 'mooney': 1008, 'fighting': 1009, 'fingers': 1010, 'toes': 1011, 'john': 1012, 'hurroo': 1013, 'drums': 1014, 'beguiled': 1015, 'carry': 1016, 'bone': 1017, 'havent': 1018, 'walkin': 1019, 'kilgary': 1020, 'pepper': 1021, 'countin': 1022, 'forth': 1023, 'deliver': 1024, 'daddy': 1025, 'em': 1026, 'deceive': 1027, 'between': 1028, 'even': 1029, 'prisoner': 1030, 'fists': 1031, 'knocked': 1032, 'carriages': 1033, 'rollin': 1034, 'juice': 1035, 'courtin': 1036, 'ponchartrain': 1037, 'does': 1038, 'stranger': 1039, 'marry': 1040, 'adieu': 1041, 'ask': 1042, 'tipped': 1043, 'arrived': 1044, 'ladies': 1045, 'potatoes': 1046, 'courting': 1047, 'miss': 1048, 'small': 1049, 'ned': 1050, 'ribbons': 1051, 'heel': 1052, 'bonny': 1053, 'pipe': 1054, 'thrush': 1055, 'sweethearts': 1056, 'unto': 1057, 'rise': 1058, 'softly': 1059, 'milking': 1060, 'rare': 1061, 'pity': 1062, 'treasure': 1063, 'noon': 1064, 'sailing': 1065, 'banish': 1066, 'riches': 1067, 'comfort': 1068, 'yonder': 1069, 'flows': 1070, 'fairer': 1071, 'lass': 1072, 'woods': 1073, 'strayed': 1074, 'locks': 1075, 'breaking': 1076, 'june': 1077, 'started': 1078, 'hearted': 1079, 'beer': 1080, 'daylight': 1081, 'among': 1082, 'bundle': 1083, 'connaught': 1084, 'quay': 1085, 'erins': 1086, 'galway': 1087, 'fearless': 1088, 'bravely': 1089, 'marches': 1090, 'fate': 1091, 'neck': 1092, 'trod': 1093, 'marched': 1094, 'antrim': 1095, 'sash': 1096, 'flashed': 1097, 'hath': 1098, 'foemans': 1099, 'fight': 1100, 'heavy': 1101, 'bore': 1102, 'mans': 1103, 'counter': 1104, 'dozen': 1105, 'gallon': 1106, 'bottles': 1107, 'diamond': 1108, 'resemble': 1109, 'tiny': 1110, 'friendly': 1111, 'weather': 1112, 'inside': 1113, 'remember': 1114, 'someone': 1115, 'hat': 1116, 'body': 1117, 'dancers': 1118, 'hanging': 1119, 'empty': 1120, 'shoes': 1121, 'broke': 1122, 'december': 1123, 'move': 1124, 'reason': 1125, 'roof': 1126, 'naught': 1127, 'tower': 1128, 'power': 1129, 'king': 1130, 'dreaming': 1131, 'crew': 1132, 'whos': 1133, 'mccann': 1134, 'smoke': 1135, 'notes': 1136, 'yeoman': 1137, 'cavalry': 1138, 'guard': 1139, 'forced': 1140, 'brother': 1141, 'cousin': 1142, 'blame': 1143, 'croppy': 1144, 'dressed': 1145, 'trees': 1146, 'wore': 1147, 'words': 1148, 'swiftly': 1149, 'dawn': 1150, 'lovd': 1151, 'voices': 1152, 'moaning': 1153, 'dark': 1154, 'gather': 1155, 'tay': 1156, 'swinging': 1157, 'drinkin': 1158, 'sitting': 1159, 'stile': 1160, 'springing': 1161, 'yours': 1162, 'kept': 1163, 'aisey': 1164, 'rub': 1165, 'dub': 1166, 'dow': 1167, 'shelah': 1168, 'fairly': 1169, 'beggarman': 1170, 'begging': 1171, 'slept': 1172, 'holes': 1173, 'coming': 1174, 'thru': 1175, 'boo': 1176, 'lady': 1177, 'kerry': 1178, 'pipers': 1179, 'laugh': 1180, 'beaming': 1181, 'guineas': 1182, 'least': 1183, 'diggin': 1184, 'mourne': 1185, 'spending': 1186, 'mellow': 1187, 'plying': 1188, 'slowly': 1189, 'mooncoin': 1190, 'flow': 1191, 'sounds': 1192, 'shine': 1193, 'cool': 1194, 'crystal': 1195, 'fountain': 1196, 'moonlight': 1197, 'grandmother': 1198, 'crooning': 1199, 'merrily': 1200, 'spins': 1201, 'lightly': 1202, 'moving': 1203, 'lattice': 1204, 'grove': 1205, 'swings': 1206, 'finger': 1207, 'shamrock': 1208, 'pocket': 1209, 'springtime': 1210, 'gilgarra': 1211, 'rapier': 1212, 'ringum': 1213, 'mornin': 1214, 'heather': 1215, 'build': 1216, 'maidens': 1217, 'prime': 1218, 'nlyme': 1219, 'flavours': 1220, 'lusty': 1221, 'reminded': 1222, 'attend': 1223, 'guardian': 1224, 'creeping': 1225, 'dale': 1226, 'vigil': 1227, 'visions': 1228, 'revealing': 1229, 'breathes': 1230, 'holy': 1231, 'strains': 1232, 'hover': 1233, 'hark': 1234, 'solemn': 1235, 'winging': 1236, 'earthly': 1237, 'shalt': 1238, 'awaken': 1239, 'destiny': 1240, 'emigrants': 1241, 'amid': 1242, 'longing': 1243, 'parted': 1244, 'townland': 1245, 'vessel': 1246, 'crowded': 1247, 'disquieted': 1248, 'folk': 1249, 'escape': 1250, 'hardship': 1251, 'sustaining': 1252, 'glimpse': 1253, 'faded': 1254, 'strangely': 1255, 'seas': 1256, 'anger': 1257, 'desperate': 1258, 'plight': 1259, 'worsened': 1260, 'delirium': 1261, 'possessed': 1262, 'clouded': 1263, 'prayers': 1264, 'begged': 1265, 'forgiveness': 1266, 'seeking': 1267, 'distant': 1268, 'mither': 1269, 'simple': 1270, 'ditty': 1271, 'ld': 1272, 'li': 1273, 'hush': 1274, 'lullaby': 1275, 'huggin': 1276, 'hummin': 1277, 'rock': 1278, 'asleep': 1279, 'outside': 1280, 'modestly': 1281, 'ry': 1282, 'ay': 1283, 'di': 1284, 're': 1285, 'dai': 1286, 'rie': 1287, 'shc': 1288, 'bridle': 1289, 'stable': 1290, 'oats': 1291, 'eat': 1292, 'soldier': 1293, 'aisy': 1294, 'arose': 1295, 'christmas': 1296, '1803': 1297, 'australia': 1298, 'marks': 1299, 'carried': 1300, 'rusty': 1301, 'iron': 1302, 'wains': 1303, 'mainsails': 1304, 'unfurled': 1305, 'curses': 1306, 'hurled': 1307, 'swell': 1308, 'moth': 1309, 'firelights': 1310, 'horses': 1311, 'rode': 1312, 'taking': 1313, 'hades': 1314, 'twilight': 1315, 'forty': 1316, 'slime': 1317, 'climate': 1318, 'bravery': 1319, 'ended': 1320, 'bond': 1321, 'rebel': 1322, 'iii': 1323, 'violin': 1324, 'clay': 1325, 'sooner': 1326, 'sport': 1327, 'colour': 1328, 'knows': 1329, 'earth': 1330, 'serve': 1331, 'clyde': 1332, 'mourn': 1333, 'weep': 1334, 'suffer': 1335, 'diamonds': 1336, 'queen': 1337, 'hung': 1338, 'tied': 1339, 'apprenticed': 1340, 'happiness': 1341, 'misfortune': 1342, 'follow': 1343, 'strolling': 1344, 'selling': 1345, 'bar': 1346, 'customer': 1347, 'slipped': 1348, 'luck': 1349, 'jury': 1350, 'trial': 1351, 'case': 1352, 'warning': 1353, 'liquor': 1354, 'porter': 1355, 'pleasures': 1356, 'fishing': 1357, 'farming': 1358, 'glens': 1359, 'softest': 1360, 'dripping': 1361, 'snare': 1362, 'lose': 1363, 'court': 1364, 'primrose': 1365, 'bee': 1366, 'hopeless': 1367, 'wonders': 1368, 'admiration': 1369, 'haunt': 1370, 'wherever': 1371, 'sands': 1372, 'purer': 1373, 'within': 1374, 'grieve': 1375, 'drumslieve': 1376, 'ballygrant': 1377, 'deepest': 1378, 'boatsman': 1379, 'ferry': 1380, 'childhood': 1381, 'reflections': 1382, 'boyhood': 1383, 'melting': 1384, 'roaming': 1385, 'reported': 1386, 'marble': 1387, 'stones': 1388, 'ink': 1389, 'support': 1390, 'drunk': 1391, 'seldom': 1392, 'sick': 1393, 'numbered': 1394, 'foam': 1395, 'compare': 1396, 'sights': 1397, 'coast': 1398, 'clare': 1399, 'kilkee': 1400, 'kilrush': 1401, 'watching': 1402, 'pheasants': 1403, 'homes': 1404, 'streams': 1405, 'dublins': 1406, 'cockles': 1407, 'mussels': 1408, 'fish': 1409, 'monger': 1410, 'ghost': 1411, 'wheels': 1412, 'eden': 1413, 'vanished': 1414, 'finea': 1415, 'halfway': 1416, 'cootehill': 1417, 'gruff': 1418, 'whispering': 1419, 'crow': 1420, 'newborn': 1421, 'babies': 1422, 'huff': 1423, 'start': 1424, 'sorrowful': 1425, 'squall': 1426, 'babys': 1427, 'toil': 1428, 'worn': 1429, 'fore': 1430, 'flute': 1431, 'yer': 1432, 'boot': 1433, 'magee': 1434, 'scruff': 1435, 'slanderin': 1436, 'marchin': 1437, 'assisted': 1438, 'drain': 1439, 'dudeen': 1440, 'puff': 1441, 'whisperings': 1442, 'barrin': 1443, 'chocolate': 1444, 'feegee': 1445, 'sort': 1446, 'moonshiny': 1447, 'stuff': 1448, 'addle': 1449, 'brain': 1450, 'ringin': 1451, 'glamour': 1452, 'gas': 1453, 'guff': 1454, 'whisper': 1455, 'oil': 1456, 'remarkable': 1457, 'policeman': 1458, 'bluff': 1459, 'maintain': 1460, 'guril': 1461, 'sic': 1462, 'passage': 1463, 'rough': 1464, 'borne': 1465, 'breeze': 1466, 'boundless': 1467, 'stupendous': 1468, 'roll': 1469, 'thundering': 1470, 'motion': 1471, 'mermaids': 1472, 'fierce': 1473, 'tempest': 1474, 'gathers': 1475, 'oneill': 1476, 'odonnell': 1477, 'lucan': 1478, 'oconnell': 1479, 'brian': 1480, 'drove': 1481, 'danes': 1482, 'patrick': 1483, 'vermin': 1484, 'whose': 1485, 'benburb': 1486, 'blackwater': 1487, 'owen': 1488, 'roe': 1489, 'munroe': 1490, 'lambs': 1491, 'skip': 1492, 'views': 1493, 'enchanting': 1494, 'rostrevor': 1495, 'groves': 1496, 'lakes': 1497, 'ride': 1498, 'tide': 1499, 'majestic': 1500, 'shannon': 1501, 'sail': 1502, 'loch': 1503, 'neagh': 1504, 'ross': 1505, 'gorey': 1506, 'saxon': 1507, 'tory': 1508, 'soil': 1509, 'sanctified': 1510, 'enemies': 1511, 'links': 1512, 'encumbered': 1513, 'resound': 1514, 'hosannahs': 1515, 'bide': 1516, 'hushed': 1517, 'lying': 1518, 'kneel': 1519, 'ave': 1520, 'tread': 1521, 'fail': 1522, 'simply': 1523, 'gasworks': 1524, 'croft': 1525, 'dreamed': 1526, 'canal': 1527, 'factory': 1528, 'clouds': 1529, 'drifting': 1530, 'prowling': 1531, 'beat': 1532, 'springs': 1533, 'siren': 1534, 'docks': 1535, 'train': 1536, 'smelled': 1537, 'smokey': 1538, 'sharp': 1539, 'axe': 1540, 'steel': 1541, 'tempered': 1542, 'chop': 1543, 't': 1544, 'agree': 1545, 'leaning': 1546, 'weirs': 1547, 'ray': 1548, 'glow': 1549, 'changeless': 1550, 'constant': 1551, 'bounding': 1552, 'castles': 1553, 'sacked': 1554, 'scattered': 1555, 'fixed': 1556, 'endearing': 1557, 'gifts': 1558, 'fading': 1559, 'wouldst': 1560, 'adored': 1561, 'loveliness': 1562, 'ruin': 1563, 'itself': 1564, 'verdantly': 1565, 'unprofaned': 1566, 'fervor': 1567, 'faith': 1568, 'forgets': 1569, 'sunflower': 1570, 'rag': 1571, 'games': 1572, 'hold': 1573, 'defend': 1574, 'veteran': 1575, 'volunteers': 1576, 'pat': 1577, 'pearse': 1578, 'clark': 1579, 'macdonagh': 1580, 'macdiarmada': 1581, 'mcbryde': 1582, 'james': 1583, 'connolly': 1584, 'placed': 1585, 'machine': 1586, 'ranting': 1587, 'hour': 1588, 'bullet': 1589, 'stuck': 1590, 'craw': 1591, 'poisoning': 1592, 'ceannt': 1593, 'lions': 1594, 'union': 1595, 'poured': 1596, 'dismay': 1597, 'horror': 1598, 'englishmen': 1599, 'khaki': 1600, 'renown': 1601, 'fame': 1602, 'forefathers': 1603, 'blaze': 1604, 'priests': 1605, 'offer': 1606, 'charmin': 1607, 'variety': 1608, 'renownd': 1609, 'learnin': 1610, 'piety': 1611, 'advance': 1612, 'widout': 1613, 'impropriety': 1614, 'flowr': 1615, 'cho': 1616, 'powrfulest': 1617, 'preacher': 1618, 'tenderest': 1619, 'teacher': 1620, 'kindliest': 1621, 'donegal': 1622, 'talk': 1623, 'provost': 1624, 'trinity': 1625, 'famous': 1626, 'greek': 1627, 'latinity': 1628, 'divils': 1629, 'divinity': 1630, 'd': 1631, 'likes': 1632, 'logic': 1633, 'mythology': 1634, 'thayology': 1635, 'conchology': 1636, 'sinners': 1637, 'wishful': 1638, 'childer': 1639, 'avick': 1640, 'gad': 1641, 'flock': 1642, 'grandest': 1643, 'control': 1644, 'checking': 1645, 'coaxin': 1646, 'onaisy': 1647, 'lifting': 1648, 'avoidin': 1649, 'frivolity': 1650, 'seasons': 1651, 'innocent': 1652, 'jollity': 1653, 'playboy': 1654, 'claim': 1655, 'equality': 1656, 'comicality': 1657, 'bishop': 1658, 'lave': 1659, 'gaiety': 1660, 'laity': 1661, 'clergy': 1662, 'jewels': 1663, 'plundering': 1664, 'pillage': 1665, 'starved': 1666, 'cries': 1667, 'thems': 1668, 'bondage': 1669, 'fourth': 1670, 'tabhair': 1671, 'dom': 1672, 'lã¡mh': 1673, 'harmony': 1674, 'east': 1675, 'destroy': 1676, 'command': 1677, 'gesture': 1678, 'troubles': 1679, 'weak': 1680, 'peoples': 1681, 'creeds': 1682, 'lets': 1683, 'needs': 1684, 'passion': 1685, 'fashion': 1686, 'guide': 1687, 'share': 1688, 'sparkling': 1689, 'meeting': 1690, 'iull': 1691, 'contented': 1692, 'ache': 1693, 'painful': 1694, 'wrote': 1695, 'twisted': 1696, 'twined': 1697, 'cheek': 1698, 'bedim': 1699, 'holds': 1700, 'smiles': 1701, 'scarcely': 1702, 'darkning': 1703, 'beyond': 1704, 'yearn': 1705, 'laughs': 1706, 'humble': 1707, 'brightest': 1708, 'gleam': 1709, 'forgot': 1710, 'pulled': 1711, 'comb': 1712, 'counting': 1713, 'knock': 1714, 'murray': 1715, 'fellow': 1716, 'hail': 1717, 'tumblin': 1718, 'apple': 1719, 'pie': 1720, 'gets': 1721, 'doleful': 1722, 'enemy': 1723, 'nearly': 1724, 'slew': 1725, 'queer': 1726, 'mild': 1727, 'legs': 1728, 'indeed': 1729, 'island': 1730, 'sulloon': 1731, 'flesh': 1732, 'yere': 1733, 'armless': 1734, 'boneless': 1735, 'chickenless': 1736, 'egg': 1737, 'yell': 1738, 'bowl': 1739, 'rolling': 1740, 'swearing': 1741, 'rattled': 1742, 'saber': 1743, 'deceiver': 1744, 'rig': 1745, 'um': 1746, 'du': 1747, 'rum': 1748, 'jar': 1749, 'shinin': 1750, 'coins': 1751, 'promised': 1752, 'vowed': 1753, 'devils': 1754, 'awakened': 1755, 'six': 1756, 'guards': 1757, 'numbers': 1758, 'odd': 1759, 'flew': 1760, 'mistaken': 1761, 'mollys': 1762, 'robbing': 1763, 'sentry': 1764, 'sligo': 1765, 'fishin': 1766, 'bowlin': 1767, 'others': 1768, 'railroad': 1769, 'ties': 1770, 'crossings': 1771, 'swamps': 1772, 'elevations': 1773, 'resolved': 1774, 'sunset': 1775, 'higher': 1776, 'win': 1777, 'allegators': 1778, 'wood': 1779, 'treated': 1780, 'shoulders': 1781, 'paint': 1782, 'picture': 1783, 'vain': 1784, 'returned': 1785, 'cottage': 1786, 'sociable': 1787, 'foaming': 1788, 'n': 1789, 'jeremy': 1790, 'lanigan': 1791, 'battered': 1792, 'hadnt': 1793, 'pound': 1794, 'farm': 1795, 'acres': 1796, 'party': 1797, 'listen': 1798, 'glisten': 1799, 'rows': 1800, 'ructions': 1801, 'invitation': 1802, 'minute': 1803, 'bees': 1804, 'cask': 1805, 'judy': 1806, 'odaly': 1807, 'milliner': 1808, 'wink': 1809, 'peggy': 1810, 'mcgilligan': 1811, 'lashings': 1812, 'punch': 1813, 'cakes': 1814, 'bacon': 1815, 'tea': 1816, 'nolans': 1817, 'dolans': 1818, 'ogradys': 1819, 'sounded': 1820, 'taras': 1821, 'hall': 1822, 'nelly': 1823, 'gray': 1824, 'rat': 1825, 'catchers': 1826, 'doing': 1827, 'kinds': 1828, 'nonsensical': 1829, 'polkas': 1830, 'whirligig': 1831, 'julia': 1832, 'banished': 1833, 'nonsense': 1834, 'twist': 1835, 'jig': 1836, 'mavrone': 1837, 'mad': 1838, 'ceiling': 1839, 'brooks': 1840, 'academy': 1841, 'learning': 1842, 'learn': 1843, 'couples': 1844, 'groups': 1845, 'accident': 1846, 'happened': 1847, 'terrance': 1848, 'mccarthy': 1849, 'finnertys': 1850, 'hoops': 1851, 'cried': 1852, 'meelia': 1853, 'murther': 1854, 'gathered': 1855, 'carmody': 1856, 'further': 1857, 'satisfaction': 1858, 'midst': 1859, 'kerrigan': 1860, 'declared': 1861, 'painted': 1862, 'suppose': 1863, 'morgan': 1864, 'powerful': 1865, 'stretched': 1866, 'smashed': 1867, 'chaneys': 1868, 'runctions': 1869, 'lick': 1870, 'phelim': 1871, 'mchugh': 1872, 'replied': 1873, 'introduction': 1874, 'kicked': 1875, 'terrible': 1876, 'hullabaloo': 1877, 'piper': 1878, 'strangled': 1879, 'squeezed': 1880, 'bellows': 1881, 'chanters': 1882, 'entangled': 1883, 'gaily': 1884, 'mairis': 1885, 'hillways': 1886, 'myrtle': 1887, 'bracken': 1888, 'sheilings': 1889, 'sake': 1890, 'rowans': 1891, 'herring': 1892, 'meal': 1893, 'peat': 1894, 'creel': 1895, 'bairns': 1896, 'weel': 1897, 'toast': 1898, 'soar': 1899, 'blackbird': 1900, 'note': 1901, 'linnet': 1902, 'lure': 1903, 'cozy': 1904, 'catch': 1905, 'company': 1906, 'harm': 1907, 'wit': 1908, 'recall': 1909, 'leisure': 1910, 'awhile': 1911, 'sorely': 1912, 'ruby': 1913, 'enthralled': 1914, 'sorry': 1915, 'theyd': 1916, 'falls': 1917, 'lot': 1918, 'tuned': 1919, 'bough': 1920, 'cow': 1921, 'chanting': 1922, 'melodious': 1923, 'scarce': 1924, 'soothed': 1925, 'solace': 1926, 'courtesy': 1927, 'salute': 1928, 'amiable': 1929, 'captive': 1930, 'slave': 1931, 'future': 1932, 'banter': 1933, 'enamour': 1934, 'indies': 1935, 'afford': 1936, 'transparently': 1937, 'flame': 1938, 'add': 1939, 'fuel': 1940, 'grant': 1941, 'desire': 1942, 'expire': 1943, 'wealth': 1944, 'damer': 1945, 'african': 1946, 'devonshire': 1947, 'lamp': 1948, 'alladin': 1949, 'genie': 1950, 'also': 1951, 'withdraw': 1952, 'tease': 1953, 'single': 1954, 'airy': 1955, 'embarrass': 1956, 'besides': 1957, 'almanack': 1958, 'useless': 1959, 'date': 1960, 'ware': 1961, 'rate': 1962, 'fragrance': 1963, 'loses': 1964, 'consumed': 1965, 'october': 1966, 'knowing': 1967, 'steer': 1968, 'blast': 1969, 'danger': 1970, 'farthing': 1971, 'affection': 1972, 'enjoy': 1973, 'choose': 1974, 'killarneys': 1975, 'sister': 1976, 'pains': 1977, 'loss': 1978, 'tuam': 1979, 'saluted': 1980, 'drank': 1981, 'pint': 1982, 'smother': 1983, 'reap': 1984, 'cut': 1985, 'goblins': 1986, 'bought': 1987, 'brogues': 1988, 'rattling': 1989, 'bogs': 1990, 'frightning': 1991, 'dogs': 1992, 'hunt': 1993, 'hare': 1994, 'follol': 1995, 'rah': 1996, 'mullingar': 1997, 'rested': 1998, 'limbs': 1999, 'blithe': 2000, 'heartfrom': 2001, 'paddys': 2002, 'cure': 2003, 'lassies': 2004, 'laughing': 2005, 'curious': 2006, 'style': 2007, 'twould': 2008, 'bubblin': 2009, 'hired': 2010, 'wages': 2011, 'required': 2012, 'almost': 2013, 'deprived': 2014, 'stroll': 2015, 'quality': 2016, 'locality': 2017, 'something': 2018, 'wobblin': 2019, 'enquiring': 2020, 'rogue': 2021, 'brogue': 2022, 'wasnt': 2023, 'vogue': 2024, 'spirits': 2025, 'falling': 2026, 'jumped': 2027, 'aboard': 2028, 'pigs': 2029, 'rigs': 2030, 'jigs': 2031, 'bubbling': 2032, 'holyhead': 2033, 'wished': 2034, 'instead': 2035, 'bouys': 2036, 'liverpool': 2037, 'safely': 2038, 'fool': 2039, 'boil': 2040, 'temper': 2041, 'losing': 2042, 'abusing': 2043, 'shillelagh': 2044, 'nigh': 2045, 'hobble': 2046, 'load': 2047, 'hurray': 2048, 'joined': 2049, 'affray': 2050, 'quitely': 2051, 'cleared': 2052, 'host': 2053, 'march': 2054, 'faces': 2055, 'farmstead': 2056, 'fishers': 2057, 'ban': 2058, 'vengeance': 2059, 'hapless': 2060, 'about': 2061, 'hemp': 2062, 'rope': 2063, 'clung': 2064, 'grim': 2065, 'array': 2066, 'earnest': 2067, 'stalwart': 2068, 'stainless': 2069, 'banner': 2070, 'marching': 2071, 'torn': 2072, 'furious': 2073, 'odds': 2074, 'keen': 2075, 'toomebridge': 2076, 'treads': 2077, 'upwards': 2078, 'traveled': 2079, 'quarters': 2080, 'below': 2081, 'hogshead': 2082, 'stack': 2083, 'stagger': 2084, 'dig': 2085, 'hole': 2086, 'couple': 2087, 'scratch': 2088, 'consolation': 2089, 'tyrant': 2090, 'remorseless': 2091, 'foe': 2092, 'lift': 2093, 'stranded': 2094, 'prince': 2095, 'edward': 2096, 'coffee': 2097, 'trace': 2098, 'fiddlin': 2099, 'dime': 2100, 'shy': 2101, 'hello': 2102, 'wintry': 2103, 'yellow': 2104, 'somewhere': 2105, 'written': 2106, 'begin': 2107, 'tap': 2108, 'caught': 2109, 'leap': 2110, 'clumsy': 2111, 'graceful': 2112, 'fiddlers': 2113, 'everywhere': 2114, 'boots': 2115, 'laughtcr': 2116, 'suits': 2117, 'easter': 2118, 'gowns': 2119, 'sailors': 2120, 'pianos': 2121, 'setting': 2122, 'someones': 2123, 'hats': 2124, 'rack': 2125, 'chair': 2126, 'wooden': 2127, 'feels': 2128, 'touch': 2129, 'awaitin': 2130, 'thc': 2131, 'fiddles': 2132, 'closet': 2133, 'strings': 2134, 'tbe': 2135, 'covers': 2136, 'buttoned': 2137, 'sometimes': 2138, 'melody': 2139, 'passes': 2140, 'slight': 2141, 'lack': 2142, 'moved': 2143, 'homeward': 2144, 'swan': 2145, 'moves': 2146, 'goods': 2147, 'gear': 2148, 'din': 2149, 'rude': 2150, 'wherein': 2151, 'dwell': 2152, 'abandon': 2153, 'energy': 2154, 'blight': 2155, 'praties': 2156, 'sheep': 2157, 'cattle': 2158, 'taxes': 2159, 'unpaid': 2160, 'redeem': 2161, 'bleak': 2162, 'landlord': 2163, 'sheriff': 2164, 'spleen': 2165, 'heaved': 2166, 'sigh': 2167, 'bade': 2168, 'goodbye': 2169, 'stony': 2170, 'anguish': 2171, 'seeing': 2172, 'feeble': 2173, 'frame': 2174, 'wrapped': 2175, 'cï¿½ta': 2176, 'mï¿½r': 2177, 'unseen': 2178, 'stern': 2179, 'rally': 2180, 'cheer': 2181, 'revenge': 2182, 'waking': 2183, 'wisdom': 2184, 'dwelling': 2185, 'battleshield': 2186, 'dignity': 2187, 'shelter': 2188, 'heed': 2189, 'inheritance': 2190, 'heavem': 2191, 'heaven': 2192, 'victory': 2193, 'reach': 2194, 'whatever': 2195, 'befall': 2196, 'ruler': 2197, 'pleasant': 2198, 'rambling': 2199, 'board': 2200, 'followed': 2201, 'shortly': 2202, 'anchor': 2203, '23rd': 2204, 'lrelands': 2205, 'daughters': 2206, 'crowds': 2207, 'assembled': 2208, 'fulfill': 2209, 'jovial': 2210, 'conversations': 2211, 'neighbors': 2212, 'turning': 2213, 'tailor': 2214, 'quigley': 2215, 'bould': 2216, 'britches': 2217, 'lived': 2218, 'flying': 2219, 'dove': 2220, 'hiii': 2221, 'dreamt': 2222, 'joking': 2223, 'manys': 2224, 'cock': 2225, 'shrill': 2226, 'awoke': 2227, 'california': 2228, 'miles': 2229, 'banbridge': 2230, 'july': 2231, 'boreen': 2232, 'sheen': 2233, 'coaxing': 2234, 'elf': 2235, 'shake': 2236, 'bantry': 2237, 'onward': 2238, 'sped': 2239, 'gazed': 2240, 'passerby': 2241, 'gem': 2242, 'irelands': 2243, 'travelled': 2244, 'hit': 2245, 'career': 2246, 'square': 2247, 'surrendered': 2248, 'tenant': 2249, 'shawl': 2250, 'gown': 2251, 'crossroads': 2252, 'dress': 2253, 'try': 2254, 'sheeps': 2255, 'deludhering': 2256, 'yoke': 2257, 'rust': 2258, 'plow': 2259, 'fireside': 2260, 'sits': 2261, 'whistle': 2262, 'changing': 2263, 'fright': 2264, 'downfall': 2265, 'cornwall': 2266, 'parlour': 2267, 'passing': 2268, 'william': 2269, 'betray': 2270, 'guinea': 2271, 'walking': 2272, 'mounted': 2273, 'platform': 2274, 'deny': 2275, 'walked': 2276, 'margin': 2277, 'lough': 2278, 'leane': 2279, 'bloomed': 2280, 'whom': 2281, 'cap': 2282, 'cloak': 2283, 'glossy': 2284, 'pail': 2285, 'palm': 2286, 'venus': 2287, 'bank': 2288, 'travelians': 2289, 'babes': 2290, 'freebirds': 2291, 'grew': 2292, 'matters': 2293, 'famine': 2294, 'rebelled': 2295, 'windswept': 2296, 'harbour': 2297, 'botany': 2298, 'whilst': 2299, 'wan': 2300, 'cloud': 2301, 'shannons': 2302, 'returnd': 2303, 'doubts': 2304, 'fears': 2305, 'aching': 2306, 'seemd': 2307, 'mingling': 2308, 'flood': 2309, 'path': 2310, 'wrath': 2311, 'lamenting': 2312, 'sudden': 2313, 'kissd': 2314, 'showrs': 2315, 'flowing': 2316, 'laughd': 2317, 'beam': 2318, 'soared': 2319, 'aloft': 2320, 'phantom': 2321, 'outspread': 2322, 'throbbing': 2323, 'hid': 2324, 'treasures': 2325, 'pots': 2326, 'tin': 2327, 'cans': 2328, 'mash': 2329, 'bran': 2330, 'barney': 2331, 'peeled': 2332, 'searching': 2333, 'connemara': 2334, 'butcher': 2335, 'quart': 2336, 'bottle': 2337, 'help': 2338, 'gate': 2339, 'glory': 2340, 'lane': 2341, 'village': 2342, 'church': 2343, 'spire': 2344, 'graveyard': 2345, 'baby': 2346, 'blessing': 2347, 'hoping': 2348, 'trust': 2349, 'strength': 2350, 'thank': 2351, 'bidding': 2352, 'bread': 2353, 'shines': 2354, 'fifty': 2355, 'often': 2356, 'shut': 2357, 'frisky': 2358, 'pig': 2359, 'whisky': 2360, 'uncle': 2361, 'enlisted': 2362, 'trudged': 2363, 'bosom': 2364, 'daisy': 2365, 'drubbing': 2366, 'shirts': 2367, 'battle': 2368, 'blows': 2369, 'pate': 2370, 'bothered': 2371, 'rarely': 2372, 'dropped': 2373, 'honest': 2374, 'thinks': 2375, 'eight': 2376, 'score': 2377, 'basin': 2378, 'zoo': 2379, 'everybody': 2380, 'calls': 2381, 'trades': 2382, 'dinner': 2383, 'slip': 2384, 'corner': 2385, 'barn': 2386, 'currabawn': 2387, 'shocking': 2388, 'wet': 2389, 'raindrops': 2390, 'rats': 2391, 'peek': 2392, 'waken': 2393, 'spotted': 2394, 'apron': 2395, 'calico': 2396, 'blouse': 2397, 'frighten': 2398, 'afraid': 2399, 'flaxen': 2400, 'haired': 2401, 'rags': 2402, 'tags': 2403, 'leggins': 2404, 'collar': 2405, 'tie': 2406, 'goggles': 2407, 'fashioned': 2408, 'bag': 2409, 'bulging': 2410, 'sack': 2411, 'peeping': 2412, 'skin': 2413, 'rink': 2414, 'doodle': 2415, 'getting': 2416, 'raked': 2417, 'gladness': 2418, 'tuning': 2419, 'fills': 2420, 'eily': 2421, 'prouder': 2422, 'thady': 2423, 'boldly': 2424, 'lasses': 2425, 'fled': 2426, 'silent': 2427, 'glad': 2428, 'echo': 2429, 'companions': 2430, 'soars': 2431, 'enchanted': 2432, 'granted': 2433, 'adoration': 2434, 'gives': 2435, 'joyous': 2436, 'elation': 2437, 'covered': 2438, 'winter': 2439, 'riding': 2440, 'cherry': 2441, 'coal': 2442, 'falter': 2443, 'bowed': 2444, 'bonnet': 2445, 'courteous': 2446, 'looks': 2447, 'engaging': 2448, 'sell': 2449, 'purse': 2450, 'yearly': 2451, 'need': 2452, 'market': 2453, 'gain': 2454, 'dearly': 2455, 'tarry': 2456, 'although': 2457, 'parlay': 2458, 'ranks': 2459, 'girded': 2460, 'slung': 2461, 'warrior': 2462, 'bard': 2463, 'betrays': 2464, 'rights': 2465, 'faithful': 2466, 'chords': 2467, 'asunder': 2468, 'sully': 2469, 'bravry': 2470, 'londons': 2471, 'sight': 2472, 'workin': 2473, 'sow': 2474, 'wheat': 2475, 'gangs': 2476, 'sweep': 2477, 'expressed': 2478, 'london': 2479, 'top': 2480, 'dresses': 2481, 'bath': 2482, 'startin': 2483, 'fashions': 2484, 'mccree': 2485, 'nature': 2486, 'designed': 2487, 'complexions': 2488, 'cream': 2489, 'regard': 2490, 'sip': 2491, 'colors': 2492, 'wait': 2493, 'waitin': 2494, 'sweeps': 2495, 'beauing': 2496, 'belling': 2497, 'windows': 2498, 'cursing': 2499, 'faster': 2500, 'waiters': 2501, 'bailiffs': 2502, 'duns': 2503, 'bacchus': 2504, 'begotten': 2505, 'politicians': 2506, 'funds': 2507, 'dadda': 2508, 'living': 2509, 'drives': 2510, 'having': 2511, 'racking': 2512, 'tenants': 2513, 'stewards': 2514, 'teasing': 2515, 'raising': 2516, 'wishing': 2517, 'sunny': 2518, 'doves': 2519, 'coo': 2520, 'neath': 2521, 'sunbeam': 2522, 'robin': 2523, 'waters': 2524, 'larks': 2525, 'join': 2526, 'breaks': 2527, 'oftimes': 2528, 'lilies': 2529, 'declining': 2530, 'vale': 2531, 'shades': 2532, 'mantle': 2533, 'spreading': 2534, 'listening': 2535, 'shedding': 2536, 'beginning': 2537, 'spinning': 2538, 'blind': 2539, 'drowsily': 2540, 'knitting': 2541, 'cheerily': 2542, 'noiselessly': 2543, 'whirring': 2544, 'foots': 2545, 'stirring': 2546, 'sprightly': 2547, 'chara': 2548, 'tapping': 2549, 'ivy': 2550, 'flapping': 2551, 'somebody': 2552, 'sighing': 2553, 'autumn': 2554, 'noise': 2555, 'chirping': 2556, 'holly': 2557, 'shoving': 2558, 'wrong': 2559, 'coolin': 2560, 'casement': 2561, 'rove': 2562, 'moons': 2563, 'brightly': 2564, 'shakes': 2565, 'lays': 2566, 'longs': 2567, 'lingers': 2568, 'glance': 2569, 'puts': 2570, 'lazily': 2571, 'easily': 2572, 'lowly': 2573, 'reels': 2574, 'noiseless': 2575, 'leaps': 2576, 'ere': 2577, 'lovers': 2578, 'roved': 2579, 'verdant': 2580, 'braes': 2581, 'skreen': 2582, 'countrie': 2583, 'foreign': 2584, 'strand': 2585, 'dewy': 2586, 'climb': 2587, 'rob': 2588, 'boat': 2589, 'sails': 2590, 'loaded': 2591, 'sink': 2592, 'leaned': 2593, 'oak': 2594, 'trusty': 2595, 'false': 2596, 'reached': 2597, 'pricked': 2598, 'waxes': 2599, 'fades': 2600, 'wholl': 2601, 'cockle': 2602, 'gloom': 2603, 'news': 2604, 'forbid': 2605, 'patricks': 2606, 'napper': 2607, 'tandy': 2608, 'hows': 2609, 'distressful': 2610, 'englands': 2611, 'remind': 2612, 'pull': 2613, 'throw': 2614, 'sod': 2615, 'root': 2616, 'underfoot': 2617, 'laws': 2618, 'blades': 2619, 'growin': 2620, 'dare': 2621, 'show': 2622, 'caubeen': 2623, 'year': 2624, 'returning': 2625, 'store': 2626, 'ale': 2627, 'frequent': 2628, 'landlady': 2629, 'credit': 2630, 'custom': 2631, 'sovereigns': 2632, 'landladys': 2633, 'wines': 2634, 'confess': 2635, 'pardon': 2636, 'prodigal': 2637, 'caress': 2638, 'forgive': 2639, 'ofttimes': 2640, 'wondering': 2641, 'powr': 2642, 'beguile': 2643, 'teardrop': 2644, 'lilting': 2645, 'laughters': 2646, 'twinkle': 2647, 'lilt': 2648, 'seems': 2649, 'linnets': 2650, 'real': 2651, 'regret': 2652, 'throughout': 2653, 'youths': 2654, 'chance': 2655, 'spied': 2656, 'receiver': 2657, 'counted': 2658, 'penny': 2659, 'bu': 2660, 'rungum': 2661, 'chamber': 2662, 'course': 2663, 'charges': 2664, 'filled': 2665, 'ready': 2666, 'footmen': 2667, 'likewise': 2668, 'draw': 2669, 'pistol': 2670, 'couldnt': 2671, 'shoot': 2672, 'robbin': 2673, 'jailer': 2674, 'tight': 2675, 'fisted': 2676, 'army': 2677, 'stationed': 2678, 'cork': 2679, 'roamin': 2680, 'swear': 2681, 'treat': 2682, 'sportin': 2683, 'hurley': 2684, 'bollin': 2685, 'maids': 2686, 'summertime': 2687, 'pluck': 2688, 'yon': 2689}\n",
      "total words: 2690\n"
     ]
    }
   ],
   "source": [
    "# Initialize the Tokenizer class\n",
    "tokenizer = Tokenizer()\n",
    "\n",
    "# Generate the word index dictionary\n",
    "tokenizer.fit_on_texts(corpus)\n",
    "\n",
    "# Define the total words. You add 1 for the index `0` which is just the padding token.\n",
    "total_words = len(tokenizer.word_index) + 1\n",
    "\n",
    "print(f'word index dictionary: {tokenizer.word_index}')\n",
    "print(f'total words: {total_words}')"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "id": "JK29FzZ7QW-4"
   },
   "source": [
    "## Preprocessing the Dataset\n",
    "\n",
    "Next, you will generate the inputs and labels for your model. The process will be identical to the previous lab. The `xs` or inputs to the model will be padded sequences, while the `ys` or labels are one-hot encoded arrays."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 6,
   "metadata": {
    "id": "soPGVheskaQP"
   },
   "outputs": [],
   "source": [
    "# Initialize the sequences list\n",
    "input_sequences = []\n",
    "\n",
    "# Loop over every line\n",
    "for line in corpus:\n",
    "\n",
    "\t# Tokenize the current line\n",
    "\ttoken_list = tokenizer.texts_to_sequences([line])[0]\n",
    "\n",
    "\t# Loop over the line several times to generate the subphrases\n",
    "\tfor i in range(1, len(token_list)):\n",
    "\t\t\n",
    "\t\t# Generate the subphrase\n",
    "\t\tn_gram_sequence = token_list[:i+1]\n",
    "\n",
    "\t\t# Append the subphrase to the sequences list\n",
    "\t\tinput_sequences.append(n_gram_sequence)\n",
    "\n",
    "# Get the length of the longest line\n",
    "max_sequence_len = max([len(x) for x in input_sequences])\n",
    "\n",
    "# Pad all sequences\n",
    "input_sequences = pad_sequences(input_sequences, maxlen=max_sequence_len, padding='pre')\n",
    "\n",
    "# Create inputs and label by splitting the last token in the subphrases\n",
    "xs, labels = input_sequences[:,:-1],input_sequences[:,-1]\n",
    "\n",
    "# Convert the label into one-hot arrays\n",
    "ys = tf.keras.utils.to_categorical(labels, num_classes=total_words)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "id": "TmWHCO0dQGlZ"
   },
   "source": [
    "You can then print some of the examples as a sanity check."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 7,
   "metadata": {
    "id": "pJtwVB2NbOAP"
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "sample sentence: ['come', 'all', 'ye', 'maidens', 'young', 'and', 'fair']\n",
      "[51, 12, 96, 1217, 48, 2, 69]\n"
     ]
    }
   ],
   "source": [
    "# Get sample sentence\n",
    "sentence = corpus[0].split()\n",
    "print(f'sample sentence: {sentence}')\n",
    "\n",
    "# Initialize token list\n",
    "token_list = []\n",
    "\n",
    "# Look up the indices of each word and append to the list\n",
    "for word in sentence: \n",
    "  token_list.append(tokenizer.word_index[word])\n",
    "\n",
    "# Print the token list\n",
    "print(token_list)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 8,
   "metadata": {
    "id": "lMr6kKfzROlW"
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "token list: [   0    0    0    0    0    0    0    0    0   51   12   96 1217   48\n",
      "    2]\n",
      "decoded to text: ['come all ye maidens young and']\n",
      "one-hot label: [0. 0. 0. ... 0. 0. 0.]\n",
      "index of label: 69\n"
     ]
    }
   ],
   "source": [
    "# Pick element\n",
    "elem_number = 5\n",
    "\n",
    "# Print token list and phrase\n",
    "print(f'token list: {xs[elem_number]}')\n",
    "print(f'decoded to text: {tokenizer.sequences_to_texts([xs[elem_number]])}')\n",
    "\n",
    "# Print label\n",
    "print(f'one-hot label: {ys[elem_number]}')\n",
    "print(f'index of label: {np.argmax(ys[elem_number])}')"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 9,
   "metadata": {
    "id": "49Cv68JOakwv"
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "token list: [   0    0    0    0    0    0    0    0    0    0   51   12   96 1217\n",
      "   48]\n",
      "decoded to text: ['come all ye maidens young']\n",
      "one-hot label: [0. 0. 1. ... 0. 0. 0.]\n",
      "index of label: 2\n"
     ]
    }
   ],
   "source": [
    "# Pick element\n",
    "elem_number = 4\n",
    "\n",
    "# Print token list and phrase\n",
    "print(f'token list: {xs[elem_number]}')\n",
    "print(f'decoded to text: {tokenizer.sequences_to_texts([xs[elem_number]])}')\n",
    "\n",
    "# Print label\n",
    "print(f'one-hot label: {ys[elem_number]}')\n",
    "print(f'index of label: {np.argmax(ys[elem_number])}')"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "id": "VKWWUZm5VPG9"
   },
   "source": [
    "## Build and compile the Model\n",
    "\n",
    "Next, you will build and compile the model. We placed some of the hyperparameters at the top of the code cell so you can easily tweak it later if you want."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 10,
   "metadata": {
    "id": "w9vH8Y59ajYL"
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "WARNING:tensorflow:From c:\\Users\\DELL\\AppData\\Local\\Programs\\Python\\Python311\\Lib\\site-packages\\keras\\src\\backend.py:873: The name tf.get_default_graph is deprecated. Please use tf.compat.v1.get_default_graph instead.\n",
      "\n",
      "Model: \"sequential\"\n",
      "_________________________________________________________________\n",
      " Layer (type)                Output Shape              Param #   \n",
      "=================================================================\n",
      " embedding (Embedding)       (None, 15, 100)           269000    \n",
      "                                                                 \n",
      " bidirectional (Bidirection  (None, 300)               301200    \n",
      " al)                                                             \n",
      "                                                                 \n",
      " dense (Dense)               (None, 2690)              809690    \n",
      "                                                                 \n",
      "=================================================================\n",
      "Total params: 1379890 (5.26 MB)\n",
      "Trainable params: 1379890 (5.26 MB)\n",
      "Non-trainable params: 0 (0.00 Byte)\n",
      "_________________________________________________________________\n"
     ]
    }
   ],
   "source": [
    "# Hyperparameters\n",
    "embedding_dim = 100\n",
    "lstm_units = 150\n",
    "learning_rate = 0.01\n",
    "\n",
    "# Build the model\n",
    "model = Sequential([\n",
    "          Embedding(total_words, embedding_dim, input_length=max_sequence_len-1),\n",
    "          Bidirectional(LSTM(lstm_units)),\n",
    "          Dense(total_words, activation='softmax')\n",
    "])\n",
    "\n",
    "# Use categorical crossentropy because this is a multi-class problem\n",
    "model.compile(\n",
    "    loss='categorical_crossentropy', \n",
    "    optimizer=tf.keras.optimizers.Adam(learning_rate=learning_rate), \n",
    "    metrics=['accuracy']\n",
    "    )\n",
    "\n",
    "# Print the model summary\n",
    "model.summary()"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "id": "OpI0d9cfR43c"
   },
   "source": [
    "## Train the model\n",
    "\n",
    "From the model summary above, you'll notice that the number of trainable params is much larger than the one in the previous lab. Consequently, that usually means a slower training time. It will take roughly 7 seconds per epoch with the GPU enabled in Colab and you'll reach around 76% accuracy after 100 epochs."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 11,
   "metadata": {
    "id": "Nc4zC7C4jJpN"
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Epoch 1/100\n",
      "WARNING:tensorflow:From c:\\Users\\DELL\\AppData\\Local\\Programs\\Python\\Python311\\Lib\\site-packages\\keras\\src\\utils\\tf_utils.py:492: The name tf.ragged.RaggedTensorValue is deprecated. Please use tf.compat.v1.ragged.RaggedTensorValue instead.\n",
      "\n",
      "WARNING:tensorflow:From c:\\Users\\DELL\\AppData\\Local\\Programs\\Python\\Python311\\Lib\\site-packages\\keras\\src\\engine\\base_layer_utils.py:384: The name tf.executing_eagerly_outside_functions is deprecated. Please use tf.compat.v1.executing_eagerly_outside_functions instead.\n",
      "\n",
      "377/377 [==============================] - 9s 15ms/step - loss: 6.6277 - accuracy: 0.0735\n",
      "Epoch 2/100\n",
      "377/377 [==============================] - 5s 13ms/step - loss: 5.7699 - accuracy: 0.1122\n",
      "Epoch 3/100\n",
      "377/377 [==============================] - 5s 13ms/step - loss: 4.9489 - accuracy: 0.1627\n",
      "Epoch 4/100\n",
      "377/377 [==============================] - 5s 13ms/step - loss: 4.0698 - accuracy: 0.2290\n",
      "Epoch 5/100\n",
      "377/377 [==============================] - 5s 13ms/step - loss: 3.2568 - accuracy: 0.3208\n",
      "Epoch 6/100\n",
      "377/377 [==============================] - 5s 14ms/step - loss: 2.6011 - accuracy: 0.4247\n",
      "Epoch 7/100\n",
      "377/377 [==============================] - 5s 14ms/step - loss: 2.1354 - accuracy: 0.5023\n",
      "Epoch 8/100\n",
      "377/377 [==============================] - 5s 13ms/step - loss: 1.7526 - accuracy: 0.5866\n",
      "Epoch 9/100\n",
      "377/377 [==============================] - 5s 14ms/step - loss: 1.4806 - accuracy: 0.6404\n",
      "Epoch 10/100\n",
      "377/377 [==============================] - 7s 19ms/step - loss: 1.2834 - accuracy: 0.6909\n",
      "Epoch 11/100\n",
      "377/377 [==============================] - 7s 17ms/step - loss: 1.1253 - accuracy: 0.7274\n",
      "Epoch 12/100\n",
      "377/377 [==============================] - 7s 19ms/step - loss: 1.0802 - accuracy: 0.7353\n",
      "Epoch 13/100\n",
      "377/377 [==============================] - 6s 16ms/step - loss: 1.0743 - accuracy: 0.7358\n",
      "Epoch 14/100\n",
      "377/377 [==============================] - 6s 17ms/step - loss: 1.1066 - accuracy: 0.7176\n",
      "Epoch 15/100\n",
      "377/377 [==============================] - 6s 17ms/step - loss: 1.1353 - accuracy: 0.7101\n",
      "Epoch 16/100\n",
      "377/377 [==============================] - 6s 16ms/step - loss: 1.1035 - accuracy: 0.7147\n",
      "Epoch 17/100\n",
      "377/377 [==============================] - 6s 16ms/step - loss: 1.0578 - accuracy: 0.7274\n",
      "Epoch 18/100\n",
      "377/377 [==============================] - 6s 16ms/step - loss: 1.0163 - accuracy: 0.7357\n",
      "Epoch 19/100\n",
      "377/377 [==============================] - 7s 18ms/step - loss: 0.9286 - accuracy: 0.7630\n",
      "Epoch 20/100\n",
      "377/377 [==============================] - 7s 18ms/step - loss: 0.8576 - accuracy: 0.7799\n",
      "Epoch 21/100\n",
      "377/377 [==============================] - 7s 18ms/step - loss: 0.8401 - accuracy: 0.7858\n",
      "Epoch 22/100\n",
      "377/377 [==============================] - 7s 17ms/step - loss: 0.8866 - accuracy: 0.7723\n",
      "Epoch 23/100\n",
      "377/377 [==============================] - 6s 17ms/step - loss: 0.9649 - accuracy: 0.7480\n",
      "Epoch 24/100\n",
      "377/377 [==============================] - 7s 17ms/step - loss: 1.0676 - accuracy: 0.7204\n",
      "Epoch 25/100\n",
      "377/377 [==============================] - 7s 17ms/step - loss: 1.0996 - accuracy: 0.7100\n",
      "Epoch 26/100\n",
      "377/377 [==============================] - 6s 17ms/step - loss: 1.0435 - accuracy: 0.7224\n",
      "Epoch 27/100\n",
      "377/377 [==============================] - 6s 17ms/step - loss: 0.9611 - accuracy: 0.7495\n",
      "Epoch 28/100\n",
      "377/377 [==============================] - 6s 17ms/step - loss: 0.8523 - accuracy: 0.7767\n",
      "Epoch 29/100\n",
      "377/377 [==============================] - 6s 17ms/step - loss: 0.8122 - accuracy: 0.7911\n",
      "Epoch 30/100\n",
      "377/377 [==============================] - 6s 17ms/step - loss: 0.7833 - accuracy: 0.7906\n",
      "Epoch 31/100\n",
      "377/377 [==============================] - 6s 17ms/step - loss: 0.8398 - accuracy: 0.7755\n",
      "Epoch 32/100\n",
      "377/377 [==============================] - 7s 18ms/step - loss: 0.9307 - accuracy: 0.7536\n",
      "Epoch 33/100\n",
      "377/377 [==============================] - 6s 17ms/step - loss: 1.0388 - accuracy: 0.7298\n",
      "Epoch 34/100\n",
      "377/377 [==============================] - 6s 17ms/step - loss: 1.1223 - accuracy: 0.7098\n",
      "Epoch 35/100\n",
      "377/377 [==============================] - 6s 17ms/step - loss: 1.0884 - accuracy: 0.7151\n",
      "Epoch 36/100\n",
      "377/377 [==============================] - 6s 17ms/step - loss: 1.0125 - accuracy: 0.7306\n",
      "Epoch 37/100\n",
      "377/377 [==============================] - 6s 17ms/step - loss: 0.8722 - accuracy: 0.7705\n",
      "Epoch 38/100\n",
      "377/377 [==============================] - 6s 17ms/step - loss: 0.7836 - accuracy: 0.7916\n",
      "Epoch 39/100\n",
      "377/377 [==============================] - 6s 16ms/step - loss: 0.7526 - accuracy: 0.8018\n",
      "Epoch 40/100\n",
      "377/377 [==============================] - 5s 14ms/step - loss: 0.7575 - accuracy: 0.7966\n",
      "Epoch 41/100\n",
      "377/377 [==============================] - 5s 14ms/step - loss: 0.7936 - accuracy: 0.7896\n",
      "Epoch 42/100\n",
      "377/377 [==============================] - 6s 17ms/step - loss: 0.9226 - accuracy: 0.7588\n",
      "Epoch 43/100\n",
      "377/377 [==============================] - 6s 17ms/step - loss: 1.0084 - accuracy: 0.7329\n",
      "Epoch 44/100\n",
      "377/377 [==============================] - 6s 15ms/step - loss: 0.9981 - accuracy: 0.7352\n",
      "Epoch 45/100\n",
      "377/377 [==============================] - 5s 14ms/step - loss: 0.9332 - accuracy: 0.7505\n",
      "Epoch 46/100\n",
      "377/377 [==============================] - 5s 14ms/step - loss: 0.8718 - accuracy: 0.7707\n",
      "Epoch 47/100\n",
      "377/377 [==============================] - 5s 13ms/step - loss: 0.8797 - accuracy: 0.7662\n",
      "Epoch 48/100\n",
      "377/377 [==============================] - 5s 14ms/step - loss: 0.8414 - accuracy: 0.7737\n",
      "Epoch 49/100\n",
      "377/377 [==============================] - 5s 13ms/step - loss: 0.8105 - accuracy: 0.7862\n",
      "Epoch 50/100\n",
      "377/377 [==============================] - 5s 13ms/step - loss: 0.7872 - accuracy: 0.7884\n",
      "Epoch 51/100\n",
      "377/377 [==============================] - 5s 13ms/step - loss: 0.7882 - accuracy: 0.7913\n",
      "Epoch 52/100\n",
      "377/377 [==============================] - 5s 13ms/step - loss: 0.8324 - accuracy: 0.7789\n",
      "Epoch 53/100\n",
      "377/377 [==============================] - 5s 13ms/step - loss: 0.9350 - accuracy: 0.7519\n",
      "Epoch 54/100\n",
      "377/377 [==============================] - 5s 13ms/step - loss: 0.9619 - accuracy: 0.7480\n",
      "Epoch 55/100\n",
      "377/377 [==============================] - 5s 13ms/step - loss: 0.9448 - accuracy: 0.7512\n",
      "Epoch 56/100\n",
      "377/377 [==============================] - 5s 13ms/step - loss: 0.9202 - accuracy: 0.7611\n",
      "Epoch 57/100\n",
      "377/377 [==============================] - 5s 13ms/step - loss: 0.8563 - accuracy: 0.7713\n",
      "Epoch 58/100\n",
      "377/377 [==============================] - 5s 13ms/step - loss: 0.8213 - accuracy: 0.7839\n",
      "Epoch 59/100\n",
      "377/377 [==============================] - 5s 13ms/step - loss: 0.8024 - accuracy: 0.7831\n",
      "Epoch 60/100\n",
      "377/377 [==============================] - 5s 13ms/step - loss: 0.9599 - accuracy: 0.7531\n",
      "Epoch 61/100\n",
      "377/377 [==============================] - 5s 13ms/step - loss: 0.9800 - accuracy: 0.7426\n",
      "Epoch 62/100\n",
      "377/377 [==============================] - 5s 13ms/step - loss: 0.9511 - accuracy: 0.7466\n",
      "Epoch 63/100\n",
      "377/377 [==============================] - 5s 13ms/step - loss: 0.9091 - accuracy: 0.7562\n",
      "Epoch 64/100\n",
      "377/377 [==============================] - 5s 13ms/step - loss: 0.8358 - accuracy: 0.7755\n",
      "Epoch 65/100\n",
      "377/377 [==============================] - 5s 13ms/step - loss: 0.7737 - accuracy: 0.7961\n",
      "Epoch 66/100\n",
      "377/377 [==============================] - 5s 13ms/step - loss: 0.7415 - accuracy: 0.8019\n",
      "Epoch 67/100\n",
      "377/377 [==============================] - 5s 14ms/step - loss: 0.7811 - accuracy: 0.7915\n",
      "Epoch 68/100\n",
      "377/377 [==============================] - 5s 13ms/step - loss: 0.7916 - accuracy: 0.7849\n",
      "Epoch 69/100\n",
      "377/377 [==============================] - 5s 13ms/step - loss: 0.8149 - accuracy: 0.7807\n",
      "Epoch 70/100\n",
      "377/377 [==============================] - 5s 14ms/step - loss: 0.8336 - accuracy: 0.7770\n",
      "Epoch 71/100\n",
      "377/377 [==============================] - 5s 14ms/step - loss: 0.8974 - accuracy: 0.7638\n",
      "Epoch 72/100\n",
      "377/377 [==============================] - 5s 14ms/step - loss: 0.8985 - accuracy: 0.7597\n",
      "Epoch 73/100\n",
      "377/377 [==============================] - 5s 14ms/step - loss: 0.9237 - accuracy: 0.7579\n",
      "Epoch 74/100\n",
      "377/377 [==============================] - 5s 14ms/step - loss: 1.1303 - accuracy: 0.7186\n",
      "Epoch 75/100\n",
      "377/377 [==============================] - 5s 14ms/step - loss: 0.9395 - accuracy: 0.7550\n",
      "Epoch 76/100\n",
      "377/377 [==============================] - 5s 14ms/step - loss: 0.8447 - accuracy: 0.7749\n",
      "Epoch 77/100\n",
      "377/377 [==============================] - 5s 14ms/step - loss: 0.7729 - accuracy: 0.7956\n",
      "Epoch 78/100\n",
      "377/377 [==============================] - 5s 14ms/step - loss: 0.7816 - accuracy: 0.7938\n",
      "Epoch 79/100\n",
      "377/377 [==============================] - 5s 14ms/step - loss: 0.7837 - accuracy: 0.7904\n",
      "Epoch 80/100\n",
      "377/377 [==============================] - 5s 14ms/step - loss: 0.7836 - accuracy: 0.7890\n",
      "Epoch 81/100\n",
      "377/377 [==============================] - 5s 14ms/step - loss: 0.7949 - accuracy: 0.7832\n",
      "Epoch 82/100\n",
      "377/377 [==============================] - 5s 14ms/step - loss: 0.7881 - accuracy: 0.7863\n",
      "Epoch 83/100\n",
      "377/377 [==============================] - 5s 14ms/step - loss: 0.8286 - accuracy: 0.7789\n",
      "Epoch 84/100\n",
      "377/377 [==============================] - 5s 14ms/step - loss: 0.8194 - accuracy: 0.7820\n",
      "Epoch 85/100\n",
      "377/377 [==============================] - 5s 14ms/step - loss: 0.8447 - accuracy: 0.7750\n",
      "Epoch 86/100\n",
      "377/377 [==============================] - 5s 14ms/step - loss: 0.8350 - accuracy: 0.7809\n",
      "Epoch 87/100\n",
      "377/377 [==============================] - 5s 13ms/step - loss: 0.7981 - accuracy: 0.7838\n",
      "Epoch 88/100\n",
      "377/377 [==============================] - 5s 14ms/step - loss: 0.7980 - accuracy: 0.7859\n",
      "Epoch 89/100\n",
      "377/377 [==============================] - 5s 14ms/step - loss: 0.7817 - accuracy: 0.7901\n",
      "Epoch 90/100\n",
      "377/377 [==============================] - 5s 14ms/step - loss: 0.7995 - accuracy: 0.7822\n",
      "Epoch 91/100\n",
      "377/377 [==============================] - 5s 14ms/step - loss: 0.8269 - accuracy: 0.7794\n",
      "Epoch 92/100\n",
      "377/377 [==============================] - 5s 14ms/step - loss: 0.8531 - accuracy: 0.7730\n",
      "Epoch 93/100\n",
      "377/377 [==============================] - 5s 14ms/step - loss: 0.8008 - accuracy: 0.7821\n",
      "Epoch 94/100\n",
      "377/377 [==============================] - 5s 14ms/step - loss: 0.8200 - accuracy: 0.7770\n",
      "Epoch 95/100\n",
      "377/377 [==============================] - 5s 14ms/step - loss: 0.7962 - accuracy: 0.7874\n",
      "Epoch 96/100\n",
      "377/377 [==============================] - 5s 14ms/step - loss: 0.7840 - accuracy: 0.7907\n",
      "Epoch 97/100\n",
      "377/377 [==============================] - 5s 14ms/step - loss: 0.7958 - accuracy: 0.7868\n",
      "Epoch 98/100\n",
      "377/377 [==============================] - 5s 14ms/step - loss: 0.7930 - accuracy: 0.7858\n",
      "Epoch 99/100\n",
      "377/377 [==============================] - 5s 14ms/step - loss: 0.8508 - accuracy: 0.7729\n",
      "Epoch 100/100\n",
      "377/377 [==============================] - 5s 14ms/step - loss: 0.9407 - accuracy: 0.7522\n"
     ]
    }
   ],
   "source": [
    "epochs = 100\n",
    "\n",
    "# Train the model\n",
    "history = model.fit(xs, ys, epochs=epochs)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "id": "WgAzLnLATFts"
   },
   "source": [
    "You can visualize the accuracy below to see how it fluctuates as the training progresses."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 12,
   "metadata": {
    "id": "3YXGelKThoTT"
   },
   "outputs": [
    {
     "data": {
      "image/png": "iVBORw0KGgoAAAANSUhEUgAAAjcAAAGwCAYAAABVdURTAAAAOXRFWHRTb2Z0d2FyZQBNYXRwbG90bGliIHZlcnNpb24zLjguMywgaHR0cHM6Ly9tYXRwbG90bGliLm9yZy/H5lhTAAAACXBIWXMAAA9hAAAPYQGoP6dpAABbW0lEQVR4nO3de1zT9f4H8Nc22LiP+7iIImoqXkBBEe8ppeaxLE9ZWRq/spOXsjjnlJ5KO3UKu5mVHi3TOqWpWaZdTDO8paIoeL/gXRAcFxHGRTbYvr8/BjMCFMa27xiv5+OxxyO++363N1/Nvfa5SgRBEEBERETkIKRiF0BERERkSQw3RERE5FAYboiIiMihMNwQERGRQ2G4ISIiIofCcENEREQOheGGiIiIHIqT2AXYmsFgQG5uLjw9PSGRSMQuh4iIiJpAEASUlpYiJCQEUumt22baXLjJzc1FWFiY2GUQERGRGbKzs9GuXbtbntPmwo2npycA483x8vISuRoiIiJqCo1Gg7CwMNPn+K20uXBT2xXl5eXFcENERNTKNGVICQcUExERkUNhuCEiIiKHwnBDREREDoXhhoiIiBwKww0RERE5FIYbIiIicigMN0RERORQGG6IiIjIoTDcEBERkUNhuCEiIiKHwnBDREREDkX0cLN48WKEh4fDxcUFcXFxSEtLu+X5CxcuRNeuXeHq6oqwsDC88MILqKystFG1REREZO9EDTdr165FUlIS5s2bh4yMDERFRWHUqFHIz89v8Pyvv/4as2fPxrx583Dq1CksX74ca9euxb/+9S8bV07kGKr0BgiCIHYZZAOVVXpU6w1il0FkE6KGmwULFmDq1KlITExEZGQkli5dCjc3N6xYsaLB8/fu3YtBgwbh0UcfRXh4OO6++2488sgjt23tIaL6TuZqMHD+Ngx+ezvWHcyG3sCQ44gqq/RYtO0s+ry+FeMW7UFRuU7skoisTrRwo9PpkJ6ejoSEhJvFSKVISEhAampqg9cMHDgQ6enppjBz4cIFbNq0Cffcc0+j76PVaqHRaOo8iNq6s3mleHz5fhSUapFTfAP//PYoRi/chS0n1GzJcRCCIGDryTzc/cEuvPfrGdyo0uPUVQ0eX74fJTeqxC6PyKpECzeFhYXQ6/VQqVR1jqtUKqjV6gavefTRR/H6669j8ODBcHZ2RqdOnTB8+PBbdkslJydDqVSaHmFhYRb9PYham0uF5Zj02X5cK9ehZ6gXXhrdDUpXZ5zNL8PfvkrH/f/dixO5JWKXSS2QU3wDT3x+AFO/PIisogqovBSYNy4S/h5ynMjV4P++OIAKXbXYZZqluEKH7KIKGNjSSLcg+oDi5tixYwfeeust/Pe//0VGRgbWr1+Pn3/+GW+88Uaj18yZMwclJSWmR3Z2tg0rJrIv2UUVeHTZPuSXatEtyBNf/V8cpg3vhF0v3omZd3aGq7MMh7OLMX7xHnyy8zw/QFohQRAwY1UGdp4pgFwmxbThnbDt78OROKgjvvy/OHi5OCH98nVM/fIgKqv0YpfbLMUVOox8fyeGvLMdPV/bgvGL92D2d0fxv72XkHWtQuzyyI5IBJHaoHU6Hdzc3PDtt99i/PjxpuNTpkxBcXExNm7cWO+aIUOGYMCAAXj33XdNx1auXImnn34aZWVlkEpvn9U0Gg2USiVKSkrg5eVlkd+FyGAQoNZUQu4khYfCCQonKSQSidhl1aEuqcSDn+xFdtENdApwx5qn4xHgqahzTr6mEq9sOI5fT+YBAOIj/PD+Q1EI8XYVo2SzVVbpcS6/DN2DvSCT2tefg7X9frYAjy9Pg4uzFD89OwSdAz3qPH8o6zoe+2w/ynV6JHQPxH8nxUDu1Dq+536w9Qw+TDnb6PNRYd64NyoEY3sFI0jpYsPKyBaa8/ntZKOa6pHL5YiJiUFKSoop3BgMBqSkpGDmzJkNXlNRUVEvwMhkMgDgOAES1ez1R/HNwSumn2VSCdzlMiR0V+H9h6LsIui8+N1RZBfdQAc/N3w9dUC9YAMAgV4u+OTxGKw9kI1//3gSqReuYfTCXXjnr1EY3TNIhKqb7mrJDWw7nY/tp/Ox+1whKqsMuDcqBB8+HG0X999WFm07BwB4pH/7esEGAPq098HyJ/phyoo0/HYqH+MX78F7D0YhMsS+v+yVaavxxd5LAIAPH45GZLAXTqtLkakuRUbWdey7cA1HsotxJLsY//n5JHqFKhHh745wf3eE+7mjo787eoR4wUlmf0FObxCwIzMfW06oMS4qBEO6BNjsvTWVVdh6Ig8/H7uKI9nF6N/RF5PiOmBgJz9IW/EXA9FabgDjVPApU6bgk08+Qf/+/bFw4UJ88803OH36NFQqFSZPnozQ0FAkJycDAF577TUsWLAAn376KeLi4nDu3DlMmzYNMTExWLt2bZPeky03ZGm/HLuKaasyGn0++YFeeKR/extWVN/xnBL85ePdkEkl+C1pGDr6u9/2mouF5Xh+zSEcuVICuUyKvXNGwN+jfiASgyAIuHStAumXryP9chEOXrqOs/llDZ778j3dMXVohI0rFMfBS0X469JUOMsk2PXinQhWNt7itutMAWatOYTrFVVwkkowc0RnTB/e2W5bcT7ddR5vbTqNCH93bE0aVq9FrqBUi03HruLHI7k4ePl6g69xh8oDr93bAwM7+dui5NsqrtDhm4PZ+GrfZWQX3QAASCTAP+7uiunDO1k1lG87nYev92dh15lC6BpYIqCDnxse7d8e9/QKhsrLxS7+XjTn81vUcAMAixYtwrvvvgu1Wo3o6Gh89NFHiIuLAwAMHz4c4eHh+OKLLwAA1dXVePPNN/HVV18hJycHAQEBGDduHN588014e3s36f0Yblq/PE0lluw4jzBfNzw5uKOoteSXVmLUB7twvaIKM+7shKS7uqJCV41yrR7fHMzGgq1n4Klwwq9JQ2/5QWNtM77OwM9Hr2J8dAgWPtynyddV6Q24d9EenLqqwfwHeuFhkUMaAGw+rsYrG46jsExb57hEAvQJ88aIboG4s1sgDlwswms/noRUAqx8Mg4DO9vHB5o1PfF5GnZkFuCR/mFIfqD3bc8vKNXi1Q3HsfmEcRJH92AvvD2hF3q387Zypc1TWaXHkHe2o6BUi3f+2hsPxd56Ykhu8Q0cvVKMi4UVuHytHBcLy3EyV4NSrXEQ9dhewfjX2O4I9XaFtlqPveeuYfNxNXadLUB8hB/+fV8PeLo4W+X3OJFbgkNZxUi/fB3bTudDW20MFkpXZ/Rup8TvZwsBAKN7BOG9h6LgobB8B8vqtCzMWX/M9HPnQA/8pXcw+oX7YssJNb7PyDHdq1rebs4I8FAgSOmCZ0d0Qf+Ovhav63ZaVbixNYab1qtab8AXey9h4W9nUVbzP97Hj/TBuKgQUeoRBAFTvzyI307lo3uwFzbOGFTn243eIOCBJXtxJLsYI7sF4rMpsaJ0j1wsLMfI93fAIACbnx+CbkHN+3u/ePs5vLslE8O7BuCLxP5WqrJpjueUYMKSvdBWGyB3kqJ3qBIxHXzQt4MP+oX7wtddbjpXEAT8fd0RrM/Iga+7HD8+OxihNho7tCMzHx9vOwdXZxl83OXwcXOGt5sc8RF+iO/kZ5X3PHalBOMW7YZUAmz/x3B08Lt96xxgvE8/Hb2KuRuP43qFcYr4gAhfPDGwI+6KVNnFmKWV+y7jlQ3HEaJ0wY5/3mlWK0JxhQ4Ltp7Byn2XYRAAF2cpBnf2x74LRaZ/T2p19HfHokf7oEeIskV16w0CjlwpxvbT+dh1pgAnr2pQpa/7kRsZ7IUpAzvg3qhQuMplWJOWhbkbT0CnN6BLoAc+nRzbpJbWpvrhSC5mrTkEQQAeim2HJwdHoGuQZ51zKnTV+PFILlanZeN4Tgmq/zSxwNPFCT89O7jJf8csheHmFhhuWqcDl4rw6objOK0uBQAEeiqQX6qFp8IJm2YNQZivm81r+uZANl787ijkMil+eHZQg6HhTF4pxn70O6r0Aj58OBr3RYfavM45649hdVoWRnQLxIon+jX7+nP5ZUhYsBPOMgnSX70LXlb4RtsU18t1GLdoN65cv4E7uwZg6eMxUDjJbnlNZZUeE5bsxYlcDXq3U+Kbv8XDxfnW17TUufwyjF+8p94HJgDIZVLs+9fIOiHMUp75Kh2bT6hxf59QfDAxutnXF5Zp8ebPp/DDkVzTgo6h3q54PL4DHoxpBz+RuiSr9Abc+d4OXLl+A6+Ni8QTg1rWWnsyV4PXfjyBtItFpmMqLwVG9QhCVDtvvP9rJnJLjJMD5o2LxKP926NKLyD1wjX8ekKNPecKcYfKE6/f17PBQcuCIGDHmQL8eCQXOzIL6i2a6O8hR5/2PujT3hvxEX6IDvOu96UnI+s6nvkqHfmlWiicpBjYyQ/DuwZieNeA2waK4zklmPF1Bnzd5Xg+4Q4M7eJvev3fTubhmZXpqDYImBTXHv8Z3/O2X7gMBgElN6pQUKZFYakW7/2aiYysYvQI8cJ30wZa/f+nP2K4uQWGm9bns98v4D8/nwJgbBqdPbobHujbDo8s24f0y9cRHeaNdc/Ew9mGAwWziyoweuEulOv0mDOmG/42rFOj536UchYLtp6Bj5sztiYNs+m4lXxNJQa/vR06vQHrnolHv3DzmpITFuzEufwy0QKa3iDgic/T8PvZQnTwc8MPMwZD6da0kJVdVIF7F+3G9YoqPBjTDu8+GGW1Osu01bhv0W6cLyhHv3AfPNK/PYrKdSiuqML3h3KQU3wDb0/ohYn9LNu9dzavFHd9sAsAsPWFoeii8rzNFY3LLb6BlfsuY3Valqklx0kqwcjugXgwJgzDuwbYdFDu+owrSPrmCPzc5dj90gi4ylv+YSoIAracyMPZvFIM6uKP6HbepsGz18t1+Me6I0g5bdwGKCrMGxfyyxrspnl7Qm+M6nFzoP35gjK89sMJU9cSAHgqnDC0awDu7BqIuI6+aOfj2qQW3HxNJWZ+fQhpl4rqHI/wd8djAzpgysDweq1q+y9cw1P/O1in1v4dffHPUV1RVW3AE18cgK7agPHRIVjwULRZA4avltzA2I92o6hch0f6t0fyA72a/RrmYri5BYab1iXrWgUSPtgJXbUBD8W2w+wx3U3feq9cr8CYD39HaWU1pg3vhJdGd7NJTQaDgEeW7cP+i0XoF+6DNU/H37LpvkpvwLiPd+O0uhR/6R2MRY/2tUmdADD/l9NYuvM8Yjr44LtpA81+nfe2ZGLR9nMY0zMISx6LsWCFTfP25tNYsuM8XJ1l+H7GwGZ3re0+W4jJK/bDIAA/zBxklTElgiBg+qoM/HJcDZWXAj89O6TOjLTa7r2hdwTgy/+zbPfeC2sP4/tDORjdIwhLH7fMn09llR4/HMnFyn2XcfTKzUUd/T0UmBzfATPv7Gz12TQGg4C7F+7CufwyvDi6K6YP72zV96slCAI++/0i3t582tQlE+ipQEKkCvERfvhk13kczzGudv9I//b4+9134LPfL2L57guo0guQy6R4NK49RvUIQmy4j9lfvARBQGZeKXZkFmD76XykX75uqicqzBvvTOht6lJKOZWH6asyoK02oH9HX/QMUWLl/svQ1YzpcZJKUG0QcFekCv+d1LdFXwZ3nSnAlM/TIAjABxOjcH+fdma/VnMw3NwCw03r8vSXB/HryTwM6uyHlU/G1fvGs+nYVUxflQGJBPjq/+IwuIv1B42mnMrDk/87CDe5DJtnDUV7v9t3iR27UoLx/90DvUHAiidiMaKb6rbXtJSmsgqDkrehVFuNzybHIiHS/PesnW3l6ixDxqt3WeTbc1P9cTbaR4/0wb1mjrF6dvUh/HgkF08MDMdr9/awZIkAgE92nkfyL6fhLJNgzdPxiOngU+f5CwVlGPH+TjhJJTj4SgK83SzTNXX5WjlGvL8TeoOAH2cORq92LRsn0pDTag2+PXgFGw7noLDM2M1yuxZLS9h8XI1nVqbD08UJe2aPsHmX6NErxdh1pgCDOvsj6g+tO7pqA97/NROf7LoAAJBKgNphKXd2DcC8cT0QbsFxMrU0lVXYeDgX7/xyGqXaajjLJJg+vDNCfVwxZ/0x6A0CEroHYtGjfeHiLENu8Q18vO0svjl4BXqDgEGd/bB8Sj+LdCUt2HoGH6WchauzDBtnDsIdLWgtbKrmfH6LP7eLqBG/ny3AryfzIJNKMG9cjwabcu/pFYxH+reHIAAvfHO43gwaa1h/KAeA8RtbU4INAPRqpzTN7Poo5ZxN1mVaue8ySrXVuEPlgRHdAlv0Wj1CvBDq7YobVXrsOltgoQpv74cjuUj65ggAYOqQjmYHGwB4oG+o6TWrLLw79p5zhXh782kAwNxxPeoFGwCICPBAtyBPVBuMez5Zykcp56A3CBjeNcAqwQYAugV54ZW/RCJ1zkjMGWNsIX1nSyYO/qnLxJIEQcDH24wL9k2O7yDKWK/e7bwxc0QX9GnvU6eVSu4kxZx7umPVU3FQeSlgEIB2Pq5YNjkWK57oZ5VgAwBeLs54fEAHbE0ahoTuKuNYvpSzePHbo8YJDH1CseSxGFN4CfF2RfIDvfFb0jC8+9fe+GyyZYINAMwa2QWDO/vjRpUe01am291q1ww3ZJeq9Ab8+8eTAIz/sN3qW8Hcv0TiDpUHCkq1pgXMrEVTWWX6YLq/T/PGnjw9NAJyJykOZxungVpTZZUeK3ZfAgA8M6xTi7sPJBKJaRG/Lccb3vutuSp01Ziz/ije3XIaeZrKOs9VVunxyoZjeG71Idyo0uPOrgEt7nYc0tkf/h4KFJXrsDPTcgHtXH4Znl19CAYB+GtMOzwW1/h4mnt6BQMwtjhawvmCMnx/yLh45AsJd1jkNW/FWSbF00MjcG9UCPQGAc+uPmS1XcZ/O5WPE7kauMlleHKwfa5TNKizP7Y8PxTLJsfit6RhuCtSZZMZkUFKFyybHINFj/aBX003feKgcLz3YFSD3U0d/d3xYGyYRVtcZVIJFj4cjUBPBc4XlGNNWpbFXtsSGG7ILn2Zehnn8stMI/5vxVUuw8tjIwEA32VcwQ2d9b5B/HLsKnTVBtyh8kCPZq7o6u+hwISa1oNPa5qzrWXXmQIUlmkRrHSx2FT52nDz26k8Uz9+S6zYfRGr07KxePt5DH57G/657gjO5JXi8rVy/HXpXqzclwWJBHh2RGd8NqVfiwexOsmkuC/aeC/WH7pym7Ob5vK1ckz6bB+KynXoFaq87eyTe3oZ7+Huc4UW2Zn7w9/OwiAACd0DERXm3eLXawqJRIK3HuiFCH93XC2pRNI3hy2+B5kgCPgw5QwAYMrAcKvMLrMUbzc57opU2XTWEGD8c/hL7xBs/+dw/PTsYMz9S6TNVxT291BgVkIXAMAnuy5Y5N8FS2G4IbtTWKbFwq3Gf9heHNUVStfbN0cP6eyP9r5uKK2sxo9Hc61W2/oMY5fU/X3amfUNrfYb6NZTebhYWG7R2v5o3wVjd8Gd3QItNousb3sf+HsooKmsxr4L11r0WmXaany2+yIAICLAHVV6AevSr+DuD3bh7g924XiOBr7ucnyR2B9/v7urxdZaqe2a+u1UPkoqWhYurlyvwKPL9iNPo8UdKg98kXj7Jv/OgZ7oEuiBKr2AlFMt65o6k1dq+rv+wl3Wb7X5Iw+FExZP6guFkxQ7MguwdNd5i77+ttP5OJ5jbLWZOsQ+W23shZeLM3qGKkXbYmRC33YI9FTgakklNtR02dsDhhuyO+9uzkSpthq9QpV48DYrkdaSSiV4tKY7YNW+y1ap68r1Cuy/WASJBKYWgObqHOiBkd0CIQjA8t3Wa73Zf9EYPgZEWG7BOJlUgrt7GAcl165oa66V+y6juKIKHf3dsfWFYVg/fSDG9AyCRAJoqw2I7eCDn58bjGF3WHaPnchgL3QL8oSu2oCfW9A1pC6pxKTP9iOn+AYi/N2x8qm4Jq8DY6muqYW/nYEgAGN6BrV4sTlzdA/2wr9rBma//+sZbDycY1ofpyUEQcDC34xjbR6P72DXrTYEuDjfDKBLdp63yN8BS2C4IbtyNq8U36RnAwBeuzeyWd/YH4xpB2eZBEeulODYH6auWsrGw8ZvyQM6+rVol+zafY7WHbyCa1YYAF1SUYWTV43TVAdYeIn00TVrevx6Is/sf8Ru6PT47HdjsJs+vBNkUgn6tvfBksdisOMfw7H0sb5Y/fQAq2xXIZFITK036zPM65oqKNVi0mf7cPlaBcJ8XbFqahwCPZu+A3VtuNl1phCllea1Hp3ILcGmY2pIJLhtt601TewXhvv7hEJvEDBrzWEMe3c7Ptl5HtdbMA5ne2Y+juWUwNVZhqfZatMqPBrXHkpXZ1wsLMcvxy0znqylGG7IrnybcQVCzRiCmA7N+2D281BgTE/jB8fXaZZtvREEAd/XNLne37dli9jFdfRF73ZKaKsNWLnP8oPwDlwqgiAYF/sK9Gr6h25TxHfyg5eLEwrLtMjIMm9Q9NdpWSgs0yHM1xXj/zQou4OfO0b3DLbqgoz3RYdCKgEOXr6Oy9ea1zVYWKbFY5/tx/mCcoQoXfD1U80PYXeoPNApwB06vQHbahaKa67alo2/9A6pt3S+LUkkEiQ/0AvPDOsEpaszrly/geRfTmNAcgqeW30IK3ZfxL4L15rcBfjHVpvJ8R1EWxWZmsdd4YTEQeEAgMXbz9tkNujtMNyQ3TAYBGw8ZGwd+WuMeYtCPTagAwBjK4vGzG/FDTmeo8G5/DIonKQY0zPo9hfcgkQiMTXjfpl6yeJTKGu7pOIiLL+xnbNMalov5+ejzf+GVlmlxyc7jeMzpg/vbNNVpWupvFwwqGYTze+bMUagsEyLScv2IzOvFCovBVZNHWDWth8SicTUemPOPTx6pRhbT+ZBKjFOxxWbi7MMs8d0w745I/HOhN7oEeIFbbUBPxzJxes/ncTDn+5D1Ou/YtD8bVh74NZhfkdmAY5eMbbatJWd3B3FEwPD4S6X4dRVDbZnmhfaLYnhhuzGvgvXoNZUwsvFCXeauS5Lv3AfdAn0QIVOb9HBbbWza+6KVFlkt+AxPYMQ6u2Ka+W6Zn3ANkXtYOK4jtbZoHFcb+N4o42Hc5o9O+Kbg9nIL9UiROmCCX1ts6ppQ2rf+/tDOU36lvnnYLN66oAWbWZY28K440xBg3tQNaZCV21aImF8dCg6B3qYXYOlucpleKhfGH56djC+mzYQz43sgrsiVabNSnOKb2DB1jON3m9BELAw5eZYG1tuU0It5+0mN325XLTNNmt53QrDDdmN2g/5sb1DbrshYmMkEgkmmQYWZ1nkf7BqvQE/HjG2KD3Qwi6pWk4yKf6vZlG/Zb9fsNhUWk1lFU7kGscbWaPlBgCGdPGHykuB6xVVzZrxo6s2YOkOY6vNM8M7mbWzs6Xc3UMFN7kMl69V3LZ77Y/BJtDTGGwiAloWKroHe6Kjvzt01YYm38MybTWe+PwA0i9fh7tcZpqCa28kEgliOvgg6a47sGxyLPbMHoH0VxIgd5IiT6PFpWsVDV53LKcER7KL4eIs5QypVurJwR0hd5IiI6sY+y9ab4HHpmC4IbtwQ6fHLzWLw7U0QNzftx1cnKXIzCu1yGJ5v58rRGGZDn7ucgzpYrnZOxP7hcFT4YQLBeXYfa7w9hc0Qfql6zAIQAc/N6sMyAWMway25eObg9lNvu67jCvILalEoKcCDzVxFpy1uMmdTK0nL3571Lia85+6Ma+X6/DNgWxM/CTVFGzWPN3yYAMYA8DYmq6pN346iQsFZbc8X1NZhcnL9yPtYhE8FU748sn+t90d2p74eSjQp2YdntTzDS8jsOuMcWHFoV0C6uzJRa1HoJcLHoo1/tuweLt1F1S9HYYbsgu/ncpDmbYa7XxcEdO+/tL1zaF0dTYt07/SAtPCv69Z22ZcVIhFx4h4KJwwoWZs0VcWmr5eu/7MACt1SdWqHRO180xBvdWFG6KprMKHNQNF/zask80XPGvIk4M7wl0uw/mCcryy4Tj6v5mCf647gv/tvYTHl+9H7Ju/4cXvjuJ8QblFg02tp4dFIDLYC4VlOjz22X5cud5wi0ZJRRUeX56GjKxieLk4YeVTcc0ebG8PapclaGyNpNqdtIdYePo/2dbfhnaCwkmKQE8Xi29z0hwMN2QXTDOR+oRaZJXNSXHGvt9Nx9QorjB/WmppZRV+Pak21WZptX3UKafykFN8o8Wvt6+mKdhaXVK1IgI80C/cBwbB2CJzO2//chpqTSU6+LmZug3FFhnihd9fGoFXxnZHpwB33KjSY136Fcz74QR+P1sIvUFAZLAX/n7XHfjp2cEWDTaAcfG1L5/sj4gAd+SWVOKxz/Yjv/RmUBQEAemXr+PRz/bhSHYxvN2c8fXUATZbidjS4jvdDDd/7i4u11abugeHdLb+5rdkPWG+bkj7VwLef6jhrSBsheGGRFdYpsXOmibpP08NNlfvdkrjYm16AzYdM3/BuV+Oq1FZZUBEgDt6W2FTws6BHhjYyQ8GAVi9v2XTwsu01TieUzvexrotNwBMCyyuO3jllmOb0i4WYVXN75b8QC+7aLWp5esux1NDIvBb0jCseyYeE/q2w4AIX7w0uht2/GM4Ns0agmdHdrH4lPpa/h4KrHoqDqHerrh0rQKTl6fhUmE5Vuy+iFELd2HCkr04kauBn7scq6cOQM9Q2y/WZynRYd6QO0mRX6rFhT+tzr3/4jVU6QW083FFhyZuRkv2S+lm+01O/4zhhkT305Fc6A0Cotop0clC344lEokpKG04bP5spNouqQl9zdtuoSlqW2/WHMhq0d4sBy8VQW8QEObrapqhYk1jewXDTS7DxcJyHGxkbFNllR6zvzsKAHi4XxgGdrLPb+USiQT9wn3x/kNRWPN0PKYN72S1nZ3/LFjpilVPxSHAU4HT6lIMf28HXv/pJM7klcHF2Ti+6btpA9E9uHl7mdkbF2cZ+rb3BlC/a8rUJdUlQLRtBMixMNyQ6Gq7pCzValPr3qgQSCTGloPGxjPcSk7xDeyrWTPG3O0WmuKuSBUCPRUoLNO1aFuD2tkJ1poC/mfuCifToNhvDjQ8sHjRtnO4UFiOAE8F5ozpbpO6WqNwf3esfDIO3jXfeLsHe+H1+3pgf03zvq2ClrXFRxjDbe1yBbV2m8KNfYZfan0YbkhU5wvKcORKCWRSicV2r64V4u2K/uHGsSc/HGn+ZpobDuVAEIwrCrfzsV5TubNMikf6G8ehrEw1f2CxaTCxDbqkaj3Uz9g19fOxq/XWazl1VYOlNQv2vXFfD7toqrZnXYM88esLQ7Hl+aHY9NxgTI4Pb9Kmsa3JgJqxYKnnb467UZdU4mx+GSQSYGAn2/3dJcfGcEP1HLxUhC9TL+G/O87h3S2n8doPJzBv43FcLWn5gNc/q93fZ2gXf6ss2lU7CHhDExdrq/XH7RZssdjcI/3bQyaVIO1SEU6rNc2+vkJXbdpPK87C+0ndSmwHH3T0d0eFTo9Nf1ht92rJDcz+7iiqDQJG9VBhdM20a7q1QE8XdA3ydNiumej23lA4SVFYpsX5AuO4m9/PGsfb9Q5VwtuNm2SSZTiJXQDZj2q9AW9vPo1lv19s8Pmsogp8ntjfIu8lCAL+t/cSltQs6vaAlQLEmF7BmLvxBM7kleHU1VJEhjRt3EKd7RZ6tWy7haYIUrrg7kgVfjmuxsp9l/Gf8b2adX365euoNggI9XY1a0sAc0kkEjwY2w7vbM7EJ7vOY9fZAmRcvo7cEuOsH08XJ7x+X0+b1UP2TeEkQ0wHH+w9fw37LlxD50AP0xpPllxDiogtNwSgZkPA5ftNwebOrgH4a0w7PDEwHH8bFgEnqQTbMwuw93zLF5ur0hvw6sbjeO3HkzAIxt28a8duWJrS1RkjarZy2NiMgcW105sttd1CUzxeM7D4+4ycZu8WXdslZe0p4A2Z0LcdpBLgfEE5fjp6FbkllZBJJegZ6oX/TuoLlZVmGlHrVNttmnrhGgwGAXtqws1gjrchC2LLDeFwdjGmrUzH1ZJKuMtleO/BKIz5U9i4odPjy9TLmP/LaWyYPsjstWhKblRh5tcZ+P1sISQSYPbobnh6aIRVm+HH9wnB5hNqbDycixdHd4PsNrVX/WG7BVvufxTfyQ8RAe64UFCO7w/lYHJ8eJOuq9Yb8NtJ40Z11l68ryEqLxe8PDYSqeevIaqdEjHhPohq5w13Bf95ofpqw83+C9dw8qoGhWU6uMll6NvCxTuJ/ogtN23c9tP5eGhpKq6WVCLC3x0bZgyqF2wA4LmRXeAul+HolRL8dKz5OxkDQL6mEg/8dw9+P1sIN7kMnz4ei78N62T18QXDuwbC08UJak2lacfsW/n9bAGulevg7yG36ewNiUSCyTWtN5/uutDk1T2/2HsJmXml8HJxwsju5m042lJPDu6Iz6bE4tmRXTCwkz+DDTUqKkxZM+5Gh//tvQTAGHjE3GuMHA//NrVxH207C53egJHdArFh5iB0UXk2eJ6/hwJ/G9YJAPDultPQVuub9T66agOmrcrA+YJyBCtdsO6ZeNwVqWpx/U3h4iwzdXttPHT7WVPf/WG7BScbr7A5sV97+HsocOX6DdMaO7eSXVSB9389AwB4eWx3+HEnZbJzCicZYsONrTS13b+DuSoxWRjDTRtWcqMKR7KLAQBvjO8Jr9uMLXlqSEcEeCqQXXQDq/Y1bzXdtzadQvrl6/B0ccLqqQPQI8S2K63eF22cNbXp2FVUVjUezDSVVdh60rhLsy27pGq5ymX421DjjsiLtp+7ZeuNIAh4ecNx3KjSI66jr+ibURI1VW33qaFmAiPXtyFLY7hpw1LPF8IgABEB7ghpwoq2bnInvJBwBwDg421noWnioNeNh3PwRU3z8wcPRYuyIFlcR18EK11Qqq3GttP5jZ634Ncz0FUb0CXQAz2aOLPK0iYNaA8/dzmyiiqw4VDjrTc/HMnFrjMFkDtJkfxAL4edPkyOZ8Af1rMJ8nJB50DL7ttFxHDThpmWPG9Gk/BDse3QKcAd1yuqsLRmGvetnFZrMPu7YwCAZ0d0RoKNuqL+TCqV4N6aVYb/89PJBlcs/jb9iimEvTS6m2hhwU3uhKl/aL2pbqD15nq5Dq//eBIA8NyIzhbf1JHImqLaecPF2fjxM7iLP4M5WRzDTRu22zQFs+nrSzjJpHhpdDcAwLLfL+Cr1EuNLo6nqazCM1+l40aVHkO6+OP5mlYfsfxtaCd0qtmBedJn+5GvubkD87ErJfjX98YQNmtkF9FCWK3HB3SAr7scl69VYOPh+uOE/vPzKVwr16GryhNPD+0kQoVE5pM7SU3r2thq7B21LQw3bVR2UQUuX6uAk1RiWhK9qe6KVOHeqBBU6QW8uvEEnl97GOV/WHpfEATsPVdo3OH4WgVCvV3x0cN9bjsF29p83eVY+VQc2vm44vK1Cjy2fD+KynW4VqbF3746CF21cWD1rJFdRK0TMO7b9NSQjgDqtt7kaSrx8vfH8F3GFUgkQPKEXpxlQq3S/Ad6YeWTcRjVw/qLZFLbw/mabVRtl1Sf9t7NXqROIpHgw4ej0StUifmbT2Pj4VycyNXgv5P64kJBOZbsPG8aqOzqLMOSx/rCx90+llUPVrri66cG4MFP9uJMXhkmr9gPd7kTcmumwn/wcLTZa/hY2uT4cHy66wIuFpZj1f4sqDWV+HzPRVRWGYPOtGGduDYItVp+HgoM7sLZfWQdEqE5G+44AI1GA6VSiZKSEnh5iTNg1B5MX5WOTcfUeCHhDsxKML+l4sClIsxYlYH8Um2d4wonKR7uF4apQyOsuumkuc7ll+KhT/ahqFwHAHCXy7BhRuNT4cWyePs5vLsls86xmA4+eHFUV8TZcINMIiKxNefzm+3ZbZDeIGDPOeNidi1d8rxfuC9+fm6IaTdfTxcnzLyzM/bMHoF/39fTLoMNAHQO9MRXT/aHl4ux8fL9h6LtLtgAwOT4DvCp2U27q8oTn02OxbfPxDPYEBHdgl203CxevBjvvvsu1Go1oqKi8PHHH6N//4Y3aBw+fDh27txZ7/g999yDn3/++bbvxZYb43YL4xfvgaeLEw69epdFFqrTGwSkX76O7sGeNtuLyRLySytRVK5DtyD7/btwvqAM2UUVGNIlQPRxS0REYmnO57foY27Wrl2LpKQkLF26FHFxcVi4cCFGjRqFzMxMBAbWX0p+/fr10Ol0pp+vXbuGqKgoPPjgg7Ysu1XbfbYAABAf4WexFXhlUgn6d7T9po0tFejpgkBP+97YsVOABzpxqjcRUZOJ3i21YMECTJ06FYmJiYiMjMTSpUvh5uaGFStWNHi+r68vgoKCTI+tW7fCzc2N4aYZTOvbcFVQIiJyQKKGG51Oh/T0dCQkJJiOSaVSJCQkIDU1tUmvsXz5cjz88MNwd2941VutVguNRlPn0ZaVa6uRkXUdQPPWtyEiImotRA03hYWF0Ov1UKnqLuKkUqmgVqtve31aWhqOHz+Op556qtFzkpOToVQqTY+wsLa9/07axSJU6QW083FFuJ99DvYlIiJqCdG7pVpi+fLl6NWrV6ODjwFgzpw5KCkpMT2ys7NtWKH9+WOXFJc8JyIiRyTqgGJ/f3/IZDLk5eXVOZ6Xl4egoFuvWlleXo41a9bg9ddfv+V5CoUCCgUXiqq1+5xxMPHgzuySIiIixyRqy41cLkdMTAxSUlJMxwwGA1JSUhAfH3/La9etWwetVovHHnvM2mU6jDxNJc7klUEigWldGiIiIkcj+lTwpKQkTJkyBbGxsejfvz8WLlyI8vJyJCYmAgAmT56M0NBQJCcn17lu+fLlGD9+PPz8+CHdVIdqBhJ3D/Kym+0QiIiILE30cDNx4kQUFBRg7ty5UKvViI6OxubNm02DjLOysiCV1m1gyszMxO7du/Hrr7+KUXKrdTzHOFOsdzulyJUQERFZj+jhBgBmzpyJmTNnNvjcjh076h3r2rUr7GBh5VbneG4JAKBHKMMNERE5rlY9W4qaThAEHM8xhpueIfa71QAREVFLMdy0EXkaLQrLdJBJJegezHBDRESOi+Gmjahttekc4AEXZ5nI1RAREVkPw00bcXO8DVttiIjIsTHctBG1M6V6hnAwMREROTaGmzbiRE3LTU/OlCIiIgfHcNMGFJZpcbWkEgAQyZlSRETk4Bhu2oATucYuqQh/d3go7GJpIyIiIqthuGkDamdKcfE+IiJqCxhu2gDTeBt2SRERURvAcNMGmGZKseWGiIjaAIYbB1dSUYWsogoAQA+23BARURvAcOPgTlw1dkm183GFt5tc5GqIiIisj+HGwZ3g4n1ERNTGMNw4uNptF3q1Y7ghIqK2geHGwZmmgXO8DRERtREMNw6sXFuNC4XlAIAe7JYiIqI2guHGgZ26qoEgAEFeLgjwVIhdDhERkU0w3Diw2i6pnqHskiIioraD4caBHa/ZU4pdUkRE1JYw3DgwDiYmIqK2iOHGQemqDThfUAYAiGS4ISKiNoThxkGdyy9DlV6Al4sTQr1dxS6HiIjIZhhuHNSpq8bxNt2CvSCRSESuhoiIyHYYbhxUbbiJDGaXFBERtS0MNw7qlNoYbroHe4pcCRERkW0x3DggQRBw6mopAKA7W26IiKiNYbhxQPmlWhSV6yCVAHeo2HJDRERtC8ONAzpZM94mIsADLs4ykashIiKyLYYbB1Q7mJhdUkRE1BYx3Digm+Nt2CVFRERtD8ONA2LLDRERtWUMNw6mskqPC7XbLjDcEBFRG8Rw42DO5JXCIAC+7nIEeirELoeIiMjmGG4czM0uKU9uu0BERG2S6OFm8eLFCA8Ph4uLC+Li4pCWlnbL84uLizFjxgwEBwdDoVDgjjvuwKZNm2xUrf0zDSYOYpcUERG1TU5ivvnatWuRlJSEpUuXIi4uDgsXLsSoUaOQmZmJwMDAeufrdDrcddddCAwMxLfffovQ0FBcvnwZ3t7eti/eTp3kYGIiImrjRA03CxYswNSpU5GYmAgAWLp0KX7++WesWLECs2fPrnf+ihUrUFRUhL1798LZ2RkAEB4ebsuS7Zpx2wWGGyIiattE65bS6XRIT09HQkLCzWKkUiQkJCA1NbXBa3744QfEx8djxowZUKlU6NmzJ9566y3o9fpG30er1UKj0dR5OKor12+gtLIazjIJOgd6iF0OERGRKEQLN4WFhdDr9VCpVHWOq1QqqNXqBq+5cOECvv32W+j1emzatAmvvvoq3n//ffznP/9p9H2Sk5OhVCpNj7CwMIv+HvakttWmU4AH5E6iD6ciIiISRav6BDQYDAgMDMSnn36KmJgYTJw4ES+//DKWLl3a6DVz5sxBSUmJ6ZGdnW3Dim2rdjAx17chIqK2TLQxN/7+/pDJZMjLy6tzPC8vD0FBQQ1eExwcDGdnZ8hkNzeD7N69O9RqNXQ6HeRyeb1rFAoFFIq2sd4Lx9sQERGJ2HIjl8sRExODlJQU0zGDwYCUlBTEx8c3eM2gQYNw7tw5GAwG07EzZ84gODi4wWDT1pxSM9wQERGJ2i2VlJSEZcuW4X//+x9OnTqFadOmoby83DR7avLkyZgzZ47p/GnTpqGoqAizZs3CmTNn8PPPP+Ott97CjBkzxPoV7EaZthqXr1UA4IaZRETUtok6FXzixIkoKCjA3LlzoVarER0djc2bN5sGGWdlZUEqvZm/wsLCsGXLFrzwwgvo3bs3QkNDMWvWLLz00kti/Qp2I7Om1SbQUwE/j7bRDUdERNQQiSAIgthF2JJGo4FSqURJSQm8vByn++abg9l48dujGNzZHyufihO7HCIiIotqzud3q5otRY3LLb4BAGjn4ypyJUREROJiuHEQteEmxJvhhoiI2jaGGweRW1wJgOGGiIiI4cZB3Gy5cRG5EiIiInEx3DgAQRCQUxNuQtlyQ0REbRzDjQMoKtdBW21c2DBIyZYbIiJq2xhuHEDteJsATwUUTrLbnE1EROTYGG4cQA5nShEREZkw3DiAXNN4G3ZJERERMdw4ANNMKSVbboiIiBhuHEBuCbuliIiIajHcOIAcLuBHRERkwnDjAHK5xg0REZEJw00rp63Wo6BUC4CrExMREQEMN61eXokx2CicpPB1l4tcDRERkfgYblq5P267IJFIRK6GiIhIfAw3rVwuF/AjIiKqg+GmleNu4ERERHUx3LRyXOOGiIioLoabVo5r3BAREdXFcNPKcY0bIiKiuhhuWjFBEDigmIiI6E8YblqxkhtVqNDpAQDBSg4oJiIiAhhuWrXaNW78PeRwcZaJXA0REZF9YLhpxXI5mJiIiKgehptWzDTeRslwQ0REVIvhphXjYGIiIqL6GG5asRyuTkxERFQPw00rxjVuiIiI6mO4acU4oJiIiKg+hptWqkpvQF4pww0REdGfMdy0UuqSSggCIHeSws9dLnY5REREdoPhppW6OQ3cBVKpRORqiIiI7AfDTSuVW8Jp4ERERA1huGmlOJiYiIioYQw3rVQOF/AjIiJqkF2Em8WLFyM8PBwuLi6Ii4tDWlpao+d+8cUXkEgkdR4uLm1vEbuba9y0vd+diIjoVkQPN2vXrkVSUhLmzZuHjIwMREVFYdSoUcjPz2/0Gi8vL1y9etX0uHz5sg0rtg/ceoGIiKhhooebBQsWYOrUqUhMTERkZCSWLl0KNzc3rFixotFrJBIJgoKCTA+VStXouVqtFhqNps6jtRMEAVeuM9wQERE1xKxws337dou8uU6nQ3p6OhISEm4WJJUiISEBqampjV5XVlaGDh06ICwsDPfddx9OnDjR6LnJyclQKpWmR1hYmEVqF9P1iipU6PQAuPUCERHRn5kVbkaPHo1OnTrhP//5D7Kzs81+88LCQuj1+notLyqVCmq1usFrunbtihUrVmDjxo1YuXIlDAYDBg4ciCtXrjR4/pw5c1BSUmJ6tKRee5FdVAEAUHkp4OIsE7kaIiIi+2JWuMnJycHMmTPx7bffIiIiAqNGjcI333wDnU5n6frqiY+Px+TJkxEdHY1hw4Zh/fr1CAgIwCeffNLg+QqFAl5eXnUerV1tl1Q7HzeRKyEiIrI/ZoUbf39/vPDCCzh8+DD279+PO+64A9OnT0dISAiee+45HDlypMmvI5PJkJeXV+d4Xl4egoKCmvQazs7O6NOnD86dO9fs36O1yr5ubLkJ82GXFBER0Z+1eEBx3759MWfOHMycORNlZWVYsWIFYmJiMGTIkFuOhQEAuVyOmJgYpKSkmI4ZDAakpKQgPj6+Se+v1+tx7NgxBAcHt+j3aE2u1IQbttwQERHVZ3a4qaqqwrfffot77rkHHTp0wJYtW7Bo0SLk5eXh3Llz6NChAx588MHbvk5SUhKWLVuG//3vfzh16hSmTZuG8vJyJCYmAgAmT56MOXPmmM5//fXX8euvv+LChQvIyMjAY489hsuXL+Opp54y91dpdbKLjN1SYb5suSEiIvozJ3MuevbZZ7F69WoIgoDHH38c77zzDnr27Gl63t3dHe+99x5CQkJu+1oTJ05EQUEB5s6dC7VajejoaGzevNk0yDgrKwtS6c0Mdv36dUydOhVqtRo+Pj6IiYnB3r17ERkZac6v0ipdMXVLseWGiIjozySCIAjNvWjkyJF46qmn8MADD0ChUDR4TnV1Nfbs2YNhw4a1uEhL0mg0UCqVKCkpaZWDiwVBQLdXN0NbbcCuf96J9n4MOERE5Pia8/ltVsvNH8fINPrCTk52F2wcQUGZFtpqA6QSIJhbLxAREdVj1pib5OTkBlcQXrFiBd5+++0WF0WNqx1vE6x0hbNM9AWmiYiI7I5Zn46ffPIJunXrVu94jx49sHTp0hYXRY27OVOKg4mJiIgaYla4UavVDU69DggIwNWrV1tcFDWOC/gRERHdmlnhJiwsDHv27Kl3fM+ePU2aIUXmq916gdPAiYiIGmbWgOKpU6fi+eefR1VVFUaMGAHAOMj4xRdfxN///neLFkh1seWGiIjo1swKN//85z9x7do1TJ8+3bSflIuLC1566aU6C+6R5XHrBSIiolszK9xIJBK8/fbbePXVV3Hq1Cm4urqiS5cuja55Q5ahNwjILa5pufFlyw0REVFDzAo3tTw8PNCvXz9L1UK3kaepRJVegJNUgiAvrnFDRETUELPDzcGDB/HNN98gKyvL1DVVa/369S0ujOqrHW8T4u0KmVQicjVERET2yazZUmvWrMHAgQNx6tQpfP/996iqqsKJEyewbds2KJVKS9dINThTioiI6PbMCjdvvfUWPvjgA/z444+Qy+X48MMPcfr0aTz00ENo3769pWukGqaZUt4cb0NERNQYs8LN+fPnMXbsWACAXC5HeXk5JBIJXnjhBXz66acWLZBuMs2UYssNERFRo8wKNz4+PigtLQUAhIaG4vjx4wCA4uJiVFRUWK46quPm1gtsuSEiImqMWQOKhw4diq1bt6JXr1548MEHMWvWLGzbtg1bt27FyJEjLV0j1ajdNJMtN0RERI0zK9wsWrQIlZWVAICXX34Zzs7O2Lt3LyZMmIBXXnnFogWSUbXeALXGeM/ZckNERNS4Zoeb6upq/PTTTxg1ahQAQCqVYvbs2RYvjOq6WlIJvUGA3EmKAA8ulkhERNSYZo+5cXJywjPPPGNquSHbqB1M3M7bFVKucUNERNQoswYU9+/fH4cPH7ZwKXQrV4q47QIREVFTmDXmZvr06UhKSkJ2djZiYmLg7u5e5/nevXtbpDi6iRtmEhERNY1Z4ebhhx8GADz33HOmYxKJBIIgQCKRQK/XW6Y6MjEt4MfBxERERLdkVri5ePGipeug2+DWC0RERE1jVrjp0KGDpeug22DLDRERUdOYFW6+/PLLWz4/efJks4qhhmmr9cgrNc5O45gbIiKiWzMr3MyaNavOz1VVVaioqIBcLoebmxvDjYXlFldCEABXZxl83eVil0NERGTXzJoKfv369TqPsrIyZGZmYvDgwVi9erWla2zz/jjeRiLhGjdERES3Yla4aUiXLl0wf/78eq061HIcb0NERNR0Fgs3gHH14tzcXEu+JAGmPaWClS4iV0JERGT/zBpz88MPP9T5WRAEXL16FYsWLcKgQYMsUhjdVFCqBQAEejLcEBER3Y5Z4Wb8+PF1fpZIJAgICMCIESPw/vvvW6Iu+oOCmplSAZ7cMJOIiOh2zAo3BoPB0nXQLdS23DDcEBER3Z5Fx9yQdeSbuqUYboiIiG7HrHAzYcIEvP322/WOv/POO3jwwQdbXBTdZDAIKCxjyw0REVFTmRVudu3ahXvuuafe8TFjxmDXrl0tLopuKrlRhSq9AADw92C4ISIiuh2zwk1ZWRnk8vor5To7O0Oj0bS4KLqptkvKx80Zcif2IhIREd2OWZ+WvXr1wtq1a+sdX7NmDSIjI5v9eosXL0Z4eDhcXFwQFxeHtLS0Jl23Zs0aSCSSerO3HAkHExMRETWPWbOlXn31VTzwwAM4f/48RowYAQBISUnB6tWrsW7duma91tq1a5GUlISlS5ciLi4OCxcuxKhRo5CZmYnAwMBGr7t06RL+8Y9/YMiQIeb8Cq1GQRmngRMRETWHWS0348aNw4YNG3Du3DlMnz4df//733HlyhX89ttvzW5FWbBgAaZOnYrExERERkZi6dKlcHNzw4oVKxq9Rq/XY9KkSfj3v/+NiIiIW76+VquFRqOp82hN8jVcwI+IiKg5zB7EMXbsWOzZswfl5eUoLCzEtm3bMGzYsGa9hk6nQ3p6OhISEm4WJJUiISEBqampjV73+uuvIzAwEE8++eRt3yM5ORlKpdL0CAsLa1aNYmO3FBERUfOYFW4OHDiA/fv31zu+f/9+HDx4sMmvU1hYCL1eD5VKVee4SqWCWq1u8Jrdu3dj+fLlWLZsWZPeY86cOSgpKTE9srOzm1yfPSionQbOmVJERERNYla4mTFjRoMhIScnBzNmzGhxUY0pLS3F448/jmXLlsHf379J1ygUCnh5edV5tCambikvhhsiIqKmMGtA8cmTJ9G3b996x/v06YOTJ082+XX8/f0hk8mQl5dX53heXh6CgoLqnX/+/HlcunQJ48aNMx2r3QrCyckJmZmZ6NSpU5PfvzVgyw0REVHzmNVyo1Ao6gUSALh69SqcnJqel+RyOWJiYpCSkmI6ZjAYkJKSgvj4+Hrnd+vWDceOHcPhw4dNj3vvvRd33nknDh8+3OrG0zRFvoazpYiIiJrDrJabu+++G3PmzMHGjRuhVCoBAMXFxfjXv/6Fu+66q1mvlZSUhClTpiA2Nhb9+/fHwoULUV5ejsTERADA5MmTERoaiuTkZLi4uKBnz551rvf29gaAescdQWWVHprKagCcLUVERNRUZoWb9957D0OHDkWHDh3Qp08fAMDhw4ehUqnw1VdfNeu1Jk6ciIKCAsydOxdqtRrR0dHYvHmzaZBxVlYWpNK2uTJv7Z5ScpkUXq5m/VERERG1ORJBEARzLiwvL8eqVatw5MgRuLq6onfv3njkkUfg7Oxs6RotSqPRQKlUoqSkxO4HF2dkXccD/92LUG9X7Jk9QuxyiIiIRNOcz2+zmwPc3d0xePBgtG/fHjqdDgDwyy+/AADuvfdec1+W/oBr3BARETWfWeHmwoULuP/++3Hs2DFIJBIIggCJRGJ6Xq/XW6zAtozhhoiIqPnMGswya9YsdOzYEfn5+XBzc8Px48exc+dOxMbGYseOHRYuse3KZ7ghIiJqNrNablJTU7Ft2zb4+/tDKpVCJpNh8ODBSE5OxnPPPYdDhw5Zus42qbblJpDhhoiIqMnMarnR6/Xw9PQEYFyILzc3FwDQoUMHZGZmWq66No7dUkRERM1nVstNz549ceTIEXTs2BFxcXF45513IJfL8emnn952l25quoLSmgX8uDoxERFRk5kVbl555RWUl5cDMO7Q/Ze//AVDhgyBn58f1q5da9EC2zJTt5QXF/AjIiJqKrPCzahRo0z/3blzZ5w+fRpFRUXw8fGpM2uKzCcIws19pdgtRURE1GQWW/bW19fXUi9FAIorqlClN66v6O8hF7kaIiKi1qNt7mvQCtS22ni7OUPhJBO5GiIiotaD4cZO5WtquqQ4mJiIiKhZGG7sVEGZcaZUoBfDDRERUXMw3Ngp0xo3bLkhIiJqFoYbO2XqluJMKSIiomZhuLFTtQOKAz25xg0REVFzMNzYKW69QEREZB6GGzvFHcGJiIjMw3Bjp7gjOBERkXkYbuyQtlqPkhtVANhyQ0RE1FwMN3aottVGLpNC6eoscjVEREStC8ONHfrjYGJuREpERNQ8DDd2qDbc+LNLioiIqNkYbuxQPlcnJiIiMhvDjR0yzZTivlJERETNxnBjh9hyQ0REZD6GGzvE1YmJiIjMx3Bjh27uK8VwQ0RE1FwMN3aoQFMJgC03RERE5mC4sTOCIJhabhhuiIiImo/hxs4UletQpRcAAIGeLiJXQ0RE1Pow3NgZdU2XlL+HHHIn/vEQERE1Fz897Yy6xBhugpRstSEiIjIHw42dqW25CfJiuCEiIjIHw42dYcsNERFRyzDc2BlTuGHLDRERkVnsItwsXrwY4eHhcHFxQVxcHNLS0ho9d/369YiNjYW3tzfc3d0RHR2Nr776yobVWpepW0rpKnIlRERErZPo4Wbt2rVISkrCvHnzkJGRgaioKIwaNQr5+fkNnu/r64uXX34ZqampOHr0KBITE5GYmIgtW7bYuHLruMqWGyIiohaRCIIgiFlAXFwc+vXrh0WLFgEADAYDwsLC8Oyzz2L27NlNeo2+ffti7NixeOONN+o9p9VqodVqTT9rNBqEhYWhpKQEXl5elvklLKjXvC0o1Vbjt6Rh6BzoIXY5REREdkGj0UCpVDbp81vUlhudTof09HQkJCSYjkmlUiQkJCA1NfW21wuCgJSUFGRmZmLo0KENnpOcnAylUml6hIWFWax+SyvTVqNUWw2AA4qJiIjMJWq4KSwshF6vh0qlqnNcpVJBrVY3el1JSQk8PDwgl8sxduxYfPzxx7jrrrsaPHfOnDkoKSkxPbKzsy36O1hS7WBiT4UTPBROIldDRETUOrXKT1BPT08cPnwYZWVlSElJQVJSEiIiIjB8+PB65yoUCigUrWOPJk4DJyIiajlRw42/vz9kMhny8vLqHM/Ly0NQUFCj10mlUnTu3BkAEB0djVOnTiE5ObnBcNOa3JwpxXBDRERkLlG7peRyOWJiYpCSkmI6ZjAYkJKSgvj4+Ca/jsFgqDNouLVSl9wAwJlSRERELSF6t1RSUhKmTJmC2NhY9O/fHwsXLkR5eTkSExMBAJMnT0ZoaCiSk5MBGAcIx8bGolOnTtBqtdi0aRO++uorLFmyRMxfwyLYckNERNRyooebiRMnoqCgAHPnzoVarUZ0dDQ2b95sGmSclZUFqfRmA1N5eTmmT5+OK1euwNXVFd26dcPKlSsxceJEsX4Fi+GYGyIiopYTfZ0bW2vOPHlb+8vHv+N4jgbLp8RiZHfV7S8gIiJqI1rNOjdUF1tuiIiIWo7hxk7oqg0oLNMB4IBiIiKilmC4sRN5NYOJ5TIpfN3lIldDRETUejHc2InacKNSKiCRSESuhoiIqPViuLETtbuBB3u5ilwJERFR68ZwYyduttxwvA0REVFLMNzYCVPLDcMNERFRizDc2AnTNHDOlCIiImoRhhs7wa0XiIiILIPhxk5wAT8iIiLLYLixAwaDYBpQzG4pIiKilmG4sQOF5VpUGwRIJUCAp0LscoiIiFo1hhs7kFeiBQD4eyjgLOMfCRERUUvwk9QOXC25AYDTwImIiCyB4cYOmBbw43gbIiKiFmO4sQNcwI+IiMhyGG7sgJpbLxAREVkMw40dULPlhoiIyGIYbuyAaXVi7ghORETUYgw3IhMEgasTExERWRDDjchKtdWo0OkBcHViIiIiS2C4EVltq43S1RmucpnI1RAREbV+DDci4zRwIiIiy2K4EVleCRfwIyIisiSGG5Gx5YaIiMiyGG5EduV6BQAgWMlp4ERERJbAcCOyi4XlAICIAHeRKyEiInIMDDciqw03Hf0ZboiIiCyB4UZEJRVVuFauA8BwQ0REZCkMNyK6eM3YaqPyUsBd4SRyNURERI6B4UZEFwvLALDVhoiIyJIYbkR0saB2vI2HyJUQERE5DoYbEV2onSnFlhsiIiKLYbgR0YUCzpQiIiKyNIYbkQiCcHMaONe4ISIishi7CDeLFy9GeHg4XFxcEBcXh7S0tEbPXbZsGYYMGQIfHx/4+PggISHhlufbqzyNFjeq9JBJJWjv6yZ2OURERA5D9HCzdu1aJCUlYd68ecjIyEBUVBRGjRqF/Pz8Bs/fsWMHHnnkEWzfvh2pqakICwvD3XffjZycHBtX3jIXamZKtfd1g7NM9D8GIiIihyH6p+qCBQswdepUJCYmIjIyEkuXLoWbmxtWrFjR4PmrVq3C9OnTER0djW7duuGzzz6DwWBASkqKjStvGa5MTEREZB2ihhudTof09HQkJCSYjkmlUiQkJCA1NbVJr1FRUYGqqir4+vo2+LxWq4VGo6nzsAcXOZiYiIjIKkQNN4WFhdDr9VCpVHWOq1QqqNXqJr3GSy+9hJCQkDoB6Y+Sk5OhVCpNj7CwsBbXbQlsuSEiIrIO0bulWmL+/PlYs2YNvv/+e7i4uDR4zpw5c1BSUmJ6ZGdn27jKhl3kGjdERERWIeqGRv7+/pDJZMjLy6tzPC8vD0FBQbe89r333sP8+fPx22+/oXfv3o2ep1AooFAoLFKvpVTpDcgqqgDAaeBERESWJmrLjVwuR0xMTJ3BwLWDg+Pj4xu97p133sEbb7yBzZs3IzY21halWlR2UQWqDQJcnWVQeTbc4kRERETmEX0r6qSkJEyZMgWxsbHo378/Fi5ciPLyciQmJgIAJk+ejNDQUCQnJwMA3n77bcydOxdff/01wsPDTWNzPDw84OHROvZoqu2SCvd3h1QqEbkaIiIixyJ6uJk4cSIKCgowd+5cqNVqREdHY/PmzaZBxllZWZBKbzYwLVmyBDqdDn/961/rvM68efPw2muv2bJ0s3G8DRERkfWIHm4AYObMmZg5c2aDz+3YsaPOz5cuXbJ+QVZm2jCT422IiIgsrlXPlmqtuMYNERGR9TDciIBr3BAREVkPw42NlWurodZUAmC4ISIisgaGGxu7dM3YauPrLoe3m1zkaoiIiBwPw42NXeB4GyIiIqtiuLExjrchIiKyLoYbG2O4ISIisi6GGxu7wAX8iIiIrIrhxoYEQcDFgjIAQERA69gqgoiIqLVhuLGha+U6aCqrIZEAHfzcxC6HiIjIITHc2NDJXA0AINzPHS7OMpGrISIickwMNzZ0PLcEANAjxEvkSoiIiBwXw40Nncgxttz0ClWKXAkREZHjYrixodqWm54MN0RERFbDcGMjJTeqcPlaBQB2SxEREVkTw42N1A4mbufjyj2liIiIrIjhxkaO59R0SYWwS4qIiMiaGG5s5OZ4G3ZJERERWRPDjY3Uttz04GBiIiIiq2K4sYFybbVpTyl2SxEREVkXw40NnLqqgSAAKi8FAjwVYpdDRETk0BhubICDiYmIiGyH4cYGjtdMA+d4GyIiIutjuLGBmy03nClFRERkbQw3VlZZpcfZ/DIA3HaBiIjIFhhurCxTXQq9QYCvuxzBShexyyEiInJ4DDdWVrt4X48QL0gkEpGrISIicnwMN1Z2PMc4mJhdUkRERLbBcGNlJ2pabnox3BAREdkEw40VVekNOH21FADXuCEiIrIVhhsrOpNXCp3eAE8XJ4T5uopdDhERUZvAcGNFJ2rH24QoOZiYiIjIRhhurKh2plTPUC7eR0REZCsMN1Z04NJ1AEDvdt7iFkJERNSGMNxYyfVyHU5dNXZLDYjwE7kaIiKitkP0cLN48WKEh4fDxcUFcXFxSEtLa/TcEydOYMKECQgPD4dEIsHChQttV2gz7btwDQDQJdADAZ4KkashIiJqO0QNN2vXrkVSUhLmzZuHjIwMREVFYdSoUcjPz2/w/IqKCkRERGD+/PkICgqycbXNk1oTbgZ2YqsNERGRLYkabhYsWICpU6ciMTERkZGRWLp0Kdzc3LBixYoGz+/Xrx/effddPPzww1Ao7Ls1JPW8MdzEM9wQERHZlGjhRqfTIT09HQkJCTeLkUqRkJCA1NRUi72PVquFRqOp87C2/NJKnM0vg0QCxHVkuCEiIrIl0cJNYWEh9Ho9VCpVneMqlQpqtdpi75OcnAylUml6hIWFWey1G7PvQhEAoHuQF3zc5VZ/PyIiIrpJ9AHF1jZnzhyUlJSYHtnZ2VZ/T3ZJERERicdJrDf29/eHTCZDXl5eneN5eXkWHSysUChsPj4n9XwhACCeU8CJiIhsTrSWG7lcjpiYGKSkpJiOGQwGpKSkID4+XqyyWuxqyQ1culYBqQToH+ErdjlERERtjmgtNwCQlJSEKVOmIDY2Fv3798fChQtRXl6OxMREAMDkyZMRGhqK5ORkAMZByCdPnjT9d05ODg4fPgwPDw907txZtN/jj2q7pHqFKuHl4ixyNURERG2PqOFm4sSJKCgowNy5c6FWqxEdHY3NmzebBhlnZWVBKr3ZuJSbm4s+ffqYfn7vvffw3nvvYdiwYdixY4ety29QbbgZwPE2REREopAIgiCIXYQtaTQaKJVKlJSUwMvL8htaDpq/DTnFN/BFYj8M7xpo8dcnIiJqi5rz+e3ws6VsKbuoAjnFN+AklaBfOMfbEBERiYHhxoJqu6SiwrzhrhC1x4+IiKjNYrixoL2cAk5ERCQ6hhsLEQSBm2USERHZAYYbC7lYWI48jRZymRR9O/iIXQ4REVGbxYEhFpJTfAN+7nJ0DvSAi7NM7HKIiIjaLIYbCxnSJQAHX0lAyY0qsUshIiJq09gtZUESiQTebtwFnIiISEwMN0RERORQGG6IiIjIoTDcEBERkUNhuCEiIiKHwnBDREREDoXhhoiIiBwKww0RERE5FIYbIiIicigMN0RERORQGG6IiIjIoTDcEBERkUNhuCEiIiKHwnBDREREDsVJ7AJsTRAEAIBGoxG5EiIiImqq2s/t2s/xW2lz4aa0tBQAEBYWJnIlRERE1FylpaVQKpW3PEciNCUCORCDwYDc3Fx4enpCIpFY9LU1Gg3CwsKQnZ0NLy8vi7421cV7bTu817bDe207vNe2Y6l7LQgCSktLERISAqn01qNq2lzLjVQqRbt27az6Hl5eXvyfxUZ4r22H99p2eK9th/fadixxr2/XYlOLA4qJiIjIoTDcEBERkUNhuLEghUKBefPmQaFQiF2Kw+O9th3ea9vhvbYd3mvbEeNet7kBxUREROTY2HJDREREDoXhhoiIiBwKww0RERE5FIYbIiIicigMNxayePFihIeHw8XFBXFxcUhLSxO7pFYvOTkZ/fr1g6enJwIDAzF+/HhkZmbWOaeyshIzZsyAn58fPDw8MGHCBOTl5YlUseOYP38+JBIJnn/+edMx3mvLycnJwWOPPQY/Pz+4urqiV69eOHjwoOl5QRAwd+5cBAcHw9XVFQkJCTh79qyIFbdOer0er776Kjp27AhXV1d06tQJb7zxRp29iXivzbdr1y6MGzcOISEhkEgk2LBhQ53nm3Jvi4qKMGnSJHh5ecHb2xtPPvkkysrKWl6cQC22Zs0aQS6XCytWrBBOnDghTJ06VfD29hby8vLELq1VGzVqlPD5558Lx48fFw4fPizcc889Qvv27YWysjLTOc8884wQFhYmpKSkCAcPHhQGDBggDBw4UMSqW7+0tDQhPDxc6N27tzBr1izTcd5ryygqKhI6dOggPPHEE8L+/fuFCxcuCFu2bBHOnTtnOmf+/PmCUqkUNmzYIBw5ckS49957hY4dOwo3btwQsfLW58033xT8/PyEn376Sbh48aKwbt06wcPDQ/jwww9N5/Bem2/Tpk3Cyy+/LKxfv14AIHz//fd1nm/KvR09erQQFRUl7Nu3T/j999+Fzp07C4888kiLa2O4sYD+/fsLM2bMMP2s1+uFkJAQITk5WcSqHE9+fr4AQNi5c6cgCIJQXFwsODs7C+vWrTOdc+rUKQGAkJqaKlaZrVppaanQpUsXYevWrcKwYcNM4Yb32nJeeuklYfDgwY0+bzAYhKCgIOHdd981HSsuLhYUCoWwevVqW5ToMMaOHSv83//9X51jDzzwgDBp0iRBEHivLenP4aYp9/bkyZMCAOHAgQOmc3755RdBIpEIOTk5LaqH3VItpNPpkJ6ejoSEBNMxqVSKhIQEpKamiliZ4ykpKQEA+Pr6AgDS09NRVVVV595369YN7du3570304wZMzB27Ng69xTgvbakH374AbGxsXjwwQcRGBiIPn36YNmyZabnL168CLVaXedeK5VKxMXF8V4308CBA5GSkoIzZ84AAI4cOYLdu3djzJgxAHivrakp9zY1NRXe3t6IjY01nZOQkACpVIr9+/e36P3b3MaZllZYWAi9Xg+VSlXnuEqlwunTp0WqyvEYDAY8//zzGDRoEHr27AkAUKvVkMvl8Pb2rnOuSqWCWq0WocrWbc2aNcjIyMCBAwfqPcd7bTkXLlzAkiVLkJSUhH/96184cOAAnnvuOcjlckyZMsV0Pxv6N4X3unlmz54NjUaDbt26QSaTQa/X480338SkSZMAgPfaippyb9VqNQIDA+s87+TkBF9f3xbff4YbahVmzJiB48ePY/fu3WKX4pCys7Mxa9YsbN26FS4uLmKX49AMBgNiY2Px1ltvAQD69OmD48ePY+nSpZgyZYrI1TmWb775BqtWrcLXX3+NHj164PDhw3j++ecREhLCe+3g2C3VQv7+/pDJZPVmjeTl5SEoKEikqhzLzJkz8dNPP2H79u1o166d6XhQUBB0Oh2Ki4vrnM9733zp6enIz89H37594eTkBCcnJ+zcuRMfffQRnJycoFKpeK8tJDg4GJGRkXWOde/eHVlZWQBgup/8N6Xl/vnPf2L27Nl4+OGH0atXLzz++ON44YUXkJycDID32pqacm+DgoKQn59f5/nq6moUFRW1+P4z3LSQXC5HTEwMUlJSTMcMBgNSUlIQHx8vYmWtnyAImDlzJr7//nts27YNHTt2rPN8TEwMnJ2d69z7zMxMZGVl8d4308iRI3Hs2DEcPnzY9IiNjcWkSZNM/817bRmDBg2qt6TBmTNn0KFDBwBAx44dERQUVOdeazQa7N+/n/e6mSoqKiCV1v2Yk8lkMBgMAHivrakp9zY+Ph7FxcVIT083nbNt2zYYDAbExcW1rIAWDUcmQRCMU8EVCoXwxRdfCCdPnhSefvppwdvbW1Cr1WKX1qpNmzZNUCqVwo4dO4SrV6+aHhUVFaZznnnmGaF9+/bCtm3bhIMHDwrx8fFCfHy8iFU7jj/OlhIE3mtLSUtLE5ycnIQ333xTOHv2rLBq1SrBzc1NWLlypemc+fPnC97e3sLGjRuFo0ePCvfddx+nJ5thypQpQmhoqGkq+Pr16wV/f3/hxRdfNJ3De22+0tJS4dChQ8KhQ4cEAMKCBQuEQ4cOCZcvXxYEoWn3dvTo0UKfPn2E/fv3C7t37xa6dOnCqeD25OOPPxbat28vyOVyoX///sK+ffvELqnVA9Dg4/PPPzedc+PGDWH69OmCj4+P4ObmJtx///3C1atXxSvagfw53PBeW86PP/4o9OzZU1AoFEK3bt2ETz/9tM7zBoNBePXVVwWVSiUoFAph5MiRQmZmpkjVtl4ajUaYNWuW0L59e8HFxUWIiIgQXn75ZUGr1ZrO4b023/bt2xv8N3rKlCmCIDTt3l67dk145JFHBA8PD8HLy0tITEwUSktLW1ybRBD+sFQjERERUSvHMTdERETkUBhuiIiIyKEw3BAREZFDYbghIiIih8JwQ0RERA6F4YaIiIgcCsMNERERORSGGyIiInIoDDdE1CZJJBJs2LBB7DKIyAoYbojI5p544glIJJJ6j9GjR4tdGhE5ACexCyCitmn06NH4/PPP6xxTKBQiVUNEjoQtN0QkCoVCgaCgoDoPHx8fAMYuoyVLlmDMmDFwdXVFREQEvv322zrXHzt2DCNGjICrqyv8/Pzw9NNPo6ysrM45K1asQI8ePaBQKBAcHIyZM2fWeb6wsBD3338/3Nzc0KVLF/zwww+m565fv45JkyYhICAArq6u6NKlS70wRkT2ieGGiOzSq6++igkTJuDIkSOYNGkSHn74YZw6dQoAUF5ejlGjRsHHxwcHDhzAunXr8Ntvv9UJL0uWLMGMGTPw9NNP49ixY/jhhx/QuXPnOu/x73//Gw899BCOHj2Ke+65B5MmTUJRUZHp/U+ePIlffvkFp06dwpIlS+Dv72+7G0BE5mvxvuJERM00ZcoUQSaTCe7u7nUeb775piAIggBAeOaZZ+pcExcXJ0ybNk0QBEH49NNPBR8fH6GsrMz0/M8//yxIpVJBrVYLgiAIISEhwssvv9xoDQCEV155xfRzWVmZAED45ZdfBEEQhHHjxgmJiYmW+YWJyKY45oaIRHHnnXdiyZIldY75+vqa/js+Pr7Oc/Hx8Th8+DAA4NSpU4iKioK7u7vp+UGDBsFgMCAzMxMSiQS5ubkYOXLkLWvo3bu36b/d3d3h5eWF/Px8AMC0adMwYcIEZGRk4O6778b48eMxcOBAs35XIrIthhsiEoW7u3u9biJLcXV1bdJ5zs7OdX6WSCQwGAwAgDFjxuDy5cvYtGkTtm7dipEjR2LGjBl47733LF4vEVkWx9wQkV3at29fvZ+7d+8OAOjevTuOHDmC8vJy0/N79uyBVCpF165d4enpifDwcKSkpLSohoCAAEyZMgUrV67EwoUL8emnn7bo9YjINthyQ0Si0Gq1UKvVdY45OTmZBu2uW7cOsbGxGDx4MFatWoW0tDQsX74cADBp0iTMmzcPU6ZMwWuvvYaCggI8++yzePzxx6FSqQAAr732Gp555hkEBgZizJgxKC0txZ49e/Dss882qb65c+ciJiYGPXr0gFarxU8//WQKV0Rk3xhuiEgUmzdvRnBwcJ1jXbt2xenTpwEYZzKtWbMG06dPR3BwMFavXo3IyEgAgJubG7Zs2YJZs2ahX79+cHNzw4QJE7BgwQLTa02ZMgWVlZX44IMP8I9//AP+/v7461//2uT65HI55syZg0uXLsHV1RVDhgzBmjVrLPCbE5G1SQRBEMQugojojyQSCb7//nuMHz9e7FKIqBXimBsiIiJyKAw3RERE5FA45oaI7A57y4moJdhyQ0RERA6F4YaIiIgcCsMNERERORSGGyIiInIoDDdERETkUBhuiIiIyKEw3BAREZFDYbghIiIih/L/MdWGQdgTIPkAAAAASUVORK5CYII=",
      "text/plain": [
       "<Figure size 640x480 with 1 Axes>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    }
   ],
   "source": [
    "import matplotlib.pyplot as plt\n",
    "\n",
    "# Plot utility\n",
    "def plot_graphs(history, string):\n",
    "  plt.plot(history.history[string])\n",
    "  plt.xlabel(\"Epochs\")\n",
    "  plt.ylabel(string)\n",
    "  plt.show()\n",
    "\n",
    "# Visualize the accuracy\n",
    "plot_graphs(history, 'accuracy')"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "id": "9gxKIcvGTUnw"
   },
   "source": [
    "## Generating Text\n",
    "\n",
    "Now you can let the model make its own songs or poetry! Because it is trained on a much larger corpus, the results below should contain less repetitions as before. The code below picks the next word based on the highest probability output."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 18,
   "metadata": {
    "id": "6Vc6PHgxa6Hm"
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      " Mountains with so little from her own heart whatever befall a truth eye now is for gone and as had loves hair to see again without she mary my green banks i had the white moon gone with the morning he had gone gone and now more gone and gone and i had clothes my brings on around the sinking funds fine long ago long love now my bride loves days gone gone and sea is and will well i had no gone where love not such beauty alone that won me call that father had i like to keep me\n"
     ]
    }
   ],
   "source": [
    "# Define seed text\n",
    "seed_text =\" Mountains\"  \n",
    "# Define total words to predict\n",
    "next_words = 100\n",
    "\n",
    "# Loop until desired length is reached\n",
    "for _ in range(next_words):\n",
    "\n",
    "\t# Convert the seed text to a token sequence\n",
    "\ttoken_list = tokenizer.texts_to_sequences([seed_text])[0]\n",
    "\n",
    "\t# Pad the sequence\n",
    "\ttoken_list = pad_sequences([token_list], maxlen=max_sequence_len-1, padding='pre')\n",
    "\t\n",
    "\t# Feed to the model and get the probabilities for each index\n",
    "\tprobabilities = model.predict(token_list, verbose=0)\n",
    "\n",
    "\t# Get the index with the highest probability\n",
    "\tpredicted = np.argmax(probabilities, axis=-1)[0]\n",
    "\n",
    "\t# Ignore if index is 0 because that is just the padding.\n",
    "\tif predicted != 0:\n",
    "\t\t\n",
    "\t\t# Look up the word associated with the index. \n",
    "\t\toutput_word = tokenizer.index_word[predicted]\n",
    "\n",
    "\t\t# Combine with the seed text\n",
    "\t\tseed_text += \" \" + output_word\n",
    "\n",
    "# Print the result\t\n",
    "print(seed_text)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "id": "wHtrtAFAT6tn"
   },
   "source": [
    "Here again is the code that gets the top 3 predictions and picks one at random."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 17,
   "metadata": {
    "id": "yJfzKm-8mVKD"
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Mountains for sunshine or no one night it on my uncle was countin my now heartfrom i so gone gone alas your now awaken light to love gone people and gone away with and be gone gone away and ill ever you venture to reap and tried home dancing guril gave they eyes gone and they may ride on the dawning by the grass gone with your eyes glisten away and with your eyes bright clothes gone and foot host without him row in high gone away and ill pride place gone gone i bowed from parting glass gone fell and\n"
     ]
    }
   ],
   "source": [
    "# Define seed text\n",
    "seed_text = \"Mountains\"\n",
    "# Define total words to predict\n",
    "next_words = 100\n",
    "\n",
    "# Loop until desired length is reached\n",
    "for _ in range(next_words):\n",
    "\n",
    "\t# Convert the seed text to a token sequence\n",
    "  token_list = tokenizer.texts_to_sequences([seed_text])[0]\n",
    "\n",
    "\t# Pad the sequence\n",
    "  token_list = pad_sequences([token_list], maxlen=max_sequence_len-1, padding='pre')\n",
    "\t\n",
    "\t# Feed to the model and get the probabilities for each index\n",
    "  probabilities = model.predict(token_list, verbose=0)\n",
    "\n",
    "  # Pick a random number from [1,2,3]\n",
    "  choice = np.random.choice([1,2,3])\n",
    "\t\n",
    "  # Sort the probabilities in ascending order \n",
    "  # and get the random choice from the end of the array\n",
    "  predicted = np.argsort(probabilities)[0][-choice]\n",
    "\n",
    "\t# Ignore if index is 0 because that is just the padding.\n",
    "  if predicted != 0:\n",
    "\t\t\n",
    "\t\t# Look up the word associated with the index. \n",
    "\t  output_word = tokenizer.index_word[predicted]\n",
    "\n",
    "\t\t# Combine with the seed text\n",
    "\t  seed_text += \" \" + output_word\n",
    "counter = 0\n",
    "# Print the result\n",
    "print(seed_text)         \t\n"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "id": "DP0--sdMUJ_k"
   },
   "source": [
    "## Wrap Up\n",
    "\n",
    "This lab shows the effect of having a larger dataset to train your text generation model. As expected, this will take a longer time to prepare and train but the output will less likely become repetitive or gibberish. Try to tweak the hyperparameters and see if you get better results. You can also find some other text datasets and use it to train the model here.  "
   ]
  }
 ],
 "metadata": {
  "accelerator": "GPU",
  "colab": {
   "collapsed_sections": [],
   "name": "C3_W4_Lab_2_irish_lyrics.ipynb",
   "private_outputs": true,
   "provenance": []
  },
  "kernelspec": {
   "display_name": "Python 3 (ipykernel)",
   "language": "python",
   "name": "python3"
  },
  "language_info": {
   "codemirror_mode": {
    "name": "ipython",
    "version": 3
   },
   "file_extension": ".py",
   "mimetype": "text/x-python",
   "name": "python",
   "nbconvert_exporter": "python",
   "pygments_lexer": "ipython3",
   "version": "3.11.3"
  }
 },
 "nbformat": 4,
 "nbformat_minor": 1
}