Crawler cleanup (#52)

* organize imports

* replace json structure / function with simple class

* replace print with logger

* add optional domain arg to indicator.. for now

* add new wrapper

* replace traceback prints with logging

* add wrapper to ensure we don't break things due to wacko webpages, address some code errors

* possibly dangerous cleaning of functions

* this function was always comparing the original domain to itself

* test

* it's the tiny things that destroy everything, fixed the return type

* a few more bugfixes

* fix imports after merge