Need fast lookup for block lists

[jmeaster30]

I want the ability to download a file of bad domain names and be able to block domains if they are in that file

This would require some sort of fast lookup data structure.

• BloomFilter
  • Probabilistic (possibly in or definitely not)
  • Can't remove elements from set
  • Complicated
  • Space-Efficient
  • Sounds fun though
• HashSet
  • O(1) assuming hashing is constant time
  • Binary search list of integers?
  • Don't care about the time for adding (as long as updating doesn't affect other threads reading from it) so we can still do lookups in other threads

[jmeaster30]

We COULD make the database handle it

[jmeaster30]

Turns out the bloom filter is NOT complicated. I have an implementation but want to do more research into other options

[jmeaster30]

I think its best to trust sqlite cause it is pretty fast already!

Just need a good index on the record table