handle clicks outside inventory and non modifying clicks (#661)

handle clicks outside inventory and non modifying clicks (#661) #2112