-
Notifications
You must be signed in to change notification settings - Fork 0
Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
* add scaling as input to attentionbase * delete print * added fixed corruption vector * add corruption per batch * add prints for debugging * add more prints * hard code domain names to check bug * change frozenset to list * added more prints * add print * debug * remove prints after debugging * add prints for debugging * add shape print * change corruption vector * print * change dim * change to cuda * remove print * prints * check if loop works * checking * add other prints * remove unnessary part of the loop * add prints for debugging * more prints * change to 5 * remove prints * change corruption from 5 to 25 * changed corruption to 5 again * add prints for debugging * more prints * add more * add more prints * made another corruption function * add prints * change * change * remove prints in new corruption function * add prints for debug * change tensor size * add more noise * add prints * changed corruption * change corrruption * remove prints * change corruption * change to old corruption * made a new corruption functor on tensors * debug * add prints * more prints * change * nog meer * prints * more prints * prints * add more prints * changed function * debug * remove prints * check how the attention scores change * print attention dict * prints * change corruption to corrupt side as well * add print to check * change sides * other change * remove prints * remove prints * add attention scores to log * add calculate mean attention * print attention scores * mean attention * remove print attentions scores * omkeren * add variable corruption * made a new function for testing all corruption combi * found a bug in corruption scaling (default should be 0.0) * remove prints * add prints * change corruption * remove prints * removed batch corruption function * made a new function to train corruption on both sides * remove prints for training * bug * added second step attention in query attention * add corruption vector to device * removed * added step 2 * added even anoter step * deleted added steps * added multiple steps as a parameter for query attention * found bug in variable corruption * removed static attention and changed into step 0 * changed corruption functions to one and two sided corr * spelling mistake * again mistake * remove prints * Added some comments * line was too long * Fix mypy issues --------- Co-authored-by: bdvllrs <[email protected]>
- Loading branch information
1 parent
c7d5554
commit 774ff2f
Showing
3 changed files
with
217 additions
and
91 deletions.
There are no files selected for viewing
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Oops, something went wrong.