GoyalA. x 3

bookTransformers with competitive ensembles of independent mechanisms

An important development in deep learning from the earliest MLPs has been a move towards architectur...

2021-03-01 20:18:34

GoyalA.LambA.HeD.KeG.LiaoC.F.

bookThe variational bandwidth bottleneck: Stochastic evaluation on an information budget

In many applications, it is desirable to extract only the relevant information from complex input da...

2020-04-27 20:01:11

BengioY.GoyalA.BotvinickM.LevineS.

bookSparse attentive backtracking: Long-range credit assignment in recurrent networks

… Ideally, SAB will not select all microstates, instead attending only to the most salien...

2017-11-07 20:05:56

CharlinL.GoyalA.KeN.R.BilaniukO.BinasJ.