TheMisAdventures
Just random thoughts and topics from various subjects that I find interesting.
January 2024
Tutorial: Fast Attention using LSH and Sampling - The HyperAttention Algorithm
The HyperAttention Algorithm is a new algorithm for computing fast attention in deep learning models. This blog post is a tutorial on its details. The algorithm is due to Han, Jayaram, Karbasi et al. (2023)
September 2023
All The Linear Algebra You Need For Grad School
A journey through all the linear algebra one should know well before embarking on graduate studies in Math, Data Science or Computer Science.
August 2023
Seq2seq Translation Tutorial
In this blog, I discuss seq2seq Deep Learning Models in Pytorch.
July 2023
A journey into word embeddings.
In this blog, I explore Word2Vec and general word embedding strategies in NLP.