Just random thoughts and topics from various subjects that I find interesting.

January 2024

Tutorial: Fast Attention using LSH and Sampling - The HyperAttention Algorithm

The HyperAttention Algorithm is a new algorithm for computing fast attention in deep learning models. This blog post is a tutorial on its details. The algorithm is due to Han, Jayaram, Karbasi et al. (2023)

September 2023

All The Linear Algebra You Need For Grad School

A journey through all the linear algebra one should know well before embarking on graduate studies in Math, Data Science or Computer Science.

August 2023

Seq2seq Translation Tutorial

In this blog, I discuss seq2seq Deep Learning Models in Pytorch.

July 2023

A journey into word embeddings.

In this blog, I explore Word2Vec and general word embedding strategies in NLP.