Hangman with DQN and Transformers
TL;DR. We train a small bidirectional Transformer + Double DQN to play Hangman, restricted to words ≤5 characters (training and inference) to keep the demo c...
GMV Forecasting via xDeepFM
In this post, I aim to share how I conducted a proof of concept (PoC) to solve a real-world problem using deep learning techniques, emphasizing a clean code ...
Decoding LoRA: A Comprehensive Summary on Low-Rank Adaptation
Recently, I came across an intriguing article on low-rank techniques employed in Large Language Models (LLM) specifically focusing on LoRA: Low-Rank Adaptati...
Comparing Sequence-to-Sequence Decoders: With and Without Attention
This post goes beyond a conventional code walkthrough inspired by this tutorial. My goal is to elevate the narrative by offering a comprehensive comparison b...
Note: Derivation of Normal Bayesian Test
The Normal Bayesian test is a statistical method used in hypothesis testing, particularly in the context of Bayesian statistics. It is applied to assess the ...