Recent Posts

• January 25, 2026

  Transformer -- Decoder-Only Model Explained In Codes

  This is the very first post of many Transformer series posts. Keeping track of my own learning notes.Two types of model classesI will mainly use transformers library from HuggingFace. The transformers library has two types of model classes: AutoM...

• January 19, 2026

  Floating Point Computations Errors

  Floating-point computations are well-known for their susceptibility to round-off errors. In this post, I aim to document a couple of scenarios where these errors occur and explore potential workarounds where applicable.Scenario 1When the component...

• December 25, 2024

  Simple Way to Use Mathjax with Jekyll

  To add MathJax to a Jekyll Blog, the easiest option is to simply add the following script into your layout file such as _layouts/head.html<script type="text/javascript" id="MathJax-script" async src="https://cdn.jsdelivr.net/npm/mathjax@3/es5/...

• March 08, 2022

  Takeaways from the NeurlPS 2021 Conference

  My experience with NeurlPS 2021 Conference was phenomenal despite I have to join the Zoom meetings from a shitty quarantine hotel at Shanghai as if I began a prison sentence.Anyway, following is the main takeaways from some of sessions that I part...

• October 30, 2021

  What I did to improve the data pipeline efficiency by 100x in MS SQL

  I was going to build a training data pipeline fetching fresh labelled data from a MS SQL DB continuously. Soon after I noticed scalability would be a bottleneck here since this MS SQL DB is very OLTP focused and not indexed for massive analytical ...