This article is mainly based on Umar Jamil's course ^{[1]} for learning and recording. Our goal is to align the behavior of LLMs with our…