Different Designs For LLM KD Loss

A talk about KLD and its associated improvements in the context of LLM KD, and then extending to JSD, Wasserstein Distance.