๐๏ธ ๐ด Soft Prompts
Prompt tuning(@lester2021power), an alternative to model fine tuning(@khashabi2021prompt), freezes the model weights, and updates the parameters of a prompt. The resultant prompt is a 'soft prompt'.
๐๏ธ ๐ด Interpretable Soft Prompts
Soft prompts are a sequence of vectors which