Skip to content

Commit 2165670

Browse files
committed
Update exp-svd.md
1 parent 42a52dc commit 2165670

File tree

1 file changed

+1
-0
lines changed

1 file changed

+1
-0
lines changed

morea/nlp/exp-svd.md

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -15,6 +15,7 @@ morea_labels:
1515
\\( \newcommand{\upto}{,\ldots,} \\)
1616
\\( \newcommand{\prob}{\mathbb{P}} \\)
1717

18+
## Motivation
1819
The singular value decomposition is a neat way to understand what is happening with matrix operations, and one good direction to interpret LLMs under the hood. We begin with a motivating example: the movie ratings data. The below is a snippet of preferences (from 1-5 where 5 is best) of 26 movies rated by 61 students (anonymized):
1920

2021
<img src="./movieprefs.png" alt="Movie ratings" width="900px"/>

0 commit comments

Comments
 (0)