๐ Tokenizer
See how text is split into tokens
Tokens:
Token count: 0 |
Character count: 0
๐ Activation Functions
Visualize ReLU, Sigmoid, Tanh, GELU
f(x) = max(0, x)
๐ฏ Attention Visualization
See how tokens attend to each other
Attention Matrix: Click a word to see what it attends to
โ Vector Arithmetic
Explore word analogies with embeddings
โ
+
Result: queen
๐ก๏ธ Temperature Sampling
See how temperature affects probability distribution
Next token probabilities:
๐ง Simple Neural Net
Play with weights and see the output change
Input
Weight (w)
w = 1.5
Output
3.0
output = ReLU(w ร input) = max(0, w ร input)