Pixel, row 1, column 1, Pixel, row 1, column 7, Pixel, row 1, column 8, Pixel, row 2, column 1, Pixel, row 2, column 3, Pixel, row 2, column 4, Pixel, row 2, column 8, Pixel, row 3, column 1, Pixel, row 3, column 2, Pixel, row 3, column 3 and 22 more
Blank: this pixel adds nothing.
Pixel, row 1, column 2, Pixel, row 6, column 6
Brightness 60%. Every unit in the first hidden layer receives it.
Pixel, row 1, column 3, Pixel, row 1, column 5, Pixel, row 3, column 6, Pixel, row 4, column 4, Pixel, row 6, column 7, Pixel, row 8, column 3, Pixel, row 8, column 5
Brightness 90%. Every unit in the first hidden layer receives it.
Pixel, row 1, column 4, Pixel, row 2, column 6, Pixel, row 4, column 5, Pixel, row 5, column 6, Pixel, row 8, column 4
Brightness 95%. Every unit in the first hidden layer receives it.
Pixel, row 1, column 6, Pixel, row 5, column 5, Pixel, row 8, column 2
Brightness 50%. Every unit in the first hidden layer receives it.
Pixel, row 2, column 2, Pixel, row 3, column 5, Pixel, row 5, column 7
Brightness 30%. Every unit in the first hidden layer receives it.
Pixel, row 2, column 5, Pixel, row 2, column 7, Pixel, row 7, column 5
Brightness 20%. Every unit in the first hidden layer receives it.
Pixel, row 3, column 7, Pixel, row 5, column 4, Pixel, row 7, column 3
Brightness 10%. Every unit in the first hidden layer receives it.
Pixel, row 4, column 3, Pixel, row 4, column 6, Pixel, row 7, column 2, Pixel, row 8, column 6
Brightness 40%. Every unit in the first hidden layer receives it.
Pixel, row 7, column 6
Brightness 80%. Every unit in the first hidden layer receives it.
Pixel, row 7, column 7
Brightness 70%. Every unit in the first hidden layer receives it.
Hidden layer 1, unit 1
Looks for a stroke across the top. Fires at 88% for this picture.
- Layer
- Hidden layer 1
- Receives
- 64 inputs
- Role
- Picks out strokes and edges
- Activation
- ReLU, scaled to 0–100%
Hidden layer 1, unit 2
Looks for a curve at the upper right. Fires at 92% for this picture.
- Layer
- Hidden layer 1
- Receives
- 64 inputs
- Role
- Picks out strokes and edges
- Activation
- ReLU, scaled to 0–100%
Hidden layer 1, unit 3
Looks for a vertical stroke on the left. Fires at 6% for this picture.
- Layer
- Hidden layer 1
- Receives
- 64 inputs
- Role
- Picks out strokes and edges
- Activation
- ReLU, scaled to 0–100%
Hidden layer 1, unit 4
Looks for a short bar across the middle. Fires at 81% for this picture.
- Layer
- Hidden layer 1
- Receives
- 64 inputs
- Role
- Picks out strokes and edges
- Activation
- ReLU, scaled to 0–100%
Hidden layer 1, unit 5
Looks for a closed loop at the top. Fires at 14% for this picture.
- Layer
- Hidden layer 1
- Receives
- 64 inputs
- Role
- Picks out strokes and edges
- Activation
- ReLU, scaled to 0–100%
Hidden layer 1, unit 6
Looks for a curve at the lower right. Fires at 95% for this picture.
- Layer
- Hidden layer 1
- Receives
- 64 inputs
- Role
- Picks out strokes and edges
- Activation
- ReLU, scaled to 0–100%
Hidden layer 1, unit 7
Looks for a stroke across the bottom. Fires at 84% for this picture.
- Layer
- Hidden layer 1
- Receives
- 64 inputs
- Role
- Picks out strokes and edges
- Activation
- ReLU, scaled to 0–100%
Hidden layer 1, unit 8
Looks for ink in the lower left corner. Fires at 38% for this picture.
- Layer
- Hidden layer 1
- Receives
- 64 inputs
- Role
- Picks out strokes and edges
- Activation
- ReLU, scaled to 0–100%
Hidden layer 1, unit 9
Looks for a diagonal from upper right. Fires at 22% for this picture.
- Layer
- Hidden layer 1
- Receives
- 64 inputs
- Role
- Picks out strokes and edges
- Activation
- ReLU, scaled to 0–100%
Hidden layer 1, unit 10
Looks for an empty centre. Fires at 9% for this picture.
- Layer
- Hidden layer 1
- Receives
- 64 inputs
- Role
- Picks out strokes and edges
- Activation
- ReLU, scaled to 0–100%
Hidden layer 1, unit 11
Looks for a gap on the left side. Fires at 76% for this picture.
- Layer
- Hidden layer 1
- Receives
- 64 inputs
- Role
- Picks out strokes and edges
- Activation
- ReLU, scaled to 0–100%
Hidden layer 1, unit 12
Looks for a stroke down the middle. Fires at 11% for this picture.
- Layer
- Hidden layer 1
- Receives
- 64 inputs
- Role
- Picks out strokes and edges
- Activation
- ReLU, scaled to 0–100%
Hidden layer 1, unit 13
Looks for two curves stacked on the right. Fires at 90% for this picture.
- Layer
- Hidden layer 1
- Receives
- 64 inputs
- Role
- Picks out strokes and edges
- Activation
- ReLU, scaled to 0–100%
Hidden layer 1, unit 14
Looks for a closed loop at the bottom. Fires at 17% for this picture.
- Layer
- Hidden layer 1
- Receives
- 64 inputs
- Role
- Picks out strokes and edges
- Activation
- ReLU, scaled to 0–100%
Hidden layer 1, unit 15
Looks for a sharp corner at the top left. Fires at 4% for this picture.
- Layer
- Hidden layer 1
- Receives
- 64 inputs
- Role
- Picks out strokes and edges
- Activation
- ReLU, scaled to 0–100%
Hidden layer 1, unit 16
Looks for a tail at the lower left. Fires at 63% for this picture.
- Layer
- Hidden layer 1
- Receives
- 64 inputs
- Role
- Picks out strokes and edges
- Activation
- ReLU, scaled to 0–100%
Hidden layer 2, unit 1
Looks for an upper bowl opening left. Fires at 91% for this picture.
- Layer
- Hidden layer 2
- Receives
- 16 inputs
- Role
- Combines strokes into parts of a digit
- Activation
- ReLU, scaled to 0–100%
Hidden layer 2, unit 2
Looks for a lower bowl opening left. Fires at 94% for this picture.
- Layer
- Hidden layer 2
- Receives
- 16 inputs
- Role
- Combines strokes into parts of a digit
- Activation
- ReLU, scaled to 0–100%
Hidden layer 2, unit 3
Looks for a left side left open. Fires at 87% for this picture.
- Layer
- Hidden layer 2
- Receives
- 16 inputs
- Role
- Combines strokes into parts of a digit
- Activation
- ReLU, scaled to 0–100%
Hidden layer 2, unit 4
Looks for two closed loops. Fires at 8% for this picture.
- Layer
- Hidden layer 2
- Receives
- 16 inputs
- Role
- Combines strokes into parts of a digit
- Activation
- ReLU, scaled to 0–100%
Hidden layer 2, unit 5
Looks for a single upright stroke. Fires at 3% for this picture.
- Layer
- Hidden layer 2
- Receives
- 16 inputs
- Role
- Combines strokes into parts of a digit
- Activation
- ReLU, scaled to 0–100%
Hidden layer 2, unit 6
Looks for a flat top bar with a drop. Fires at 19% for this picture.
- Layer
- Hidden layer 2
- Receives
- 16 inputs
- Role
- Combines strokes into parts of a digit
- Activation
- ReLU, scaled to 0–100%
Hidden layer 2, unit 7
Looks for a loop at the bottom only. Fires at 12% for this picture.
- Layer
- Hidden layer 2
- Receives
- 16 inputs
- Role
- Combines strokes into parts of a digit
- Activation
- ReLU, scaled to 0–100%
Hidden layer 2, unit 8
Looks for a hook at the top. Fires at 66% for this picture.
- Layer
- Hidden layer 2
- Receives
- 16 inputs
- Role
- Combines strokes into parts of a digit
- Activation
- ReLU, scaled to 0–100%
Hidden layer 2, unit 9
Looks for a crossing in the middle. Fires at 5% for this picture.
- Layer
- Hidden layer 2
- Receives
- 16 inputs
- Role
- Combines strokes into parts of a digit
- Activation
- ReLU, scaled to 0–100%
Hidden layer 2, unit 10
Looks for a curve that meets itself. Fires at 15% for this picture.
- Layer
- Hidden layer 2
- Receives
- 16 inputs
- Role
- Combines strokes into parts of a digit
- Activation
- ReLU, scaled to 0–100%
Digit 0
0% sure the picture is a 0.
- Layer
- Output
- Receives
- 10 inputs
- Turned into confidence by
- Softmax: all ten sum to 100%
Digit 1
0% sure the picture is a 1.
- Layer
- Output
- Receives
- 10 inputs
- Turned into confidence by
- Softmax: all ten sum to 100%
Digit 2
2% sure the picture is a 2.
- Layer
- Output
- Receives
- 10 inputs
- Turned into confidence by
- Softmax: all ten sum to 100%
Digit 3
The network's answer: 89% sure the picture is a 3.
- Layer
- Output
- Receives
- 10 inputs
- Turned into confidence by
- Softmax: all ten sum to 100%
Digit 4
0% sure the picture is a 4.
- Layer
- Output
- Receives
- 10 inputs
- Turned into confidence by
- Softmax: all ten sum to 100%
Digit 5
3% sure the picture is a 5.
- Layer
- Output
- Receives
- 10 inputs
- Turned into confidence by
- Softmax: all ten sum to 100%
Digit 6
0% sure the picture is a 6.
- Layer
- Output
- Receives
- 10 inputs
- Turned into confidence by
- Softmax: all ten sum to 100%
Digit 7
1% sure the picture is a 7.
- Layer
- Output
- Receives
- 10 inputs
- Turned into confidence by
- Softmax: all ten sum to 100%
Digit 8
5% sure the picture is a 8.
- Layer
- Output
- Receives
- 10 inputs
- Turned into confidence by
- Softmax: all ten sum to 100%
Digit 9
0% sure the picture is a 9.
- Layer
- Output
- Receives
- 10 inputs
- Turned into confidence by
- Softmax: all ten sum to 100%
