The hypothesized AI (around 11:20) to produce convincing ex post facto explanations of decisions was a plot feature of Douglas Adams's 1987 novel _Dirk Gently's Holistic Detective Agency_.
Yes, I agree that if you generate explanations without reference to the mechanism of the AI, only asking for a post-hoc justification of a decision, then that's bad. But he seems to have totally forgotten to address the idea of explanations that refer to coarse-grained properties of the mechanism of the AI. E.g. explaining an image classifier's decision by looking at the features at some intermediate layer with the highest Shapely values, and assigning human interpretations to those features by a combination of natural and artificial highly-activating examples.
I love this dissertation. I think DNNs are fundamentally unusable because humans can't understand the trained algorithm. We need a human readable description of an algorithm that is also trainable.
The hypothesized AI (around 11:20) to produce convincing ex post facto explanations of decisions was a plot feature of Douglas Adams's 1987 novel _Dirk Gently's Holistic Detective Agency_.
i really apreciate your help with dowloanding this software
BROOO thankyou so much, this really helped and the tutorial was really easy to use as well :)
Yes, I agree that if you generate explanations without reference to the mechanism of the AI, only asking for a post-hoc justification of a decision, then that's bad. But he seems to have totally forgotten to address the idea of explanations that refer to coarse-grained properties of the mechanism of the AI.
E.g. explaining an image classifier's decision by looking at the features at some intermediate layer with the highest Shapely values, and assigning human interpretations to those features by a combination of natural and artificial highly-activating examples.
yes..? no?
I love this dissertation. I think DNNs are fundamentally unusable because humans can't understand the trained algorithm. We need a human readable description of an algorithm that is also trainable.