coref debugging? #12672
-
Hi -- For example, I have "Robert Whittle" and "Rosie Rivera" in one article, and the relevant clusters look like this:
The last three spans (Rivera, Rivera, she) shouldn't be in cluster 3, and would ideally be in cluster 13 (but that's less important). There is nothing fancy in the code itself:
How would I go about looking under the hood to get some insight into how the model made its decisions? (Any other debugging tips would be appreciated as well, but I'm just trying to figure out where to start!) |
Beta Was this translation helpful? Give feedback.
Replies: 1 comment 2 replies
-
Hey, this is a great question, though it is a bit outside the realm of what you can achieve with SpaCy. There's a lot of research on interpreting/explaining deep learning model decisions, and it's far from being a settled science, unfortunately. One thing you could look at is the actual features being generated for each noun phrase, but it's probably not going to be very helpful - these models typically have far too many parameters for us to be able to neatly explain their decisions as a set of rules. |
Beta Was this translation helpful? Give feedback.
Hey, this is a great question, though it is a bit outside the realm of what you can achieve with SpaCy. There's a lot of research on interpreting/explaining deep learning model decisions, and it's far from being a settled science, unfortunately. One thing you could look at is the actual features being generated for each noun phrase, but it's probably not going to be very helpful - these models typically have far too many parameters for us to be able to neatly explain their decisions as a set of rules.