Idea
Another improvement for Non-local Neural Networks
- Embed a pyramid sampling module (See PSPNet) into non-local blocks, which could largely reduce the computation cost yet provide substantial semantic feature statistics
- Use the same method not only for the self-attention computation, but also to calculate the correlations between every pixel of the low-level and high-level feature maps