https://blog.litespeedtech.com/2017/06/21/wpw-more-about-crawling/