why use crawler

I found that I was no longer willing to write the crawler program, more often use jquery output page link, and then wget to download, this will be faster.