Hacks #8-32
Perl Modules
Resources You May Find Helpful
Hack 8. Installing Perl Modules
Hack 9. Simply Fetching with LWP::Simple
Hack 10. More Involved Requests with LWP::UserAgent
Hack 11. Adding HTTP Headers to Your Request
Hack 12. Posting Form Data with LWP
Hack 13. Authentication, Cookies, and Proxies
Hack 14. Handling Relative and Absolute URLs
Hack 15. Secured Access and Browser Attributes
Hack 16. Respecting Your Scrapee's Bandwidth
Hack 17. Respecting robots.txt
Hack 18. Adding Progress Bars to Your Scripts
Hack 19. Scraping with HTML::TreeBuilder
Hack 20. Parsing with HTML::TokeParser
Hack 21. WWW::Mechanize 101
Hack 22. Scraping with WWW::Mechanize
Hack 23. In Praise of Regular Expressions
Hack 24. Painless RSS with Template::Extract
Hack 25. A Quick Introduction to XPath
Hack 26. Downloading with curl and wget
Hack 27. More Advanced wget Techniques
Hack 28. Using Pipes to Chain Commands
Hack 29. Running Multiple Utilities at Once
Hack 30. Utilizing the Web Scraping Proxy
Hack 31. Being Warned When Things Go Wrong
Hack 32. Being Adaptive to Site Redesigns
