- Joined
- Nov 16, 2011
- Messages
- 3,692
- Reaction score
- 863
the kind that downloads whole websites... anybody ever used one? recommendations?
offline websurfing programs
- Thread starter robert l. bentham
- Start date
- Joined
- Apr 3, 2005
- Messages
- 1,809
- Reaction score
- 794
Most of the time, websites have server-side algorithms to store data on a server-side database. You cannot copy that just like that.
- Joined
- Apr 12, 2005
- Messages
- 4,767
- Reaction score
- 697
Try this: http://www.httrack.com/
Just point it to Google.com and make it search for every combination of words in the dictionary and before you know you'll have the entire web on your HD. Ummm... On second thought, please don't.
Actually, progs like httrack are somewhat hated by webmasters. They put a fair bit of load on a server, so use it wisely if you really need to at all.
Just point it to Google.com and make it search for every combination of words in the dictionary and before you know you'll have the entire web on your HD. Ummm... On second thought, please don't.
Actually, progs like httrack are somewhat hated by webmasters. They put a fair bit of load on a server, so use it wisely if you really need to at all.
- Joined
- May 17, 2005
- Messages
- 12,258
- Reaction score
- 2,693
wget all - can get a bit crazy, have to watch the depth. Can't remember the syntax. Do remember using a caching proxy once which is better than just wgetting the site because if you wget it then you probably end up having to edit the urls to make it work.
Simple copying won't work on sites that use a lot of javascript to access content.
Also depends on whether what you get back changes based on cookies and such.
Simple copying won't work on sites that use a lot of javascript to access content.
Also depends on whether what you get back changes based on cookies and such.
- Joined
- Nov 16, 2011
- Messages
- 3,692
- Reaction score
- 863
Try this: http://www.httrack.com/
Just point it to Google.com and make it search for every combination of words in the dictionary and before you know you'll have the entire web on your HD. Ummm... On second thought, please don't.
Actually, progs like httrack are somewhat hated by webmasters. They put a fair bit of load on a server, so use it wisely if you really need to at all.
stumbled onto that one at zdnet...
works pretty good... i used a spyder program a few years back on the state of oklahoma website... bout 4 hrs into it im looking at peoples driver license info and thought mebbe i mighta gone too many layers in...a call from oklahoma verified that concern... lol... they were glad to have discovered that problem...