|
30 Jul 03 - 11:32 AM (#993422) Subject: Tech: How do I download the whole shebang? From: Joe Offer This is a question that's been in the back of my mind for a while. I've seen wonderful lyrics sites come and go. When they go, I've got to go looking for the songs all over again. I'm wondering if there's an easy way to download a large number of lyrics files to my computer. Take for instance, the Silverstein files at this site (click). Or the huge collection of jazz lyrics at Rabid Squirrel. Is there a way to do it without downloading each file individually? -Joe Offer- |
|
30 Jul 03 - 11:38 AM (#993431) Subject: RE: Tech: How do I download the whole shebang? From: Bill D yes, Joe there is...sometimes..... It depends on how the site is set up. When Rose the Record Lady was first up, I got all of it by using a program...but she has since changed to a system that prevents direct access of the 'source' page. I will take a look at the site you mention and see if my tricks will get them. |
|
30 Jul 03 - 11:43 AM (#993437) Subject: RE: Tech: How do I download the whole shebang? From: ToulouseCruise if you only get half of it, would it just be a shebump? are you homophobic, afraid of a hebang? something against 50's music, not wanting a sheboom sheboom? Okay, maybe I am just a little bored at work.... Please carry on and ignore me. Brian. |
|
30 Jul 03 - 11:52 AM (#993446) Subject: RE: Tech: How do I download the whole shebang? From: katlaughing I thought you'd be talking about the entire contents of the Mudcat, up to today, Joe! A useful question, just in case, esp. concerning the old and memorable threads, PMs, etc.:-) |
|
30 Jul 03 - 11:53 AM (#993449) Subject: RE: Tech: How do I download the whole shebang? From: Bill D ok, Joe...the answer is, you can do it if you are willing to take them as HTML files..I just got the first 20 or so from the Silverstein site in about 20 seconds...after setting uo the program. Now...I 'think' there is a way to then strip the HTML from a file automatically and leave it just as a plain text file....but I'll need to experiment and see if that can be done in batch mode, or you are right back where you started, doing it one at a time. If you are willing to have the files in HTML mode, it is easy. |
|
30 Jul 03 - 11:56 AM (#993454) Subject: RE: Tech: How do I download the whole shebang? From: Joe Offer Well, yes, Bill. I'm willing to have them any way I can get them. So, how does one do it? -Joe- |
|
30 Jul 03 - 12:01 PM (#993460) Subject: RE: Tech: How do I download the whole shebang? From: Clinton Hammond Get a good download manager and set them up to auto-download? Or is that not what ya mean? |
|
30 Jul 03 - 12:07 PM (#993466) Subject: RE: Tech: How do I download the whole shebang? From: Mark Clark Joe, Your Web browser may let you make a copy of the site on your hard disk. In Internet Explorer (I use IE 6.0) click favorites on the menu bar and then "Add to Favorites…" Check the box where it says "Make available offline," this will enable the button labeled "Customize." Clicking the "Customize" button starts a wizzard that helps you configure what you want to save and how often you want IE to check for updates and keep things in sync. If the site has pages that refer to other sites, as is often done with multimedia feeds like RealAudio, you won't pick up the remote content, only the access pages. In the case where lyrics are stored on the site, you should be able to replicate the site. Under the "File" menu there is a toggle called "Work Offline." That toggle determines whether you're looking at your local copy of a site or the real, remote one. This isn't something I do much so I don't really have useful experience with the facility but I don't see why it it shouldn't work. - Mark |
|
30 Jul 03 - 12:28 PM (#993482) Subject: RE: Tech: How do I download the whole shebang? From: Bill D Joe....what I used was Go!zilla- but I think that any good download manager..like maybe DLEXPERT will do it. (Go!zilla has a paid mode which gets tedious) DLExpert can be set to put them in the folder you designate...then you can open then either in your browser, or in a special program which can view HTML. Arachnophilia will do this and edit also (and is famous for it's creator's attitude..*grin*)...so will NoteTab NoteTab lite is free, and will actually strip the HTML from a file, if you want to, leaving just the text....there are fancier versions, but they cost $$...but are VERY good! |
|
30 Jul 03 - 12:30 PM (#993486) Subject: RE: Tech: How do I download the whole shebang? From: Amos Adobe Acrobat has the capability of capturing a whole site to harddisk in PDF format, including as many levels deep as you set it to go. You can include or exclude images. It only works where the site structure permits it. There are programs that do that exclusively. Dunno which ones in the Windows world. A |
|
30 Jul 03 - 12:36 PM (#993494) Subject: RE: Tech: How do I download the whole shebang? From: Bill D there no longer seems to be a 'free' version of Go!zilla...(I expect one can....ahem...'bypass' the registration process, but I have had my version for 4-5 years, and see no need to explore that right now...) Try DLExpert...you will like it, no matter what you do with it..and I have others like StarDownloader and GetSmart, if there are problems. |
|
30 Jul 03 - 12:45 PM (#993500) Subject: RE: Tech: How do I download the whole shebang? From: Bert Try making contact with the manager of the site. They may well offer to sell you a CD which could save you an awful lot of time and trouble. |
|
30 Jul 03 - 01:09 PM (#993522) Subject: RE: Tech: How do I download the whole shebang? From: Joe Offer Hi, Bert - I tried to contact the owner of Rabid Squirrel, but got no response. The owners of the surviving lyrics sites have to make themselves scarce to avoid the copyright cops. I see somebody above wondered about downloading the entire content of the Mudcat Forum. I can't see a great value in that because it changes all the time, and a download like that would put a real drain on our resources. As I recall, there is a Website - wayback machine or something like that - that will give you a look at what Mudcat was like on a given date. -Joe Offer- |
|
30 Jul 03 - 01:44 PM (#993552) Subject: RE: Tech: How do I download the whole shebang? From: Deckman Hi Joe ... I'm going to make certain, with this posting, that you receive your full compliment of useless information today. Did you know, or care, that the word "shebang" has Irish roots. It was in very common use in America during the Civil War. It was referred to in diaries relating to the shacks of sticks, canvas, mud, that prisoners made in Andersonville Prison for protection from the sun. Now that we understand that, we'll start on the Finnish alphabet in the morning. There are only seventeen letters in the Finni ........ CHEERS, Bob |
|
30 Jul 03 - 02:02 PM (#993571) Subject: RE: Tech: How do I download the whole shebang? From: Billy the Bus G'day, I'll heartily endorse Bill's vote for Eric Fookes' NoteTab. Eric calls it a "text editor" - HA, HA!! I've used it for ALL my writing since it first came out in 1997. I still use only a fraction of it's capabilities - you need to be a programmer to take advantage of it's full potential. I use it with the free version of WordWeb, an excellent Dictionary-Thesaurus by Anthony Lewis. You can use it in almost and Windows program (except a browser form like this one). It's 6am - in the words of Samuel Pepys - "and so to bed." That thread of Rick's has got me off on several tangents. Ni' Ni' - Sam ... ZZZzzzzzzzzzzzzzzzzzzzz |
|
30 Jul 03 - 03:21 PM (#993643) Subject: RE: Tech: How do I download the whole shebang? From: GUEST,.gargoyle Joe - some of the spiders/bots (spyders)(they've been around for 10 years an early one was "fly-cast") are so sophisticated they will copy the entire site - and then spin off and copy the sites of those linking TO the site you copied. The early ones were like having your own SakSam search-engine to scour for information http://www.datashaping.com/
Checkout this Wired article from 2001 - of a "Project Guttenberg" type approach with independent people working together to copy the net. http://www.wired.com/news/print/0%2C1294%2C47184%2C00.html
The BotSpot provides you with a wide selection of software posibilities and some are freeware:
http://www.botspot.com/BOTSPOT/Windows/Download_Bots/Off-line_Browsing_Bots/index.html
Details on some of them are below:
WebZip 5.0
Grab-A-Site
DISCo Pump
HAVE FUN! |
|
30 Jul 03 - 03:30 PM (#993651) Subject: RE: Tech: How do I download the whole shebang? From: Bill D Joe...if you have any problems getting what you want (figuring out download manager, etc)....let me know, I can probably do it all in 30 minutes and get you a CD made) |
|
30 Jul 03 - 04:50 PM (#993695) Subject: RE: Tech: How do I download the whole shebang? From: GUEST,Q Following with interest. Will try some of gargoyle's suggestions. Walt Whitman, best known as a poet, apparently was the firsr to mention shebang in print, 1862-1863, in his Journal entries about the Civil War. "Their shebang enclosures of bushes." 1863: "The soldiers guarding the road came out from their tents or shebangs of bushes." Bret Harte, 1877, used the phrase "the whole shebang," but Mark Twain used "shebang" to refer to a project (a book) in 1869, and a vehicle in 1872. Seems to have been a soldier's term for a temporary shelter made of brush; Irish origin speculative at best, may date to the soldiers in the west after the Mexican War. The OED and Webster's considers the origin to be American. |
|
30 Jul 03 - 05:36 PM (#993723) Subject: RE: Tech: How do I download the whole shebang? From: Deckman Man oh man. Do I get an award for the most blantant thread creep ... or what? Bob |
|
30 Jul 03 - 06:37 PM (#993760) Subject: RE: Tech: How do I download the whole shebang? From: Bill D yes, yes, Bob..*grin*...your award will be in the mail....You did fill out the forms, didn't you? No?..well, you go to this website and download the whole shebang, and....oh...never mind... |
|
30 Jul 03 - 06:56 PM (#993780) Subject: RE: Tech: How do I download the whole shebang? From: GUEST,Q Now will post as red in the face. Anyone know anything about the Grab-a-site posted by Gargoyle? They want $70, though. |
|
30 Jul 03 - 07:17 PM (#993798) Subject: RE: Tech: How do I download the whole shebang? From: Bill D I always assume there is a free way....so I go to Son of Spy's freeware site...in this case page 4 of the internet applications look at SiteSnagger, WebDownloader, WebLeech, WebReaper...and especially 'Website Extractor' (there may be more on other pagers...these are alphabetical) ...you will note apps that are labeled "Spyware"...Son of Spy works HARD to find real and FREE items...often he knows the ONLY free version left! |
|
30 Jul 03 - 07:25 PM (#993804) Subject: RE: Tech: How do I download the whole shebang? From: Bill D indeed, on page 4..(just change the 4 to 3 in the address) is PixWeb, which seems to be useful in endeavors like this. if you want to read reviews of things like this before you install them, you can go to Google groups search and enter the name of the program and maybe see what others have said...like this for SiteSnagger |
|
30 Jul 03 - 09:27 PM (#993868) Subject: RE: Tech: How do I download the whole shebang? From: IvanB I use HTTrack which is also found at Son of Spy. It is a program to create a mirror of a website on your hard disk and you can set parameters such as how many layers deep to capture, etc. I'm on a DSL connection and it took me less than 5 seconds to capture the Silverstein site - in fact, I spent more time setting up the capture than in performing it. If a site prohibits 'bots' HTT won't work, but I've found few that do. I tend to set up my captures for late at night when I won't be slowing traffic too much on the site. |
|
30 Jul 03 - 11:10 PM (#993913) Subject: RE: Tech: How do I download the whole shebang? From: Bill D Thanks, Ivan! I'll take a look...(ain't got me a broadband connection yet, but it is on my 'to do' list for this summer....) |