Download list of urls from text file

It only takes a minute to sign up. Connect and share knowledge within a single location that is structured and easy to search. I need a program that I can give a lit of URLs to either paste or in a file like below and then it must be able to crawl those links and save files of a certain type, like images for example. I have tried a few spiders but not had luck. Currently, the only way to download everything, is to open each link, then I use the "DownThemAll!

This works page by page, but I need something similar that works a whole list of URLs. Could I also add that it be something fairly easy to use that has a half decent user interface and doesn't run from the command line.

There's not been any way of doing this from a browser or without downloading dodgy one-hit wonder freeware so I've written a Chrome browser extension that fits the bill. It's called TabSave , available in the webstore here. It also has the ability to download every tab open in the active window, hence the name. This is the default, just click the edit button to insert a list yourself. It's all open source, the GitHub repo is linked in the webstore description if you want to send a pull request or suggest a feature.

Both are Chrome extensions, so no need to download desktop software. So downloading it with TabSave just gives you the same name videos and you have to guess wich is the content somewhat like " Imagine how much extra work you need to do to achieve this kind of task. If you need quick list download of files as-is, go TabSave. If you need start to need change the name files on the run, go Chrono. I know I'm gravedigging here, but I was searching for a similar program and found BitComet which works really well, you can import url's from textfiles etc.

Libre Sr. Libre 31 2 2 bronze badges. The -Z option can be combined with -K - to read lots of URLs from a file and download them a lot more quickly than running multiple curl commands MaxWaterman every url config should be in its own line that is enough.

Max Waterman Thank you for the -Z option very useful for mass file download. Dean Householder Dean Householder 3 3 bronze badges. Sign up or log in Sign up using Google. Sign up using Facebook. Sign up using Email and Password. Post as a guest Name. Email Required, but never shown. The Overflow Blog. Podcast An oral history of Stack Overflow — told by its founding team. Millinery on the Stack: Join us for Winter Summer?

Bash, ! Will they be escaped? Without escaping the shell will think that the command should be run in background. Can replace the -O with a redirect into a file instead, or whatever is suitable.

Evgeny Evgeny 5 5 silver badges 10 10 bronze badges. The Overflow Blog. Podcast An oral history of Stack Overflow — told by its founding team. Millinery on the Stack: Join us for Winter Summer? Bash, ! Featured on Meta. New responsive Activity page. Rest in peace, Michael Hampton. Related 3. Hot Network Questions. Server Fault works best with JavaScript enabled.

If you're on OpenWrt or using some old version of wget which doesn't gives you -i option:. Furthermore, if you don't have wget , you can use curl or whatever you use for downloading individual files. Stack Overflow for Teams — Collaborate and share knowledge with a private group. Create a free Team What is Teams? Collectives on Stack Overflow. Learn more. Ask Question. Asked 5 years ago.

Active 1 year, 10 months ago. Viewed k times. Let's say I have a text file of hundreds of URLs in one location, e. Improve this question.