I'm working on a program that downloads and analyzes historical stock data from Yahoo Finance. I download the data in my program by using the wget command. I have a list of about 3,000 stock symbols and the .csv files for each one are downloaded twice (for weekly and monthly data). Could Yahoo flag my large amount of wget requests as an attack? Maybe as a dos attack of some sort?

  • 2
    Have you checked that yahoo doesn't have an API for this? – wireghoul Feb 19 '15 at 23:23
  • Of course they could, however if you want to know if they do you will need to either ask Yahoo or read available documentation. – Rory Alsop Feb 19 '15 at 23:33
  • As far as I can find, this actually is the Yahoo API for finance data. The data is obtained by building URLs. I'll ask Yahoo and post their reply. – Dustin01 Feb 20 '15 at 0:03
  • 1
    Found this question, which answers the question of Yahoo's request limit: stackoverflow.com/questions/9346582/… – Dustin01 Feb 20 '15 at 0:35
  • Actually the above link is likely the best answer. It details Yahoo limits from which one could establish compliance with is not a DOS attack. – Darrell Teague Feb 23 '15 at 23:58

The answer is subjective but wget simply makes HTTP GET requests, just as is done with a browser.

At worst one might claim a denial of service (DOS) attack but if only a single thread, most would classify as either normal use or perhaps aggressive crawling.

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Not the answer you're looking for? Browse other questions tagged or ask your own question.