Machine Learning for the Web

Search engine choice and the application code

Since scraping directly from the most relevant search engines such as Google, Bing, Yahoo, and others is against their term of service, we need to take initial review pages from their REST API (using scraping services such as Crawlera, http://crawlera.com/, is also possible). We decided to use the Bing service, which allows 5,000 queries per month for free.

In order to do that, we register to the Microsoft Service to obtain the key needed to allow the search. Briefly, we followed these steps:

1. Register online on https://datamarket.azure.com.
2. In My Account, take the Primary Account Key.
3. Register a new application (under DEVELOPERS | REGISTER; put Redirect URI: https://www.bing.com)

After that, we can write ...