Many public APIs have rate limits. If you are attempting to pull down any substantial amount of data using a particular API that requires many API calls, you'll undoubtedly need to work around those rate limits and find a way to get to your data as fast as possible without exceeding your request quota. In cases such as this, a queue architecture can help out:
I have personally implemented this exact pattern with great success. Here, a third-party API provides an endpoint to /items. The actual data being retrieved is of little importance to explain the details. Here, the challenge is that we can only fetch the ...
