Another aspect that we need to address is how the model will be maintained. Is this a model that will not change over time? Is it modeling a dynamic phenomenon requiring the model to adjust its prediction over time?
The model is usually built in an offline batch training and then used on live data to serve predictions as shown in the following diagram. If we are able to receive feedback on model predictions, for instance, whether the stock went up as the model predicted, and whether the candidate responded to campaign, the feedback should be used to improve the initial model:
The feedback could be really useful to improve ...
