Right now, all of the event data we scrape from Astra, Mazevo, and The Comet Calendar is for the future. We scrape future data and upload it to MongoDB, deleting the old data. I can see a use case for someone needing this historical event data that were deleting, maybe as some kind of training data or something.
Develop a way to upload new Astra, Mazevo, and The Comet Calendar data without deleting the old data. Use the date as the key to replace matching entries during upload.
In addition, check whether the CourseBook events route allows pulling events from the past (as in like over a year ago). If it does not, update the aggregation that generates the events collection to generate all days, instead of just future days.
Right now, all of the event data we scrape from Astra, Mazevo, and The Comet Calendar is for the future. We scrape future data and upload it to MongoDB, deleting the old data. I can see a use case for someone needing this historical event data that were deleting, maybe as some kind of training data or something.
Develop a way to upload new Astra, Mazevo, and The Comet Calendar data without deleting the old data. Use the date as the key to replace matching entries during upload.
In addition, check whether the CourseBook events route allows pulling events from the past (as in like over a year ago). If it does not, update the aggregation that generates the events collection to generate all days, instead of just future days.