Excessive File Size & Number
The Imperial Aeronautics Data Store will have a high limit in terms of number of files that can be uploaded and the upload limit of uploaded files. However, an assertion should be made before the pipeline is executed warning users if they have exceeded those limits, as upload is guaranteed to fail in that instance. This should take into account the fact that an extra "metadata.json" file is also produced. The upload limit should be queried from the data store so that up-to-date values are always used.