It must be clear when, where and how the data is brought to the same grid. The simplest approach is to resample everything before it is passed to the inference engine. When data from different sources is combined though, the inference engine might want to decide on how this combination is done not only spectrally/thematically, but also spatially.
If the resampling is done outside of the inference engine, we might consider adding a new component for this.