This can be achieved by using pre-allocated memory for parameters if they are not cached (the parameter caches can be used for this), and making sure allocations in evaluation are reduced to a minimum.
We could also support in-place evaluation of vector valued interpolations.