We're currently making a call from the front-end to api/saved_objects/_find?per_page=10001&type=index-pattern which is being done here. This can result in a very large request, oven 10's of megabytes due to the field cache. We should request the index patterns as we need them, and limit the fields being requested. A similar effort was recently done with Lens.