### Is this a regression? - [ ] Yes, this behavior used to work in the previous version ### The previous version in which this bug was not present was _No response_ ### Description https://user-images.githubusercontent.com/43982973/173754571-dff8c299-1f0e-469c-be89-fffbb92631cc.mov When scrolling through example for appendOnly on documentation site (https://material.angular.io/cdk/scrolling/overview), the list acts glitchy. It is constantly jumping back to the begining. ### Reproduction Steps to reproduce: 1. add appendOnly attribute 2. scroll fast ### Expected Behavior It shouldn't do that. ### Actual Behavior It is jumping back to the start of the list. ### Environment - Angular: - CDK/Material: at least from 12 to 14 - Browser(s): Chrome v100 - Operating System (e.g. Windows, macOS, Ubuntu): macOs