One thing. When I unfollow. Typically in this situation I would expect the item to be unfollowed but to stay in the list for this session, with the button changed to “Follow”. Helps with errors and visual validation. Then it would be gone the next time I open this screen.
Context: #19330 (comment)