Certain Mario Party 1, 2 and 3 Minigames run slower then they do on real hardware. #406

Describe the bug
When playing certain mini-games in Mario Party 1, 2, and 3, the frame rate of the game will be noticeably lower then it would be on real hardware. I've been led to understand that this is usually due to a CPU bottleneck, but given the hardware I have my doubts.

To Reproduce
Steps to reproduce the behavior:

1. Boot up Mario Party 3
2. Head over to the Mini-Game room (Yellow Star)
3. Talk to Toad, head over to the blue books (4 Player mini-games), play any mini-game that has to render 4 individual screens, some good examples for Mario Party 3 are Aces High, Frigid Bridges, and Awful Tower.
4. Play the mini-game, you'll notice the lag immediately.

Expected behavior
Given the accuracy of the emulator otherwise, I would expect the emulator to run the game at a frame-rate similar to that of real hardware

Screenshots
How the game should run: https://youtu.be/Knfez1Zg9BQ
How the game actually runs: https://streamable.com/dxvi5u

Desktop (please complete the following information):

• OS: Windows
• Version: 10
• GPU: NVIDIA RTX 3070
• CPU: AMD RYZEN 5800X3D

Additional context
A Raphnet N64 adapter N64 adapter and its corresponding plug-in was used to test the game on Simple64, however, the same behavior can be observed while using the normal controller plug-in, and a normal game-pad. Here's a save file to help out with testing.
https://github.com/simple64/simple64/files/13398683/Mario.Party.3.U.-76A8BBC8.zip