Package Manger - Switching between "In Project" and "All" can create long load times

1. What happened
When switching between "In Project and "All" and vise-versa in the package manager can take a long time to load. I would maybe expect this for "All" but should "In Project" not be instantious?

2. How we can reproduce it using the example you attached
- Open any Unity project
- Open the package manager (Window > Package manager)
- Select "All" and install the Cinemachine package.
- Once installed flip back and forward between "In Project" and "All" in the package manager window.
Notice issue >> Very long load time can happen upwards of 30 seconds + even for "In Project"