How to reproduce:
1. Open the “IN-81932_memory“ project
2. Open the “prefab1“ asset
3. Select AutoSave in the top right corner of the Scene view
4. Open Task Manager on the device
5. Enable and disable the prefab in the Inspector 10-15 times
6. Observe the memory usage in the Task manager

Expected result: The memory stays stable
Actual result: The memory increases significantly

Reproducible with: 2021.3.42f1, 2022.3.41f1, 6000.0.14f1

Reproducible on: Windows 10, Windows 11
Not reproducible on: No other environment tested

Note:
- The issue does not reproduce after re-importing materials
- The project might open with errors regarding packages or prefabs. The issue is reproducible despite the errors.