How to reproduce:
1. Open the project “IN-113061_PhysicsMemoryUsage”
2. Open the SampleScene
3. Open the Profiler (Window → Analysis → Profiler)
4. Enter Play Mode
5. In the Hierarchy, select the “Spawner” GameObject
6. In the Inspector, click Spawn objects
7. Observe the Physics section in the Profiler

Expected result: The Physics Used Memory settles. In most cases settles at single digit MB numbers
Actual result: The Physics Used Memory keeps growing in steps. At first it grows rapidly, afterwards it takes some time to see the step up in memory growth

Reproducible with: 2023.3.0a5, 6000.0.58f1, 6000.2.6f1, 6000.3.0b3, 6000.4.0a1
Not reproducible with: 2022.3.67f1, 2023.3.0a4

Reproducible on: Windows 11
Not reproducible on: No other environments tested

Note: The “Spawner” GameObject spawns 1000 GameObjects that disable and enable their colliders. It has the option to also spawn GameObjects that destroy and re-add themselves to the scene