How to reproduce:
1. Open the “Collider2DRepro“ project
2. Open the “Scenes/Regular/Trying New Angles“ scene
3. Enter the Play mode
4. Press the letter ‘K' on the keyboard
5. Press the letter 'A’ on the keyboard
6. Open the “Breakable Blocks“ GameObject in the Inspector
7. Observe the Scene view

Expected result: When the two bottom tiles are set to null (destroyed) they are not detecting collision
Actual result: When the two bottom tiles are set to null (destroyed) they are still detecting collision, and Collider Bounds are still in place

Reproducible with: 2022.3.15f1, 2023.2.3f1, 2023.3.0a17
Could not test with: 2021.3.33f1 (Could not fix the “The type or namespace name 'IntegerField' could not be found“ error message)

Reproducible on: macOS 13.5.2 (Intel)
Not reproducible on: No other environment tested

Workaround: Open the “Grid > Breakable Blocks“ GameObject in the Inspector and in the Tilemap Collider 2D Component set Max Tile Change Count to 0