Reproduction steps:
1. Open the attached project “RectNotMove”
2. Select the Recttool by clicking on the button in Scene view or press the assigned key (by default: t)
3. Make sure that In the Scene view via the Toggle Tool Handle Position dropdown menu Pivot is selected
4. Select the GameObject “Image”
5. Move the pivot from the center towards any of the corners
6. Try to move the GameObject “Image” multiple times by clicking and dragging from different positions

Expected result: GameObject is moved
Actual result: Some zones are created on the GameObject, which do not let GameObject to be moved.

Reproducible with: 2021.3.15f1, 2021.3.20f1, 2022.2.8f1, 2023.1.0b5, 2023.2.0a4
Not reproducible with: 2020.3.45f1, 2021.3.14f1

Reproducible on: Windows 10