Reproduction steps:
1. Open the attached “Rigidbody Problem.zip” project
2. Open the “Assets/Scenes/SampleScene.unity“ scene
3. Enter the Play Mode
4. Press W key
5. Observe the Game View

Expected result: GameObject moves forward
Actual result: GameObject moves forward and spins around

Reproducible with: 2023.2.0a12, 2023.2.0f1, 2023.3.0a14
Not reproducible with: 2021.3.32f1, 2022.3.13f1, 2023.2.0a11

Reproducible on: Windows 11
Not reproducible on: No other environment tested