How to reproduce:
1. Create a new project
2. In the Hierarchy window right-click > UI > Button - TextMeshPro
3. Import TMP Essentials
4. In the Hierarchy window select the "Button" GameObject and in the Inspector window add "Vertical Layout Group" Component
5. Press Ctrl + z or command + z or File > Undo
6. Observe the Text in the Button

Expected result: Text is in the middle of the Button
Actual result: Text is not in the middle of the Button

Reproducible with: 2.1.4 - 2.2.0-preview.2 (2019.4.36f1), 3.0.6 (2020.3.30f1, 2021.2.0a8, 2022.1.0a12, 2022.1.0b11), 3.2.0-pre.2 (2022.2.0a7)
Not reproducible with: 3.0.6 (2021.2.0a9, 2021.2.15f1, 2022.1.0a11)
Could not test with: 4.0.0-pre.1 (Errors)

Note: With Legacy Button, the Text disappears after adding the "Vertical Layout Group" Component