How to reproduce:
1. Open the attached project
2. Open Game scene
3. Open animation window and select Horse game object
4. Enable keyframe recording mode and place time indicator to some position
5. Enable or disable second or third edge collider 2D

Result: Keyframes appear but it doesn't animate anything
Expected behavior: components which can be duplicated on game object can be animated

Note: also tested with Audio source, same issue is there

Reproducible: 5.3.7p4, 5.4.4p2, 5.5.1p4, 5.6.0b8

By Design: we don't support animating the multiple time the same component on the same GO. This a limitation of the Animation system.