Rendering corruption when using Vulkan

Download the Viking Village from the A$ and build a player setting Vulkan as the primary API.
Notice the corruptions when moving around and rotating the camera.
http://recordit.co/wD2Dfn4ucu

This could not be reproduced on 2018.1 0a6 or 2017.2 0f1

Note from Mikko: Bisected the first occurrence of this bug to https://ono.unity3d.com/unity/unity/pull-request/47407//graphics/buffer-cleanup/shared-buffer-removal , and this later gets fixed by https://ono.unity3d.com/unity/unity/pull-request/51479//graphics/vertex-decl-fixes