I personally don't like the idea of, "dolphin diving". It looks and feels unintentional and unpolished. I've had my fair share of games where people find exploits and use them to their advantage. For example, Conan Exiles had similar problems or Chivalry. Those who played the game normally, were always at an advantage, so eventually everyone had to do the same exploits in order to remain relevant. If you're going to add a mechanic, then officially add it.
Don't let your players exploit mechanics. The same people that exploit this, whether you guys care or not, are the same ones that hide their chests and do other game breaking exploits once they arise. You guys shouldn't cultivate that type of community.