@achaboot You are right and here's the reason why.
I've heard some wild tales about 2 man taking down 4 man ships, and with a really terrible crew i'm sure anything is possible.
But once you understand how durable a Galleon is you realize this there is almost no stopping it with a good crew on board.
We were sailing 4 man on voice with several crying chests and other goodies, another Galleon spotted us and took up the fight. We had only 30 planks on board, but with constant fire to the lower deck 2-3 holes at a time we had 3 people repairing and running with water and one man on the wheel. The water reached the mid deck but we still managed to move it out of the ship while one man repaired.
Our barrels were empty by the time we reached the outpost, but we also managed to sail across the map under fire and turn in all the chest before anyone could get to our ship.
So you see for a 2 man ship to sink a galleon with a good crew is not possible, even if they had both man firing and hitting the lower deck with each shot they would still not sink it or move their ship either.
So in reality nothing can sink a well crewed Galleon, not even another Galleon, unless they hit with all their cannons on the lower deck 3-4 times in a row with no interval.
This needs to change, there needs to be a risk factor for Galleons as well otherwise everyone will match up in 4 like they did in beta.