MP Rupert Lowe mistook the crew for migrants as they rowed up the east coast of England.