There are quite a range of waterproof cameras on the market at the moment, lots of which can be mounted to things, so you can attach them to helmets, boats, etc. and a lot of them are under £250.
A particularly good one for kayaking is the GoPro Digital Hero 5, it is really lightweight so you...