Paddle
Your new boat probably came with a paddle. I've never seen a boat come with a good paddle. It is just a starter, to get you going. Get a good paddle that is the right size for you. It will make a world of difference. Keep the old one for a spare. Rule of thumb: your paddle should be about your height. If you install a thick seat cushion, you might want to go a little longer even.
Also, get some foam grips. Repetitive motion with wet hands is a sure way to get blisters, and you will quickly fall out of love with your new hobby. Inexpensive foam grips as shown are available on eBay. I cut them in half, and turn one set into two. I use double-sided tape to keep them from sliding on the shaft. Make sure the seam is out of the way before you fix them down.
There are also expensive grips available, but my experience is that expensive or cheap, a set of grips lasts about a season, so why spend more?