Contrary to the advice, you do not need an accountant, especially if you are able to ignore another part of the advice and not register for VAT (if your turnover is below the registration threshold of £82,000) which simplifies the accounting greatly. Your duties are then mainly as follows:
Use HMRC PAYE Tools to report each salary payment you make, and pay any National Insurance if applicable (which it won't be if you keep you salary below £671 a month).
Use the same tool to report any expense payments each May (form P11D).
Use Companies House WebFiling to submit your annual return (a short submission confirming some details about your company's directors and shareholdings etc.) each company year end.
Use HRMC's Online services to submit your corporation tax and accounts nine months after each year end. I pay £45 each year for collection of Excel templates from http://www.diyaccounting.co.uk/ to record my accounts which produces a mockup of the HMRC web form with the fields filled in.
Pay yourself a dividend one or twice a year and find a Word template to print out a record of the payment and the board meeting you had to decide on it.
Finally, use HMRC Online Self Assessment to submit your personal tax return each January, which you may already be doing anyway.
Looking at all this now it seems like a lot, but it's not as bad it sounds. I suppose you've got to have something of an interest in learning how a business is run to justify it. On the other hand you can save your company a tidy sum, plus as a company director you're legally responsible for the accuracy of the various submissions anyway, whether an accountant does it all for you or not, so you may as well have a sound understanding of it all I say. Also, I don't know whether this is the really the case or not but I've a theory that the more you run your operation like a proper business the less likely you're going to come a cropper of an IR45 disguised employment judgement, which could be severely financially damaging.
Running your own operation like this will put you in a better position for trying out any side projects I believe, and of course it will all stand you in good stead when you finally hit on the world changing idea you've been waiting for and your one man band blossoms into a large corporation (although do then get some accountants - but at least you'll have some idea what they're up to).