@Andruser
That's interesting, thanks. I know I'm very sensitive to certain sounds, so I suspected that this was a sound that some people might not even notice, whilst being very annoying to me.
Having said all this, the router has not been making the noise for the last day or so - it seems to only happen at certain times/days. Perhaps it's when the router is working hard, or is doing background updates or something. It sounds like a problem I'll just have to live with until they release an updated version.
By the way, I'm 33, and according to the test I have the ears of a 27 year old - not sure what significance that has though!