Whether you find it amusing or frustrating - or a little of both - the fact is if you own a cat, they are going to knock objects off any elevated surface, such as your desk or a table. Are they simply trying to be annoying, or is there a reason for this behavior? Dog people will use this as an example of how cats are not intelligent and a reason not to like them.