It's Always Your Fault. In my experience it almost always is, but the thrill of proving that there is a fault in someone elses code should not be underestimated - making a test case that fails and getting feedback is very fullfilling.
Only problem is when you can't create that test case, because - it turns out - the error really is in your own code. But at least you have then found it. ⊗