True, that is awkward. Personally, I would find it more awkward to unfriend someone. And one can always claim (truthfully, even) to not reliably/consistently read LJ.

Of course, the people whose journals I keep off my default view aren't ones I'm likely to run into, so that helps.