Have you read Fowler page 708 (Second Edition) on Who and Whom?

As I read him he supports my usage for the written form as distinct from talk.