You've hit the nail on the head there. Sunday morning train services are useless for travel to races, so on the odd occasions when I have been to a Sunday race rather than church, it has either been when I have gone away for the whole weekend (e.g. when I did Pen y Fan a few years ago), or a local race that I can cycle to.