
I got a great response to my article on the Absent from the Table report on reasons why people have stopped attending Mass in Australia. But several people said that because the respondents all self-selected – that they chose to take part in the project – this made the project inherently weak.
This isn’t the case, so let me try to change your mind.
All research is about answering a question. When the question is about what specific people think or do or say, we need to ask them to tell us the answers. But the trouble is that it’s often hard to get answers. These people may not be in a generous mood, or they may be very busy.
They may not like being asked what they think are stupid questions. They may not know you or trust you, or they might be suspicious of how their answers will be used. But they’re the only ones who can help us, so we’ve still got to find them and approach them somehow.
Surveys can reach quite a large group of people, but all surveys only collect information from people who are willing to give it to us. Every survey in the world has been completed by a self-selected group of people – the ones who chose to take part in it.
There’s no way of getting round this. We can’t force people to do a survey – that’s grossly unethical.
Even if we hire a polling company to do what we call “cold calling” on the phone, the people who don’t hang up instantly have still chosen to take part in that survey.

It’s true that there are other ways we can find out things about Catholics in Australia. We can use the census data, which tells us about the people who say they are Catholic.
We can find out where they live, how old they are, their employment type and rate, their income, and so on. We must tell the government this stuff every five years, so we don’t have any choice. But the census can’t tell us if any of these people are going to Mass, and it doesn’t tell us what they actually believe.
We can also count heads in our five-yearly national count of Mass attendance. This tells us where our Mass-goers are going to Mass. But this doesn’t tell us things like where they were born, what language they speak at home, or again what they actually believe.
To find out these things, we must ask the people themselves. The simplest way is with a survey. Survey-based research can be fantastic for finding things out – but you must know who you’re talking to.
So every good survey includes questions about sex, age, where you live, your education level, and other factors that might affect your answers to the survey questions.
Once we have a group of people who’ve responded, we look at how well they represent the people we really wanted to talk to.
It’s generally quite easy to do this. We already have the census information on nominal Catholics, and we have information from the national count of attendance.
You can easily work out if you’ve talked to the right group of people, based on this. So if it isn’t representative, is your survey a failure and your results useless?
Not at all. You can still use the data; you just need to be very transparent about who you talked to. For example, my Catholics in Australia 2022 study ended up with a sample of around 75 per cent regular Mass attenders and 25 per cent who weren’t as regular.
Obviously, the Australian Catholic population is 90 per cent non-Mass attending, so this was way off beam. But it was also brilliant because it gave Professor Stephen Bullivant and I an unparalleled look at who was still going to Mass in Australia, and why, and what they really believed about all sorts of things.
We found out that when you survey Catholics, it’s critical to ask them how often they go to Mass. This one specific factor can really affect how they answer survey questions about faith and practice.
And that’s what we told everyone, and that’s how we used the data. It formed the basis of my book Witness: the future Catholic Church in Australia, because the data showed us who was likely to stick around for the next decade or so.
Surveys aren’t the problem, and nor is self-selection. They are good servants, but bad masters.
They’re a valuable way of carrying out research. But it really matters how they’re designed and who ends up completing them.







