Going to church on Sunday

Many of us have the time and the luxury to participate at a church service every Sunday or Saturday depending on which day your church service is held. There is a chunk of people who can't. Does it mean that they are not believers of Jesus Christ message or not? I am raising this question because in my community many of us tend to judge people degree of Christianity by their going to church or not. As far I am concerned, it is your actions that determine your love for Jesus and its message. What is your opinion about it?