They won't call you back because you'll have a criminal record for verbally assaulting a judge. Oh, did I mention you'll go to jail for a couple days and pay a fine? No? Well, you get the idea. I've gone about 4 or 5 times, never been picked. It's just no big deal to go and it is a hugely important civic responsibility. I mean, if you were innocent of a crime and on trial, wouldn't you want the most competent jurors to show up and care about your case? I sure as hell would. Go. Serve. Be thankful that we have a system of justice that allows the general public to participate.
By the way, if your summons is "lost in the mail," they will send it again. Eventually, they will fine you for not responding and you'll still have to serve.