Changing of job is certainly not a solution. You have to become practical and answer them in their language. This may sound difficult to you but even your attempt of doing so will improve their attitude towards you. Let them know that you do not like them making your fun and will not tolerate it by just ignoring or keeping silent. Initially they may show their resistance by making more fun but on long run your message will be delivered to them.