It seems that you are not his prime priority as even though he is busy he can spare sometime for a relationship if he wants to maintain but it seems that he is interested in only physical relation with you. But if that is not what you want then you need to talk to him about what you feel and clarify with him about your expectations in the relationship.