Most young toddlers will act like this, so it is important to understand that there is nothing wrong with him. I think it is great that you can connect with him during lunchtime – the more he gets of you, the better. I would anticipate that over the next few weeks, he will get used to your brief visits. I would try to “spy” on him after you leave, just so you can get a sense of how fussy he gets, and how long it takes for him to calm down. Once you see him playing and happy, you will feel much better about going back to work. If you don’t have time for this, you can ask the caregiver to call you with an update. Above all, use your “mother’s instinct” on this one. If something is telling you that this is the wrong situation for him, then make a change.