I need opinions from parents on this situation?

I think you sound completely reasonable, and anyone who doesn't see eye to eye with your stipulations is just being belligerent. Honestly, I'd say you're being more than generous, considering he hasn't seen your child in four years.