Why did by boyfriend react this way? (for the guys out there)?

sounds like you got serious first and he just called your hand. Maybe he left because it was his way of not fighting with you. He probably left cause that was pretty much the end of the night. You wanted to watch the movies, he didn't. He wanted to have sex first, you didn't. It didn't really leave much options for anything else for the rest of the night.