Darry does love Ponyboy, but he feels a lot of pressure to be both brother and father. Darry and Pony's parents died in a car accident, leaving Darry as the parent because he was the oldest brother. Pony says that Darry treats him harshly compared to his older brother.
