This line supports the idea that Odysseus cares for his men, because although it would have been much easier to leave those who ate the Lotus behind, Odysseus insisted on dragging them back to the ship with him, because he couldn't bear the thought of leaving his men behind when there is still a way to save them.