Let you Go

Letting him go doesn't mean you stopped caring. 

It means you stopped trying to force him to.