How do I tell my fiance, also the father of my child, that we are not right for each other?

Tell him just how you told us. You can't do it anymore. If you know this situation is bad for you, then it can't be good for your child, either. Good luck hun.