Newborn wants to be attached to my all night!?

I am strictly feeding her, she is 2 weeks old now. She eats and sleeps fine during the day, but come night time all she does is cry, and the only thing that makes her stop is putting her to my . I tried pacifiers and they do not work! well the only one that works ok is the "soothie" pacifier, like the ones they give you baby at the hospital..but yea she prefers my . Its not that shes hungry, she just wants to suckle and shell fall asleep like that. How long will she do this? If i switch her to formula (dont judge me!!) will she stop doing this?