Hello Kate,
Firstly I am so very sorry for your loss - losing a baby no matter at what stage is one of the worst pains I think any woman has to face. You will never forget your little one, but be assured in time you will be able to think about them with less hurt. You will however always hold a little place in your heart for them though.
Remember that you shouldn't expect to feel in a particular way - you will probably go through a range of emotions in the coming days / weeks. My best advice is to go with how you feel and do not be afraid to grieve when you need to. Be kind to yourself and keep talking to your DH - its important to keep communicating.
I have lost four babies since starting ttc (two at around 9 - 10 weeks) so I can imagine how you feel. Have you had any investigaitons as to why it took you 21 months to conceive? Do you have PCOS for example?
Remember you are not alone and when you are ready, do come and join us on ttc after miscarriage...we are a nice little family over there and support eachother through good and bad.
Take care of you. (Sending hugs)
Apple x