What seemed to fix it was disabling the option in Windows Live Mail to convert emails with pictures to picture emails. However, this conversion happened when the messages were received. For existing emails that have already been converted, right-click and forward as attachment seemed to do the trick.
To disable picture emails:
- File > Options > Mail > Compose > Convert messages to photo e-mail when adding photos