Self-Guiding Multimodal LSTM—When We Do Not Have a Perfect Training Dataset for Image Captioning

摘要

In this paper, a self-guiding multimodal LSTM (sgLSTM) image captioning model is proposed to handle an uncontrolled imbalanced real-world image-sentence dataset. We collect a FlickrNYC dataset from Flickr as our testbed with 306,165 images and the origina