Open Access. Powered by Scholars. Published by Universities.®
Articles 1 - 4 of 4
Full-Text Articles in Computer Engineering
Show, Prefer And Tell: Incorporating User Preferences Into Image Captioning, Annika Lindh, Robert J. Ross, John Kelleher
Show, Prefer And Tell: Incorporating User Preferences Into Image Captioning, Annika Lindh, Robert J. Ross, John Kelleher
Conference papers
Image Captioning (IC) is the task of generating natural language descriptions for images. Models encode the image using a convolutional neural network (CNN) and generate the caption via a recurrent model or a multi-modal transformer. Success is measured by the similarity between generated captions and human-written “ground-truth” captions, using the CIDEr [14], SPICE [1] and METEOR [2] metrics. While incremental gains have been made on these metrics, there is a lack of focus on end-user opinions on the amount of content in captions. Studies with blind and low-vision participants have found that lack of detail is a problem [6, 13, …
Reality Analagous Synthetic Dataset Generation With Daylight Variance For Deep Learning Classification, Thomas Lee, Susan Mckeever, Jane Courtney
Reality Analagous Synthetic Dataset Generation With Daylight Variance For Deep Learning Classification, Thomas Lee, Susan Mckeever, Jane Courtney
Conference papers
For the implementation of Autonomously navigating Unmanned Air Vehicles (UAV) in the real world, it must be shown that safe navigation is possible in all real world scenarios. In the case of UAVs powered by Deep Learning algorithms, this is a difficult task to achieve, as the weak point of any trained network is the reduction in predictive capacity when presented with unfamiliar input data. It is possible to train for more use cases, however more data is required for this, requiring time and manpower to acquire. In this work, a potential solution to the manpower issues of exponentially scaling …
Mediaeval2019: Flood Detection In Time Sequence Satellite Images, Palavi Jain, Bianca Schoen-Phelan, Robert J. Ross
Mediaeval2019: Flood Detection In Time Sequence Satellite Images, Palavi Jain, Bianca Schoen-Phelan, Robert J. Ross
Conference papers
In this work, we present a flood detection technique from time series satellite images for the City-centered satellite sequences (CCSS) task in the MediaEval 2019 competition [1]. This work utilises a three channel feature indexing technique [13] along with a VGG16 pretrained model for automatic detection of floods. We also compared our result with RGB images and a modified NDWI technique by Mishra et al, 2015 [15]. The result shows that the three channel feature indexing technique performed the best with VGG16 and is a promising approach to detect floods from time series satellite images.
Investigating The Impact Of Unsupervised Feature-Extraction From Multi-Wavelength Image Data For Photometric Classification Of Stars, Galaxies And Qsos, Annika Lindh
Conference papers
Accurate classification of astronomical objects currently relies on spectroscopic data. Acquiring this data is time-consuming and expensive compared to photometric data. Hence, improving the accuracy of photometric classification could lead to far better coverage and faster classification pipelines. This paper investigates the benefit of using unsupervised feature-extraction from multi-wavelength image data for photometric classification of stars, galaxies and QSOs. An unsupervised Deep Belief Network is used, giving the model a higher level of interpretability thanks to its generative nature and layer-wise training. A Random Forest classifier is used to measure the contribution of the novel features compared to a set …