October 9, 2019

166 words 1 min read

paraschopra/one-network-many-uses

paraschopra/one-network-many-uses

Four-in-one deep network: image search, image captioning, similar words and similar images using a singlemodel

repo name paraschopra/one-network-many-uses
repo link https://github.com/paraschopra/one-network-many-uses
homepage https://towardsdatascience.com/one-neural-network-many-uses-build-image-search-image-captioning-similar-words-and-similar-1e22080ce73d
language Jupyter Notebook
size (curr.) 159549 kB
stars (curr.) 128
created 2019-02-27
license

One neural network, many uses

Jupyter notebook corresponding to tutorial: One neural network network, many uses: image captioning, image search, similar images and similar words using one model

Requires following packages:

  • PyTorch
  • Numpy
  • Matplotlib

Dataset NOT included (please download separately)

To follow along, you’ll need to download the Flickr8K dataset. Fill this form and you’ll receive a download link on your email. (There’s also a direct link to download the 1GB Flickr8K dataset, though not sure how long it’ll stay like that). Extract the zip file in the ‘Flicker8k_Dataset’ folder in the same directory as your notebook. You’ll also need to download captions from here. Extract captions in the folder ‘caption_datasets’.

Example performance

Image caption example:

art 1

Similar words example

art 2

Similar images example

asrt 3

Image search example

search example

search example

Made by @paraschopra

MIT License.

comments powered by Disqus