paraschopra/one-network-many-uses
Four-in-one deep network: image search, image captioning, similar words and similar images using a singlemodel
repo name | paraschopra/one-network-many-uses |
repo link | https://github.com/paraschopra/one-network-many-uses |
homepage | https://towardsdatascience.com/one-neural-network-many-uses-build-image-search-image-captioning-similar-words-and-similar-1e22080ce73d |
language | Jupyter Notebook |
size (curr.) | 159549 kB |
stars (curr.) | 128 |
created | 2019-02-27 |
license | |
One neural network, many uses
Jupyter notebook corresponding to tutorial: One neural network network, many uses: image captioning, image search, similar images and similar words using one model
Requires following packages:
- PyTorch
- Numpy
- Matplotlib
Dataset NOT included (please download separately)
To follow along, you’ll need to download the Flickr8K dataset. Fill this form and you’ll receive a download link on your email. (There’s also a direct link to download the 1GB Flickr8K dataset, though not sure how long it’ll stay like that). Extract the zip file in the ‘Flicker8k_Dataset’ folder in the same directory as your notebook. You’ll also need to download captions from here. Extract captions in the folder ‘caption_datasets’.
Example performance
Image caption example:
Similar words example
Similar images example
Image search example
Made by @paraschopra
MIT License.