fredhohman/shapeshop
Towards Understanding Deep Learning Representations via Interactive Experimentation
| repo name | fredhohman/shapeshop |
| repo link | https://github.com/fredhohman/shapeshop |
| homepage | |
| language | Python |
| size (curr.) | 1411 kB |
| stars (curr.) | 14 |
| created | 2016-09-21 |
| license | MIT License |
ShapeShop
Towards Understanding Deep Learning Representations via Interactive Experimentation
The Shape Workshop (ShapeShop) is an interactive system for visualizing and understanding what representations a neural network model has learned in images consisting of simple shapes. It encourages model building, experimentation, and comparison to helps users explore the robustness of image classifiers.
Read the paper.
View the poster.
Watch the teaser.
Installation
We suggest creating a new environment to run ShapeShop. If you are using Anaconda, create a new environment called shapeshop by running
conda create --name shapeshop python=3
Switch to this environment by running
source activate shapeshop
Requirements: Python (3.5)
From within the new environment install the following packages with the versions listed below:
numpy==1.11.3
scipy==0.18.1
flask==0.11.1
keras==1.2.0
tensorflow==0.12.1
matplotlib==2.0.0
Pillow==4.1.1
For Keras, use our backend provided in keras.json. Your shapeshop environment’s keras.json backend is located $HOME/.keras/keras.json. See keras.io/backend for more details.
Requirements: JavaScript
D3 4.0 (loaded via web, no installation needed)
jQuery 1.12.4 (loaded via web, no installation needed)
Download or Clone
Once the requirements have been met, simply download or clone the repository.
git clone https://github.com/fredhohman/shapeshop.git
Usage
Running ShapeShop
Run the system by
python server.py
from the shapeshop/ directory and pointing your browser to http://localhost:5000.
Using ShapeShop
To use ShapeShop, follow the enumerated steps.
- Select Training Data: Choose what training data you want include. The number of training images chosen corresponds to how many classes the image classifier contains. You must select at least two (when two are chosen, this corresponds to binary classification)!
- Select Model: Choose which model you want to use. MLP corresponds to a multilayer perceptron and CNN corresponds to a convolutional neural network.
- Select Hyperparameters: Choose what hyperparameters you want for model training and the image generation process.
- Train and Visualize: Click the button to train the model and generate your results!
ShapeShop uses the class activation maximization visualization technique to maximize each class to produce N images, each corresponding to one class. The system then presents all N resulting images, correlation coefficients, and the original class desired to be visualized back to the user for visual inspection and comparison. This process then repeats, where the user can select different images to train on, produce more images from new models, and compare to the previous results.
Citation
ShapeShop: Towards Understanding Deep Learning Representations via Interactive Experimentation.
Fred Hohman, Nathan Hodas, Duen Horng Chau.
Extended Abstracts, ACM Conference on Human Factors in Computing Systems (CHI). May 6-11, 2017. Denver, CO, USA.
Read the paper.
View the poster.
Watch the teaser: ACM, PoloClub.
License
MIT License. See LICENSE.md.
Credits
For questions and support contact Fred Hohman.
