Sketching and Guessing with Keras

By Max Candocia

|

July 14, 2017


Last Updated 10/09/2017

I have updated the algorithm for classification. It should be much more accurate than before.

Draw something and have the computer guess what it is. Check out the Facebook mcCanvasDrawings page for some images and collages that have been submitted.

Here are the possible predictions:


Animals
Bee
Bird
Butterfly
Cat
Dog
Fish
Horse
Turtle
Shapes
Circle
Cube
Heart
Rectangle
Spiral
Square
Star
Triangle
Plants
Banana
Flower
Mushroom*
Pineapple
Pumpkin
Tree
Flags
American Flag
British Flag
Canadian Flag
Chilean Flag
Chinese Flag
Cuban Flag
French Flag
German Flag
Indian Flag
Israeli Flag
Jamaican Flag
Japanese Flag
Laotian Flag
Mexican Flag
Nigerian Flag
Puerto Rican Flag
Russian Flag
South Korean Flag
Swedish Flag
Tanzanian Flag
Ukrainian Flag
Miscellaneous
Car
Dragon
Ghost
Rainbow
Smiley Face
Snowman
Trebuchet
Characters
Elf
Fairy
Ninja
Pirate
Santa Claus
Witch
Wizard

* Yes, I know mushrooms are technically fungi

Instructions

You can draw on the canvas while left-clicking with your mouse. The color will be the one from the palette to the upper-left of the canvas. You can erase everything by clicking on the "Everything Eraser" and clicking on the canvas. You can switch to eraser mode by clicking on "Eraser" and treating it like you are drawing. You can switch back to normal drawing mode by clicking on "Marker". You can also download your picture in another window by clicking "download" so you can print it out and hang it on your refrigerator. It won't close your current window.

You may also toggle the background color to change the brightness by clicking on "Toggle Background". There are 17 different shades it cycles through. The background does not affect the image submitted/downloaded, but it may be easier for you to draw something like a snowman if the background is darker.

If you want to submit your drawing, click "Submit Image", and it will be sent to the server. For security reasons, you will not be able to access the images once they are sent to the server and you leave the page. When you submit the image, you grant me (non-exclusive) permission to use, modify, and distribute the image.

The palette chooser was made with Spectrum JS, and the canvas drawing was made with sketch.js. I may change the drawing library in the future to have some more sophisticated features.

Brush Size: 5

What is this a picture of? (required)

What is this image, specifically? (optional)

What does the computer think this is?  

RankGuessProbability
1
2
3
4
5

Tags: 

Recommended Articles

Visualizing My Runs in 2017

A visualization of my running from 2017 using ggplot2.

Sketching and Guessing

Draw a picture and see if the computer can guess it. You can also submit images for the algorithm to develop more possible results.