sketch2frog - Generating Frogs from Simple Sketches

Example results on hand drawn frogs. Stripes and markings are meaningfully translated and there is diversity in frog colour.

[Learn more] [Try it out]

---

sketch2frog transforms hand drawn sketches to colour images of frogs, inspired by edges2cats and other applications. A dataset of sketch-like images is generated using U2Net and DexiNed, these frog image-sketch pairs are used to train a pix2pix model.

pix2pix is a Conditional GAN for image-to-image translation with paired datasets. This project contains a build of pix2pix in TensorFlow 2 and combines ideas from several implementations, listed in the resources below.

Dataset

This dataset created by Jon Shamir contains 7796 preprocessed 224x224 frog images, mostly on white backgrounds.

Resources

1. Image-to-Image Translation with Conditional Adversarial Networks (pix2pix paper)
2. pix2pix: Image-to-image translation with a conditional GAN - TensorFlow Tutorials
3. How to Develop a Pix2Pix GAN for Image-to-Image Translation - Jason Brownlee
4. Modern implementation of a GAN in Keras - François Chollet
5. How to Train a GAN? Tips and tricks to make GANs work - Soumith Chintala