Seminar by Douglas Eck on Magenta
Seminar by Douglas Eck on Magenta
Douglas Eck, from Google Brain, gives a talk about "Generative Models of Drawing and Sound" on Thursday, June 15th 2017, at 12:30 in room 55.410.
Abstract: I'll give an overview talk about Magenta, a project investigating music and art generation using deep learning and reinforcement learning. I'll discuss some of the goals of Magenta and how it fits into the general trend of AI moving into our daily lives. I'll talk about two specific recent projects. First I'll discuss our research on Teaching Machines to Draw with SketchRNN, a LSTM recurrent neural network able to construct stroke-based drawings of common objects. SketchRNN is trained on thousands of crude human-drawn images representing hundreds of classes. Second I'll talk about NSynth, a deep neural network that learns to make new musical instruments via a WaveNet-style temporal autoencoder. Trained on hundreds of thousands of musical notes, the model learns to generalize in the space of musical timbres, allowing musicians to explore new sonic spaces such as sounds that exist somewhere between a bass guitar and a flute. This will be a high-level overview talk with no need for prior knowledge of machine learning models such as LSTM or WaveNet.