「lstm&titanで音楽を作った」第12回カジュアルトーク会向け 20160207

Download 「Lstm&titanで音楽を作った」第12回カジュアルトーク会向け 20160207

If you can't read please download the document

Post on 15-Apr-2017

838 views

Category:

Technology

0 download

Embed Size (px)

TRANSCRIPT

PowerPoint

DeepLearningTitanLSTM201627

12

+

1

AIDeepLearning

+

AIDeepLearning2

NvidiaTITANPC

+

TitanPC3

NvidiaTITANPC

+

MIDI4

TITANDeepLearning

DeepLearningTitan & LSTMDeepLearning

+

5

Andrej Karpathy blog

LSTMDouglas Eck, Jurgen Schmidhuber, 2007A First Look at Music Composition using LSTM Recurrent Neural NetworksRNN(Kratarth Goel, Raunaq Vohra, J.K. Sahoo,2014)Polyphonic Music Generation by Modeling Temporal Dependencies Using a RNN-DBN

LSTMRNN

+

A First Look at Music Composition using LSTM Recurrent Neural Networkshttp://people.idsia.ch/~juergen/blues/IDSIA-07-02.pdfhttp://arxiv.org/pdf/1412.7927.pdf

6

LSTMLong Short Term Memory)1995RNNRecurrent Neural Network)

RNN

Andrew Karpath Blog ( http://karpathy.github.io/2015/05/21/rnn-effectiveness/)

NNRNN

+

7

LSTMABC

MIDI

ABC

+

ABC

Karpathychar-rnn (https://github.com/karpathy/char-rnn)

MIDIABCLSTMMIDI

+

9

ABCABChttp://abcnotation.com/

ABC

X:1T:sooranbushiM:2/4L:1/8K:FFC2 DF | A2 GF | A2 GF | G2 FC | D2 FC | D2 D2 | z2 z2 ||zG AA | GA AA | GA AA | GF D2 | zA, CA, | CD GF | zG AF | DC FD | D z CC |DF A2| A3 c | G F2 C | D2 D2 | D2 z2||

DCEFG

+

http://abcnotation.com/tuneshttp://www.ece.wisc.edu/~cobb/irish/Tunebook.html

10

ABC

+

LSTMRnn_size128Num_layersLearning_date2e-3)Dropout0Seq_length50Train_frac0.95Val_frac0.05Grad_clip5GpuidGPUCPU

prime_text Temparature1: 0.8

+

cmd:text()cmd:text('Train a character-level language model')cmd:text()cmd:text('Options')-- datacmd:option('-data_dir','data/tinyshakespeare','data directory. Should contain the file input.txt with input data')-- model paramscmd:option('-rnn_size', 128, 'size of LSTM internal state')cmd:option('-num_layers', 2, 'number of layers in the LSTM')cmd:option('-model', 'lstm', 'lstm,gru or rnn')-- optimizationcmd:option('-learning_rate',2e-3,'learning rate')cmd:option('-learning_rate_decay',0.97,'learning rate decay')cmd:option('-learning_rate_decay_after',10,'in number of epochs, when to start decaying the learning rate')cmd:option('-decay_rate',0.95,'decay rate for rmsprop')cmd:option('-dropout',0,'dropout for regularization, used after each RNN hidden layer. 0 = no dropout')cmd:option('-seq_length',50,'number of timesteps to unroll for')cmd:option('-batch_size',50,'number of sequences to train on in parallel')cmd:option('-max_epochs',50,'number of full passes through the training data')cmd:option('-grad_clip',5,'clip gradients at this value')cmd:option('-train_frac',0.95,'fraction of data that goes into train set')cmd:option('-val_frac',0.05,'fraction of data that goes into validation set')-- test_frac will be computed as (1 - train_frac - val_frac)cmd:option('-init_from', '', 'initialize network parameters from checkpoint at this path')-- bookkeepingcmd:option('-seed',123,'torch manual random number generator seed')cmd:option('-print_every',1,'how many steps/minibatches between printing out the loss')cmd:option('-eval_val_every',1000,'every how many iterations should we evaluate on validation data?')cmd:option('-checkpoint_dir', 'cv', 'output directory where checkpoints get written')cmd:option('-savefile','lstm','filename to autosave the checkpont to. Will be inside checkpoint_dir/')cmd:option('-accurate_gpu_timing',0,'set this flag to 1 to get precise timings when using GPU. Might make code bit slower but reports accurate timings.')-- GPU/CPUcmd:option('-gpuid',0,'which gpu to use. -1 = use CPU')cmd:option('-opencl',0,'use OpenCL (instead of CUDA)')cmd:text()

12

38697KB

X:2T:AlicesZ: id:dc-reel-2M:CL:1/8K:E MinorD|EGBG AGED|E2GE DEB,D|EGBG A2Bd|eBdB AGED|!EGBG AGED|E2GE DEB,D|DB,A,B, DEFA|BFAF FEE:|!K:G MajorF|G2DB, DGBG|A2EC EcBA|G2DB, DGBG|AcBA AGGF|!G2DB, DGBG|A2EC EcBA|G2DB, DGBG|AcBA AGG:|!

X:3T:AndersonsZ: id:dc-reel-3M:CL:1/8K:D MajorB|ABdf efdB|AFF2 EDEF|ABdf efdf|afef d3:|!f|a2fa bafa|a2fd edBd|a2fa bafb|afef defg|!a2fa bafa|a2fd edBd|AFF2 ABdf|afef d3|]!

X:4X

+

X:6K:FiondinZ: id:dc-reel-176M:CL:1/8K:G Majorgf|gBB2 GBB2|dBAG BGEG|BGAB cege|dBAc BGG2|!dBB2 GBAB|GBB2 GEEG|BGED EA,B,|A,B,A, B,A,DE|!DGF2 GFG2|BdeB dBed|e3A B3A|Bdeg fdd:|!e|dBB2 gBAB|G2BG dGBd|gfdB ABGB|AGFA EGED|![2 fgaf gedf|gdBG AGEG|BddB edce|dBcA BGG:|!

X:150T:Hongy Moos of in ConiagZ: id:dc-reel-290M:CL:1/8K:A DorianA2EA cdec|dBGB AEGF|EAcA Bdgf|eaa^g aba=g|!e=fed cAA2|gedc BdcB|AEcE dEcd|ecAG EAA2:|!a2ea c'aea|g2dg bgdg|aged cded|cABG EAA2|!a2ea c'aea|gage dBGB|ABcd eaaf|gedg eAA2:|!

:

+

14

+

340,130KBX: 1T:A and D% Nottingham Music DatabaseS:EFM:4/4K:AM:6/8P:Af|"A"ecc c2f|"A"ecc c2f|"A"ecc c2f|"Bm"BcB "E7"B2f|"A"ecc c2f|"A"ecc c2c/2d/2|"D"efe "E7"dcB| [1"A"Ace a2:| [2"A"Ace ag=g||\K:DP:B"D"f2f Fdd|"D"AFA f2e/2f/2|"G"g2g ecd|"Em"efd "A7"cBA|"D"f^ef dcd|"D"AFA f=ef|"G"gfg "A7"ABc |1"D"d3 d2e:|2"D"d3 d2||

X: 2T:Abacus% Nottingham Music DatabaseS:By Hugh Barwell, via Phil RoweM:6/8K:G"G"g2g B^AB|d2d G3|"Em"GAB "Am"A2A|"D7"ABc "G"BAG|"G"g2g B^AB|d2d G2G|"Em"GAB "Am"A2G|"D7"FGA "G"G3::"D7"A^GA DFA|"G"B^AB G3|"A7"^c=c^c Ace|"D7"fef def|"G"g2g de=f|"E7"e2e Bcd|"Am"c2c "D7"Adc| [1"G"B2A G3:| [2"G"B2A G2F||"Em"E2E G2G|B2B e2e|"Am"c2A "B7"FBA|"Em"G2F E3|"Em"EFG "Am"ABc|"B7"B^c^d "Em"e2e|"F#7"f2f f2e|"B7"^def BAF|"Em"E2E G2G|B2B e2e|"Am"c2A "B7"FBA|"Em"G2F E3|"Em"EFG "Am"ABc|"B7"B^c^d "Em"e2e|"F#7"f2e "B7"^def |[1"Em"e3 "D7"d3:|[2"Em"e3 "E7"e3||

[ ]S

+

X: 54T:Cackiantin's Brce% Nottingham Music DatabaseS:Bob McQuillen Manch 1976, via Phil RoweM:6/8K:D"A7"d3 |"D"f2f Aff|"A7"ecA Ade|"D"f2f fed|"D"d2F B2A|"D"d2e d2d|"G"BAB dBd|"A"e2e edc|"D"d3 -dBA|"D"faf "A7"efe|"D"fgf "A"ecA|"Em"B2G "A"A2:|P:BA|"D"d2f a2f|"G"b2b "D"a2f|"A"e2e ABc|"Bm"B2B "E7"B2d|"A7"cBc ABc|"D"dfe "G"dcB|"D"AFD "A"G2e|"D"faf "A7"e2A|"D"fed Aed|"G"B2d "A"e2c|"Em"Bcd "A7"cBc|"D"d3 -d2||

X: 33T:The Donny Charlberot% Nottingham Music DatabaseS:Pauline Wilson, via Phil RoweM:6/8K:DA|"D"ddf "A7"ecA|"G"BdB "D"AFA|"G"Bcd "A7"efg|"D"fdd d2::A|"D"FAF "G"CEG|"D"FGA "G"BAB|"A"ABc "D"ded|"A7"cdc "A"BAG:"D"FAd fed|"A7"cBA ABc|"D"dfe "G"dcB|"D"ABA FAA|"D"A2A dAG|"G"dBd "A"ecA|"D"d3 d2:|

+

(:;.:ABCABC

+

ABCABC38697kb34340130kb2813810kb1

+

LSTMABC

+

LSTM ( Skype ,Facebook )URL

12/9From:Suzuki

http://tabelog.com/en/tokyo/A13030130303130307Sent on:

12/14From:Suzuki

butt sy ftther autin hacle.Sent on:URL

+

TITANGPUCPU1

CPUGPUCPUGPU1.33220.090314.751.34260.091114.731.55160.070122.13

GPUCPU1520

+

LSTMABCABCTITAN

+

Recommended

View more >