[cedec2016] 大規模学習を用いたcgの最先端研究の紹介 - 前半
TRANSCRIPT
Research
PG-Short 2016EG-Short 2016 医療情報学 2014 ACM Trans. Graph. 2014
ACM/EG SCA 2012 ACM/EG SCA 2013 ACM Trans. Graph. 2015 ACM UIST 2014 ACM CHI 2016
PG 2016
On-Going
PG 2016
PG-Short 2016EG-Short 2016 医療情報学 2014 ACM Trans. Graph. 2014
ACM/EG SCA 2012 ACM/EG SCA 2013 ACM Trans. Graph. 2015 ACM UIST 2014 ACM CHI 2016 On-GoingACM/EG SCA 2012 ACM/EG SCA 2013
PG 2016
PG-Short 2016EG-Short 2016 医療情報学 2014 ACM Trans. Graph. 2014
ACM/EG SCA 2012 ACM/EG SCA 2013 ACM Trans. Graph. 2015 ACM UIST 2014 ACM CHI 2016 On-Going
EG-Short 2016 医療情報学 2014
PG 2016
PG-Short 2016EG-Short 2016 医療情報学 2014 ACM Trans. Graph. 2014
ACM/EG SCA 2012 ACM/EG SCA 2013 ACM Trans. Graph. 2015 ACM UIST 2014 ACM CHI 2016 On-Going
ACM Trans. Graph. 2014
ACM Trans. Graph. 2015
PG 2016
PG 2016
PG-Short 2016EG-Short 2016 医療情報学 2014 ACM Trans. Graph. 2014
ACM/EG SCA 2012 ACM/EG SCA 2013 ACM Trans. Graph. 2015 ACM UIST 2014 ACM CHI 2016 On-GoingACM UIST 2014 ACM CHI 2016 On-Going
PG-Short 2016
PG-Short 2016EG-Short 2016 医療情報学 2014 ACM Trans. Graph. 2014
ACM/EG SCA 2012 ACM/EG SCA 2013 ACM Trans. Graph. 2015 ACM UIST 2014 ACM CHI 2016
PG 2016
On-Going
Real-Time Example-Based Elastic Deformation Y. Koyama, K. Takayama, N. Umetani, and T. Igarashi SCA 2012
Interactive Deformation of Heart Models from Medical Images K. Nakashima, Y. Koyama, T. Igarashi, T. Ijiri, S. Inada, K. Nakazawa Eurographics 2016 Short Papers
0
100
200
300
400
500
600
700
800
2005 2006 2007 2008 2009 2010 2011 2012 2013 2014 2015 2016
Body Talk: Crowdshaping Realistic 3D Avatars with Words S. Streuber, Q. Ramirez, M. Hill, C. Hahn, S. Zuffi, A. O'Toole, M. Black SIGGRAPH 2016
AttribIt: Content Creation with Semantic Attributes S. Chaudhuri, E. Kalogerakis, S. Giguere, and T. Funkhouser UIST 2013
「もっと怖く」「もっと強そうに」などの 言葉にもとづいた三次元モデリングが可能
Semantic Shape Editing Using Deformation Handles M. E. Yumer, S. Chaudhuri, J. K. Hodgins, and L. B. Kara SIGGRAPH 2015
言葉に基づくスライダによる形状編集
異なるトポロジでも適用可能
A Similarity Measure for Illustration Style E. Garces, A. Agarwala, D. Gutierrez, and A. Hertzmann SIGGRAPH 2014
スタイルを考慮した画像検索
Style Compatibility for 3D Furniture Models T. Liu, A. Hertzmann, W. Li, T. Funkhouser SIGGRAPH 2015
応用:スタイルの親和性を考慮した三次元モデル検索
Crowd-Powered Parameter Analysis for Visual Design Exploration Y. Koyama, D. Sakamoto, and T. Igarashi UIST 2014
Mirror Mirror: Crowdsourcing Better Portraits J.-Y. Zhu, A. Agarwala, A. A. Efros, E. Shechtman, and J. Wang SIGGRAPH Asia 2014
Body Talk: Crowdshaping Realistic 3D Avatars with Words S. Streuber, Q. Ramirez, M. Hill, C. Hahn, S. Zuffi, A. O'Toole, M. Black SIGGRAPH 2016
AttribIt: Content Creation with Semantic Attributes S. Chaudhuri, E. Kalogerakis, S. Giguere, and T. Funkhouser UIST 2013
Semantic Shape Editing Using Deformation Handles M. E. Yumer, S. Chaudhuri, J. K. Hodgins, and L. B. Kara SIGGRAPH 2015
A Similarity Measure for Illustration Style E. Garces, A. Agarwala, D. Gutierrez, and A. Hertzmann SIGGRAPH 2014
Style Compatibility for 3D Furniture Models T. Liu, A. Hertzmann, W. Li, T. Funkhouser SIGGRAPH 2015
Crowd-Powered Parameter Analysis for Visual Design Exploration Y. Koyama, D. Sakamoto, and T. Igarashi UIST 2014
Mirror Mirror: Crowdsourcing Better Portraits J.-Y. Zhu, A. Agarwala, A. A. Efros, E. Shechtman, and J. Wang SIGGRAPH Asia 2014
Body Talk: Crowdshaping Realistic 3D Avatars with Words S. Streuber, Q. Ramirez, M. Hill, C. Hahn, S. Zuffi, A. O'Toole, M. Black SIGGRAPH 2016
AttribIt: Content Creation with Semantic Attributes S. Chaudhuri, E. Kalogerakis, S. Giguere, and T. Funkhouser UIST 2013
Semantic Shape Editing Using Deformation Handles M. E. Yumer, S. Chaudhuri, J. K. Hodgins, and L. B. Kara SIGGRAPH 2015
A Similarity Measure for Illustration Style E. Garces, A. Agarwala, D. Gutierrez, and A. Hertzmann SIGGRAPH 2014
Style Compatibility for 3D Furniture Models T. Liu, A. Hertzmann, W. Li, T. Funkhouser SIGGRAPH 2015
Crowd-Powered Parameter Analysis for Visual Design Exploration Y. Koyama, D. Sakamoto, and T. Igarashi UIST 2014
Mirror Mirror: Crowdsourcing Better Portraits J.-Y. Zhu, A. Agarwala, A. A. Efros, E. Shechtman, and J. Wang SIGGRAPH Asia 2014
言葉や描写とデザイン要素の関係性を学習
Body Talk: Crowdshaping Realistic 3D Avatars with Words S. Streuber, Q. Ramirez, M. Hill, C. Hahn, S. Zuffi, A. O'Toole, M. Black SIGGRAPH 2016
AttribIt: Content Creation with Semantic Attributes S. Chaudhuri, E. Kalogerakis, S. Giguere, and T. Funkhouser UIST 2013
Semantic Shape Editing Using Deformation Handles M. E. Yumer, S. Chaudhuri, J. K. Hodgins, and L. B. Kara SIGGRAPH 2015
A Similarity Measure for Illustration Style E. Garces, A. Agarwala, D. Gutierrez, and A. Hertzmann SIGGRAPH 2014
Style Compatibility for 3D Furniture Models T. Liu, A. Hertzmann, W. Li, T. Funkhouser SIGGRAPH 2015
Crowd-Powered Parameter Analysis for Visual Design Exploration Y. Koyama, D. Sakamoto, and T. Igarashi UIST 2014
Mirror Mirror: Crowdsourcing Better Portraits J.-Y. Zhu, A. Agarwala, A. A. Efros, E. Shechtman, and J. Wang SIGGRAPH Asia 2014
言葉や描写とデザイン要素の関係性を学習
デザイン要素間の認知的な距離を学習
Body Talk: Crowdshaping Realistic 3D Avatars with Words S. Streuber, Q. Ramirez, M. Hill, C. Hahn, S. Zuffi, A. O'Toole, M. Black SIGGRAPH 2016
AttribIt: Content Creation with Semantic Attributes S. Chaudhuri, E. Kalogerakis, S. Giguere, and T. Funkhouser UIST 2013
Semantic Shape Editing Using Deformation Handles M. E. Yumer, S. Chaudhuri, J. K. Hodgins, and L. B. Kara SIGGRAPH 2015
A Similarity Measure for Illustration Style E. Garces, A. Agarwala, D. Gutierrez, and A. Hertzmann SIGGRAPH 2014
Style Compatibility for 3D Furniture Models T. Liu, A. Hertzmann, W. Li, T. Funkhouser SIGGRAPH 2015
Crowd-Powered Parameter Analysis for Visual Design Exploration Y. Koyama, D. Sakamoto, and T. Igarashi UIST 2014
Mirror Mirror: Crowdsourcing Better Portraits J.-Y. Zhu, A. Agarwala, A. A. Efros, E. Shechtman, and J. Wang SIGGRAPH Asia 2014
言葉や描写とデザイン要素の関係性を学習
デザイン要素間の認知的な距離を学習
デザイン要素の美的評価基準を学習
(x) =
1
1 + exp(x)
-3 -2 -1 0 1 2 3
0.5
1
(x)
(x) =
1
1 + exp(x)
-3 -2 -1 0 1 2 3
0.5
1
(x)
f( ) = 0.13
f( ) = 0.96
f( ) = 0.53
f( ) = 0.13
f( ) = 0.96
f( ) = 0.53
f
f(x) = w
Tx
x f
f(x) = w
Tx
x f
f w,
i Ai Bi
i Ai Bi
A5 B5
i Ai Bi
i Ai Bi
f(x
iA) > f(x
iB) f
i Ai Bi
f(x
iA) > f(x
iB) f
(f(x
iA) f(x
iB)
)f
i Ai Bi
max
w
X
i2D
�f(x
iA) f(x
iB)
�f
f(x
iA) > f(x
iB) f
(f(x
iA) f(x
iB)
)f
p(choose A over B) = (f(xA) f(xB))
arg max
w{p(w|D)} = arg max
w{p(D|w)p(w)}
= arg max
w{log p(D|w) + log p(w)}
= arg max
w
(X
i2Dlog σ(f(x
iA)− f(x
iB))− λkwk1
)
p(choose A over B) = (f(xA) f(xB))
arg max
w{p(w|D)} = arg max
w{p(D|w)p(w)}
= arg max
w{log p(D|w) + log p(w)}
= arg max
w
(X
i2Dlog σ(f(x
iA)− f(x
iB))− λkwk1
)
p(choose A over B) = (f(xA) f(xB))
arg max
w{p(w|D)} = arg max
w{p(D|w)p(w)}
= arg max
w{log p(D|w) + log p(w)}
= arg max
w
(X
i2Dlog σ(f(x
iA)− f(x
iB))− λkwk1
)
p(choose A over B) = (f(xA) f(xB))
arg max
w{p(w|D)} = arg max
w{p(D|w)p(w)}
= arg max
w{log p(D|w) + log p(w)}
= arg max
w
(X
i2Dlog σ(f(x
iA)− f(x
iB))− λkwk1
)
p(choose A over B) = (f(xA) f(xB))
arg max
w{p(w|D)} = arg max
w{p(D|w)p(w)}
= arg max
w{log p(D|w) + log p(w)}
= arg max
w
(X
i2Dlog σ(f(x
iA)− f(x
iB))− λkwk1
)
p(choose A over B) = (f(xA) f(xB))
arg max
w{p(w|D)} = arg max
w{p(D|w)p(w)}
= arg max
w{log p(D|w) + log p(w)}
= arg max
w
(X
i2Dlog σ(f(x
iA)− f(x
iB))− λkwk1
)
p(choose A over B) = (f(xA) f(xB))
arg max
w{p(w|D)} = arg max
w{p(D|w)p(w)}
= arg max
w{log p(D|w) + log p(w)}
= arg max
w
(X
i2Dlog σ(f(x
iA)− f(x
iB))− λkwk1
)
p(choose A over B) = (f(xA) f(xB))
arg max
w{p(w|D)} = arg max
w{p(D|w)p(w)}
= arg max
w{log p(D|w) + log p(w)}
= arg max
w
(X
i2Dlog σ(f(x
iA)− f(x
iB))− λkwk1
)
p(choose A over B) = (f(xA) f(xB))