03 0122 1000 3 storytelling

Download 03 0122 1000 3 Storytelling

Post on 06-May-2015

1.392 views

Category:

Entertainment & Humor

0 download

Embed Size (px)

TRANSCRIPT

  • 1.Automatic Storytelling inComics Sheng-Wei (Kuan-Ta) Chen Inst. of Information Science Academia Sinica

2. Intrinsic Needs of Human Being!

  • Communication
  • Storytelling
    • Todays world is information-saturated
    • Computers are becoming a larger and larger part ofpeoples lives (Intel 2005)
    • More and more people are documenting their liveswith digital images, video, music, and recordings(Imation 2003)
    • As storage space gets cheaper, and people record moreand more and more, they need some way to automatethe categorization of all of these digital memories

3.

  • Recall ,shareandpreserve(gaming)experience
    • Virtual communitysuch as forums, blogs
    • Video, screenshots, comicsor other art formats
    • Narrative , summary, story
  • Search Lineage Story or LineageComics
    • Around 26,600 files in YouTube and 724,000 items in Google
    • http://www.lineage2.com/community/fanart.html
    • http://himewikia.blogspot.com/

4.

  • Example:

5.

  • Example:

6. Examples 7. More examples 8. Narrative

  • In short,People Like Stories .Or, put more accurately,PeopleRemember Stories
  • So we provide a summarization tool to aid storytelling of end-users
  • But why Comics

9. Comic

  • A storytelling medium
  • Vocabulary of comics
    • Panel layout
      • Border shape
      • Panel size
      • Bleed, splash page
    • Speech balloon and sound effects
    • Motion lines
  • Visual language
    • Draw attention to important events
  • Reference:http://scottmccloud.com/2-print/index.html(McCloud, Scott)

10. Comic Generation Tools

  • Automation support
    • The computer is charged with a greater rolein the creation of the comic
  • Authoring support
    • Tools offer the most agency in creating panelsand layouts of any size and shape
  • Reference:http://dm.lcc.gatech.edu/~jalderman/comics/

11.

  • Comic Chat (1996)
  • Comic Chat visually represents
  • conversationsas sequences of
  • comicpanels.
  • Automation support:
  • Changing posture and facial expression of users avatars in chat room
  • Placing word balloons in naturalreading order
  • Zooming camera to frame the people talking
  • Parsing text into panels procedurally.
  • Panels are all in the same size
  • Reference: http://kurlander.net/DJ/Projects/ComicChat/resources.html

12.

  • Microsoft Chat 2.5

Chat room: Massage Authoring support: Emotion Wheel allows users tochoose the facialexpression andbody language Comic mode 13.

  • Microsoft Chat Character Editor
  • Character Icon
  • Character Contents
  • New Pose
  • New Pose

14.

  • Example:

15.

  • Video Manga (1999-2003)
  • It provides asummaryofvideo clips
  • that allows users to quickly browse a long
  • video incomic book format .
  • Mangais named after a Japanese word for "comic book"
  • A video is represented withdifferent-sized keyframesthat packed in a comic book format
  • Video Manga allows users to quickly browse a long video
  • The visual summaries support printing function
  • Reference:
  • http://www.fxpal.com/?p=manga

16.

  • Automation support:
  • A video is segmented based on thecolor featuresof each frame
  • The segments are clustered according to theirsimilarities
  • We have introduced animportance scoreto rank the segments
  • A segment is considered to be important if it is long and rare
  • The keyframes are extracted fromhighly ranked segments
  • The keyframes aresize d according to their scores
  • The frame-packing algorithm puts the keyframes in a comic book format
  • Authoring support:
  • Handling captions to its frames manually typed in by users

17.

  • Video Manga : Summary of staff meeting

18.

  • Generating Comics From
  • 3D Interactive Computer
  • Graphics(2006)
  • Automation support:
  • Recognizing scenes
  • Converting to visual depiction
  • Comic layout
  • Image processing
  • Reference: http://ieeexplore.ieee.org/xpl/freeabs_all.jsp?arnumber=1626186

19.

  • Recognizing scenes
    • Time and space
    • Separating scenes when
      • The interaction level is low
      • The location changes
  • Converting to visual depiction
    • Transforming each sceneinto a sequence of images depictingthe main event
    • Using idioms to depict interactions
      • Change of scene
      • Shooting
      • conversation
  • Automation support

20.

  • Comic layout
    • B (Big):peak interaction images andchange-of-scene
    • S (small):action-to-action pair orFP viewpoint shots
    • F (fixed):images with speech balloon
    • N (neutral):all others
  • Image processing
    • Mean shift
    • Laplacian
    • K-means

21.

  • Example:

22.

  • Comic Life(2005)
  • Application for creating comics:
  • loading images into comic panels
  • Authoring support:
  • Simple and Easy-to-useinterface
    • Drag in your pictures, captions, sound effects (ka-blam!') andspeech balloons and its done!
    • Layout templates
    • Filters like hand-drawn, paintedand night vision
  • More freedom to create comic butstill some restrictions
  • Reference:
  • http://plasq.com/comiclife-win

23.

  • Comic Life1.3

24.

  • Example:

25.

  • Manga Studio
  • Applicationfor creating comics:
  • drawing, laying out comic and
  • styling comics
  • Authoring support:
  • High versatility and flexibilityto create comics
    • A large collection of special effects
    • Sketch, ink, and color artworks without the need for any other graphics applications
  • Interface similar to Photoshop
  • Reference: http://my.smithmicro.com/mac/manga/index.html

26. Our Proposal

  • Automation support
    • Frame selection
    • Layout computing
  • Authoring support
    • Comic layout
    • Graphic Effects
    • Internet support
  • User interface

27.

  • Comic Gene (2009)
  • It automatically summarize players
  • interactions ( logs and screenshots )
  • in virtual world intocomics .
  • Automation support:
  • Recording log and shots (Addon)
  • Frame selection
  • Comic layout computing
  • Rendering comics
  • Authoring support:
  • Editing log files and screenshots
  • Comic layout
    • Option setting
    • Changing size and position of the shots
  • Reference: http://mmnet.iis.sinica.edu.tw/publication_detail.html?key=chan09_comics

28. How to improve!

  • Prototype

29. 1. Automation Support

  • Automatically summarize logs and frames into comics
    • Log: events
    • Frame: video, photos, screenshot sand so on