pfi final presentation

24
イイイイイイイイイ イイイイ

Upload: kenta-oono

Post on 19-Jun-2015

2.480 views

Category:

Documents


2 download

DESCRIPTION

final presentation on the Intern in PFI date : on 2010/09/30 author Kenta OONO

TRANSCRIPT

  • 1.

2.

1twitter
2twitter
3.

2




Basic,C
VHDL
Haskell
4.
5.

1twitter
2twitter
6. 1:twitter





7.
RT
RT(RTQT)

8. :
mnAA=UV*
Um
mn

V
permutation
Web DB Press vol.49
- ()
9. :
(Rank1000)


10.
crawling
log file
Query
Using Message Pack RPC
11. Extractor -> logtter
DOT
DOT
MessagePackRPC

12. (ex.)
13.
14.
Gather+StreamerTwitterlogtter
15.
=diag(s1, s2,, sn)
(s1s2sn)

=diag(s1, s2,, sm,0,0)

M=UV*
rank mM
16.

1twitter
2twitter
17. 2twitter

2


18.
(1)
(2) extractor
(3) logtter
crawling
JSON files
Send DOT files
by Message Pack RPC
19.
20.
(D)


DC,Ave(C - Ave)/Ave
Ave0
21.
K := {k1,k2,,kn}:
D := {,d1,d2,d3,}:
T := {t1,t2,,tm} :
PK : T -> 2K,PD: T -> 2D
Ki := {tT | PK(t)ki} ,Dj:= {tT | PD(t)dj}
T = i=1,,nKi = j=,1,2,Dj
c : K D -> N
c(ki,dj):={tT | tKiDj}
b : K D -> R0
b(ki,dj):= (c(ki,dj) - p=0,,Mc(ki,dj-p)/M)/c(ki,dj)
(if c(ki,dj) N)
0 (otherwise)
Where N,M are some constants
22.
9272918:00~19:00
30/hour

40
2/hour
23. 929
24.
25.

Bursty and Hierarchical Structure in Streams [J. Kleinberg 02]
1
1

JSON
Bot
screen name
26.
Bursty and Hierarchical Structure in Streams [J. Kleinberg 02]

27. Concept (1/2)
emission at rate
||
=t
e-
from [J. Kleinberg 02]
28. Concept (2/2)







Automaton

Keyword
29. 2