smart not taker

Upload: prabhat-sharma

Post on 14-Apr-2018

353 views

Category:

Documents


18 download

TRANSCRIPT

  • 7/30/2019 Smart Not Taker

    1/27

    1

    1. ABSTRACT

    The Smart Note Taker is such a helpful product that satisfies the needs of the people in

    todays technologic and fast life. This product can be used in many ways. The Smart Note

    Taker provides taking fast and easy notes to people who are busy ones self with something.

    With the help of Smart Note Taker, people will be able to write notes on the air, while being

    busy with their work. The written note will be stored on the memory chip of the pen, and will

    be able to read in digital medium after the job has done. This will save time and facilitate life.

    There will be an additional feature of the product which will monitor the notes, which were

    taken before, on the application program used in the computer. This application program can

    be a word document or an image file. Then, the sensed figures that were drawn onto the air

    will be recognized and by the help of the software program we will write, the desiredcharacter will be printed in the word document. If the application program is a paint related

    program, then the most similar shape will be chosen by the program and then will be printed

    on the screen. Since, JAVA Applet is suitable for both the drawings and strings, all these

    applications can be put together by developing a single JAVA program. The JAVA code that

    we will develop will also be installed on the pen so that the processor inside the pen will type

    and draw the desired shape or text on the display panel.

    Several methods have been proposed to make classroom presentations more accessible to

    students who are legally blind. For example, lectures might be recorded (for later review) or a

    human note-taker might be hired to take notes, which are then provided to the student.

    However, these approaches do not engage students who are legally blind in the process of

    understanding and participating in classroom presentations, and might even encourage them

    to skip class.

    To improve accessibility of classroom lectures for students who are legally blind, and to

    encourage them to take notes, we have developed the Note-Taker. This device requires no

    existing infrastructure or prior setup in a classroom, and does not require the lecturer to adjust

    the presentation. However, it makes classroom presentations accessible to many students who

    are legally blind.

    In developing the Note-Taker, we investigated the usability and the shortcomings of current

    assistive technologies that might be used by students who are legally blind in the classroom

    (Sections 3 and 4). Based on these findings, we prototyped a solution that addressed these

    short comings(Section 5), and conducted two case studies (Section 6). In the first case study,

    the first author (who is himself legally blind) used the Note-Taker for an entire semester; in

  • 7/30/2019 Smart Not Taker

    2/27

    2

    the second case study, another student (who is also legally blind)used a second Note-Taker

    prototype in classes for one month.

    2. INTRODUCTION

    The Smart Note Taker is such a helpful product that satisfies the needs of the people in

    today's technologic and fast life. This product can be used in many ways. The Smart Note

    Taker provides taking fast and easy notes to people who are busy one's self with something.

    With the help of Smart Note Taker, people will be able to write notes on the air, hile being

    busy with their work. The written note will be stored on the memory chip of the pen, and will

    be able to read in digital medium after the job has done. This will save time and facilitate life.

    The Smart Note Taker is good and helpful for blinds that think and rite freely. Another place,

    where our product can play an important role, is where two people talks on the phone. The

    subscribers are apart from each other while their talk and they may want to use figures or

    texts to understand themselves better.

    It's also useful especially for instructors in presentations. The instructors may not want to

    present the lecture in front of the board. The drawn figure can be processed and directly sent

    to the server computer in the room. The server computer then can roadcast the drawn shape

    through network to all of the computers which are present in the room. By this way, the

    lectures are aimed to be more efficient and fun. This product will be simple but powerful. The

    product will be able to sense 3D shapes and motions that user tries to draw. The sensed

    information will be processed and transferred to the memory chip and then will be monitored

    on the Smart Note Taker display device.

    The drawn shape then can be broadcasted to the network or sent to a mobile device. There

    will be an additional feature of the product which will monitor the notes, which were taken

    before, on the application program used in the computer. This application program can be aword document or an image file.

    Then, the sensed figures that were drawn onto the air will be recognized and by the help of

    the software program we will write, the desired character will be printed in the word

    document. If the application program is a paint related program, then the most similar shape

    will be chosen by the program and then will be printed on the screen.

    What is some information on the 'smart note taker'?In:

    Internet, Learning Tips [Edit categories] I went to the "Smart Note Taker" website - it is

    poorly-written, with a lot of typographical errors, and thus is not a professional site. Also,

  • 7/30/2019 Smart Not Taker

    3/27

    3

    the contact address is a gmail address, which is not a reputable business email. I'd say this is

    a case of something that sounds too good to be true - don't waste money on it. It seems to be

    some sort of recording device where you write your notes with a pen onto your laptop

    instead of typing - I can't see how that would be worth the money. My advice is to learn

    how to take notes yourself - see the Related Questions - and then you will be the Smart Note

    Taker! Latest News - October, 2009 There is now a product SIMILAR to this "Smart Note

    Taker" listed on the market with a delivery time of "soon" - it is made by Kawell Industry in

    Hongkong - there are no prices listed, and the MINIMUM order they will accept is for 50

    devices! Here's their information: Mobile Note Taker or Digital Pen Mobile note taker (or

    digital pen)--- portable handwriting capture device using handwriting recognition technology

    to capture your hand writing notes, drawings, sketches anytime, anywhere then upload, file,

    email your handwriting notes, drawings, sketches once connected to computer. An nice

    digital scribe to assist your business, study and daily life. There is also a voice-recording

    product listed from Everway, also in China - they have absolutely no prices listed, but here's

    the information for their product: Being responsible for coordinating meetings and taking

    minutes, your heavy workload can be greatly reduced, and you are assured of complete and

    accurate minutes if you use a high-quality pen recorder.

    We strongly recommend you to take a look at our newly developed ballpoint-pen-shaped

    Pen Recorder which, with a metallic and stylish body and concealed mini buttons, is capable

    of producing professional sound quality. Our Pen Recorder integrates the four functions

    writing, digital recording, MP3 player and USB drive into an ideal recording and

    entertainment device for business people, investigators, secretaries andstudents.

    3. SYSTEM OVERVIEW

    3.1. CONSTRUCTION

    The Smart NoteTaker is such a helpful product that satisfies the needs of the people in today's

    technologic and fast life. This product can be used in many ways. The Smart NoteTake

    provides taking fast and easy notes to people who are busy one's self with something. With

    the help of Smart NoteTaker, people will be able to write notes on the air, while being busy

    with their work. The written note will be stored on the memory chip of the pen, and will be

    able to read in digital medium after the job has done. This will save time and facilitate life.

    The Smart NoteTaker is good and helpful for blinds that think and write freely. Another

    place, where our product can play an important role, is where two people talks on the phone.

  • 7/30/2019 Smart Not Taker

    4/27

    4

    The subscribers are apart from each other while their talk, and they may want to use figures

    or texts to understand themselves better. It's also useful especially for instructors in

    presentations. The instructors may not want to present the lecture in front of the board. The

    drawn figure can be processed and directly sent to the server computer in the room. The

    server computer then can broadcast the drawn shape through network to all of the computers

    which are present in the room. By this way, the lectures are aimed to be more efficient and

    fun. This product will be simple but powerful. The product will be able to sense 3D shapes

    and motions that user tries to draw. The sensed information will be processed and transferred

    to the memory chip and then will be monitored on the display device. The drawn shape then

    can be broadcasted to the network or sent to a mobile device. There will be an additional

    feature of the product which will monitor the notes, which were taken before, on the

    application program used in the computer. This application program can be a word document

    or an image file. Then, the sensed figures that were drawn onto the air will be recognized

    and by the help of the software program we will write, the desired character will be printed

    in the word document. If the application program is a paint related program, then the most

    similar shape will be chosen by the program and then will be printed on the screen. Since,

    JAVA Applet is suitable for both the drawings and strings, all these applications can be put

    together by developing a single JAVA program.

    The JAVA code that we will develop will also be installed on the pen so that the processor

    inside the pen will type and draw the desired shape or text on the display panel.

    3.2.Main features

    Since, JAVA applet is suitable for both the drawings and strings, all these applications can be

    put together by developing a single JAVA applet program. The java code that we will

    develop will also be installed on the pen so that the processor in the pen will and type the able

    to draw desired text on the display panel.

    Applet:

    Applet is a function of java which for example, is a kind of container (file) which contains a

    set of programs made in java. Java is a high level language. It is widely used in making

    various applications Based on java. It is one of the best features of java. The various strings,

    drawings etc will be made using a class file and this file will not be a single file.

    It will be a set of files linked together in a single and then you will be the Smart Note Taker!

    Latest News - October, 2009 There is now a product SIMILAR to this "Smart Note Taker"

  • 7/30/2019 Smart Not Taker

    5/27

    5

    listed on the market with a delivery time of "soon".

    Database:

    The system installed in the pen will consist of a database which will help the processor torecognize various words made visually in the air. Each word written in the air will resemble

    to a word in the database Sipnas COET, Amravati. Smart Note Taker and the word present

    in the database will be printed. This will remain the basic principle of the working of a smart

    note taker.

    Working:

    Smart note taker will be simple but powerful. The product will be able to sense 3D shapes

    and motions that user tries to draw. The sensed information will be processed and transferredto the memory chip and then will be monitored on the display device. The drawn shape then

    can be broadcasted to the network or sent to a mobile device. There will be an additional

    feature of the product that will monitor the notes, which were taken before, on the application

    program used in the computer. This application program can be a word document or an image

    file. Then, the sensed that were drawn into the air will be recognized and with the help of the

    software program software we will write the desired character will be printed in the word

    document. If the application program is a paint related program, then the most similar shape

    will be chosen by the program and then will be printed on screen.

    3.3. INTERIOR STRUCTURE:

    Fig: 3.2 Interior structure of SNT Technology

  • 7/30/2019 Smart Not Taker

    6/27

    6

    4.TECHNICAL DEFINITION OF THE PRODUCT

    In order to meet the technical requirements of the product we need Operating System Like

    Windows or Linux in order to implement software part of the project, Displacement Sensors

    to recognize the displacement of the pen in three dimensions, parallel cable to communicate

    with computer, software to solve the displacement data and finds the individual coordinate

    displacements in three axes and transform the data into text format, analog to digital

    converter to process analos displacement data and convert them into digital format, switch to

    control the pen and Rechargeable battery.

    Operating System

    Software program to convert data into text or string format

    Displacement Sensor Parallel cable

    Analog to digital converter

    Switch

    Rechargeable battery

    4.1.PROBLEM STATEMENT

    The Note-Taker project was born out of necessity when the first author, David, found thattraditional methods of note taking were proving unsuccessful. In his own words,

    Before senior-level math, I aced college by keeping up with note-taking in lectures as best I

    could. For some classes, mostly math, it was necessary that I spent extra time in the textbook

    or reading third-party material, but I always managed to get the grade. Senior-level math was

    like a slap in the face. Quite suddenly I had no way of keeping up with note-taking, but

    needed to. Wed fill the boards up half a dozen times proving lemmas and theorems that

    relied on those lemmas. I routinely got lost in the theorem proofs because in one case, Id opt

    not to take notes (and thus forget the lemma by the time of the theorem) or Id opt to take

    notes, which entailed such a frantic pace that the lecture was essentially useless. In either

    case, I wasnt getting the intuition behind the proofs that the lecture was so importantly

    attempting to provide. Having had all of high school and most of college to tryout the various

    classroom assistive technologies, I knew that nothing off-the-shelf was going to fix my

    problem. Thats when I approached the lab and started bouncing ideas around.

    Through a series of brainstorming exercises, discussions and informal experiments, we found

    that Davids problems stemmed from one primary issue: As he used a monocular to view the

  • 7/30/2019 Smart Not Taker

    7/27

    7

    board at the front of the classroom, there was a delay each time David switched from viewing

    the board to his notes, or from his notes back to the board. These delays stemmed from sitting

    up to see the board and then hunching down to within a few inches from his notes on the

    desktop. David especially lost time when trying to use his monocular to find and return to the

    relevant spot on the chalkboard (or whiteboard) at the front of the classroom. Over time,

    these Board-Note-Board (BNB) delays accumulated to the point that David was unable to

    keep pace with the lecture. Here is how David described the situation:

    Going from notes to the board was the big problem. I would say it was akin to finding

    Waldo while limiting your view to a square inch of the page. What I needed was something

    that allowed me to view the board and my notes near-simultaneously, like a fully-sighted

    student. Then Id stand a chance at keeping up with the lecture.

    A related problem was that Davids monocular ofchoice, the Ocutech , provided only a fixed

    6X zoom. This sometimes proved insufficient in classes where the board was filled multiple

    times, since his professors were writing smaller than he was accustomed to. Particularly when

    David used his Ocutech to try to keep up with notes, he frequently got eyestrain headaches

    that limited his subsequent ability to read sometimes for up to 12 hours after the class.

    Despite a thorough literature survey and product review, we found no solution to be

    satisfactory, so set out to create our own.

    5.RELATED WORK

    It has been shown that active note-taking in class helps students recall information even if

    the notes are not studied subsequently outside of class . It has also been shown that note-

    taking produces a pattern of interaction in which note takers performed better on far-transfer

    tasks, such as problem solving in STEM classes . Note-taking also promotes a deeper level of

    understanding (rather than just more learning overall) due to the assimilative encoding

    process that is engaged .

    5.1.Alternatives to Note-Taking

    One common alternative to active, personal note-taking is university-supplied human note-

    takers. (Availability of such note-taking services is mandated by the Americans with

    Disabilities Act in the United States.) These note-takers are typically another student in the

    class who is paid a stipend ($25 per credit hour at Arizona State University) to provide the

    student who is legally blind with copies of his/her notes. While sometimes helpful, such note-

  • 7/30/2019 Smart Not Taker

    8/27

    8

    taking services do not engage the legally blind student in classroom learning as effectively as

    active, personal note-taking. For instance, David found that notes provided by university-

    supplied human note-takers were often of limited value because he did not create them, and

    they did not reflect his way of thinking. In his own words, David found these notes as

    foreign as a textbookonly less legible.

    5.2. Popular Assistive Devices for People with Low Vision

    The most widely used approach for helping people with low vision (including legal

    blindness) is to provide magnification. Magnifiers can be broadly classified into two

    categories: those that are aimed at improving near sight (for tasks such as reading, writing, or

    manual tasks) and those that are aimed at improving far sight (for tasks such as identifying an

    approaching bus, watching a movie, or simply enjoying scenery).

    Designing a magnification device for improving near sight is relatively simple. Many near

    sight tasks (such as reading and writing) are done while seated, so the size and the weight of

    the magnifier is less critical. It is even practical to use AC power to run a device such as a

    magnifier lamp, as shown in 2(a), or a CCTV magnifier for reading, as shown in 2(b). Even a

    computer can be used to facilitate reading if the document is available in electronic form, and

    if magnification software such as Zoom Text (shown in 2(c)) is used to enlarge the text on the

    display screen.

    However, designing a device for improving far sight can be more difficult. Users typically

    want a device that is portable, lightweight, and (if electronic) that has a battery life long

    enough to last for an entire day. Many people who have low vision, or are legally blind, use

    handheld monocular, as shown in 3(a). These small, highly portable, optical devices typically

  • 7/30/2019 Smart Not Taker

    9/27

    9

    provide a magnification between 4x and 12x. While the higher magnifications are needed by

    some users, they result in smaller fields of view. Most monocular provide afixed

    magnification level, but some allow for adjustment. Costs range from $20 - $300.

    A variant to the handheld monocular is a glasses-mounted monocular, such as the Ocutech

    VES - Mini shown in 3(b). Due to its small size, the monocular in this product provides less

    magnificationusually 4X or 8X. It is often used as a general aid by people with low-vision,

    and it costs about $700.

    Higher technology solutions employ wearable video display systems. The Jordy shown in

    4(a) and the Flipper Port shown in 4(b) (both by Enhanced Vision) are the best known

    examples of these technologies . The Jordy consists of a head-mounted goggle display that

    includes a video camera, while the Flipper Port consists of a head-mounted goggle display

    and a swiveling camera that sits on a desktop. Both of these products provide the user with

    real-time VGA resolution video. Various enhancements and filters can be applied to the video

    stream in real time (allowing for modification of contrast, sharpness, and brightness) and both

    products provide an optical zoom of at least 20X. The Flipper Port can also focus at very

    close distances, which allows it to act as a magnifier for reading text. Costs for either product

    range from $2000 - $3000. The Jordy is simply impractical for classroom note-taking because

    the goggles need to be at least partially removed in order to take notes.

  • 7/30/2019 Smart Not Taker

    10/27

    10

    5.3. Problems with Popular Assistive Devices

    Secondary and post-secondary students who have low vision, or are legally blind, face a

    particular challenge because classroom note-taking requires the student to repeatedly and

    rapidly switch back and forth between far sight tasks (such as viewing the professor, theblackboard, or a PowerPoint slide)and a near sight task (i.e. note-taking).

    The relatively high magnification provided by a hand-held monocular helps alleviate

    eyestrain. However, a simple adaptation to free the hands (such as mounting the monocular

    on a stand that clamps to a table) is unsatisfactory because it still requires the student to

    continually shift positions (i.e. to straighten up to peer through the monocular, and then

    hunch down to take notes).

    The Ocutech frees the hands to take notes, but its small size affords only a small field of

    view. As a result, students may have difficulty quickly re-locating the professor (or the region

    of interest on the chalkboard/whiteboard) after looking down to take notes.

    The Jordy is simply impractical for classroom note-taking because the goggles need to be at

    least partially removed in order to take notes. The Flipper Port (with its desktop swiveling

    camera) could, in principle, be swiveled upward to view the professor, blackboard, or

    PowerPoint, and then downward to view the notes. However, its autofocus feature takes

    much too long, making the transition time even longer than using a monocular.

    In addition, both of these assistive devices have rather ominous-looking head-mounted

    goggles that are rather alienating to all involved. Regardless of how comfortable or

    uncomfortable the goggles are for the user, they prevent eye contact, making it awkward to

    ask questions of the lecturer, or to interact with peers.

    Regardless of which of these four technologies are used during note-taking, students who are

    legally blind must constantly shift back and forth between an upright posture (to view the

    front of the room though the assistive device) and a face-down posture (hovering a few

    inches over the page to view what is being written). These constant movements (and the need

    to re-orient to the front of the room each time) add up to significant BNB delays, preventing

    the students from keeping pace with the lecture.

    5.4.Available Classroom Technologies: Digital Whiteboards and Lecture

    Recording Systems

    Digital whiteboards (sometimes called interactive whiteboards) can be used to automatically

    transfer the writing from the board into an electronic representation. Digital whiteboards are

  • 7/30/2019 Smart Not Taker

    11/27

    11

    often used in business settings (such as conference rooms) where they can be used to

    facilitate teleconferencing. However, digital whiteboards are considerably more expensive

    than standard chalkboards or whiteboards, and their relatively small size means that more

    boards are needed to provide an adequately-sized writing surface in a classroom.

    The Live Board running the Tivoli application was the first proposed digital whiteboard.

    Since its introduction, many other solutions such as have been proposed or introduced, in

    both research and commercial settings. Most of these devices can act as a computer display,

    using either forward or rear-projection; most can be written on with digital ink (using a

    somewhat awkward wireless stylus); and most generate a video output signal representing

    what has been written on them. Some approaches, such as in employ a device that fits onto a

    conventional whiteboard, to add digital whiteboard functionality. While this is a portable

    solution that might seem appropriate for a student who is legally blind, it is impractical in

    most situations because: (1) each device only supports a single board, (2) the device supports

    only boards of a certain (smaller than standard) size, (3) the device takes take time to set up,

    and (4) the set up requires that the student enter the classroom early and attach a device to

    each board before class. Furthermore, accuracy is sometimes less than desired, and the stylus

    that lecturers must use are commonly regarded as awkward.

    Aprs Classroom and Auto Auditorium [offer automatic recording of lectures through the

    use of semi-permanent camera setups. These systems do not summarize a lecture they

    simply record it. While the recordings can be of value, they do not encourage the students to

    actively participate in class, and some would argue that recording lectures may even

    discourage participation and/or class attendance.

    Other systems have also been proposed for recording lectures. The system described in uses

    a consumer camcorder to capture video of overhead presentations, and then summarizes the

    video using key frames. Photo Note is designed to assist students with disabilities

    particularly those with vision or hearing impairments. The Photo Note system requires that

    two camcorders and one still image camera be set up in a classroom prior to the lecture one

    camcorder is aimed at the lecturer and the other is fixed on a sign language interpreter (if

    required). The still camera takes a higher resolution (8 Megapixel) photo every 3 seconds. All

    three streams are synchronized, recorded, and made available for the student to review after

    class. Through the use of image processing operations, the system attempts to extract

    handwriting and text from a chalkboard/whiteboard or from a projected image, and these

    extracted images can also be enhanced for students who have low vision, or are legally blind.

    This Photo Note solution can be used as an alternative to university-supplied human note-

  • 7/30/2019 Smart Not Taker

    12/27

    12

    takers. However, it still does not engage students who are legally blind in active personal

    note-taking, or in active participation during the class lecture.

    6. Design PrinciplesNone of the existing classroom technologies provide students who are legally blind with

    adequate real-time access to classroom lectures. Many of these existing technologies have

    significant overhead, such as prior setup in the classroom, and many of them require the

    lecturer to adapt the presentation, and none of these classroom technologies deal with the

    BNB delays faced by students who are legally blind. Based on our observations, and our

    discussions with David and other legally blind students, we have developed the following

    principles to guide our design of technology to assist students who are legally blind duringnote-taking activities:

    The solution should not rely upon the presence of previously installed equipment inthe classroom.

    The solution should not make students who are legally blind dependent on others(including other students, the lecturer, or a member of the technical staff)

    7.CURRENT PRODUCTS7.1. MOBILE NOTE TAKER

    The Ultimate Handwriting Capture Device Mobile Note Taker is the worlds first portable

    handwriting capture device based on natural handwriting as an input. Attach plain paper of

    any kind and use Pegasus the electronic pen to capture,store and share handwritten drawings,

    sketches, notes, and memos at meetings, lectures, and conferences. Mobile Note Taker has a

    built-in LCD to confirm input. The onboard flash memory can store up to 50 pages (size A4).

    Mobile Note Taker works in two modes: - mobile mode and Connectedmode. In mobile

    mode note taker receiver unit is not connected to a PC via USB cable. In connected mode the

    base unit is connected to a PC through USB cable.

  • 7/30/2019 Smart Not Taker

    13/27

    13

    Fig: 4.1. Mobile Note Taker

    7.2.Features &Benefits:

    Uses standard paper - no special paper required Stores up to 50 A4 pages Includes LCD to

    view and confirm input Operates both in mobile mode and when connected to PC, notebook

    or other device Connects to PC/Notebook via USB cable (included) Includes software for

    synchronization and management of stored files Writes directly into MS Office applications

    (in Connected mode) Allows file transfer over LAN, email, and instant messaging application

    (in connected mode).

    Capture, Organize, and Share Your Notes Digitally-Anywhere, Anytime! Mobile Mode

    Enables capture and storage of notes and sketches digitally at meetings, lectures, and

    conference. Connected mode synchronizes the Mobile Note Taker and a PC/Notebook via

    USB cable (included). You can upload, organize, move, edit or add to handwritten notes,

    ideas, sketches, phone numbers, or reminders. The included software also enables memos,

    notes, and sketches to be sent via e-mail or over the LAN network. It is also possible towrite

    directly into MS Word or Outlook, and add a personal touch to ICQ instant messages.

    Based on Pegasus successful PC Notes Taker, Mobile Note Taker is the ultimate

    handwriting capture device. Even if you dont have standard size paper or piece of paper with

    you - you can use anything - an envelope, an old receipt, a tear-off from a paper bag and best

    of all in your own natural and writing. As long as you have the Mobile Note Taker, you can

    jot down your most inspired ideas and be sure that youll never lose them again.

  • 7/30/2019 Smart Not Taker

    14/27

    14

    7.3. PC NOTE TAKER

    Fig: 4.2. PC Note Taker

    PC Notes Taker is the world's first device that captures natural handwriting on any surface

    onto a PC in real time. Based on a revolutionary electronic pen, PC Notes Taker displays the

    user's handwritten notes, memos or drawings on the computer, and stores the image for future

    use. PC Notes Taker is ideal for markets where handwritten input is essential, such as health,

    educational and financial sectors. Supplied with user-friendly software, PC Notes Taker is

    compatible with PCs and notebooks. Adds Handwriting Input to any Computer PC Notes

    Taker is the world's first device that captures natural handwriting on any surface onto a PC in

    real time. Based on a evolutionary electronic pen, PC Notes Taker displays the user'shandwritten notes, memos or drawings on the computer, and stores the image for future use.

    PC Notes Taker is ideal for markets where handwritten input is essential, such as health,

    educational and financial sectors. Supplied with user-friendly software, PC Notes Taker is

    compatible with PCs and notebooks.

    7.4.Features & Benefits:

    Capture of handwriting from any plain paper or other writing surface Input of continuouswriting up to A4 page size Insert sketches, signatures, equations, and notes into Word

  • 7/30/2019 Smart Not Taker

    15/27

    15

    documents E-mail sketches or handwritten notes in any language using MS OUTLOOK

    Convert handwriting to digital text using MS word recognition engine Annotate, add

    comments, edit and draw in your own handwriting onto MS office documents Create

    instant messaging using ICQNEW.

    7.5. SMART PEN

    The Smart Pen is a device that resembles a fat pen or stylus, but contains a tiny computer and

    a set of sophisticated sensors that record and analyze every motion, and then transmit this

    information to a nearby computer via infrared, radio or direct electric signal .A Smart Pen

    helps a computer to recognize handwritten or drawn input. A computer is treated as 1 level of

    Complexity higher in its ability to recognize the handwriting of anybody who uses a SmartPen. Costs $50, weight is negligible.

    7.6.SOLO PEN:

    This is a progressive development of the Smart Pen : a pen with sufficient processing power

    to recognize handwriting on its own with the equivalent of Complexity 1. It can also be used

    as a Smart Pen. Solo Pen has a long, narrow screen that displays the writing for the user to

    check.The user of a Solo Pen can write on a regular writing surface, as the Solo Pen has anormal writing tip.

    TL8 Solo Pens have trouble with the spatial relationship of writing, so if the user writes three

    lines on paper and then wants to write a heading above the first line, the Solo Pen might put it

    a line higher or lower than desired. The user can also write inthe air, but this requires an IQ

    roll to avoid mistakes. TL8 Solo Pens are great for short notes on the run, not for novel

    writing.

    TL8 Solo Pens can be used in a Virtual Reality environment. The pen continually transmits

    its location to the VR manager, which displays the writing in the virtual environment. The

    data is stored and downloaded to a computer via infrared. A Solo Pen is TL8, costs $100 and

    has negligible weight. It has a rechargeable A Power Cell, but do not bother about energy as

    long as the Pen is placed into its recharging stand (comes with the pen).

  • 7/30/2019 Smart Not Taker

    16/27

    16

    Fig 4.3 Smart Pen

    7.7.SMART QUILL:

    Dubbed Smart Quill, the sleek and stylish prototype pen is different from other electronic

    pens on the market today in that users don't have to write on a special pad in order to record

    what they write. Instead, Smart Quill contains sensors that record movement by using theearth's gravity system, whether you write on paper or in the air. Smart Quill isn't all space

    age, though it contains an ink cartridge so that users can see what they write down on paper.

    "Why should people use a keyboard when they can use a pen?" said John Collins, project

    manager for Smart Quill at BT Labs. Many people have never learned to type quickly and

    accurately, but everyone knows how to write, he pointed out.

    The pen works in conjunction with a regular PC; onto which users install special handwriting

    recognition software developed by BT Labs, Collins said. Users write down notes in their

    regular handwriting and the movements are stored within Smart Quill. Up to 10 pages of

    notes can be stored locally on the pen, Collins said. Once the pen is hooked up to the

    computer, the handwriting recognition software translates the movements into text on-screen.

    Unlike many handwriting recognition programs, the Smart Quill system analyzes movements

    instead of shapes, Collins said. This allowed BT to get rid of the electronic notepad

    associated with most computer pens. Smart Quill contains a few local applications such as an

    address book, daily planner, and calculator. Users can enter information into these

    applications by pushing a button on the pen and writing down what they would like to enter,

  • 7/30/2019 Smart Not Taker

    17/27

    17

    Collins said. There is also a small three-line screen to read the information stored in the pen;

    users can scroll down the screen by tilting the pen slightly, he said.

    One of the major asset is that Smart Quill does not need a screen to work. This is possible

    through revolutionary "Spatial Sensing" system which uses semiconductor accelerometers.

    Accelerometers senses pen/hand movement instead of shapes. It also automatically detects

    left or right handed use.

    8. TECHNOLOGY

    8.1. DISPLAY TECHNOLOGY

    Technology used in SmartNoteTaker for display is Kopin Corps Cyber Display technology.

    Cyber Display is a inch diagonal LCD that uses circuitry built on a silicon wafer, then

    removed and mounted to glass. The displays are integrated to miniature monitors using its

    own backlighting, optics, ICS and packaging.

  • 7/30/2019 Smart Not Taker

    18/27

    18

    8.2.Here are some tips to taking good notes that will help you understand

    your classes better.

    Make your notebook an outline of the material - you can even use the textbook as a guideand write down major topics ahead of time

    Write down anything the teacher puts onto the board. If they think it is important, itprobably will be on a quiz or test.

    Write down anything the teacher says more than once. If they repeat something, they thinkit is important also.

    Write down any words that the teacher explains - give definitions, examples, and anydiagrams or drawings that the teacher uses to explain the terms.

    Ask the teacher to explain again if you do not understand anything, or ask they they write itdown so you can copy it into your notes

    Copy any drawings, diagrams, maps, or images the teacher draws (if it is very complicated,make sure it is in your textbook so you can study it later, or see if the teacher can make you

    a copy)

    You can also record the lecture (ask the teacher if it is OK first) and copy notes after class if you can't

    write quickly enough to keep up. In this case, you should listen carefully to the lecture and see how

    much you can understand before you write the notes.

    9.Organized Note-Taking System

    There are a variety of different systems for taking notes - here's some information on how to

    do each one! Click on the Link at the end for more complete examples of each

    The Charting Method - this is a way of taking notes for a confusing lecture which involves alot of relationships, dialogue, comparisons and other connections between a lot of different

    areas. Make you paper into a set of columns with the main topics to be covered in your

    lecture written at the top of the sheet. As the teacher covers each fact, write it into the

    correct column. This is a good method if you have a lot of information and not a lot of time

    to write, but you have to know what topics are going to be covered ahead of time, so that

    you can make your columns.

  • 7/30/2019 Smart Not Taker

    19/27

    19

    The Cornell Method - this is a way of adding extra information and "clues" to your noteswithout recopying the whole thing. Basically, you just leave a huge blank margin on the left

    or right side of your page, then add cues, hints, and extra information in the blank spaces.

    When you study, you can cover up your notes and just look at the cues in the margin to see

    if you know the material.

    The Outline Method - this is the one I usually recommend; it is a way of showing main factsand how they are related to one another. You can do a formal outline - the kind with

    numbers, letters, etc. - or just use the indented areas to show what goes underneath what

    category. The major points or most important facts will be listed further toward the left-

    hand side of the page. Information which explains these facts, defines terms, or otherwise

    supports the main points will be listed underneath them and indented toward the right. This

    is a good way to make your notebook because all you have to do to study is read each point

    as a question. The only problem with using an outline would be if you have a teacher who

    covers a lot of information very quickly so that it's hard for you to keep up; in that case, use

    another method during their class or ask for a written outline to keep in your notes.

    The Mapping Method - this is a visual method of taking notes, and involves making a map ordiagram showing how all the information is connected. It is a good way to keep up with a

    teacher who covers lots of information, or when you don't know exactly what the lecture

    will be about (such as a guest speaker). Instead of taking detailed notes, you just jot down

    the main points. Then, you draw lines connecting facts or details; show connections with

    arrows; circle important information; or any other visual way you want to remind yourself of

    the lecture and the information you learned. This method works best if you use it as a rough-

    draft, then recopy the information into an outline or list afterword for easier studying.

    The Sentence Method - this is another way of handling a lecture with a lot of information.You just copy down the important information as the teacher speaks, writing each fact on a

    new line - you do not actually have to write complete sentences so long as you get the

    important information down. The best way to use this method is as a rough draft, because

    you have trouble reading through the mass of sentences later on when studying - use this

    method to get the information, then recopy it into an outline so that it makes more sense

    and is easier to study.

  • 7/30/2019 Smart Not Taker

    20/27

    20

    9.2 .HANDWRITING RECOGNITION:

    Accelerometers measure hand movement in 2 or 3 planes

    On board DSP converts to ASCII characters for pen applications

    Write on paper, flat surface, and vertical wall or in air

    Single character recognition on pen

    SmartNoteTaker works by measuring the pen's movements and matching them to the

    movements that produce letters and words programmed into its memory. It's similar to the

    way a microphone detects sound. Consistency of handwriting, rather than neatness, is the

    only condition for accuracy.

    There are 2 techniques used for this purpose :1) Accelerometer technology

    2) Handwriting recognition software

    Accelerometer Technology:

    This technology uses a device called Accelerometer which is used for measuring motion. A

    tiny accelerometer in a pen could be used to detect the stops and starts, arcs and loops of

    handwriting, and transmit this information to a small microprocessor that would make sense

    of it as text. There's also the possibility of viewing a full page of text through a specialmonocular magnified "virtual" screen that could be built into the end of the pen.

    Invisible writing in air is achieved through this unique technology called accelerometer that

    monitors hand movements and can also be used as a virtual hinge to scroll around the small

    screen on the pen and detect left or right- handed use. It records movement by using the

    earth's gravity system, whether you write on paper or in the air. Hence it is independent of

    surface used.

    Movements are stored within the SmartNoteTaker. This information is transmitted on to a

    small microprocessor that would make sense of it as a text displayed on the sleek built in

    screen.

    There are 2 types of accelerometer:

    1. Two Axes Accelerometer: This accelerometer measures acceleration in two axes. An

    Example for Two Axes Accelerometer is ADXL202 Accelerometer.

    2. Three Axes Accelerometer: This accelerometer measures acceleration in three axes. An

    Example for Three Axes Accelerometer is Tronics +/- 2g accelerometer.

  • 7/30/2019 Smart Not Taker

    21/27

    21

    An accelerometer is a device that measures proper acceleration. This is not necessarily the

    same as the coordinate acceleration (change of velocity of the device in space), but is rather

    the type of acceleration associated with the phenomenon of weight experienced by a test mass

    that resides in the frame of reference of the accelerometer device.

    9.3.Prototype of SmartNoteTaker:

    This SmartNote Taker prototype records writing on paper for radio transmission to a pocket

    pc, desktop, cell phone or tablet computer. The accelerometer tracks the angular movement of

    the top of the pen at an angle in the air and these angles plotted as x/y position on pc screen.An early hardware prototype picture shows, left to right, tilt sensor , PIC 8 bit

    microcontroller, batteries, and 433Mhz 1200 Baud radio transmitter. Currently a radio

    receiver on the RS232 port of a pc records the pen movement for analysis via pc. The pen

    will power down after a period of no movement so doesn't need an on/off switch. The battery

    life is approximately 22 hours.

    Handwriting Recognition Software:This software embedded in the microprocessor of the pen is used to recognize handwriting of

    the user. Pen works in conjunction with a regular PC on to which users install special

    handwriting recognition software. The handwriting recognition software translates

    movements in to text on screen.

    Handwriting recognition software constitutes two major phases:

    i) Handwriting transcription

    ii) Handwriting recognitioni)Handwriting Transcription

    In this phase, the recorded acceleration signals are then transcript to its original form. Here

    this aspect is solved using simple double integration method in order to retrace the pen tip

    movement on paper.

    Method:

    -In order for this principle to work properly, we have to solve two main problems:

    -Firstly, we have to know pens spatial orientation in order to withdraw the earth gravity

    component to the measured accelerations.

  • 7/30/2019 Smart Not Taker

    22/27

    22

    -Secondly, we have to succeed in the double integration, which is to solve all the derivation

    problems due to this method.

    Fig: 5.2 Represents the acceleration signals recorded while one is writing a small capital B.

    ii) Handwriting Recognition:

    The second huge aspect is the characters and signatures recognition. The hardware

    (accelerometers plus contact detector) embedded in the pen has proved a really efficient

    combination for this application.

    Method

    -The same method is used to recognize the characters written by a single user and to find

    whose signature is the one that has just been done.

    -We use a simple Euclidian distance as the comparison process, and of course the decision

    process is the smaller distance found.

    -The first step consists in creating the reference database for the characters as for the

    signatures. For this a mean signal is computed for each recorded symbol.

    -The second step is the recognition process

    1. For the creation of database, each symbol was reproduced several times and a mean

    normalized symbol was computed.

  • 7/30/2019 Smart Not Taker

    23/27

    23

    2. For recognition process, the unknown symbol is first normalized, the distance between this

    symbol and the entire database symbol is computed. Then the unknown symbol is recognized

    as the one with the lowest distance.

    10. ADVANTAGES

    -Can be used as standard pen and can carry anywhere without stressing mind to carry it.

    - With the help of smart note taker we can write notes on any surface even in air. That is we

    can write notes any time without using a paper.

    - is used along with paint and JAVA graphics so we can say this product is compatible with

    all graphics software.

    -Light weighted and easily portable-on phone talks or for instructor.

    -Useful for any person, any institute.

    10.2 .DISADVANTAGES

    - Expensive

    -No templates and other sophisticated formats available.

    -Cant drag items to other tabs directly.-Awareness requires.

    11. APPLICATIONS

    With the help of smart note taker handwritten notes will be instantly converted into editable

    text

    Another place, where this product can play important role is where two people talk on the

    phone. The subscribers are apart from each other while their talk and they may want to use

    figures or text to understand themselves better.

    Can be use by teachers directly and indirectly by students, too

    Smart note taker is reliable and powerful.

    It is helpful for blinds that think and write freely.

    Smart note taker is used for instructors in presentations.

    It is used along with paint and JAVA graphics so we can say this product is compatible with

    all graphics software. Easy-to-use wireless connection.

  • 7/30/2019 Smart Not Taker

    24/27

    24

    12. FUTURE SCOPE

    Companies had succeeded to make similar products and put them in the market. Putting a

    newly invented, innovative product in the market is not easy. The prices in the market must

    be well observed for similar products. The prices of 2-D digital pens are about 50 dollars to

    90 dollars. So the price of smart note taker will be high. But this disadvantage definitely is

    eliminated in near future.Future models could receive e-mails and pager messages via a

    wireless messaging system and could use digital signature recognition for security purposes.

    Working on improving the handwriting recognition software and expects it to understand

    cursive.

  • 7/30/2019 Smart Not Taker

    25/27

    25

    13. CONCLUSION

    The system will try to improve a pen, which helps people get rid of typing problems on

    computer by the technology, which converts your handwriting to text format on your PC.

    This technology provides taking notes on air. Beside this, it can also be used like all other

    classical pens. Therefore, this device will increase the capacity of noting the texts, lessons

    and projects you work on.

  • 7/30/2019 Smart Not Taker

    26/27

    26

    14.REFRENCE

    [1]Writer-Dependent Recognition of Handwritten Whiteboard Notes in Smart Meeting

    Room Environments Liwicki, M.; Schlapbach, A.; Bunke, H.

    Document Analysis Systems, 2008. DAS '08. The Eighth IAPR International Workshop on

    Digital Object Identifier: 10.1109/DAS.2008.8

    Publication Year: 2008 , Page(s): 151157

    [2]Smart grids, smart cities need better networks [Editor's Note] Chen, T.M.

    Network, IEEE Volume: 24 , Issue: 2 Digital Object Identifier:

    10.1109/MNET.2010.5430136 Publication Year: 2010 , Page(s): 23

    [3]Mathematical model and computer simulation of text reproduction based upon Quantity

    Rather Than Quality concept Kawabe, H.; Sugimori, K.; Shimomura, Y.; Seto, S.Computers

    and Industrial Engineering (CIE), 2010 40th International Conference on Digital Object

    Identifier: 10.1109/ICCIE.2010.5668281 Publication Year: 2010

    [4]Powering the Future: Organic Solar Cells with Polymer Energy Storage Yindar Chuo;

    Omrane, B.; Landrock, C.; Aristizabal, J.; Hohertz, D.; Grayli, S.V.; Kaminska, B.

    Design & Test of Computers, IEEE Volume: 28 , Issue: 6 Digital Object Identifier:

    10.1109/MDT.2011.93 Publication Year: 2011 , Page(s): 32 40Collective Intelligence

    Applications -- Algorithms and Visualization Nagalakshmi, A.; Joglekar, S.

    Emerging Applications of Information Technology (EAIT), 2011 Second International

    Conference on Digital Object Identifier: 10.1109/EAIT.2011.82 Publication Year: 2011 ,

    Page(s): 2530

    [5]Take note: academic note-taking and annotation behaviorCunningham, S.J.; Knowles, C.Digital Libraries, 2005. JCDL '05. Proceedings of the 5th ACM/IEEE-CS Joint Conferenceon

    Digital Object Identifier: 10.1145/1065385.1065477 Publication Year: 2005 , Page(s): 374

    374

    http://ieeexplore.ieee.org/xpl/articleDetails.jsp?tp=&arnumber=4669956&contentType=Conference+Publications&queryText%3DSmart+Note+Takerhttp://ieeexplore.ieee.org/xpl/articleDetails.jsp?tp=&arnumber=4669956&contentType=Conference+Publications&queryText%3DSmart+Note+Takerhttp://ieeexplore.ieee.org/xpl/mostRecentIssue.jsp?punumber=4669929http://dx.doi.org/10.1109/DAS.2008.8http://ieeexplore.ieee.org/xpl/RecentIssue.jsp?punumber=65http://ieeexplore.ieee.org/xpl/tocresult.jsp?isnumber=5430133http://dx.doi.org/10.1109/MNET.2010.5430136http://ieeexplore.ieee.org/xpl/articleDetails.jsp?tp=&arnumber=5668281&contentType=Conference+Publications&queryText%3DSmart+Note+Takerhttp://ieeexplore.ieee.org/xpl/articleDetails.jsp?tp=&arnumber=5668281&contentType=Conference+Publications&queryText%3DSmart+Note+Takerhttp://ieeexplore.ieee.org/xpl/articleDetails.jsp?tp=&arnumber=5668281&contentType=Conference+Publications&queryText%3DSmart+Note+Takerhttp://ieeexplore.ieee.org/xpl/articleDetails.jsp?tp=&arnumber=5668281&contentType=Conference+Publications&queryText%3DSmart+Note+Takerhttp://ieeexplore.ieee.org/xpl/mostRecentIssue.jsp?punumber=5658183http://ieeexplore.ieee.org/xpl/mostRecentIssue.jsp?punumber=5658183http://dx.doi.org/10.1109/ICCIE.2010.5668281http://ieeexplore.ieee.org/xpl/articleDetails.jsp?tp=&arnumber=5963627&contentType=Journals+%26+Magazines&queryText%3DSmart+Note+Takerhttp://ieeexplore.ieee.org/xpl/RecentIssue.jsp?punumber=54http://ieeexplore.ieee.org/xpl/tocresult.jsp?isnumber=6123672http://dx.doi.org/10.1109/MDT.2011.93http://ieeexplore.ieee.org/xpl/articleDetails.jsp?tp=&arnumber=5734910&contentType=Conference+Publications&queryText%3DSmart+Note+Takerhttp://ieeexplore.ieee.org/xpl/articleDetails.jsp?tp=&arnumber=5734910&contentType=Conference+Publications&queryText%3DSmart+Note+Takerhttp://ieeexplore.ieee.org/xpl/mostRecentIssue.jsp?punumber=5734893http://ieeexplore.ieee.org/xpl/mostRecentIssue.jsp?punumber=5734893http://dx.doi.org/10.1109/EAIT.2011.82http://ieeexplore.ieee.org/xpl/articleDetails.jsp?tp=&arnumber=4118577&contentType=Conference+Publications&queryText%3DSmart+Note+Takerhttp://ieeexplore.ieee.org/xpl/mostRecentIssue.jsp?punumber=4118504http://dx.doi.org/10.1145/1065385.1065477http://dx.doi.org/10.1145/1065385.1065477http://ieeexplore.ieee.org/xpl/mostRecentIssue.jsp?punumber=4118504http://ieeexplore.ieee.org/xpl/articleDetails.jsp?tp=&arnumber=4118577&contentType=Conference+Publications&queryText%3DSmart+Note+Takerhttp://dx.doi.org/10.1109/EAIT.2011.82http://ieeexplore.ieee.org/xpl/mostRecentIssue.jsp?punumber=5734893http://ieeexplore.ieee.org/xpl/mostRecentIssue.jsp?punumber=5734893http://ieeexplore.ieee.org/xpl/articleDetails.jsp?tp=&arnumber=5734910&contentType=Conference+Publications&queryText%3DSmart+Note+Takerhttp://ieeexplore.ieee.org/xpl/articleDetails.jsp?tp=&arnumber=5734910&contentType=Conference+Publications&queryText%3DSmart+Note+Takerhttp://dx.doi.org/10.1109/MDT.2011.93http://ieeexplore.ieee.org/xpl/tocresult.jsp?isnumber=6123672http://ieeexplore.ieee.org/xpl/RecentIssue.jsp?punumber=54http://ieeexplore.ieee.org/xpl/articleDetails.jsp?tp=&arnumber=5963627&contentType=Journals+%26+Magazines&queryText%3DSmart+Note+Takerhttp://dx.doi.org/10.1109/ICCIE.2010.5668281http://ieeexplore.ieee.org/xpl/mostRecentIssue.jsp?punumber=5658183http://ieeexplore.ieee.org/xpl/mostRecentIssue.jsp?punumber=5658183http://ieeexplore.ieee.org/xpl/articleDetails.jsp?tp=&arnumber=5668281&contentType=Conference+Publications&queryText%3DSmart+Note+Takerhttp://ieeexplore.ieee.org/xpl/articleDetails.jsp?tp=&arnumber=5668281&contentType=Conference+Publications&queryText%3DSmart+Note+Takerhttp://dx.doi.org/10.1109/MNET.2010.5430136http://ieeexplore.ieee.org/xpl/tocresult.jsp?isnumber=5430133http://ieeexplore.ieee.org/xpl/RecentIssue.jsp?punumber=65http://dx.doi.org/10.1109/DAS.2008.8http://ieeexplore.ieee.org/xpl/mostRecentIssue.jsp?punumber=4669929http://ieeexplore.ieee.org/xpl/articleDetails.jsp?tp=&arnumber=4669956&contentType=Conference+Publications&queryText%3DSmart+Note+Takerhttp://ieeexplore.ieee.org/xpl/articleDetails.jsp?tp=&arnumber=4669956&contentType=Conference+Publications&queryText%3DSmart+Note+Taker
  • 7/30/2019 Smart Not Taker

    27/27

    IndexContents Page No.

    1. Abstract 12. Introduction 2

    3. System Overview 3

    Construction 3 Main Features 4 Interior Structure 5

    4.Technical Definition Of The Product 6

    Problem Statement 6

    5.Related Work 7 Alternatives To Note-Taking 7 Popular Assistive Devices For People With Low Vision 8

    6. Design Principles 12

    7.Current Products 12

    Mobile Note Taker 12 Pc Note Taker 14 Smart Pen 15

    8. Technology 17

    Display Technology 179.Organized Note-Taking System 18

    Handwriting Recognition 20 Prototype Of Smartnotetaker 21

    10. Advantages 23

    11. Applications 23

    12. Future Scope 24

    13. Conclusion 25

    14.Refrence 26