Development of the iPad Application “Sound Reading”Ryan DuToit, Bennett Hansen, Dr. Timothy Urness

*Department of Mathematics and Computer Science, College of Arts and Sciences, Drake University, Des Moines, IA

Mobile computing is a high interest topic in computer science today. The Drake University Virtual Language Studies is taking advantage of this trend by developing an iPad application. The application, “Sound Reading,” is designed to assist with foreign language listening and speaking comprehension. To accomplish this, it allows a fluent speaker or instructor to create an audio recording and share it with other language learners. Many features are implemented, including audio recording and playback, dynamic text manipulation, Bluetooth data transfer, and server connectivity. Sound Reading was developed using Apple’s integrated development environment, Xcode, and the code was written in the Objective-C language. The app is currently being finalized and will be submitted to the iOS App Store upon completion.

Abstract:

Project background:• Internship funded by Drake University Virtual Language Studies Program• Met regularly with Drake professor Jan Marston during summer of 2011

• Develop iPad application to assist with listening comprehension and reading comprehension in a classroom setting

• Make application universal so it could be used with any language• User-friendly features that could be used with minimal instruction

Goals:

Desired features:• Audio recording and playback• Dynamic text manipulation

• Allow application to recognize user interactions with text on screen• Data sharing of audio recordings

• Bluetooth transfer between devices in close proximity to one another• Secure web server upload/download

How app works from user standpoint:• User enters foreign language text into application• User creates audio recording of himself/herself reading the text, tapping

on key words as they are said to save them as “word stamps”• Recording and individual word stamps can be reviewed by user and

deleted before saving• User shares recording with others by Bluetooth transfer or uploading to a

web server• Other users can view the foreign text and listen to the audio recording

• Key words in text become highlighted at point in recording when they are said

Challenges

• Highlighting and coloring words are unavailable in Apple’s default libraries • Created a webpage filled with the content we want• Use HTML and JavaScript to provide the dynamic color coding and highlighting that we desire.

[code]

• Improve user interface with better button layout, page navigation, and color scheme

• Met with Graphic Design Faculty member Hilary Williams for suggestions on look and feel for app

Future Plans

• Set up secure server-client architecture to facilitate uploading and downloading recordings

• Submit Sound Reading to Apple’s App Store

Development Tools• Xcode – Apple’s IDE for iOS development

• Objective-C – Language in which majority of iOS applications are developed in. We chose Objective-C because of Apple’s excellent documentation and support, along with our experience with the language.

• Git – A version control system, which makes it easy to share and update code with multiple developers.

• iPads – Used for testing the application in its native environment.

Design Choices

Split View

Simple Audio Controls

Color Coding Words

Color Coded Words