atks (arabic toolkit services)

Ramzy Hassanramzyhassan44@gmail.com

ATKSArabic Toolkit Service

Outline

• Introduction • ATKS Modules• Link ATKS with C#• Example • Comparison

Introduction

Introduction

• The Arabic Toolkit Service (ATKS) offers a set of APIs for basic processing of writtenArabic language.

• The Toolkit is designed to help the Arabic developer by providing high-quality Arabic NLP APIs.

• The ATKS provides a rich set of APIs as SOAP Web Services, and covering the basic language processing operations through the following components

ATKS Modules

Modules

• Colloquial Converter (Work)• Diacritizer (Work)• Named Entity Recognition(Work)• Parser(Work)• POS Tagging (Work)• Sarf (Work)• Speller (dose not work)• Transliterater (dose not work)

Modules (Cont.)• Colloquial Converter

• The Colloquial Converter provides translation of Egyptian colloquial text into the equivalent Modern Standard Arabic text along with rich mapping information

• Diacritizer

Modules (Cont.)

• The automatic Diacritizer component performs vowel restoration on input Arabic text.• The main objective of the Diacritizer is to insert both missing vowels—diacritics—of the

stem and the missing vowel for the case ending.

• Named Entity Recognition

Modules (Cont.)

• The Named Entity Recognizer (NER) detects and classifies named entities in Arabic text.• It classifies them into three categories: persons, locations, and organizations. • It also provides a character index at which the named entity is located in the original text.

• Parser

Modules (Cont.)

• The Parser determines the grammatical structure of Arabic sentences, such as which groups of words combine to form phrases and which words are the subject or the object of a verb.

• The Parser relies heavily on the Arabic POS Tagger to identify the correct part of speech for each token in an input Arabic sentence, and the Arabic Named-Entity Recognizer to identify named entities in the input sentence after it has been corrected using the Arabic Auto-Corrector.

• POS Tagging

Modules (Cont.)

• The Part of Speech (POS) Tagger is responsible for identifying the correct part of speech for each token of any given Arabic sentence.

• The POS Tagger relies heavily on the Morphological Analyzer to extract the relevant morpho-syntactic features for the input words.

• The POS Tagger also relies on the Auto-Corrector to correct input text.

• Sarf

Modules (Cont.)

• Sarf provides automatic morphological analysis of Arabic words.• It provides all possible morphological analyses for any given input Arabic word.• Each analysis consists of the diacritized word and the morphological breakdown of the

analysis in terms of prefixes, stem, and suffixes. The stem is further decomposed into its root and morphological pattern.

• Moreover, each analysis carries the part of speech and a set of morpho-syntactic features such as gender, number, transitivity, verb voice, and verb mood.

• Speller

Modules (Cont.)

• The Speller detects and corrects misspelled words in Arabic text and is designed for Modern Standard Arabic.

• The Speller APIs also enable auto-correction of Common Arabic Mistakes, frequent orthographical errors.

• The main objective of the Speller is to enhance the quality of written Arabic text, hence improving the accuracy of the various Arabic text-processing components.

• Transliterater

Modules (Cont.)

• Transliteration is the conversion of text from one script to another while preserving the same pronunciation.

• The Transliterator provides translation of named entities, such as human and city names, from English to Arabic and vice versa—and conversion of text from Romanized Arabic to native Arabic script.

Link ATKS with C#

Steps• Sign up in this website :

http://research.microsoft.com/en-US/projects/atks/default.aspx• If you already have Microsoft account, you will just need to sign in and then complete

registration details for using ATKS Tool.• After registration they will send you a verification email to active your account.• After 1-2 days they will review your Application and then send other email that contains

AppID which will be use in your Application later.• After that go to Visual Studio – create new C# windows or console Application.• Go to solution explorer on the right side of your Visual studio on your screen and then

click on References menu the choose the second option (add service reference).• A pop-up window will appear copy your module link and name it the press OK.• In your Project code your must include the namespace of your service to make you be

able to use it public classes• After that write your own code and debug it. Wow Success and I get result • It’s good try other modules now.

Example

Comparison

ComparisonComparison

faces ATKS MADAMIRA NLTK

Simplicity Simple HardBecause of it

standard dealing

average

Programming languages

C# Java Python

Accessibility Web service only Stand –alone versionClient- server version

Python downloaded module

Arabic Support Guaranteed Guaranteed Limited

Adjustability Not available just sending feedbacks

Not available Available you can add your own grammer

Contacts

• Facebook.com/ramzy.hassan35• Twitter.com/Rezoo_N1• ramzyhassan44@gmail.com

Question ?