Language and dialect identification in social media analysis

Stephen Tratz; Douglas Briesch; Jamal Laoudi; Clare Voss; V. Melissa Holland

doi:10.1117/12.2059092

5 June 2014 Language and dialect identification in social media analysis

Stephen Tratz, Douglas Briesch, Jamal Laoudi, Clare Voss, V. Melissa Holland

Author Affiliations +

Proceedings Volume 9122, Next-Generation Analyst II; 91220K (2014) https://doi.org/10.1117/12.2059092
Event: SPIE Sensing Technology + Applications, 2014, Baltimore, Maryland, United States

Abstract

Historically-unwritten Arabic dialects are increasingly appearing online in social media texts and are often intermixed with other languages, including Modern Standard Arabic, English, and French. The next generation analyst will need new capabilities to quickly distinguish among the languages appearing in a given text and to identify informative patterns of language switching that occur within a user’s social network—patterns that may correspond to socio-cultural aspects such as participants’ perceived and projected group identity. This paper presents work to (i) collect texts written in Moroccan Darija, a low-resource Arabic dialect from North Africa, and (ii) build an annotation tool that (iii) supports development of automatic language and dialect identification and (iv) provides social and information network visualizations of languages identified in tweet conversations.

Citation Download Citation

Stephen Tratz, Stephen Tratz, Douglas Briesch, Douglas Briesch, Jamal Laoudi, Jamal Laoudi, Clare Voss, Clare Voss, V. Melissa Holland, V. Melissa Holland, "Language and dialect identification in social media analysis", Proc. SPIE 9122, Next-Generation Analyst II, 91220K (5 June 2014); doi: 10.1117/12.2059092; https://doi.org/10.1117/12.2059092

ACCESS THE FULL ARTICLE

PERSONAL SIGN IN
Full access may be available with your subscription

Email or Username Forgot your username?

Password Forgot your password?

Show

Remember Email/Username on this computer

Remember Password

No SPIE account? Create an account
or Institutional Sign In via Shibboleth

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available

Members: $14.40

Non-members: $18.00 ADD TO CART

Show All Keywords

Keywords/Phrases

Search In:

Publication Years