Showing posts with label Twitter. Show all posts
Showing posts with label Twitter. Show all posts

Thursday, April 3, 2014

Social Media and the Emergence of Open-Source Geospatial Intelligence

Recently the USGIF published a book entitled "Human Geography: Socio-Cultural Dynamics and Global Security" in which we have a chapter called "Social Media and the Emergence of Open-Source Geospatial Intelligence". This book has been some  time in the making. We blogged about our contribution in  2012. But its finally its out! Below is the abstract for our chapter:

The emergence of social media has provided the public with an effective and irrepressible real-time mechanism to broadcast information. The great popularity of platforms such as twitter and YouTube, and the substantial amount of content that is communicated through them are making social media an essential component of open-source intelligence. The information communicated through such feeds conveys the interests and opinions of individuals, and reveals links and the complex structure of social networks. However, this information is only partially exploited if one does not consider its geographical aspect. Indeed, social media feeds more often than not have some sort of geographic content, as they may communicate the location from where a particular report is contributed, the geolocation of an image, or they may refer to a specific sociocultural hotspot. By harvesting this geographic content from social media feeds we can transfer the extracted knowledge from the amorphous cyberspace to the geographic space, and gain a unique understanding of the human lansdscape, its structure and organization, and its evolution over time. This newfound opportunity signals the emergence of open-source geospatial intelligence, whereby social media contributions can be analyzed and mined to gain unparalleled situational awareness. In this paper we showcase a number of sample applications that highlight the capabilities of harvesting geospatial intelligence from social media feeds, focusing particularly on twitter as a representative data source. 

Geolocated pairs of tweeters and retweeters in Tokyo at the time immediately following the Sendai earthquake

Full Reference: 
Stefanidis, A., Crooks, A.T., Radzikowski, J., Croitoru, A. and Rice, M. (2014), Social Media and the Emergence of Open-Source Geospatial Intelligence, in Murdock, D.G., Tomes, R. and Tucker, C. (eds.), Human Geography: Socio-Cultural Dynamics and Global Security, US Geospatial Intelligence Foundation (USGIF), Herndon, VA, pp. 109-123. (pdf)

Friday, March 7, 2014

Comparing the spatial characteristics cyber and physical communities

Readers of the blog know that I have an interest in social media, and how through it we can gain an understanding of society at large. The question is how does the cyber community reflect the corresponding physical community? To this end, papers from 6th ACM SIGSPATIAL International Workshop on Location-Based Social Networks which was held in conjunction with the 21st ACM SIGSPATIAL conference have just come out on the  ACM Digital Library. We presented a paper at the conference entitled "Comparing the Spatial Characteristics of Corresponding Cyber and Physical Communities: A Case Study" The abstract of the paper is as follows:

"The proliferation of social media over the past few years is presenting us with unique opportunities to sample opinions and interests at spatial and temporal resolutions previously unheard of. In order to make best use of this information though, we need a better understanding of the degree to which the cyber community that is observed through them can serve as a proxy for the corresponding physical community. In this paper we are making a contribution towards this issue by presenting a case study in which we compare spatial characteristics of a community both in the physical and cyber spaces. The key findings of our analysis relate to the selection of an appropriate level of spatial aggregation for analyzing social media content, and on the effect in the level of participation of the distance from the point of interest."


We hope you enjoy it.

Full reference: 
  • Lu, X., Croitoru, A., Radzikowski, J, Crooks, A. T. and Stefanidis, A. (2013), Comparing the Spatial Characteristics of Corresponding Cyber and Physical Communities: A Case Study, 6th ACM SIGSPATIAL International Workshop on Location-Based Social Networks, Orlando, FL, pp 11-14. (pdf)

    Monday, October 21, 2013

    IR: State-Driven and Citizen-Driven Networks

    Our work exploring how social media can be used to study events around the world has resulted in a new publication in the  Social Science Computer Review entitled "International Relations: State-Driven and Citizen-Driven Networks." In essence what we are attempting to do is compare traditional international relations (e.g. from the United Nations General Assembly voting patterns) to those arising from the bottom up interactions (i.e from people on the ground). The abstract of the paper is below along with some of the images that accompany the paper.
    The international community can be viewed as a set of networks, manifested through various transnational activities. The availability of longitudinal datasets such as international arms trades and United Nations General Assembly (UNGA) allows for the study of state-driven interactions over time. In parallel to this top-down approach, the recent emergence of social media is fostering a bottom-up and citizen driven avenue for international relations (IR). The comparison of these two network types offers a new lens to study the alignment between states and their people. This paper presents a network-driven approach to analyze communities as they are established through different forms of bottom-up (e.g. Twitter) and top-down (e.g. UNGA voting records and international arms trade records) IR. By constructing and comparing different network communities we were able to evaluate the similarities between state-driven and citizen-driven networks. In order to validate our approach we identified communities in UNGA voting records during and after the Cold War. Our approach showed that the similarity between UNGA communities during and after the Cold War was 0.55 and 0.81 respectively (in a 0-1 scale). To explore the state- versus citizen-driven interactions we focused on the recent events within Syria within Twitter over a sample period of one month. The analysis of these data show a clear misalignment (0.25) between citizen-formed international networks and the ones established by the Syrian government (e.g. through its UNGA voting patterns).


    Full reference:
    Crooks, A.T., Masad, D., Croitoru, A., Cotnoir, A., Stefanidis, A. and Radzikowski, J. (2013), International Relations: State-Driven and Citizen-Driven Networks, Social Science Computer Review. DOI:10.1177/0894439313506851
    If you don't have access to Social Science Computer Review, send us an email and we can send you an early version of the paper. This is also only part of our work on using multiple networks to explore international relations. One can of course also explore the networks in more detail. For example in the figure below we plot the actual transfer of arms between states during the 2001 and 2011 period. One can clearly see how different states are connected with Syria however, Russia has connections to many states.

    Arms transfers

    Or if we explore Twitter hastags and add an edge between any pair of hashtags when they are used in the same tweet we can explore an emergent ontology of topic labels users associate with each other. For example, the #Allepo hashtag is associated with other hashtags which appear to local events, including “#civilian”, “#airstrike”, “#hunger”, “#pictures”, many of which are only connected to the #Aleppo hashtag as shown below.



    Sunday, September 15, 2013

    Geosocial Gauge Paper


    As regular readers of the blog know, we have been spending a lot of time recently looking at social media and the growth in locational information within such media. To this end we are very happy to see one of our papers appear in the International Journal of Geographical Information Science. The paper is entitled "GeoSocial Gauge: A System Prototype for Knowledge Discovery from Social Media" which in essence discusses the challenge of merging diverse social media datasets into a single database which can then be used to generate geosocial knowledge. Below is the abstract:
    "The remarkable success of online social media sites marks a shift in the way people connect and share information. Much of this information now contains some form of geographical content because of the proliferation of location-aware devices, thus fostering the emergence of geosocial media – a new type of user-generated geospatial information. Through geosocial media we are able, for the first time, to observe human activities in scales and resolutions that were so far unavailable. Furthermore, the wide spectrum of social media data and service types provides a multitude of perspectives on real-world activities and happenings, thus opening new frontiers in geosocial knowledge discovery. However, gleaning knowledge from geosocial media is a challenging task, as they tend to be unstructured and thematically diverse. To address these challenges, this article presents a system prototype for harvesting, processing, modeling, and integrating heterogeneous social media feeds towards the generation of geosocial knowledge. Our article addresses primarily two key components of this system prototype: a novel data model for heterogeneous social media feeds and a corresponding general system architecture. We present these key components and demonstrate their implementation in our system prototype, GeoSocial Gauge."

    Full reference:
    Croitoru, A., Crooks, A.T., Radzikowski, J. and Stefanidis, A. (in press), GeoSocial Gauge: A System Prototype for Knowledge Discovery from Social Media, International Journal of Geographical Information Science. DOI: 10.1080/13658816.2013.825724

    If you don't have access to IGIS, send us an email and we can send you an early version of the paper.

    Friday, May 10, 2013

    Tweets from President Obama's inauguration 2013-01-21

    Following on from a previous post on agent-based modeling and elections. Here we show geo-located tweets during the day of President Obama's inauguration 2013-01-21.


    If you want to explore what people are currently saying about President Obama check out our Geosocial Gauge Website.

    Screen shot of Geo social Gauge. Clockwise from top left: Location of tweets, basic sentiment of tweets (green positive, red: negative and gray: neutral), most active countries tweeting and a word cloud of the most popular words in the tweets.


    Monday, April 8, 2013

    GeoSocial Gauge



    Over the last couple of months we have been working on getting our GeoSocial Gauge system up and running. The idea behind the website is to bring together social media and geographical analysis to monitor and explore people’s views, reactions, and interactions through space and time. It takes advantage of the emergence of social media to observe the human landscape as the living, breathing organism that it is: we can witness the explosion-like dissemination of information within a society, or the clusters of individuals who share common opinions or attitudes, and map the locations of these clusters. This is an unprecedented development that broadens drastically our understanding of the way that people act, react to events, and interact with each other and with their environment. We refer to this novel approach to study the integration of geography and society as GeoSocial Analysis.

    The GeoSocial Gauge has several live streams ranging from exploring the political issues (e.g. Sequester) to to see what people are tweeting about TV (The Walking Dead).

    Screen shot of GeoSocial Gauge of the Sequester. Showing the location of tweets, the most frequent words and whether or not the messages are positive (green) or negative (red).
    Screen shot of GeoSocial Gauge of The Walking Dead.
    Some of our initial work on this type of analyis can be found at:
    • Stefanidis, T., Crooks, A.T. and Radzikowski, J. (2013), Harvesting Ambient Geospatial Information from Social Media Feeds, GeoJournal, 78, (2): 319-338.
    • Crooks, A.T., Croitoru, A., Stefanidis, A. and Radzikowski, J. (2013), #Earthquake: Twitter as a Distributed Sensor System, Transactions in GIS, 17(1): 124-147.



    Friday, April 13, 2012

    #Earthquake: Twitter as a Distributed Sensor System

    Our work on using social media continues to develop and we have recently had a paper accepted in Transactions in GIS, entitled "#Earthquake: Twitter as a Distributed Sensor System". Below we present our abstract and some of the results.
    Social media feeds are rapidly emerging as a novel avenue for the contribution and dissemination of information that is often geographic. Their content often includes references to events occurring at, or affecting specific locations. Within this paper we analyze the spatial and temporal characteristics of the twitter feed activity responding to a 5.8 magnitude earthquake which occurred on the East Coast of the United States (US) on August 23, 2011. We argue that these feeds represent a hybrid form of a sensor system that allows for the identification and localization of the impact area of the event. By contrasting this to comparable content collected through the dedicated crowdsourcing ‘Did You Feel It?’ (DYFI) website of the US Geological Survey we assess the potential of the use of harvested social media content for event monitoring. The experiments support the notion that people act as sensors to give us comparable results in a timely manner, and can complement other sources of data to enhance our situational awareness and improve our understanding and response to such events.
    The movie below show geolocated tweets with references to the earthquake through keyword (earthquake or earth and quake) and hashtag search (#earthquake or #quake) for the first hour after the earthquake.





    The following images give a glimpse at some of our analysis.
    Response pattern as function of distance from epicenter for the first 400 seconds after the earthquake. At the top we see a plot of (reaction time, distance) of all tweets during that period. At the bottom we show the histogram of the number of tweets as a function of distance.
    Locations of the 40 tweets in the shaded area of the figure above overlaid over the USGS CDI scale map. Tweet locations are marked as green circles. Color-coding in the graph is ranging from red (high perceived intensity) to yellow (lower perceived intensity). The dashed line shows a distance of approximately 950 km (8.5 degrees of angular distance) from the epicenter.
    The movie below gives you an idea of some of the tweet content:





    Full reference to this paper is:
    Crooks, A. T.,  Croitoru, A.,  Stefanidis, A. and Radzikowski, J. (acepted) "#Earthquake: Twitter as a Distributed Sensor System" Transactions in GIS.

    Sunday, February 19, 2012

    ElectionGauge

    A project we have been working on at GMU called ElectionGauge has now gone live (although still under development). The idea about the project is tie geo-spatial analysis, linguistic analysis, and social network analysis to analyze Twitter responses to the upcoming US elections in real time with the aim of predicting election results.


    One question we are exploring is  do the tweets of users match the speech of candidates? For example, as Maksim Tsvetovat, one of the co-founders says “repeal Obamacare” might identify you as Tea Partier, while “legalize marijuana” puts you in Ron Paul’s camp. While still in beta, below is snapshot from the site:


    Find out more see: @maksim2042, @JackieKazil & @ElectionGauge or at Tech Cocktail

    Friday, January 27, 2012

    Social Media and the Emergence of Open-Source Geospatial Intelligence

    Sample of geolocated tweets referring
    Occupy Wall Street.
    We have just finished a paper entitled 'Social Media and the Emergence of Open-Source Geospatial Intelligence' for Socio-Cultural Dynamics and Global Security. For those interested below is the abstract:

    The emergence of social media has provided the public with an effective and irrepressible real-time mechanism to broadcast information. The great popularity of platforms such as twitter and YouTube, and the substantial amount of content that is communicated through them are making social media an essential component of open-source intelligence. The information communicated through such feeds conveys the interests and opinions of individuals, and reveals links and the complex structure of social networks. However, this information is only partially exploited if one does not consider its geographical aspect. Indeed, social media feeds more often than not have some sort of geographic content, as they may communicate the location from where a particular report is contributed, the geolocation of an image, or they may refer to a specific sociocultural hotspot. By harvesting this geographic content from social media feeds we can transfer the extracted knowledge from the amorphous cyberspace to the geographic space, and gain a unique understanding of the human lansdscape, its structure and organization, and its evolution over time. This new-found opportunity signals the emergence of open-source geospatial intelligence, whereby social media contributions can be analyzed and mined to gain unparalleled situational awareness. In this paper we showcase a number of sample applications that highlight the capabilities of harvesting geospatial intelligence from social media feeds, focusing particularly on twitter as a representative data source.
    Selection of geolocated pairs of tweeters and retweeters in Tokyo at the time immediately
    following the Sendai earthquake
    Full reference:
    Stefanidis, A., Crooks, A.T., Radzikowski, J., Croitoru, A. and Rice, M. (2014), Social Media and the Emergence of Open-Source Geospatial Intelligence, in Murdock, D.G., Tomes, R. and Tucker, C. (eds.), Human Geography: Socio-Cultural Dynamics and Global Security, US Geospatial Intelligence Foundation (USGIF), Herndon, VA, pp. 109-123. (pdf)