Showing posts with label Crowdsourcing. Show all posts
Showing posts with label Crowdsourcing. Show all posts

Sunday, June 16, 2013

New Publication: GIS and Agent-Based models for Humanitarian Assistance

Inputs to the model
 
As the readers of the blog know, we have an interest in GIS, agent-based modeling and crowdsourcing. Now we have a paper that combines all these three elements. Its entitled "GIS and Agent-Based models for Humanitarian Assistance" and is published in Computers, Environment and Urban Systems. 
 
The model itself was written in MASON and uses extensively GeoMASON. Data comes from several different sources (both raster and vector) including OpenStreetMap and LandScan. Below you can read an abstract of the paper and see a movie of one of the scenarios.

"Natural disasters such as earthquakes and tsunamis occur all over the world, altering the physical landscape and often severely disrupting people’s daily lives. Recently researchers’ attention has focused on using crowds of volunteers to help map the damaged infrastructure and devastation caused by natural disasters, such as those in Haiti and Pakistan. This data is extremely useful, as it is allows us to assess damage and thus aid the distribution of relief, but it tells us little about how the people in such areas will react to the devastation. This paper demonstrates a prototype spatially explicit agent-based model, created using crowdsourced geographic information and other sources of publicly available data, which can be used to study the aftermath of a catastrophic event. The specific case modelled here is the Haiti earthquake of January 2010. Crowdsourced data is used to build the initial populations of people affected by the event, to construct their environment, and to set their needs based on the damage to buildings. We explore how people react to the distribution of aid, as well as how rumours relating to aid availability propagate through the population. Such a model could potentially provide a link between socio-cultural information about the people affected and the relevant humanitarian relief organizations."



Full Reference: 
Crooks, A.T. and Wise, S. (2013), GIS and Agent-Based models for Humanitarian Assistance, Computers, Environment and Urban Systems, 41: 100-111.

Monday, April 16, 2012

Natural Disasters and Crowdsourcing: Haiti

Natural disasters such as earthquakes and tsunamis occur all over the world, altering the physical landscape and often severely disrupting people’s daily lives. Recently researchers’ attention has focused on using crowds of volunteers to help map the infrastructure and devastation caused by natural disasters, such as those in Haiti and Pakistan. For example, in the movie below shows the response to the earthquake by the OpenStreetMap community within 12 hours of the earthquake. The white flashes indicate edits to the map (often by tracing satellite/aerial photography).




While this data is extremely useful, as it is allows us to assess damage and thus aid the distribution of relief, but it tells us little about how the people in such areas will react to the devastation, the supply of food, or the reconstruction. To address this, we are exploring how agent-based modeling can be used to explore peoples reactions. To do this we have created a prototype spatially explicit agent-based model, created using crowdsourced geographic information and other sources of publicly available data, which can be used to study the aftermath of a catastrophic event. The specific case modeled here is the Haiti earthquake of January 2010. Crowdsourced data is used to build the initial populations of people affected by the event, to construct their environment, and to set their needs based on the damage to buildings. 

The idea behind the model is to explore how people react to the distribution of aid, as well as how rumors propagating through the population and crowding around aid distribution points might lead to food riots and similar social phenomena. Such a model could potentially provide a link between socio-cultural information of the people affected and relevant humanitarian relief organizations.




The animation above shows one simulation run where there is the spread of  information and agent movement (red dots) around one center (blue dot). While the chart below shows how over time the density of agents around the food station increases over time.

The idea behind such a model is one can take crowdsourced information and fuse it into an agent-based model and see how people will react to the distribution of food centers. For example, the movie below shows how agents find out about four (hypothetical) different food centers and decide whether or not to go to them in a 6 by 8km area of Port-au-Prince.



Spread of information and agent movement (red dots) in a 6 by 8km area of Port-au-Prince.

More details about this model to come......

Wednesday, September 15, 2010

Geospatial Revolution - Episode 1

Via the VerySpatial Blog I came across the first episode (below) of the Geospatial Revolution Project and thought it was worth sharing. To quote from the site:
"The mission of the Geospatial Revolution Project is to expand public knowledge about the history, applications, related privacy and legal issues, and the potential future of location-based technologies"

Monday, March 16, 2009

AAG: The Rise of Neogeography

If any readers are attending the AAG next week in Las Vegas, Andrew Hudson-Smith of Digital Urban and myself have organised a session entitled "Concepts, Tools and Applications: The Rise of Neogeography." This session discusses the concepts, tools, applications and challenges arising when collecting, sharing and communicating data for the Neogeographer. The session explores a wide range of topics from Digital Earths, Volunteered Geographic Information and through to Virtual Worlds.

The session will take place on Friday, 27th of March, from 8:00 AM - 9:40 AM in the North Hall N116, Las Vegas Convention Center

The program is as follows:

Hope to see you there.

Friday, February 27, 2009

Crowdsourcing Spatial Surveys and Mapping

Below is a paper we will be presenting in March at GISRUK 2009. The full reference is:

Crooks, A. T., Hudson-Smith, A., M., Milton, R., and Batty, M. (2009), Crowdsourcing Spatial Surveys and Mapping, in Fairbairn, D. (ed.), Proceedings of the 17th Geographical Information Systems Research UK Conference, Durham University, England.

We thought we would put it on-line, to gauge peoples thoughts about it as it is the product of the crowd. Any comments and suggestions are most welcome.

Why blog about this work? It demonstrates the potential of crowdsourcing peoples opinions to specific questions over space and time both statistically and geographically, such work potentially allows one to crowdsource peoples perceptions on: fear of household burglary, quality of local schools, who would you vote for? etc. Additionally it is the ability to access real time information and use it for a purpose. For example, with the growth in mobile phones with built in GPS (such as the iPhone) if one had enough participants one could use the data for calibrating pedestrian or traffic simulations and therefore help potentially understand human behavoir. Such as peoples daily movement patterns (see urbanTick for such work).

Crowdsourcing Spatial Surveys and Mapping

1. Introduction

This paper presents the potential of linking the GMap Creator software and the MapTube web service to create near-real time spatial surveys. Three different surveys will be presented which map people’s perceptions about certain questions, including the current financial crisis, anti-social behaviour and peoples thoughts on road pricing. Basic results will be highlighted for each and the geodemographic profiles of respondents will be explored. However, before discussing this, the underlying technologies that we use for the creation of the surveys: GMap Creator and MapTube, will be introduced.

1.1. GMap Creator

GMap Creator is a free piece of software that takes a shapefile and enables the creation of thematic layers which can be quickly and easily integrated into Google Maps in a simple ‘point and click’ manner (see Hudson-Smith et al. (under review) for more details). Using GMap Creator, it is possible to overlay pre-rendered thematic tiles on top of street and satellite views of Google Maps, making it possible to show complex areal coverage’s. The purpose of such a tool is to build feature rich cartographic websites that may easily be used and interpreted by individuals who have limited experience of spatial data handling (e.g. www.londonprofiler.org Gibin et al., 2008) rather than for more formal exploratory spatial data analysis.

1.2. MapTube

MapTube (www.maptube.org) combines the generic idea of YouTube where users can share information with the ability of GMap Creator to create thematic maps. MapTube provides a ‘place to put maps’ as we demonstrate in Figure 1, which highlights the most viewed maps currently on the MapTube site. MapTube acts as a portal for geographic data, data is not stored on the site. Every map hosted on MapTube is held on an outside server, and pulled in using the XML file which is automatically created when using GMap Creator. This allows data creators to maintain ownership of the data. MapTube allows one to view and compare different datasets as a series of layers (i.e. mashup) through the Google Map interface. However, we are currently working on an implementation for OpenLayers (see Milton, 2008).

Figure 1. MapTube home page showing the most popular maps.

2: Near Real-Time Spatial Surveys

Not only does MapTube allow people to share and view other people’s maps but it can also be used in more innovative ways. For example, as web surveys are often aspatial (e.g. surveymonkey.com), the ability to combine GMap Creator and MapTube offers a simple solution to build spatial surveys for large areas. Figure 2 shows the process of creating the near real-time maps. Users are asked a series of questions and to enter their postcode so that the results can be geo-coded. This is then sent to a web server, time stamped and stored in a database. Every 30 minutes (however, this can be varied) a script is run to create a new shapefile, compiling all the results from a survey, aggregating them into a spatial units (in this case postcode districts). The shapefile is then passed to GMap Creator along with an XML file containing information including: settings for colour thresholds, maximum level of zoom and the field name of the shapefile for which the map is to be created on. GMap Creator runs creates a series of image tiles which updates the map on MapTube which can then be served back over the internet.

Figure 2. The process of gathering, storing and creation of maps.

What follows are three surveys which map people’s perceptions about certain issues done in association various BBC organisations. For each survey no personal information was collected and participants were reassured that actual locations could not be identified. This was ensured through the use of postcode districts rather than the postcode unit or building address therefore preserving data confidentiality. Used in conjunction with MapTube, it allowed participants and other users to take other information and lay the maps on top of one other.

2.1. Mapping the Credit Crunch

A pilot study was carried out as an experiment to create a mood map of the credit crunch within the United Kingdom in conjunction with BBC Radio 4 iPM show . Based on what is the “singly most significant factor hurting the person the most about the credit crunch”, participants were asked to enter the first part of their postcode (postcode district) so their responses could be geo-tagged along with one of six options to choose from: mortgage or rent, fuel, food prices, holidays, other, or the credit crunch is not affecting me.

Between 26th April and 29th June 2008 there were 23475 responses to the survey with 48.8% of response saying that fuel was most significant factor hurting the person the most about the credit crunch (Figure 3). However there was spatial variation around the country with more respondents within Greater London saying it was either mortgage or rent, or food as shown in Figure 4.


Figure 3. Overall percentages for the Credit Crunch Survey.

Figure 4. Results of the Credit Crunch Survey Focused Around London (Note: the Colour represents the Most Frequent Response in the Postcode District).

2.2. Anti-Social Behaviour in East Anglia

The Credit Crunch Map has since led to BBC Look East, using the system to map peoples perceptions of anti-social behaviour.


Anti-Social Behaviour in East Anglia.

Each respondent was asked “what problems do you face where you live?” Respondents had five options: drunken youths, noisy neighbours, boy racers, no problems, great community and no problems. The survey ran between 4th July 2008 and 12th September 2008. During this time 6902 responses were received. Figure 5 shows the overall percentages, with 33.7% saying drunken youths with the other categories broken down relatively evenly between 14 to 18%. Figure 6 maps the responses with drunken youths clustering around urban areas such as Norwich and Newmarket.



Figure 5. Overall Percentages for the Anti-Social Behaviour Survey.


Figure 6. Results of the Anti-Social Behaviour Survey Focused Around East Anglia (Note: the Colour represents the Most Frequent Response in the Postcode District, click here to see the map).

2.3. The Manchester Congestion Charge

There was a proposal for Manchester in introduce a congestion charge zone motorists pay to drive in and out of the city at peak times. The BBC North West Tonight program wanted people's reaction to the proposed Greater Manchester congestion charge, from within the city but also people who drive in from outside the region. As these people don't get a vote but may end up paying the charge (subsequently the people of Manchester said no).


The Manchester Congestion Charge.


People were asked the following question “If a congestion charge is introduced in Greater Manchester, along with significant investment in public transport, will you:” and then asked to select one of the following options: drive and pay the charge, drive at different times, use public transport/motorbike/bicycle, work or shop elsewhere, or I am not affected by these changes. The survey began on 14th October 2008. By the 10th December 2008, there were 14933 responses with 46.8% saying they would work or shop elsewhere (Figure 7). This online collaboration provided a unique picture of how well the proposal was going down across the north west of England as the map is updated every day (Click here to see the final map).



Figure 7. Overall percentages for the Manchester Congestion Survey.

3. Geodemographic Profiles of Respondents

While we only asked for respondents or their first part of their postcode, many entered their full postcode as can be seen in Table 1. We note that this in not a representative sample but it does provide an opportunity to further investigate who is responding to such surveys. To gain this understanding we use two geodemographic classification schemes. First, the Acorn classification from CACI which categorises neighbourhoods based on multidimensional socio-demographic attributes. The second being the e-Society geodemographic classification (Longley et al., 2008) which categorizes neighbourhoods based on their engagement with new information communication technologies.

For the analysis, index scores was calculated. An index score compares the over or under representation of a specific target variable against a base population (e.g. the national average). Where a score of 100 is the national average, 200 is double the national average and a score of 50 is 50% below the national average. From such analysis it is the middle and upper classes who are over-represented within the surveys as shown in Table 2, this potentially relates to demographics of the readers, listeners, and viewers Radio 4 and the BBC news. The over representation of E-business users in the E-society classification (Table 3) suggest many respondents are answering the questionnaire while at work. Furthermore the geodemographic profiles of responses to individual questions can also be explored as seen in Table 4. Across all demographic groups the biggest concern was fuel.


Table 1. Total Number of Respondents to Surveys and Number Who Entered Their Full Postcode.


Table 2. Index Scores of Respondents by Acorn Category Classification.


Table 3. Index Scores of Respondents by E-Society Group Classification.

Table 4. Percentage of Responses to the Credit Crunch Survey Broken Down by Acorn Category.


4. Discussion

This paper has demonstrated the potential of using GMap Creator and MapTube for near-real time spatial survey thus providing a resource to map the nations opinions to specific questions over space and time both statistically and geographically. The potential of this approach for gathering spatial information is enormous. For example, it could easily be used to gather other information such as fear of household burglary, the quality of primary school education and so on. We consider this in many senses this to be Web 2.0 and Neogeography in action.

However, the geodemographics of the respondents shows there is an inherit bias in who is answering the questions and there is the question to whether or not respondents are influenced by the maps before answering the questions. Further work is to explore how the maps evolve over time, as each response is time stamped and how this relates to news headlines. Additionally, we are currently exploring the geodemographic profiles of each survey in more detail. We have currently re-run the credit crunch with the BBC with slightly different options to the answer.

The question remains the same - "what single factor is hurting you most about the credit crunch?" But we decided to change the categories slightly:Mortgage or rent, Petrol, Food prices, Job security, Utility bills, or Not affected. This survey ran between 5th October 2008 and 3 February 2009 and has now closed. The final map can be viewed here. During this time we received 20,072 responses, which can be broken down as follows (Figure 8): Mortgage or Rent 11.05%, Petrol 4.7%, Food Prices 11.89%, Job Security 27.25%, Utility Bills 21.92%, and Not Affected 23.20%


The Return of the Credit Crunch on the BBC Site

Figure 8: Overall percentages for the Credit Crunch Survey

5. References

Gibin M, Singleton AD, Mateos P, and Longley PA. (2008) Exploratory cartographic visualisation of London using the Google Maps API Applied Spatial Analysis and Policy 1(2) pp85-97.

Hudson-Smith A, Crooks AT, Gibin M, Milton R, and Batty M (under review) Neogeography and Web 2.0: Concepts, Tools and Applications, Journal of Location Based Services.

Longley PA, Webber R, Li C, (2008) The UK geography of the e-society: a national classification Environment and Planning A 40(2) pp362-382.

Milton R (2008) GMap Creator, OpenLayers and OpenStreetMap CASA Blog. Available at http://blog.casa.ucl.ac.uk/?p=60 .

Friday, February 13, 2009

Computational Social Science

I came across an interesting idea from the SimSoc mailing list sent by Professor Nigel Gilbert, about crowdsourcing a book on computational social science. See below for the email message:

“Sage will be publishing a four volume set on Computational Social Science in Spring 2010. This four volume set will reprint the key articles in the emerging field of computational social science. It will include:

· the hard-to-find classic papers that first signalled the potential of the computational approach;

· a selection of influential examples of computational social science from a wide range of social science disciplines, including economics, sociology, geography, political science, social psychology, anthropology and archaeology, and business and management; and

· contributions on the methodology of computational social science, including comparisons with other approaches.

Computational social science is here defined as the use of computational models (so including all forms of simulation, but not, for example, equation-based models).


The set will include approximately 80 articles. The great majority will be either articles originally published in academic journals, or as chapters from edited collections derived from conferences. They will be divided into sections, each with a brief introduction.


You can help with selecting the 80 articles (no complete books or lengthy reports). The articles proposed so far can be found in a CiteULike group at: http://www.citeulike.org/group/8686/library



You can add your suggestions, and comment on the items already proposed. Everyone who contributes or comments has a chance of winning a free copy of the four volume set (worth about £500, $1000, €750). The winner will be selected at random before the date of publication from those who have participated.”


This is quite an interesting experiment and if nothing else the page should provide a useful reference for those interested computational social science. For example, the often overlooked Sakoda (1971) Checkerboard Model of Social Interaction is mentioned and many more articles which I have found useful in understanding and exploring computational social science.

Tuesday, January 13, 2009

CASA S4 Modelling Tour Workshop


Last week CASA hosted a two day workshop showcasing our work along with researchers from the University of Leeds as part of the of the S4 European Spatial Analysis network modelling tour. Over 150 people both from the public and private sector came to the event from all across Europe. The first day of the event was designed to showcase CASA's use of new technologies for mapping and visualizing information about cities and was entitled "Geographic Information in a Web-Based World."

Talks ranged from introducing GMapCreator and MapTube which enable web-based mapping for sharing and visualising geographic information, to public engagement via the London Profiler, Public Profiler and the E-Society Classification websites. The geography and ethnicity of people's names was explored which introduced the WorldNames and Onomap websites.

Other talks on the first day explored the use of MapTube and GMapCreator for Crowdsourcing near-real time spatial surveys and understanding crowdsourced geographical information via the analysis of OpenStreetMap. On a more data oriented side, there were talks on exploring urban data collection and mapping, analysing and visualising fine scale urban form and socio-economic datasets. The day concluded with a talk by Andrew Hudson-Smith from Digital Urban on Web 2.0 and neogeography in real and virtual spaces: from geocaching through to Second Life.



The second day of the workshop was entitled "Developments in Urban Models, Simulation and Spatial Analysis" and talks ranged from: rank clocks and scaling in city sizes, geodemographics, retail modelling, the need to capture urban form patterns and processes in agent-based models, pedestrian modelling, consumer behaviour, microsimulation and 3D visualisation and communication of agent-based models.


Click here to see the full program and to download the presentations.

Add Image

Monday, September 22, 2008

Concepts, Tools and Applications: The Rise of Neogeography


Just a quick note that Andrew Hudson-Smith from Digital Urban and myself are organizing a session at the 2009 AAG. entitled "Concepts, Tools and Applications: The Rise of Neogeography" Below is an extended abstract for the session:

The world of Geographic Information (GI) Science has changed. It has experienced expeditious growth over the last few years leading to fundamental changes to the field. Web 2.0, specifically The Cloud, GeoWeb and Crowd Sourcing are revolutionising the way in which we gather, present, share and analyse geographic data. This renaissance in the importance of geography in the Web 2.0 world is becoming known as 'Neogeography'.

Neogeography is geography for the general public using Web 2.0 techniques to create and overlay their own locational and related information on and into systems that mirror the real world. Location and space now represents a key part of the Web 2.0 revolution. Tagging not only the type of information but where such information is produced, who uses it and at what time, is fast becoming the killer application that roots information about interactivity generated across the web to systems that users can easily access and use in their own communication with others.

The aim of this session is twofold; first to bring together practitioners to discuss concepts and challenges that the field of Neogeography faces. Secondly, to provide an opportunity for researchers and developers to present recent tools and applications for collecting, sharing and communicating spatial data for the Neogeographer. We are actively seeking topics ranging across the entire spectrum of Neogeography, from Crowdsourcing, Digital Earths, Neogeography, Web Mashups, Volunteered Geographic Information, Virtual Worlds (e.g. Second Life) and associated Web 2.0 technologies.

Anyone who wishes to presents a paper must first register for the annual meeting, submit an abstract (no more than 250 words that describes the presentation's purpose, methods, and conclusions) by the October 16, 2008. Once this has been done, you need to send us your program identification number (PIN), which we will use to add you to the session.

Further details on the paper requirements and cost of registration for the AAG meeting can be found at http://www.aag.org/annualmeetings/2009/index.htm

We look forward to hearing from you

Andrew and Andy