Geographic Situational Awareness: Mining Tweets for Disaster Preparedness, Emergency Response, Impact, and Recovery
Abstract
:1. Introduction
2. Related Works
2.1. Situational Awareness and Message Coding
2.2. Event Detection and Tracking
2.3. Disaster Response and Relief
2.4. Damage Assessment
3. Methodology
3.1. Data
3.2. Tweet Categories and Keywords during Different Disaster Phases
beprep, blackoutnyc, breakingstorm, franken-storm, frankenstorm, frankenstormsupplies, hurricane, hurricaneny, hurricanenyc, hurricaneprep, hurricanepreparation, hurricanerelief, hurricanes, hurricanesandy, hurricanesandyaftermath, hurricanesandyproblems, hurricanesandysuppprt, newyorkhurricane, newyorksandy, njpower, nychurricane, nycsandy, nycsandyneeds, nycstorm, nyhurricane, nysandy, nystorm, sandy, sandyaftermath, sandyaid, sandycommute, sandyhelp, sandyhuracan, sandyinny, sandyisknockingatmydoor, sandylove, sandyny, sandynyc, sandyprep, sandypreparation, sandyproblems, sandyrecovery, sandyregistry, sandyrelief, sandyshurricane, sandysucks, sandyvolunteer, storm, stormprep, storms, superstorm, superstorms
Phase | Category | Keywords | Report Information about |
---|---|---|---|
Preparedness | prepare | beprep, gear up, get ready, hurricaneprep, hurricanepreparation, in ready for, prep for, preparation, prepare, prepared, preparedness, preparing, prepping, readiness, ready for, sandyprep, sandypreparation, stormprep | preparation, getting ready, etc., without mentioning specific actions(such as heading to a store) |
plans | emergency plan | emergency plans | |
shelter in place | snuggled up safely inside, stay home, stay inside, stay safe, staysafe | staying home and keeping safe | |
stock up | checklist, fill up tub, frankenstorm supplies, go to PLACE, groceries, grocery shopping, head to PLACE, hurricane necessities, hurricane shop, hurricane supplies, kits, pick up PLACE, prep kit, sandy essentials, sandy necessities, sandy provisions, sandy supplies, sandybags, shopping, stock, stocked, stocking, storm necessities, storm supplies, survival kit, tool kit, trip to PLACE | actions in stocking up goods, food, tools, etc., in a store | |
prepare for outage | candle, candles, charge power, flashlight, flashlights, generator, generators, in case of power outage | charging electrical products (e.g., phones and notebooks), or purchasing generators, candles, flashlights, etc., in case of power outage | |
evacuation | evacuate, evacuated, evacuating, evacuation, evacuee, head away from, leave home, leaving city, police ask leave, seeking refuge, sleep outside, stay with friends | leaving the home or city, seeking refuge, sleeping outside, or staying with friends or involving police asking citizens to evacuate the potential flooding zone. | |
tip | frankenstorm tip, hurricane tips, storm tip | advice for behavior during the disaster | |
event tracking | crisis response map, following news, Google’s map of resources and information, hurricane sandy live air travel updates, map, service alert, track, tracking, watch nbc, weather channel | monitoring and tracking the status of the disaster event by watching the news from TV or other sources | |
Response | organization | emergency medical services, ems, federal emergency management agency, fema, nypd, oem, office of emergency management, official new york city police department, red cross, red-cross, redcross, salvation army | disaster response and recovery organizations, such as Red Cross, EMS, FEMA, OEM, NYPD, Salvation Army, etc. |
housing | hotel, housing, shelter | staying in a hotel or shelter | |
food | feed victims, food trucks, free lunch, free meals, get meals, refugee meal, sandyrelief meal | getting free meals, or seeing a FEMA food truck | |
utilities.power | emergency power, emergency generator | emergency power or emergency generators | |
rescue | ambulance, emergency response, escape, escaped, escaping, first aid, rescue, rescued, rescuing | rescues of disaster victims | |
Impact | business | board up BUSINESS, BUSINESS closed | closing stores, parks, businesses, office, malls, or restaurants or the delay or cancellation of planned events or schedules, etc. |
casualty | dead, death, death toll, drowned, kill | disaster-caused deaths | |
work | days off, days off work, don’t go to office, don’t go to work, laid off, lost job, no work | closed offices, losing jobs, or time off work | |
communication | cable went out, cell service out, COMMUNICATION down, COMMUNICATION withdraw, internet failure, internet not working, internet out, no COMMUNICATION, there goes the COMMUNICATION | the failure of or disaster impact on internet, cable, and wifi | |
utilities.heating | no ac, no heat, no heater | problems with heating | |
utilities.gas | gas long line, no gas, wait for gas | gas shortages | |
utilities.water | no water, wait water return, water shortage, without water | water problems | |
utilities.power | black out, blackout, blackoutnyc, con ed, con edison, coned, dark, darker, downed electrical wires, POWER down, POWER not expected, POWER off, POWER out, POWER outage, goodbye POWER, knock out POWER, lose POWER, losing POWER, lost POWER, njpower, no POWER, noPOWER, off the grid, powerless, shut off POWER, taken POWER, transformer exploding, transformer explosion, w/o POWER, wait POWER return, without POWER, without pow | power outages | |
damage | catastrophe, collapse, damage, damaged, damaging, debris, destroy, destroyed, destruct, destructed, destructing, destruction, destroying, devastate, devastation, rip off, ruin, ruined, ruining, wreck, wrecking | infrastructure damage caused by the disaster | |
flood | flood, flooded, flooding, spill over, surge overflow, under water, underwater, wash away, washing away, water over the roof, water overflow, water rushing, drown | flooding | |
general impact | affect, affected, airport with no planes, blocked, blocking, cancel, cancelled, cancelling, cancels, close, closed, closes, closing, closure, commutingproblems, delay, delayed, delaying, delays, falling, falls, fell, flipped over, homeless, hurricanesandyproblems, impact, mess up, messy, no commuter vechicle, sandycommute, sandyproblems, short of, shortage, shut down, strand people, subway lines down, tear apart, things flying, torn apart, traffic, what sandy did in harlem | things or people affected by the disaster | |
school | close school, days off school, don’t go to school, no school, no schools, no skool, not waking up for school, school closed | school closures | |
aftermath | after hurricanesandy, after sandy, aftermath, hurricanesandyaftermath, post sandy, post-hurricane, post-sandy, sandyaftermath, | messes after the disaster; typically a photo is attached with the message to show the mess | |
tree | downed tree, fallen branches, fallen stick, fallen tree, fallensoldier, tree came down, car crusher, tree down, tree downed, tree fall, tree fallen apart, tree fell, tree got knocked down, tree meet, tree meet car, tree ripped down, uprooted tree | tree damage | |
transportation in general | Transportation, MTA | commuting problems or damage to transportation systems and infrastructure | |
transportation.traffic | traffic, jam, congestion | traffic status | |
transportation.subway | TRANSIT closed, TRANSIT delayed, TRANSIT shut down | the impact on or damage to the subway system or delay, congestion, or cancellation of subway services | |
transportation.bus | bus line, megabus, strand people | the impact on or damage to the bus system or delay, congestion or cancellation of bus services | |
transportation.ferry | ferry suspend | the delay, congestion, or shutdown of ferry services | |
transportation.road | ROAD close | the closure of a road, street, bridge, or tunnel. | |
transportation.airport | airport, airplane, flight, JFK, John F. Kennedy International Airport, LGA, LaGuardia Airport, EWR, Newark International Airport | the impact, damage, or shutdown of airports, or delays and cancellations of flights | |
Recovery | business | back BUSINESS, open BUSINESS, reopen BUSINESS | the reopening or return to normal of stores, parks, businesses, offices, malls, restaurants, etc. |
cleanup | Clean up, cleanup, demolite, demolition, removal, remove, tree cutting, tree trimming | removing debris caused by the disaster | |
work | back office, back work, go to work, head office | getting back to office or work | |
school | open school, back school, reopen school, school reopen | return to or reopen of school | |
housing | back home, be back, head home | return back to home after being evacuated | |
communication | COMMUNICATION back, COMMUNICATION return, have steady cell service | return of internet and cable services | |
utilities.heating | heat or heater back, heat or heather return | return of heating services | |
utilities.gas | have gas, on long lines | return of gas availability | |
utilities.water | water back, water return | return of water | |
utilities.power | POWER up, POWER back, POWER return | return of electricity | |
restore | restock, restoration, restore, restored, restoring | restoration of goods and services | |
fund raising/donation | aid, auction benefit sandy, donate, donation, fund raising, fundraiser, funds, grant, nycsandyneeds, programs, sandyaid, sandylove, sandyregistry, drop off | donation of money or goods or fund raising activities | |
repair | renovate, renovating, renovation, repair, repaired, repairing | the repair of infrastructure that was damaged during the disaster | |
rebuild | build back, building back, built back, rebuild, rebuilding, rebuilt, reconstruct | rebuilding infrastructure or neighborhoods and communities that were destroyed by the disaster | |
recover | back after sandy, back after storm, bounce back, bounced back, first time since sandy, first time since storm, recover, recovering, recovery, sandyrecovery, store shelves full | the recovery of life and the city after the disaster | |
humanity | help, help and serve, help neighbor, help out, help victims, help with, offer goods, sandyhelp, sandyvolunteer, teaforhumanity, volunteer, volunteering, | relief actions and efforts around the disaster | |
relief | hurricanerelief, relief, sandyrelief | offering or asking for help and volunteers | |
transportation in general | Transportation reopen/open, MTA reopen/open | the restoration of transportation services | |
transportation.traffic | no traffic, no jam, no congestion | recovery of traffic | |
transportation.subway | TRANSIT reopen/open | restoration of subway systems | |
transportation.bus | bus line reopen/open, megabus reopen/open | restoration and availability of the bus system | |
transportation.ferry | ferry reopen/open | reopen and availability of the ferry services | |
transportation.road | ROAD reopen/open | reopen of closed roads, streets, bridges and tunnels | |
transportation.airport | airport, JFK, John F. Kennedy International Airport, LGA, LaGuardia Airport, EWR, or Newark International Airport open/reopen | reopen of airports or the restoration of normal flights | |
stock | post-sandy stock up | stocking up on supplies after sandy | |
Others | others | N/A |
3.3. Data Annotation
3.4. Data Preprocessing and Classification
3.5. Experimental Results
Category | Precision | Recall | F1-Score | Sub-Category | Number |
---|---|---|---|---|---|
recovery.relief | 0.923 | 0.923 | 0.923 | recovery.relief, recovery.humanity, recovery.funding | 1751 |
impact.utilities.gas | 0.920 | 0.849 | 0.880 | impact.utilities.gas | 110 |
preparedness.prepare | 0.908 | 0.887 | 0.897 | preparedness.prepare, preparedness.Stock, preparedness.prepareforoutage | 1304 |
impact.utilities | 0.874 | 0.831 | 0.851 | impact.communication, impact.utilities.heating, impact.utilities.water, impact.utilities.power | 912 |
impact.flood | 0.853 | 0.869 | 0.856 | impact.flood | 404 |
preparedness.shelter_in_place | 0.838 | 0.840 | 0.832 | preparedness.shelter_in_place | 237 |
impact.school | 0.832 | 0.831 | 0.826 | impact.school | 196 |
impact.postsandy | 0.828 | 0.817 | 0.822 | impact.damage | 939 |
response.clearnup | 0.807 | 0.832 | 0.813 | response.clearnup | 151 |
others.others | 0.806 | 0.664 | 0.726 | others.others | 1464 |
response.housing | 0.778 | 0.835 | 0.800 | response.housing | 187 |
recovery.recover | 0.689 | 0.733 | 0.704 | recovery.recover | 181 |
recovery.work | 0.663 | 0.755 | 0.687 | recovery.work | 86 |
recovery.utilities | 0.614 | 0.750 | 0.664 | recovery.communication, recovery.utilities.heating, recovery.utilities.water, recovery.utilities.power | 143 |
preparedness.evacuation | 0.585 | 0.723 | 0.644 | preparedness.evacuation, response.escape | 134 |
impact.work | 0.543 | 0.559 | 0.526 | impact.work | 74 |
recovery.business | 0.500 | 0.634 | 0.550 | recovery.business, recovery.transportation, recovery.transportation.airport, recovery.transportation.bus, recovery.transportation.ferry, recovery.transportation.road, recovery.transportation.subway, recovery.transportation.traffic, recovery.transportation.train | 120 |
impact.casualty | 0.480 | 0.758 | 0.572 | impact.casualty | 55 |
impact.business | 0.445 | 0.807 | 0.569 | impact.business, impact.impact, impact.work, impact.transportation, impact.transportation.airport, impact.transportation.bus, impact.transportation.ferry, impact.transportation.road, impact.transportation.subway, impact.transportation.traffic, impact.transportation.train | 535 |
preparedness.event_tracking | 0.300 | 0.655 | 0.399 | preparedness.event_tracking | 61 |
response.rescue | 0.050 | 0.100 | 0.067 | response.rescue | 20 |
recovery.rebuild | 0.000 | 0.000 | 0.000 | recovery.rebuild | 21 |
4. Disaster Situation Analysis
4.1. Topic Trend over Time
4.2. Topics in Space
5. Conclusions
Supplementary Files
Supplementary File 1Author Contributions
Conflicts of Interest
Acknowledgement
References
- Neal, D.M. Reconsidering the phases of disaster. Int. J. Mass Emerg. Disasters 1997, 15, 239–264. [Google Scholar]
- U.S. Department of Education. Action Guide for Emergency Management at Institutions of Higher Education. 2010. Available online: http://rems.ed.gov/docs/rems_ActionGuide.pdf (accessed on 7 June 2015). [Google Scholar]
- FEMA 1998 Animals in Disaster: Module Awareness and Preparedness. Available online: http://training.fema.gov/EMIWeb/downloads/is10comp.pdf (accessed on 7 June 2015).
- Pu, C.; Kitsuregawa, M. Big Data and Disaster Management: A Report from the JST/NSF Joint Workshop. Georgia Institute of Technology, CERCS. 2013. Available online: https://grait-dm.gatech.edu/wp-content/uploads/2014/03/BigDataAndDisaster-v34.pdf (accessed on 7 June 2015).
- Vieweg, S.; Hughes, A.L.; Starbird, K.; Palen, L. Microblogging during two natural hazards events: What Twitter may contribute to situational awareness. In Proceedings of the 2010 SIGCHI Conference on Human Factors in Computing Systems, Atlanta, GA, USA, 10–15 April 2010.
- Kumar, S.; Barbier, G.; Abbasi, M.A.; Liu, H. TweetTracker: An analysis tool for humanitarian and disaster relief. In Proceedings of the Fifth International Conference on Weblogs and Social Media, ICWSM, Barcelona, Spain, 17–21 July 2011.
- Blanchard, H.; Carvin, A.; Whitaker, M.E.; Fitzgerald, M.; Harman, W.; Humphrey, B. White Paper: The Case for Integrating Crisis Response with Social Media; American Red Cross: Washington, DC, USA, 2012. [Google Scholar]
- Cameron, M.A.; Power, R.; Robinson, B.; Yin, J. Emergency situation awareness from twitter for crisis management. In Proceedings of the 21st International Conference Companion on World Wide Web, Lyon, France, 16–20 April 2012.
- Savage, M.; Devine, F.; Cunningham, N.; Taylor, M.; Li, Y.; Hjellbrekke, J.; Roux, B.L.; Friedman, S.; Miles, A. A new model of social class? Findings from the BBC’s Great British class survey experiment. Sociology 2013, 47, 219–250. [Google Scholar] [CrossRef] [Green Version]
- Imran, M.; Elbassuoni, S.; Castillo, C.; Diaz, F.; Meier, P. Practical extraction of disaster-relevant information from social media. In Proceedings of the 22nd International Conference on World Wide Web Companion, Rio de Janeiro, Brazil, 13–17 May 2013.
- Purohit, H.; Castillo, C.; Diaz, F.; Sheth, A.; Meier, P. Emergency-relief coordination on social media: Automatically matching resource requests and offers. First Monday 2013, 19. [Google Scholar] [CrossRef]
- Ashktorab, Z.; Brown, C.; Nandi, M.; Culotta, A. Tweedr: Mining twitter to inform disaster response. In Proceedings of the 11th International ISCRAM Conference, University Park, PA, USA, 18–21 May 2014.
- Huang, Q.; Xu, C. A Data-driven framework for archiving and exploring social media data. Ann. GIS 2014, 20, 265–277. [Google Scholar]
- Warfield, C. The Disaster Management Cycle. 2008. Available online: http://www.gdrc.org/uem/disasters/1-dm_cycle.html (accessed on 7 June 2015).
- Vieweg, S. Situational Awareness in Mass Emergency: A Behavioral and Linguistic Analysis of Microblogged Communications. Ph.D. Thesis, University of Colorado at Boulder, Boulder, CO, USA, 2012. [Google Scholar]
- Meier, P. Digital Disaster Response to Typhoon Pablo. Available online: http://voices.nationalgeographic.com/2012/12/19/digital-disaster-response/ (accessed on 7 June 2015).
- Sakaki, T.; Okazaki, M.; Matsuo, Y. Earthquake shakes Twitter users: Real-time event detection by social sensors. In Proceedings of the 19th International Conference on World Wide Web, Raleigh, NC, USA, 26–30 April 2010.
- Signorini, A.; Segre, A.M.; Polgreen, P.M. The use of Twitter to track levels of disease activity and public concern in the US during the influenza A H1N1 pandemic. PLoS ONE 2011, 6. [Google Scholar] [CrossRef] [PubMed]
- Kent, J.D.; Capello, H.T., Jr. Spatial patterns and demographic indicators of effective social media content during the Horsethief Canyon fire of 2012. Cartogr. Geogr. Inf. Sci. 2013, 40, 78–89. [Google Scholar] [CrossRef]
- Mandel, B.; Culotta, A.; Boulahanis, J.; Stark, D.; Lewis, B.; Rodrigue, J. A demographic analysis of online sentiment during hurricane irene. In Proceedings of the Second Workshop on Language in Social Media, Atlanta, GA, USA, 13 June 2012.
- Spinsanti, L.; Ostermann, F. Automated geographic context analysis for volunteered information. Appl. Geogr. 2013, 43, 36–44. [Google Scholar] [CrossRef]
- Gao, H.; Barbier, G.; Goolsby, R. Harnessing the crowdsourcing power of social media for disaster relief. IEEE Intell. Syst. 2011, 26, 10–14. [Google Scholar] [CrossRef]
- Schnebele, E.; Cervone, G. Improving remote sensing flood assessment using volunteered geographical data. Nat. Hazards Earth Syst. Sci. 2013, 13, 669–677. [Google Scholar] [CrossRef]
- Schnebele, E.; Cervone, G.; Kumar, S.; Waters, N. Real time estimation of the Calgary floods using limited remote sensing data. Water 2014, 6, 381–398. [Google Scholar] [CrossRef]
- Schnebele, E.; Oxendine, C.; Cervone, G.; Ferreira, C.M.; Waters, N. Using non-authoritative sources during emergencies in urban areas. In Computational Approaches for Urban Environments; Springer: Berlin, Germany, 2015; pp. 337–361. [Google Scholar]
- Owen, S.; Anil, R.; Dunning, T.; Friedman, E. Mahout in Action; Manning Publications Co.: Greenwich, CT, USA, 2011. [Google Scholar]
- Xiao, Y.; Huang, Q.; Wu, K. Understanding social media data for disaster management. Nat. Hazards 2015. [Google Scholar] [CrossRef]
- Oh, O.; Kwon, K.H.; Rao, H.R. An exploration of social media in extreme events: Rumor theory and twitter during the Haiti Earthquake 2010. In Proceedings of the 2010 ICIS, Saint Louis, MO, USA, 10–20 August 2010.
- Goodchild, M.F.; Li, L. Assuring the quality of volunteered geographic information. Spat. Stat. 2012, 1, 110–120. [Google Scholar] [CrossRef]
- De Albuquerque, J.P.; Herfort, B.; Brenning, A.; Zipf, A. A geographic approach for combining social media and authoritative data towards identifying useful information for disaster management. Int. J. Geogr. Inf. Sci. 2015, 29, 667–689. [Google Scholar] [CrossRef]
© 2015 by the authors; licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution license (http://creativecommons.org/licenses/by/4.0/).
Share and Cite
Huang, Q.; Xiao, Y. Geographic Situational Awareness: Mining Tweets for Disaster Preparedness, Emergency Response, Impact, and Recovery. ISPRS Int. J. Geo-Inf. 2015, 4, 1549-1568. https://doi.org/10.3390/ijgi4031549
Huang Q, Xiao Y. Geographic Situational Awareness: Mining Tweets for Disaster Preparedness, Emergency Response, Impact, and Recovery. ISPRS International Journal of Geo-Information. 2015; 4(3):1549-1568. https://doi.org/10.3390/ijgi4031549
Chicago/Turabian StyleHuang, Qunying, and Yu Xiao. 2015. "Geographic Situational Awareness: Mining Tweets for Disaster Preparedness, Emergency Response, Impact, and Recovery" ISPRS International Journal of Geo-Information 4, no. 3: 1549-1568. https://doi.org/10.3390/ijgi4031549
APA StyleHuang, Q., & Xiao, Y. (2015). Geographic Situational Awareness: Mining Tweets for Disaster Preparedness, Emergency Response, Impact, and Recovery. ISPRS International Journal of Geo-Information, 4(3), 1549-1568. https://doi.org/10.3390/ijgi4031549