Next Article in Journal
The City of Tomorrow from… the Data of Today
Previous Article in Journal
Random Forest-Based Landslide Susceptibility Mapping in Coastal Regions of Artvin, Turkey
 
 
Search for Articles:
Title / Keyword
Author / Affiliation / Email
Journal
Article Type
 
 
Advanced Search
 
Section
Special Issue
Volume
Issue
Number
Page
 
Journals
IJGI
Volume 9
Issue 9
10.3390/ijgi9090551
ijgi-logo
Submit to this Journal Review for this Journal Propose a Special Issue
► Article Menu

Article Menu

share Share announcement Help format_quote Cite question_answer Discuss in SciProfiles
first_page
settings
Order Article Reprints
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Review

GIS-Based Emotional Computing: A Review of Quantitative Approaches to Measure the Emotion Layer of Human–Environment Relationships

by
Yingjing Huang
1,
Teng Fei
1,*,
Mei-Po Kwan
2,3,4,
Yuhao Kang
5,
Jun Li
1,
Yizhuo Li
1,
Xiang Li
6 and
Meng Bian
7
1
School of Resource and Environmental Sciences, Wuhan University, Wuhan 430000, China
2
Department of Geography and Resource Management, The Chinese University of Hong Kong, Shatin, Hong Kong, China
3
Institute of Space and Earth Information Science, The Chinese University of Hong Kong, Shatin, Hong Kong, China
4
Department of Human Geography and Spatial Planning, Utrecht University, 3584 CB Utrecht, The Netherlands
5
Geospatial Data Science Lab, Department of Geography, University of Wisconsin-Madison, Madison, WI 53706, USA
6
Institute of Surveying and Mapping, Information Engineering University, Zhengzhou 450000, China
7
School of Remote Sensing and Information Engineering, Wuhan University, Wuhan 430000, China
*
Author to whom correspondence should be addressed.
ISPRS Int. J. Geo-Inf. 2020, 9(9), 551; https://doi.org/10.3390/ijgi9090551
Submission received: 22 July 2020 / Revised: 5 September 2020 / Accepted: 13 September 2020 / Published: 15 September 2020
Browse Figures
Versions Notes

Abstract

:
In recent years, with the growing accessibility of abundant contextual emotion information, which is benefited by the numerous georeferenced user-generated content and the maturity of artificial intelligence (AI)-based emotional computing technics, the emotion layer of human–environment relationship is proposed for enriching traditional methods of various related disciplines such as urban planning. This paper proposes the geographic information system (GIS)-based emotional computing concept, which is a novel framework for applying GIS methods to collective human emotion. The methodology presented in this paper consists of three key steps: (1) collecting georeferenced data containing emotion and environment information such as social media and official sites, (2) detecting emotions using AI-based emotional computing technics such as natural language processing (NLP) and computer vision (CV), and (3) visualizing and analyzing the spatiotemporal patterns with GIS tools. This methodology is a great synergy of multidisciplinary cutting-edge techniques, such as GIScience, sociology, and computer science. Moreover, it can effectively and deeply explore the connection between people and their surroundings with the help of GIS methods. Generally, the framework provides a standard workflow to calculate and analyze the new information layer for researchers, in which a measured human-centric perspective onto the environment is possible.

1. Introduction

The human–environment relationship has always been a key issue in geography in terms of the interaction between human society and its activities and geographical environment [1,2,3]. There is a significant body of literature that investigates such relationship from various aspects, including evaluation [4], modeling [5], and application [6], and these studies provide a solid foundation for the burgeoning and interdisciplinary fields, such as quality of life (QOL) [7].
Presently, there are two main forms to measure the interaction between human and environment: the objective indices of environment attributes, such as evaluation index systems, and the subjective indices from human perceptions, such as sense of place. As for the former, the evaluation index systems usually are composed of indices that cover aspects such as accessibility, density, land use, and land cover changes, and economics [8,9]. Nevertheless, the selection of such indices is limited to current understanding of the interaction between humans and environment. In other words, human–environment relationship may be underrepresented with such methodology. As for the latter, the literature delivered various questionnaires to obtain indigenous people’s sense of place in three place constructs: place identity, place dependence, and place attachment [10]. Although subjective indices like sense of place seem to draw a synthetical picture of human–environment relationship from the humanistic perspective, they emphasize portraying people’s abstract emotional connection with their inhabited locality. Similarly, the items of questionnaires are still constrained by the state of knowledge.
On the one hand, the concept of “place” is more than a location or a restricted space but a reality to be understood from the perspectives of people. “Place” reflects the way people perceive and experience the surrounding environment [11]. On the other hand, emotion, which dramatically influences human consciousness [12], serves as a bridge between the environment (both physical and social environment) and the final experience that a person obtained from the environment [13,14,15,16,17]. Therefore, exploring collective emotion of places plays a conspicuous role in human–environment relationship research. With the advent of big data era and the maturity of artificial intelligence (AI)-based emotional computing techniques, massive individual-level emotional information is available to scientists. Over the last decade, emotional computing has gained momentum, and it provides possibilities for developing a new layer of emotion information for human–environment relationship research.
In this paper, we present a novel research framework, which equips collective emotion with geographic information system (GIS) methods to quantitatively measure the emotion layer of human–environment relationship, namely GIS-based emotional computing. This framework aims to provide a standard workflow for calculating and analyzing the new information layer in different geographical granularities. These results allow further study about understanding human behavior in a certain environment and planning from a human-centric perspective. Crucially, we expect that this framework provides complementary information to existing methodologies, rather than supplant them (see Figure 1). We define the term GIS-based emotional computing as a data-driven methodology that extracts emotional characteristics in places and analyzes it with GIS methods. Compared to affective computing proposed by Picard [18], GIS-based emotional computing focuses on collective emotion in places rather than individual emotional states. We advocate that the GIS-based emotional computing can be a prominent research framework, and a useful tool, for dynamic diagnosis of the human–environment relationship in different geographical and temporal granularities, with collective emotions obtained from on-the-fly user-generated contents (UGCs).
As illustrated in Figure 2, the framework comprises three key steps: first, collecting environment and emotion related data in various context from data sources such as social network sites and official sites; second, exploring and cleaning data and extracting emotional information from georeferenced emotion related data based on its data structure; and third, conducting spatiotemporal analysis using GIS methods such as spatial interpolation and kernel density analysis in order to provide researchers with additional insights into the complex human–environment relationship. To elaborate the contents of each step, the rest of this paper is structured as follows. In Section 2, step 1 and step 2 of GIS-based emotional computing will be stated. Specifically, we classify three types of data sources of human emotions in the existing literature and elaborate their current advantages and weakness. On the basis of data sources and data structure, we introduce several popular methods of emotion recognition. Additionally, Section 3 presents the step 3 of GIS-based emotional computing, and three analysis directions show the potential of GIS methods in emotion analysis. Section 4 summarizes the current challenges and opportunities on GIS-based emotional computing. Finally, in Section 5, we end the paper with a number of key conclusions.

2. Emotion Recognition

Emotion organizes our cognitive processes and action tendencies [19] and influences individuals’ social interactions in systematic ways [20,21,22,23]. Furthermore, studies suggest that emotional expressions have a potential impact on personality, even can predict life outcomes (e.g., marriage and personal well-being) of decades later [24,25]. Since measuring a person’s emotional state is one of the most vexing problems in emotional studies, emotion recognition plays a dominant role in GIS-based emotional computing. Generally, the data sources of human emotions include the following three types: self-report, body sensor, and UGC. According to data structure, the methods of emotion recognition can be classified into four types: self-reported, body sensor-based, UGC text-based, and UGC image-based. As such methods continue to be improved, we will introduce several popular methods of each type in this section.

2.1. Self-Reported

Self-report usually collects emotional information by online or offline questionnaires and interviews. It is a traditional and classic data source. Although alternative data sources of human emotions emerged one after another, self-report remains a popular choice.
A substantial body of research on self-reported emotional information proves its easy interpretability, the richness of information, and sheer practicality [26,27,28]. For example, a recent study obtained the daily time, location, activity, mode of transportation, and emotions of female sex workers in their diaries [29]. However, the response rate of questionnaires, in most studies, remains relatively low [10,30], and these studies rest upon the assumption that respondents can represent those who refused to respond. Moreover, prior literature has also shown that people have blind spots in their self-knowledge, and they may not always understand their emotional states very accurately [31,32].
There are two mainstream self-reported scales wildly utilized in emotional research. One common test called Satisfaction With Life (SWL) was put forward by Diener, Larsen [33]: its score reflects the extent to which a person feels that his/her life is worthwhile [34,35]. Continued efforts have been made by scholars and policymakers to measure and promote subjective well-being for individuals and groups at the community level with the help of SWL [36,37]. Applications of SWL have been implemented at regional, national [38], and global levels [39,40,41].
However, the SWL test is restricted to only rate people’s happiness. A two-factor model of Positive and Negative Affect Schedule (PANAS), developed by Watson et al. [42], has been used more extensively according to the self-report emotion literature. This model is comprised of two 10-item emotion scales. These items are words that describe different feelings and emotions in Positive Affect (PA) and Negative Affect (NA), such as interested and irritable to describe a person’s emotional state. Updated versions of the PANAS were developed. For instance, to assess specific emotional states, Watson et al. [42] created a 60-item extended version of the PANAS (the PANAS-X) that can measure 11 specific emotions including fear, sadness, guilt, hostility, shyness, fatigue, surprise, joviality, self-assurance, attentiveness, and serenity. Meanwhile, a 30-item, modified version of the PANAS designed for children (PANAS-C) was proposed by Laurent et al. [43], and provides a brief, useful way to differentiate anxiety from depression in children.

2.2. Body Sensor

In recent decades, with the motivation of making computers that can assess and even understand users’ emotional states, existing literature of human-computer interaction (HCI) has applied sensing technology to collect users’ physiological signals in different emotional states [44,45,46]. Stationary and wearable sensors are both commonly utilized to collect the changes in the physiological signals of users [47]. As an example, a wearable sensor platform was developed by Choi et al. [48], which monitored mental stress.
Even if people do not explicitly express their emotions through facial expressions, changes in their physiological patterns are inevitable and collectible [49]. However, the inherent noise in physiological signals and their non-standard data structures has hampered the wide utilization of such data [49]. Even more, they can only provide datasets with limited sample sizes and short time durations [50,51,52].
There is a popular workflow of body sensor-based methods. Once the physiological signals were collected from multi-sensory devices, signal processing methods were used to extract applicable features from the physiological signals. Then, machine learning algorithms utilize, such features as model inputs to predict emotional state. Generally, five types of physiological signals are widely captured because they are show the correlation of underlying emotional fluctuations [53], including: (1) cardiovascular activities, (2) electrodermal activities, (3) the respiratory system, (4) the electromyogram activities, and (5) brain activities. Likewise, there are numerous options of signal processing methods (e.g., Fourier transform, wavelet transform, thresholding, and peak detection) and machine learning algorithms (e.g., k-nearest neighbor, regression trees, Bayesian network, and support vector machine) in the workflow [49]. For instance, Choi et al. [48] used the k-nearest-neighbor algorithm and the discriminant function analysis to analyze the physiological signals such as galvanic skin response and heat flow, when classifying the emotions.

2.3. UGC Text-Based

When entering the 21st century, the increasing development of social networking sites (SNS) provides unprecedented opportunities to collect massive individual emotional information. Geo-tagged UGC (e.g., microblogs, blogs, and reviews) usually collect from various SNS such as Twitter, Amazon, Weibo, and Flickr.
These UGC offer rich information about users’ emotions in different settings such as family, work, and travel. Moreover, those petabytes of data have high spatiotemporal resolution, and their collection is convenient and timesaving. Nevertheless, abundant evidence shows that the bias (including emotional bias) exists in big data, and its spatial sparsity still needs to be addressed [54]. Furthermore, although geo-information shows that UGC can be related to places, emotions may not be directly affected by the surrounding environments since they may be influenced by the activities at specific places. As for UGC text, it is difficult to extract emotional information within complex sentences (e.g., multiple negations and metaphors). There is no common model or algorithm to detect emotions in different languages. Besides, the same sentence may have different meanings in diverse contexts and cultures.
Early research in this area focused on identifying and quantifying the polarity (i.e., positive or negative) of natural language text. For example, Pang, Lee [55], and Read [56] utilized support vector machine and Naïve Bayes (NB) classifier to extract emotional polarity from large volumes of movie reviews and emoticons. Since human emotions are very subjective and complex, setting just positive, negative, and neutral categories is too coarse to capture the full details of human emotions [57]. Recently, there has been an increased emphasis on extracting multi-dimensional human emotions from text by developing emotion lexicons such as WordNet-Affect (WNA) [58], EmoSenticNet (ESN) [59], and word-emotion lexicon [60].
Moreover, there is research that aims to improve the existing emotion lexicons to make it suitable for different settings. For example, a novel emotion lexicon was developed by Chakraverty et al. [61], which was compiled by integrating information from three aspects: the domain of psychology, the lexical ontology WordNet, and the set of emoticons and slangs commonly used in web jargon.

2.4. UGC Image-Based

UGC images contain the advantages and disadvantages of UGC we discussed above. With regard to images, their quantity is less than UGC text. Although images are informative, they resist interpretation. With the development of technology in computer vision, image-based emotion extraction methods are becoming more and more mature. Detecting facial expressions is a fashionable image-based extraction method. Human faces provide one of the most powerful, versatile, and natural means of communicating a wide array of mental states [62], and the relationship between facial muscles and discrete emotion in various cultures is consistent [63]. Most of the techniques on facial expression-based emotion extraction methods are inspired by the work of Ekman et al. [64], who produced the facial action coding system (FACS). Still, many early facial-expression datasets [65,66] were collected under “lab-controlled” settings where participants were asked to artificially generate some specific expressions, which do not provide a good representation of natural facial expressions [67]. In recent years, several studies have utilized robust computational algorithms to automatically capture human emotions from individuals’ facial expressions in photos. Recent efforts like that of Yu [68] have proposed a method that contains a face detection module based on the ensemble of three face detectors, followed by a classification module with the ensemble of multiple deep convolutional neural networks (CNN). What’s more, several commercial application programming interfaces (APIs), such as Face++ Detect API [14] and Microsoft Azure Emotion API [69], are available for scientific research.

3. Analyzing Collective Emotion with GIS

Generally, there are following three analysis directions in the current emotion studies of human–environment relationship: (1) the temporal and spatial distribution of human emotions, (2) the impact of environment on collective emotion, and (3) collective emotion as indicator. In this section, we will illustrate how to apply GIS methods to these studies.

3.1. The Temporal and Spatial Distribution of Human Emotions

Due to the changes of the environment, people may have different emotional experiences at different times and places. Understanding the distribution of human emotions is a basic topic in GIS-based emotional computing, and it is broadly observed at different granularities in the existing literature [70,71,72,73]. For example, the diurnal and seasonal rhythms of the changes in individual-level emotions can be identified by natural language processing from Twitter text [74]. Additionally, Flickr photos with geotags are traced and analyzed to extract the trend in the changes of human emotions between 2004 and 2014 [75] at the international level. Moreover, the World Happiness Report [40] surveys the state of global happiness. Visualization of the spatiotemporal distribution of human emotions at the national scale is widely carried out in different countries [38,76,77]. Moreover, researchers have begun to study the distribution of human emotions at fine granularities including communities and parks [78,79]. However, the previous emotion maps either displayed the discontinuous sample points or a simple regionalization of emotions averages to various areal units at a certain scale because of spatial sparsity of the sampling data. In the GIS-based emotional computing framework, evenly distributed sampling points and GIS methods, such as spatial sparsity would be used to improve the accuracy. Further improvements will be discussed in Section 4.

3.2. The Impact of Environment on Collective Emotion

Scholars have shown that the surrounding environment has impacts on collective emotion [10,11,12]. It appears that both physical and social environmental factors are related to collective emotion [80,81,82]. On the one hand, literature from environmental psychology has explored the interactions between collective emotion and physical environmental factors such as naturalness [83], density, accessibility, and so forth. Most of these studies suggested that happiness is lower in less natural landscapes, denser populations, and in areas with more traffic inconveniences. On the other hand, the relationships between collective emotion and socio-economic attributes have been reported widely in social science. For instance, Easterlin [13] found that there is a significant positive association between income and happiness within countries. Table 1 shows what kinds of environmental factors and at what scales have related works examined the impact of environment on human emotions.
Nevertheless, such studies are usually limited to a fixed granularity, and it is difficult to tell whether scale affects the interactions between collective emotion and environmental factors. Furthermore, the interactions are mostly qualitative rather than quantitative. With integrating GIS methods to emotion analysis, solving these problems can be possible. For example, as for the interaction between collective emotion and the accessibility of an environmental feature such as a water body or green vegetation, separately establishing several buffers will help us to explore how distance from an environmental feature has an impact on collective emotion.

3.3. Collective Emotion as Indicators

Since Goodchild [93] proposed the concept of volunteered geographic information (VGI), which suggests that general individuals can be compared to environmental sensors, a variety of studies have tried to explore urban development patterns using individual-level big geospatial data, called “social sensing” [94]. In the context of human–environment relationship, collective emotion has been served as a system of indicators describing the interaction of human and environment and supporting policymakers to make decisions [95].
Collective emotion provides a new insight to understand crisis events that range from natural disasters to man-made conflicts and how people respond to such rapid environment changes [96,97]. For example, Chien et al. [98] evaluated sentiment analysis of Flickr text in disaster management at the time of the strike of a typhoon in Taiwan, China in 2009. Likewise, Dewan et al. [99] analyzed the emotion of textual and visual content obtained from Facebook during the terror attacks in Paris, France, 2015.
In recent years, collective emotion in places is gradually applied to guide urban planning [100,101]. A recent work analyzed the spatial characteristics of residents’ emotions in the city and at different types of places in the city of Nanjing, China, to provide evidence that could help optimize urban space development [102]. Likewise, another research measured pedestrians’ emotions, and results offered initial evidence that certain spaces or spatial sequences do cause emotional arousal [103]. A semantic and sentiment analysis was conducted to understand the perceptions of people towards their living environments by examining online neighborhood textual reviews [79] and nearby neighborhood street view images [104].
Although discovering valuable insights, these studies have great possibilities to obtain more accurate results by GIS-based emotional computing. Firstly, the framework focuses on the multisource data collection methods, which improve the volume and tolerance to the noise of emotion data. Moreover, the integration of multiple disciplines, such as GIScience, computer science, and social science, brings excellent calculation and analysis abilities that enable researches to perceive dynamic and complex responses to places in near real-time. For instance, poorly timed traffic lights at crossroads and a situation of severe earthquake both became detectable for immediately deciding the assistance policies.

4. Challenges and Opportunities

While GIS-based emotional computing offers rich insights into a better understanding of human–environment relationship, it poses a number of challenges, highlighted below: firstly, different emotional baselines may exist in different regions and even between individuals. In other words, emotional experiences may be influenced by many factors such as individuals’ memory, life history, culture, age, and gender. Diener, Diener [105] found that self-esteem is strongly related to subjective well-being (analogous to general positive emotions such as happiness) in individualist cultures (such as the United States), but only has limited effects in collectivist cultures (such as China). In fact, prior literature has shown that how and when emotions are experienced may differ from one culture to another [106,107,108,109]. This difference is also affected by population’s age and gender characteristics [110,111]. Therefore, researchers should take the demographic composition and culture of different places into account when conducting research with GIS-based emotional computing.
Spatial sparsity of data on human emotions is an important issue to be solved. Although emotion maps have been created by studies at different spatial scales [84,112], the sampling data is an occurrence collection. In other words, these are presence-only data without absence data. Therefore, the previous emotional studies were either the interpolations of sampling points, which inevitably involved overfitting, the discontinuous display of sample points [112], or simply the regionalization of emotions averages to various areal units at a certain scale [113]. However, for emotional expressions that cannot be observed, it is hard to determine the emotions that are associated with places. In a recent work, Li et al. [114] utilized MaxEnt [115], a species distribution model, which is intensively applied in ecology, to map the geographic distribution of human emotions at a global scale but fell short of applying to other granularity such as city and community. Yet, there is still no model available that all scholars have agreed upon through a consensus to describe and predict the continuous distribution of human emotions based on presence-only data.
Another challenge is that spaces with various land use mix (LUM) [116] may trigger different emotions. People usually express emotional responses to “place” rather than “space” [8], but multiple places may overlap in the same space at different times. For a specific street, people may stay on the street for work during the daytime while visiting bars at night. The locale and its spatiotemporal dynamics may influence human emotions and are supposed to be taken into consideration for GIS-based emotional computing.
It is important to note that SNS emotional information may bring systematic bias for GIS-based emotional computing. SNS users as a sample may not be representative of the total population [117,118]. Besides, due to the potential social pressures imposed by SNS [119,120], users may suppress or exaggerate their emotions. For instance, Huang et al. [121] suggest that the majority of Weibo users tend to post more photos with positive emotions instead of negative emotions, and there are significant differences in place emotion extracted from Weibo and in-situ. Since there is no model that is suitable for all places to rectify the emotions extracted from SNS yet, it is wise to pay attention to the bias of big data when conducting emotion research.
The impact of GIS-based emotional computing is multi-fold. With the help of the framework, the informative emotion layer of human–environment relationship can potentially enrich a variety of fields such as traffic planning, urban safety, human-centric tourism, and evaluating current planning projects. One the one hand, GIS-based emotional computing aims to collect massive multisource georeferenced data and provide state-of-the-art, multidisciplinary techniques for effectively and accurately detecting normalized emotion information from such data. On the other hand, the map from individual emotion to place emotion is promised by using GIS-based spatial analysis. Furthermore, geostatistics is a useful tool for deducing the causality between collective emotion and environmental factors.
There are several opportunities in the current development of GIS-based emotional computing. There has also been research into the connection between human perception and urban space through urban street view imagery, which is another promising dataset that can be employed in GIS based emotion computing [104,122]. Building a multi-source emotional data fusion model can greatly advance the development of GIS-based emotional computing. A good way to obtain a wide range of human emotions in real-world settings is by combining big data (human emotions extracted from UGC) with small data [123] (human emotions captured in reality) based on different cultures and demographic characteristics to calibrate online emotion. Moreover, why people are satisfied with some places instead of others has not yet been extensively investigated. It remains unclear which environmental factors will influence people’s emotions at all scales and how to properly quantify the extent of their influence.

5. Example of Implementing GIS-Based Emotional Computing

The emotion information analyzed by GIS-based emotional computing plays an increasingly vital role in human–environment relationship research, and it serves as a critical component of various applications including resource management, conservation, human geography, crime analysis, real estate, psychology, environmental justice, etc. Hereby we give an example that exhibits the potential to quantify human emotion and serves as a layer in GIS for human–environment relationships study.
The recommendation of tourist sites is a key topic in tourism studies. With GIS-based emotional computing techniques, georeferenced contents uploaded by tourists to photo services in the public domain enrich traditional recommendation systems with an emotion layer. One of our previous studies collected Flickr photos of 80 tourist sites all over the world, and applied spatial clustering to emotion information extracted from photos, for constructing an emotion layer for these tourist sites. Afterward, a map of tourist sites with emotion tendency and a ranking list of global tourist sites based on emotion were drawn, which serve as references for potential tourists. By calculating and analyzing the emotion layer and other layers in GIS, we have also attempted to identify, which natural and non-natural environmental factors may have an impact on visitor’s emotions [84]. The workflow of the example can be seen in Figure 3. This example illustrated that, with GIS-based emotional computing, it is possible to cater to tourist preferences for accurate advertising and management of the tourist industry.

6. Conclusions

In this paper, we propose a new conceptual framework: GIS-based emotional computing, for providing a new approach to measure the emotion layer of human–environment relationship. The methodology comprises three steps: (1) collecting environment and emotion related data from different data sources, (2) detecting emotional information from georeferenced emotion related data by AI-based emotional computing techniques, and (3) conducting spatiotemporal analysis using GIS. The current literature related to each step was reviewed, and the improvements of GIS-based emotional computing can be done were discussed. The emotion layer reveals deep interactions between human and their surrounding environment, and it reveals “what people real feel” instead of “what people would feel”. GIS-based emotional computing consolidates the cutting-edge technologies of multidisciplinary, such as GIScience, sociology, and computer science, for providing a more effective and accurate avenue to calculate and analyze the emotion layer. It is important to note that GIS-based emotional computing of this scope has only been possible recently, due to the increasing capability of both massive UGC with emotional information and the technologies that take advantage of these resources. This implied that GIS-based emotional computing may have unlimited potential because of developing and advancing technologies. However, while the promise of collective emotion in describing the human–environment relationship is alluring, the challenges above have to be addressed for increased uptake of GIS-based emotional computing.

Author Contributions

Conceptualization and Writing-Original Draft Preparation, Teng Fei and Yingjing Huang; Methodology, Mei-Po Kwan, Xiang Li, and Meng Bian; Investigation, Jun Li and Yizhuo Li; Resources, Yuhao Kang; Writing-Review & Editing, Mei-Po Kwan. All authors have read and agreed to the published version of the manuscript.

Funding

This work is supported by Open Fund of State Laboratory of Information Engineering in Surveying, Mapping and Remote Sensing, Wuhan University (Grant No. 19E02).

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Wu, C. On the core of geography-The regional system of man-land relationship (Man-earth areal system: The core of geographical study). Econ. Geogr. 1991, 3, 7–12. (In Chinese) [Google Scholar] [CrossRef]
  2. Pattison, W.D. The four traditions of geography. J. Geogr. 1964, 63, 211–216. [Google Scholar] [CrossRef] [Green Version]
  3. Yang, Q.; Mei, L. Human-activity-geographical-environment relationship. Syst. Em. Reg. Syst. Econ. Geogr. 2001, 21, 532–537. (In Chinese) [Google Scholar] [CrossRef]
  4. Gao, C.; Lei, J.; Jin, F. The classification and assessment of vulnerability of man-land system of oasis city in arid area. Front. Earth Sci. 2013, 7, 406–416. [Google Scholar] [CrossRef]
  5. Gimblett, R.; Daniel, T.; Cherry, S.; Meitner, M.J. The simulation and visualization of complex human–environment interactions. Landsc. Urban Plan. 2001, 54, 63–79. [Google Scholar] [CrossRef]
  6. Olson, J.M.; Alagarswamy, G.; Andresen, J.A.; Campbell, D.J.; Davis, A.Y.; Ge, J.; Huebner, M.; Lofgren, B.; Lusch, D.P.; Moore, N.J.; et al. Integrating diverse methods to understand climate–land interactions in East Africa. Geoforum 2008, 39, 898–911. [Google Scholar] [CrossRef]
  7. Shafer, C.; Lee, B.K.; Turner, S. A tale of three greenway trails: User perceptions related to quality of life. Landsc. Urban Plan. 2000, 49, 163–178. [Google Scholar] [CrossRef]
  8. Munda, G. Measuring sustainability: A multi-criterion framework. Environ. Dev. Sustain. 2005, 7, 117–134. [Google Scholar] [CrossRef]
  9. Chen, L.; Zhou, G. Evaluation on the man-land relationship coordination degree in Wangcheng District of Changsha City. J. Hum. Settl. West China 2018, 33, 54–58. [Google Scholar] [CrossRef]
  10. Jorgensen, B.S.; Stedman, R.C. Sense of place as an attitude: Lakeshore owners attitudes toward their properties. J. Environ. Psychol. 2001, 21, 233–248. [Google Scholar] [CrossRef]
  11. Tuan, Y.-F. Space and Place: Humanistic Perspective. In Philosophy in Geography; Gale, S., Olsson, G., Eds.; Springer Netherlands: Dordrecht, The Netherlands, 1979; pp. 387–427. [Google Scholar]
  12. Petrantonakis, P.C.; Hadjileontiadis, L.J. Emotion recognition from brain signals using hybrid adaptive filtering and higher order crossings analysis. IEEE Trans. Affect. Comput. 2010, 1, 81–97. [Google Scholar] [CrossRef]
  13. Howell, A.J.; Dopko, R.L.; Passmore, H.-A.; Buro, K. Nature connectedness: Associations with well-being and mindfulness. Pers. Individ. Differ. 2011, 51, 166–171. [Google Scholar] [CrossRef]
  14. Nisbet, E.K.; Zelenski, J.M. Underestimating Nearby Nature: Affective Forecasting Errors Obscure the Happy Path to Sustainability. Psychol. Sci. 2011, 22, 1101–1106. [Google Scholar] [CrossRef] [PubMed]
  15. Capaldi, C.A.; Dopko, R.L.; Zelenski, J.M. The relationship between nature connectedness and happiness: A meta-analysis. Front. Psychol. 2014, 5, 976. [Google Scholar] [CrossRef] [Green Version]
  16. Easterlin, R.A. Does Economic Growth Improve the Human Lot? Some Empirical Evidence. In Nations and Households in Economic Growth; David, P.A., Reder, M.W., Eds.; Academic Press: Cambridge, MA, USA, 1974; pp. 89–125. [Google Scholar]
  17. Singh, V.K.; Atrey, A.; Hegde, S. Do individuals smile more in diverse social company? Studying smiles and diversity via social media photos. In Proceedings of the 25th ACM international conference on Multimedia, Mountain View, CA, USA, 23–27 October 2017; pp. 1818–1827. [Google Scholar]
  18. Picard, R.W. Affective Computing; MIT Press: Cambridge, MA, USA, 2000. [Google Scholar]
  19. Picard, R.W. Affective computing: Challenges. Int. J. Hum.-Comput. Stud. 2003, 59, 55–64. [Google Scholar] [CrossRef]
  20. Barrett, K.C.; Campos, J.J. Perspectives on emotional development II: A functionalist approach to emotions. In Handbook of Infant Development, 2nd ed.; Wiley Series on Personality Processes; John Wiley & Sons: Oxford, UK, 1987; pp. 555–578. [Google Scholar]
  21. Ekman, P. An argument for basic emotions. Cogn. Emot. 1992, 6, 169–200. [Google Scholar] [CrossRef]
  22. Frijda, N.H.; Mesquita, B. The social roles and functions of emotions. In Emotion and Culture: Empirical Studies of Mutual Influence; American Psychological Association: Washington, DC, USA, 1994; pp. 51–87. [Google Scholar] [CrossRef]
  23. Keltner, D.; Kring, A.M. Emotion, social function, and psychopathology. Rev. Gen. Psychol. 1998, 2, 320–342. [Google Scholar] [CrossRef]
  24. Harker, L.; Keltner, D. Expressions of positive emotion in women’s college yearbook pictures and their relationship to personality and life outcomes across adulthood. J. Pers. Soc. Psychol. 2001, 80, 112–124. [Google Scholar] [CrossRef]
  25. Hertenstein, M.J.; Hansel, C.; Butts, A.M.; Hile, S.N. Smile intensity in photographs predicts divorce later in life. Motiv. Emot. 2009, 33, 99–105. [Google Scholar] [CrossRef]
  26. Paulhus, D.L.; Vazire, S. The self-report method. In Handbook of Research Methods in Personality Psychology; The Guilford Press: New York, NY, USA, 2007; pp. 224–239. [Google Scholar]
  27. Lucas, R.E.; Baird, B.M. Global Self-Assessment; American Psychological Association: Washington, DC, USA, 2006; pp. 29–42. [Google Scholar]
  28. Swann, W.B.; Chang-Schneider, C.; McClarty, K.L. Do people’s self-views matter? Self-concept and self-esteem in everyday life. Am. Psychol. 2007, 62, 84–94. [Google Scholar] [CrossRef] [Green Version]
  29. Andrade, E.; Leyva, R.; Kwan, M.-P.; Magis, C.; Stainez-Orozco, H.; Brouwer, K. Women in sex work and the risk environment: Agency, risk perception, and management in the sex work environments of two Mexico-U.S. border cities. Sex. Res. Soc. Policy 2018, 16, 317–328. [Google Scholar] [CrossRef] [PubMed]
  30. Stedman, R.C. Is it really just a social construction? The contribution of the physical environment to sense of place. Soc. Nat. Resour. 2003, 16, 671–685. [Google Scholar] [CrossRef]
  31. Robinson, M.D.; Clore, G.L. Episodic and semantic knowledge in emotional self-report: Evidence for two judgment processes. J. Pers. Soc. Psychol. 2002, 83, 198–215. [Google Scholar] [CrossRef] [PubMed]
  32. Barrett, L.F.; Robin, L.; Pietromonaco, P.R.; Eyssell, K.M. Are women the “more emotional” sex? Evidence from emotional experiences in social context. Cogn. Emot. 1998, 12, 555–578. [Google Scholar] [CrossRef]
  33. Diener, E.; Larsen, R. Temporal stability and cross-situational consistency of affective, behavioral, and cognitive responses. Bord. Glob. World 2009, 39, 7–24. [Google Scholar] [CrossRef]
  34. Diener, E.; Diener, M.; Diener, C. Factors predicting the subjective well-being of nations. J. Pers. Soc. Psychol. 1995, 69, 851–864. [Google Scholar] [CrossRef]
  35. Diener, E.; Inglehart, R.; Tay, L. Theory and validity of life satisfaction scales. Soc. Indic. Res. 2012, 112, 497–527. [Google Scholar] [CrossRef]
  36. White, M.P.; Alcock, I.; Wheeler, B.W.; Depledge, M. Would you be happier living in a greener urban area? A fixed-effects analysis of panel data. Psychol. Sci. 2013, 24, 920–928. [Google Scholar] [CrossRef]
  37. Wheeler, B.W.; White, M.P.; Stahl-Timmins, W.; Depledge, M. Does living by the coast improve health and wellbeing? Health Place 2012, 18, 1198–1201. [Google Scholar] [CrossRef] [Green Version]
  38. Bates, W. Gross national happiness. Asian-Pac. Econ. Lit. 2009, 23, 1–16. [Google Scholar] [CrossRef]
  39. Quercia, D. Don’t worry, be happy: The geography of happiness on Facebook. In Proceedings of the 5th Annual ACM Web Science Conference, Paris, France, 2–4 May 2013. [Google Scholar]
  40. The United Nations Sustainable Development Solutions Network. World Happiness Report. 2019. Available online: https://worldhappiness.report/ (accessed on 15 July 2020).
  41. Diener, E.; Emmons, R.A.; Larsen, R.J.; Griffin, S. The satisfaction with life scale. J. Pers. Assess. 1985, 49, 71–75. [Google Scholar] [CrossRef] [PubMed]
  42. Watson, D.; Clark, L.A.; Tellegen, A. Development and validation of brief measures of positive and negative affect: The PANAS scales. J. Pers. Soc. Psychol. 1988, 54, 1063–1070. [Google Scholar] [CrossRef] [PubMed]
  43. Laurent, J.; Catanzaro, S.J.; Joiner, T.E.; Rudolph, K.D.; Potter, K.I.; Lambert, S.; Osborne, L.; Gathright, T. A measure of positive and negative affect for children: Scale development and preliminary validation. Psychol. Assess. 1999, 11, 326–338. [Google Scholar] [CrossRef]
  44. Brave, S.; Nass, C. Emotion in human–computer interaction. In The Human-Computer Interaction Handbook; Jacko, J.A., Sears, A., Eds.; L. Erlbaum Associates Inc.: Hillsdale, NJ, USA, 2002; pp. 81–96. [Google Scholar]
  45. Muller, M.J.; Wharton, C. Toward an HCI research and practice agenda based on human needs and social responsibility. In Proceedings of the Human Factors in Computing Systems, CHI’97: Looking to the Future, Atlanta, GA, USA, 22–27 March 1997. [Google Scholar] [CrossRef]
  46. Kapoor, A.; Burleson, W.; Picard, R.W. Automatic prediction of frustration. Int. J. Hum.-Comput. Stud. 2007, 65, 724–736. [Google Scholar] [CrossRef]
  47. Ollander, S.; Godin, C.; Campagne, A.; Charbonnier, S. A comparison of wearable and stationary sensors for stress detection. In Proceedings of the IEEE International Conference on Systems, Man, and Cybernetics, Budapest, Hungary, 9–12 October 2016; pp. 004362–004366. [Google Scholar]
  48. Choi, J.; Ahmed, B.; Gutierrez-Osuna, R. Development and evaluation of an ambulatory stress monitor based on wearable sensors. IEEE Trans. Inf. Technol. Biomed. 2011, 16, 279–286. [Google Scholar] [CrossRef] [Green Version]
  49. Rani, P.; Liu, C.; Sarkar, N.; Vanman, E.J. An empirical study of machine learning techniques for affect recognition in human–robot interaction. Pattern Anal. Appl. 2006, 9, 58–69. [Google Scholar] [CrossRef]
  50. Healey, J.; Picard, R. Detecting stress during real-world driving tasks using physiological sensors. IEEE Trans. Intell. Transp. Syst. 2005, 6, 156–166. [Google Scholar] [CrossRef] [Green Version]
  51. Arroyo, I.; Cooper, D.G.; Burleson, W.S.; Woolf, B.P.; Muldner, K.; Christopherson, R. Emotion sensors go to school. In Proceedings of the Artificial Intelligence in Education, Brighton, UK, 6–10 July 2009. [Google Scholar]
  52. Woolf, B.; Dragon, T.; Arroyo, I.; Cooper, D.G.; Burleson, W.; Muldner, K. Recognizing and Responding to Student Affect. In Proceedings of the the International Conference on Human-Computer Interaction, San Diego, CA, USA, 19–24 July 2009. [Google Scholar]
  53. Jerritta, S.; Murugappan, M.; Nagarajan, R.; Wan, K. Physiological signals based human emotion Recognition: A review. In Proceedings of the International Colloquium on Signal Processing and Its Applications, Penang, Malaysia, 4–6 March 2011. [Google Scholar]
  54. Goodchild, M.F. The quality of big (geo) data. Dialog- Hum. Geogr. 2013, 3, 280–284. [Google Scholar] [CrossRef]
  55. Pang, B.; Lee, L. A sentimental education: Sentiment analysis using subjectivity summarization based on minimum cuts. In Proceedings of the Association for Computational Linguistics, Barcelona, Spain, 22 July 2004; pp. 271–278. [Google Scholar] [CrossRef] [Green Version]
  56. Read, J. Using emoticons to reduce dependency in machine learning techniques for sentiment classification. In Proceedings of the ACL Student Research Workshop, Ann Arbor, MI, USA, 27 June 2005. [Google Scholar]
  57. Feng, S.; Wang, D.; Yu, G.; Gao, W.; Wong, K.-F. Extracting common emotions from blogs based on fine-grained sentiment clustering. Knowl. Inf. Syst. 2010, 27, 281–302. [Google Scholar] [CrossRef]
  58. Strapparava, C.; Valitutti, A. WordNet affect: An affective extension of WordNet. In Proceedings of the Language Resources and Evaluation, Lisbon, Portugal, 26–28 May 2004. [Google Scholar]
  59. Poria, S.; Gelbukh, A.; Cambria, E.; Hussain, A.; Huang, G.-B. EmoSenticSpace: A novel framework for affective common-sense reasoning. Knowl.-Based Syst. 2014, 69, 108–123. [Google Scholar] [CrossRef] [Green Version]
  60. Mohammad, S.M.; Turney, P.D. Crowdsourcing a word-emotion association lexicon. Comput. Intell. 2012, 29, 436–465. [Google Scholar] [CrossRef] [Green Version]
  61. Chakraverty, S.; Sharma, S.; Bhalla, I. Emotion–location mapping and analysis using twitter. J. Inf. Knowl. Manag. 2015, 14, 1550022. [Google Scholar] [CrossRef]
  62. El Kaliouby, R.; Robinson, P. Mind reading machines: Automated inference of cognitive mental states from video. In Proceedings of the 2004 IEEE International Conference on Systems, Man and Cybernetics, The Hague, The Netherlands, 10–13 October 2004. [Google Scholar]
  63. Ekman, P.; Friesen, W.V. Constants across cultures in the face and emotion. J. Pers. Soc. Psychol. 1971, 17, 124–129. [Google Scholar] [CrossRef] [Green Version]
  64. Ekman, P.; Friesen, W.V.; Hager, J.C. Facial Action Coding System. The Manual; Consulting Psychologists Press: San Francisco, CA, USA, 1978. [Google Scholar]
  65. Bartlett, M.S.; Littlewort, G.; Frank, M.G.; Lainscsek, C.; Fasel, I.R.; Movellan, J. Automatic recognition of facial actions in spontaneous expressions. J. Multimed. 2006, 1. [Google Scholar] [CrossRef]
  66. Gross, R.; Matthews, I.; Cohn, J.; Kanade, T.; Baker, S. Multi-PIE. Image Vis. Comput. 2010, 28, 807–813. [Google Scholar] [CrossRef]
  67. Dhall, A.; Goecke, R.; Lucey, S.; Gedeon, T. Collecting large, richly annotated facial-expression databases from movies. IEEE Multimed. 2012, 19, 34–41. [Google Scholar] [CrossRef] [Green Version]
  68. Yu, Z. Image based static facial expression recognition with multiple deep network learning. In Proceedings of the Acm on International Conference on Multimodal Interaction, Seattle, WA, USA, 9–13 November 2015. [Google Scholar]
  69. Takac, P.; Sincak, P.; Mach, M. Lecture improvement using students emotion assessment provided as SaS for teachers. In Proceedings of the 2016 International Conference on Emerging eLearning Technologies and Applications (ICETA), Vysoke Tatry, Slovakia, 24–25 November 2016. [Google Scholar]
  70. Abdullah, S.; Murnane, E.L.; Costa, J.M.R.; Choudhury, T. Collective smile: Measuring societal happiness from Geolocated Images. In Proceedings of the 18th ACM Conference on Computer Supported Cooperative Work & Social Computing, Vancouver, BC, Canada, 14–18 March 2015. [Google Scholar]
  71. English, T.; Carstensen, L.L. Emotional experience in the mornings and the evenings: Consideration of age differences in specific emotions by time of day. Front. Psychol. 2014, 5, 185. [Google Scholar] [CrossRef]
  72. Allisio, L.; Mussa, V.; Bosco, C.; Patti, V.; Ruffo, G.F. Felicittà: Visualizing and estimating happiness in italian cities from geotagged tweets. In Proceedings of the 1st International Workshop on Emotion and Sentiment in Social and Expressive Media: Approaches and perspectives from AI, Turin, Italy, 3 October 2013. [Google Scholar]
  73. Jang, M.-H. Three-dimensional visualization of an emotional map with geographical information systems: A case study of historical and cultural heritage in the Yeongsan River Basin, Korea. Int. J. Geogr. Inf. Sci. 2012, 26, 1393–1413. [Google Scholar] [CrossRef]
  74. Golder, S.A.; Macy, M.W. Diurnal and seasonal mood vary with work, sleep, and daylength across diverse cultures. Science 2011, 333, 1878–1881. [Google Scholar] [CrossRef] [Green Version]
  75. Kang, Y.; Zeng, X.; Zhang, Z.; Wang, Y.; Fei, T. Who are happier? Spatio-temporal analysis of worldwide human emotion based on geo-crowdsourcing faces. In Proceedings of the Ubiquitous Positioning, Indoor Navigation and Location-Based Services (UPINLBS), Wuhan, China, 22–23 March 2018. [Google Scholar]
  76. Easterlin, R.A.; Morgan, R.; Switek, M.; Wang, F. China’s life satisfaction, 1990–2010. Proc. Natl. Acad. Sci. USA 2012, 109, 9775–9780. [Google Scholar] [CrossRef] [Green Version]
  77. Everett, G. Measuring national well-being: A UK perspective. Rev. Income Wealth 2015, 61, 34–42. [Google Scholar] [CrossRef] [Green Version]
  78. Plunz, R.A.; Zhou, Y.; Vintimilla, M.I.C.; McKeown, K.; Yu, T.; Uguccioni, L.; Sutto, M.P. Twitter sentiment in New York City parks as measure of well-being. Landsc. Urban Plan. 2019, 189, 235–246. [Google Scholar] [CrossRef]
  79. Hu, Y.; Deng, C.; Zhou, Z. A semantic and sentiment analysis on online neighborhood reviews for understanding the perceptions of people toward their living environments. Ann. Am. Assoc. Geogr. 2019, 1–21. [Google Scholar] [CrossRef]
  80. Zheng, S.; Wang, J.; Sun, C.; Zhang, X.; Kahn, M.E. Air pollution lowers Chinese urbanites’ expressed happiness on social media. Nat. Hum. Behav. 2019, 3, 237–243. [Google Scholar] [CrossRef] [PubMed]
  81. Zijlema, W.; Wolf, K.; Emeny, R.; Ladwig, K.; Peters, A.; Kongsgård, H.; Hveem, K.; Kvaløy, K.; Yli-Tuomi, T.; Partonen, T.; et al. The association of air pollution and depressed mood in 70,928 individuals from four European cohorts. Int. J. Hyg. Environ. Health 2016, 219, 212–219. [Google Scholar] [CrossRef] [Green Version]
  82. Svoray, T.; Dorman, M.; Shahar, G.; Kloog, I. Demonstrating the effect of exposure to nature on happy facial expressions via Flickr data: Advantages of non-intrusive social network data analyses and geoinformatics methodologies. J. Environ. Psychol. 2018, 58, 93–100. [Google Scholar] [CrossRef]
  83. Mayer, F.; Frantz, C.M. The connectedness to nature scale: A measure of individuals’ feeling in community with nature. J. Environ. Psychol. 2004, 24, 503–515. [Google Scholar] [CrossRef] [Green Version]
  84. Kang, Y.; Jia, Q.; Gao, S.; Zeng, X.; Wang, Y.; Angsüsser, S.; Liu, Y.; Ye, X.; Fei, T. Extracting human emotions at different places based on facial expressions and spatial clustering analysis. Trans. GIS 2019, 23, 450–480. [Google Scholar] [CrossRef]
  85. MacKerron, G.; Mourato, S. Happiness is greater in natural environments. Glob. Environ. Chang. 2013, 23, 992–1000. [Google Scholar] [CrossRef] [Green Version]
  86. Thompson, C.W.; Roe, J.J.; Aspinall, P.A.; Mitchell, R.; Clow, A.; Miller, D. More green space is linked to less stress in deprived communities: Evidence from salivary cortisol patterns. Landsc. Urban Plan. 2012, 105, 221–229. [Google Scholar] [CrossRef] [Green Version]
  87. Jiang, B.; Li, D.; Larsen, L.; Sullivan, W.C. A dose-response curve describing the relationship between urban tree cover density and self-reported stress recovery. Environ. Behav. 2014, 48, 607–629. [Google Scholar] [CrossRef]
  88. Welsch, H. Environment and happiness: Valuation of air pollution using life satisfaction data. Ecol. Econ. 2006, 58, 801–813. [Google Scholar] [CrossRef]
  89. Kaplan, R. The Nature of the View from Home: Psychological Benefits. Environ. Behav. 2001, 33, 507–542. [Google Scholar] [CrossRef]
  90. Grahn, P.; Stigsdotter, U.A. Landscape planning and stress. Urban For. Urban Green. 2003, 2, 1–18. [Google Scholar] [CrossRef] [Green Version]
  91. De Vries, S.; Verheij, R.A.; Groenewegen, P.P.; Spreeuwenberg, P. Natural environments—Healthy environments? An exploratory analysis of the relationship between greenspace and health. Environ. Plan. A Econ. Space 2003, 35, 1717–1731. [Google Scholar] [CrossRef] [Green Version]
  92. Yang, W.; Mu, L.; Shen, Y. Effect of climate and seasonality on depressed mood among twitter users. Appl. Geogr. 2015, 63, 184–191. [Google Scholar] [CrossRef]
  93. Goodchild, M.F. Citizens as sensors: The world of volunteered geography. GeoJournal 2007, 69, 211–221. [Google Scholar] [CrossRef] [Green Version]
  94. Liu, Y.; Liu, X.; Gao, S.; Gong, L.; Kang, C.; Zhi, Y.; Chi, G.; Shi, L. Social sensing: A new approach to understanding our socioeconomic environments. Ann. Assoc. Am. Geogr. 2015, 105, 512–530. [Google Scholar] [CrossRef]
  95. Zeile, P.; Resch, B.; Exner, J.-P.; Sagl, G. Urban emotions: Benefits and risks in using human sensory assessment for the extraction of contextual emotion information in urban planning. In Planning Support Systems and Smart Cities; Geertman, S., Ferreira, J.J., Goodspeed, R., Stillwell, J., Eds.; Springer International Publishing: Cham, Switzerland, 2015; pp. 209–225. [Google Scholar] [CrossRef]
  96. Alfarrarjeh, A.; Agrawal, S.; Kim, S.H.; Shahabi, C. Geo-spatial multimedia sentiment analysis in disasters. In Proceedings of the 2017 IEEE International Conference on Data Science and Advanced Analytics (DSAA), Tokyo, Japan, 19–21 October 2017. [Google Scholar]
  97. Do, H.J.; Lim, C.-G.; Kim, Y.J.; Choi, H.-J. Analyzing emotions in twitter during a crisis: A case study of the 2015 Middle East Respiratory Syndrome outbreak in Korea. In Proceedings of the 2016 International Conference on Big Data and Smart Computing (BigComp), Hong Kong, China, 18–20 January 2016; pp. 415–418. [Google Scholar] [CrossRef]
  98. Chien, Y.; Comber, A.; Carver, S. Does Flickr work in disaster management?—A case study of Typhoon Morakot in Taiwan. In Proceedings of the GIS Research UK (GISRUK), Manchester, UK, 18–21 April 2017. [Google Scholar]
  99. Dewan, P.; Bharadhwaj, V.; Mithal, A.; Suri, A.; Kumaraguru, P. Visual themes and sentiment on social networks to aid first responders during crisis events. arXiv 2016, arXiv:1610.07772. [Google Scholar]
  100. Resch, B.; Summa, A.; Zeile, P.; Strube, M. Citizen-centric urban planning through extracting emotion information from twitter in an interdisciplinary space-time-linguistics algorithm. Urban Plan. 2016, 1, 114. [Google Scholar] [CrossRef]
  101. López-Ornelas, E.; Zaragoza, N.M. Social Media Participation: A Narrative Way to Help Urban Planners. In Social Computing and Social Media; Meiselwitz, G., Ed.; Springer International Publishing: Cham, Switzerland, 2015; pp. 48–54. [Google Scholar]
  102. Zhen, F.; Tang, J.; Chen, Y. Spatial distribution characteristics of residents’ emotions based on Sina Weibo big data: A case study of Nanjing. In Big Data Support of Urban Planning and Management: The Experience in China; Shen, Z., Li, M., Eds.; Springer International Publishing: Cham, Switzerland, 2017; pp. 43–62. [Google Scholar]
  103. Hijazi, I.H.; Koenig, R.; Schneider, S.; Li, X.; Bielik, M.; Schmit, G.N.J.; Donath, D. Geostatistical analysis for the study of relationships between the emotional responses of urban walkers to urban spaces. Int. J. E-Plan. Res. 2016, 5, 1–19. [Google Scholar] [CrossRef] [Green Version]
  104. Zhang, F.; Zhou, B.; Liu, L.; Liu, Y.; Fung, H.H.; Lin, H.; Ratti, C. Measuring human perceptions of a large-scale urban region using machine learning. Landsc. Urban Plan. 2018, 180, 148–160. [Google Scholar] [CrossRef]
  105. Diener, E.; Diener, M.L. Cross-cultural correlates of life satisfaction and self-esteem. J. Personal. Soc. Psychol. 1995, 68, 653–663. [Google Scholar] [CrossRef]
  106. Kitayama, S.; Markus, H.R.; Kurokawa, M. Culture, emotion, and well-being: Good feelings in Japan and the United States. Cogn. Emot. 2000, 14, 93–124. [Google Scholar] [CrossRef]
  107. Wierzbicka, A. Emotion, language, and cultural scripts. In Emotion and Culture: Empirical Studies of Mutual Influence; American Psychological Association: Washington, DC, USA, 2004; pp. 133–196. [Google Scholar]
  108. Ellsworth, P.C. Sense, Culture, and Sensibility; Kitayama, S., Ed.; American Psychological Association (APA): Washington, DC, USA, 1994. [Google Scholar] [CrossRef]
  109. Suh, E.; Diener, E.; Oishi, S.; Triandis, H.C. The shifting basis of life satisfaction judgments across cultures: Emotions versus norms. J. Pers. Soc. Psychol. 1998, 74, 482–493. [Google Scholar] [CrossRef]
  110. Lafrance, M.; Hecht, M.A.; Paluck, E.L. The contingent smile: A meta-analysis of sex differences in smiling. Psychol. Bull. 2003, 129, 305–334. [Google Scholar] [CrossRef] [Green Version]
  111. Gross, J.J.; Carstensen, L.L.; Pasupathi, M.; Tsai, J.; Skorpen, C.G.; Hsu, A.Y.C. Emotion and aging: Experience, expression, and control. Psychol. Aging 1997, 12, 590–599. [Google Scholar] [CrossRef]
  112. Doytsher, Y.; Galon, B.; Kanza, Y. Emotion maps based on Geotagged posts in the social media. In Proceedings of the 1st ACM SIGSPATIAL Workshop on Geospatial Humanities, Redondo Beach, CA, USA, 7–10 November 2017. [Google Scholar]
  113. Mitchell, L.; Frank, M.R.; Harris, K.D.; Dodds, P.S.; Danforth, C.M. The geography of happiness: Connecting twitter sentiment and expression, demographics, and objective characteristics of place. PLoS ONE 2013, 8, e64417. [Google Scholar] [CrossRef] [Green Version]
  114. Li, Y.; Fei, T.; Huang, Y.; Li, J.; Li, X.; Zhang, F.; Kang, Y.; Wu, G. Emotional habitat: Mapping the global geographic distribution of human emotion with physical environmental factors using a species distribution model. Int. J. Geogr. Inf. Sci. 2020, 1–23. [Google Scholar] [CrossRef]
  115. Elith, J.; Phillips, S.J.; Hastie, T.; Dudík, M.; Chee, Y.E.; Yates, C.J. A statistical explanation of MaxEnt for ecologists. Divers. Distrib. 2010, 17, 43–57. [Google Scholar] [CrossRef]
  116. Gervasoni, L.; Bosch, M.; Fenet, S.; Sturm, P. A framework for evaluating urban land use mix from crowd-sourcing data. In Proceedings of the IEEE International Conference on Big Data, Boston, MA, USA, 11–14 December 2017. [Google Scholar] [CrossRef] [Green Version]
  117. Boyd, D.; Crawford, K. Critical questions for big data. Inf. Commun. Soc. 2012, 15, 662–679. [Google Scholar] [CrossRef]
  118. Li, L.; Goodchild, M.F.; Xu, B. Spatial, temporal, and socioeconomic patterns in the use of Twitter and Flickr. Cartogr. Geogr. Inf. Sci. 2013, 40, 61–77. [Google Scholar] [CrossRef]
  119. Sabatini, F.; Sarracino, F. Keeping up with the e-joneses: Do online social networks raise social comparisons? arXiv 2016, arXiv:1507.08863. [Google Scholar] [CrossRef] [Green Version]
  120. Mayol, A.; Pénard, T. Facebook use and individual well-being: Like me to make me happier! Rev. d’Économ. Ind. 2017, 158, 101–127. [Google Scholar] [CrossRef] [Green Version]
  121. Huang, Y.; Li, J.; Wu, G.; Fei, T. Quantifying the bias in place emotion extracted from photos on social networking sites: A case study on a university campus. Cities 2020, 102, 102719. [Google Scholar] [CrossRef]
  122. Liu, Y.; Yuan, Y.; Zhang, F. Mining urban perceptions from social media data. J. Spat. Inf. Sci. 2020, 20, 51–55. [Google Scholar] [CrossRef]
  123. Kitchin, R.; Lauriault, T.P. Small data in the era of big data. Geojournal 2014, 80, 463–475. [Google Scholar] [CrossRef]
Ijgi 09 00551 g001 550
Figure 1. The methodologies of quantitatively and qualitatively describing human–environment relationship.
Figure 1. The methodologies of quantitatively and qualitatively describing human–environment relationship.
Ijgi 09 00551 g001
Ijgi 09 00551 g002 550
Figure 2. The conceptual framework of geographic information system (GIS)-based emotional computing.
Figure 2. The conceptual framework of geographic information system (GIS)-based emotional computing.
Ijgi 09 00551 g002
Ijgi 09 00551 g003 550
Figure 3. The workflow of an example implementing GIS-based emotional computing.
Figure 3. The workflow of an example implementing GIS-based emotional computing.
Ijgi 09 00551 g003
Table
Table 1. Previous works on the impact of environment on human emotions.
Table 1. Previous works on the impact of environment on human emotions.
Data SourceSample SizeStudy AreaResultsCitation
Flickr photos2,416,191 facesGlobalEnvironmental factors such as natural landscape and water body have significant impact on tourists’ happiness.Kang et al. [84]
Flickr photos60,013 imagesGreater Boston Area, the United StatesComponents of exposure to nature including green vegetation, proximity to water bodies, and undeveloped areas have a robust, positive effect on happiness.Svoray et al. [82]
self-report app records1,138,481 responses from 21,947 usersThe United KingdomThe relationships between environmental factors (land cover type and weather) and happiness are highly statistically significant.MacKerron, Mourato [85]
self-reports25 participantsDundee, the United KingdomMore green space in the surrounding environment can help people to adapt to stress.Ward Thompson et al. [86]
self-reports158 participantsNAThere is a positive, linear association between the density of urban street trees and self-reported stress recovery.Jiang et al. [87]
tweet text of Sina Weibo210 million microblog tweetsChinaAir quality is associated with happiness.Zheng et al. [80]
self-reportsNAMultiple countriesAir pollution plays a statistically significant role as a predictor in subjective well-being.Welsch [88]
self-reports564 householdsCommunities in Ann Arbor, Michigan, the United StatesHaving natural elements in the view from the window contributes to residents’ sense of well-being.Kaplan [89]
self-reports953 participantsNine Swedish citiesStatistically significant relationships were found between the use of urban open green spaces and self-reported experiences of stress.Grahn, Stigsdotter [90]
self-reportsover 10,000 individual adultsThe United KingdomThe individuals are happier when living with greater amounts of urban green space.White et al. [36]
self-reports17,000 individualsThe NetherlandsSelf-reported distress is greater in areas with lower levels of green space.de Vries et al. [91]
tweet text of Twitter34 metropolitan statistical areasThe United StatesClimate factors like relative humidity and temperature contribute to local depression rates.Yang et al. [92]
self-reportsNAThe United StatesThere is a significant positive association between income and happiness within countriesEasterlin [13]
NA—not available.

Share and Cite

MDPI and ACS Style

Huang, Y.; Fei, T.; Kwan, M.-P.; Kang, Y.; Li, J.; Li, Y.; Li, X.; Bian, M. GIS-Based Emotional Computing: A Review of Quantitative Approaches to Measure the Emotion Layer of Human–Environment Relationships. ISPRS Int. J. Geo-Inf. 2020, 9, 551. https://doi.org/10.3390/ijgi9090551

AMA Style

Huang Y, Fei T, Kwan M-P, Kang Y, Li J, Li Y, Li X, Bian M. GIS-Based Emotional Computing: A Review of Quantitative Approaches to Measure the Emotion Layer of Human–Environment Relationships. ISPRS International Journal of Geo-Information. 2020; 9(9):551. https://doi.org/10.3390/ijgi9090551

Chicago/Turabian Style

Huang, Yingjing, Teng Fei, Mei-Po Kwan, Yuhao Kang, Jun Li, Yizhuo Li, Xiang Li, and Meng Bian. 2020. "GIS-Based Emotional Computing: A Review of Quantitative Approaches to Measure the Emotion Layer of Human–Environment Relationships" ISPRS International Journal of Geo-Information 9, no. 9: 551. https://doi.org/10.3390/ijgi9090551

APA Style

Huang, Y., Fei, T., Kwan, M.-P., Kang, Y., Li, J., Li, Y., Li, X., & Bian, M. (2020). GIS-Based Emotional Computing: A Review of Quantitative Approaches to Measure the Emotion Layer of Human–Environment Relationships. ISPRS International Journal of Geo-Information, 9(9), 551. https://doi.org/10.3390/ijgi9090551

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop pFad - Phonifier reborn

Pfad - The Proxy pFad of © 2024 Garber Painting. All rights reserved.

Note: This service is not intended for secure transactions such as banking, social media, email, or purchasing. Use at your own risk. We assume no liability whatsoever for broken pages.


Alternative Proxies:

Alternative Proxy

pFad Proxy

pFad v3 Proxy

pFad v4 Proxy