Next Article in Journal
Spatial Planning Data Structure Based on Blockchain Technology
Previous Article in Journal
Isochrone-Based Accessibility Analysis of Pre-Hospital Emergency Medical Facilities: A Case Study of Central Districts of Beijing
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

SAMPLID: A New Supervised Approach for Meaningful Place Identification Using Call Detail Records as an Alternative to Classical Unsupervised Clustering Techniques

by
Manuel Mendoza-Hurtado
*,
Juan A. Romero-del-Castillo
and
Domingo Ortiz-Boyer
Computer and Numerical Analysis, Campus de Rabanales, Albert Einstein Building, University of Cordoba, 14071 Cordoba, Spain
*
Author to whom correspondence should be addressed.
ISPRS Int. J. Geo-Inf. 2024, 13(8), 289; https://doi.org/10.3390/ijgi13080289
Submission received: 28 May 2024 / Revised: 2 August 2024 / Accepted: 15 August 2024 / Published: 17 August 2024

Abstract

:
Data supplied by mobile phones have become the basis for identifying meaningful places frequently visited by individuals. In this study, we introduce SAMPLID, a new Supervised Approach for Meaningful Place Identification, based on providing a knowledge base focused on the specific problem we aim to solve (e.g., home/work identification). This approach allows to tackle place identification from a supervised perspective, offering an alternative to unsupervised clustering techniques. These clustering techniques rely on data characteristics that may not always be directly related to classification objectives. Our results, using mobility data provided by call detail records (CDRs) from Milan, demonstrate superior performance compared to applying clustering techniques. For all types of CDRs, the best results are obtained with the 20 × 20 subgrid, indicating that the model performs better when supplied with information from neighboring cells with a close spatial relationship, establishing neighborhood relationships that allow the model to clearly learn to identify transitions between cells of different types. Considering that it is common for a place or cell to be labeled in multiple categories at once, this supervised approach opens the door to addressing the identification of meaningful places from a multi-label perspective, which is difficult to achieve using classical unsupervised methods.

1. Introduction

The generalization of mobile phone usage has turned mobile phones into useful tools for gathering mobility data and extracting knowledge applicable to areas such as mobile network optimization [1], the identification of human mobility patterns [2,3], marketing [4], urban planning [5,6], service planning, public transport [7], and tourism [8], among others.
These data can be obtained from the mobile’s global positioning system [9,10], the proximity to a radio-frequency beacon such as a Wi-Fi antenna or beacon [11], or call detail records (CDRs) stored by mobile phone network operators [12,13,14,15].
CDRs contain information that identifies the type of activity (internet, incoming/outgoing call, SMS message, etc.), its time of occurrence, and the radio base station (RBS) that provides the service. This information allows the user to be geolocated within the area covered by the RBS.
Although the positioning accuracy obtained by using CDRs depends on the extent of the area covered by the RBS, the large amount of information provided by these records makes them a useful tool for identifying population patterns such as those related to work, leisure, home, travel, and tourism [3,7,12,13,14,15]. Several other works with the use of mobile network data and CDRs have been conducted, such as in [16], where Gergő et al. demonstrate how mobile network data can provide an efficient, automated alternative to traditional census methods for analyzing commuting patterns in the Budapest Metropolitan Area. And in [17], Ferreira et al. present a methodology to identify individual users’ routine locations and attach semantic meanings to these locations using anonymized CDRs from mobile network data.
In any population analysis, the identification of meaningful places or locations [18,19] regularly visited by individuals or anchor points is of special interest. Home and work are the most common anchor points [12].
Clustering techniques [20] have been widely used in the literature for place identification [19,21,22]. Cluster analysis, also known as clustering, is the unsupervised process of partitioning a set of unlabeled data points into distinct and mutually exclusive groups (clusters) based on their inherent similarities. This process aims to maximize the similarity of data points within each cluster while minimizing the similarity between data points belonging to different clusters. Csáji et al. [21] use k-means, a clustering algorithm to identify locations exhibiting similar weekly calling patterns and to identify which places correspond to work or home based on the calling patterns. In the work of Isaacman et al. [15], clustering is used to associate several clusters with the places most frequently visited by users, and then those clusters are ranked and defined as home or work based on the hour during which they have the most events. For each cluster, they calculate five variables using the CDR data and a score using logistic regression, with coefficients calculated using the reported locations of the 18 volunteers. The resulting model for identifying home and work concludes, as expected, that the determining variables are only two: the number of events that occur during work hours (between 1 p.m. and 5 p.m.) and home hours (weekends or weekdays between 7 p.m. and 7 a.m.). Although the model uses the knowledge provided by the 18 volunteers, this only serves to demonstrate that the variables calculated from the CDR data fulfill the purpose for which they were defined. In [9], data traces are also grouped with clustering, and time-based clustering is used to categorize the identified places.
Recently, more advanced and refined clustering techniques have been introduced, such as the method described in [23], which combines Particle Swarm Optimization (PSO) with Fuzzy c-means (FCM) clustering. This approach aims to overcome the limitations of traditional FCM, including its sensitivity to noise and reliance on initial centroid selection.
In a k-means algorithm, the general objective is to obtain k partitions that minimize the sum of squared Euclidean distances between objects and cluster centroids. Although this algorithm is efficient, it is sensitive to noise and outliers. In contrast to k-means, the k-medoids algorithm [24] chooses actual data points as centers and minimizes the sum of general pairwise dissimilarities, making it more robust to noise and outliers.
Clustering represents an easy way to analyze and categorize data because it is an unsupervised learning technique and, typically, no difficult data processing is required. However, the groupings are based on data characteristics, which are not always related to the classification objectives [25]. That is, clusters made based on a measure of similarity or proximity of the data do not always have to correspond well with the classes into which we want to classify the data.
As an alternative to clustering and unsupervised learning, we can use supervised classification to identify population patterns that are learned by the classifier from correctly labeled data provided to it during the training phase. In supervised learning, we have a dataset with input labels and a desired output. The main objective is to build a model that is capable of predicting the desired output of a new object given the input features. In supervised learning, there is always a clear distinction between a training set and the test set that must be inferred.
The k-nearest neighbors (kNN) classifier [26] is among the highest-performing methods for classification tasks. This simple yet effective classification algorithm can be easily interpreted. The main challenge is to choose the optimal value of the k neighbors, which is highly data dependent.
In this paper, we present SAMPLID, a new Supervised Approach for Meaningful PLace IDentification using mobility data provided by call detail records of Milan. The idea underlying our approach is based on addressing place identification problems from a supervised perspective, providing the model with representative information that allows it to learn from the places labeled by a expert, rather than through analysis and categorization of unlabeled data. In this way, we can train a classifier based on the knowledge provided and focused on the problem we aim to solve.
Providing a solid knowledge base to the classifier is essential. To generate training data for the classification model, we manually label several subregions using different sampling strategies such as random selection or selecting a large area containing all types of places to identify as detailed in the following sections. We attempt to identify the home and work places by training the model with manually labeled subgrids, based on the predominant type of buildings for each cell, and then predict the class for the complete grid.
To compare these approaches, we use mobility CDR data from the city of Milan [27] to identify home and work places and make a comparative study against clustering analysis, which is typically used in mobility scenarios [9,14,15]. We use k-means and k-medoids algorithms as unsupervised classifiers and SAMPLID-kNN using kNN classifier as a supervised classifier.
Overall, the contributions of our work are as follows.
  • We propose to address the problem of meaningful place identification from a supervised perspective to improve the results obtained with unsupervised methods, such as clustering techniques, which are traditionally used when dealing with large amounts of unlabeled data like those provided by CDRs.
  • To achieve this, we propose selecting a representative portion of the available data and correctly labeling it to use as a knowledge base for training a supervised model or classifier. This will enable us to accurately classify the entirety of the data for which we do not know the labels.
    We use mobility CDR data from the city of Milan to identify home and work places. To achieve this, we correctly label the data corresponding to a 20 × 20 subgrid and a series of random cells into which we divided the city of Milan.
  • We compare the results obtained using k-means and k-medoids algorithms as unsupervised classifiers and SAMPLID-kNN using the kNN classifier as a supervised classifier.
  • Finally, we not only assess the effectiveness of the proposed method compared to the alternatives considered, but we also draw additional conclusions, such as what information contained in the CDRs is most useful for identifying home and work places; whether better results are obtained using the knowledge provided by the 20 × 20 subgrid, the selected random cells, or their combination; the advantages and limitations of the proposed method; and the direction for future research.
In the next sections, we describe our proposed method (Section 2), the data used to perform the experiments and the experimental setup that we used to test the goodness of our proposed method (Section 3). We present our results in Section 4, and in Section 5, we state the conclusions of our work and future research lines.

2. SAMPLID: Supervised Approach for Meaningful Place Identification

In this section, we explain how to approach the problem of identifying areas of interest through supervised learning as an alternative to the traditionally used unsupervised methods.
The first problem we encounter in unsupervised classification is determining the number of classes c to identify. We can set this number based on our objectives or use a statistical procedure, letting the classifier analyze the data and classify them based on their characteristics. However, these data characteristics do not always have meaning or utility for the classification objectives, and the classifier may identify curious but impractical spurious correlations.
SAMPLID does not seek similarities among the data for classification; instead, it tries to find or learn a function that, when applied to the input variables associated with a pattern or sample, indicates the class to which the data belong.
Let T be a dataset consisting of n cells x i and its associated classes y i , T = { ( x i , y i ) } , 1 i n , ( x i X , y i Y ) . Here, Y = { y 1 , , y c } and x i = ( x i 1 , , x i j , x i m ) , where c is the number of classes and m is the number of variables available to classify each cell. h is a classifier, and h ( x i ) = y i is the predicted class for the example x i [28].
Here, we need a set of representative patterns or cells correctly classified T = { ( x i , y i ) } that allows us to infer a function h ( x i ) = y i and evaluate its efficiency before using it to classify unlabeled patterns x i . If such a set of patterns is not available, it will be necessary to generate a set using a specific strategy to select and classify such patterns.
We can choose to create a random selection of cells from the entire surface or part of the surface under study, select one or several representative subgrids that integrate all types of cells, or a combination of both. A random selection will, a priori, contain more information about the characteristics of the cells based on their distribution on the map, whereas a selection of subgrids will contain more information about the boundaries between areas of different types.
The classification of the learning set will depend on the characteristics of the problem to be solved. In the case of identifying home and work places, cells can be classified with on-site observation, based on maps that provide information about building types, signage in the areas, businesses, etc. The classification accuracy of the learning set is crucial for inferring the classifier. The importance and complexity of this task determine the size of the learning set.
The next step is to use a supervised classification method that allows us to infer the function h ( x i ) = y i . Taking into account the characteristics of the problem at hand, the kNN classifier may be a good choice. This classifier is well known and widely used due to its good generalization and easy implementation [29,30]. Although simple, the kNN classifier can usually match, and even surpass, the performance of more sophisticated and complex methods. The kNN algorithm utilizes a reference set of data points, known as prototypes, to encode the domain knowledge relevant to the problem. To classify a cell x i using SAMPLID-kNN, the k cells that are more similar to x i are obtained, denoted as the k nearest neighbors, and x i is classified into the class that is most frequent in this set of k neighbors.
The time complexity of the algorithm in the prediction phase is O ( n · m + n log n ) .
If the classifier obtained and evaluated with correctly classified data is sufficiently accurate, we will apply the classifier to the study area. The method for evaluating the goodness of the results obtained in unlabeled cells will depend on the characteristics of the problem and actual evidence based on observation or available data.
Algorithm 1 presents SAMPLID in a formal manner and describes the steps for addressing the problem of meaningful place identification using supervised classifiers. A flowchart of the algorithm is represented in Figure 1.
Algorithm 1: SAMPLID: Supervised Approach forMeaningful Place Identification.
Ijgi 13 00289 i001

3. Experimental Setup

Next, we describe the characteristics of the data, the supervised classification method used to evaluate the goodness of SAMPLID, and the clustering algorithms used for comparison with our proposed method.

3.1. Data Description

Access to communication data is often restricted, typically requiring research teams to enter into non-disclosure agreements and research contracts with private companies. This limited availability of open datasets presents a significant challenge for researchers seeking to conduct studies in this field.
In this context, research challenges providing access to datasets to a large number of researchers are becoming a valuable framework. An example is Orange’s “Data for Development” (D4D) initiative in 2013 [31] and 2014–2015 [32], but unfortunately, these data are no longer available.
However, Telecom Italia, in association with several universities and foundations, has made available the data that will be used in this study. This dataset stands out due to its open- and multi-source aggregation of data from diverse sources, such as telecommunications, weather, news, social networks, and electricity information for the city of Milan [27]. We will focus on the telecommunication data, which consist of CDR data aggregated in 10 min intervals on a 100-by-100 grid (squared cells with an approximate size of 235 × 235 m) that covers the city of Milan (Figure 2a).
Each time a user interacts with the telecommunications network, the operator assigns an RBS and creates a CDR containing the RBS that handled the interaction and the time at which the interaction occurred. Each RBS covers a specific area of the territory v and allows its users to be geolocated using RBS coverage maps R B S c _ m a p (Figure 2b).
A square of the grid can be composed of several portions of the coverage areas of the RBS and vice versa. To perform spatial aggregation, the number of interactions or records S i ( t ) in a grid square i at time t is calculated as follows [27]:
S i ( t ) = v R B S c _ m a p R v ( t ) A v i A v ,
where R v ( t ) is the number of records in v at time t, A v is the area of v, and A v i is the area of the intersection between v and the square i.
The number of records in the datasets S i ( t ) is calculated as follows:
S i ( t ) = S i ( t ) κ ,
where κ is a constant that hides the true number of records.
The CDR contains records for the following activities:
  • Incoming SMS (smsin). A dedicated CDR is generated for each received SMS message.
  • Sent SMS (smsout). Similarly, a single CDR is generated for each sent SMS message.
  • Incoming call (callin). Every received call triggers the creation of a corresponding CDR.
  • Outgoing call (callout). Likewise, a CDR is generated for each initiated call.
  • Internet. Mobile internet activity is represented in the CDR. A CDR is generated at the start and end of each internet connection. Additionally, during an ongoing connection, a new CDR is created if the duration exceeds 15 min or if data transfer surpasses 5 MB.
The information is already aggregated and anonymized so that it is not possible to identify individual mobility data. The data are provided in text files, in which each line contains the following fields: cell identifier, date, time, number of records ( S i ( t ) ) of incomng SMS messages (smsin), sent SMS messages (smsout), incoming calls (callin), outgoing calls (callout) and internet.
For our study, we select a typical week with no festivities over the two-month period available to perform classification and clustering on the map. We focus on one week because we are aiming to distinguish home and work places; one week is sufficient for studying mobile traffic patterns while providing enough input data. We also use a working day (Monday) for comparison with the results obtained from using a week of data.
We process the dataset by aggregating the measures into hourly intervals and scaling their values into a range of [0, 1] using a min-max scaling [33], for ease of data management.
As a means of classifying the complete grid, we manually label two sets of cells as home and work places. This labeling is possible because of the available file of the Milan grid, which is a GeoJSON file [34] that contains the coordinates of the 100 × 100 grid. The first set is formed by cells belonging to a 20 × 20 subgrid that includes an industrial zone that is clearly delimited and some high-density residential areas (Figure 3a (Available at http://geojson.io/#data=data:text/x-url, https://raw.githubusercontent.com/mendozamanu/milan-mobility/main/geojsons/test20by20.geojson accessed on 14 August 2024). The second set consists of 250 cells randomly chosen from the upper left 50 × 50 subgrid (Figure 3b (Available at http://geojson.io/#data=data:text/x-url, https://raw.githubusercontent.com/mendozamanu/milan-mobility/main/geojsons/rgridtest.geojson accessed on 14 August 2024)).

3.2. Supervised Classification Method

To validate SAMPLID, we use the kNN classifier [26] because it is one of the most commonly used, simple, effective, and easily interpretable classifiers, with a high performance that reaches the level of more complex classifiers. To evaluate the performance of SAMPLID-kNN, we use k = { 5 , 10 } as the number of neighbors, and six different datasets:
  • The 20 × 20 subgrid with data for one week;
  • The 20 × 20 subgrid with data for one working day;
  • The subgrid formed by 250 random cells with data for one week;
  • The subgrid formed by 250 random cells with data for one working day;
  • The 20 × 20 subgrid and 250 random cells with data for one week;
  • The 20 × 20 subgrid and 250 random cells with data for one working day.
To obtain results, we perform a 10-fold cross-validation for each mobile traffic metric (incoming SMS, outgoing SMS, incoming calls, outgoing calls, and internet traffic) and each value of k = { 5 , 10 } .
The results obtained will indicate the most appropriate values for k and the mobile traffic metric, the most appropriate training set, and whether it is better to use data for one week or one working day. Using this information, we apply SAMPLID-kNN to the whole grid and assess whether the method is effective in predicting home and work places for the whole grid.

3.3. Clustering Method

To compare the results obtained with our model, we use a k-means clustering algorithm whose objective is to minimize the sum of the squared Euclidean distances between elements of the clusters and their centroids. This algorithm converges rapidly and is widely used in the literature for detecting meaningful places [21].
We also apply the k-medoids clustering algorithm [24], which minimizes a sum of general pairwise dissimilarities and chooses actual data points as centers. This algorithm may be more robust to noise and outliers than the k-means algorithm.
First, we apply the k-means and k-medoids algorithms with two clusters to identify two classes, potentially being home and work. Next, we conduct a silhouette analysis [35] using the silhouette coefficient [36] to calculate the optimal number of clusters k; we then apply the clustering algorithms again with the optimal number of clusters, k. Here, we utilize values between k = 2 and k = 7 .

4. Results

After describing the experiments that we have performed in order to identify which approach achieves superior results in detecting home and work places, we present the results in this section. All of the map visualization figures can be accessed at the reference links.
Table 1 and Table 2 show the accuracy and standard deviation values obtained by SAMPLID-kNN with 5 or 10 neighbors, respectively, for each dataset considered. The values marked in bold represent the best result for each category of incoming or outgoing SMS messages, calls, and internet. A t-test [37] with an alpha of 0.05 is conducted to identify significant differences among the results. We also calculate Cohen’s d [38] to determine whether the significant differences are very small ( d 0.01 ), small ( d 0.2 ), medium ( d 0.5 ), large ( d 0.8 ), very large ( d 1.20 ), or huge ( d 2.0 ).
The best results, in absolute terms, are obtained for the 20 × 20 subgrid with data for outgoing calls (callout) for one working day with the number of neighbors k = 10 ; in general, the results obtained are sufficient to consider this algorithm capable of predicting home and work places.
For incoming messages (smsin), outgoing messages (smsout), and incoming calls (callin), the best results are obtained with the 20 × 20 week dataset. For outgoing calls (callout) and internet, the best results are obtained with the 20 × 20 day dataset.
We can see that the 20 × 20 subgrid performs better than the random subgrid. This behavior may result from the greater facility in classifying cells concentrated in a zone with clear transitions between areas, compared with randomly chosen cells with diverse spatial relationships due to the extent of the territory covered. However, the use of both datasets does not improve the results, indicating that the information provided to the classifier by groups of close cells is essential for achieving good results.
The differences obtained for k = 5 and k = 10 are not significant for smsin, callout, or internet, but these differences are significant for smsout ( k = 10 ) and callin ( k = 5 ). The Cohen’s d values for smsout, d = 0.318 , and callin, d = 0.339 indicate that these significant differences are moderate. Therefore, we can conclude that the results obtained for k = 5 and k = 10 are similar.
In a more visual way, Figure 4a on the left, (Available at http://geojson.io/#data=data:text/x-url, https://raw.githubusercontent.com/mendozamanu/milan-mobility/main/geojsons/true20x20.geojson accessed on 14 August 2024) shows the manually labeled subgrid, and on the right, Figure 4b (Available at http://geojson.io/#data=data:text/x-url, https://raw.githubusercontent.com/mendozamanu/milan-mobility/main/geojsons/predictions_2020co.geojson accessed on 14 August 2024) shows the same predicted subgrid for the 20 × 20 sample classified with SAMPLID-kNN ( k = 10 ) using callout data from one working day. The red cells represent a residential zone, and transparent cells represent a working zone. Both figures visually indicate the good performance of the classification. The main discrepancies occur, as expected, in cells that are difficult to classify because they share both types of places or they are border cells, small islands, or cells that have a shared use as in a university campus.
If a group of cells is covered by a single RBS, the cells will have the same data; if they belong to different classes, the classifier will assign the same class to all cells. If cells of different classes are covered by different RBSs, their data will be different, and the cells will be more easily classified.
Once the goodness of the results obtained in the labeled cells using SAMPLID-kNN has been evaluated, we proceed to predict home/work labels for the whole grid. To do this, we use the configuration for which we obtained the best results in the previous phase, i.e., the 20 × 20 subgrid with callout data for one working day, as a training set, with k = 10 .
The results are shown in Figure 5 (Available at http://geojson.io/#data=data:text/x-url, https://raw.githubusercontent.com/mendozamanu/milan-mobility/main/geojsons/predictions_fullgrid_co.geojson accessed on 14 August 2024). A red grid represents a zone identified as home, and a transparent grid indicates a working zone. The city center is primarily classified as home. Only some large areas covered by RBSs that primarily cover working zones are classified as such. When we move away from the city center, the opposite trend occurs, and the residential zones are difficult to identify when their extension or density is not sufficient. As we move away from densely populated areas, the extent of the area covered by the RBSs increases, and it becomes more complex to detect the islands of cells belonging to residential zones. Given the limitations of the data used, the SAMPLID-kNN prediction provides valuable insight into the identification of home and work places in the city of Milan.
Now, we evaluate the predictions of the clustering algorithms and compare the results with those obtained via SAMPLID-kNN.
Table 3 and Table 4 show the results obtained by the k-means and k-medoids clustering algorithms using two clusters. The best results, shown in bold, are obtained with the k-medoids algorithm and the 20 × 20 subgrid with callout data for one working day; however, these results are never better than those obtained by the kNN classification.
Figure 6a (available at http://geojson.io/#data=data:text/x-url, https://raw.githubusercontent.com/mendozamanu/milan-mobility/main/geojsons/clust20x20_2.geojson accessed on 14 August 2024) shows the best results obtained for the 20 × 20 subgrid and k-means using smsin data from one working day. Similarly, Figure 6b (available at http://geojson.io/#data=data:text/x-url, https://raw.githubusercontent.com/mendozamanu/milan-mobility/main/geojsons/clust20x20_km2.geojson accessed on 14 August 2024) shows the best classification obtained for the same area and k-medoids using callout data from one working day. Graphically, we can see that the k-means classifies almost all cells as home, even those that are clearly work. In the case of k-medoids, a clear border is established between the left part of the image, home, and the right part, work. In both cases, the clustering is not able to improve the classification performed by the proposed model SAMPLID using kNN (Figure 4b).
Next, we apply clustering to the whole grid using the configuration for which we obtain the best results: callout data for one working day with the k-medoids algorithm.
The results obtained are shown in Figure 7 (Available at http://geojson.io/#data=data:text/x-url, https://raw.githubusercontent.com/mendozamanu/milan-mobility/main/geojsons/clust_fg_km2_callout.geojson accessed on 14 August 2024). We can see that the clustering algorithms have more difficulty in identifying residential areas far from the city center and large areas of the city center without homes than the method proposed in this work (Figure 5).
To determine whether it is possible to improve the clustering results obtained for the whole grid algorithm by applying better data partitioning, we determine the silhouette coefficient for k values ranging between k = 2 and k = 7 , as shown in Table 5 for each dataset. The values marked in bold represent the best results, which are those closest to unity. In general, the best results are always obtained for the k = 2 cluster, which indicates that the best way to group the data is in two clusters as we did before. Thus, it is not necessary to conduct additional runs of the clustering algorithms.

5. Conclusions and Future Research Lines

In this paper, we have presented a new supervised approach for meaningful place identification using mobility data provided by the CDRs stored by the operator Telecom Italia of the Milan mobile phone network as an alternative to classical unsupervised clustering techniques. In contrast to cluster analysis, our proposed method does not group or classify mobility data based on their general characteristics, regardless of whether the characteristics make sense for the purpose of classification. Instead, SAMPLID, our proposed method, learns a classification function based on prior knowledge provided to the classifier. The application of this method for identifying home and work places allowed us to evaluate the performance of the new proposed approach in classifying random cells, cells grouped in a grid, or a combination of both. Additionally, our results aided us in determining whether it is more appropriate to use data from a working day or a standard week for the problem of interest and in identifying what type of activity recorded by the CDRs is the most promising.
The best results for our proposed method with kNN as a supervised classifier (SAMPLID-kNN) were obtained by using a 20 × 20 subgrid with outgoing call data (callout) for one working day and k = 10 . For all types of CDRs, the best results were obtained with the 20 × 20 subgrid, indicating that the model performs better when provided with information from nearby cells with a close spatial relationship, establishing neighboring relations that define clear transitions between cells of different types. The use of random cells with diverse spatial relationships does not seem to provide any advantage. Regarding the type of CDR used, although the best results were obtained using callout, there were no significant differences between the different data types, as all types record a common population pattern to a greater or lesser extent. The value of k also does not seem to have much importance, most likely because of the homogenizing effect of spatial aggregation, which assigns the same values to cells covered by the same RBS and smoothens the differences between cells covered by multiple RBSs. Moreover, although using data from one working day instead of one week does not lead to a significant improvement in the results, this approach allows us to identify the same patterns of population behavior from less information.
As expected, the best results for clustering algorithms were also obtained with callout data for one working day based on the 20 × 20 subgrid and k-medoids, which are more robust to noise and outliers than k-means. However, these results did not exceed those obtained with the model proposed in this paper.
Our results show that the k-medoids clustering algorithms are less sensitive than our model to transitions between different types of cells and have more difficulty in classifying home places far from the city center and work places in the city center.
Although the intrinsic characteristics of CDRs make it difficult to achieve greater precision in the identification of home and work places, this study has demonstrated the benefits of SAMPLID, our proposed supervised approach. Despite the effort required to correctly identify a significant number of patterns that enable any supervised classifier to learn effectively, we have demonstrated the potential of this approach in addressing the complex problem of meaningful place identification.
The large amount of information stored by mobile phone network operators about the activity of mobile phones in CDRs makes them a useful tool for identifying meaningful places frequently visited by individuals. On the other hand, CDRs are limited in location accuracy because they record positions only at the granularity of a radio base station. However, the increase in the density of the RBS network is proportional to the population density it serves, which helps keep the bias within acceptable margins for identifying meaningful places such as home and work.
As a final conclusion, we can affirm that the results obtained in this work using the supervised approach proposed by SAMPLID are sufficiently good to consider its application in any population analysis traditionally addressed using unsupervised clustering techniques, especially when dealing with large amounts of unlabeled data, such as CDRs. In this study, we have demonstrated that labeling a small representative portion of the data can lead to substantial improvements by enabling the application of supervised learning techniques.
These promising results motivate the beginning of a new line of research aimed at identifying meaningful locations through a supervised approach using knowledge extracted from the mobility data provided by mobile phones. Clearly, the performance of the supervised approach proposed in this work could be improved by using more precise positioning methods, which are not always available in the necessary quantity and breadth.
Among the most interesting future research directions is the study of different sampling methods that allow us to select a set of cells or representative territory areas that provide us with a good knowledge base for training the classifier. Equally interesting would be the study of the characteristics that the used classifier should have and a comparative study of the most promising alternatives.
One of the problems we face when classifying a cell into a single category is that it may contain several classes of places or have shared uses. Thus, we believe that addressing the problem of meaningful place identification from a multi-label perspective is one of the most promising and innovative lines of research, given the intrinsic characteristics of the problem. In this context, novel knowledge selection methods or instance selection [39] and optimization of the used classifier [40] can also be applied to improve the performance.

Author Contributions

Conceptualization, Manuel Mendoza-Hurtado and Domingo Ortiz-Boyer; methodology, Manuel Mendoza-Hurtado and Domingo Ortiz-Boyer; software, Manuel Mendoza-Hurtado, Domingo Ortiz-Boyer and Juan A. Romero-del-Castillo; validation, Manuel Mendoza-Hurtado, Domingo Ortiz-Boyer and Juan A. Romero-del-Castillo; formal analysis, Manuel Mendoza-Hurtado and Domingo Ortiz-Boyer; investigation, Manuel Mendoza-Hurtado and Domingo Ortiz-Boyer; resources, Manuel Mendoza-Hurtado, Domingo Ortiz-Boyer and Juan A. Romero-del-Castillo; data curation, Manuel Mendoza-Hurtado and Domingo Ortiz-Boyer; writing—original draft preparation, Manuel Mendoza-Hurtado and Domingo Ortiz-Boyer; writing—review and editing, Manuel Mendoza-Hurtado, Domingo Ortiz-Boyer and Juan A. Romero-del-Castillo; visualization, Manuel Mendoza-Hurtado, Domingo Ortiz-Boyer and Juan A. Romero-del-Castillo; supervision, Manuel Mendoza-Hurtado, Domingo Ortiz-Boyer and Juan A. Romero-del-Castillo; project administration, Manuel Mendoza-Hurtado, Domingo Ortiz-Boyer and Juan A. Romero-del-Castillo; funding acquisition, Domingo Ortiz-Boyer and Juan A. Romero-del-Castillo. All authors have read and agreed to the published version of the manuscript.

Funding

This work was supported by the Spanish Ministry of Science and Innovation by grant number PID2022-141869NB-I00 and the University of Cordoba (FPU-UCO-2020) for D. Mendoza-Hurtado.

Data Availability Statement

The data that support the findings of this study are available from BigDataChallenge contest at: https://dataverse.harvard.edu/dataverse/bigdatachallenge accessed on 14 August 2024. Restrictions apply to the availability of these data, which were used under license for this study. Additional data and code used are available at the figshare platform: https://figshare.com/s/073d3cbd472002f33ee7 accessed on 14 August 2024.

Conflicts of Interest

The authors declare no conflicts of interest.The funders had no role in the design of the study; in the collection, analyses, or interpretation of data; in the writing of the manuscript, or in the decision to publish the results.

Abbreviations

The following abbreviations are used in this manuscript:
CDRCall Detail Record
RBSRadio Base Station
SMSShort Messaging Service
kNNk-Nearest Neighbors
SAMPLIDSupervised Approach for Meaningful Place Identification

Notations

Ta dataset
nthe number of instances
x i the feature vector of the i-th cell (or instance) in the dataset
y i the class label associated with the i-th cell x i
Xthe feature space
Ythe label (or classes) space
cthe number of classes
mthe number of features (or variables)
ha classifier
x i an unlabeled feature
y i the class label predicted with the i-th cell x i
S i ( t ) the number of interactions or records in grid square i at time t
tthe time at which the interactions or records are counted
vthe coverage area or region
R B S c _ m a p coverage map of the Radio Base Station
R v ( t ) the number of records in coverage area v at time t
A v the area of the coverage region v
S i ( t ) the scaled number of records in grid square i at time t
κ a constant to obscure the true number of records
kthe number of neighbors for the k-nearest neighbors algorithm

References

  1. Fiandrino, C.; Zhang, C.; Patras, P.; Banchs, A.; Widmer, J. A Machine-Learning-Based Framework for Optimizing the Operation of Future Networks. IEEE Commun. Mag. 2020, 58, 20–25. [Google Scholar] [CrossRef]
  2. Chen, H.; Song, X.; Xu, C.; Zhang, X. Using Mobile Phone Data to Examine Point-of-Interest Urban Mobility. J. Urban Technol. 2020, 27, 43–58. [Google Scholar] [CrossRef]
  3. Anniki, P.; Siiri, S.; Rein, A. The Relationship between Social Networks and Spatial Mobility: A Mobile-Phone-Based Study in Estonia. J. Urban Technol. 2018, 25, 7–25. [Google Scholar] [CrossRef]
  4. Quercia, D.; Di Lorenzo, G.; Calabrese, F.; Ratti, C. Mobile Phones and Outdoor Advertising: Measurable Advertising. IEEE Pervasive Comput. 2011, 10, 28–36. [Google Scholar] [CrossRef]
  5. Ferrari, L.; Mamei, M.; Colonna, M. Discovering events in the city via mobile network analysis. J. Ambient Intell. Humaniz. Comput. 2012, 5, 265–277. [Google Scholar] [CrossRef]
  6. Wang, Z.; Yue, Y.; He, B.; Nie, K.; Tu, W.; Du, Q.; Li, Q. A Bayesian spatio-temporal model to analyzing the stability of patterns of population distribution in an urban space using mobile phone data. Int. J. Geogr. Inf. Sci. 2021, 35, 116–134. [Google Scholar] [CrossRef]
  7. Calabrese, F.; Di Lorenzo, G.; Liu, L.; Ratti, C. Estimating Origin Destination Flows Using Mobile Phone Location Data. IEEE Pervasive Comput. 2011, 10, 36–44. [Google Scholar] [CrossRef]
  8. Ahas, R.; Aasa, A.; Mark, Ü.; Pae, T.; Kull, A. Seasonal tourism spaces in Estonia: Case study with mobile positioning data. Tour. Manag. 2007, 28, 898–910. [Google Scholar] [CrossRef]
  9. Kang, J.H.; Welbourne, W.; Stewart, B.; Borriello, G. Extracting Places from Traces of Locations. SIGMOBILE Mob. Comput. Commun. Rev. 2005, 9, 58–68. [Google Scholar] [CrossRef]
  10. Zhuang, C.; Yuan, N.J.; Song, R.; Xie, X.; Ma, Q. Understanding People Lifestyles: Construction of Urban Movement Knowledge Graph from GPS Trajectory. In Proceedings of the Twenty-Sixth International Joint Conference on Artificial Intelligence, IJCAI-17, Melbourne, Australia, 19–25 August 2017; pp. 3616–3623. [Google Scholar] [CrossRef]
  11. Kim, D.H.; Hightower, J.; Govindan, R.; Estrin, D. Discovering semantically meaningful places from pervasive RF-beacons. In Proceedings of the UbiComp’09, New York, NY, USA, 30 September–3 October 2009; pp. 21–30. [Google Scholar]
  12. Ahas, R.; Silm, S.; Järv, O.; Saluveer, E.; Tiru, M. Using Mobile Positioning Data to Model Locations Meaningful to Users of Mobile Phones. J. Urban Technol. 2010, 17, 3–27. [Google Scholar] [CrossRef]
  13. Frias-Martinez, V.; Virseda, J.; Rubio, A.; Frias-Martinez, E. Towards Large Scale Technology Impact Analyses: Automatic Residential Localization from Mobile Phone-Call Data. In Proceedings of the 4th ACM/IEEE International Conference on Information and Communication Technologies and Development, New York, NY, USA, 3–16 December 2010; ICTD’10. [Google Scholar] [CrossRef]
  14. Duan, Z.; Liu, L.; Wang, S. MobilePulse: Dynamic profiling of land use pattern and OD matrix estimation from 10 million individual cell phone records in Shanghai. In Proceedings of the 2011 19th International Conference on Geoinformatics, Shanghai, China, 24–26 June 2011; pp. 1–6. [Google Scholar] [CrossRef]
  15. Isaacman, S.; Becker, R.; Cáceres, R.; Kobourov, S.; Martonosi, M.; Rowland, J.; Varshavsky, A. Identifying Important Places in People’s Lives from Cellular Network Data. In Proceedings of the Pervasive Computing, San Francisco, CA, USA, 12–15 June 2011; Springer: Berlin/Heidelberg, Germany, 2011; pp. 133–151. [Google Scholar] [CrossRef]
  16. Pintér, G.; Felde, I. Commuting Analysis of the Budapest Metropolitan Area Using Mobile Network Data. ISPRS Int. J. Geo-Inf. 2022, 11, 466. [Google Scholar] [CrossRef]
  17. Ferreira, G.; Alves, A.; Veloso, M.; Bento, C. Identification and Classification of Routine Locations Using Anonymized Mobile Communication Data. ISPRS Int. J. Geo-Inf. 2022, 11, 228. [Google Scholar] [CrossRef]
  18. Susnea, I.; Dumitriu, L.; Talmaciu, M.; Pecheanu, E.; Munteanu, D. Unobtrusive Monitoring the Daily Activity Routine of Elderly People Living Alone, with Low-Cost Binary Sensors. Sensors 2019, 19, 2264. [Google Scholar] [CrossRef]
  19. Nurmi, P.; Koolwaaij, J. Identifying meaningful locations. In Proceedings of the 2006 Third Annual International Conference on Mobile and Ubiquitous Systems: Networking & Services, San Jose, CA, USA, 17–21 July 2006. [Google Scholar] [CrossRef]
  20. Singh, S.; Singh Gill, N. Analysis and Study of K-Means Clustering Algorithm. Int. J. Eng. Res. Technol. (IJERT) 2013, 2, 2546–2551. [Google Scholar]
  21. Csáji, B.C.; Browet, A.; Traag, V.; Delvenne, J.C.; Huens, E.; Van Dooren, P.; Smoreda, Z.; Blondel, V.D. Exploring the mobility of mobile phone users. Phys. A Stat. Mech. Its Appl. 2013, 392, 1459–1473. [Google Scholar] [CrossRef]
  22. Raja, M.; Exler, A.; Hemminki, S.; Konomi, S.; Sigg, S.; Inoue, S. Towards pervasive geospatial affect perception. GeoInformatica 2018, 22, 1–27. [Google Scholar] [CrossRef]
  23. Kumar, N.; Kumar, H. A fuzzy clustering technique for enhancing the convergence performance by using improved Fuzzy c-means and Particle Swarm Optimization algorithms. Data Knowl. Eng. 2022, 140, 102050. [Google Scholar] [CrossRef]
  24. Park, H.S.; Jun, C.H. A simple and fast algorithm for K-medoids clustering. Expert Syst. Appl. 2009, 36, 3336–3341. [Google Scholar] [CrossRef]
  25. Kononenko, I.; Kukar, M. Chapter 12—Cluster Analysis. In Machine Learning and Data Mining; Kononenko, I., Kukar, M., Eds.; Woodhead Publishing: Sawston, UK, 2007; pp. 321–358. [Google Scholar] [CrossRef]
  26. Cover, T.; Hart, P. Nearest neighbor pattern classification. IEEE Trans. Inf. Theory 1967, 13, 21–27. [Google Scholar] [CrossRef]
  27. Barlacchi, G.; De Nadai, M.; Larcher, R.; Casella, A.; Chitic, C.; Torrisi, G.; Antonelli, F.; Vespignani, A.; Pentland, A.; Lepri, B.; et al. A multi-source dataset of urban life in the city of Milan and the Province of Trentino. Sci. Data 2015, 2, 1–15. [Google Scholar] [CrossRef]
  28. Bishop, C.M. Pattern Recognition and Machine Learning; Springer: Berlin/Heidelberg, Germany, 2006. [Google Scholar]
  29. García-Pedrajas, N.; Ortiz-Boyer, D. Boosting k-nearest neighbor classifier by means of input space projection. Expert Syst. Appl. 2009, 36, 10570–10582. [Google Scholar] [CrossRef]
  30. García-Pedrajas, N.; del Castillo, J.A.R.; Ortiz-Boyer, D. A cooperative coevolutionary algorithm for instance selection for instance-based learning. Mach. Learn. 2009, 78, 381–420. [Google Scholar] [CrossRef]
  31. Blondel, V.D.; Esch, M.; Chan, C.; Clerot, F.; Deville, P.; Huens, E.; Morlot, F.; Smoreda, Z.; Ziemlicki, C. Data for Development: The D4D Challenge on Mobile Phone Data. arXiv 2013, arXiv:1210.0137. [Google Scholar]
  32. de Montjoye, Y.A.; Smoreda, Z.; Trinquart, R.; Ziemlicki, C.; Blondel, V.D. D4D-Senegal: The Second Mobile Phone Data for Development Challenge. arXiv 2014, arXiv:1407.4885. [Google Scholar]
  33. Juszczak, P.; Tax, D.M.J.; Duin, R.P.W. Feature Scaling in Support Vector Data Description 2002. Available online: http://rduin.nl/papers/asci_02_occ.pdf (accessed on 14 August 2024).
  34. Butler, H.; Daly, M.; Doyle, A.; Gillies, S.; Schaub, T.; Schaub, T. The GeoJSON Format; Request for Comments 7946; RFC Editor: Wilmington, DE, USA, 2016. [Google Scholar] [CrossRef]
  35. Rousseeuw, P.J. Silhouettes: A graphical aid to the interpretation and validation of cluster analysis. J. Comput. Appl. Math. 1987, 20, 53–65. [Google Scholar] [CrossRef]
  36. Kaufman, L.; Rousseeuw, P.J. Finding Groups in Data: An Introduction to Cluster Analysis; John Wiley: Hoboken, NJ, USA, 1990. [Google Scholar]
  37. Santafé, G.; Inza, I.; Lozano, J. Dealing with the evaluation of supervised classification algorithms. Artif. Intell. Rev. 2015, 44, 467–508. [Google Scholar] [CrossRef]
  38. Sawilowsky, S. New Effect Size Rules of Thumb. J. Mod. Appl. Stat. Methods 2009, 8, 597–599. [Google Scholar] [CrossRef]
  39. del Castillo, J.A.R.; Ortiz-Boyer, D.; García-Pedrajas, N. Instance selection for multi-label learning based on a scalable evolutionary algorithm. In Proceedings of the 2021 International Conference on Data Mining Workshops (ICDMW), Virtual Conference, 7–10 December 2021; pp. 843–851. [Google Scholar] [CrossRef]
  40. del Castillo, J.A.R.; Mendoza-Hurtado, M.; Ortiz-Boyer, D.; García-Pedrajas, N. Local-based k values for multi-label k-nearest neighbors rule. Eng. Appl. Artif. Intell. 2022, 116, 105487. [Google Scholar] [CrossRef]
Figure 1. Graphical representation of SAMPLID.
Figure 1. Graphical representation of SAMPLID.
Ijgi 13 00289 g001
Figure 2. (a) Grid system of Milan. (b) An example of a RBS coverage map of Milan.
Figure 2. (a) Grid system of Milan. (b) An example of a RBS coverage map of Milan.
Ijgi 13 00289 g002
Figure 3. Satellite view of (a) a 20 × 20 subgrid and (b) randomly chosen cells, in red, of the upper right 50 × 50 subgrid.
Figure 3. Satellite view of (a) a 20 × 20 subgrid and (b) randomly chosen cells, in red, of the upper right 50 × 50 subgrid.
Ijgi 13 00289 g003
Figure 4. (a) True and (b) predicted classification for the 20 × 20 subgrid classified with SAMPLID-kNN ( k = 10 ) using callout data from one working day.
Figure 4. (a) True and (b) predicted classification for the 20 × 20 subgrid classified with SAMPLID-kNN ( k = 10 ) using callout data from one working day.
Ijgi 13 00289 g004
Figure 5. SAMPLID-kNN home/work prediction for the full grid.
Figure 5. SAMPLID-kNN home/work prediction for the full grid.
Ijgi 13 00289 g005
Figure 6. Classification for the 20 × 20 subgrid with (a) k-means using smsin data from one working day and (b) k-medoids using callout data from one working day.
Figure 6. Classification for the 20 × 20 subgrid with (a) k-means using smsin data from one working day and (b) k-medoids using callout data from one working day.
Ijgi 13 00289 g006
Figure 7. k-means clustering result (k = 2). Cluster 1 in red and Cluster 2 in transparent/yellow.
Figure 7. k-means clustering result (k = 2). Cluster 1 in red and Cluster 2 in transparent/yellow.
Ijgi 13 00289 g007
Table 1. SAMPLID-kNN (k = 5) classification results.
Table 1. SAMPLID-kNN (k = 5) classification results.
smsinsmsoutcallincalloutinternet
AccStdAccStdAccStdAccStdAccStd
20 × 20—week0.7770.0570.7550.0630.7750.0570.7700.6680.6920.069
20 × 20—day0.7550.0570.7370.0390.7520.0680.7800.0790.7270.056
Random—week0.7170.0630.6650.0510.7050.0630.6730.0450.6970.078
Random—day0.7250.0920.7020.1070.7010.0420.6930.0540.6770.065
Random & 20 × 20—week0.7160.0580.6880.0500.7080.0540.7280.0570.7160.057
Random & 20 × 20—day0.7150.0520.7210.0540.7190.0590.7150.070.7160.066
Table 2. SAMPLID-kNN (k = 10) classification results.
Table 2. SAMPLID-kNN (k = 10) classification results.
smsinsmsoutcallincalloutinternet
AccStdAccStdAccStdAccStdAccStd
20 × 20—week0.7820.0540.7750.0550.7550.0900.7600.0610.7020.091
20 × 20—day0.7700.0720.7470.0450.7470.0680.7850.0720.7270.061
Random—week0.6850.0700.7100.0890.7140.0700.6850.0520.6650.079
Random—day0.7050.0750.7130.1040.7100.0750.6930.6030.6820.078
Random & 20 × 20—week0.7390.0710.7040.0430.7180.0690.7380.0820.7070.057
Random & 20 × 20—day0.7240.0420.7240.0480.7380.0550.7270.0560.7150.080
Table 3. Cluster accuracy results obtained by k-means using two clusters.
Table 3. Cluster accuracy results obtained by k-means using two clusters.
smsinsmsoutcallincalloutinternet
20 × 20—week0.5400.5280.5050.5700.515
20 × 20—day0.6380.6350.5030.5030.525
Random—week0.6290.6170.6370.6050.657
Random—day0.6410.6210.6370.5970.661
Random & 20 × 20—week0.6310.6300.5630.6050.543
Random & 20 × 20—day0.6340.6350.5460.5390.543
Table 4. Cluster accuracy results obtained by k-medoids using two clusters.
Table 4. Cluster accuracy results obtained by k-medoids using two clusters.
smsinsmsoutcallincalloutinternet
20 × 20—week0.6500.6300.6430.7280.548
20 × 20—day0.6400.6350.6530.7400.588
Random—week0.5730.5850.5770.5520.573
Random—day0.5520.5850.5810.5690.565
Random & 20 × 20—week0.5570.6100.5420.6190.515
Random & 20 × 20—day0.5770.5540.5630.6050.540
Table 5. Values of the silhouette coefficient for k clusters.
Table 5. Values of the silhouette coefficient for k clusters.
Datasetk Clusterssmsinsmsoutcallincalloutinternet
20 × 20 week20.7260.6680.7420.7640.769
30.7150.5930.7370.7030.771
40.7210.6050.6700.7080.747
50.6160.6000.6830.6520.624
60.6260.4740.6690.6190.635
70.6300.4830.6060.5840.622
20 × 20 day20.8340.8010.7400.7270.749
30.7470.6450.7470.7270.772
40.7430.6630.7020.6910.752
50.6620.6660.7140.7040.655
60.6620.5580.7110.6770.621
70.6430.5670.6410.6150.649
Random week20.8630.8410.8820.8580.887
30.8550.7770.8550.8090.835
40.7240.7550.7890.7930.799
50.6920.5030.6990.6880.673
60.6650.4980.6960.6830.671
70.6580.5120.6870.6870.680
Random day20.8740.8490.8850.8560.886
30.8490.8050.8580.8340.828
40.8220.7760.8160.8210.748
50.7090.7770.7390.7240.674
60.7110.5840.7250.7070.675
70.7020.5870.7250.7060.671
Random & 20 × 20 week20.8520.8170.7910.8280.808
30.7460.7050.7480.7210.799
40.7180.5720.7560.7330.723
50.6340.5480.6910.6480.649
60.6220.5460.6820.6130.660
70.6310.5510.6110.5880.644
Random & 20 × 20 day20.8590.8430.7840.7770.794
30.7090.7190.7780.7590.794
40.7400.6540.7720.7630.775
50.6750.6410.7110.7130.681
60.6710.6440.6620.6380.684
70.6630.5810.6530.6210.623
Full grid week20.9210.9200.9150.9130.933
30.8970.8760.8950.8900.878
40.8230.7660.7810.8220.782
50.7510.6720.7470.7440.749
60.7320.6540.7470.7400.708
70.7170.6170.7060.7080.706
Full grid day20.9240.9300.9160.9160.934
30.9030.8850.9030.8960.892
40.8200.8000.7940.8220.853
50.7690.7370.7650.7650.760
60.7420.6840.7680.7670.741
70.7380.6770.7360.7400.732
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Mendoza-Hurtado, M.; Romero-del-Castillo, J.A.; Ortiz-Boyer, D. SAMPLID: A New Supervised Approach for Meaningful Place Identification Using Call Detail Records as an Alternative to Classical Unsupervised Clustering Techniques. ISPRS Int. J. Geo-Inf. 2024, 13, 289. https://doi.org/10.3390/ijgi13080289

AMA Style

Mendoza-Hurtado M, Romero-del-Castillo JA, Ortiz-Boyer D. SAMPLID: A New Supervised Approach for Meaningful Place Identification Using Call Detail Records as an Alternative to Classical Unsupervised Clustering Techniques. ISPRS International Journal of Geo-Information. 2024; 13(8):289. https://doi.org/10.3390/ijgi13080289

Chicago/Turabian Style

Mendoza-Hurtado, Manuel, Juan A. Romero-del-Castillo, and Domingo Ortiz-Boyer. 2024. "SAMPLID: A New Supervised Approach for Meaningful Place Identification Using Call Detail Records as an Alternative to Classical Unsupervised Clustering Techniques" ISPRS International Journal of Geo-Information 13, no. 8: 289. https://doi.org/10.3390/ijgi13080289

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop