1. Introduction
The generalization of mobile phone usage has turned mobile phones into useful tools for gathering mobility data and extracting knowledge applicable to areas such as mobile network optimization [
1], the identification of human mobility patterns [
2,
3], marketing [
4], urban planning [
5,
6], service planning, public transport [
7], and tourism [
8], among others.
These data can be obtained from the mobile’s global positioning system [
9,
10], the proximity to a radio-frequency beacon such as a Wi-Fi antenna or beacon [
11], or call detail records (CDRs) stored by mobile phone network operators [
12,
13,
14,
15].
CDRs contain information that identifies the type of activity (internet, incoming/outgoing call, SMS message, etc.), its time of occurrence, and the radio base station (RBS) that provides the service. This information allows the user to be geolocated within the area covered by the RBS.
Although the positioning accuracy obtained by using CDRs depends on the extent of the area covered by the RBS, the large amount of information provided by these records makes them a useful tool for identifying population patterns such as those related to work, leisure, home, travel, and tourism [
3,
7,
12,
13,
14,
15]. Several other works with the use of mobile network data and CDRs have been conducted, such as in [
16], where Gergő et al. demonstrate how mobile network data can provide an efficient, automated alternative to traditional census methods for analyzing commuting patterns in the Budapest Metropolitan Area. And in [
17], Ferreira et al. present a methodology to identify individual users’ routine locations and attach semantic meanings to these locations using anonymized CDRs from mobile network data.
In any population analysis, the identification of meaningful places or locations [
18,
19] regularly visited by individuals or anchor points is of special interest. Home and work are the most common anchor points [
12].
Clustering techniques [
20] have been widely used in the literature for place identification [
19,
21,
22]. Cluster analysis, also known as clustering, is the unsupervised process of partitioning a set of unlabeled data points into distinct and mutually exclusive groups (clusters) based on their inherent similarities. This process aims to maximize the similarity of data points within each cluster while minimizing the similarity between data points belonging to different clusters. Csáji et al. [
21] use
k-means, a clustering algorithm to identify locations exhibiting similar weekly calling patterns and to identify which places correspond to work or home based on the calling patterns. In the work of Isaacman et al. [
15], clustering is used to associate several clusters with the places most frequently visited by users, and then those clusters are ranked and defined as home or work based on the hour during which they have the most events. For each cluster, they calculate five variables using the CDR data and a score using logistic regression, with coefficients calculated using the reported locations of the 18 volunteers. The resulting model for identifying home and work concludes, as expected, that the determining variables are only two: the number of events that occur during work hours (between 1 p.m. and 5 p.m.) and home hours (weekends or weekdays between 7 p.m. and 7 a.m.). Although the model uses the knowledge provided by the 18 volunteers, this only serves to demonstrate that the variables calculated from the CDR data fulfill the purpose for which they were defined. In [
9], data traces are also grouped with clustering, and time-based clustering is used to categorize the identified places.
Recently, more advanced and refined clustering techniques have been introduced, such as the method described in [
23], which combines Particle Swarm Optimization (PSO) with Fuzzy c-means (FCM) clustering. This approach aims to overcome the limitations of traditional FCM, including its sensitivity to noise and reliance on initial centroid selection.
In a
k-means algorithm, the general objective is to obtain
k partitions that minimize the sum of squared Euclidean distances between objects and cluster centroids. Although this algorithm is efficient, it is sensitive to noise and outliers. In contrast to
k-means, the
k-medoids algorithm [
24] chooses actual data points as centers and minimizes the sum of general pairwise dissimilarities, making it more robust to noise and outliers.
Clustering represents an easy way to analyze and categorize data because it is an unsupervised learning technique and, typically, no difficult data processing is required. However, the groupings are based on data characteristics, which are not always related to the classification objectives [
25]. That is, clusters made based on a measure of similarity or proximity of the data do not always have to correspond well with the classes into which we want to classify the data.
As an alternative to clustering and unsupervised learning, we can use supervised classification to identify population patterns that are learned by the classifier from correctly labeled data provided to it during the training phase. In supervised learning, we have a dataset with input labels and a desired output. The main objective is to build a model that is capable of predicting the desired output of a new object given the input features. In supervised learning, there is always a clear distinction between a training set and the test set that must be inferred.
The
k-nearest neighbors (kNN) classifier [
26] is among the highest-performing methods for classification tasks. This simple yet effective classification algorithm can be easily interpreted. The main challenge is to choose the optimal value of the
k neighbors, which is highly data dependent.
In this paper, we present SAMPLID, a new Supervised Approach for Meaningful PLace IDentification using mobility data provided by call detail records of Milan. The idea underlying our approach is based on addressing place identification problems from a supervised perspective, providing the model with representative information that allows it to learn from the places labeled by a expert, rather than through analysis and categorization of unlabeled data. In this way, we can train a classifier based on the knowledge provided and focused on the problem we aim to solve.
Providing a solid knowledge base to the classifier is essential. To generate training data for the classification model, we manually label several subregions using different sampling strategies such as random selection or selecting a large area containing all types of places to identify as detailed in the following sections. We attempt to identify the home and work places by training the model with manually labeled subgrids, based on the predominant type of buildings for each cell, and then predict the class for the complete grid.
To compare these approaches, we use mobility CDR data from the city of Milan [
27] to identify home and work places and make a comparative study against clustering analysis, which is typically used in mobility scenarios [
9,
14,
15]. We use
k-means and
k-medoids algorithms as unsupervised classifiers and SAMPLID-kNN using kNN classifier as a supervised classifier.
Overall, the contributions of our work are as follows.
We propose to address the problem of meaningful place identification from a supervised perspective to improve the results obtained with unsupervised methods, such as clustering techniques, which are traditionally used when dealing with large amounts of unlabeled data like those provided by CDRs.
To achieve this, we propose selecting a representative portion of the available data and correctly labeling it to use as a knowledge base for training a supervised model or classifier. This will enable us to accurately classify the entirety of the data for which we do not know the labels.
We use mobility CDR data from the city of Milan to identify home and work places. To achieve this, we correctly label the data corresponding to a 20 × 20 subgrid and a series of random cells into which we divided the city of Milan.
We compare the results obtained using k-means and k-medoids algorithms as unsupervised classifiers and SAMPLID-kNN using the kNN classifier as a supervised classifier.
Finally, we not only assess the effectiveness of the proposed method compared to the alternatives considered, but we also draw additional conclusions, such as what information contained in the CDRs is most useful for identifying home and work places; whether better results are obtained using the knowledge provided by the 20 × 20 subgrid, the selected random cells, or their combination; the advantages and limitations of the proposed method; and the direction for future research.
In the next sections, we describe our proposed method (
Section 2), the data used to perform the experiments and the experimental setup that we used to test the goodness of our proposed method (
Section 3). We present our results in
Section 4, and in
Section 5, we state the conclusions of our work and future research lines.
2. SAMPLID: Supervised Approach for Meaningful Place Identification
In this section, we explain how to approach the problem of identifying areas of interest through supervised learning as an alternative to the traditionally used unsupervised methods.
The first problem we encounter in unsupervised classification is determining the number of classes c to identify. We can set this number based on our objectives or use a statistical procedure, letting the classifier analyze the data and classify them based on their characteristics. However, these data characteristics do not always have meaning or utility for the classification objectives, and the classifier may identify curious but impractical spurious correlations.
SAMPLID does not seek similarities among the data for classification; instead, it tries to find or learn a function that, when applied to the input variables associated with a pattern or sample, indicates the class to which the data belong.
Let
T be a dataset consisting of
n cells
and its associated classes
,
. Here,
and
, where
c is the number of classes and
m is the number of variables available to classify each cell.
h is a classifier, and
is the predicted class for the example
[
28].
Here, we need a set of representative patterns or cells correctly classified that allows us to infer a function and evaluate its efficiency before using it to classify unlabeled patterns . If such a set of patterns is not available, it will be necessary to generate a set using a specific strategy to select and classify such patterns.
We can choose to create a random selection of cells from the entire surface or part of the surface under study, select one or several representative subgrids that integrate all types of cells, or a combination of both. A random selection will, a priori, contain more information about the characteristics of the cells based on their distribution on the map, whereas a selection of subgrids will contain more information about the boundaries between areas of different types.
The classification of the learning set will depend on the characteristics of the problem to be solved. In the case of identifying home and work places, cells can be classified with on-site observation, based on maps that provide information about building types, signage in the areas, businesses, etc. The classification accuracy of the learning set is crucial for inferring the classifier. The importance and complexity of this task determine the size of the learning set.
The next step is to use a supervised classification method that allows us to infer the function
. Taking into account the characteristics of the problem at hand, the kNN classifier may be a good choice. This classifier is well known and widely used due to its good generalization and easy implementation [
29,
30]. Although simple, the kNN classifier can usually match, and even surpass, the performance of more sophisticated and complex methods. The kNN algorithm utilizes a reference set of data points, known as prototypes, to encode the domain knowledge relevant to the problem. To classify a cell
using SAMPLID-kNN, the
k cells that are more similar to
are obtained, denoted as the
k nearest neighbors, and
is classified into the class that is most frequent in this set of
k neighbors.
The time complexity of the algorithm in the prediction phase is log .
If the classifier obtained and evaluated with correctly classified data is sufficiently accurate, we will apply the classifier to the study area. The method for evaluating the goodness of the results obtained in unlabeled cells will depend on the characteristics of the problem and actual evidence based on observation or available data.
Algorithm 1 presents SAMPLID in a formal manner and describes the steps for addressing the problem of meaningful place identification using supervised classifiers. A flowchart of the algorithm is represented in
Figure 1.
Algorithm 1: SAMPLID: Supervised Approach forMeaningful Place Identification. |
![Ijgi 13 00289 i001]() |
3. Experimental Setup
Next, we describe the characteristics of the data, the supervised classification method used to evaluate the goodness of SAMPLID, and the clustering algorithms used for comparison with our proposed method.
3.1. Data Description
Access to communication data is often restricted, typically requiring research teams to enter into non-disclosure agreements and research contracts with private companies. This limited availability of open datasets presents a significant challenge for researchers seeking to conduct studies in this field.
In this context, research challenges providing access to datasets to a large number of researchers are becoming a valuable framework. An example is Orangeâs “Data for Development” (D4D) initiative in 2013 [
31] and 2014–2015 [
32], but unfortunately, these data are no longer available.
However, Telecom Italia, in association with several universities and foundations, has made available the data that will be used in this study. This dataset stands out due to its open- and multi-source aggregation of data from diverse sources, such as telecommunications, weather, news, social networks, and electricity information for the city of Milan [
27]. We will focus on the telecommunication data, which consist of CDR data aggregated in 10 min intervals on a 100-by-100 grid (squared cells with an approximate size of 235 × 235 m) that covers the city of Milan (
Figure 2a).
Each time a user interacts with the telecommunications network, the operator assigns an RBS and creates a CDR containing the RBS that handled the interaction and the time at which the interaction occurred. Each RBS covers a specific area of the territory
v and allows its users to be geolocated using RBS coverage maps
(
Figure 2b).
A square of the grid can be composed of several portions of the coverage areas of the RBS and vice versa. To perform spatial aggregation, the number of interactions or records
in a grid square
i at time
t is calculated as follows [
27]:
where
is the number of records in
v at time
t,
is the area of
v, and
is the area of the intersection between
v and the square
i.
The number of records in the datasets
is calculated as follows:
where
is a constant that hides the true number of records.
The CDR contains records for the following activities:
Incoming SMS (smsin). A dedicated CDR is generated for each received SMS message.
Sent SMS (smsout). Similarly, a single CDR is generated for each sent SMS message.
Incoming call (callin). Every received call triggers the creation of a corresponding CDR.
Outgoing call (callout). Likewise, a CDR is generated for each initiated call.
Internet. Mobile internet activity is represented in the CDR. A CDR is generated at the start and end of each internet connection. Additionally, during an ongoing connection, a new CDR is created if the duration exceeds 15 min or if data transfer surpasses 5 MB.
The information is already aggregated and anonymized so that it is not possible to identify individual mobility data. The data are provided in text files, in which each line contains the following fields: cell identifier, date, time, number of records () of incomng SMS messages (smsin), sent SMS messages (smsout), incoming calls (callin), outgoing calls (callout) and internet.
For our study, we select a typical week with no festivities over the two-month period available to perform classification and clustering on the map. We focus on one week because we are aiming to distinguish home and work places; one week is sufficient for studying mobile traffic patterns while providing enough input data. We also use a working day (Monday) for comparison with the results obtained from using a week of data.
We process the dataset by aggregating the measures into hourly intervals and scaling their values into a range of [0, 1] using a min-max scaling [
33], for ease of data management.
3.2. Supervised Classification Method
To validate SAMPLID, we use the kNN classifier [
26] because it is one of the most commonly used, simple, effective, and easily interpretable classifiers, with a high performance that reaches the level of more complex classifiers. To evaluate the performance of SAMPLID-kNN, we use
as the number of neighbors, and six different datasets:
The 20 × 20 subgrid with data for one week;
The 20 × 20 subgrid with data for one working day;
The subgrid formed by 250 random cells with data for one week;
The subgrid formed by 250 random cells with data for one working day;
The 20 × 20 subgrid and 250 random cells with data for one week;
The 20 × 20 subgrid and 250 random cells with data for one working day.
To obtain results, we perform a 10-fold cross-validation for each mobile traffic metric (incoming SMS, outgoing SMS, incoming calls, outgoing calls, and internet traffic) and each value of .
The results obtained will indicate the most appropriate values for k and the mobile traffic metric, the most appropriate training set, and whether it is better to use data for one week or one working day. Using this information, we apply SAMPLID-kNN to the whole grid and assess whether the method is effective in predicting home and work places for the whole grid.
3.3. Clustering Method
To compare the results obtained with our model, we use a
k-means clustering algorithm whose objective is to minimize the sum of the squared Euclidean distances between elements of the clusters and their centroids. This algorithm converges rapidly and is widely used in the literature for detecting meaningful places [
21].
We also apply the
k-medoids clustering algorithm [
24], which minimizes a sum of general pairwise dissimilarities and chooses actual data points as centers. This algorithm may be more robust to noise and outliers than the
k-means algorithm.
First, we apply the
k-means and
k-medoids algorithms with two clusters to identify two classes, potentially being home and work. Next, we conduct a silhouette analysis [
35] using the silhouette coefficient [
36] to calculate the optimal number of clusters
k; we then apply the clustering algorithms again with the optimal number of clusters,
k. Here, we utilize values between
and
.
4. Results
After describing the experiments that we have performed in order to identify which approach achieves superior results in detecting home and work places, we present the results in this section. All of the map visualization figures can be accessed at the reference links.
Table 1 and
Table 2 show the accuracy and standard deviation values obtained by SAMPLID-kNN with 5 or 10 neighbors, respectively, for each dataset considered. The values marked in bold represent the best result for each category of incoming or outgoing SMS messages, calls, and internet. A
t-test [
37] with an alpha of 0.05 is conducted to identify significant differences among the results. We also calculate Cohen’s
d [
38] to determine whether the significant differences are very small (
), small (
), medium (
), large (
), very large (
), or huge (
).
The best results, in absolute terms, are obtained for the 20 × 20 subgrid with data for outgoing calls (callout) for one working day with the number of neighbors ; in general, the results obtained are sufficient to consider this algorithm capable of predicting home and work places.
For incoming messages (smsin), outgoing messages (smsout), and incoming calls (callin), the best results are obtained with the 20 × 20 week dataset. For outgoing calls (callout) and internet, the best results are obtained with the 20 × 20 day dataset.
We can see that the 20 × 20 subgrid performs better than the random subgrid. This behavior may result from the greater facility in classifying cells concentrated in a zone with clear transitions between areas, compared with randomly chosen cells with diverse spatial relationships due to the extent of the territory covered. However, the use of both datasets does not improve the results, indicating that the information provided to the classifier by groups of close cells is essential for achieving good results.
The differences obtained for and are not significant for smsin, callout, or internet, but these differences are significant for smsout () and callin (). The Cohen’s d values for smsout, , and callin, indicate that these significant differences are moderate. Therefore, we can conclude that the results obtained for and are similar.
In a more visual way,
Figure 4a on the left, (Available at
http://geojson.io/#data=data:text/x-url,
https://raw.githubusercontent.com/mendozamanu/milan-mobility/main/geojsons/true20x20.geojson accessed on 14 August 2024) shows the manually labeled subgrid, and on the right,
Figure 4b (Available at
http://geojson.io/#data=data:text/x-url,
https://raw.githubusercontent.com/mendozamanu/milan-mobility/main/geojsons/predictions_2020co.geojson accessed on 14 August 2024) shows the same predicted subgrid for the 20 × 20 sample classified with SAMPLID-kNN (
) using callout data from one working day. The red cells represent a residential zone, and transparent cells represent a working zone. Both figures visually indicate the good performance of the classification. The main discrepancies occur, as expected, in cells that are difficult to classify because they share both types of places or they are border cells, small islands, or cells that have a shared use as in a university campus.
If a group of cells is covered by a single RBS, the cells will have the same data; if they belong to different classes, the classifier will assign the same class to all cells. If cells of different classes are covered by different RBSs, their data will be different, and the cells will be more easily classified.
Once the goodness of the results obtained in the labeled cells using SAMPLID-kNN has been evaluated, we proceed to predict home/work labels for the whole grid. To do this, we use the configuration for which we obtained the best results in the previous phase, i.e., the 20 × 20 subgrid with callout data for one working day, as a training set, with .
The results are shown in
Figure 5 (Available at
http://geojson.io/#data=data:text/x-url,
https://raw.githubusercontent.com/mendozamanu/milan-mobility/main/geojsons/predictions_fullgrid_co.geojson accessed on 14 August 2024). A red grid represents a zone identified as home, and a transparent grid indicates a working zone. The city center is primarily classified as home. Only some large areas covered by RBSs that primarily cover working zones are classified as such. When we move away from the city center, the opposite trend occurs, and the residential zones are difficult to identify when their extension or density is not sufficient. As we move away from densely populated areas, the extent of the area covered by the RBSs increases, and it becomes more complex to detect the islands of cells belonging to residential zones. Given the limitations of the data used, the SAMPLID-kNN prediction provides valuable insight into the identification of home and work places in the city of Milan.
Now, we evaluate the predictions of the clustering algorithms and compare the results with those obtained via SAMPLID-kNN.
Table 3 and
Table 4 show the results obtained by the
k-means and
k-medoids clustering algorithms using two clusters. The best results, shown in bold, are obtained with the
k-medoids algorithm and the 20 × 20 subgrid with
callout data for one working day; however, these results are never better than those obtained by the kNN classification.
Figure 6a (available at
http://geojson.io/#data=data:text/x-url,
https://raw.githubusercontent.com/mendozamanu/milan-mobility/main/geojsons/clust20x20_2.geojson accessed on 14 August 2024) shows the best results obtained for the 20 × 20 subgrid and
k-means using smsin data from one working day. Similarly,
Figure 6b (available at
http://geojson.io/#data=data:text/x-url,
https://raw.githubusercontent.com/mendozamanu/milan-mobility/main/geojsons/clust20x20_km2.geojson accessed on 14 August 2024) shows the best classification obtained for the same area and
k-medoids using callout data from one working day. Graphically, we can see that the
k-means classifies almost all cells as home, even those that are clearly work. In the case of
k-medoids, a clear border is established between the left part of the image, home, and the right part, work. In both cases, the clustering is not able to improve the classification performed by the proposed model SAMPLID using kNN (
Figure 4b).
Next, we apply clustering to the whole grid using the configuration for which we obtain the best results: callout data for one working day with the k-medoids algorithm.
To determine whether it is possible to improve the clustering results obtained for the whole grid algorithm by applying better data partitioning, we determine the silhouette coefficient for
k values ranging between
and
, as shown in
Table 5 for each dataset. The values marked in bold represent the best results, which are those closest to unity. In general, the best results are always obtained for the
cluster, which indicates that the best way to group the data is in two clusters as we did before. Thus, it is not necessary to conduct additional runs of the clustering algorithms.
5. Conclusions and Future Research Lines
In this paper, we have presented a new supervised approach for meaningful place identification using mobility data provided by the CDRs stored by the operator Telecom Italia of the Milan mobile phone network as an alternative to classical unsupervised clustering techniques. In contrast to cluster analysis, our proposed method does not group or classify mobility data based on their general characteristics, regardless of whether the characteristics make sense for the purpose of classification. Instead, SAMPLID, our proposed method, learns a classification function based on prior knowledge provided to the classifier. The application of this method for identifying home and work places allowed us to evaluate the performance of the new proposed approach in classifying random cells, cells grouped in a grid, or a combination of both. Additionally, our results aided us in determining whether it is more appropriate to use data from a working day or a standard week for the problem of interest and in identifying what type of activity recorded by the CDRs is the most promising.
The best results for our proposed method with kNN as a supervised classifier (SAMPLID-kNN) were obtained by using a 20 × 20 subgrid with outgoing call data (callout) for one working day and . For all types of CDRs, the best results were obtained with the 20 × 20 subgrid, indicating that the model performs better when provided with information from nearby cells with a close spatial relationship, establishing neighboring relations that define clear transitions between cells of different types. The use of random cells with diverse spatial relationships does not seem to provide any advantage. Regarding the type of CDR used, although the best results were obtained using callout, there were no significant differences between the different data types, as all types record a common population pattern to a greater or lesser extent. The value of k also does not seem to have much importance, most likely because of the homogenizing effect of spatial aggregation, which assigns the same values to cells covered by the same RBS and smoothens the differences between cells covered by multiple RBSs. Moreover, although using data from one working day instead of one week does not lead to a significant improvement in the results, this approach allows us to identify the same patterns of population behavior from less information.
As expected, the best results for clustering algorithms were also obtained with callout data for one working day based on the 20 × 20 subgrid and k-medoids, which are more robust to noise and outliers than k-means. However, these results did not exceed those obtained with the model proposed in this paper.
Our results show that the k-medoids clustering algorithms are less sensitive than our model to transitions between different types of cells and have more difficulty in classifying home places far from the city center and work places in the city center.
Although the intrinsic characteristics of CDRs make it difficult to achieve greater precision in the identification of home and work places, this study has demonstrated the benefits of SAMPLID, our proposed supervised approach. Despite the effort required to correctly identify a significant number of patterns that enable any supervised classifier to learn effectively, we have demonstrated the potential of this approach in addressing the complex problem of meaningful place identification.
The large amount of information stored by mobile phone network operators about the activity of mobile phones in CDRs makes them a useful tool for identifying meaningful places frequently visited by individuals. On the other hand, CDRs are limited in location accuracy because they record positions only at the granularity of a radio base station. However, the increase in the density of the RBS network is proportional to the population density it serves, which helps keep the bias within acceptable margins for identifying meaningful places such as home and work.
As a final conclusion, we can affirm that the results obtained in this work using the supervised approach proposed by SAMPLID are sufficiently good to consider its application in any population analysis traditionally addressed using unsupervised clustering techniques, especially when dealing with large amounts of unlabeled data, such as CDRs. In this study, we have demonstrated that labeling a small representative portion of the data can lead to substantial improvements by enabling the application of supervised learning techniques.
These promising results motivate the beginning of a new line of research aimed at identifying meaningful locations through a supervised approach using knowledge extracted from the mobility data provided by mobile phones. Clearly, the performance of the supervised approach proposed in this work could be improved by using more precise positioning methods, which are not always available in the necessary quantity and breadth.
Among the most interesting future research directions is the study of different sampling methods that allow us to select a set of cells or representative territory areas that provide us with a good knowledge base for training the classifier. Equally interesting would be the study of the characteristics that the used classifier should have and a comparative study of the most promising alternatives.
One of the problems we face when classifying a cell into a single category is that it may contain several classes of places or have shared uses. Thus, we believe that addressing the problem of meaningful place identification from a multi-label perspective is one of the most promising and innovative lines of research, given the intrinsic characteristics of the problem. In this context, novel knowledge selection methods or instance selection [
39] and optimization of the used classifier [
40] can also be applied to improve the performance.