Next Article in Journal
Optimization of SOX2 Expression for Enhanced Glioblastoma Stem Cell Virotherapy
Previous Article in Journal
Dominance-Based Rough Set Model in Hesitant Fuzzy Information Systems
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Investigating the Relationship between Balanced Composition and Aesthetic Judgment through Computational Aesthetics and Neuroaesthetic Approaches

1
College of Mechanical Engineering and Automation, Huaqiao University, Xiamen 361021, China
2
Xiamen Academy of Arts and Design, Fuzhou University, Xiamen 361021, China
*
Author to whom correspondence should be addressed.
Symmetry 2024, 16(9), 1191; https://doi.org/10.3390/sym16091191
Submission received: 24 July 2024 / Revised: 2 September 2024 / Accepted: 4 September 2024 / Published: 10 September 2024
(This article belongs to the Section Life Sciences)

Abstract

:
Background: Symmetry is a special kind of balance. This study aims to systematically explore and apply the role of balanced composition in aesthetic judgments by focusing on balanced composition features and employing research methods from computational aesthetics and neuroaesthetics. Methods: First, experimental materials were classified by quantifying balanced composition using several indices, including symmetry, center of gravity, and negative space. An EEG experiment was conducted with 18 participants, who were asked to respond dichotomously to the same stimuli under different judgment tasks (balance and aesthetics), with both behavioral and EEG data being recorded and analyzed. Subsequently, participants’ data were combined with balanced composition indices to construct and analyze various SVM classification models. Results: Participants largely used balanced composition as a criterion for aesthetic evaluation. ERP data indicated that from 300–500 ms post-stimulus, brain activation was more significant in the aesthetic task, with unbeautiful and imbalanced stimuli eliciting larger frontal negative waves and occipital positive waves. From 600–1000 ms, beautiful stimuli caused smaller negative waves in the PZ channel. The results of the SVM models indicated that the model incorporating aesthetic subject data (ACC = 0.9989) outperforms the model using only balanced composition parameters of the aesthetic object (ACC = 0.7074). Conclusions: Balanced composition is a crucial indicator in aesthetics, with similar early processing stages in both balance and aesthetic judgments. Multi-modal data models validated the advantage of including human factors in aesthetic evaluation systems. This interdisciplinary approach not only enhances our understanding of the cognitive and emotional processes involved in aesthetic judgments but also enables the construction of more reasonable machine learning models to simulate and predict human aesthetic preferences.

1. Introduction

Symmetry and balanced composition are widely utilized across various fields, including gardening design, architecture, and artistic creation. The term “composition” originates from the Latin word “composito”, which can be translated as “arrangement” or “organization” [1]. The principle of unity guides this process by ensuring the elements produce a harmonious aesthetic, and balance is an important means to achieve unity [2]. Arnheim [3] argued that the sense of balance is a psychological need: “When people looked at pictures, they naturally sought a state of stability and balance”. By adhering to specific methods, creators can achieve well-balanced in paintings, ensuring that the elements in the work reach a harmonious and stable visual state, resulting in a composition that is beautiful [1,4].
Although beauty has no absolute criterion, it possesses universality. Chatterjee et al. [5] suggested that art possesses a dual nature: it is both highly varied and culturally diverse, yet also universal and common to all humans. Semir Zeki et al. [6,7] divided sensory experiences, including those from aesthetic sources, into two main categories: the aesthetic experience of biological beauty, and the experience of artifactual beauty. Research indicates that balance affects eye movements and can function as a primitive visual operating system, the ability to discern balanced compositions was independent of an individual’s level of art education, both individuals with and without an artistic background could quickly determine whether a picture was balanced or not, balance is a fundamental principle in the organization and biology of organic forms, and humans share an inherent sense of composition, derived from our innate ability to recognize organic form [8,9,10,11,12]. However, the manifestation of balanced composition varies across different types of pictures, and not all balanced compositions will necessarily appeal to people [13,14]. It is generally believed that a pictorial configuration is considered balanced when its elements and their qualities are poised or organized around a balancing center, giving the appearance of being anchored and stable [15]. Scholars have long been attempting to quantify the feature of balance through various methods. Advances in the field of computer science have introduced new possibilities for computational approaches. In 2005, the concept of computational aesthetics was first introduced at the International Conference on Computational Aesthetics in Graphics, Visualization, and Imaging of the Eurographics Association, defined as the study of computational methods that can make aesthetic decisions in a manner similar to human judgment [16]. The primary research methods in computational aesthetics encompass conventional approaches with handcrafted features, as well as aesthetic judgment tasks employing deep learning techniques, etc. [17]. Although balanced composition is a relatively basic handcrafted feature, it is influenced by many factors, primarily including symmetry, center of gravity, and negative space.
Symmetrical balance pertains to the symmetrical allocation of elements on either side of the central axis within the picture, engendering mirror symmetry. Symmetry is a significant and conspicuous characteristic of the visual realm, and it is regarded as the foundation of image segmentation and perceptual organization, while also exerting a role in more advanced processes [18]. Enquist et al. [19] stated that the ubiquity of symmetry in nature and decorative art could be attributed to the sensory bias towards symmetry in humans and other organisms, which has been independently exploited by natural selection acting on biological signals and by human artistic innovation. Certain studies have revealed that even infants are already capable of efficiently processing vertically symmetrical patterns, suggesting that the recognition of vertical symmetry may be innate or acquired at a very early stage [20]. Guy et al. [21] propose that stimulus symmetry might induce selective attention to the global properties of a visual stimulus, thereby facilitating higher-level cognitive processing in infancy. Other studies have discovered that for adults, symmetry demonstrates a strong positive correlation with aesthetic judgment [22,23,24]. Certainly, the process of aesthetics is complex, and factors such as educational background, cultural differences, and professional knowledge level can all have an impact on aesthetics. Leder et al.’s [25] research discovered that in the task of rating beauty, compared with art historians and non-experts, art experts regarded asymmetrical and simple stimuli as the most beautiful, which demonstrated the influence of education and training on aesthetic appreciation. Asymmetrical balance refers to the visual asymmetry of elements in a picture, but through the ingenious arrangement of factors such as color, shape, and size, the whole still appears harmonious and stable.
Asymmetrical balance is typically more dynamic, which can arouse a deeper level of interest and discussion from the audience. Studies have discovered that when adults arrange picture elements on circular and rectangular backgrounds, they will use the center of the picture as the “anchor” to evenly distribute the structure or physical weight of the elements around the main axis of the design throughout the entire structure [15,26]. Many studies on balanced composition focus on this “anchor”. Wilson and Chatterjee proposed a method for quantifying balanced composition called the Assessment of Preference for Balance (APB). This method involves centering on the midpoint of the picture and using the main axes—the vertical, horizontal, and two diagonal axes. The black pixel ratios of the equal-area regions on both sides of, and inside and outside, the corresponding axes are quantified. The overall balance value is then determined by averaging these eight balance ratios [27]. Some scholars have also put forward that the degree of deviation between the center of gravity and the center of the picture can be used as a quantitative indicator of balance [28]. Research has shown that using the deviation of the center of mass as a quantitative indicator of the balanced composition of multi-object and dynamic patterns is positively correlated with the degree of favorability [29]. Alternatively, in a polar coordinate system, an angle variable can be added based on the Euclidean distance to quantify the balance [30]. Some studies use the more robust Manhattan distance instead of the Euclidean distance [31]. Through rational composition, the blank negative space can also be a part of the balanced composition. The negative space can be deliberately designed to represent significant content in the scene [32,33]. By leaving blank areas around the main subject, the viewer’s attention can be naturally guided to focus on the main subject, thereby enhancing the visual impact. Appropriately distributing negative space in the picture can balance the visual weight, achieving an overall harmonious effect. For the quantification of blank space, some researchers directly obtain it by using the ratio of the pixels of the blank area to the total pixels of the picture [34]. However, some scattered color blocks do not affect the viewer’s overall impression of the painting. Therefore, in some studies, when calculating the blank space, only the larger white areas in the painting are considered as the blank area by partitioning the blank area [31].
Balance composition is closely related to aesthetics, and in their explorations artists are unconsciously exploring the organization of the visual brain, though with techniques unique to them [35]. To unveil the cognitive processes involved in the creation and appreciation of artworks, using neurological terminology to explain art has become a trend, and the study of aesthetics is gradually shifting from basic visual functions to a comprehensive neurobiological theory of art. Semir Zeki [36,37] defined neuroaesthetics as the study of the neural basis for the contemplation and creation of a work of art, which reflects the intersection of neuroscience, psychology, and aesthetics. Chatterjee et al. [38,39] characterized neuroaesthetics as the cognitive neuroscience of aesthetic experience, suggesting that aesthetic experiences likely emerge from the interaction between emotion–valuation, sensory–motor, and meaning–knowledge neural systems. The event-related potential (ERP) method enables researchers to identify the mental processing modes involved in cognitive and aesthetic processing. Many studies have used this method to investigate the connection between visual features and aesthetics, analyzing the cognitive processing of various features, such as symmetry, and their association with aesthetic judgments [22,40,41,42].
Both neuroaesthetics and computational aesthetics have made significant contributions to the study of aesthetics, each offering unique perspectives rooted in their respective disciplinary characteristics. Some scholars have suggested that an interdisciplinary approach, combining the methodologies of neuroaesthetics and computational aesthetics, could lead to more accurate predictions of human aesthetic preferences [43]. Li et al. [44] pointed out that computational aesthetics offered additional perspectives that deepened our understanding of aesthetic appreciation, while recent advancements in neuroaesthetics provided insights into the neural mechanisms underlying cognitive processes involved in aesthetic experiences and, by integrating characteristics from both fields, this approach enabled a more profound understanding of aesthetic appreciation. They leveraged neuroimaging data to identify neural features associated with subjective aesthetic experiences and predict aesthetic preferences. Coccagna et al. [45] employed a machine-learning-based data analysis methodology that extracts symbolic like/dislike rules based on the voltage at the most relevant frequencies from the most relevant electrodes. Iigaya et al. [46] proposed that any stimulus can be decomposed into objective components, a number of features or properties are associated with positive aesthetic judgments, and that aesthetic valuation can be seen as a high-level judgment derived from these elementary features. It follows that the aesthetic process involves at least two components: the stimulus, which serves as the aesthetic object, and the human, who acts as the aesthetic subject. Research on both aspects contributes to a more comprehensive understanding of aesthetics. With an emphasis on the feature of balance, this study investigates the relationship between balanced composition and aesthetic appreciation using a combined approach of neuroaesthetics and computational aesthetics research methods.
Based on existing research, firstly, we use images consisting of basic geometric shapes as experimental materials. Computational aesthetics methods were applied to quantify the factors of balanced composition—symmetry, center of gravity, and negative space—and cluster analysis was conducted to classify these materials. Second, employing neuroaesthetic research methods, an electroencephalography (EEG) experiment was conducted to analyze participants’ cognitive differences in balance judgment and aesthetic judgment tasks using the same set of materials. Finally, a multi-modal data integration approach was used to build a machine learning model based on computational aesthetics. The model incorporates parameters of balanced composition from the stimuli and ERP data collected from participants. By employing this interdisciplinary approach, the study aims to enhance the understanding of the relationship between balanced composition and aesthetics and to develop machine learning models capable of predicting human aesthetic preferences.

2. Materials and Methods

2.1. Materials

All stimulus materials were generated using Processing 5.0 software by configuring various parameters. All stimulus materials have a resolution of 300 dpi, and on a white background with a dimension of 500 × 500 pixels, several black squares, isosceles right triangles, and circles of different sizes are randomly and non-overlappingly distributed, as depicted in Figure 1. Next, the image was rotated 45° clockwise, and a black circular background was added as the subsequent experimental material, as shown in Figure 2. Subsequently, the balance parameters of the experimental materials were quantified. In this study, three parameters were utilized to quantify the balance: symmetry, center of gravity, and negative space.

2.2. Parameters of Balance

2.2.1. Symmetry

Symmetry encompasses left–right symmetry and central symmetry. Left–right symmetry pertains to the mirror symmetry of the content on the left and right sides of the image, while central symmetry refers to symmetry around the center of symmetry.
In this study, by counting the number of pixels with different positions on the left and right sides of the image with the central axis as the symmetry axis, the same method was also used to quantify the central symmetry value. As long as one of the two symmetries was fulfilled, the image could be regarded as symmetrical. Hence, through the quantification results, the closer symmetry type of the image could be determined, and this outcome was utilized as the symmetry value of the image.
A s y m m e t r y L R = x = 1 W / 2 I ( x , y ) I ( W x , y )
A s y m m e t r y c e n t e r = 1 2 x = 1 W I ( x , y ) I ( W x , H y )
S y m m e t r y = m i n ( A s y m m e t r y L R , A s y m m e t r y c e n t e r )

2.2.2. Center of Gravity

The overall distribution of the picture is quantified by the degree of deviation of the picture’s center of gravity. Firstly, the coordinates of the center of gravity x c e n t e r , y c e n t e r and the center of the image x c e n t r o i d , y c e n t r o i d are obtained, and subsequently, the Manhattan distance between the two is computed:
x c e n t e r , y c e n t e r = ( 1 N x = 1 W y = 1 H x · I x , y , 1 N x = 1 W y = 1 H y · I ( x , y ) )
x c e n t r o i d , y c e n t r o i d = ( W 2 , H 2 )
D M a n h a t t a n = x c e n t e r x c e n t r o i d + y c e n t e r y c e n t r o i d
Here, I ( x , y ) is the pixel value (0 or 1) of the image at position ( x , y ) , W is the width of the image, and H is the height of the image.

2.2.3. Negative Space

The quantification of negative space necessitates the division and feature extraction of the picture space, Quadtree is a data structure, and its fundamental concept is to recursively divide the two-dimensional space into a tree structure of varying levels [47].
In this study, the image was initially divided into four quadrants, and subsequently, each quadrant was inspected to determine if it was blank. If the quadrant was blank, the area of the quadrant was recorded; then, the non-blank quadrants were recursively subdivided until the termination condition was satisfied, as depicted in Figure 3.
The area of all white regions is recorded as S W h i t e , which serves as an indicator of the overall contrast of the picture. During the recursive process, a termination condition is set, and the last two results are removed. The prominent large white area is considered the main blank area and recorded as S B l a n k . Despite similar blank areas, the distribution of the blank area might vary. Some blank spaces are extensive and broad, while others are small and fragmented. The largest white rectangle obtained in the recursive process is utilized as a characteristic index to assess different blank spaces and is recorded as S Q u a d .

2.3. Stimulus

From the materials generated by the software, through the experimenters’ screening, some materials with similar facial expressions were excluded, and ultimately 279 materials were retained as experimental materials. Visual Studio 2019 software and the open-source computer vision and image processing library Open Source Computer Vision Library (OpenCV) were used to extract and quantify the features of the experimental materials. Based on the feature data, IBM SPSS Statistics 26 software was used for second-order clustering processing, and the experimental materials were divided into two categories, as shown in Table 1. Type I materials (N = 137) are more symmetrical, with a smaller negative space area and a center of gravity closer to the center of the picture; Type II materials (N = 142) are more asymmetrical, with a larger negative space area and a center of gravity farther from the center of the picture. Type I materials are more in line with the balanced composition in the general sense, so they are defined as “balanced” in this study. Conversely, Type II materials are classified as “imbalanced”.

2.4. Participant

In this experiment, 18 graduate students were recruited from the College of Mechanical Engineering and Automation, Huaqiao University, including 14 males and 4 females, aged between 22 and 30 years old. All the participants were right-handed and had not received systematic art education, and their vision or corrected vision was normal. Before the experiment, sufficient communication was conducted, and the participants signed the informed consent form. As compensation after the experiment, each participant received CNY 50. All the procedures and protocols of this experiment were approved by the School of Medicine, Huaqiao University.

2.5. Procedure

The experimental materials were printed on 85 mm × 85 mm cards and randomly presented to the participants. The participants were required to quickly browse and determine the style of the experimental materials, and then, based on their personal aesthetic standards, categorize the materials into three groups: at least 80 beautiful ones, at least 80 not beautiful ones, and the remaining ones with no feeling or indistinguishable, as shown in Figure 4. After completing the categorization, the experimenter would randomly select 5–10 materials for the participants to judge to ensure the accuracy of the classification. If there was a high error rate, the participants would be required to reclassify. There was a maximum of 3 days between the pre-experiment and the main experiment (mostly the next day), to ensure that in the main experiment, the participants could correctly distinguish between beautiful and not beautiful experimental materials.
In the main experiment, the aesthetic judgment task and balance judgment task were completely crossed, and all stimulus materials were presented in a random order. Before the main experiment, the experimenter gave the participants “aesthetic education”, using the characteristics of Type I materials as the balance index, and conveyed the form of balanced composition to the participants through verbal expression. During the experiment, the participants were required to concentrate and place the middle finger or index finger of their left and right hands on the Q and P keys of the keyboard. There was detailed experimental instruction before the experiment began.
Before the main experiment, there was a training block containing 20 stimuli (5 stimuli of each category), aiming to familiarize the participants with the experimental process. The stimulus materials in the training block did not appear in the formal experiment. Only when the accuracy rate of the training block was greater than 80% were the participants allowed to enter the formal experiment. The main experiment consisted of a total of 300 trials, including 75 balanced, 75 imbalanced, 75 beautiful, and 75 not beautiful trials. The main experiment was divided into three blocks, each with 100 trials, and there was at least a 5 min break between each block. Each trial began with a stationary white cross at the center of the screen, displayed on a gray background for 1000 ms. Subsequently, a cue word (beauty, balance) for the judgment task was presented for 1200 ms. After that, a stimulus image appeared for 3000 ms, during which the participants were required to make a judgment and press the button as promptly as possible. Finally, a blank stimulus lasting for 1000 ms appeared, and the participants could blink and rest during this stage, as shown in Figure 5. The entire experiment took approximately 1.5–2 h, including the preparation stage before the experiment. The experiment was conducted in a standard lightbox, as shown in Figure 6.

3. Results

EEG data were recorded using Neuroscan SynAmps2 equipment. The electrode distribution utilized in EEG experiments follows the international 10–20 system. Each electrode placement site is identified by a letter denoting the brain lobe or region it monitors: the prefrontal lobe (Fp) and frontal lobe (F) are situated in the anterior portion of the brain. The parietal lobe (P) is located at the top of the brain. The central region (C) is positioned in the central part of the brain. The occipital lobe (O) is located at the back of the brain. “Z” (zero) refers to electrodes placed on the midline sagittal plane of the skull (Fpz, Fz, Cz, Oz), while even-numbered electrodes (2, 4, 6, 8) are placed on the right side of the head, and odd-numbered electrodes (1, 3, 5, 7) are placed on the left side of the head. The reference electrodes were placed on both mastoids (M1, M2), and two pairs of electrodes were used to record the vertical electrooculogram (VEOG) and horizontal electrooculogram (HEOG). The VEOG electrodes were placed above and below the left eye, respectively, and the HEOG electrodes were placed 1 cm away from the outer corner of each eye. During the experiment, the impedance between the electrodes and the scalp was maintained below 10 kΩ to ensure signal quality.
After the completion of continuous EEG recording, offline data processing was carried out. CURRY 8.0 software was utilized to extract and analyze the EEG data. This included steps such as EEG data segmentation, artifact removal, baseline correction, and averaging. The bandpass filter range was set to 0–30 Hz, and the EEG artifact removal criterion was ±100 μV. Subsequently, the EEG data were segmented into 1200 ms epochs, with a time window ranging from 200 ms before the stimulus onset to 1000 ms after the stimulus onset, and the 200 ms before the stimulus onset was used as the baseline. Sixty-channel data were used for repeated measures analysis of variance (ANOVA). Mauchly’s sphericity test and within-subject effects test were employed. Finally, Bonferroni’s post hoc comparison method was used for multiple pairwise comparisons to explore specific differences between groups.
Since the EEG data of two participants were not satisfactory (availability rate < 50%), the data of sixteen participants were retained for analysis (with an average of 6.7% of the data being rejected).

3.1. Behavioral Results

The effects of different tasks (aesthetic, balance) and different answers (yes, no) on the accuracy (ACC) and reaction time (RT) of judgment were analyzed using repeated measures ANOVA. The results revealed that the main effects of the answer and task factors on the ACC were not significant (F < 1), and the interaction was also not significant (F (1, 15) = 3.956, p = 0.065). It can be observed from Table 2 that the accuracy rates in all four conditions were greater than 90%, indicating that the participants were able to accurately discriminate whether the experimental materials were beautiful and whether the composition was balanced.
The main effects of task and answer on RT were not significant (F < 1), but the interaction was significant (F (1, 15) = 4.952, p = 0.042). Further analysis revealed that the specific results showed that there were no significant differences between answers under each task condition, and there were no significant differences between tasks under each answer condition. This suggests that the significance of the interaction may result from the small differences in specific condition combinations rather than the overall significant differences.

3.2. Event-Related Potential Results

As shown in Figure 7, the grand-average ERP and isopotential contour plot indicated that starting from 300 ms to 500 ms, a negative wave with a relatively larger amplitude was activated in the anterior frontal to central regions of the anterior half of the brain. In the parietal–occipital regions, different experimental conditions triggered positive waves with varying amplitudes. Within the time window between 600 ms and 1000 ms, distinct negative waves were activated in the parietal region under different experimental conditions.

3.2.1. Early Stage (300–500 ms)

A three-factor repeated measures ANOVA was performed on the ERP average amplitude data across all electrodes using channel (60) × task (aesthetics, balance) × answer (yes, no). The findings indicated that the task main effect was significant (F (1, 15) = 4.999, p = 0.041), with the average amplitude of the balance task (0.232 μV ± 0.037) being notably smaller for the aesthetics task (0.256 μV ± 0.034). The main effect of the answer was significant (F (1, 15) = 13.659, p = 0.002), with the average amplitude for the answer “Yes” (0.290 μV ± 0.037) significantly greater than for the answer “No” (0.208 μV ± 0.132). The interaction between channel and task was not significant (F (59, 885) = 1.210, p = 0.139). The interaction between channel and answer was significant (F (59, 885) = 13.308, p < 0.01). Further analysis (Table 3) revealed that in the prefrontal lobe (FP1, FPZ, FP2), frontal lobe (F3, FZ, F4), and area near the central region (FCZ, CZ, CPZ), the “No” answer condition activated a larger negative wave. In the parietal–occipital (PO3, POZ, PO4) and occipital regions (O1, OZ, O2), the average amplitude for the “No” answer was significantly greater than for the “Yes” answer, with the “No” condition activating a larger positive wave.
The three-way interaction was significant (F (59, 885) = 1.495, p = 0.011). Further analysis (Table 4) showed that in the prefrontal, frontal, and central regions, a larger negative wave was activated for the “No” answer in both tasks. In the parietal–occipital and occipital regions, a larger positive wave was activated under the “No” condition for both tasks.

3.2.2. Late Stage (600–1000 ms)

A three-factor repeated measures ANOVA was performed on the data, yielding the following results: the main effect of the task was not significant (F < 1). The main effect of the answer was significant (F (1, 15) = 4.906, p = 0.001), with the average amplitude for the answer “Yes” (0.191 μV ± 0.027) significantly greater than for the answer “No” (0.119 μV ± 0.034). The interaction between channel and task was not significant (F < 1). The three-way interaction was not significant (F < 1). The interaction between channel and answer was significant (F (59, 885) = 1.605, p = 0.003). Further analysis (Table 5) revealed that in the PZ channel, the main effect of the answer was significant (F (1, 15) = 5.196, p = 0.038), with the negative wave amplitude for the answer “Yes” (−0.143 μV ± 0.446) being smaller than for the answer “No” (−0.806 μV ± 0.411), particularly in the aesthetics task.

4. Machine Learning Model

Based on the experimental results, a model of the experimental data is constructed. On the one hand, this is to further verify the reliability of the experimental results, and on the other hand, it is to explore the feasibility of optimizing the model by increasing the data of neuroaesthetics research. This study involves the interaction of two tasks (aesthetics, balance) and two answers (yes, no). Four types of data need to be classified, and the proportion of the four types of data is basically equal. Therefore, the support vector machine (SVM) is selected for modeling. SVM is a potent supervised learning model widely applied in classification and regression analysis. It achieves classification tasks by finding the optimal hyperplane to separate data samples of different categories. Its primary advantage lies in its ability to handle high-dimensional data [48]. In this study, the LIBSVM toolbox is used to implement the training and prediction of the SVM model, and the LIBSVM supports multiple kernel functions (such as linear kernel, polynomial kernel) and multi-class classification tasks [49]. The steps of the method are: use the LIBSVM toolbox in MATLAB (R2023b MATLAB 23.2) to train the data, select the appropriate penalty parameter C and kernel parameter γ, then train the SVM model with the best parameters, and evaluate the performance on the test set [50].
First, based on the behavioral data, the data with incorrect judgments by the subjects were eliminated, and the experimental data with correct responses were retained, totaling 4548 groups. In the output layer data, the classification results of the stimulus materials’ balanced composition were based on the results of the experimental calculation, and the aesthetic classification results of the stimulus materials were based on the classification results of each participant. The input layer data of the model included the feature data related to the balanced composition of the materials, and different schemes were selected for SVM modeling:
Scheme I: The input layer only contained the parameter data related to balanced composition in this study: symmetry, center of gravity, and negative space.
Scheme II: The input layer included the data in Scheme I, behavioral data (RT), and ERP data. The electrodes on the midline were selected, including the average amplitudes in the 300–500 ms time window of the FPZ, FZ, FCZ, CZ, POZ, and OZ electrodes and the average amplitudes in the 600–1000 ms time window of the PZ channel.
All data were standardized (standardization):
X = X μ σ
Here, X is the standardized feature value, X is the original feature value, μ is the mean of the feature, and σ is the standard deviation of the feature.
Next, determine whether the data are linearly separable in the original feature space. Use the principal component analysis (PCA) method to reduce the dimensionality of the data set to two dimensions, train a simple linear classifier (C = 1), and evaluate the performance of the linear classifier using 10-fold cross-validation. The results are shown in Figure 8.
The decision boundary indicates that the decision boundaries of both schemes cannot effectively separate different categories of samples and, with obvious intersections and overlaps, the model is not linearly separable in the reduced-dimensional feature space. Hence, the radial basis function kernel (RBF) is chosen for modeling. The RBF kernel function can map the original feature space to a high-dimensional feature space, enabling the data to be linearly separable in the new feature space, thereby addressing the issue of linear inseparability in the original feature space [51,52]. Eighty percent of the data are utilized as the training set, and twenty percent of the data are used as the test set. The model quality is evaluated through 10-fold cross-validation, and the grid search method is employed to determine the optimal C and γ. In the preliminary search stage, five values are uniformly sampled within a large range [−2, 2] in the logarithmic space, and the ACC is used for comprehensive assessment. The results are presented in Table 6:
The preliminary search results indicate that the C and γ of the two schemes perform well within the interval [0.01, 10]. Thus, in the fine search stage, the search range of C and γ is narrowed down to [0.01, 10], and 50 candidate values are generated using linear space sampling, totaling 25,000 combinations. To comprehensively evaluate the performance of the proposed model, the area under the receiver operating characteristic curve (AUC) is utilized to assess the performance of the multi-class SVM model. For the four-type classification problem in this study, the macro-average method, which calculates the AUC value of each category and takes the average, is used to comprehensively evaluate the overall model performance. Through this approach, the classification ability of the model on different categories can be comprehensively understood, and the accuracy and reliability of the evaluation results can be ensured. The AUC threshold is set at 0.7, and on this basis, the SVM classification model with the highest ACC is sought to ensure that the model has strong discriminatory ability while maximizing its overall classification accuracy. The results are presented in Figure 9 and Table 7.
It can be seen from Figure 9 and Table 7 that the optimal solution of Scheme I has an average loss of 0.2932 in the model cross-validation, an accuracy rate of 0.7074 on the test set, and an AUC of 0.8822. The model has a certain classification ability. The optimal solution of Scheme II has an average loss of 0.003 in the cross-validation, an accuracy rate of 0.9989 on the test set, and an AUC of 0.9997. Compared with Scheme I, the classification effect of Scheme II is better, the performance of the model in different folds is relatively stable, and the performance on the training and validation sets is consistent, indicating that the model has good generalization ability. According to the display of precision, recall, and F1 value, Scheme II has a significant overall improvement in the classification ability of each category compared to Scheme I.

5. Discussion

In this study, the materials were classified into balanced and imbalanced compositions based on several parameters, including symmetry, center of gravity, and negative space. Behavioral data indicated that the participants were able to quickly and accurately categorize the materials only after receiving a brief introduction before the formal experiment to understand the characteristics of balanced compositions in this study. This further proves that people can quickly learn to understand and distinguish whether the composition of a picture is balanced [13,53]. After removing the experimental data with incorrect responses, a statistical analysis of the materials that the subjects considered beautiful and not beautiful revealed that 92.92% of the materials considered beautiful by the participants were balanced compositions and 7.08% were imbalanced compositions, while 93.58% of the materials considered not beautiful were imbalanced compositions and 6.42% were balanced compositions. In other words, during the pre-experiment, when the subjects were not informed of the purpose of the experiment, they mostly chose balanced compositions as the main criterion for evaluating beauty. This finding further supports previous research conclusions that, while a balanced composition does not always signify beauty, it is a crucial factor in evaluating the aesthetic effects of images [29,30] and serves as an important organizational principle underlying the compositional strategies adults use when creating visual displays [54].
ERP data revealed that in the early stage (300–500 ms), ERP data showed significant separation between tasks, and the aesthetic task activated more extensive and active brain region activities than the balance task. At the same time, significant separation also occurred in the answers, and beautiful and balanced materials activated more active brain region activities in this time window. Specific analysis showed that unbeautiful and imbalanced materials activated significant ERP components in different brain regions: unbeautiful and imbalanced materials activated larger-amplitude negative waves in the prefrontal to central regions and larger-amplitude positive waves in the parietal–occipital and occipital regions. In the late stage (600–1000 ms), ERP data showed significant separation in the answers, specifically on the PZ channel, where beautiful materials activated a larger-amplitude sustained posterior negativity (SPN).
Studies have shown that the orbitofrontal cortex (OFC) exhibits different activities when perceiving beautiful and ugly stimuli and plays a crucial role in artistic creation of “beauty” in paintings [55,56,57,58]. There are significant differences in the ERP of the aesthetic response to artistic stimuli in the prefrontal region, and negative emotional stimuli (such as disgusting pictures) can trigger a larger-amplitude negative wave [59,60,61]. Research has shown that early negative emotions are generated in the prefrontal cortex to evaluate unbeautiful patterns that form early impressions in the response. The early frontal negative wave reflects the processing stage involving negative aesthetic evaluation [23,62]. In the aesthetics task and balance task of this study, the unbeautiful and imbalanced stimuli activated a larger-amplitude frontal negative wave, indicating that the brain experienced higher cognitive conflict and emotional discomfort when confronted with these stimuli. Both aesthetics judgment and balance judgment have triggered a higher cognitive load and emotional response to stimuli that do not conform to expectations in cognitive processing, which is reflected in the enhancement of the frontal negative wave. This provides a neurophysiological basis for understanding the interaction between cognition and emotion in aesthetics and balance judgments.
The P300 component in the parietal–occipital region reflects the difference in attentional selection of target stimuli in different tasks and is closely related to the redistribution of attention [63,64,65]. In the aesthetic task, the specific manifestation is that compared with less efficient processing, efficient processing is considered to result in a lower response [66]. In this study, unbeautiful and imbalanced materials may attract more attentional resources, and beautiful stimuli usually trigger positive emotional responses. This emotional pleasure can reduce cognitive load, thereby reducing the amplitude of P300. Balanced compositions are typically regarded as stable and comfortable and may induce less cognitive load. The larger-amplitude P300 component might reflect the brain’s enhanced attention and concentration on these stimuli. Additionally, it suggests that when processing unbeautiful and imbalanced materials, more attentional resources are required to analyze and comprehend this visual information, resulting in increased processing difficulty and decreased sorting efficiency. This outcome implies that the characteristic of balance is closely associated with the connection between aesthetics and cognitive processing, and balance is a significant aspect of beauty.
Sustained posterior negativity (SPN) is considered to be associated with the aesthetic judgment task and is predominantly observed in posterior brain regions such as the occipital and parietal lobes. It shows a continuous negative deflection, reflecting the cognitive activities and additional cognitive resources required in the process of visual attention and spatial processing. When a figure is considered beautiful, the emotional pleasure may ease the cognitive load, thereby reducing the SPN amplitude, which is considered to illustrate the importance of some features (such as symmetry) in aesthetic judgment [67,68,69,70,71]. Herron’s study discovered that the SPN in the 600–1200 ms range is sensitive to task fluency. When the retrieval task is not fluent, the SPN amplitude is larger, and as task fluency increases, the SPN shows a graded attenuation [72]. In this study, in the PZ channel, there was no significant difference in the SPN in the balance task, suggesting that although balance is also a visual aesthetic feature, its processing may differ from that of symmetry. Although the symmetrical feature is also a global composition feature, it typically has distinct visual cues, while the balance feature, especially asymmetric balance, requires the coordination of the overall layout and element distribution, which may mean that in the balance judgment task, regardless of whether it is balanced or imbalanced, the subjects analyze all the elements in all the pictures, thus there is no obvious SPN difference. However, in the aesthetic task, the beautiful stimulus activates a smaller-amplitude SPN, possibly because in the aesthetic task, the beautiful stimulus triggers a positive emotional response, reducing the brain’s cognitive processing load on these stimuli, which is consistent with the emotion regulation theory and task fluency theory, that is, when the subjects encounter beautiful experimental materials, positive emotions can alleviate the cognitive load, and the processing process is smoother and easier.
The study demonstrates the effectiveness of integrating neuroaesthetic data and hand-crafted features in enhancing the performance of aesthetic evaluation models. By incorporating both behavioral and ERP data into the SVM model, Scheme II significantly outperformed Scheme I, which only utilized features related to balanced composition. Scheme II achieved a notably higher accuracy rate (0.9989) and AUC (0.9997), indicating superior classification capability and generalization ability. The inclusion of ERP data, specifically the average amplitudes in key time windows and channels, allowed the model to capture more nuanced patterns associated with aesthetic judgment. This implies that integrating human factors via an interdisciplinary approach which combines neuroaesthetics and advanced machine learning models can more effectively establish an integrated aesthetic evaluation system that can simulate and predict human aesthetic preferences [43,44,73].

6. Conclusions

This study underscores the practicality and necessity of integrating computational aesthetics and neuroaesthetics methodologies. By systematically analyzing the relationship between visual features and aesthetic perception, the findings reveal that aesthetic judgments and balance judgments share similar early neural activation patterns. However, while balance in composition can influence aesthetic evaluation, it is not the sole determinant of beauty. Dependence on specific features alone to differentiate beauty from non-beauty offers a constrained perspective. The SVM classification model used in this study indicates that incorporating multi-modal data significantly enhances the performance and accuracy of machine learning models in simulating and predicting human aesthetic preferences. This research further highlights the significance of incorporating human factors into aesthetic evaluation systems. By employing an interdisciplinary approach, a more comprehensive understanding of the relationship between balanced composition and aesthetic appreciation is achieved. This approach facilitates the development of models that simulate and predict how humans process and differentiate various types of materials across different tasks, thereby enhancing the understanding of the interaction between the aesthetic subject and object.

Author Contributions

F.L., W.S., Y.L. and W.X. designed the experiment; F.L. and W.X. utilized the Neuroscan SynAmps2 device to record the EEG data and e-prime 3.0 software to record behavioral data; F.L. and W.X. analyzed and processed the experimental data using the CURRY 8.0 and IBM SPSS Statistics 26 software; F.L. and W.X. used MATLAB (R2023b MATLAB 23.2) software for machine learning model construction. F.L. and W.X. edited the first draft of the paper; W.S., W.X. and Y.L. revised the paper. All authors have read and agreed to the published version of the manuscript.

Funding

This research was funded by the Social Science Foundation of Fujian Province project (No. FJ2024C131), 2024 Ministry of Education Humanities and Social Sciences Research Art Studies Planning Fund Project: Neurobehavioral Empirical Research on Participatory Design Targeting Users’ Implicit Aesthetic Needs.

Institutional Review Board Statement

The study was conducted in accordance with the Declaration of Helsinki and approved by the School of Medicine, Huaqiao University.

Informed Consent Statement

Informed consent for participation was obtained from all subjects involved in the study.

Data Availability Statement

The datasets supporting the results of this article are included within the article.

Acknowledgments

We would like to thank all experimenters and participants of this study.

Conflicts of Interest

The authors declare no conflicts of interest.

References

  1. Soxibov, R. COMPOSITION AND ITS APPLICATION IN PAINTING. Sci. Innov. 2023, 2, 108–113. [Google Scholar]
  2. Rivotti, V.; Proença, J.; Jorge, J.A.; Sousa, M.C. Composition Principles for Quality Depiction and Aesthetics. In Proceedings of the Computational Aesthetics’07: Third Eurographics Conference on Computational Aesthetics in Graphics, Visualization and Imaging, Banff, AB, Canada, 20–22 June 2007. [Google Scholar]
  3. Arnheim, R. Art and Visual Perception: A Psychology of the Creative Eye; University of California Press: Berkeley, CA, USA, 1954. [Google Scholar]
  4. Mcmanus, I.C.; Edmondson, D.; Rodger, J. Balance in pictures. Br. J. Psychol. 1985, 76, 311–324. [Google Scholar] [CrossRef]
  5. Nadal, M.; Chatterjee, A. Neuroaesthetics and art’s diversity and universality. WIREs Cogn. Sci. 2019, 10, e1487. [Google Scholar] [CrossRef] [PubMed]
  6. Zeki, S.; Chén, O.Y.; Romaya, J.P. The Biological Basis of Mathematical Beauty. Front. Hum. Neurosci. 2018, 12, 467. [Google Scholar] [CrossRef]
  7. Zeki, S.; Chén, O.Y. The Bayesian-Laplacian brain. Eur. J. Neurosci. 2020, 51, 1441–1462. [Google Scholar] [CrossRef]
  8. Corwin, D.M. Pictorial Balance Is a Bottom-Up Aesthetic Property Mediated by Eye Movements. A Model of a Primitive Visual Operating System Explains Balance and Visual Properties of Pictures; Cold Spring Harbor Laboratory Press: Cold Spring Harbor, NY, USA, 2023. [Google Scholar]
  9. Langford, R.C. Ocular Behavior and the Principle of Pictorial Balance. J. Gen. Psychol. 1936, 15, 293–325. [Google Scholar] [CrossRef]
  10. Locher, P.J. The Contribution of Eye-Movement Research to an Understanding of the Nature of Pictorial Balance Perception: A Review of the Literature. Empir. Stud. Arts 1996, 14, 143–163. [Google Scholar] [CrossRef]
  11. Locher, P.; Nagy, Y. Vision Spontaneously Establishes the Percept of Pictorial Balance. Empir. Stud. Arts 1996, 14, 17–31. [Google Scholar] [CrossRef]
  12. Stebbing, P.D. A Universal Grammar for Visual Composition? Leonardo (Oxford) 2004, 37, 63–70. [Google Scholar] [CrossRef]
  13. Hübner, R.; Fillinger, M.G. Perceptual Balance, Stability, and Aesthetic Appreciation: Their Relations Depend on the Picture Type. I-Perception 2019, 10, 1386602948. [Google Scholar] [CrossRef]
  14. Samuel, F.; Kerzel, D. Judging Whether it is Aesthetic: Does Equilibrium Compensate for the Lack of Symmetry? I-Perception 2013, 4, 57–77. [Google Scholar] [CrossRef] [PubMed]
  15. Locher, P.J.; Jan Stappers, P.; Overbeeke, K. The role of balance as an organizing design principle underlying adults’ compositional strategies for creating visual displays. Acta Psychol. 1998, 99, 141–161. [Google Scholar] [CrossRef]
  16. Hoenig, F. Defining Computational Aesthetics. In Proceedings of the First Eurographics Conference on Computational Aesthetics in Graphics, Visualization and Imaging, Girona, Spain, 18–20 May 2005. [Google Scholar]
  17. Zhang, J.; Miao, Y.; Yu, J. A Comprehensive Survey on Computational Aesthetic Evaluation of Visual Art Images: Metrics and Challenges. IEEE Access 2021, 9, 77164–77187. [Google Scholar] [CrossRef]
  18. Bertamini, M.; Silvanto, J.; Norcia, A.M.; Makin, A.D.J.; Wagemans, J. The neural basis of visual symmetry and its role in mid- and high-level visual processing. Ann. N. Y. Acad. Sci. 2018, 1426, 111–126. [Google Scholar] [CrossRef]
  19. Enquist, M.; Arak, A. Symmetry, beauty and evolution. Nature 1994, 372, 169–172. [Google Scholar] [CrossRef]
  20. Bornstein, M.H.; Ferdinandsen, K.; Gross, C.G. Perception of symmetry in infancy. Dev. Psychol. 1981, 17, 82–86. [Google Scholar] [CrossRef]
  21. Guy, M.W.; Reynolds, G.D.; Mosteller, S.M.; Dixon, K.C. The effects of stimulus symmetry on hierarchical processing in infancy. Dev. Psychobiol. 2017, 59, 279–290. [Google Scholar] [CrossRef]
  22. Jacobsen, T.; Hofel, L. Descriptive and evaluative judgment processes: Behavioral and electrophysiological indices of processing symmetry and aesthetics. Cogn. Affect. Behav. Neurosci. 2003, 3, 289–299. [Google Scholar] [CrossRef]
  23. Höfel, L.; Jacobsen, T. Electrophysiological Indices of Processing Symmetry and Aesthetics. J. Psychophysiol. 2007, 21, 9–21. [Google Scholar] [CrossRef]
  24. Jacobsen, T.; Höfel, L. Aesthetics Electrified: An Analysis of Descriptive Symmetry and Evaluative Aesthetic Judgment Processes Using Event-Related Brain Potentials. Empir. Stud. Arts 2001, 19, 177–190. [Google Scholar] [CrossRef]
  25. Leder, H.; Tinio, P.P.L.; Brieber, D.; Kröner, T.; Jacobsen, T.; Rosenberg, R. Symmetry Is Not a Universal Law of Beauty. Empir. Stud. Arts 2019, 37, 104–114. [Google Scholar] [CrossRef]
  26. Locher, P.; Cornelis, E.; Wagemans, J.; Stappers, P.J. Artists’ Use of Compositional Balance for Creating Visual Displays. Empir. Stud. Arts 2001, 19, 213–227. [Google Scholar] [CrossRef]
  27. Wilson, A.; Chatterjee, A. The Assessment of Preference for Balance: Introducing a New Test. Empir. Stud. Arts 2005, 23, 165–180. [Google Scholar] [CrossRef]
  28. Park, J.W. Secrets of Balanced Composition as Seen through a Painter’s Window: Visual Analyses of Paintings Based on Subset Barycenter Patterns. Leonardo 2019, 52, 364–373. [Google Scholar] [CrossRef]
  29. Hübner, R.; Fillinger, M.G. Comparison of Objective Measures for Predicting Perceptual Balance and Visual Aesthetic Preference. Front. Psychol. 2016, 7, 335. [Google Scholar] [CrossRef]
  30. Li, M.; Lv, J.; Tang, C. Aesthetic assessment of paintings based on visual balance. IET Image Process. 2019, 13, 2821–2828. [Google Scholar] [CrossRef]
  31. Fan, Z.; Li, Y.; Zhang, K.; Yu, J.; Huang, M.L. Measuring and Evaluating the Visual Complexity Of Chinese Ink Paintings. Comput. J. 2022, 65, 1964–1976. [Google Scholar] [CrossRef]
  32. Fan, Z.; Zhang, K.; Zheng, X.S. Evaluation and Analysis of White Space in Wu Guanzhong’s Chinese Paintings. Leonardo 2019, 52, 111–116. [Google Scholar] [CrossRef]
  33. Zhang, T.Y. Aesthetics and philosophical interpretation of the ‘intended blank’ in Chinese paintings. Int. J. Arts Humanit. Soc. Sci. 2021, 10, 64–74. [Google Scholar]
  34. Wang, G.; Shen, J.; Yue, M.; Ma, Y.; Wu, S. A Computational Study of Empty Space Ratios in Chinese Landscape Painting, 618–2011. Leonardo (Oxford) 2022, 55, 43–47. [Google Scholar] [CrossRef]
  35. Zeki, S.; Lamb, M. The neurology of kinetic art. Brain 1994, 117, 607–636. [Google Scholar] [CrossRef] [PubMed]
  36. Zeki, S. Inner Vision an Exploration of Art and the Brain; Oxford University Press: Oxford, UK, 1999. [Google Scholar]
  37. Zeki, S. Art and the Brain. Brain 1998, 127, 71–103. [Google Scholar]
  38. Pearce, M.T.; Zaidel, D.W.; Vartanian, O.; Skov, M.; Leder, H.; Chatterjee, A.; Nadal, M. Neuroaesthetics: The Cognitive Neuroscience of Aesthetic Experience. Perspect. Psychol. Sci. 2016, 11, 265–279. [Google Scholar] [CrossRef] [PubMed]
  39. Chatterjee, A.; Vartanian, O. Neuroscience of aesthetics. Ann. N. Y. Acad. Sci. 2016, 1369, 172–194. [Google Scholar] [CrossRef]
  40. Jacobsen, T. On the electrophysiology of aesthetic processing. Prog. Brain Res. 2013, 204, 159–168. [Google Scholar]
  41. Leder, H.; Belke, B.; Oeberst, A.; Augustin, D. A model of aesthetic appreciation and aesthetic judgments. Br. J. Psychol. 2004, 95, 489–508. [Google Scholar] [CrossRef]
  42. Leder, H.; Nadal, M. Ten years of a model of aesthetic appreciation and aesthetic judgments: The aesthetic episode—Developments and challenges in empirical aesthetics. Br. J. Psychol. 2014, 105, 443–464. [Google Scholar] [CrossRef]
  43. Liang, T.; Lau, B.T.; White, D.; Barron, D.; Zhang, W.; Yue, Y.; Ogiela, M. Artificial Aesthetics: Bridging Neuroaesthetics and Machine Learning; ACM: New York, NY, USA, 2024. [Google Scholar]
  44. Li, R.; Zhang, J. Review of computational neuroaesthetics: Bridging the gap between neuroaesthetics and computer science. Brain Inform. 2020, 7, 16. [Google Scholar] [CrossRef]
  45. Coccagna, M.; Manzella, F.; Mazzacane, S.; Pagliarini, G.; Sciavicco, G. Statistical and symbolic neuroaesthetics rules extraction from EEG signals. In Proceedings of the International Work-Conference on the Interplay Between Natural and Artificial Computation, Tenerife, Spain, 31 May–3 June 2022; Springer: Berlin/Heidelberg, Germany, 2022. [Google Scholar]
  46. Iigaya, K.; O Doherty, J.P.; Starr, G.G. Progress and promise in neuroaesthetics. Neuron 2020, 108, 594–596. [Google Scholar] [CrossRef]
  47. Finkel, R.A.; Bentley, J.L. Quad trees a data structure for retrieval on composite keys. Acta Inform. 1974, 4, 1–9. [Google Scholar] [CrossRef]
  48. Boser, B.; Guyon, I.; Vapnik, V. A Training Algorithm for Optimal Margin Classifiers; ACM: New York, NY, USA, 1992. [Google Scholar]
  49. Cortes, C.; Vapnik, V. Support-vector networks. Mach. Learn. 1995, 20, 273–297. [Google Scholar] [CrossRef]
  50. Chang, C.; Lin, C. LIBSVM: A library for support vector machines. ACM Trans. Intell. Syst. Technol. (TIST) 2011, 2, 1–27. [Google Scholar] [CrossRef]
  51. Shawe-Taylor, J.; Cristianini, N. Kernel Methods for Pattern Analysis; Cambridge University Press: Cambridge, UK, 2004. [Google Scholar]
  52. Bishop, C.M.; Nasrabadi, N.M. Pattern Recognition and Machine Learning; Springer: Berlin/Heidelberg, Germany, 2006. [Google Scholar]
  53. Jahanian, A.; Vishwanathan, S.V.N.; Allebach, J.P.; Rogowitz, B.E.; Pappas, T.N.; de Ridder, H. Learning visual balance from large-scale datasets of aesthetically highly rated images. SPIE 2015, 9394, 93940Y. [Google Scholar]
  54. Locher, P.J. Experimental Techniques for Investigating the Contribution of Pictorial Balance to the Creation and Perception of Visual Displays. Empir. Stud. Arts 2003, 21, 127–135. [Google Scholar] [CrossRef]
  55. Kawabata, H.; Zeki, S. Neural Correlates of Beauty. J. Neurophysiol. 2004, 91, 1699–1705. [Google Scholar] [CrossRef]
  56. Jacobsen, T.; Schubotz, R.I.; Höfel, L.; Cramon, D.Y.V. Brain correlates of aesthetic judgment of beauty. Neuroimage 2006, 29, 276–285. [Google Scholar] [CrossRef]
  57. Ishizu, T.; Zeki, S. The experience of beauty derived from sorrow. Hum. Brain Mapp. 2017, 38, 4185–4200. [Google Scholar] [CrossRef]
  58. Petcu, E.B. The Rationale for a Redefinition of Visual Art Based on Neuroaesthetic Principles. Leonardo 2018, 51, 59–60. [Google Scholar] [CrossRef]
  59. Schupp, H.T.; Markus, J.; Weike, A.I.; Hamm, A.O. Emotional facilitation of sensory processing in the visual cortex. Psychol. Sci. 2003, 14, 7–13. [Google Scholar] [CrossRef]
  60. Thai, C.H. Electrophysiological Measures of Aesthetic Processing; Swinburne University of Technology: Melbourne, Australia, 2019. [Google Scholar]
  61. Fairhall, S.L.; Ishai, A. Neural correlates of object indeterminacy in art compositions. Conscious. Cogn. 2008, 17, 923–932. [Google Scholar] [CrossRef]
  62. Munar, E.; Nadal, M.; Rosselló, J.; Flexas, A.; Moratti, S.; Maestú, F.; Marty, G.; Cela-Conde, C.J.; Martinez, L.M. Lateral orbitofrontal cortex involvement in initial negative aesthetic impression formation. PLoS ONE 2012, 7, e38152. [Google Scholar] [CrossRef] [PubMed]
  63. Eimer, M. The N2pc component as an indicator of attentional selectivity. Electroencephalogr. Clin. Neurophysiol. 1996, 99, 225–234. [Google Scholar] [CrossRef] [PubMed]
  64. Hopf, J.M.; Mangun, G.R. Shifting visual attention in space: An electrophysiological analysis using high spatial resolution mapping. Clin. Neurophysiol. 2000, 111, 1241–1257. [Google Scholar] [CrossRef] [PubMed]
  65. Qin, Y.; Ma, L.; Kujala, T.; Silvennoinen, J.; Cong, F. Neuroaesthetic exploration on the cognitive processing behind repeating graphics. Front. Neurosci. 2022, 16, 1025862. [Google Scholar] [CrossRef] [PubMed]
  66. O’Hare, L.; Goodwin, P. ERP responses to images of abstract artworks, photographs of natural scenes, and artificially created uncomfortable images. J. Cogn. Psychol. (Hove Engl.) 2018, 30, 627–641. [Google Scholar] [CrossRef]
  67. Höfel, L.; Jacobsen, T. Electrophysiological indices of processing aesthetics: Spontaneous or intentional processes? Int. J. Psychophysiol. 2007, 65, 20–31. [Google Scholar] [CrossRef] [PubMed]
  68. Jacobsen, T.; Klein, S.; Löw, A. The Posterior Sustained Negativity Revisited—An SPN Reanalysis of Jacobsen and Höfel (2003). Symmetry 2018, 10, 27. [Google Scholar] [CrossRef]
  69. Lengger, P.G.; Fischmeister, F.P.S.; Leder, H.; Bauer, H. Functional neuroanatomy of the perception of modern art: A DC–EEG study on the influence of stylistic information on aesthetic experience. Brain Res. 2007, 1158, 93–102. [Google Scholar] [CrossRef]
  70. Bertamini, M.; Makin, A.; Pecchinenda, A. Testing whether and when abstract symmetric patterns produce affective responses. PLoS ONE 2013, 8, e68403. [Google Scholar]
  71. Makin, A.D.J.; Wilton, M.M.; Pecchinenda, A.; Bertamini, M. Symmetry perception and affective responses: A combined EEG/EMG study. Neuropsychologia 2012, 50, 3250–3261. [Google Scholar]
  72. Herron, J.E. Decomposition of the ERP late posterior negativity: Effects of retrieval and response fluency. Psychophysiology 2007, 44, 233–244. [Google Scholar] [CrossRef]
  73. Botros, C.; Mansour, Y.; Eleraky, A. Architecture Aesthetics Evaluation Methodologies of Humans and Artificial Intelligence. MSA Eng. J. 2023, 2, 450–462. [Google Scholar] [CrossRef]
Figure 1. Stimulus materials generated by Processing 5.0 software.
Figure 1. Stimulus materials generated by Processing 5.0 software.
Symmetry 16 01191 g001
Figure 2. An illustration of the experimental materials generated after adjustment.
Figure 2. An illustration of the experimental materials generated after adjustment.
Symmetry 16 01191 g002
Figure 3. Decomposition of Negative Space using Quadtree.
Figure 3. Decomposition of Negative Space using Quadtree.
Symmetry 16 01191 g003
Figure 4. Pre-experiment: (a) Randomly Present the Printed Experimental Materials on the Desktop; (b) Participant Classifying Experimental Materials Based on Aesthetic Standards in the Pre-Experiment.
Figure 4. Pre-experiment: (a) Randomly Present the Printed Experimental Materials on the Desktop; (b) Participant Classifying Experimental Materials Based on Aesthetic Standards in the Pre-Experiment.
Symmetry 16 01191 g004
Figure 5. Illustration of the stimulus paradigm applied.
Figure 5. Illustration of the stimulus paradigm applied.
Symmetry 16 01191 g005
Figure 6. Main experiment: (a) Display of the experimental environment; (b) Participant Performing Binary Responses to Stimuli in the Main Experiment.
Figure 6. Main experiment: (a) Display of the experimental environment; (b) Participant Performing Binary Responses to Stimuli in the Main Experiment.
Symmetry 16 01191 g006
Figure 7. EEG Analysis for task (aesthetics, balance) × answer (yes, no): (a) Grand–average event–related brain potentials; (b) Isopotential contour plot. (N = 16).
Figure 7. EEG Analysis for task (aesthetics, balance) × answer (yes, no): (a) Grand–average event–related brain potentials; (b) Isopotential contour plot. (N = 16).
Symmetry 16 01191 g007
Figure 8. Decision Boundary of Linear SVM for Multi–Class Data: (a) Scheme I; (b) Scheme II.
Figure 8. Decision Boundary of Linear SVM for Multi–Class Data: (a) Scheme I; (b) Scheme II.
Symmetry 16 01191 g008
Figure 9. Model results of the two schemes: (a) Scheme I; (b) Scheme II.
Figure 9. Model results of the two schemes: (a) Scheme I; (b) Scheme II.
Symmetry 16 01191 g009
Table 1. Different features’ data and classification results of experimental materials.
Table 1. Different features’ data and classification results of experimental materials.
FeaturesType IType 2
S y m m e t r y 5580.89 ± 1833.5478793.33 ± 1617.024
D M a n h a t t a n 3.13 ± 5.46361.77 ± 9.796
Negative Space S W h i t e 87,043.39 ± 3263.695100,282.39 ± 2006.143
S B l a n k 71,792.99 ± 3671.64288,583.86 ± 2282.042
S Q u a d 1387.36 ± 1027.0543738.78 ± 542.609
Table 2. The result of behavioral data.
Table 2. The result of behavioral data.
TaskAnswerACCRT/ms
MeanSDMeanSD
AestheticsYes0.9290.118861.760156.099
No0.9580.093785.35392.479
BalanceYes0.9580.081845.142163.939
No0.9460.101816.509169.781
Table 3. Results of ERP Amplitude Analysis by Channel and Answer Conditions.
Table 3. Results of ERP Amplitude Analysis by Channel and Answer Conditions.
ChannelANOVA ResultAnswer
YesNo
Mean/μVSDMean/μVSD
FP1F (1, 15) = 29.015, p < 0.01−2.2441.119−3.8091.002
FPZF (1, 15) = 27.804, p < 0.01−2.2221.224−3.7941.126
FP2F (1, 15) = 20.009, p < 0.01−1.6391.089−2.8141.061
F3F (1, 15) = 25.088, p < 0.01−0.7650.758−2.1630.645
FZF (1, 15) = 13.330, p = 0.002−0.8230.682−2.2220.586
F4F (1, 15) = 6.656, p = 0.0210.4340.557−0.3200.579
FCZF (1, 15) = 10.532, p = 0.005−0.1700.502−1.4660.514
CZF (1, 15) = 5.742, p = 0.0301.3260.4250.3830.444
CPZF (1, 15) = 5.635, p = 0.0313.3710.5372.7200.533
PO3F (1, 15) = 10.879, p = 0.0050.3060.7671.4560.559
POZF (1, 15) = 13.346, p = 0.0020.7690.8441.8370.743
PO4F (1, 15) = 28.232, p < 0.01−0.1850.9901.7970.822
O1F (1, 15) = 23.707, p < 0.01−1.8670.563−0.0970.312
OZF (1, 15) = 15.907, p = 0.001−2.4640.626−0.8240.411
O2F (1, 15) = 25.305, p < 0.01−2.1960.836−0.1940.630
Table 4. Results of Three–Way Interaction Analysis (Task × Channel × Answer) on ERP Amplitudes.
Table 4. Results of Three–Way Interaction Analysis (Task × Channel × Answer) on ERP Amplitudes.
TaskChannelANOVA ResultAnswer
YesNo
Mean/μVSDMean/μVSD
BalanceFP1F (1, 15) = 26.006, p < 0.01−2.0471.143−4.1330.982
FPZF (1, 15) = 18.811, p = 0.001−2.0001.255−4.0461.040
FP2F (1, 15) = 13.557, p = 0.002−1.4241.116−3.0330.971
F3F (1, 15) = 31.103, p < 0.01−0.8090.764−2.3940.697
FZF (1, 15) = 12.354, p = 0.003−0.7070.649−2.3950.612
F4F (1, 15) = 5.987, p = 0.0270.5200.579−0.5700.619
FCZF (1, 15) = 8.895, p = 0.009−0.1970.471−1.6360.539
CZF (1, 15) = 5.218, p = 0.0371.2480.4410.2260.504
PO3F (1, 15) = 13.329, p = 0.0020.3450.8131.7430.530
POZF (1, 15) = 13.988, p = 0.0020.7610.8622.0260.732
PO4F (1, 15) = 27.946, p < 0.01−0.1880.9951.9120.816
O1F (1, 15) = 29.321, p < 0.01−1.8410.5610.2850.348
OZF (1, 15) = 16.653, p = 0.001−2.3900.606−0.5200.431
O2F (1, 15) = 27.554, p < 0.01−2.1790.8040.0030.632
AestheticsFPZF (1, 15) = 8.235, p = 0.012−2.4431.225−3.5421.232
FZF (1, 15) = 8.712, p = 0.010−0.9390.748−2.0500.586
FCZF (1, 15) = 9.542, p = 0.007−0.1430.562−1.2960.522
CZF (1, 15) = 4.967, p = 0.0421.4030.4290.5410.411
CPZF (1, 15) = 7.560, p = 0.0153.4850.5592.7560.521
POZF (1, 15) = 8.374, p = 0.0110.7770.8421.6490.761
O1F (1, 15) = 12.742, p = 0.003−1.8930.592−0.4790.330
OZF (1, 15) = 11.080, p = 0.005−2.5380.675−1.1270.429
O2F (1, 15) = 18.168, p = 0.001−2.2120.884−0.3910.655
Table 5. Results of two-factor repeated measures ANOVA (PZ).
Table 5. Results of two-factor repeated measures ANOVA (PZ).
ChannelTaskANOVA ResultAnswer
YesNo
Mean/μVSDMean/μVSD
PZBalanceF (1, 15) = 1.712, p = 0.210−0.2770.451−0.7360.443
AestheticsF (1, 15) = 5.659, p = 0.031−0.0090.487−0.8770.422
Table 6. ACC of models with different combinations of C and γ in the two schemes.
Table 6. ACC of models with different combinations of C and γ in the two schemes.
γ = 0.01γ = 0.1γ = 1γ = 10γ = 100
Scheme IC = 0.010.2560.2560.5020.4910.256
C = 0.10.7040.6930.5560.4960.256
C = 10.7080.7080.5800.5370.491
C = 100.7110.7070.5930.5360.497
C = 1000.7050.7030.5990.5490.536
Scheme IIC = 0.010.2580.2580.2580.4950.258
C = 0.10.2580.2580.9200.5180.258
C = 10.2600.3480.9820.5810.495
C = 100.2610.3720.9810.7750.521
C = 1000.2610.3740.9820.9230.542
Table 7. Models with best combinations of C and γ in the two schemes.
Table 7. Models with best combinations of C and γ in the two schemes.
Scheme IScheme II
Best C1.23338.9806
Best γ0.01003.0682
Train ACC0.70680.9970
Test ACC0.707370.9989
AUC0.883520.99965
Precision0.677420.743590.625570.7740610.9952811
Recall0.686920.756520.691920.69288110.995691
F10.682130.750.657070.7312310.997640.997841
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Lin, F.; Song, W.; Li, Y.; Xu, W. Investigating the Relationship between Balanced Composition and Aesthetic Judgment through Computational Aesthetics and Neuroaesthetic Approaches. Symmetry 2024, 16, 1191. https://doi.org/10.3390/sym16091191

AMA Style

Lin F, Song W, Li Y, Xu W. Investigating the Relationship between Balanced Composition and Aesthetic Judgment through Computational Aesthetics and Neuroaesthetic Approaches. Symmetry. 2024; 16(9):1191. https://doi.org/10.3390/sym16091191

Chicago/Turabian Style

Lin, Fangfu, Wu Song, Yan Li, and Wanni Xu. 2024. "Investigating the Relationship between Balanced Composition and Aesthetic Judgment through Computational Aesthetics and Neuroaesthetic Approaches" Symmetry 16, no. 9: 1191. https://doi.org/10.3390/sym16091191

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop