• <tr id="yyy80"></tr>
  • <sup id="yyy80"></sup>
  • <tfoot id="yyy80"><noscript id="yyy80"></noscript></tfoot>
  • 99热精品在线国产_美女午夜性视频免费_国产精品国产高清国产av_av欧美777_自拍偷自拍亚洲精品老妇_亚洲熟女精品中文字幕_www日本黄色视频网_国产精品野战在线观看 ?

    SRAFE: Siamese Regression Aesthetic Fusion Evaluation for Chinese Calligraphic Copy

    2023-12-01 10:43:58MingweiSunXinyuGongHaitaoNieMuhammadMinhasIqbalBinXie

    Mingwei Sun| Xinyu Gong | Haitao Nie | Muhammad Minhas Iqbal,3 |Bin Xie

    Abstract Evaluation of calligraphic copy is the core of Chinese calligraphy appreciation and inheritance.However, previous aesthetic evaluation studies often focussed on photos and paintings, with few attempts on Chinese calligraphy.To solve this problem, a Siamese regression aesthetic fusion method is proposed, named SRAFE, for Chinese calligraphy based on the combination of calligraphy aesthetics and deep learning.First, a dataset termed Evaluated Chinese Calligraphy Copies (E3C) is constructed for aesthetic evaluation.Second,12 hand-crafted aesthetic features based on the shape,structure,and stroke of calligraphy are designed.Then, the Siamese regression network (SRN) is designed to extract the deep aesthetic representation of calligraphy.Finally, the SRAFE method is built by fusing the deep aesthetic features with the hand-crafted aesthetic features.Experimental results show that scores given by SRAFE are similar to the aesthetic evaluation label of E3C, proving the effectiveness of the authors’ method.

    K E Y W O R D S calligraphy evaluation, hand-crafted aesthetic features, siamese regression network

    1 | INTRODUCTION

    Chinese calligraphy,as one of the treasures of Chinese culture,shines splendidly in the world's culture and art.As the core of Chinese calligraphy,aesthetic evaluation is of great significance to art research, education and inheritance.With the development of computational aesthetic evaluation, there is some research in the field of photographic images [1], western paintings [2, 3], ink paintings [4], webpage [5] etc.However,how to make an objective,accurate and interpretable aesthetic evaluation of Chinese calligraphy images is still a challenge.Aesthetic evaluation aims to evaluate the aesthetic quality of images by simulating human aesthetics and the perception of beauty automatically.At present, the relevant research of aesthetic evaluation is mainly based on hand crafted and deep learning methods [6].Based on hand-crafted features such as colour, contrast, Sharpness, Mavridaki et al.[7] proposed an evaluation system using five basic photography rules,and Redi et al.[8]introduced a framework to access the quality of digital portraits.They all performed well on the AVA dataset.Also for the AVA dataset, Li et al.[9] presented a personality-assisted multi-task deep learning framework and Zhang et al.[10]proposed a multi-modal self and collaborative attention network to make photo aesthetic assessment, which were all based on deep learning.

    In terms of Chinese calligraphy,most calligraphy evaluation research is based on the hand-crafted features.From the aesthetic perspective, the features of calligraphy stroke and structure were designed in several studies.Gao et al.[11] proposed a method of Chinese handwriting quality evaluation based on an 8-Directionalfeature.The evaluation model designedbyLi et al.[12]computed the difference in the WF-histogram between the initial style and standard style to generate the score of the target-style after training.Zhou et al.[13] extracted Chinese calligraphyintothree featurestoproduce an evaluationvalue bya proposed PPD method.To improve aesthetic evaluation performance,Lian etal.[14]presentedmoreglobal shapefeaturesto describe and evaluate the aesthetic quality of a Chinese character.

    Meanwhile, to evaluate the quality of calligraphic copies,several studies designed the features based on the relationship between calligraphy copies and their corresponding template,which can provide a reference to make the aesthetic evaluation more objective.Based on the features of centre, size, and projection, Han et al.[15] used fuzzy inference techniques to score calligraphy characters on three ranks.Wang et al.[16]calculated stroke sequence, character shape and stroke shape similarities between calligraphic copies and templates.They also implemented a comprehensive evaluation involving the whole character and stroke similarities to achieve a final composited evaluation score[17].In addition,although the fuzzy evaluation method constructed by Ref.[18]is more accurate,the method based on the writing process recorded by resistive touch screen has limitations for hardware facilities.

    From the previous studies above,with the strong aesthetic regularity of Chinese calligraphy, hand-crafted features based on calligraphy aesthetic attributes can allow the evaluation method interpretable and reasonable.However, the handcrafted features require calligraphy professional knowledge,and the limited hand-crafted features always ignore some hidden aesthetic information of calligraphy, resulting in the insufficient ability of aesthetic evaluation.Deep learning can effectively extract hidden aesthetic information in calligraphy images to supplement the hand-crafted features,although it is a black box with a lack of interpretability.Therefore, we try to achieve aesthetic evaluation performance and interpretability at the same time by combining the deep network with the handcrafted features.

    In this paper, we make the following three contributions.

    ? To construct dataset E3C, we collect 11,008 calligraphic copy images from students and amateurs,including 59 kinds of Chinese characters, and invite 121 people to evaluate aesthetic scores, thus providing data for the study of calligraphy aesthetics.E3C will be public.

    ? Based on the aesthetics of calligraphy,we designed 12 handcrafted features by comparing calligraphic copies and corresponding templates from the perspective of shape,structure and strokes of calligraphy and analysed feature validation.Through machine learning algorithms including multiple linear regression, Xgboost [19], and LightGBM [20] regression,we obtained continuous scores of calligraphic copies in the range of 1–10,which were similar to calligraphy experts'scores.

    ? In order to fully extract the aesthetic hidden information of calligraphy copy images, based on different pre-training backbones, we design the Siamese regression network(SRN) to extract the deep aesthetic features for calligraphy evaluation.To further improve the performance of aesthetic evaluation algorithm, innovatively, the SRAFE method is proposed for Chinese calligraphy by fusing the deep aesthetic features with the 12 hand-crafted features (See Figure 1).The effectiveness of our method is proved by ablation experiments.

    2 | PROPOSED DATASET E3C

    Being treated as a machine learning problem,the construction on the dataset becomes the key precondition in aesthetic evaluation of Chinese calligraphic copies.We build a dataset termed Evaluated Chinese Calligraphy Copies(E3C),in which dataset E3C is split in a reasonable way with appropriate evaluation metrics to evaluate the prediction performance of our proposed method.

    2.1 | Dataset E3C

    F I G U R E 1 Overview of our SRAFE method for Chinese calligraphy

    As shown in Figure 2,we constructed dataset E3C to train the model.The dataset collected 11,008 calligraphic copy images from students and amateurs, including 59 kinds of Chinese characters, and invited 121 people (including 10 experts and 111 majors)to evaluate aesthetic scores in our scoring system.Each calligraphy copy was graded by three experts and more than 10 majors ranging from 1 to 10,where 1 means the most negative aesthetic score and 10 means the most positive aesthetic score.The aesthetic score graded by experts is obtained by calculating the average.The majors aesthetic score is generated as follows: The highest and lowest scores from majors are removed and replaced by the mode.Then,the final score label of each calligraphic copy is calculated by the weighted average from the expert and majors aesthetic score,among which the weight of the expert aesthetic score is 0.7 and the amateurs is 0.3.Figure 3 shows the distribution of aesthetic labels, similar to a normal distribution.

    2.2 | Dataset for experiments

    As the benchmark of the experiment, E3C is divided into training set, validation set and test set at the ratio of 6:2:2,on the premise of the same distribution.The test set contains Chinese characters that have never appeared in the training set and verification set to prove the robustness and generalisation of the methods.What's more, the calligraphic copies of Chinese character ‘Ming’ never appears in the training set and verification set but only in the test set.The aesthetic prediction of the algorithm for character ‘Ming’ can truly reflect the performance of the aesthetic evaluation methods.

    F I G U R E 2 Samples of dataset E3C

    2.3 | Evaluation metrics

    To evaluate the prediction performance of our proposed method, we calculate the average mean absolute error (MAE)and Pearson correlation coefficient (PCC).MAE is formally expressed as

    wheremis the number of samples,^yiis the predicted value of theith sample, andyiis the true value of theith sample.It is worth noting that MAE represents the error of scores on a scale of one to ten; the smaller the MAE the better the prediction performance.PCC is used to measure the correlation between prediction and label; higher absolute value means better performance.PCC is defined as

    whereμYandμ^Yrepresent the mean value of the true label and the mean value of the predicted value, respectively,σYandσ^Yrepresent the standard deviation of the true label and the standard deviation of the predicted value,respectively.

    3 | METHODS ON AESTHETIC FEATURE EXTRACTION

    In this section, based on the calligraphic aesthetic, 12 handcrafted aesthetic features consisting of calligraphic shape,structure,and stroke feature are designed from the comparison between calligraphic copyCand the corresponding templateT.These hand-crafted features are the quantification of human aesthetics of calligraphy and can contribute to the calligraphy aesthetic evaluation methods.

    3.1 | Calligraphic image registration

    The calligraphic copy photos often have different sizes.Moreover,the relative position and relative size of the character in the calligraphic image are uncontrollable, as shown in Figure 4b.Therefore, calligraphic image registration is an indispensable basis for evaluating calligraphic copy quality with an objective score.From an aesthetic point of view, the following two conditions should be satisfied by calligraphic image registration.1) The number of pixels in the copy character and template character is the same.2)The centre of gravity of the copy character and the template character is the same.In this section, calligraphic image registration of the calligraphic copyCand the calligraphic templateTcan be implemented as follows.

    3.1.1 | Calligraphic image preprocessing

    First,CandTare resized to the same width with the original aspect ratio fixed and binarised after grey-scale transformation.Then noise such as dropped ink is removed by setting the threshold of the connected domain area.After image preprocessing, useless interference information can be filtered out and calligraphic characters can be retained.

    3.1.2 | Calligraphic size registration

    We extract the smallest fitting rectangle of the calligraphic character inCandTas the ROI.The parameterswidth* andheight* denote theC-ROI's width and height respectively.After resizing, the two parameters can be calculated as

    whereSCandSTare the total number of pixels of the calligraphic character inC-ROI andT-ROI, respectively.After resizing, the calligraphic characters ofCandThave the same number of pixels.

    F I G U R E 4 Calligraphic image registration.(a) Original calligraphic template.(b) Original calligraphic copy.(c) Calligraphic template afterimage registration.(d) Calligraphic copy after image registration

    3.1.3 | Calligraphic location registration

    For calligraphic characters ofTandC, the centre of gravity is calculated as

    3.2 | Feature on calligraphic shape

    The most intuitive way to evaluate the difference betweenCandTis to compare their shapes.To quantify the difference in aesthetics, we use the overlapping ratio to represent the similarity in calligraphic shape, as shown in Figure 5a.The features on calligraphic shape can be formally expressed as

    whereACandATrepresent the area of the calligraphic character inCand the corresponding character inT, respectively.f1is in the range of 0–1 and has an obviously positive correlation with the quality of calligraphic copy.Then,we mapf1to the shape aesthetic scoref2with a scope of 1-10 by

    F I G U R E 5 (a)The visual calligraphy guidance based on shape feature,where the red contour reflects the template,and f1 is 0.368.(b) The visual calligraphy guidance based on structure feature, where the red contourreflects the template's structure while the blue reflects the copy's structure,and f2 is 0.876

    The shape feature can be used in calligraphy teaching.As shown in Figure 3a, by superimposing the red contour of the template on the copy image, the difference between the copy and the template can be presented clearly, which can provide students with intuitive visual guidance.

    3.3 | Features on calligraphic structure

    In Chinese calligraphy, the structure of Chinese characters usually determines its overall aesthetic quality.In this section,the features on a calligraphic structure are mainly quantified by convex hull feature extraction and projection feature extraction.

    3.3.1 | Convex hull feature extraction

    The convex hull of the calligraphic character can reflect the overall structure of the character.We compare the convex hulls of the characters inTandCto obtain an overall structure feature by the overlapping ratiof3, which is defined

    whereSCandSTrepresent the area of the convex hull of calligraphic character in C and T,respectively.f3is in the range of 0–1, which is all positively associated with the quality of calligraphic copy.Moreover, as Figure 5b shows, the convex hull feature can describe the difference on calligraphic structure and can provide visual guidance.

    3.3.2 | Projection feature extraction

    F I G U R E 6 The projection of T and C to the direction of 0°,-45°,45°,and 90°.The red dotted line represents the projected baseline in‘mizi’grid,and the black histograms represent the projected histograms oncorresponding red dotted lines

    When practicing Chinese calligraphy, the character is usually written in a‘mizi’ grid, which is an intersected figure designed specifically for writing Chinese characters,as shown by the red grid in Figure 6.Through the horizontal line, the vertical line,left diagonal and right diagonal of the ‘mizi’ grid, it is convenient for beginners to determine the position and direction of the strokes when writing and provide them with a structural reference.Inspired by this,we projectTandCto the direction of the four baselines of the ‘mizi’ grid, which are in the directions of 0°,-45°,45°,and 90°,as shown in Figure 6.HTdenotes the projected histogram ofT, andHCdenotes the projected histogram ofCin the direction of 0°.The overlapping ratio in the directions of 0° is formally expressed as

    Then,we can calculate the correlation ofHTandHCin the direction of 0° by

    Accordingly, featuresf6~f11are obtained by calculating the overlapping ratio and correlation in the directions of -45°,45°, and 90° to quantify the histograms.

    3.4 | Features on calligraphic stroke

    The details and layout of the strokes have a significant impact on the aesthetic quality of calligraphy.To quantify the aesthetic feature of strokes,first,we detect the keypoints of calligraphic strokes based on Faster RCNN [21], then realise the keypoint registration through CPD [22], and finally calculate the difference according to the keypoint information of the template,as seen in Figure 1d.

    3.4.1 | Keypoint detection on calligraphic stroke

    With strong regularity on visual characteristics, the keypoints of calligraphic strokes can be divided into two categories; one is the beginning and ending of strokes and the other is the turning and crossing of strokes.Based on the two categories,we established the calligraphy keypoint detection dataset with 800 calligraphic images and 13,648 keypoint boxes.The keypoint boxes with two category labels contain the edge information of the key parts of the strokes, and their centre points are the keypoints of the strokes.The experimental results show that in the test set of 100 calligraphic images with 17 characters, the detection precision is 0.988, and the recall is 0.917.Therefore,the keypoint detection of calligraphic characters can be realised with excellent performance based on Faster RCNN.

    3.4.2 | Keypoint registration based on CPD

    F I G U R E 7 Samples of the keypoint detection result on the calligraphic copy

    As Figure 7 shows,we can obtain keypoints ofTandCby the above method.To achieve keypoint registration ofTandC,based on CPD, we make some improvements to solve the problem of registering to the same keypoint when some keypoints are too close.We try to split the connected domains of characters to reduce the registration scope based on corresponding connected domains.For the keypoints registered repeatedly in the same connected domain, only the closest keypoint is kept, and the remaining points are rematched to avoid pairing errors.

    3.4.3 | Quantification of calligraphic stroke feature

    The calligraphic stroke feature is quantified by calculating the average Euclidean distance of the keypoints as follows

    4 | PROPOSED SRAFE METHOD

    If only the above hand-crafted features are used, there will be the lack of aesthetic information and unsatisfactory evaluation performance due to the current limited and incomplete handcrafted features.Therefore, in this section, we propose the SRAFE method, which fuses the hand-crafted features with deep learning methods; Figure 1 illustrates the framework of our proposed method.First, we transform the basic Siamese network by pre-training the backbone with shared weights,extract and contrast deep feature combined with the regression layer for supervised learning.Then, based on the 12 aesthetic features consisting of calligraphic shape, structure, and stroke features from the section 3, our SRAFE method fuses them with the deep features from SRN,which are trained by lightGBM regression to build our calligraphy evaluation model.

    4.1 | SRN for calligraphy evaluation in SRAFE

    The Siamese network[23]takes two samples as input,with the representation of their embedding in high-dimensional space as output, to compare the similarity of the two samples.Meanwhile, through transfer learning, using the pre-training model based on CNN as the backbone, we can achieve better and faster performance in the task of computer vision[24].Inspired by this, based on the Siamese network, we take the pre-training model of ImageNet as the backbone to learn the deep representation reflecting the aesthetics of calligraphy.As shown in Figure 1a, the two backbone branches input by calligraphic copyCand the corresponding templateTshare weights, and finally connect the 10-dimensional linear layer,respectively.We design the regression layer as the last layer by replacing the cross entry loss to the European loss of theT's 10-dimensional tensor and theC's 10-dimensional tensor.To better learn the differences ofTandC, the specific loss function is defined as follows:

    where 10-ynrepresents the gap betweenthe Euclidean distance and the full aesthetic score.The smaller the Euclidean distance between the deep features ofTandC,the higher the calligraphy aesthetic score.Therefore, in this MSE loss, the Euclidean distance is used to approach the gap between the label and the full score.As the output of our SRN,10-ynis also a prediction of the aesthetic quality of calligraphy copy.

    4.2 | Aesthetic fusion and regression in SRAFE

    As shown in Figure 1, SRAFE mainly fuses the hand-crafted aesthetic features on the basis of the SRN to improve the performance and interpretability of the evaluation model.Feature fusion is mainly the fusion offeaturedeep,Euclideanandfeaturehandshown in Figure 1.The deep aesthetic features with 10 dimensions ofTandCcan be extracted through the SRN,whereEuclideanis the European distance of the two deep features with 1 dimension.Meanwhile,featuredeepis the difference obtained by subtraction of two deep aesthetic features,with 10 dimensions.featurehandis the 12-dimensional tensor obtained by the hand-crafted features.We set the dimension of the deep feature 10 to achieve a balance between the deep features and hand-crafted features in learning.With the fusion offeaturedeep,Euclideanandfeaturehand, the 23-dimensional fused features can be obtained, and the final aesthetic evaluation scores are predicted by lightGBM regression.

    If we only rely on the SRN for aesthetic evaluation, the deep features are in the black box, which lacks interpretability and aesthetic prior knowledge of calligraphy.From the perspective of professional aesthetic evaluation on character shape,structure,and stroke,the hand-crafted aesthetic features can not only improve the interpretability of evaluation but also supplement the aesthetic information ignored by the deep features.However,if only the hand-crafted features are used,it will also lead to the lack of aesthetic information and unsatisfactory evaluation performance due to the current limited and incomplete hand-crafted features.Therefore, theoretically,our SRAFE method can make the deep features and the handcrafted aesthetic features complement each other, increase the interpretability and improve the performance of aesthetic evaluation at the same time.

    5 | EXPERIMENTS AND DISCUSSION

    In the experiments, we validate the validity of the 12 handcrafted aesthetic features on the dataset E3C and Table 1 summarizes the 12 features.Meanwhile, based on the 12 features, we compared the prediction performance of multiple linear regression (MLE), Xgboost and LightGBM on the test set of E3C, and chose LightGBM as the regressor for the following experiments.Then, we compare different pretraining models in our SRN to determine the backbone, to extract the hidden aesthetic information of calligraphy copies better.Finally, through ablation experiments, the effectiveness of our SRAFE method is verified.The experimental results show that the score of calligraphic copy quality predicted by our proposed SRAFE method is similar to that of human.

    5.1 | Feature validation

    As shown in Figure 8, the correlation coefficient betweenf1andf2is high,becausef2is the mapping off1between 0 and 10 points.We find that the features extracted by projection onthe same direction,such asf4andf5,f6andf7,f8andf9,f10andf11have a strong correlation, because they are constructed by quantifying the similarity of the projection histogram of a same angle.The correlation coefficient betweenf1and the label is 0.41, which is the most positive correlation with the label among the 12 features, indicating that the aesthetic feature designed from the perspective of calligraphy shape is close to the aesthetic of public and is more consistent with human aesthetics.In addition to the features designed from the perspective of shape, the correlation coefficient betweenf12and label is -0.34, which has the largest negative correlation with the label among the 12 features, indicating that the aesthetic features designed from the perspective of calligraphy strokes are close to the aesthetic score of calligraphy public and are in good agreement with human aesthetics.Among the 12 features, the smallest correlation with the label isf12, 0.12,which also shows a correlation with the label.

    T A B L E 1 Feature description

    5.2 | Performance of the hand‐crafted aesthetic features

    As human evaluation for calligraphy is often based on subjective aesthetics, it is difficult to give accurate and objective scores,so we use regression algorithms to fit the integer scores,so as to obtain continuous prediction scores on calligraphy evaluation.Considering the performance of algorithms on different datasets may be different, multiple linear regression(MLR), Xgboost and LightGBM were used to train the regression model and compared on performance.

    According to Table 2,LightGBM performs better than MLR and Xgboost on the test set of E3C containing 1799 calligraphic copies with 0.989 MAE under the ten-point scoring rule and 0.548 PCC.So,we choose the LightGBM as the regressor for the following aesthetic evaluation algorithms.

    F I G U R E 8 Pearson correlation coefficients of the 12 features and labels

    Although this method can predict the aesthetic quality of calligraphy copies,its performance is not satisfactory,and there is still room for improvement,which is also consistent with our previous conjecture.It is necessary to further extract the deep aesthetic information of calligraphy copy images to improve the performance.

    5.3 | Performance of SRN

    In the implementation,all the network training and testing are performed with NVIDIA RTX3090 GPU and PyTorch 1.8.We use Adam optimiser with the 0.001 base learning rate and(0.9,0.990)betas.Table 3 shows the performance comparison in selecting ResNet101[25],InceptionV3[26]and Densnet121[27] as the backbone.The statistics in Table 3 that the model with ResNet101 yields a higher PCC and a lower MAE than other two pre-trained backbones.Therefore, we choose pretrained ResNet101 as the backbone in the SRN.

    Through this method,we can obtain the deep features and the Euclidean distance reflecting the calligraphy aesthetic evaluation.However, the 0.836 MAE still has plenty of room for improvement,and the deep features lack the interpretability of calligraphy aesthetics.Therefore, in the experiment on the SRAFE method,we fuse the 12 hand-crafted aesthetic features of calligraphy with our SRN.

    5.4 | Performance of SRAFE

    To further improve the performance of calligraphy evaluation,our SRAFE method fuses the deep features from the SRN and the hand-crafted aesthetic features.We further investigate the effectiveness of the SRAFE method by ablation experiments,which also verify the effect of submodules (deep features,European distance of two deep features, and hand-crafted aesthetic features) in SRAFE on performance.The result of ablation shows in Table 4.

    T A B L E 2 Performance comparisons of different models based on the 12 features

    T A B L E 3 Performance comparisons of SRN in different backbones

    According to Table 4 above, Exp.7 is of the optimal prediction performance.It shows that our SRAFE method improves 0.170 on MAE and 0.041 on PCC compared with SRN,meanwhile,improves 0.323 on MAE and 0.261 on PCC compared with only hand-crafted features.Exp.2 and 4(3 and 5,6 and 7)demonstrated the effectiveness of the deep feature from the SRN.The deep feature can characterise the aesthetic differences betweenTandC,which would facilitate the model robustness enhancement.Through comparing the results of Exp.1 and 4 (3 and 6, 5 and 7), it can be found that the addition of Euclidean distance could be conducive to aesthetic prediction, although the improvement is small when the deep feature exists.The Euclidean distance is the output of the SRN,and it also directly reflects the aesthetic gap betweenTandC.It is discovered in Exp.1 and 5 (2 and 6, 4 and 7) that the performance improvement brought about by the hand-crafted features is less than 0.112 on MAE.Furthermore,we find that the deep feature contributes the most to the performance of calligraphy evaluation.It also proves that the deep network can extract useful hidden aesthetic information, which is an effective supplement to hand-crafted aesthetic features.

    In Figure 9,we select the character‘Ming’from the test set as the display of the aesthetic evaluation of calligraphy by SRAFE method.The blue part ‘LABEL’ is the label of E3C dataset, which is the public aesthetic score, and the red part‘PRED’ is the predicted aesthetic score of SRAFE algorithm,and the real aesthetic score of‘Ming’increases from left to right.It is worth mentioning that the character‘Ming’is never in the training set and validation set.It shows that the SRAFE method can give a good aesthetic score on Chinese calligraphy with good generalisation performance.

    As Figure 10 shows, the aesthetic score labels of the test set, which contains 1786 calligraphic copy images, are arranged from low to high (blue scatter plot) and are compared with the corresponding aesthetic predicted scores obtained by the SRAFE method (orange scatter plot).In the figure, the ordinate is the aesthetic prediction score(1–10),the abscissa is the number of the calligraphy copy test case image.The orange dots are relatively dense from low to high, indicating that our method can predict the aesthetic score with good performance.We also analyse the samples with large prediction deviations.Some bad cases are of unsatisfactory font segmentation in image pre-processing, resulting in the deviation of feature extraction, which needs to be optimised and improved in the future.Meanwhile, some copies with low scores are predicted to have high scores due to there are few low score samples during training.Moreover, the ink stains that will be removed and ignored by the algorithm are an important factor to reduce the scoring of aesthetic labels.Therefore, the treatment of sample imbalance and the impact of ink stains on aesthetic evaluation are follow-up research work.

    T A B L E 4 Performance of SRAFE method ablation experiments

    F I G U R E 9 Calligraphy copy examples of ‘Ming’ evaluated by the SRAFE method

    F I G U R E 1 0 SRAFE prediction results on the test set of E3C

    6 | CONCLUSION AND FUTURE WORK

    To build a connection between Chinese calligraphy and computational aesthetic evaluation, which is a challenging work, we proposed a Siamese aesthetic fusion framework for calligraphy(SRAFE).The novelty of SRAFE is to design some handcrafted features from the perspective of calligraphy aesthetics,combined with the deep features learnt from the SRN.The 12 hand-crafted features are more consistent with the human aesthetics of calligraphy, contributing to model interpretation.Meanwhile, the deep features reflect the deep aesthetic gap from calligraphic templates, improve the performance and generalisation of the model.What's more,in the future, dataset E3C will be public for the research on calligraphy evaluation.

    Currently, our SRAFE method can achieve good evaluation performance in regular script, while Chinese calligraphy contains many fonts such as running script and cursive script with quite different appearances.For the E3C dataset, the current calligraphy images mainly come from the copying homework of primary school students, which are mainly regular calligraphy images and lack of calligraphy images of other fonts.To address this limitation, we will include more calligraphic copies of seal character, official script and running script in our E3C dataset which is the research basis for aesthetic evaluation of other fonts.For our SRAFE method, different fonts may have different aesthetic prior knowledge and unique aesthetic characteristics, which may limit the evaluation performance of the SRAFE for other fonts.Therefore, it is necessary to design more targeted artificial aesthetic features for aesthetic evaluation.Besides,we will extend more deep hidden aesthetic features and split strokes based on deep learning for further evaluation, and research on how to make SRAFE better assist the aesthetic evaluation task on different fonts.Moreover, we will perform a more in-depth study on quantitative aesthetic evaluation in Chinese calligraphy.

    CONFLICT OF INTEREST

    The authors declare that they have no conflict of interest.

    DATA AVAILABILITY STATEMENT

    Data available on request due to privacy/ethical restrictions.

    ORCID

    Mingwei Sunhttps://orcid.org/0000-0001-6196-9833

    Bin Xiehttps://orcid.org/0000-0003-2135-0694

    别揉我奶头~嗯~啊~动态视频| 成人三级做爰电影| 国产av一区在线观看免费| 脱女人内裤的视频| 免费无遮挡裸体视频| 亚洲精品在线美女| 国产精品香港三级国产av潘金莲| 日本精品一区二区三区蜜桃| av超薄肉色丝袜交足视频| 黄色片一级片一级黄色片| 一个人免费在线观看的高清视频| 两个人视频免费观看高清| 18禁裸乳无遮挡免费网站照片 | 亚洲熟妇中文字幕五十中出| 久久人妻熟女aⅴ| 好男人在线观看高清免费视频 | 最新美女视频免费是黄的| 国产亚洲欧美精品永久| 真人做人爱边吃奶动态| 少妇裸体淫交视频免费看高清 | 亚洲 国产 在线| 精品国产一区二区三区四区第35| 叶爱在线成人免费视频播放| 麻豆国产av国片精品| 国产av一区在线观看免费| 波多野结衣巨乳人妻| 成年版毛片免费区| 伊人久久大香线蕉亚洲五| 午夜福利欧美成人| 欧美激情 高清一区二区三区| 亚洲av成人av| 搡老妇女老女人老熟妇| 99久久国产精品久久久| 久久人妻av系列| 欧美日本视频| 亚洲伊人色综图| 亚洲成人精品中文字幕电影| 国产欧美日韩一区二区三| 琪琪午夜伦伦电影理论片6080| 欧美激情 高清一区二区三区| 国产91精品成人一区二区三区| 黑人巨大精品欧美一区二区蜜桃| 巨乳人妻的诱惑在线观看| 久久久久亚洲av毛片大全| 亚洲专区中文字幕在线| 国产精品自产拍在线观看55亚洲| а√天堂www在线а√下载| 美女 人体艺术 gogo| 午夜久久久在线观看| 成人三级做爰电影| 777久久人妻少妇嫩草av网站| 妹子高潮喷水视频| 日韩欧美三级三区| 叶爱在线成人免费视频播放| 精品久久蜜臀av无| 99国产精品99久久久久| 久久久久久免费高清国产稀缺| 免费av毛片视频| 久久香蕉国产精品| 夜夜爽天天搞| av天堂久久9| 精品久久久久久成人av| 一边摸一边做爽爽视频免费| av中文乱码字幕在线| 男人舔女人下体高潮全视频| 亚洲精品久久国产高清桃花| 精品欧美一区二区三区在线| 欧美 亚洲 国产 日韩一| 国产精品一区二区精品视频观看| 亚洲国产精品999在线| 1024香蕉在线观看| 制服丝袜大香蕉在线| 美女 人体艺术 gogo| 欧美大码av| 国产视频一区二区在线看| 日本五十路高清| 欧美老熟妇乱子伦牲交| 久久天躁狠狠躁夜夜2o2o| 老司机午夜十八禁免费视频| 欧美 亚洲 国产 日韩一| 女同久久另类99精品国产91| 啦啦啦 在线观看视频| 最近最新免费中文字幕在线| 两个人看的免费小视频| netflix在线观看网站| 午夜两性在线视频| videosex国产| 1024视频免费在线观看| 色尼玛亚洲综合影院| 国产成人免费无遮挡视频| 脱女人内裤的视频| 村上凉子中文字幕在线| 一个人免费在线观看的高清视频| 久久香蕉激情| 欧美一级a爱片免费观看看 | 国产欧美日韩精品亚洲av| 两个人视频免费观看高清| 两性夫妻黄色片| 窝窝影院91人妻| 亚洲av五月六月丁香网| 91精品三级在线观看| 久久久久久国产a免费观看| 桃红色精品国产亚洲av| 在线播放国产精品三级| 动漫黄色视频在线观看| 国产91精品成人一区二区三区| 叶爱在线成人免费视频播放| 久久久国产成人免费| 精品国产乱子伦一区二区三区| 国产激情欧美一区二区| 国产精品1区2区在线观看.| 黄色女人牲交| 电影成人av| 国产精品永久免费网站| 少妇 在线观看| 99国产极品粉嫩在线观看| 国内毛片毛片毛片毛片毛片| 免费不卡黄色视频| 咕卡用的链子| 麻豆成人av在线观看| 国产真人三级小视频在线观看| 亚洲精品中文字幕一二三四区| 一区在线观看完整版| 极品人妻少妇av视频| 看黄色毛片网站| 亚洲成人久久性| 国产精品九九99| 在线观看免费日韩欧美大片| 老司机午夜十八禁免费视频| 午夜激情av网站| 日韩免费av在线播放| 久久精品人人爽人人爽视色| 两性夫妻黄色片| 老司机午夜十八禁免费视频| av电影中文网址| 精品不卡国产一区二区三区| 成人亚洲精品一区在线观看| 女人被狂操c到高潮| 国语自产精品视频在线第100页| 国产野战对白在线观看| 一级,二级,三级黄色视频| 可以在线观看的亚洲视频| 国产1区2区3区精品| 精品少妇一区二区三区视频日本电影| 一级a爱片免费观看的视频| 中亚洲国语对白在线视频| 亚洲欧美精品综合久久99| 中文字幕精品免费在线观看视频| 亚洲中文字幕一区二区三区有码在线看 | 免费一级毛片在线播放高清视频 | 成在线人永久免费视频| 国产亚洲欧美98| 国产人伦9x9x在线观看| 午夜福利高清视频| 欧美激情极品国产一区二区三区| 国产成人一区二区三区免费视频网站| 50天的宝宝边吃奶边哭怎么回事| 国产成人欧美| 99re在线观看精品视频| 俄罗斯特黄特色一大片| 欧美丝袜亚洲另类 | 久久久久久久久中文| 亚洲精品国产区一区二| 免费在线观看影片大全网站| 国产精品98久久久久久宅男小说| 变态另类成人亚洲欧美熟女 | 亚洲国产精品sss在线观看| 嫩草影视91久久| 黄网站色视频无遮挡免费观看| 久久精品亚洲熟妇少妇任你| 久久精品亚洲熟妇少妇任你| 国产视频一区二区在线看| 在线观看www视频免费| 欧美激情久久久久久爽电影 | 日韩欧美一区二区三区在线观看| 欧美黑人精品巨大| 午夜福利一区二区在线看| 亚洲男人天堂网一区| 变态另类丝袜制服| 天天添夜夜摸| 国产97色在线日韩免费| 正在播放国产对白刺激| 精品国内亚洲2022精品成人| 动漫黄色视频在线观看| 亚洲精品美女久久av网站| 一二三四社区在线视频社区8| 久久精品影院6| 亚洲aⅴ乱码一区二区在线播放 | 欧美在线黄色| 久久午夜亚洲精品久久| 免费观看精品视频网站| 午夜视频精品福利| 亚洲性夜色夜夜综合| 精品一区二区三区四区五区乱码| 国产区一区二久久| 亚洲成人免费电影在线观看| 亚洲熟妇中文字幕五十中出| 精品国产一区二区久久| 啦啦啦韩国在线观看视频| 国产精品国产高清国产av| 在线观看一区二区三区| 又大又爽又粗| 一级毛片高清免费大全| 99国产极品粉嫩在线观看| 日韩视频一区二区在线观看| av福利片在线| 免费在线观看日本一区| 日韩免费av在线播放| 琪琪午夜伦伦电影理论片6080| 亚洲av成人av| 熟女少妇亚洲综合色aaa.| 女性被躁到高潮视频| 91精品国产国语对白视频| 一边摸一边抽搐一进一出视频| 99久久久亚洲精品蜜臀av| av欧美777| 别揉我奶头~嗯~啊~动态视频| 多毛熟女@视频| 欧美一级a爱片免费观看看 | 一夜夜www| 久99久视频精品免费| 可以在线观看毛片的网站| 丝袜在线中文字幕| 免费在线观看完整版高清| 国产精品一区二区三区四区久久 | 一a级毛片在线观看| 午夜福利视频1000在线观看 | 国产日韩一区二区三区精品不卡| 亚洲va日本ⅴa欧美va伊人久久| 777久久人妻少妇嫩草av网站| 999精品在线视频| 欧美日本亚洲视频在线播放| 啪啪无遮挡十八禁网站| 亚洲在线自拍视频| 免费少妇av软件| cao死你这个sao货| 亚洲第一电影网av| 少妇熟女aⅴ在线视频| 宅男免费午夜| 变态另类丝袜制服| av片东京热男人的天堂| 成人亚洲精品av一区二区| www日本在线高清视频| 侵犯人妻中文字幕一二三四区| 欧美一区二区精品小视频在线| 精品久久久精品久久久| 一区福利在线观看| 人人妻人人澡人人看| 久久伊人香网站| 在线观看免费视频日本深夜| 久久精品国产亚洲av香蕉五月| 免费女性裸体啪啪无遮挡网站| 99香蕉大伊视频| 欧美黄色淫秽网站| 欧美激情久久久久久爽电影 | 日韩大码丰满熟妇| 中文字幕久久专区| 久久婷婷人人爽人人干人人爱 | 免费在线观看日本一区| 国产精品影院久久| 久久天躁狠狠躁夜夜2o2o| 国产成人精品久久二区二区免费| 亚洲成人免费电影在线观看| 搡老岳熟女国产| cao死你这个sao货| 怎么达到女性高潮| 亚洲少妇的诱惑av| 精品一品国产午夜福利视频| 丁香欧美五月| videosex国产| 日本vs欧美在线观看视频| 国产精品久久电影中文字幕| 精品一区二区三区视频在线观看免费| 在线永久观看黄色视频| 久9热在线精品视频| 国产精品电影一区二区三区| 欧美一区二区精品小视频在线| 黄片小视频在线播放| 亚洲人成电影观看| 真人做人爱边吃奶动态| 久久中文看片网| 国产极品粉嫩免费观看在线| 精品第一国产精品| 丝袜美足系列| 久久人人精品亚洲av| 黄频高清免费视频| 九色国产91popny在线| 亚洲国产毛片av蜜桃av| 久久久久久国产a免费观看| 欧美色欧美亚洲另类二区 | 曰老女人黄片| 亚洲自拍偷在线| 色播亚洲综合网| 看黄色毛片网站| 成人三级黄色视频| 国产色视频综合| 亚洲国产精品久久男人天堂| 亚洲电影在线观看av| 午夜福利免费观看在线| 国产区一区二久久| 欧美一区二区精品小视频在线| 丰满的人妻完整版| 欧美成狂野欧美在线观看| 国产人伦9x9x在线观看| 18禁观看日本| 色综合亚洲欧美另类图片| 日本 欧美在线| 亚洲av片天天在线观看| 国产xxxxx性猛交| 亚洲美女黄片视频| 91国产中文字幕| 色av中文字幕| 精品一区二区三区视频在线观看免费| 久久久久久久午夜电影| 亚洲成a人片在线一区二区| 9热在线视频观看99| 少妇粗大呻吟视频| 亚洲熟妇熟女久久| 亚洲欧洲精品一区二区精品久久久| 制服人妻中文乱码| 国产精品 国内视频| 久久婷婷成人综合色麻豆| 人人妻人人澡欧美一区二区 | 色综合亚洲欧美另类图片| а√天堂www在线а√下载| 制服诱惑二区| 亚洲人成伊人成综合网2020| 亚洲成人免费电影在线观看| 大陆偷拍与自拍| 高潮久久久久久久久久久不卡| 成人国产综合亚洲| av有码第一页| 可以在线观看的亚洲视频| 窝窝影院91人妻| 久久久国产欧美日韩av| 亚洲中文字幕一区二区三区有码在线看 | 久久久久精品国产欧美久久久| 无人区码免费观看不卡| 十分钟在线观看高清视频www| 黄片大片在线免费观看| 大码成人一级视频| 免费观看精品视频网站| 中文亚洲av片在线观看爽| 丁香欧美五月| 女性生殖器流出的白浆| 久久天堂一区二区三区四区| 满18在线观看网站| 亚洲熟妇熟女久久| av超薄肉色丝袜交足视频| 欧美中文综合在线视频| 国产精品1区2区在线观看.| 久久久久久大精品| 中文字幕人妻熟女乱码| 一级毛片女人18水好多| 午夜福利欧美成人| 变态另类丝袜制服| 久久青草综合色| 国产精品久久久久久亚洲av鲁大| 亚洲七黄色美女视频| 久久精品国产综合久久久| 宅男免费午夜| 亚洲avbb在线观看| 纯流量卡能插随身wifi吗| 国产精品av久久久久免费| 在线播放国产精品三级| 一级a爱片免费观看的视频| 99在线视频只有这里精品首页| 国产激情欧美一区二区| 亚洲精品在线美女| 久久中文看片网| 在线av久久热| 此物有八面人人有两片| 母亲3免费完整高清在线观看| 午夜福利成人在线免费观看| 男女午夜视频在线观看| 欧美日韩一级在线毛片| 黑人巨大精品欧美一区二区mp4| 黄色女人牲交| 国产成人精品无人区| 日韩高清综合在线| 淫秽高清视频在线观看| 极品人妻少妇av视频| 免费观看精品视频网站| 欧美亚洲日本最大视频资源| 免费观看精品视频网站| 在线观看www视频免费| 欧美性长视频在线观看| 国产精品国产高清国产av| 国产不卡一卡二| 免费搜索国产男女视频| 在线av久久热| 精品国产超薄肉色丝袜足j| 亚洲av成人av| 久久性视频一级片| 国产av一区在线观看免费| 一边摸一边做爽爽视频免费| 国产亚洲av高清不卡| 一区福利在线观看| av网站免费在线观看视频| 法律面前人人平等表现在哪些方面| 午夜成年电影在线免费观看| 欧美乱色亚洲激情| 亚洲自拍偷在线| 高清黄色对白视频在线免费看| 日日干狠狠操夜夜爽| 精品熟女少妇八av免费久了| 国产成人av激情在线播放| 久久久久久久久免费视频了| 亚洲av五月六月丁香网| 美女免费视频网站| 美女高潮到喷水免费观看| 午夜精品在线福利| 国产高清videossex| 97人妻天天添夜夜摸| 亚洲国产精品合色在线| 国产精品影院久久| 99在线人妻在线中文字幕| 大香蕉久久成人网| 别揉我奶头~嗯~啊~动态视频| 欧美乱妇无乱码| 亚洲第一电影网av| 老汉色∧v一级毛片| 国产91精品成人一区二区三区| av中文乱码字幕在线| 免费高清视频大片| 久久久久九九精品影院| 亚洲第一欧美日韩一区二区三区| 成年女人毛片免费观看观看9| 在线观看免费午夜福利视频| 国产日韩一区二区三区精品不卡| 高清在线国产一区| 成人国产综合亚洲| 久久亚洲精品不卡| 亚洲九九香蕉| 久久伊人香网站| 国产精品免费视频内射| 亚洲伊人色综图| 中文字幕av电影在线播放| 一级毛片精品| 一二三四在线观看免费中文在| 不卡一级毛片| 欧美午夜高清在线| 久久久久久久久久久久大奶| 亚洲狠狠婷婷综合久久图片| 亚洲精品中文字幕一二三四区| 麻豆av在线久日| 99精品在免费线老司机午夜| 免费看a级黄色片| 日本 欧美在线| 一区二区三区国产精品乱码| 亚洲专区中文字幕在线| 女性生殖器流出的白浆| 满18在线观看网站| 国产成人精品久久二区二区91| 久久久久久久久久久久大奶| av视频在线观看入口| 成年女人毛片免费观看观看9| 自拍欧美九色日韩亚洲蝌蚪91| 亚洲第一欧美日韩一区二区三区| 女人精品久久久久毛片| 国产精品久久电影中文字幕| 美女国产高潮福利片在线看| 免费在线观看视频国产中文字幕亚洲| 国产熟女xx| 精品电影一区二区在线| av中文乱码字幕在线| 88av欧美| 亚洲性夜色夜夜综合| 黄片大片在线免费观看| 首页视频小说图片口味搜索| 国内精品久久久久久久电影| 麻豆一二三区av精品| 午夜视频精品福利| 久久精品国产清高在天天线| 禁无遮挡网站| xxx96com| 色婷婷久久久亚洲欧美| 欧美大码av| 在线十欧美十亚洲十日本专区| 丁香六月欧美| 国产一区二区三区视频了| 亚洲熟妇中文字幕五十中出| 99久久综合精品五月天人人| 中文字幕精品免费在线观看视频| 成人永久免费在线观看视频| 国产亚洲精品第一综合不卡| 黄色女人牲交| 欧美成人一区二区免费高清观看 | 国内毛片毛片毛片毛片毛片| 一边摸一边抽搐一进一小说| 自拍欧美九色日韩亚洲蝌蚪91| 大码成人一级视频| 女性被躁到高潮视频| 老熟妇仑乱视频hdxx| 亚洲av成人av| 国产精品美女特级片免费视频播放器 | 久久精品91无色码中文字幕| 国产精品 欧美亚洲| 国语自产精品视频在线第100页| 免费在线观看影片大全网站| 日韩欧美一区二区三区在线观看| 黑丝袜美女国产一区| 给我免费播放毛片高清在线观看| 女人被狂操c到高潮| 搡老熟女国产l中国老女人| 日韩欧美国产一区二区入口| 淫秽高清视频在线观看| 在线播放国产精品三级| 欧美日韩黄片免| 亚洲av电影在线进入| 一级作爱视频免费观看| 午夜日韩欧美国产| av天堂在线播放| 精品免费久久久久久久清纯| 国产高清videossex| 日韩免费av在线播放| 欧美日韩乱码在线| 日韩欧美国产在线观看| 天天躁夜夜躁狠狠躁躁| 波多野结衣av一区二区av| 日韩大码丰满熟妇| 看黄色毛片网站| 日韩成人在线观看一区二区三区| 亚洲精品久久成人aⅴ小说| 欧美成人性av电影在线观看| 我的亚洲天堂| 天天躁夜夜躁狠狠躁躁| 丝袜在线中文字幕| 亚洲欧美日韩无卡精品| 亚洲五月天丁香| 午夜免费鲁丝| 亚洲成人精品中文字幕电影| 夜夜爽天天搞| 亚洲在线自拍视频| 成人国产一区最新在线观看| 91成年电影在线观看| 日本vs欧美在线观看视频| 在线观看舔阴道视频| 亚洲成人精品中文字幕电影| 国产成人精品久久二区二区91| 国产麻豆69| 久久精品国产99精品国产亚洲性色 | 好看av亚洲va欧美ⅴa在| 18禁国产床啪视频网站| 亚洲精华国产精华精| 精品国产乱子伦一区二区三区| 亚洲国产精品合色在线| 男女做爰动态图高潮gif福利片 | 欧美一区二区精品小视频在线| 黄色视频不卡| 欧美日韩亚洲国产一区二区在线观看| 亚洲午夜理论影院| 中文字幕人成人乱码亚洲影| 亚洲五月天丁香| 日日夜夜操网爽| 91字幕亚洲| 亚洲国产欧美一区二区综合| 亚洲国产精品久久男人天堂| 日本黄色视频三级网站网址| 成人亚洲精品一区在线观看| 久久久久九九精品影院| 亚洲中文日韩欧美视频| 国产在线观看jvid| 久久精品91无色码中文字幕| 啦啦啦韩国在线观看视频| 午夜免费成人在线视频| 午夜亚洲福利在线播放| 亚洲精品国产色婷婷电影| 成人av一区二区三区在线看| 国产精品精品国产色婷婷| 国产高清videossex| 99国产极品粉嫩在线观看| 日韩av在线大香蕉| 欧美久久黑人一区二区| 久久久久亚洲av毛片大全| 高清黄色对白视频在线免费看| 午夜精品久久久久久毛片777| 高清在线国产一区| 久久婷婷成人综合色麻豆| 亚洲av电影在线进入| 一夜夜www| 最新美女视频免费是黄的| 亚洲国产精品999在线| 久久午夜亚洲精品久久| 欧美绝顶高潮抽搐喷水| 亚洲av第一区精品v没综合| 亚洲情色 制服丝袜| 精品一区二区三区视频在线观看免费| 国产不卡一卡二| 99精品久久久久人妻精品| 亚洲精品一卡2卡三卡4卡5卡| 大型黄色视频在线免费观看| 欧美成人性av电影在线观看| 国产在线精品亚洲第一网站| 免费少妇av软件| 99久久国产精品久久久| 亚洲一区中文字幕在线| 天堂√8在线中文| 国内久久婷婷六月综合欲色啪| 欧美日韩精品网址| 岛国视频午夜一区免费看| 久久久精品国产亚洲av高清涩受| 丝袜美足系列| 久热爱精品视频在线9| 国产精品香港三级国产av潘金莲| 亚洲精品中文字幕一二三四区| 波多野结衣一区麻豆| 国内精品久久久久精免费| 国产真人三级小视频在线观看| 国产精品精品国产色婷婷| 好看av亚洲va欧美ⅴa在| 亚洲精品中文字幕一二三四区| 91麻豆av在线| 欧美日本亚洲视频在线播放| 久久亚洲精品不卡|