• <tr id="yyy80"></tr>
  • <sup id="yyy80"></sup>
  • <tfoot id="yyy80"><noscript id="yyy80"></noscript></tfoot>
  • 99热精品在线国产_美女午夜性视频免费_国产精品国产高清国产av_av欧美777_自拍偷自拍亚洲精品老妇_亚洲熟女精品中文字幕_www日本黄色视频网_国产精品野战在线观看 ?

    SRAFE: Siamese Regression Aesthetic Fusion Evaluation for Chinese Calligraphic Copy

    2023-12-01 10:43:58MingweiSunXinyuGongHaitaoNieMuhammadMinhasIqbalBinXie

    Mingwei Sun| Xinyu Gong | Haitao Nie | Muhammad Minhas Iqbal,3 |Bin Xie

    Abstract Evaluation of calligraphic copy is the core of Chinese calligraphy appreciation and inheritance.However, previous aesthetic evaluation studies often focussed on photos and paintings, with few attempts on Chinese calligraphy.To solve this problem, a Siamese regression aesthetic fusion method is proposed, named SRAFE, for Chinese calligraphy based on the combination of calligraphy aesthetics and deep learning.First, a dataset termed Evaluated Chinese Calligraphy Copies (E3C) is constructed for aesthetic evaluation.Second,12 hand-crafted aesthetic features based on the shape,structure,and stroke of calligraphy are designed.Then, the Siamese regression network (SRN) is designed to extract the deep aesthetic representation of calligraphy.Finally, the SRAFE method is built by fusing the deep aesthetic features with the hand-crafted aesthetic features.Experimental results show that scores given by SRAFE are similar to the aesthetic evaluation label of E3C, proving the effectiveness of the authors’ method.

    K E Y W O R D S calligraphy evaluation, hand-crafted aesthetic features, siamese regression network

    1 | INTRODUCTION

    Chinese calligraphy,as one of the treasures of Chinese culture,shines splendidly in the world's culture and art.As the core of Chinese calligraphy,aesthetic evaluation is of great significance to art research, education and inheritance.With the development of computational aesthetic evaluation, there is some research in the field of photographic images [1], western paintings [2, 3], ink paintings [4], webpage [5] etc.However,how to make an objective,accurate and interpretable aesthetic evaluation of Chinese calligraphy images is still a challenge.Aesthetic evaluation aims to evaluate the aesthetic quality of images by simulating human aesthetics and the perception of beauty automatically.At present, the relevant research of aesthetic evaluation is mainly based on hand crafted and deep learning methods [6].Based on hand-crafted features such as colour, contrast, Sharpness, Mavridaki et al.[7] proposed an evaluation system using five basic photography rules,and Redi et al.[8]introduced a framework to access the quality of digital portraits.They all performed well on the AVA dataset.Also for the AVA dataset, Li et al.[9] presented a personality-assisted multi-task deep learning framework and Zhang et al.[10]proposed a multi-modal self and collaborative attention network to make photo aesthetic assessment, which were all based on deep learning.

    In terms of Chinese calligraphy,most calligraphy evaluation research is based on the hand-crafted features.From the aesthetic perspective, the features of calligraphy stroke and structure were designed in several studies.Gao et al.[11] proposed a method of Chinese handwriting quality evaluation based on an 8-Directionalfeature.The evaluation model designedbyLi et al.[12]computed the difference in the WF-histogram between the initial style and standard style to generate the score of the target-style after training.Zhou et al.[13] extracted Chinese calligraphyintothree featurestoproduce an evaluationvalue bya proposed PPD method.To improve aesthetic evaluation performance,Lian etal.[14]presentedmoreglobal shapefeaturesto describe and evaluate the aesthetic quality of a Chinese character.

    Meanwhile, to evaluate the quality of calligraphic copies,several studies designed the features based on the relationship between calligraphy copies and their corresponding template,which can provide a reference to make the aesthetic evaluation more objective.Based on the features of centre, size, and projection, Han et al.[15] used fuzzy inference techniques to score calligraphy characters on three ranks.Wang et al.[16]calculated stroke sequence, character shape and stroke shape similarities between calligraphic copies and templates.They also implemented a comprehensive evaluation involving the whole character and stroke similarities to achieve a final composited evaluation score[17].In addition,although the fuzzy evaluation method constructed by Ref.[18]is more accurate,the method based on the writing process recorded by resistive touch screen has limitations for hardware facilities.

    From the previous studies above,with the strong aesthetic regularity of Chinese calligraphy, hand-crafted features based on calligraphy aesthetic attributes can allow the evaluation method interpretable and reasonable.However, the handcrafted features require calligraphy professional knowledge,and the limited hand-crafted features always ignore some hidden aesthetic information of calligraphy, resulting in the insufficient ability of aesthetic evaluation.Deep learning can effectively extract hidden aesthetic information in calligraphy images to supplement the hand-crafted features,although it is a black box with a lack of interpretability.Therefore, we try to achieve aesthetic evaluation performance and interpretability at the same time by combining the deep network with the handcrafted features.

    In this paper, we make the following three contributions.

    ? To construct dataset E3C, we collect 11,008 calligraphic copy images from students and amateurs,including 59 kinds of Chinese characters, and invite 121 people to evaluate aesthetic scores, thus providing data for the study of calligraphy aesthetics.E3C will be public.

    ? Based on the aesthetics of calligraphy,we designed 12 handcrafted features by comparing calligraphic copies and corresponding templates from the perspective of shape,structure and strokes of calligraphy and analysed feature validation.Through machine learning algorithms including multiple linear regression, Xgboost [19], and LightGBM [20] regression,we obtained continuous scores of calligraphic copies in the range of 1–10,which were similar to calligraphy experts'scores.

    ? In order to fully extract the aesthetic hidden information of calligraphy copy images, based on different pre-training backbones, we design the Siamese regression network(SRN) to extract the deep aesthetic features for calligraphy evaluation.To further improve the performance of aesthetic evaluation algorithm, innovatively, the SRAFE method is proposed for Chinese calligraphy by fusing the deep aesthetic features with the 12 hand-crafted features (See Figure 1).The effectiveness of our method is proved by ablation experiments.

    2 | PROPOSED DATASET E3C

    Being treated as a machine learning problem,the construction on the dataset becomes the key precondition in aesthetic evaluation of Chinese calligraphic copies.We build a dataset termed Evaluated Chinese Calligraphy Copies(E3C),in which dataset E3C is split in a reasonable way with appropriate evaluation metrics to evaluate the prediction performance of our proposed method.

    2.1 | Dataset E3C

    F I G U R E 1 Overview of our SRAFE method for Chinese calligraphy

    As shown in Figure 2,we constructed dataset E3C to train the model.The dataset collected 11,008 calligraphic copy images from students and amateurs, including 59 kinds of Chinese characters, and invited 121 people (including 10 experts and 111 majors)to evaluate aesthetic scores in our scoring system.Each calligraphy copy was graded by three experts and more than 10 majors ranging from 1 to 10,where 1 means the most negative aesthetic score and 10 means the most positive aesthetic score.The aesthetic score graded by experts is obtained by calculating the average.The majors aesthetic score is generated as follows: The highest and lowest scores from majors are removed and replaced by the mode.Then,the final score label of each calligraphic copy is calculated by the weighted average from the expert and majors aesthetic score,among which the weight of the expert aesthetic score is 0.7 and the amateurs is 0.3.Figure 3 shows the distribution of aesthetic labels, similar to a normal distribution.

    2.2 | Dataset for experiments

    As the benchmark of the experiment, E3C is divided into training set, validation set and test set at the ratio of 6:2:2,on the premise of the same distribution.The test set contains Chinese characters that have never appeared in the training set and verification set to prove the robustness and generalisation of the methods.What's more, the calligraphic copies of Chinese character ‘Ming’ never appears in the training set and verification set but only in the test set.The aesthetic prediction of the algorithm for character ‘Ming’ can truly reflect the performance of the aesthetic evaluation methods.

    F I G U R E 2 Samples of dataset E3C

    2.3 | Evaluation metrics

    To evaluate the prediction performance of our proposed method, we calculate the average mean absolute error (MAE)and Pearson correlation coefficient (PCC).MAE is formally expressed as

    wheremis the number of samples,^yiis the predicted value of theith sample, andyiis the true value of theith sample.It is worth noting that MAE represents the error of scores on a scale of one to ten; the smaller the MAE the better the prediction performance.PCC is used to measure the correlation between prediction and label; higher absolute value means better performance.PCC is defined as

    whereμYandμ^Yrepresent the mean value of the true label and the mean value of the predicted value, respectively,σYandσ^Yrepresent the standard deviation of the true label and the standard deviation of the predicted value,respectively.

    3 | METHODS ON AESTHETIC FEATURE EXTRACTION

    In this section, based on the calligraphic aesthetic, 12 handcrafted aesthetic features consisting of calligraphic shape,structure,and stroke feature are designed from the comparison between calligraphic copyCand the corresponding templateT.These hand-crafted features are the quantification of human aesthetics of calligraphy and can contribute to the calligraphy aesthetic evaluation methods.

    3.1 | Calligraphic image registration

    The calligraphic copy photos often have different sizes.Moreover,the relative position and relative size of the character in the calligraphic image are uncontrollable, as shown in Figure 4b.Therefore, calligraphic image registration is an indispensable basis for evaluating calligraphic copy quality with an objective score.From an aesthetic point of view, the following two conditions should be satisfied by calligraphic image registration.1) The number of pixels in the copy character and template character is the same.2)The centre of gravity of the copy character and the template character is the same.In this section, calligraphic image registration of the calligraphic copyCand the calligraphic templateTcan be implemented as follows.

    3.1.1 | Calligraphic image preprocessing

    First,CandTare resized to the same width with the original aspect ratio fixed and binarised after grey-scale transformation.Then noise such as dropped ink is removed by setting the threshold of the connected domain area.After image preprocessing, useless interference information can be filtered out and calligraphic characters can be retained.

    3.1.2 | Calligraphic size registration

    We extract the smallest fitting rectangle of the calligraphic character inCandTas the ROI.The parameterswidth* andheight* denote theC-ROI's width and height respectively.After resizing, the two parameters can be calculated as

    whereSCandSTare the total number of pixels of the calligraphic character inC-ROI andT-ROI, respectively.After resizing, the calligraphic characters ofCandThave the same number of pixels.

    F I G U R E 4 Calligraphic image registration.(a) Original calligraphic template.(b) Original calligraphic copy.(c) Calligraphic template afterimage registration.(d) Calligraphic copy after image registration

    3.1.3 | Calligraphic location registration

    For calligraphic characters ofTandC, the centre of gravity is calculated as

    3.2 | Feature on calligraphic shape

    The most intuitive way to evaluate the difference betweenCandTis to compare their shapes.To quantify the difference in aesthetics, we use the overlapping ratio to represent the similarity in calligraphic shape, as shown in Figure 5a.The features on calligraphic shape can be formally expressed as

    whereACandATrepresent the area of the calligraphic character inCand the corresponding character inT, respectively.f1is in the range of 0–1 and has an obviously positive correlation with the quality of calligraphic copy.Then,we mapf1to the shape aesthetic scoref2with a scope of 1-10 by

    F I G U R E 5 (a)The visual calligraphy guidance based on shape feature,where the red contour reflects the template,and f1 is 0.368.(b) The visual calligraphy guidance based on structure feature, where the red contourreflects the template's structure while the blue reflects the copy's structure,and f2 is 0.876

    The shape feature can be used in calligraphy teaching.As shown in Figure 3a, by superimposing the red contour of the template on the copy image, the difference between the copy and the template can be presented clearly, which can provide students with intuitive visual guidance.

    3.3 | Features on calligraphic structure

    In Chinese calligraphy, the structure of Chinese characters usually determines its overall aesthetic quality.In this section,the features on a calligraphic structure are mainly quantified by convex hull feature extraction and projection feature extraction.

    3.3.1 | Convex hull feature extraction

    The convex hull of the calligraphic character can reflect the overall structure of the character.We compare the convex hulls of the characters inTandCto obtain an overall structure feature by the overlapping ratiof3, which is defined

    whereSCandSTrepresent the area of the convex hull of calligraphic character in C and T,respectively.f3is in the range of 0–1, which is all positively associated with the quality of calligraphic copy.Moreover, as Figure 5b shows, the convex hull feature can describe the difference on calligraphic structure and can provide visual guidance.

    3.3.2 | Projection feature extraction

    F I G U R E 6 The projection of T and C to the direction of 0°,-45°,45°,and 90°.The red dotted line represents the projected baseline in‘mizi’grid,and the black histograms represent the projected histograms oncorresponding red dotted lines

    When practicing Chinese calligraphy, the character is usually written in a‘mizi’ grid, which is an intersected figure designed specifically for writing Chinese characters,as shown by the red grid in Figure 6.Through the horizontal line, the vertical line,left diagonal and right diagonal of the ‘mizi’ grid, it is convenient for beginners to determine the position and direction of the strokes when writing and provide them with a structural reference.Inspired by this,we projectTandCto the direction of the four baselines of the ‘mizi’ grid, which are in the directions of 0°,-45°,45°,and 90°,as shown in Figure 6.HTdenotes the projected histogram ofT, andHCdenotes the projected histogram ofCin the direction of 0°.The overlapping ratio in the directions of 0° is formally expressed as

    Then,we can calculate the correlation ofHTandHCin the direction of 0° by

    Accordingly, featuresf6~f11are obtained by calculating the overlapping ratio and correlation in the directions of -45°,45°, and 90° to quantify the histograms.

    3.4 | Features on calligraphic stroke

    The details and layout of the strokes have a significant impact on the aesthetic quality of calligraphy.To quantify the aesthetic feature of strokes,first,we detect the keypoints of calligraphic strokes based on Faster RCNN [21], then realise the keypoint registration through CPD [22], and finally calculate the difference according to the keypoint information of the template,as seen in Figure 1d.

    3.4.1 | Keypoint detection on calligraphic stroke

    With strong regularity on visual characteristics, the keypoints of calligraphic strokes can be divided into two categories; one is the beginning and ending of strokes and the other is the turning and crossing of strokes.Based on the two categories,we established the calligraphy keypoint detection dataset with 800 calligraphic images and 13,648 keypoint boxes.The keypoint boxes with two category labels contain the edge information of the key parts of the strokes, and their centre points are the keypoints of the strokes.The experimental results show that in the test set of 100 calligraphic images with 17 characters, the detection precision is 0.988, and the recall is 0.917.Therefore,the keypoint detection of calligraphic characters can be realised with excellent performance based on Faster RCNN.

    3.4.2 | Keypoint registration based on CPD

    F I G U R E 7 Samples of the keypoint detection result on the calligraphic copy

    As Figure 7 shows,we can obtain keypoints ofTandCby the above method.To achieve keypoint registration ofTandC,based on CPD, we make some improvements to solve the problem of registering to the same keypoint when some keypoints are too close.We try to split the connected domains of characters to reduce the registration scope based on corresponding connected domains.For the keypoints registered repeatedly in the same connected domain, only the closest keypoint is kept, and the remaining points are rematched to avoid pairing errors.

    3.4.3 | Quantification of calligraphic stroke feature

    The calligraphic stroke feature is quantified by calculating the average Euclidean distance of the keypoints as follows

    4 | PROPOSED SRAFE METHOD

    If only the above hand-crafted features are used, there will be the lack of aesthetic information and unsatisfactory evaluation performance due to the current limited and incomplete handcrafted features.Therefore, in this section, we propose the SRAFE method, which fuses the hand-crafted features with deep learning methods; Figure 1 illustrates the framework of our proposed method.First, we transform the basic Siamese network by pre-training the backbone with shared weights,extract and contrast deep feature combined with the regression layer for supervised learning.Then, based on the 12 aesthetic features consisting of calligraphic shape, structure, and stroke features from the section 3, our SRAFE method fuses them with the deep features from SRN,which are trained by lightGBM regression to build our calligraphy evaluation model.

    4.1 | SRN for calligraphy evaluation in SRAFE

    The Siamese network[23]takes two samples as input,with the representation of their embedding in high-dimensional space as output, to compare the similarity of the two samples.Meanwhile, through transfer learning, using the pre-training model based on CNN as the backbone, we can achieve better and faster performance in the task of computer vision[24].Inspired by this, based on the Siamese network, we take the pre-training model of ImageNet as the backbone to learn the deep representation reflecting the aesthetics of calligraphy.As shown in Figure 1a, the two backbone branches input by calligraphic copyCand the corresponding templateTshare weights, and finally connect the 10-dimensional linear layer,respectively.We design the regression layer as the last layer by replacing the cross entry loss to the European loss of theT's 10-dimensional tensor and theC's 10-dimensional tensor.To better learn the differences ofTandC, the specific loss function is defined as follows:

    where 10-ynrepresents the gap betweenthe Euclidean distance and the full aesthetic score.The smaller the Euclidean distance between the deep features ofTandC,the higher the calligraphy aesthetic score.Therefore, in this MSE loss, the Euclidean distance is used to approach the gap between the label and the full score.As the output of our SRN,10-ynis also a prediction of the aesthetic quality of calligraphy copy.

    4.2 | Aesthetic fusion and regression in SRAFE

    As shown in Figure 1, SRAFE mainly fuses the hand-crafted aesthetic features on the basis of the SRN to improve the performance and interpretability of the evaluation model.Feature fusion is mainly the fusion offeaturedeep,Euclideanandfeaturehandshown in Figure 1.The deep aesthetic features with 10 dimensions ofTandCcan be extracted through the SRN,whereEuclideanis the European distance of the two deep features with 1 dimension.Meanwhile,featuredeepis the difference obtained by subtraction of two deep aesthetic features,with 10 dimensions.featurehandis the 12-dimensional tensor obtained by the hand-crafted features.We set the dimension of the deep feature 10 to achieve a balance between the deep features and hand-crafted features in learning.With the fusion offeaturedeep,Euclideanandfeaturehand, the 23-dimensional fused features can be obtained, and the final aesthetic evaluation scores are predicted by lightGBM regression.

    If we only rely on the SRN for aesthetic evaluation, the deep features are in the black box, which lacks interpretability and aesthetic prior knowledge of calligraphy.From the perspective of professional aesthetic evaluation on character shape,structure,and stroke,the hand-crafted aesthetic features can not only improve the interpretability of evaluation but also supplement the aesthetic information ignored by the deep features.However,if only the hand-crafted features are used,it will also lead to the lack of aesthetic information and unsatisfactory evaluation performance due to the current limited and incomplete hand-crafted features.Therefore, theoretically,our SRAFE method can make the deep features and the handcrafted aesthetic features complement each other, increase the interpretability and improve the performance of aesthetic evaluation at the same time.

    5 | EXPERIMENTS AND DISCUSSION

    In the experiments, we validate the validity of the 12 handcrafted aesthetic features on the dataset E3C and Table 1 summarizes the 12 features.Meanwhile, based on the 12 features, we compared the prediction performance of multiple linear regression (MLE), Xgboost and LightGBM on the test set of E3C, and chose LightGBM as the regressor for the following experiments.Then, we compare different pretraining models in our SRN to determine the backbone, to extract the hidden aesthetic information of calligraphy copies better.Finally, through ablation experiments, the effectiveness of our SRAFE method is verified.The experimental results show that the score of calligraphic copy quality predicted by our proposed SRAFE method is similar to that of human.

    5.1 | Feature validation

    As shown in Figure 8, the correlation coefficient betweenf1andf2is high,becausef2is the mapping off1between 0 and 10 points.We find that the features extracted by projection onthe same direction,such asf4andf5,f6andf7,f8andf9,f10andf11have a strong correlation, because they are constructed by quantifying the similarity of the projection histogram of a same angle.The correlation coefficient betweenf1and the label is 0.41, which is the most positive correlation with the label among the 12 features, indicating that the aesthetic feature designed from the perspective of calligraphy shape is close to the aesthetic of public and is more consistent with human aesthetics.In addition to the features designed from the perspective of shape, the correlation coefficient betweenf12and label is -0.34, which has the largest negative correlation with the label among the 12 features, indicating that the aesthetic features designed from the perspective of calligraphy strokes are close to the aesthetic score of calligraphy public and are in good agreement with human aesthetics.Among the 12 features, the smallest correlation with the label isf12, 0.12,which also shows a correlation with the label.

    T A B L E 1 Feature description

    5.2 | Performance of the hand‐crafted aesthetic features

    As human evaluation for calligraphy is often based on subjective aesthetics, it is difficult to give accurate and objective scores,so we use regression algorithms to fit the integer scores,so as to obtain continuous prediction scores on calligraphy evaluation.Considering the performance of algorithms on different datasets may be different, multiple linear regression(MLR), Xgboost and LightGBM were used to train the regression model and compared on performance.

    According to Table 2,LightGBM performs better than MLR and Xgboost on the test set of E3C containing 1799 calligraphic copies with 0.989 MAE under the ten-point scoring rule and 0.548 PCC.So,we choose the LightGBM as the regressor for the following aesthetic evaluation algorithms.

    F I G U R E 8 Pearson correlation coefficients of the 12 features and labels

    Although this method can predict the aesthetic quality of calligraphy copies,its performance is not satisfactory,and there is still room for improvement,which is also consistent with our previous conjecture.It is necessary to further extract the deep aesthetic information of calligraphy copy images to improve the performance.

    5.3 | Performance of SRN

    In the implementation,all the network training and testing are performed with NVIDIA RTX3090 GPU and PyTorch 1.8.We use Adam optimiser with the 0.001 base learning rate and(0.9,0.990)betas.Table 3 shows the performance comparison in selecting ResNet101[25],InceptionV3[26]and Densnet121[27] as the backbone.The statistics in Table 3 that the model with ResNet101 yields a higher PCC and a lower MAE than other two pre-trained backbones.Therefore, we choose pretrained ResNet101 as the backbone in the SRN.

    Through this method,we can obtain the deep features and the Euclidean distance reflecting the calligraphy aesthetic evaluation.However, the 0.836 MAE still has plenty of room for improvement,and the deep features lack the interpretability of calligraphy aesthetics.Therefore, in the experiment on the SRAFE method,we fuse the 12 hand-crafted aesthetic features of calligraphy with our SRN.

    5.4 | Performance of SRAFE

    To further improve the performance of calligraphy evaluation,our SRAFE method fuses the deep features from the SRN and the hand-crafted aesthetic features.We further investigate the effectiveness of the SRAFE method by ablation experiments,which also verify the effect of submodules (deep features,European distance of two deep features, and hand-crafted aesthetic features) in SRAFE on performance.The result of ablation shows in Table 4.

    T A B L E 2 Performance comparisons of different models based on the 12 features

    T A B L E 3 Performance comparisons of SRN in different backbones

    According to Table 4 above, Exp.7 is of the optimal prediction performance.It shows that our SRAFE method improves 0.170 on MAE and 0.041 on PCC compared with SRN,meanwhile,improves 0.323 on MAE and 0.261 on PCC compared with only hand-crafted features.Exp.2 and 4(3 and 5,6 and 7)demonstrated the effectiveness of the deep feature from the SRN.The deep feature can characterise the aesthetic differences betweenTandC,which would facilitate the model robustness enhancement.Through comparing the results of Exp.1 and 4 (3 and 6, 5 and 7), it can be found that the addition of Euclidean distance could be conducive to aesthetic prediction, although the improvement is small when the deep feature exists.The Euclidean distance is the output of the SRN,and it also directly reflects the aesthetic gap betweenTandC.It is discovered in Exp.1 and 5 (2 and 6, 4 and 7) that the performance improvement brought about by the hand-crafted features is less than 0.112 on MAE.Furthermore,we find that the deep feature contributes the most to the performance of calligraphy evaluation.It also proves that the deep network can extract useful hidden aesthetic information, which is an effective supplement to hand-crafted aesthetic features.

    In Figure 9,we select the character‘Ming’from the test set as the display of the aesthetic evaluation of calligraphy by SRAFE method.The blue part ‘LABEL’ is the label of E3C dataset, which is the public aesthetic score, and the red part‘PRED’ is the predicted aesthetic score of SRAFE algorithm,and the real aesthetic score of‘Ming’increases from left to right.It is worth mentioning that the character‘Ming’is never in the training set and validation set.It shows that the SRAFE method can give a good aesthetic score on Chinese calligraphy with good generalisation performance.

    As Figure 10 shows, the aesthetic score labels of the test set, which contains 1786 calligraphic copy images, are arranged from low to high (blue scatter plot) and are compared with the corresponding aesthetic predicted scores obtained by the SRAFE method (orange scatter plot).In the figure, the ordinate is the aesthetic prediction score(1–10),the abscissa is the number of the calligraphy copy test case image.The orange dots are relatively dense from low to high, indicating that our method can predict the aesthetic score with good performance.We also analyse the samples with large prediction deviations.Some bad cases are of unsatisfactory font segmentation in image pre-processing, resulting in the deviation of feature extraction, which needs to be optimised and improved in the future.Meanwhile, some copies with low scores are predicted to have high scores due to there are few low score samples during training.Moreover, the ink stains that will be removed and ignored by the algorithm are an important factor to reduce the scoring of aesthetic labels.Therefore, the treatment of sample imbalance and the impact of ink stains on aesthetic evaluation are follow-up research work.

    T A B L E 4 Performance of SRAFE method ablation experiments

    F I G U R E 9 Calligraphy copy examples of ‘Ming’ evaluated by the SRAFE method

    F I G U R E 1 0 SRAFE prediction results on the test set of E3C

    6 | CONCLUSION AND FUTURE WORK

    To build a connection between Chinese calligraphy and computational aesthetic evaluation, which is a challenging work, we proposed a Siamese aesthetic fusion framework for calligraphy(SRAFE).The novelty of SRAFE is to design some handcrafted features from the perspective of calligraphy aesthetics,combined with the deep features learnt from the SRN.The 12 hand-crafted features are more consistent with the human aesthetics of calligraphy, contributing to model interpretation.Meanwhile, the deep features reflect the deep aesthetic gap from calligraphic templates, improve the performance and generalisation of the model.What's more,in the future, dataset E3C will be public for the research on calligraphy evaluation.

    Currently, our SRAFE method can achieve good evaluation performance in regular script, while Chinese calligraphy contains many fonts such as running script and cursive script with quite different appearances.For the E3C dataset, the current calligraphy images mainly come from the copying homework of primary school students, which are mainly regular calligraphy images and lack of calligraphy images of other fonts.To address this limitation, we will include more calligraphic copies of seal character, official script and running script in our E3C dataset which is the research basis for aesthetic evaluation of other fonts.For our SRAFE method, different fonts may have different aesthetic prior knowledge and unique aesthetic characteristics, which may limit the evaluation performance of the SRAFE for other fonts.Therefore, it is necessary to design more targeted artificial aesthetic features for aesthetic evaluation.Besides,we will extend more deep hidden aesthetic features and split strokes based on deep learning for further evaluation, and research on how to make SRAFE better assist the aesthetic evaluation task on different fonts.Moreover, we will perform a more in-depth study on quantitative aesthetic evaluation in Chinese calligraphy.

    CONFLICT OF INTEREST

    The authors declare that they have no conflict of interest.

    DATA AVAILABILITY STATEMENT

    Data available on request due to privacy/ethical restrictions.

    ORCID

    Mingwei Sunhttps://orcid.org/0000-0001-6196-9833

    Bin Xiehttps://orcid.org/0000-0003-2135-0694

    亚洲欧美清纯卡通| 亚洲高清免费不卡视频| 亚洲av中文av极速乱| 永久网站在线| 免费av不卡在线播放| 免费观看av网站的网址| 精品国产一区二区三区久久久樱花 | 国产男人的电影天堂91| 国产精品一区二区性色av| 欧美日韩亚洲高清精品| 亚洲精品久久午夜乱码| 精品一区在线观看国产| 99久久中文字幕三级久久日本| 国产亚洲5aaaaa淫片| 你懂的网址亚洲精品在线观看| 欧美激情在线99| 国产在视频线精品| 日韩亚洲欧美综合| 亚洲欧美日韩卡通动漫| 久久久久久久大尺度免费视频| 亚洲aⅴ乱码一区二区在线播放| 日韩大片免费观看网站| av播播在线观看一区| 国产精品一区二区在线观看99| 国产免费又黄又爽又色| 亚洲图色成人| 国产精品一二三区在线看| 丰满少妇做爰视频| 色视频在线一区二区三区| 美女xxoo啪啪120秒动态图| 中文精品一卡2卡3卡4更新| 日韩大片免费观看网站| 精品久久久久久久久亚洲| 1000部很黄的大片| 天天躁夜夜躁狠狠久久av| 亚洲自拍偷在线| 男女国产视频网站| 中文乱码字字幕精品一区二区三区| videos熟女内射| 成人免费观看视频高清| 久久久久久伊人网av| 最近中文字幕高清免费大全6| 秋霞在线观看毛片| 久久久久久久久久成人| 日本与韩国留学比较| 亚洲精品国产成人久久av| 亚洲国产精品成人久久小说| 久久精品熟女亚洲av麻豆精品| 天堂中文最新版在线下载 | 丝袜美腿在线中文| 国产一级毛片在线| 看十八女毛片水多多多| 久久久久久伊人网av| 国产成人a∨麻豆精品| 国产一级毛片在线| 波野结衣二区三区在线| 久久久久久伊人网av| 成人无遮挡网站| 中文字幕亚洲精品专区| 黄色日韩在线| 国产精品av视频在线免费观看| 亚洲色图综合在线观看| 国内精品宾馆在线| 久久久久久久久久久丰满| 亚洲精华国产精华液的使用体验| 久久久久久久久久人人人人人人| 我的女老师完整版在线观看| 亚洲国产色片| 日韩电影二区| 婷婷色麻豆天堂久久| 欧美少妇被猛烈插入视频| 久久久久精品性色| 久久久精品免费免费高清| 永久网站在线| 久久ye,这里只有精品| 一级黄片播放器| 少妇的逼水好多| 男女边摸边吃奶| 97在线视频观看| 国产精品99久久99久久久不卡 | 舔av片在线| 午夜激情福利司机影院| 99re6热这里在线精品视频| 亚洲精品,欧美精品| 日韩强制内射视频| 久久久久久久国产电影| 熟女电影av网| 夫妻午夜视频| 99热6这里只有精品| 看黄色毛片网站| 亚洲av中文av极速乱| 日韩av免费高清视频| 日韩成人av中文字幕在线观看| av卡一久久| 色5月婷婷丁香| 成人免费观看视频高清| 男人舔奶头视频| 国产一区二区三区av在线| 国产成人精品婷婷| 性色avwww在线观看| 免费看av在线观看网站| 国产日韩欧美亚洲二区| 看黄色毛片网站| 1000部很黄的大片| 日韩伦理黄色片| 国产亚洲91精品色在线| 国模一区二区三区四区视频| 91精品国产九色| 大又大粗又爽又黄少妇毛片口| 特级一级黄色大片| 亚洲国产日韩一区二区| 精品酒店卫生间| 日本黄大片高清| 国产免费一级a男人的天堂| 亚洲精品自拍成人| 亚洲精品,欧美精品| 亚州av有码| 欧美国产精品一级二级三级 | 赤兔流量卡办理| 91狼人影院| 你懂的网址亚洲精品在线观看| av在线蜜桃| 又大又黄又爽视频免费| 日本猛色少妇xxxxx猛交久久| 色婷婷久久久亚洲欧美| 国产av国产精品国产| 久久精品久久久久久久性| 久久精品国产亚洲av涩爱| 免费播放大片免费观看视频在线观看| 在线 av 中文字幕| a级一级毛片免费在线观看| 老司机影院毛片| 日韩大片免费观看网站| 三级国产精品片| 欧美人与善性xxx| 精品国产乱码久久久久久小说| 亚洲国产精品成人综合色| av黄色大香蕉| 午夜福利在线在线| 欧美成人一区二区免费高清观看| 赤兔流量卡办理| 91aial.com中文字幕在线观看| 久久97久久精品| 伊人久久国产一区二区| 在线看a的网站| 激情五月婷婷亚洲| 韩国高清视频一区二区三区| 黄色日韩在线| 成人特级av手机在线观看| 天堂俺去俺来也www色官网| 日韩一区二区视频免费看| 久久99蜜桃精品久久| 久久6这里有精品| 亚洲av在线观看美女高潮| 肉色欧美久久久久久久蜜桃 | 人人妻人人爽人人添夜夜欢视频 | h日本视频在线播放| 一本色道久久久久久精品综合| 国产淫片久久久久久久久| 日本色播在线视频| xxx大片免费视频| 熟女人妻精品中文字幕| 国产精品一区二区三区四区免费观看| 国产精品秋霞免费鲁丝片| 春色校园在线视频观看| 欧美+日韩+精品| 亚洲欧美成人综合另类久久久| 99久国产av精品国产电影| 国产在线男女| 国产精品秋霞免费鲁丝片| 在线 av 中文字幕| 麻豆成人av视频| 亚洲伊人久久精品综合| 99热全是精品| 夜夜看夜夜爽夜夜摸| 亚洲自拍偷在线| freevideosex欧美| 亚洲欧美精品专区久久| 我的老师免费观看完整版| 91久久精品电影网| 国产精品成人在线| 国产精品国产三级国产av玫瑰| 久久综合国产亚洲精品| 国产精品久久久久久av不卡| 黄色视频在线播放观看不卡| 亚洲人成网站在线播| 国产探花在线观看一区二区| 久久久久久久久久人人人人人人| 亚洲激情五月婷婷啪啪| 日韩中字成人| 国产精品精品国产色婷婷| 久久久久九九精品影院| 亚洲精品中文字幕在线视频 | 亚洲精品成人久久久久久| 色哟哟·www| 亚洲欧美中文字幕日韩二区| 欧美人与善性xxx| 成人国产av品久久久| 欧美97在线视频| 久久这里有精品视频免费| 制服丝袜香蕉在线| 国产真实伦视频高清在线观看| 综合色丁香网| 如何舔出高潮| 欧美变态另类bdsm刘玥| 亚洲经典国产精华液单| 久久久久久九九精品二区国产| 亚洲自拍偷在线| 欧美少妇被猛烈插入视频| 18禁在线无遮挡免费观看视频| 亚洲欧美日韩另类电影网站 | 大香蕉97超碰在线| 亚洲成人一二三区av| av专区在线播放| 国产精品久久久久久久电影| 日韩中字成人| 国产精品精品国产色婷婷| 狂野欧美白嫩少妇大欣赏| 欧美激情国产日韩精品一区| 国产国拍精品亚洲av在线观看| 超碰97精品在线观看| 99视频精品全部免费 在线| 精品一区在线观看国产| 黄色欧美视频在线观看| 少妇人妻久久综合中文| 韩国av在线不卡| 亚洲成色77777| 丰满乱子伦码专区| 国产日韩欧美在线精品| 五月伊人婷婷丁香| 亚洲欧美日韩另类电影网站 | 亚洲av欧美aⅴ国产| 久久99热这里只频精品6学生| 观看免费一级毛片| 少妇人妻 视频| 少妇 在线观看| 亚洲经典国产精华液单| 精品少妇久久久久久888优播| 欧美一级a爱片免费观看看| 久久国产乱子免费精品| 国产精品熟女久久久久浪| 国产精品99久久久久久久久| 国产亚洲午夜精品一区二区久久 | 亚洲一级一片aⅴ在线观看| 少妇人妻久久综合中文| 99热全是精品| 身体一侧抽搐| 国产av国产精品国产| 久久这里有精品视频免费| 亚洲怡红院男人天堂| 国产乱来视频区| 九九在线视频观看精品| 在线观看免费高清a一片| 日韩电影二区| 少妇被粗大猛烈的视频| 久久久久网色| 在线a可以看的网站| 在线观看国产h片| 老师上课跳d突然被开到最大视频| 中文欧美无线码| 亚洲精品日本国产第一区| 黄色一级大片看看| 久久综合国产亚洲精品| 国产成人午夜福利电影在线观看| 亚洲欧美成人综合另类久久久| 秋霞在线观看毛片| 国产熟女欧美一区二区| 精品久久久久久久末码| 国产在线男女| 国产黄a三级三级三级人| 国产精品蜜桃在线观看| 亚洲激情五月婷婷啪啪| 高清欧美精品videossex| 久久久久国产网址| 国产亚洲最大av| 亚洲人成网站高清观看| 久久久成人免费电影| 韩国高清视频一区二区三区| 麻豆久久精品国产亚洲av| 一二三四中文在线观看免费高清| 人妻一区二区av| 国产男女内射视频| 国产一区有黄有色的免费视频| 26uuu在线亚洲综合色| 欧美xxxx性猛交bbbb| 国产黄片美女视频| 青青草视频在线视频观看| 国产色婷婷99| 99热国产这里只有精品6| 一级黄片播放器| 日本黄大片高清| 18禁在线无遮挡免费观看视频| 特级一级黄色大片| 国产精品女同一区二区软件| 国产午夜精品一二区理论片| 国产国拍精品亚洲av在线观看| 亚洲国产精品国产精品| av国产免费在线观看| 在线免费观看不下载黄p国产| 国产精品久久久久久久电影| 丰满少妇做爰视频| 久久久久久久久久人人人人人人| 性插视频无遮挡在线免费观看| 91狼人影院| 大片电影免费在线观看免费| 又黄又爽又刺激的免费视频.| 少妇人妻一区二区三区视频| 国产精品一二三区在线看| 22中文网久久字幕| 精品人妻熟女av久视频| 国内精品美女久久久久久| 美女内射精品一级片tv| 欧美+日韩+精品| 国产视频首页在线观看| 日韩电影二区| 久久久久久伊人网av| 国产v大片淫在线免费观看| 亚洲激情五月婷婷啪啪| 97精品久久久久久久久久精品| 欧美三级亚洲精品| 亚洲,一卡二卡三卡| 国产伦在线观看视频一区| 一级a做视频免费观看| 麻豆乱淫一区二区| 在线a可以看的网站| 久久韩国三级中文字幕| 国产黄片美女视频| 18禁在线无遮挡免费观看视频| 看免费成人av毛片| 一二三四中文在线观看免费高清| 伦理电影大哥的女人| 观看美女的网站| 97超碰精品成人国产| 日本猛色少妇xxxxx猛交久久| 免费黄频网站在线观看国产| 日韩不卡一区二区三区视频在线| 国产亚洲一区二区精品| 国产黄频视频在线观看| 天堂俺去俺来也www色官网| 亚洲精品亚洲一区二区| 97精品久久久久久久久久精品| 欧美精品一区二区大全| 丝袜脚勾引网站| 亚洲第一区二区三区不卡| 欧美日韩国产mv在线观看视频 | 99热国产这里只有精品6| 嘟嘟电影网在线观看| 国产午夜精品久久久久久一区二区三区| 国产高潮美女av| 久久久色成人| 国产爱豆传媒在线观看| 亚洲精品成人av观看孕妇| 交换朋友夫妻互换小说| 久久久久精品性色| 日韩av在线免费看完整版不卡| 中文乱码字字幕精品一区二区三区| 插逼视频在线观看| 春色校园在线视频观看| 精品国产露脸久久av麻豆| 成人无遮挡网站| 大陆偷拍与自拍| 偷拍熟女少妇极品色| a级一级毛片免费在线观看| 免费不卡的大黄色大毛片视频在线观看| 国产爽快片一区二区三区| 久久久午夜欧美精品| 丰满少妇做爰视频| 欧美最新免费一区二区三区| 久久6这里有精品| 国产毛片在线视频| 综合色av麻豆| 亚洲人成网站在线观看播放| 97在线视频观看| 黄色欧美视频在线观看| 五月玫瑰六月丁香| 亚洲av成人精品一区久久| 日韩不卡一区二区三区视频在线| 亚洲精品中文字幕在线视频 | 毛片一级片免费看久久久久| 色5月婷婷丁香| 激情五月婷婷亚洲| 赤兔流量卡办理| 亚洲精品色激情综合| 日日啪夜夜爽| 国产伦精品一区二区三区视频9| 日本黄色片子视频| 国产精品福利在线免费观看| 少妇熟女欧美另类| 日韩一本色道免费dvd| 少妇猛男粗大的猛烈进出视频 | 国产高清国产精品国产三级 | 亚洲丝袜综合中文字幕| 国产一区亚洲一区在线观看| 免费黄频网站在线观看国产| 最近最新中文字幕免费大全7| 日本三级黄在线观看| 国产精品秋霞免费鲁丝片| 精品亚洲乱码少妇综合久久| 一级毛片 在线播放| 又黄又爽又刺激的免费视频.| 亚洲精品色激情综合| 日韩视频在线欧美| 国产精品爽爽va在线观看网站| 熟女av电影| 色视频在线一区二区三区| 成人高潮视频无遮挡免费网站| 国产高清有码在线观看视频| 夫妻性生交免费视频一级片| 美女cb高潮喷水在线观看| 免费观看av网站的网址| 精品人妻熟女av久视频| 街头女战士在线观看网站| 国产精品久久久久久久久免| 久久99热这里只有精品18| 亚洲天堂国产精品一区在线| 久久久国产一区二区| 波多野结衣巨乳人妻| 欧美性猛交╳xxx乱大交人| 内射极品少妇av片p| 91在线精品国自产拍蜜月| 国产白丝娇喘喷水9色精品| 久久精品国产a三级三级三级| 久久99蜜桃精品久久| 欧美成人精品欧美一级黄| 看非洲黑人一级黄片| 国产91av在线免费观看| 日韩大片免费观看网站| 国产伦精品一区二区三区四那| 久久久久久久午夜电影| 在线精品无人区一区二区三 | 午夜精品国产一区二区电影 | 欧美日韩亚洲高清精品| 久久久久久伊人网av| 在线观看一区二区三区激情| 久久久久久国产a免费观看| 熟女av电影| 亚洲色图综合在线观看| 人体艺术视频欧美日本| 熟女人妻精品中文字幕| 欧美日韩视频精品一区| 日日啪夜夜爽| 有码 亚洲区| 亚洲欧美成人精品一区二区| 亚洲欧美日韩卡通动漫| 肉色欧美久久久久久久蜜桃 | 国产黄色免费在线视频| 免费黄色在线免费观看| 欧美亚洲 丝袜 人妻 在线| 又爽又黄无遮挡网站| 欧美日韩精品成人综合77777| 日韩一区二区三区影片| 国产亚洲5aaaaa淫片| 欧美日韩亚洲高清精品| av在线观看视频网站免费| 日本欧美国产在线视频| 久久久久久久久久人人人人人人| 国产一区亚洲一区在线观看| 久久精品国产a三级三级三级| 久久久午夜欧美精品| 91精品国产九色| 国内精品美女久久久久久| 好男人视频免费观看在线| 99re6热这里在线精品视频| 成人特级av手机在线观看| 亚洲图色成人| 亚洲熟女精品中文字幕| 在线看a的网站| 最后的刺客免费高清国语| 国产精品一区二区性色av| 99热全是精品| 亚洲欧美成人综合另类久久久| 又爽又黄a免费视频| 少妇的逼好多水| 久久亚洲国产成人精品v| 欧美激情在线99| 免费观看av网站的网址| 狂野欧美白嫩少妇大欣赏| 中文欧美无线码| 国产爽快片一区二区三区| 18禁裸乳无遮挡动漫免费视频 | 青春草亚洲视频在线观看| 看免费成人av毛片| 亚洲四区av| 亚洲一区二区三区欧美精品 | 亚洲av福利一区| 少妇的逼水好多| 精品少妇久久久久久888优播| 欧美日韩综合久久久久久| 国产片特级美女逼逼视频| av在线观看视频网站免费| 高清毛片免费看| 一级片'在线观看视频| 亚洲欧美成人精品一区二区| 欧美成人a在线观看| 纵有疾风起免费观看全集完整版| 久久精品久久久久久久性| 日韩制服骚丝袜av| 精品久久久久久久人妻蜜臀av| 亚洲色图综合在线观看| 三级国产精品欧美在线观看| 欧美3d第一页| 国产成人免费观看mmmm| 国产精品国产av在线观看| 国产免费视频播放在线视频| 成人毛片60女人毛片免费| 婷婷色av中文字幕| av免费在线看不卡| 国产精品不卡视频一区二区| av在线播放精品| 午夜福利在线观看免费完整高清在| 国产乱来视频区| 久久99热这里只有精品18| 日韩一区二区视频免费看| 亚洲,一卡二卡三卡| 在线看a的网站| 国产精品久久久久久精品古装| 国产成人免费观看mmmm| 91精品一卡2卡3卡4卡| 好男人视频免费观看在线| 日韩人妻高清精品专区| 欧美极品一区二区三区四区| 自拍欧美九色日韩亚洲蝌蚪91 | 免费人成在线观看视频色| 中国国产av一级| 99精国产麻豆久久婷婷| 久久久久性生活片| 国产精品一及| 久久亚洲国产成人精品v| 欧美日韩国产mv在线观看视频 | 欧美性猛交╳xxx乱大交人| 老司机影院毛片| 亚洲欧美日韩另类电影网站 | 亚洲国产欧美人成| 国产成人精品福利久久| av女优亚洲男人天堂| av免费观看日本| 成人综合一区亚洲| 久久久久久久精品精品| 午夜福利网站1000一区二区三区| 18禁动态无遮挡网站| 少妇的逼好多水| 国产成人精品福利久久| 国产美女午夜福利| 日本wwww免费看| 国产精品国产av在线观看| 欧美xxxx黑人xx丫x性爽| 午夜福利在线在线| 国产综合懂色| 黄色怎么调成土黄色| 午夜福利在线观看免费完整高清在| 超碰97精品在线观看| 大码成人一级视频| 国产欧美亚洲国产| 水蜜桃什么品种好| 日韩制服骚丝袜av| 尾随美女入室| 日韩免费高清中文字幕av| 91aial.com中文字幕在线观看| 国产成人精品一,二区| 久久久久久久精品精品| 国产高潮美女av| 欧美成人午夜免费资源| 亚洲精品国产成人久久av| 国产老妇女一区| 国产69精品久久久久777片| 五月玫瑰六月丁香| 大香蕉久久网| 一级黄片播放器| 色吧在线观看| 欧美+日韩+精品| 久久久久网色| 少妇人妻 视频| 亚洲精华国产精华液的使用体验| 亚洲欧美清纯卡通| 日韩欧美精品v在线| 大又大粗又爽又黄少妇毛片口| 亚洲国产精品成人综合色| 亚洲精品自拍成人| 最近最新中文字幕大全电影3| 日韩成人av中文字幕在线观看| 两个人的视频大全免费| 精品99又大又爽又粗少妇毛片| 男女边吃奶边做爰视频| 大陆偷拍与自拍| 亚洲成人一二三区av| 大片电影免费在线观看免费| 久久久久久久久久久免费av| 三级国产精品片| 国产精品人妻久久久影院| 99久久九九国产精品国产免费| 国产中年淑女户外野战色| 免费不卡的大黄色大毛片视频在线观看| 国产成人freesex在线| 国产成人aa在线观看| 亚洲综合色惰| 亚洲,欧美,日韩| 亚洲精品日本国产第一区| 草草在线视频免费看| 国产伦理片在线播放av一区| 在线 av 中文字幕| 日韩精品有码人妻一区| 亚洲人成网站在线观看播放| 午夜福利视频1000在线观看| 久久精品国产自在天天线| 18+在线观看网站| 日本一二三区视频观看| 久久精品国产自在天天线| 免费av观看视频| 毛片女人毛片| 少妇人妻 视频| 伦精品一区二区三区| 黄色视频在线播放观看不卡| 色吧在线观看| 精品酒店卫生间| 天堂俺去俺来也www色官网|