Open Access Issue
Multi-Scale Feature Fusion Model for Bridge Appearance Defect Detection
Big Data Mining and Analytics 2024, 7 (1): 1-11
Published: 25 December 2023
Abstract PDF (2.6 MB) Collect

Although the Faster Region-based Convolutional Neural Network (Faster R-CNN) model has obvious advantages in defect recognition, it still cannot overcome challenging problems, such as time-consuming, small targets, irregular shapes, and strong noise interference in bridge defect detection. To deal with these issues, this paper proposes a novel Multi-scale Feature Fusion (MFF) model for bridge appearance disease detection. First, the Faster R-CNN model adopts Region Of Interest (ROI) pooling, which omits the edge information of the target area, resulting in some missed detections and inaccuracies in both detecting and localizing bridge defects. Therefore, this paper proposes an MFF based on regional feature Aggregation (MFF-A), which reduces the missed detection rate of bridge defect detection and improves the positioning accuracy of the target area. Second, the Faster R-CNN model is insensitive to small targets, irregular shapes, and strong noises in bridge defect detection, which results in a long training time and low recognition accuracy. Accordingly, a novel Lightweight MFF (namely MFF-L)model for bridge appearance defect detection using a lightweight network EfficientNetV2 and a feature pyramid network is proposed, which fuses multi-scale features to shorten the training speed and improve recognition accuracy. Finally, the effectiveness of the proposed method is evaluated on the bridge disease dataset and public computational fluid dynamic dataset.

Open Access Issue
Incomplete Multi-View Clustering via Auto-Weighted Fusion in Partition Space
Tsinghua Science and Technology 2023, 28 (3): 595-611
Published: 13 December 2022
Abstract PDF (1.6 MB) Collect

As a class of effective methods for incomplete multi-view clustering, graph-based algorithms have recently drawn wide attention. However, most of them could use further improvement regarding the following aspects. First, in some graph-based models, all views are forced to share a common similarity graph regardless of the severe consistency degeneration due to incomplete views. Next, similarity graph construction and cluster analysis are sometimes performed separately. Finally, the contribution difference of individual views is not always carefully considered. To address these issues simultaneously, this paper proposes an incomplete multi-view clustering algorithm based on auto-weighted fusion in partition space. In our algorithm, the information of cluster structure is introduced into the process of similarity learning to construct a desirable similarity graph, information fusion is performed in partition space to alleviate the negative impact brought about by consistency degradation, and all views are adaptively weighted to reflect their different contributions to clustering tasks. Finally, all the subtasks are collaboratively optimized in a united framework to reach an overall optimal result. Experimental results show that the proposed method compares favorably with the state-of-the-art methods.

Open Access Issue
Fusing Syntactic Structure Information and Lexical Semantic Information for End-to-End Aspect-Based Sentiment Analysis
Tsinghua Science and Technology 2023, 28 (2): 230-243
Published: 29 September 2022
Abstract PDF (1 MB) Collect

The aspect-based sentiment analysis (ABSA) consists of two subtasks—aspect term extraction and aspect sentiment prediction. Most methods conduct the ABSA task by handling the subtasks in a pipeline manner, whereby problems in performance and real application emerge. In this study, we propose an end-to-end ABSA model, namely, SSi-LSi, which fuses the syntactic structure information and the lexical semantic information, to address the limitation that existing end-to-end methods do not fully exploit the text information. Through two network branches, the model extracts syntactic structure information and lexical semantic information, which integrates the part of speech, sememes, and context, respectively. Then, on the basis of an attention mechanism, the model further realizes the fusion of the syntactic structure information and the lexical semantic information to obtain higher quality ABSA results, in which way the text information is fully used. Subsequent experiments demonstrate that the SSi-LSi model has certain advantages in using different text information.

Open Access Issue
Exploiting More Associations Between Slots for Multi-Domain Dialog State Tracking
Big Data Mining and Analytics 2022, 5 (1): 41-52
Published: 27 December 2021
Abstract PDF (2.8 MB) Collect

Dialog State Tracking (DST) aims to extract the current state from the conversation and plays an important role in dialog systems. Existing methods usually predict the value of each slot independently and do not consider the correlations among slots, which will exacerbate the data sparsity problem because of the increased number of candidate values. In this paper, we propose a multi-domain DST model that integrates slot-relevant information. In particular, certain connections may exist among slots in different domains, and their corresponding values can be obtained through explicit or implicit reasoning. Therefore, we use the graph adjacency matrix to determine the correlation between slots, so that the slots can incorporate more slot-value transformer information. Experimental results show that our approach has performed well on the Multi-domain Wizard-Of-Oz (MultiWOZ) 2.0 and MultiWOZ2.1 datasets, demonstrating the effectiveness and necessity of incorporating slot-relevant information.

Open Access Issue
A Multitask Multiview Neural Network for End-to-End Aspect-Based Sentiment Analysis
Big Data Mining and Analytics 2021, 4 (3): 195-207
Published: 12 May 2021
Abstract PDF (613.7 KB) Collect

The aspect-based sentiment analysis (ABSA) consists of two subtasks'aspect term extraction and aspect sentiment prediction. Existing methods deal with both subtasks one by one in a pipeline manner, in which there lies some problems in performance and real application. This study investigates the end-to-end ABSA and proposes a novel multitask multiview network (MTMVN) architecture. Specifically, the architecture takes the unified ABSA as the main task with the two subtasks as auxiliary tasks. Meanwhile, the representation obtained from the branch network of the main task is regarded as the global view, whereas the representations of the two subtasks are considered two local views with different emphases. Through multitask learning, the main task can be facilitated by additional accurate aspect boundary information and sentiment polarity information. By enhancing the correlations between the views under the idea of multiview learning, the representation of the global view can be optimized to improve the overall performance of the model. The experimental results on three benchmark datasets show that the proposed method exceeds the existing pipeline methods and end-to-end methods, proving the superiority of our MTMVN architecture.

Open Access Issue
Multi-Attention Fusion Modeling for Sentiment Analysis of Educational Big Data
Big Data Mining and Analytics 2020, 3 (4): 311-319
Published: 16 November 2020
Abstract PDF (936.9 KB) Collect

As an important branch of natural language processing, sentiment analysis has received increasing attention. In teaching evaluation, sentiment analysis can help educators discover the true feelings of students about the course in a timely manner and adjust the teaching plan accurately and timely to improve the quality of education and teaching. Aiming at the inefficiency and heavy workload of college curriculum evaluation methods, a Multi-Attention Fusion Modeling (Multi-AFM) is proposed, which integrates global attention and local attention through gating unit control to generate a reasonable contextual representation and achieve improved classification results. Experimental results show that the Multi-AFM model performs better than the existing methods in the application of education and other fields.

Open Access Issue
Condition Recognition of High-Speed Train Bogie Based on Multi-View Kernel FCM
Big Data Mining and Analytics 2019, 2 (1): 1-11
Published: 15 October 2018
Abstract PDF (1.4 MB) Collect

Monitoring the operating status of a High-Speed Train (HST) at any moment is necessary to ensure its security. Multi-channel vibration signals are collected by sensors installed on bogies and beneficial information are extracted to determine the running condition. Based on multi-view clustering and considering different views of complementary information, this study proposes a Multi-view Kernel Fuzzy C-Means (MvKFCM) model for condition recognition of the HST bogie. First, fast Fourier transform coefficients of HST vibration signals of all channels are extracted. Then, the fuzzy classification coefficient of every channel is calculated after clustering to select the appropriate channels. Finally, the selected channels are used to cluster by MvKFCM and the conditions of HST are determined. Experimental results show that the selection is effective to maintain rich feature information and remove redundancy. Furthermore, the condition recognition rate of MvKFCM is higher than that of single-view and four other multiple-view clustering algorithms.

Open Access Issue
Multi-view Clustering: A Survey
Big Data Mining and Analytics 2018, 1 (2): 83-107
Published: 12 April 2018
Abstract PDF (2.4 MB) Collect

In the big data era, the data are generated from different sources or observed from different views. These data are referred to as multi-view data. Unleashing the power of knowledge in multi-view data is very important in big data mining and analysis. This calls for advanced techniques that consider the diversity of different views, while fusing these data. Multi-view Clustering (MvC) has attracted increasing attention in recent years by aiming to exploit complementary and consensus information across multiple views. This paper summarizes a large number of multi-view clustering algorithms, provides a taxonomy according to the mechanisms and principles involved, and classifies these algorithms into five categories, namely, co-training style algorithms, multi-kernel learning, multi-view graph clustering, multi-view subspace clustering, and multi-task multi-view clustering. Therein, multi-view graph clustering is further categorized as graph-based, network-based, and spectral-based methods. Multi-view subspace clustering is further divided into subspace learning-based, and non-negative matrix factorization-based methods. This paper does not only introduce the mechanisms for each category of methods, but also gives a few examples for how these techniques are used. In addition, it lists some publically available multi-view datasets. Overall, this paper serves as an introductory text and survey for multi-view clustering.

Total 8