Sort:
Open Access Research Article Online First
KDLLM: Copyright-Preserving LLM Based on Knowledge Distillation
Tsinghua Science and Technology
Published: 14 September 2026
Abstract PDF (2.1 MB) Collect
Downloads:159

Large language models (LLMs) have emerged as the cornerstone of various natural language processing activities, enabling everything from chatbots to text classification and summarization. However, using LLMs presents some significant challenges, most notably the threat of intellectual property infringement from the exposure of the entire model and the excessive communication and storage overhead associated with their large size. We propose KDLLM, a novel knowledge distillation-based framework for efficient and compact LLMs to address these challenges. KDLLM transfers the performance of a large teacher LLM to a significantly smaller student model with high performance similarity to its teacher, while obscuring architectural and parameter-level details to protect the intellectual property of the original model. The resulting student model substantially reduces the memory footprint and transmission overhead, making it amenable to deployment in bandwidth-constrained or security-sensitive environments. Comprehensive experiments demonstrate that KDLLM achieves robust performance preservation and boosts copyright protection and communication efficiency.

Open Access Research Article Online First
Secure Data Transmission and Intelligent Swarm Management for Inactive Satellites in WAICS Networks
Tsinghua Science and Technology
Published: 13 March 2026
Abstract PDF (4.1 MB) Collect
Downloads:166

The rapid growth in satellite numbers has exacerbated challenges posed by Inactive Satellites (IASs), which remain in orbit without security updates, leaving them vulnerable to exploitation. These vulnerabilities pose risks to information security and space network stability, necessitating continuous yet resource-efficient management. Given the limited resources of IAS, traditional methods are insufficient. This study proposes a protocol leveraging Proxy Re-Encryption (PRE) technology for secure data exchange between IAS and external devices. A resource-rich swarm Controller Node (SCN) manages intra-swarm communication and dynamically transitions roles to newly joining IAS with higher resources, enhancing scalability and network continuity. The design reduces communication distances, improves data exchange efficiency, and integrates Wireless Artificial Intelligent Computing Systems (WAICS) principles to optimize network topology. The SCN serves as an intermediary, re-encrypting data to ensure confidentiality and integrity without exposing sensitive information. Security analysis confirms resistance to Chosen-Plaintext Attacks (CPA) and Chosen-Ciphertext Attacks (CCA), ensuring data remains inaccessible to the SCN while fully decryptable by the intended recipient. Additionally, the protocol minimizes power consumption for resource-constrained IAS and ensures stable operation across orbital environments. By incorporating intelligent data processing, the proposed network enhances communication efficiency and resilience, addressing critical challenges in managing inactive satellites.

Open Access Issue
Lightweight Super-Resolution Model for Complete Model Copyright Protection
Tsinghua Science and Technology 2024, 29(4): 1194-1205
Published: 09 February 2024
Abstract PDF (8.6 MB) Collect
Downloads:366

Deep learning based techniques are broadly used in various applications, which exhibit superior performance compared to traditional methods. One of the mainstream topics in computer vision is the image super-resolution task. In recent deep learning neural networks, the number of parameters in each convolution layer has increased along with more layers and feature maps, resulting in better image super-resolution performance. In today’s era, numerous service providers offer super-resolution services to users, providing them with remarkable convenience. However, the availability of open-source super-resolution services exposes service providers to the risk of copyright infringement, as the complete model could be vulnerable to leakage. Therefore, safeguarding the copyright of the complete model is a non-trivial concern. To tackle this issue, this paper presents a lightweight model as a substitute for the original complete model in image super-resolution. This research has identified smaller networks that can deliver impressive performance, while protecting the original model’s copyright. Finally, comprehensive experiments are conducted on multiple datasets to demonstrate the superiority of the proposed approach in generating super-resolution images even using lightweight neural networks.

Open Access Issue
Few-Shot Graph Classification with Structural-Enhanced Contrastive Learning for Graph Data Copyright Protection
Tsinghua Science and Technology 2024, 29(2): 605-616
Published: 22 September 2023
Abstract PDF (7.7 MB) Collect
Downloads:160

Open-source licenses can promote the development of machine learning by allowing others to access, modify, and redistribute the training dataset. However, not all open-source licenses may be appropriate for data sharing, as some may not provide adequate protections for sensitive or personal information such as social network data. Additionally, some data may be subject to legal or regulatory restrictions that limit its sharing, regardless of the licensing model used. Hence, obtaining large amounts of labeled data can be difficult, time-consuming, or expensive in many real-world scenarios. Few-shot graph classification, as one application of meta-learning in supervised graph learning, aims to classify unseen graph types by only using a small amount of labeled data. However, the current graph neural network methods lack full usage of graph structures on molecular graphs and social network datasets. Since structural features are known to correlate with molecular properties in chemistry, structure information tends to be ignored with sufficient property information provided. Nevertheless, the common binary classification task of chemical compounds is unsuitable in the few-shot setting requiring novel labels. Hence, this paper focuses on the graph classification tasks of a social network, whose complex topology has an uncertain relationship with its nodes’ attributes. With two multi-class graph datasets with large node-attribute dimensions constructed to facilitate the research, we propose a novel learning framework that integrates both meta-learning and contrastive learning to enhance the utilization of graph topological information. Extensive experiments demonstrate the competitive performance of our framework respective to other state-of-the-art methods.

Open Access Issue
Link-Privacy Preserving Graph Embedding Data Publication with Adversarial Learning
Tsinghua Science and Technology 2022, 27(2): 244-256
Published: 29 September 2021
Abstract PDF (10.1 MB) Collect
Downloads:198

The inefficient utilization of ubiquitous graph data with combinatorial structures necessitates graph embedding methods, aiming at learning a continuous vector space for the graph, which is amenable to be adopted in traditional machine learning algorithms in favor of vector representations. Graph embedding methods build an important bridge between social network analysis and data analytics, as social networks naturally generate an unprecedented volume of graph data continuously. Publishing social network data not only brings benefit for public health, disaster response, commercial promotion, and many other applications, but also gives birth to threats that jeopardize each individual’s privacy and security. Unfortunately, most existing works in publishing social graph embedding data only focus on preserving social graph structure with less attention paid to the privacy issues inherited from social networks. To be specific, attackers can infer the presence of a sensitive relationship between two individuals by training a predictive model with the exposed social network embedding. In this paper, we propose a novel link-privacy preserved graph embedding framework using adversarial learning, which can reduce adversary’s prediction accuracy on sensitive links, while persevering sufficient non-sensitive information, such as graph topology and node attributes in graph embedding. Extensive experiments are conducted to evaluate the proposed framework using ground truth social network datasets.

Total 5