AI Chat Paper
Note: Please note that the following content is generated by AMiner AI. SciOpen does not take any responsibility related to this content.
{{lang === 'zh_CN' ? '文章概述' : 'Summary'}}
{{lang === 'en_US' ? '中' : 'Eng'}}
Chat more with AI
Article Link
Collect
Submit Manuscript
Show Outline
Outline
Show full outline
Hide outline
Outline
Show full outline
Hide outline
Regular Paper

PLQ: An Efficient Approach to Processing Pattern-Based Log Queries

School of Computer Science, Fudan University, Shanghai 200082, China
Show Author Information

Abstract

As software systems grow more and more complex, extensive techniques have been proposed to analyze log data to obtain the insight of the system status. However, during log data analysis, tedious manual efforts are paid to search interesting or informative log patterns from a huge volume of log data, named pattern-based queries. Although existing log management tools and database management systems can also support pattern-based queries, they suffer from low efficiency. To deal with this problem, we propose a novel approach, named PLQ (Pattern-based Log Query). First, PLQ organizes logs into disjoint chunks and builds chunk-wise bitmap indexes for log types and attribute values. Then, based on bitmap indexes, PLQ finds candidate logs with a set of efficient bit-wise operations. Finally, PLQ fetches candidate logs and validates them according to the queried pattern. Extensive experiments are conducted on real-life datasets. According to experimental results, compared with existing log management systems, PLQ is more efficient in querying log patterns and has a higher pruning rate for filtering irrelevant logs. Moreover, in PLQ, since the ratio of the index size to the data size does not exceed 2.5% for log datasets of different sizes, PLQ has a high scalability.

Electronic Supplementary Material

Download File(s)
jcst-37-5-1239-Highlights.pdf (320 KB)

References

【1】
【1】
 
 
Journal of Computer Science and Technology
Pages 1239-1254

{{item.num}}

Comments on this article

Go to comment

< Back to all reports

Review Status: {{reviewData.commendedNum}} Commended , {{reviewData.revisionRequiredNum}} Revision Required , {{reviewData.notCommendedNum}} Not Commended Under Peer Review

Review Comment

Close
Close
Cite this article:
Chen J, Wang P, Qiao F, et al. PLQ: An Efficient Approach to Processing Pattern-Based Log Queries. Journal of Computer Science and Technology, 2022, 37(5): 1239-1254. https://doi.org/10.1007/s11390-020-0653-5

1135

Views

1

Crossref

1

Web of Science

1

Scopus

0

CSCD

Received: 21 May 2020
Accepted: 30 November 2020
Published: 30 September 2022
©Institute of Computing Technology, Chinese Academy of Sciences 2022