AI Chat Paper
Note: Please note that the following content is generated by AMiner AI. SciOpen does not take any responsibility related to this content.
{{lang === 'zh_CN' ? '文章概述' : 'Summary'}}
{{lang === 'en_US' ? '中' : 'Eng'}}
Chat more with AI
PDF (5.5 MB)
Collect
Submit Manuscript AI Chat Paper
Show Outline
Outline
Show full outline
Hide outline
Outline
Show full outline
Hide outline
Open Access

Exploring Bill Similarity with Attention Mechanism for Enhanced Legislative Prediction

School of Mathematics and Information Sciences, Yantai University, Yantai 264005, China
School of Literature and Journalism, Yantai University, Yantai 264005, China
School of Computer Science and Technology, East China Normal University, Shanghai 200062, China
Show Author Information

Abstract

Common legislative prediction methods often emphasize bill content or social relationships. This paper, motivated by the insight that similar policy texts reflect comparable political ideologies and can lead to similar voting outcomes, proposes a deep learning method that exploits attention mechanisms to incorporate semantic similarity between bills into legislative prediction models. Our approach uses attention scores to identify bills that are most similar to the one being predicted, and combines the encoded features of these similar bills as additional auxiliary information. By integrating these related features, the model goes beyond the semantic information of individual bills, leading to a more comprehensive use of roll-call data. Empirical results show that utilizing bill similarity along with traditional social relationships, voter characteristics, and bill content significantly improves performance in terms of accuracy, recall, precision, and F1 score compared to models that ignore bill similarity. The results also confirm that legislators tend to maintain consistent views or voting patterns on bills that are similar in nature. In addition, we demonstrate that the attention mechanism is more effective than conventional similarity measures, such as cosine similarity and Euclidean distance, in capturing the similarities between bills.

References

[1]
S. M. Gerrish and D. M. Blei, Predicting legislative roll calls from text, in Proc. 28th International Conference on Machine Learning, Madison, WI, USA, 2011, pp. 489–496.
[2]
S. M. Gerrish and D. M. Blei, How they vote: Issue adjusted models of legislative behavior, in Proc. 25th International Conference on Neural Information Processing Systems, New York, NY, USA, 1969, pp. 2753–2761.
[3]

S. Jackman, Multidimensional analysis of roll-call data via Bayesian simulation: Identification, estimation, inference, and model checking, Political Analysis, vol. 9, no. 3, pp. 227–241, 2001.

[4]
C. Xiong, J. Callan, and T. Liu, Word-entity duet representations for document ranking, in Proc. 40th International ACM SIGIR Conference on Research and Development in Information Retrieval, New York, NY, USA, 2017, pp. 763–772.
[5]

K. Miler, Legislative responsiveness to constituency change, Am. Polit. Res., vol. 44, no. 5, pp. 816–843, 2016.

[6]

B. Lee, M. Pomirchy, and B. Schonfeld, Does the U.S. Congress respond to public opinion on trade, Am. Polit. Res., vol. 51, no. 6, pp. 731–748, 2023.

[7]

C. Ainsley, C. J. Carrubba, B. F. Crisp, B. Demirkaya, M. J. Gabel, and D. Hadzic, Roll-call vote selection: Implications for the study of legislative politics, Am. Polit. Sci. Rev., vol. 114, no. 3, pp. 691–706, 2020.

[8]

J. J. Nay, Predicting and understanding law-making with word vectors and an ensemble model, PLoS One, vol. 12, no. 5, p. e0176999, 2017.

[9]
K. T. Poole and H. Rosenthal, A spatial model for legislative roll call analysis, Am. J. Polit. Sci., vol. 29, no. 2, p. 357, 1985.
[10]

J. Clinton, S. Jackman, and D. Rivers, The statistical analysis of roll-call data, American Journal of Political Science, vol. 98, no. 2, pp. 355–370, 2004.

[11]
H. Kitschelt, K. A. Hawkins, J. P. Luna, G. Rosas, and E. J. Zechmeister, Latin American Party Systems. Cambridge, UK: Cambridge University Press, 2010.
[12]

S. Wojcik, Do birds of a feather vote together, or is it peer influence, Polit. Res. Q., vol. 71, no. 1, pp. 75–87, 2018.

[13]

M. Laver, K. Benoit, and J. Garry, Extracting policy positions from political texts using words as data, Am. Pol. Sci. Rev., vol. 97, no. 2, pp. 311–331, 2003.

[14]
H. Karimi, T. Derr, A. Brookhouse, and J. Tang, Multi-factor congressional vote prediction, in Proc. 2019 IEEE/ACM Int. Conf. Advances in Social Networks Analysis and Mining, Vancouver, Canada, 2019, pp. 266–273.
[15]

R. M. Entman, Framing: Toward clarification of a fractured paradigm, J. Commun., vol. 43, no. 4, pp. 51–58, 1993.

[16]
J. Wang, K. R. Varshney, and A. Mojsilović, Legislative prediction via random walks over a heterogeneous graph, in Proc. 2012 SIAM Int. Conf. Data Mining, Vancouver, Canada, 2012, pp. 1095–1106.
[17]

A. Born and A. Janssen, Does a district mandate matter for the behavior of politicians? An analysis of roll-call votes and parliamentary speeches, Eur. J. Polit. Econ., vol. 71, p. 102070, 2022.

[18]
J. Devlin, M. W. Chang, K. Lee, and K. Toutanova, BERT: Pre-training of deep bidirectional transformers for language understanding, in Proc. 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Minneapolis, MN, USA, 2019, pp. 4171–4186.
[19]

J. H. Kim, G. A. Barnett, and K. H. Kwon, The influence of social networks on the U.S. senate roll-call voting, Int. J. E Polit., vol. 1, no. 4, pp. 22–41, 2010.

[20]
X. Mou, Z. Wei, L. Chen, S. Ning, Y. He, C. Jiang, and X. Huang, Align voting behavior with public statements for legislator representation learning, in Proc. 59th Annual Meeting of the Association for Computational Linguistics and the 11th Int. Joint Conf. Natural Language Processing (Volume 1: Long Papers), Online, 2021, pp. 1236–1246.
[21]
Y. Yang, X. Lin, G. Lin, Z. Huang, C. Jiang, and Z. Wei, Joint representation learning of legislator and legislation for roll call prediction, in Proc. 29th Int. Joint Conf. Artificial Intelligence, Yokohama, Japan, 2020, pp. 1424–1430.
[22]

J. H. Fowler, Connecting the congress: A study of cosponsorship networks, Polit. Anal., vol. 14, no. 4, pp. 456–487, 2006.

[23]

J. H. Fowler, Legislative cosponsorship networks in the US house and senate, Soc. Netw., vol. 28, no. 4, pp. 454–465, 2006.

[24]

A. J. Clarke, Party sub-brands and American party factions, Am. J. Polit. Sci., vol. 64, no. 3, pp. 452–470, 2020.

[25]

J. M. Snyder and T. Groseclose, Estimating party influence in congressional roll-call voting, Am. J. Polit. Sci., vol. 44, no. 2, pp. 193–211, 2000.

[26]
M. A. Porter, P. J. Mucha, M. E. J. Newman, and C. M. Warmbrand, A network analysis of committees in the U.S. house of representatives, Proc. Natl. Acad. Sci. U.S.A., vol. 102, no. 20, pp. 7057–7062, 2005.
[27]

P. Clerici, Committee collaboration, competing principals, and partisanship in Argentina, The Journal of Legislative Studies, vol. 31, no. 1, pp. 248–269, 2023.

[28]

E. Salazar, D. B. Dunson, and L. Carin, Analysis of space–time relational data with application to legislative voting, Comput. Stat. Data Anal., vol. 68, pp. 141–154, 2013.

[29]

D. Cherepnalkoski, A. Karpf, I. Mozetič, and M. Grčar, Cohesion and coalition formation in the European parliament: Roll-call votes and twitter activities, PLoS One, vol. 11, no. 11, p. e0166586, 2016.

[30]

D. Schoch and U. Brandes, Legislators’ roll-call voting behavior increasingly corresponds to intervals in the political spectrum, Sci. Rep., vol. 10, no. 1, p. 17369, 2020.

[31]

G. Koger, S. Masket, and H. Noel, Cooperative party factions in American politics, Am. Polit. Res., vol. 38, no. 1, pp. 33–53, 2010.

[32]

M. Fischer, F. Varone, R. Gava, and P. Sciarini, How MPs ties to interest groups matter for legislative co-sponsorship, Soc. Netw., vol. 57, pp. 34–42, 2019.

[33]
T. Yano, N. A. Smith, and J. D. Wilkerson, Textual predictors of bill survival in congressional committees, in Proc. 2012 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Montreal, Canada, 2012, pp. 793–802.
[34]
T. Derr and J. Tang, Congressional vote analysis using signed networks, in Proc. IEEE Int. Conf. Data Mining Workshops (ICDMW), Singapore, 2018, pp. 1501–1502.
[35]
J. W. Korn and M. A. Newman, A deep learning model to predict congressional roll-call votes from legislative texts, Machine Learning and Applications: An International Journal, vol. 7, nos. 3&4, pp. 15–27, 2020.
[36]

Z. Khashman and A. Khashman, Anticipation of political party voting using artificial intelligence, Procedia Comput. Sci., vol. 102, pp. 611–616, 2016.

[37]
Z. Niu, G. Zhong, and H. Yu, A review on the attention mechanism of deep learning, Neurocomputing, vol. 452, pp. 48–62, 2021.
[38]
A. Vaswani, N. Shazeer, N. Parmar, J. Uszkoreit, L. Jones, A. N. Gomez, L. Kaiser, and I. Polosukhin, Attention is all you need, in Proc. 31st International Conference on Neural Information Processing Systems, Long Beach, CA, USA, 2017, pp. 6000–6010.
[39]

S. Sengupta and V. Dave, Predicting applicable law sections from judicial case reports using legislative text analysis with machine learning, J. Comput. Soc. Sci., vol. 5, no. 1, pp. 503–516, 2022.

[40]

H. Mentzingen, N. António, F. Bacao, and M. Cunha, Textual similarity for legal precedents discovery: Assessing the performance of machine learning techniques in an administrative court, Int. J. Inf. Manag. Data Insights, vol. 4, no. 2, p. 100247, 2024.

Journal of Social Computing
Pages 112-125
Cite this article:
Wang B, Li Y, Xu C. Exploring Bill Similarity with Attention Mechanism for Enhanced Legislative Prediction. Journal of Social Computing, 2025, 6(2): 112-125. https://doi.org/10.23919/JSC.2025.0005

55

Views

9

Downloads

0

Crossref

0

Scopus

Altmetrics

Received: 14 December 2024
Revised: 01 April 2025
Accepted: 04 April 2025
Published: 30 June 2025
© The author(s) 2025.

The articles published in this open access journal are distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/).

Return