With the development of the social media and Internet, discovering latent information from massive information is becoming particularly relevant to improving user experience. Research efforts based on preferences and relationships between users have attracted more and more attention. Predictive problems, such as inferring friend relationship and co-author relationship between users have been explored. However, many such methods are based on analyzing either node features or the network structures separately, few have tried to tackle both of them at the same time. In this paper, in order to discover latent co-interests’ relationship, we not only consider users’ attributes but network information as well. In addition, we propose an Interest-based Factor Graph Model (I-FGM) to incorporate these factors. Experiments on two data sets (bookmarking and music network) demonstrate that this predictive method can achieve better results than the other three methods (ANN, NB, and SVM).