A Ranking Information Provision Technique for Activating Domestic and Foreign Technology Transfer

Hyojin Ko, Minji Kim, Okran Jeong

Abstract


Continuous development of information technology has allowed the use of vast information without time and space constraints. However, imbalance of information is a common problem arising from improper or lacking utilization of readily accessible information. Such phenomenon can pose a risk in trading technology, complicating smooth transaction for both domestic and foreign enterprises. This paper aims to propose a novel crawling technique of technology transfer, based on integration and analysis of domestic technology information. This novel crawling technique is more cost effective than an action-based web crawler technique, as the crawling is performed on the structure of a specific domain. An extractive summarization method is introduced to weigh and summarize pages according to their importance. This combats the limitations of simple summarization techniques in the application of new information and references in fast technology trading markets. A global crawler is developed to collect information from various domains, which then allowed development of a summarization model using TextRank. Information collection from various domains, summarization according to importance and establishing a prototype of an English technology transfer website not only enables the user to capture the trend of the latest technical information, but also promotes the activation of technology transactions of domestic and foreign companies.

 

Full Text:

PDF

References


French, R. M., “Using pseudo-recurrent connectionist networks to solve the problem of sequential learning,” Proceedings of the 19th Annual Cognitive Science Society Conference. Vol. 16, 1997.

Han, D.H. and Lee, Y.-K., “Design of action-based web crawler structural configuration for multi-website management,” KIISE Transactions on Computing Practices, Vol. 27, No. 2, pp. 98-103, 2021.

Kim, H., Cho, S., and Kang, P., “KR-WordRank an unsupervised korean word extraction method based on wordrank,” Journal of the Korean Institute of Industrial Engineers Vol. 40, No. 1, pp. 18-3, 2014.

Lee, D. and Kim, K., “Web site keyword selection method by considering semantic similarity based on word2vec,” The Journal of Society for e-Business Studies, Vol. 23, No. 2, pp. 83-96, 2018.

Lee, Y.-J. and Choi, H.J., “Joint learning-based KoBERT for emotion recognition in Korean,” Korea Advanced Institute of Science and Technology, pp. 568-570, 2020.

Lin, C.-Y., “Rouge: A package for automatic evaluation of summaries,” Text summarization branches out,” Text Summarization Branches Out, pp. 74-81, 2004.

Luong, M.-T., Le, Q. V., and Manning C.D., “Electra: Pre-training text encoders as discriminators rather than generators,” arXiv preprint arXiv:2003.10555, 2020.

Mihalcea, R. and Tarau, P., “Textrank: Bringing order into text,” Conference on empirical methods in natural language processing, pp. 404-411, 2004.

Na, C.-W. and On, A.-W., “A proposal on a proactive crawling approach with analysis of state-of-the-art web crawling algorithms,” Internet Comput. Serv., Vol. 20, No. 3, pp. 43-59, 2019.

Page, L., Brin, S., Motwani, R., “The PageRank Citation Ranking: Bringing Order to the Web., Technical Report. Stanford InfoLab, 1999.

Radford, A., Narasimhan, K., Salimans, T., and Sutskevet, I., “Improving language understanding by generative pre-training,” OpenAI, 2018

Ramos, J., “Using tf-idf to determine word relevance in document queries,” Proceedings of the first instructional conference on machine learning, Vol. 242, No. 1. 2003.

Richardson, L., “Beautiful soup documentation,” Dosegljivo: https://www.crummy.com/software/BeautifulSoup/bs4/doc/. [Dostopano: 7. 7. 2018], 2007.

Song, E.-S., Kim, M., Lee, Y.R., and Ahn H., “Transformer-based text summarization using pre-trained language model,” Korean Society of Computer Information, Vol. 29, No. 2, pp. 395-398, 2021.

Srinivasa-Desikan, B., “Natural language processing and computational linguistics: A practical guide to text analysis with Python, Gensim, spaCy, and Keras,” Packt Publishing Ltd, 2018.

Szűcs, G. and Huszti, D., “Seq2seq deep learning method for summary generation by LSTM with two-way encoder and beam search decoder,” IEEE 17th International Symposium on Intelligent Systems and Informatics (SISY), IEEE, 2019.

Tay, Y., Bahri, D., Metzler, D., and Juan, D. C., “Synthesizer: Rethinking self-attention for transformer models,” International conference on machine learning, pp. 10183-10192, PMLR, 2021.

Vaswani, A., Shazeer, N., and Parmar, N., “Attention is all you need,” Advances in neural information processing systems, Vol.30, 2017.

XBathija, R., Agarwal, P., Samanna, R., and Pallavi, G.B., “Guided interactive learning through chatbot using bi-directional encoder representations from transformers (bert),” 2nd International Conference on Innovative Mechanisms for Industry Applications (ICIMIA), IEEE, pp. 82-87, 2020.

Zheng, C., He, G., and Peng, Z., “A Study of Web Information Extraction Technology Based on Beautiful Soup,” J. Comput., Vol. 10, No. 6, pp. 381-387, 2015.


Refbacks

  • There are currently no refbacks.