|Authors||C. Ieva, A. Gotlieb, S. Kaci and N. Lazaar|
|Title||Discovering Program Topoi through Clustering|
|Project(s)||The Certus Centre (SFI)|
|Publication Type||Proceedings, non-refereed|
|Year of Publication||2018|
|Conference Name||Innovative Application of Artificial Intelligence|
|Keywords||clustering, lsa, pca, program comprehension, program understanding|
Understanding source code of large open-source software projects is very challenging when there is only little documentation. New developers face the task of classifying a huge number of files and functions without any help. This paper documents a novel approach to this problem, called FEAT, which automatically extracts topoi from source code by using hierarchical agglomerative clustering. Program topoi summarize the main capabilities of a software system by presenting to developers clustered lists of functions together with an index of their relevant words. The clustering method used in FEAT exploits a new hybrid distance which combines both textual and structural elements automatically extracted from source code and comments. The experimental evaluation of FEAT shows that this approach is suitable to understand open-source software projects of size approaching 2,000 functions and 150 files, which opens the door for its deployment in the open-source community.