Classifying news stories with a constrained learning strategy to estimate the direction of a market index

• Type: Article in International Scientific Journal
• Date: 2012

Authors

Drury, B (Author) Other; Torgo, L (Author) FCUP; Almeida, JJ (Author) Other

Journal

Title: International Journal of Computer Science and Applications

Vol. 9

Pages: 1-22

ISSN: 0972-9038

Publisher: Taylor & Francis

Indexing

ISI Web of Knowledge

Scopus - 5 Citations

Other information

Authenticus ID: P-008-3CK

Abstract (EN): News can contain information which may provide an indication of the future direction of a share or stock market index. The possibility of predicting future stock market prices has attracted an increasing numbers of industry practitioners and academic researchers to this area of investigation. Popular approaches have relied upon either: models constructed from manually selected training or manually constructed dictionaries. A potential flaw of manually selecting data is that the effectiveness of the trained model is dependent upon the ability of the human annotator. An alternative approach is to manually align news stories with trends in a specific market. A negative story is inferred if it co-occurs with a market losing value where as positive story is associated with a rise. This approach may have its flaws because news stories may co-occur with market movements by chance and consequently may inhibit the construction of a robust classifier with data gathered by this method. This paper presents a strategy which combines a: rule classifier, alignment strategy and self-training to induce a robust model for classifying news stories. The proposed method is compared with several competing methodologies and is evaluated with: estimated F-Measure and estimated trading returns. In addition the paper provides an evaluation of classifying a news story with its: headline, description or story text with: Language Models and Naive Bayes. The results demonstrate a clear advantage for the proposed methodology when evaluated by estimated F-Measure. The proposed strategy also produces the highest trading returns. In addition the paper clearly demonstrates that a news story's headline provides the greatest assistance for classification. The models induced from headlines gained the highest estimated F-Measure and trading returns for each strategy with the exception of the alignment method which performed uniformly poorly. © Technomathematics Research Foundation.

Language: English

Type (Professor's evaluation): Scientific

No. of pages: 22