Ferenci, Tamás and Kotosz, Balázs: Using massively parallel processing in the testing of the robustness of statistical tests with Monte Carlo simulation. In: Proceedings of the Challenges for Analysis of the Economy, the Businesses, and Social Progress : International Scientific Conference Szeged, November 1921, 2009. pp. 13431366. (2010)

Cikk, tanulmány, mű
proceedings_of_the_challenges_for_analysis_13431366.pdf Download (318kB)  Preview 
Abstract
In this paper, we will examine the application of the Monte Carlo method in the testing of the robustness of statistical tests. The very computationintensive Monte Carlo testing was implemented using the socalled GPGPU method, which utilises the video cards’ GPU (Graphical Processing Unit) to perform the necessary calculations. The robustness of a statistical test is defined as its property to remain valid even if its assumptions are not met. (We call a test valid if its significance level is equal to its Type I Error Rate.) One way to investigate the robustness of a statistical test (especially useful if the test’s complicated structure makes analytic handling infeasible or impossible) is to employ the socalled Monte Carlo method. Here, we generate many random samples (meeting or violating the assumptions, which we can arbitrarily set), perform the statistical test many times on them, and then check whether the empirically found Type I Error Rate converges to the specified significance level or not. This way, we give up exactness for the complete insensitivity to the complexity of the examined statistical test. This method (by requiring enormous amount of random number generations and statistical testings for reliable results) is very computationintensive; traditionally only supercomputers could be used effectively, limiting the availability of this method. However a new approach, called GPGPU, makes it possible to harness the extremely high computing performance of – even ordinary, widely available – video cards found in every modern PC. We implemented a framework that performs the abovementioned MCtesting of the robustness of statistical tests. We call our program “framework”, because it can be easily expanded with virtually any statistical test (to which no GPGPU knowledge is needed), and be tested with very high performance – even with widely available tools. As an example, we performed the analysis of the well known Student’s ttest; and – using this as a starting point – we demonstrated the main advantages of our framework.
Item Type:  Article 

Journal or Publication Title:  Proceedings of the Challenges for Analysis of the Economy, the Businesses, and Social Progress : International Scientific Conference Szeged, November 1921, 2009 
Date:  2010 
ISBN:  9789630695589 
Page Range:  pp. 13431366 
Related URLs:  http://acta.bibl.uszeged.hu/57418/ 
Uncontrolled Keywords:  Statisztika  módszertan, Monte Carlo módszer 
Additional Information:  Bibliogr.: p. 13651366. ; összefoglalás angol nyelven 
Date Deposited:  2019. May. 15. 12:22 
Last Modified:  2020. Apr. 14. 14:45 
URI:  http://acta.bibl.uszeged.hu/id/eprint/57875 
Actions (login required)
View Item 