Using massively parallel processing in the testing of the robustness of statistical tests with Monte Carlo simulation

Ferenci, Tamás and Kotosz, Balázs: Using massively parallel processing in the testing of the robustness of statistical tests with Monte Carlo simulation. In: Proceedings of the Challenges for Analysis of the Economy, the Businesses, and Social Progress : International Scientific Conference Szeged, November 19-21, 2009. pp. 1343-1366. (2010)

[img]
Preview
Cikk, tanulmány, mű
proceedings_of_the_challenges_for_analysis_1343-1366.pdf

Download (318kB) | Preview

Abstract

In this paper, we will examine the application of the Monte Carlo method in the testing of the robustness of statistical tests. The very computation-intensive Monte Carlo testing was implemented using the so-called GP-GPU method, which utilises the video cards’ GPU (Graphical Processing Unit) to perform the necessary calculations. The robustness of a statistical test is defined as its property to remain valid even if its assumptions are not met. (We call a test valid if its significance level is equal to its Type I Error Rate.) One way to investigate the robustness of a statistical test (especially useful if the test’s complicated structure makes analytic handling infeasible or impossible) is to employ the so-called Monte Carlo method. Here, we generate many random samples (meeting or violating the assumptions, which we can arbitrarily set), perform the statistical test many times on them, and then check whether the empirically found Type I Error Rate converges to the specified significance level or not. This way, we give up exactness for the complete insensitivity to the complexity of the examined statistical test. This method (by requiring enormous amount of random number generations and statistical testings for reliable results) is very computation-intensive; traditionally only supercomputers could be used effectively, limiting the availability of this method. However a new approach, called GP-GPU, makes it possible to harness the extremely high computing performance of – even ordinary, widely available – video cards found in every modern PC. We implemented a framework that performs the abovementioned MC-testing of the robustness of statistical tests. We call our program “framework”, because it can be easily expanded with virtually any statistical test (to which no GP-GPU knowledge is needed), and be tested with very high performance – even with widely available tools. As an example, we performed the analysis of the well known Student’s t-test; and – using this as a starting point – we demonstrated the main advantages of our framework.

Item Type: Article
Journal or Publication Title: Proceedings of the Challenges for Analysis of the Economy, the Businesses, and Social Progress : International Scientific Conference Szeged, November 19-21, 2009
Date: 2010
ISBN: 978-963-06-9558-9
Page Range: pp. 1343-1366
Related URLs: http://acta.bibl.u-szeged.hu/57418/
Uncontrolled Keywords: Statisztika - módszertan, Monte Carlo módszer
Additional Information: Bibliogr.: p. 1365-1366. ; összefoglalás angol nyelven
Date Deposited: 2019. May. 15. 12:22
Last Modified: 2020. Apr. 14. 14:45
URI: http://acta.bibl.u-szeged.hu/id/eprint/57875

Actions (login required)

View Item View Item