{"id":31085,"date":"2016-08-06T14:00:54","date_gmt":"2016-08-06T19:00:54","guid":{"rendered":"http:\/\/blogs.ams.org\/mathgradblog\/?p=31085"},"modified":"2016-08-11T12:56:08","modified_gmt":"2016-08-11T17:56:08","slug":"false-positive-vs-false-negative","status":"publish","type":"post","link":"https:\/\/blogs.ams.org\/mathgradblog\/2016\/08\/06\/false-positive-vs-false-negative\/","title":{"rendered":"False Positive vs. False Negative"},"content":{"rendered":"<p><em>A guest post by Long Nguyen:<\/em><\/p>\n<p>Not all results of medical tests are absolutely correct. Scientists can make mistakes when they conclude that something is true when it is actually false or that something is false when it is actually true. <a href=\"http:\/\/blogs.ams.org\/mathgradblog\/files\/2016\/05\/False-Positive2.jpg\" rel=\"attachment wp-att-28926\"><img loading=\"lazy\" decoding=\"async\" class=\"alignright size-medium wp-image-28926\" src=\"http:\/\/blogs.ams.org\/mathgradblog\/files\/2016\/05\/False-Positive2-284x300.jpg\" alt=\"False-Positive2\" width=\"284\" height=\"300\" srcset=\"https:\/\/blogs.ams.org\/mathgradblog\/files\/2016\/05\/False-Positive2-284x300.jpg 284w, https:\/\/blogs.ams.org\/mathgradblog\/files\/2016\/05\/False-Positive2.jpg 494w\" sizes=\"auto, (max-width: 284px) 100vw, 284px\" \/><\/a>When something is concluded true and it is actually false, we have a <strong>false positive <\/strong>or type I error. On the other hand, when something is false and it is actually true, we have a <strong>false negative<\/strong> or type II error.<\/p>\n<p>Should we really be worried about a positive medical test for a rare disease?<\/p>\n<p>Mammography is one way to detect breast cancer at its early stage, which helps patients to increase their survival<a href=\"http:\/\/blogs.ams.org\/mathgradblog\/files\/2016\/05\/BN-HB837_HJourn_F_20150223124818.jpg\" rel=\"attachment wp-att-28928\"><img loading=\"lazy\" decoding=\"async\" class=\"alignleft size-medium wp-image-28928\" src=\"http:\/\/blogs.ams.org\/mathgradblog\/files\/2016\/05\/BN-HB837_HJourn_F_20150223124818-300x119.jpg\" alt=\"BN-HB837_HJourn_F_20150223124818\" width=\"300\" height=\"119\" srcset=\"https:\/\/blogs.ams.org\/mathgradblog\/files\/2016\/05\/BN-HB837_HJourn_F_20150223124818-300x119.jpg 300w, https:\/\/blogs.ams.org\/mathgradblog\/files\/2016\/05\/BN-HB837_HJourn_F_20150223124818.jpg 571w\" sizes=\"auto, (max-width: 300px) 100vw, 300px\" \/><\/a> rates. In 2009, John Allen Paulos, a mathematics professor at Temple University, wrote an article, <a href=\"http:\/\/www.nytimes.com\/2009\/12\/13\/magazine\/13Fob-wwln-t.html?_r=1\"><em>Manmogram Math<\/em><\/a>, to discuss how frequent women should have their mammograms. If mammograms could help diagnose breast cancer, why wouldn\u2019t we have them more frequently? According to Paulos, it is controversial whether women should have mammograms monthly since the tests could cause harmful effects resulting from radiation. Also, suppose you have a positive test, is this absolutely true that you have cancer? The answer is no.<!--more--><\/p>\n<p>So how worried should you be if you have a positive test of a rare disease? In other words, how accurate is the test? Lisa Goldberg, a statistics professor at UC Berkeley, briefly explained how we should approach this problem on a Numberphile\u2019s video,\u00a0<a href=\"https:\/\/www.youtube.com\/watch?v=M8xlOm2wPAA\">Are you REALLY sick? (false positives)<\/a>. Goldberg discussed some possible outcomes that the tests can bring to us, which is summarized in the table below:<\/p>\n<p><a href=\"http:\/\/blogs.ams.org\/mathgradblog\/files\/2016\/05\/Screen-Shot-2016-05-13-at-1.05.24-PM.png\" rel=\"attachment wp-att-28929\"><img loading=\"lazy\" decoding=\"async\" class=\"aligncenter size-medium wp-image-28929\" src=\"http:\/\/blogs.ams.org\/mathgradblog\/files\/2016\/05\/Screen-Shot-2016-05-13-at-1.05.24-PM-300x139.png\" alt=\"Screen Shot 2016-05-13 at 1.05.24 PM\" width=\"300\" height=\"139\" srcset=\"https:\/\/blogs.ams.org\/mathgradblog\/files\/2016\/05\/Screen-Shot-2016-05-13-at-1.05.24-PM-300x139.png 300w, https:\/\/blogs.ams.org\/mathgradblog\/files\/2016\/05\/Screen-Shot-2016-05-13-at-1.05.24-PM.png 592w\" sizes=\"auto, (max-width: 300px) 100vw, 300px\" \/><\/a>As we can see, there are two ways a test can fail to identify \u2018real\u2019 sick people. First, the test turns out negative while the test subject is really sick. In this case, it is a false negative. Second, the test can be positive while the test subject is really healthy, which is a false positive. Thus, it is important to measure the accuracy of the test when you receive positive test. In order to do that, we can find the probability of the sickness given a positive result, P(Sickness\/Positive Result). Apply Bayes\u2019 rule to this problem, we have:<\/p>\n<p><img decoding=\"async\" src=\"https:\/\/s0.wp.com\/latex.php?latex=P%28%5Ctext%7BSickness%7D%5Cmid%5Ctext%7BPositive+Result%7D%29+%3D+%5Cdfrac%7BP%28%5Ctext%7BPositive+Result%7D%5Cmid%5Ctext%7BSickness%7D%29%5Ccdot+P%28%5Ctext%7BSickness%7D%29%7D%7BP%28%5Ctext%7BPositive+Result%7D%29%7D&#038;bg=ffffff&#038;fg=000&#038;s=0&#038;c=20201002\" alt=\"P(&#92;text{Sickness}&#92;mid&#92;text{Positive Result}) = &#92;dfrac{P(&#92;text{Positive Result}&#92;mid&#92;text{Sickness})&#92;cdot P(&#92;text{Sickness})}{P(&#92;text{Positive Result})}\" class=\"latex\" \/><\/p>\n<p>and<\/p>\n<p><img decoding=\"async\" src=\"https:\/\/s0.wp.com\/latex.php?latex=%5Cbegin%7Baligned%7DP%28%5Ctext%7BPositive+Result%7D%29+%3D+%26P%28%5Ctext%7BPositive+Result%7D%5Cmid%5Ctext%7BSickness%7D%29%5Ccdot+P%28%5Ctext%7BSickness%7D%29%5C%5C+%26%2B+P%28%5Ctext%7BPositive+Result%7D%5Cmid+%5Ctext%7BHealthy%7D%29%5Ccdot+P%28%5Ctext%7BHealthy%7D%29%5Cend%7Baligned%7D&#038;bg=ffffff&#038;fg=000&#038;s=0&#038;c=20201002\" alt=\"&#92;begin{aligned}P(&#92;text{Positive Result}) = &amp;P(&#92;text{Positive Result}&#92;mid&#92;text{Sickness})&#92;cdot P(&#92;text{Sickness})&#92;&#92; &amp;+ P(&#92;text{Positive Result}&#92;mid &#92;text{Healthy})&#92;cdot P(&#92;text{Healthy})&#92;end{aligned}\" class=\"latex\" \/><\/p>\n<p>Suppose we have a rare disease which happens in 1 out of 1000 people; the test is 99% accurate to tell real sick people and the test misdiagnoses 1 out of 10 healthy people as sick. According to our assumption,<\/p>\n<p><img decoding=\"async\" src=\"https:\/\/s0.wp.com\/latex.php?latex=P%28%5Ctext%7BPositive+Result%7D%5Cmid+%5Ctext%7BSickness%7D%29+%3D+0.99%3B&#038;bg=ffffff&#038;fg=000&#038;s=0&#038;c=20201002\" alt=\"P(&#92;text{Positive Result}&#92;mid &#92;text{Sickness}) = 0.99;\" class=\"latex\" \/><\/p>\n<p><img decoding=\"async\" src=\"https:\/\/s0.wp.com\/latex.php?latex=P%28%5Ctext%7BSickness%7D%29+%3D+%5Ctext%7B1%7D%7B1000%7D+%3D+0.001%3B&#038;bg=ffffff&#038;fg=000&#038;s=0&#038;c=20201002\" alt=\"P(&#92;text{Sickness}) = &#92;text{1}{1000} = 0.001;\" class=\"latex\" \/><\/p>\n<p><img decoding=\"async\" src=\"https:\/\/s0.wp.com\/latex.php?latex=P%28%5Ctext%7BPositive+Result%7D%5Cmid%5Ctext%7BHealthy%7D%29+%3D+%5Cdfrac%7B1%7D%7B10%7D+%3D+0.1%3B&#038;bg=ffffff&#038;fg=000&#038;s=0&#038;c=20201002\" alt=\"P(&#92;text{Positive Result}&#92;mid&#92;text{Healthy}) = &#92;dfrac{1}{10} = 0.1;\" class=\"latex\" \/><\/p>\n<p><img decoding=\"async\" src=\"https:\/\/s0.wp.com\/latex.php?latex=P%28%5Ctext%7BHealthy%7D%29+%3D+1-%5Cdfrac%7B1%7D%7B1000%7D+%3D+0.999.&#038;bg=ffffff&#038;fg=000&#038;s=0&#038;c=20201002\" alt=\"P(&#92;text{Healthy}) = 1-&#92;dfrac{1}{1000} = 0.999.\" class=\"latex\" \/><\/p>\n<p>As a result,<\/p>\n<p><img decoding=\"async\" src=\"https:\/\/s0.wp.com\/latex.php?latex=P%28%5Ctext%7BPositive+Result%7D%29+%3D+%280.99%29%280.001%29+%2B+%280.1%29%280.999%29+%5Capprox+0.1&#038;bg=ffffff&#038;fg=000&#038;s=0&#038;c=20201002\" alt=\"P(&#92;text{Positive Result}) = (0.99)(0.001) + (0.1)(0.999) &#92;approx 0.1\" class=\"latex\" \/><\/p>\n<p>Thus,<\/p>\n<p><img decoding=\"async\" src=\"https:\/\/s0.wp.com\/latex.php?latex=P%28%5Ctext%7BSickness%7D%5Cmid%5Ctext%7BPositive+Result%7D%29+%3D+%5Cdfrac%7B%280.99%29%280.001%29%7D%7B0.1%7D+%5Capprox+0.01.&#038;bg=ffffff&#038;fg=000&#038;s=0&#038;c=20201002\" alt=\"P(&#92;text{Sickness}&#92;mid&#92;text{Positive Result}) = &#92;dfrac{(0.99)(0.001)}{0.1} &#92;approx 0.01.\" class=\"latex\" \/><\/p>\n<p>Given the rare disease and a\u00a0test that can mostly identify all sick people and give 1 false positive in every 10 test subjects, your chance of having the disease is 0.01, or 1 out of 100. So it is always a good idea to consult second opinion.<a href=\"http:\/\/blogs.ams.org\/mathgradblog\/files\/2016\/05\/expired-and-defective-pregnancy-tests-lead-to-a-false-test-result.jpg\" rel=\"attachment wp-att-28927\"><img loading=\"lazy\" decoding=\"async\" class=\"alignright size-medium wp-image-28927\" src=\"http:\/\/blogs.ams.org\/mathgradblog\/files\/2016\/05\/expired-and-defective-pregnancy-tests-lead-to-a-false-test-result-244x300.jpg\" alt=\"expired-and-defective-pregnancy-tests-lead-to-a-false-test-result\" width=\"244\" height=\"300\" srcset=\"https:\/\/blogs.ams.org\/mathgradblog\/files\/2016\/05\/expired-and-defective-pregnancy-tests-lead-to-a-false-test-result-244x300.jpg 244w, https:\/\/blogs.ams.org\/mathgradblog\/files\/2016\/05\/expired-and-defective-pregnancy-tests-lead-to-a-false-test-result.jpg 405w\" sizes=\"auto, (max-width: 244px) 100vw, 244px\" \/><\/a><\/p>\n<p>All medical tests can be resulted in false positive and false negative errors. Since medical tests can\u2019t be absolutely true, false positive and false negative are two problems we have to deal with. A false positive can lead to unnecessary treatment and a false negative can lead to a false diagnostic, which is very serious since a disease has been ignored. However, we can minimize the errors by collecting more information, considering other variables, adjusting the sensitivity (true positive rate) and specificity (true negative rate) of the test, or conducting the test multiple times. Even so,\u00a0it is still hard since reducing one type of error means increasing the other type of error. Sometimes, one type of error is more preferable than the other one, so scientists will have to evaluate the consequences of the errors and make a\u00a0decision.<\/p>\n<p>References:<br \/>\n[1] Paulos, J. A. (2009, December 10). Mammogram Math [Web]. Retrieved from\u00a0<a href=\"http:\/\/www.nytimes.com\/2009\/12\/13\/magazine\/13Fob-wwln-t.html?_r=2\">http:\/\/www.nytimes.com\/2009\/12\/13\/magazine\/13Fob-wwln-t.html?_r=2<\/a><br \/>\n[2] Haran, B. [Numberphile]. (2016, March 16). <em>Are you REALLY sick? (false positives)<\/em> [Video file]. Retrieved from\u00a0<a href=\"https:\/\/www.youtube.com\/watch?v=M8xlOm2wPAA\">https:\/\/www.youtube.com\/watch?v=M8xlOm2wPAA<br \/>\n<\/a>[3] kingscollegelondon. (2013, November 25). &#8216;<em>There&#8217;s A Math For That&#8217;-The Paradox Of The False Positive <\/em>[Video file]. Retrieved from\u00a0<a href=\"https:\/\/www.youtube.com\/watch?v=6WuTNMleuQI\">https:\/\/www.youtube.com\/watch?v=6WuTNMleuQI<br \/>\n<\/a>[4] Fernandez, E. (2011, October 17). High Rate of False-Positives with Annual Mammograms [Web]. Retrieved from\u00a0<a href=\"https:\/\/www.ucsf.edu\/news\/2011\/10\/10778\/high-rate-false-positives-annual-mammogram\">https:\/\/www.ucsf.edu\/news\/2011\/10\/10778\/high-rate-false-positives-annual-mammogram<br \/>\n<\/a>[5] MEDCRAMvideos. (2014, March 16). <em>Sensitivity and Specificity Explained Clearly<\/em>\u00a0[Video file]. Retrieved from\u00a0<a href=\"https:\/\/www.youtube.com\/watch?v=Z5TtopYX1Gc\">https:\/\/www.youtube.com\/watch?v=Z5TtopYX1Gc<br \/>\n<\/a>[6] Diagnostic Accuracy. (n.d.). Retrieved from\u00a0<a href=\"http:\/\/ebp.uga.edu\/courses\/Chapter%204%20-%20Diagnosis%20I\/4%20-%20Sensitivity%20and%20specificity.html\">http:\/\/ebp.uga.edu\/courses\/Chapter%204%20-%20Diagnosis%20I\/4%20-%20Sensitivity%20and%20specificity.html<\/a><br \/>\nImages:<br \/>\n<a href=\"http:\/\/onlinemixingmaster.com\/additive-or-subtractive-eq\/\">http:\/\/onlinemixingmaster.com\/additive-or-subtractive-eq\/<\/a><br \/>\n<a href=\"https:\/\/si.wsj.net\/public\/resources\/images\/BN-HB837_HJourn_F_20150223124818.jpg\">https:\/\/si.wsj.net\/public\/resources\/images\/BN-HB837_HJourn_F_20150223124818.jpg<br \/>\n<\/a><a href=\"http:\/\/pregnancytips.org\/wp-content\/uploads\/2014\/07\/expired-and-defective-pregnancy-tests-lead-to-a-false-test-result.jpg\">http:\/\/pregnancytips.org\/wp-content\/uploads\/2014\/07\/expired-and-defective-pregnancy-tests-lead-to-a-false-test-result.jpg<\/a><\/p>\n<div style=\"margin-top: 0px; margin-bottom: 0px;\" class=\"sharethis-inline-share-buttons\" ><\/div>","protected":false},"excerpt":{"rendered":"<p>A guest post by Long Nguyen: Not all results of medical tests are absolutely correct. Scientists can make mistakes when they conclude that something is true when it is actually false or that something is false when it is actually &hellip; <a href=\"https:\/\/blogs.ams.org\/mathgradblog\/2016\/08\/06\/false-positive-vs-false-negative\/\">Continue reading <span class=\"meta-nav\">&rarr;<\/span><\/a><\/p>\n<div style=\"margin-top: 0px; margin-bottom: 0px;\" class=\"sharethis-inline-share-buttons\" data-url=https:\/\/blogs.ams.org\/mathgradblog\/2016\/08\/06\/false-positive-vs-false-negative\/><\/div>\n","protected":false},"author":70,"featured_media":0,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"jetpack_post_was_ever_published":false,"_jetpack_newsletter_access":"","_jetpack_dont_email_post_to_subs":false,"_jetpack_newsletter_tier_id":0,"_jetpack_memberships_contains_paywalled_content":false,"_jetpack_memberships_contains_paid_content":false,"footnotes":""},"categories":[15,19],"tags":[241,96,240],"class_list":["post-31085","post","type-post","status-publish","format-standard","hentry","category-mathematics-in-society","category-statistics","tag-errors","tag-statistics-2","tag-testing"],"jetpack_featured_media_url":"","jetpack_shortlink":"https:\/\/wp.me\/p3gbww-85n","jetpack_sharing_enabled":true,"_links":{"self":[{"href":"https:\/\/blogs.ams.org\/mathgradblog\/wp-json\/wp\/v2\/posts\/31085","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/blogs.ams.org\/mathgradblog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/blogs.ams.org\/mathgradblog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/blogs.ams.org\/mathgradblog\/wp-json\/wp\/v2\/users\/70"}],"replies":[{"embeddable":true,"href":"https:\/\/blogs.ams.org\/mathgradblog\/wp-json\/wp\/v2\/comments?post=31085"}],"version-history":[{"count":16,"href":"https:\/\/blogs.ams.org\/mathgradblog\/wp-json\/wp\/v2\/posts\/31085\/revisions"}],"predecessor-version":[{"id":31113,"href":"https:\/\/blogs.ams.org\/mathgradblog\/wp-json\/wp\/v2\/posts\/31085\/revisions\/31113"}],"wp:attachment":[{"href":"https:\/\/blogs.ams.org\/mathgradblog\/wp-json\/wp\/v2\/media?parent=31085"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/blogs.ams.org\/mathgradblog\/wp-json\/wp\/v2\/categories?post=31085"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/blogs.ams.org\/mathgradblog\/wp-json\/wp\/v2\/tags?post=31085"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}