{"id":773,"date":"2014-08-21T08:30:53","date_gmt":"2014-08-21T13:30:53","guid":{"rendered":"http:\/\/blogs.ams.org\/blogonmathblogs\/?p=773"},"modified":"2014-08-20T23:40:15","modified_gmt":"2014-08-21T04:40:15","slug":"regression-twitter-and-ferguson","status":"publish","type":"post","link":"https:\/\/blogs.ams.org\/blogonmathblogs\/2014\/08\/21\/regression-twitter-and-ferguson\/","title":{"rendered":"Regression, Twitter, and #Ferguson"},"content":{"rendered":"
\"Emma<\/a>

Emma Pierson’s analysis of hashtags that have appeared in tweets about Ferguson, Missouri. Click for more information on her website. Image: Emma Pierson.<\/p><\/div>\n

Like many people, I have been following news about the events in Ferguson, Missouri with shock and sorrow for almost two weeks. I have been following these events as a human, not as a mathematician. But there’s a mathematical side to this story, too. I’m not just talking about the statistics on\u00a0how many people are killed by the police each year (which we don\u2019t even know<\/a> for sure) and the racial composition of the Ferguson police force versus the people they stop and arrest<\/a>, although those are both important. I\u2019m talking about Twitter. It\u2019s been a crucial part<\/a> of how the Ferguson story has become international news, but\u00a0it\u2019s also a useful source of data about\u00a0how people are responding to the tragedy.<\/p>\n

Emma Pierson is a computational biologist currently working for 23andMe, and her blog, Obsession with Regression<\/a>, focuses on data analysis, often with Twitter’s data. She writes,<\/p>\n

“I am very excited about Twitter because it combines two qualities.<\/p>\n

“1. People actually use it. Famous people — it\u2019s become standard for celebrities to say \u201cFollow me on Twitter!\u201d — and more importantly, lots of people.<\/p>\n

“2. It makes massive amounts of data available in a way you can process with a computer. 500,000,000 tweets<\/a> are sent every day and Twitter will give you up to 1% of those. And if I know what <\/i>1% I want — for example, only Tweets containing the word \u201cSpock\u201d — it will give me all <\/i>of them, which means I can actually hear everything <\/i>that\u2019s being said on a topic by millions of people worldwide. And not just what\u2019s being said, but who\u2019s saying it — how they describe themselves, where they live, who their friends are, and the last few thousand things they said.”<\/p><\/blockquote>\n

She has been blogging\u00a0about Twitter data since December 2013, when 23andMe was ordered to stop providing disease risk information to their customers. She wrote a post<\/a> about who was reacting to the news on Twitter and how they felt about it. Of course, being an employee of the company represents an obvious potential source of bias, so she also included a link<\/a> to the tweets she analyzed so others could study them. She\u2019s done several other interesting data analyses as well. Earlier this summer, she wrote an interesting analysis of tweets about LeBron James\u2019 most recent career move<\/a>, and of personal interest to me is her post about gender in the symphony<\/a>. (Her analysis seems to match my experience. In my four years in the orchestra in college, I think we only had two men in the viola section.)<\/p>\n

On Tuesday, Pierson wrote a post<\/a> about using Twitter to study people\u2019s reactions to current events, focusing on Ferguson. She mined a few hundred thousand tweets about Ferguson and analyzed the diferent hashtags that appeared in tweets with #Ferguson. (Part of the visualization<\/a> she made is at the top of this post.) She also put her mineTweets<\/a> program up on Github so others can use it to collect tweets about any topic in real time. She has some ideas for further analysis, particularly about whether the day\/night-peace\/violence pattern is apparent in tweets, and she’s invited others to contribute either ideas or analyses of their own.<\/p>\n

The events in Ferguson have also highlighted the difference between the way Twitter and Facebook work. I\u2019m not the only one whose Twitter feed has been saturated with #Ferguson, while Facebook has been nearly silent on the topic. In a Medium<\/a> article, Zeynep Tufekci explains how Facebook\u2019s algorithm for deciding what to show us caused this discrepancy and wonders what would have happened to Ferguson without Twitter. \u201cIt\u2019s a clear example why net neutrality is a human rights issue; a free speech issue; and an issue of the voiceless being heard, on their own terms,\u201d she writes. \u201cAlgorithms have consequences.\u201d<\/p>\n

<\/div>","protected":false},"excerpt":{"rendered":"

Like many people, I have been following news about the events in Ferguson, Missouri with shock and sorrow for almost two weeks. I have been following these events as a human, not as a mathematician. But there’s a mathematical side … Continue reading →<\/span><\/a><\/p>\n

<\/div>\n","protected":false},"author":61,"featured_media":774,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_jetpack_memberships_contains_paid_content":false,"footnotes":""},"categories":[35,58,28],"tags":[228,270,269,271,276,275,272,274,273,277],"class_list":["post-773","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-events","category-mathematics-and-computing","category-statistics","tag-algorithms","tag-big-data","tag-current-events","tag-data-analysis","tag-emma-pierson","tag-facebook","tag-ferguson","tag-social-media","tag-twitter","tag-zeynep-tufekci"],"jetpack_featured_media_url":"https:\/\/i0.wp.com\/blogs.ams.org\/blogonmathblogs\/files\/2014\/08\/ferguson-tweets.jpg?fit=732%2C506&ssl=1","jetpack_shortlink":"https:\/\/wp.me\/p3tW3N-ct","jetpack_sharing_enabled":true,"_links":{"self":[{"href":"https:\/\/blogs.ams.org\/blogonmathblogs\/wp-json\/wp\/v2\/posts\/773","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/blogs.ams.org\/blogonmathblogs\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/blogs.ams.org\/blogonmathblogs\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/blogs.ams.org\/blogonmathblogs\/wp-json\/wp\/v2\/users\/61"}],"replies":[{"embeddable":true,"href":"https:\/\/blogs.ams.org\/blogonmathblogs\/wp-json\/wp\/v2\/comments?post=773"}],"version-history":[{"count":7,"href":"https:\/\/blogs.ams.org\/blogonmathblogs\/wp-json\/wp\/v2\/posts\/773\/revisions"}],"predecessor-version":[{"id":781,"href":"https:\/\/blogs.ams.org\/blogonmathblogs\/wp-json\/wp\/v2\/posts\/773\/revisions\/781"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/blogs.ams.org\/blogonmathblogs\/wp-json\/wp\/v2\/media\/774"}],"wp:attachment":[{"href":"https:\/\/blogs.ams.org\/blogonmathblogs\/wp-json\/wp\/v2\/media?parent=773"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/blogs.ams.org\/blogonmathblogs\/wp-json\/wp\/v2\/categories?post=773"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/blogs.ams.org\/blogonmathblogs\/wp-json\/wp\/v2\/tags?post=773"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}