test blog

Liberating the Data Artist: Rethinking Creativity in Data Science

Posted by Rachel Schlotfeldt on Jul 10, 2015 3:50:12 PM

Can data ever be significant without interpretation? In a recent Atlantic article on the rise of the data artist, a stark distinction is drawn between data presentations and data art. Visualization projects like R. Luke Dubois' "A More Perfect Union" and David McCandless' various "Information is Beautiful" projects fall on the side of the latter, whereas projects such as "Rich Blocks Poor Blocks" might be considered "closer to the data". However what are the implications of seeing certain approaches to data analytics as artistic and others as more scientifically objective? The presence of the artist makes itself known in projects that explicitly use visuals to evoke sentiments in the individual, who surrounded in a modern sea of information, must grapple with the ways in which their identities and environments are being newly defined. But the process of cleaning data, selecting variables, and asking certain questions of a dataset could be defined as an artistic process as well, imbued with individual choices and altered by ideological conditioning.

Read More

Topics: Big Data

Political Generosity and Activism by State

Posted by Jasmine Wilkerson on Jul 2, 2015 11:56:34 AM

When we look at the total individual contributions to political committees by state, it is apparent that California, New York, and Texas take the lead. Given the fact that these states have the highest population, can we justify a claim that the residents are more generous when it comes to political contributions?

Read More

Topics: Big Data

Understanding Individual Political Contribution by Occupation of Top 1% vs Bottom 99%

Posted by Jasmine Wilkerson on Jun 30, 2015 4:10:41 PM

 

Read More

Topics: occupation, Politics, Big Data, data science

What are the key skills of a Data Scientist?

Posted by Raja Iqbal on Jul 9, 2014 3:24:48 PM

Truth be told, the industry does not have an agreed upon definition of a data scientist. Jokes such as “a data scientist is a data analyst living in the Silicon Valley” are abundant. Below is one such cartoon, just for fun.

Read More

Topics: Big Data, data science

Type I and Type II Error, Smoke Detector and the Boy Who Cried Wolf

Posted by Raja Iqbal on Oct 5, 2013 10:00:38 AM

[av_section min_height='' min_height_px='500px' padding='default' shadow='no-shadow' bottom_border='no-border-styling' scroll_down='' id='' color='main_color' custom_bg='' src='' attach='scroll' position='top left' repeat='no-repeat' video='' video_ratio='16:9' video_mobile_disabled='' overlay_enable='' overlay_opacity='0.5' overlay_color='' overlay_pattern='' overlay_custom_pattern='']

Read More

Topics: A/B Testing, Big Data

Big data talent war: 7 ways to win

Posted by Raja Iqbal on Apr 16, 2013 12:28:37 AM

53% of big data-focused companies say analytics experts will be tough to find for the next two years. Here’s how IT leaders plan to train, borrow, or steal talent–and what job seekers should know.

Read More

Topics: Careers, Careers in Data science

Predictive analytics adoption triples, says Accenture

Posted by Raja Iqbal on Apr 12, 2013 10:25:21 AM

Chief data officers are rising to the leadership of business analytics programmes in the UK and US more quickly than expected, according to an Accenture study that surveyed the field for the first time since 2009.

Read More

Topics: Predictive Analytics, Big Data

How-to: Resample from a large data set in parallel (with R on Hadoop)

Posted by Raja Iqbal on Apr 5, 2013 10:37:11 AM

Reposted from Cloudera blog.

Read More

Topics: R, Big Data, Hadoop

10 R packages I wish I knew about earlier

Posted by Raja Iqbal on Mar 31, 2013 10:51:11 AM

I started using R about 3 years ago. It was slow going at first. R had tricky and less intuitive syntax than languages I was used to, and it took a while to get accustomed to the nuances. It wasn’t immediately clear to me that the power of the language was bound up with the community and the diverse packages available.

Read More

Topics: R, Big Data

Big data could cripple Facebook

Posted by Raja Iqbal on Mar 31, 2013 10:46:21 AM

So there’s this startup called SmogFarm, which does big-data sentiment analysis, “pulse of the planet” stuff. I spotted them last year, and now they’ve got an actual product with an actual business model up and running in private beta:KredStreet, “The Social Stock Trader Rankings,” which performs sentiment analysis on StockTwits data and a sampling of the Twitter firehose to determine traders’ overall bullish/bearish feeling. They also compare reality against past sentiment to score and rank traders based on their accuracy, which is more interesting.

Read More

Topics: Facebook, Big Data