Results tagged “chartbeat”
January 8, 2013
Last week, we announced the new beta release of ThinkUp (if you're a geek or developer, try it out!) and one of the reasons I was most excited to talk about the new release is because it has a whole new user experience which exemplifies a belief about analytics that I've become pretty adamant about.
Every time an app provides a dashboard full of charts and graphs, it should be replaced with a news feed offering a stream of insights instead.
There are lots and lots of apps that provide a dashboard of analytics these days. From Google Analytics to Chartbeat to Facebook's Insights tool, there are all kinds of dashboard displays that we end up staring at while trying to manage a presence online. And they all share a consistent problem: It's hard to tell what the hell is going on.
Beautiful but Empty
When I talk about "dashboards" here, I don't mean ones that are already a news feed or stream of posts, like Tumblr, but the old-fashioned kind where you see a bunch of meters and dials and line charts that are supposed to communicate the current status of whatever you're tracking. You can see Chartbeat's beautiful set of graphs and charts above, and Facebook's got a fancy one for insights on their platform; It looks like this:
And you know what? I have no idea whether my numbers on those services are good or not. I don't know what I'm supposed to do about them. In fact, though I love Chartbeat, the information that I get from them that means the most is their push notifications on my phone which tell me when my site is over its maximum monthly number of visitors. That is meaningful.
Insights like exceeding my usual level of visitors, or achieving some threshold I'd never crossed before, or doing some task particularly efficiently would be meaningful markers that I could respond to intelligently.
Worse, trying to make sense of a gauge on a dashboard essentially requires me to keep three bits of data in my mind:
- What metric or measure a particular meter is reporting
- The last time I looked at that meter
- What the value of the meter was the last time I looked at it
That's a lot! For more esoteric points, it's downright impossible, so I'm left squinting at a little chart, trying to deduce its meaning. Or, on the other extreme, I get something like the line chart that shows my number of Twitter followers. That line only ever goes up and to the right. Sometimes it goes up more than others, but even that's generally impossible to discern.
A Better Meter
We had precisely these issues with ThinkUp in version 1. Lots of little line graphs and pie charts that either rarely changed, or that changed regularly but with no explanation of the meaning of those changes or recommendations of what to do as a result.
And just getting to that stage was hard! The community put a ton of effort into collecting useful data, and presenting it appropriately. But all of that hard work still left an average user of the app squinting at some inscrutable charts, ultimately unsatisfied.
So we killed the whole dashboard. And replaced it with a simple stream. Here's a live example of the White House's social data, from a very early development version of ThinkUp 2.0. Now, not all of the data here are presented in a very compelling way yet, and of course we're still working to shed our old implementation of basic charts and graphs to move into a stream that does much more to coach you about what you should be doing online.
Take the idea of your follower count. ThinkUp used to offer a pretty standard inscrutable little line chart showing your number of followers going up over time. But now, there's a stream with a couple of items in it that look like this (these aren't the final UI, just a work in progress):
That offers a bit more analysis, showing a forward-looking extrapolation of when the @whitehouse account will reach a certain number of followers. If someone sees that as a useful goal, they now have much more info than they would have had from a chart showing their past history of growth.
Then we can break down that data even further and tease out the meaning by determining which of these followers are notable for being popular or discerning enough that they should be called out or paid attention to. That looks like this:
And this isn't to say that traditional charts or graphs don't have a place in communicating information in this stream. But what we've done is put them behind disclosure buttons (again these are just a first prototype of the UI for such a thing) and made it possible to reveal the details behind an item, whether that's a detailed chart or just a full list of people to pay attention to.
Similarly, you can see an expanded version of the "interesting new followers" insight in the ThinkUp demo for the White House as well.
Even with just a rough version of our new stream built out, I immediately realized that this was a fundamentally better way to quickly consume this analytics data and be able to make decisions or act on it. There were also many other benefits to radically simplifying the user interface — I only see data now when it changes in a significant way, so I don't have to go digging around a bunch of different screens trying to deduce if something has changed and whether the change is meaningful.
This has really quickly ruined me for every other stats app that I use. Chartbeat is awesome for being real-time, but it'd be so much more compelling if it were a real-time stream or Twitter-style feed of information about how my site and my content's doing, with the ability to drill down into individual insights about my site. Google Analytics has always been totally inscrutable to me, but if it just bubbled up particularly meaningful tidbits about my site or its stats I can imagine being able to actually make educated decisions about what I do here. As it stands, I haven't had any reason to go into Google Analytics in ages.
So, a big but sincere request to everybody who's making analytics or stats apps, either standalone or as part of a larger app: Please throw away the dashboard. I know they demo well and look great in investor pitch decks or screencast videos. But they don't actually help me make decisions, or get better at what I'm doing. And that's the only reason I'm measuring something in the first place.
If you liked this (or hated it), you should also read Stop Publishing Web Pages, about the move from static web pages to streams that are part of app-style experiences. It's in the same vein.
February 13, 2010
- As I write this, the Twittersphere is going through its annual love/hate paroxysms about TED. Every year, the conference seems even more an event perfectly calibrated to inflame the bloggerati: Inarguably great presentations combined with unrepentantly exclusionary structure. A humanitarian aesthetic that shrouds a blatantly classist participation model. But what most vexes outsiders (including myself; I've never attended, though I've been invited to pay 2/3 the cost to attend one of their remote TV viewings of the event) is the sense of collective delusion that seems to overcome attendees, who fawn over even the least of the talks. It's sort of like Steve Jobs' famous Reality Distortion Field, but on more of a peer-to-peer basis. I like the idea of TED, and the people who run it, and the presentations it generates — but what's up with the groupthink?
- The New York Times reveals the teenage founder of random video chat phenomenon Chatroulette. Though the site's still new (and controversial) enough that Wikipedia's editors have thus-far decided it's not worthy of note, it's inarguably struck a chord, with a noticeably larger impact in media-fixated NYC than tech-focused San Francisco. Though the site can definitely be seen as creepy, people also seem mesmerized and intoxicated by the idea of connecting with strangers in such a visceral, immediate way.
- One of my favorite startups (naturally, part of our burgeoning NYC tech scene) is Chartbeat, which recently explained the crucial distinction that realtime analytics are not just faster analytics, they're a difference in kind from traditional static stats.
So what do these data points have in common? They're actually essentially about audience and shared experience. In the realtime web, we've focused a great deal on the latest noise. But as I said when I first wrote about the pushbutton web, what may matter most about realtime capaibilties is the user experience that's enabled. And the best use for realtime communications on the web is not to simply bring in the most recent information on a topic, but rather to make clear that others are experiencing or interacting with the same content at the same time.
There's Others Here With Us
Audiences matter. Being in an audience isn't simply about being at the same place at the same time. We act differently when we're in the presence of an audience. As audience members, we're more susceptible to being connected emotionally, expressing ourselves in uncharacteristically free ways, and forming lasting connections with the presenter, performer or content that we're experiencing.
Shy people start to sing along at concerts. Tea Party meetups start with group prayers that encourage participation from people who might otherwise be uncomfortable talking politics with strangers. Ostensibly unbiased journalists applaud at Apple keynote presentations. We are transformed when we're part of a shared experience.
Just as importantly, performers are elevated by the presence of the audience. I do a fair bit of public speaking, and I have obsessively watched a lot of the best performers of the pop culture world for my entire life. In studying their work, especially for artists who are significantly different between the studio work they do on a recording versus the live performances they do on stage, you can see a remarkable elevation of expressiveness and personality when they're facing an audience.
I've even seen it with bloggers and writers; Though blogging was often described (not inaccurately) as "theater for introverts" in its early days, a lot of bloggers and writers have matured into formidable public speakers as well. The first time I saw Malcolm Gladwell speak, almost seven years ago, he was an awkward and quiet presence, the very picture of an introverted writer. By just two years later, when he keynoted SXSW in support of the publication of Blink, he was effortlessly charming and spellbinding. Sure, he'd had a lot of practice. But it was clearly the interaction and attention of the audience that were drawing him out and raising his game.
When I create on the web today, I'm still completely isolated from the sense of having an audience. I have a couple of different (largely inaccurate or worthless) metrics about subscriber numbers, follower counts, or page views that I can look at to estimate the impact of something I've created. For a decade, though, I created posts on this blog with only a vague sense of people actually having a shared experience of reading these words. If I'm really lucky, a few friends might send me an instant message after publishing, and I'll know there was really someone on the other end of the line. Even long comment threads have the feel of the occasional straggler walking into a mostly-empty coffee shop for a few minutes: Cumulatively significant, but sparse and unpopulated at any particular moment.
That's a huge disconnect, and a huge opportunity. When I wrote my Facebook usernames post several months back, I had one of those rare moments where something I write resonates outside of the core tech community, and I could watch links to or mentions of the post roll in from Twitter and Facebook, in realtime. That sense that (what would eventually become) hundreds of people were all on my site at the same time was gratifying and rewarding in a way that felt, for the first time, just like the satisfaction I get when I know I've killed it onstage with a good presentation.
And we've misunderstood that motivation online for a long time. We deride searches for mentions of one's own work as "ego searches", implying there should be some sort of shame in looking for responses to our creativity. Services from YouTube to Twitter make it effortless to see what you've favorited from other people, but nearly impossible to measure or monitor who's marked your work as one of their favorites. Even if you can see that data, it's in an asynchronous, disconnected manner, instead of making clear which of those people were responding at the same time. Chartbeat mitigates this somewhat for me as a creator, but that doesn't help you as a reader. MyBlogLog, as ungainly and awkward as it's always been in its short life, would show some avatars for site visitors when they were on the same page. People embed live chat windows on their site so that visitors can talk to each other. But the essential experience of being in an audience isn't actually of audience members talking to one another. And while I've certainly been at movies where an excited and responsive audience improved the experience, I've absolutely never wondered if I could see a list of everyone in the audience with me, sorted by the order in which they found their seats.
Today's rough approximations of the right experience still fundamentally deny us the opportunity to be part of an audience together when we see something we love. Sure, we've all sent a YouTube link to a friend over instant messenger so that it could be enjoyed simultaneously, perhaps even to someone in the same room. But we're never allowed to just "look around" and see who else is there at the same time. It's part of the reason that very, very few web experiences can grab us and truly move us the way that media like movies and songs and television do.
There's a big opportunity here. I'm a better writer, blogger and thinker when I know there's an audience. (If I could see your eyes glazing over, maybe I would have edited this into a shorter post!) It could be transformative to our experience as creators if we could actually have the feeling of a real audience when we're sharing our thoughts to the world, instead of the arbitrary counts that the people selling advertising on the web have been referring to as an "audience" all of these years.
Most importantly, those of us who've had our lives transformed by the web, or who have had emotional and meaningful experiences of common connection through the Internet could have a way of sharing those experiences with a far broader audience that's familiar with the traditional behavior of audiences. I can't wait to see what becomes the equivalent of a standing ovation.
Thanks to Martin Fisch for the image.