WAA standards definitions and Dainow

I read Brandt Dainow argument about "The web analytics standard that failed us".

For some reason, it seems to be another rant against the Web Analytics Association, but that's another story and I don't want to know about it.

In this post, I'll give my opinion about:

  • Marketing and IT parallel universe
  • The value of the WAA
  • Consensus vs. authority
  • Algorithm and patents
I conclude with what I see in the field.

Marketing schmoozing vs engineering complexity?

In some respect, Dainow is right. The current WAA definitions is the result of "an amalgamation of various perspectives arrived at through a consensus" (from the WAA document) (i.e. avoid alienating any vendors). Just like the WAA site didn't have any web analytics tool for a long while in order to avoid political snafu with vendors. This is my opinion as a WAA member, based on informal discussion, and maybe I'm totally wrong here!

But beyond that, being myself from a technological background and a witness of the parallel universe separating marketing and IT, it's clear to me those definitions are written in marketing terms rather than engineering terminology. Obviously, Dainow would like to see the definitions written in a more engineering lingua franca. I thing that's the whole point of his argument.

Rather than throwing stones at it, Dainow should realize this document was published with the mention "For public comments". In a way, that's exactly what he is doing with his provocative style.

The value brought by the WAA

"The end goal is to have true metrics standards and uniform adoption of these standards throughout our industry". To get there, "the WAA established the Standards Committee to rationalize variations within the analytics community, and to create a standard terminology for the analytics community."

The point is right there: standard terminology. While Dainow aims to impose a technological standard which would need to be developed, supported and imposed by a standard organization, the WAA approach is to work with involved parties to develop a common terminology which, it hopes, will become a "de facto standard".

Consensus vs authority

We shouldn't forget the WAA is a volunteer organization. If I had to write "standards" as a job (i.e. be paid for it). I would certainly spend countless hours doing it and reaching out to vendors, signing strict NDAs, making friends with the engineers, etc. As volunteers, there's so much we can do. Just writing this post took me valuable time I could have spent invoicing my clients. In a troubled economy, we are looking closely at the time we spend doing "ancillary" stuff and how much those activities are bringing back in our own personal pockets. That's the sad reality!

The ISO is a standard body, and in order to claim ISO certification you need to abide by strict rules, undergo audits and pay to retain certification. On the other end, the IAB is a more open structure, much more similar to the WAA, that was able to define common terminology regarding online advertising and bring "standards, guidelines and best practices". Which one makes most sense? In my mind, the second option is the way to go!

Algorithm and patents

As a tutor of the UBC Award of Achievement in Web Analytics, I have had the chance to tutor to hundred of students. Do they really care about the engineering definition of a visit? Not really. They care about the way they will be able to communicate that information to managers and make them act on it.

My eBusiness MBA thesis will be a review of the literature available on the topic of web analytics. Simply put, literature about the concepts or use of specific products (especially Google Analytics) abound in the form of books and blogs. The rationale behind those is often a desire to stand out of the crowd and serve as bait for high income consulting services. However, scholarly literature with an engineering slant is almost non-existent. The reason might be simple: we're in the realm of privately owned algorithm and patents. For vendors, there is simply no interest in seeing what is perceived as a secret sauce revealed to the world.

Conclusion

Do we need an engineering definition of a page view, a visit, a visitor or a bounce (maybe especially bounce!)? Eventually, absolutely! But what we first need to achieve is a common communication language.

I think that's the true objective of the WAA Web Analytics Definitions document. And we're closer now than we were last year!

4 comments:

Daniel Waisberg said...

Thanks for the post Stephane, very clear and to the point.

I am not sure you mentioned one important point though: the importance of maintaining the document as specific as possible so that it will help Web Analysts to understand the concepts in a standard manner, but not too specific that it will be unpractical for any vendor to comply with.

Makes sense?
Thanks again.

Brandt said...

Daniel makes a good point, and if people were using the WAA document in the manner he describes, that would be fine. My article was driven by the feedback I get on my column which clearly showed people in marketing management are trying to use it as an engineering standard and criticising their analytics staff when they depart from it (as they must) in their calculations. Alternatively I get feedback from people reading reports using WAA definitions which, in their own words, make the reports meaningless. I was one of the founders of the WAA standards committee and left over this issue. I can assure you that there was no concept of Daniel's distinctions in our discussions.

Steve Jackson said...

Hi Stephane,

I think both you and Brandt make well argued points.

If we adopt an approach similar to that of the ISO or IETF then some things would have to happen.

As we know volunteers are currently running the WAA and have come to the current document via a consensus of leading consultants and vendors in the field. If Brandt for instance was willing to precisely define the 'big three' counts into technically precise terms as he described then I would applaud his decision and would throw my own weight behind such a document.

I would propose be that a parallel document be drawn up by Brandt (and anyone else in WAA standards or otherwise that he could persuade to help him) which defines the critical core metrics. In other words defining in precise technical terms what a visitor, visit and a page view (or event) actually is. This could then be audited by an external agency (open to discussion as to who).

The core of the standards are those three major counts but there is nothing to stop anyone going into much further depth.

I don't see why we can't come to a consensus eventually. The industry is after all still very young.

If Brandt or anyone else think the standards fail us, my challenge to them is to not simply waffle about it but actually fix it.

Regards,
Steve Jackson

Stephane Hamel at immeria.net said...

Daniel, Brandt & Steve: thanks for your participation in this thread.

Brandt: I agree a technical standard is required. I guess the issue is that most vendors still see those as proprietary and patented algorithms. Just trying to get additional info about the exact data being sent to them (for my WASP development) is a challenge!

Steve: You just convinced me! I asked to join the Standard committee of the WAA :)