Are you satisfied with your analytics training?

Lets assume that you’re in a third party analytics services/ consulting organization. I assume that your organization started with a core of like minded people with the relevant analytics credentials. And I would like to assume one of the following two things – that you’ve grown somewhat, or are planning to scale soon.

Source: The Cartoon Guide to Statistics (from Avinash Kaushik’s blog)

You must have hired or are planning to hire fresh talent. Recent undergrads and graduates. When you hire them, do you put them on a project on day 1? If not, do you train them? What is the nature of this training? The duration? What did you assume about their knowledge base when you started training them? Do you conduct the training internally using consultants’ time? Or, do you bring in trainers? What about the continuing education – understanding Digital in 2010, for instance?

Now, some more assumptions. You assumed that the quants have the knowledge or appreciation of strong technical and statistical principles behind analytic problems. You also assumed that the engineers are good programmers and problem solvers. And lastly, you assumed that the MBAs will be able to manage projects, learn enough technical stuff, support pre-sales and sales activities, etc. Somewhere, you also assumed that each of these groups will acquire the skill-sets of the other groups.

Pan the camera towards India analytics talent now. There are three distinct talent sources right now. Quants (Masters in Statistics/ Economics/ Computational Mathematics), Engineers/ Problem Solvers (just smart B.Techs), and Managers (MBAs). Think about the questions  for these three groups separately.

More questions now.

• Did you train them on a mix of SAS/R, Excel, Powerpoint, Access, SQL? Something about messaging, charts, dashboards?
• Did you spend 2-4+ weeks training these smart professionals?
• After you trained them, were you satisfied (completely) with where they are? Were they really ready to become independent analytics professionals?
• Did you question your training methods? Assuming, they are not delivering over and over?
• Did you ever question the foundational assumptions made? That a quant is not really appreciative of what goes into all this? Or, a manager who is not quant enough to start with, can never really manage?

Here is what I am thinking –

1. Can the same level of satisfaction with training be achieved in just 3-5 days? Can the remaining training duration be used for cutting edge?
2. What if you have two different sets of training? One that equips you for delivering projects, and another for turning you into a data scientist? Is there a preference for one over the other?

Source: http://www.aepconvert.com/web-analytics-training.php

Chances are that you are too busy or have too many things going on. Based on several senior folks in the industry that I have met recerntly, and over the years, this is an industry wide problem. An analyst with three years into the industry may not know anything beyond basic programming methods – not analytic thinking, not methodology depth, and not the ability to have an engaging conversation. By itself, it may seem OK, since you’re focusing on the core programming skills in the earlier years. However, what if you’ve damaged the raw material that you started with? That out of 100 people that you hired, in the hope of creating those data scientists, only about 1 or 2 really set on the path of becoming one?  What I fear for is the quintessential mediocrity that we bring to a particular field of work. IT is a great example of how we’ve treated talent. Politics is another one.

Like in almost everything else, the dependence on the aptitude of the new hire, and their given interest in the field of work is what everyone is depending on. It’s the model that has been used by strategy consulting. And by being so myopic towards project delivery, the industry is missing the knowledge component of this knowledge economy. The recent curriculum innovation in certain universities, such as NYU Stern, Northwestern, UNC, etc. gives me hope. India needs to move on that track too.

P.S.  a question – have you every wondered why the core team’s talent/ skillset is a lot higher/superior than the people you hire when you’re scaling? Is it OK to be like that?

Note: The reason I did not talk about the in-house analytics teams – they rarely have a culture of training their analytics professionals. They usually just deploy them. While I am a fan of BYOL (bring your own learning), I don’t think its applicable everywhere.

Data Democratization To Analytics Democratization

One of the more recent buzzword in the world of analytics is data democratization, used in the context of public data, govt. data or just organizational data. In layman terms, it means that everyone in the organization should have access to consistent (and preferably correct and comprehensive) information presented to them in easily consumable formats.

I am a huge fan of the possibilities that data democratization would lead to. However, the real tipping point of the world moving to an analytics led marketplace is analytics democratization, and not just data democratization.

Questions before I go further –

• Do you think it takes a lot of time for your team to get a particular report/analysis/data slice that you need for, say, an urgent meeting/review?
• Do you think that there are far too many people  involved in this process of getting the data to you? DW/ BI/ Analytics/ Product/ BU/…?
• If you are an analyst, do you think you get too many ad-hoc requests in a day? Are some of these what you’d call a re-hash of a previous request? And are you scared of telling the requester that you’ve already given it to them albeit in a different format/ it can be derived from the earlier data dump?
• If you are a business manager -Do you always get that feeling that you do not have enough information? Do you feel that you need something more? Do you also get frustrated with how long it takes to get the analysis that should have been  a cakewalk? Do you also feel that the analyst has just dumped a whole lot of data without stopping to think about the insights?

If your answer to most of the questions is yes – then your organization is most likely miles away from reaping the benefits of data democratization.

Barrier to adoption

Merely by giving access to data, access and consumption of data cannot be guaranteed. For instance, open source and freely available Linux got the appreciation of a lot of people, but remained the geek’s preferred OS. Masses stuck to their user friendly iOS and Windows systems. Even when Linux became more user friendly, the half-baked OS democratization had already created more barriers for the commoners. And the whole idea of migrating from their existing “warranty led OS” to an open source OS is something that masses (and democracy) were not ready for.

The barrier is not data, but understanding

Most stakeholders who do not advocate data driven thinking, and hence analytics, are the ones who have a limited view of what analytics is. Providing data and reports to them never solves the issue of analytics adoption. A closer look at the real leaders in this industry, e.g. CapOne, P&G, Amazon, Walmart, etc. would tell you that “analytics thinking” is ingrained in the way these organizations function and think. In these organizations, analytics has been democratized.

Data by itself is only half the value

Data is almost like a blunt weapon that can be used to club the enemy, or carved into a knife for the kitchen, or a sword for the battlefield. It can also be converted into a home equipment like needle or farm equipment like spade. Without questioning the merit of democratizing data, the real value of data can only be unleashed by making customizable adoption formats. Most end users would still look for flexible thin applications that help them understand data as per their need, or provide enough reports/dashboards that makes the need to be creative redundant. The latter will lead to the generation and maintenance of hundreds of reports that never get used, or whose existence is never ROI justified.

A report is as the reporter does

The number of dashboards and reports that I have seen in my career is an insignificant number. The significant aspect though is the “narrow’ application of most of these reports. Or, the demand-supply gap. Demand of the user, and supply from the report designer. Also, a lot of these reports are so rigid that a change in them requires raising a service request of sorts that goes through three layers of approvals and few weeks of analyst time. The number of consulting engagements that get delivered on the basis of inconsistent reports that different parts of the organizations use is a different story altogether. I believe that once analytics thinking is democratized, the products/reports/dashboards will start evolving to the needs of the masses, have flexibility to adapt on tap. And that’d be an interesting place!

****

So, even if you’ve democratized data sufficiently, you need people to understand the tools and skills that enable their conversation with data. I have seen too many “smart” people get scared when you throw too much data at them at a high speed. And whoever tells you that you cannot train the whole world what multicollinearity and mixed models are is likely trying to fool you. They need to tell you that you don’t need to.

Let’s aim for a culture where a quant(?) can communicate in a language that business can understand and the business can communicate in a language the quants can understand. And to that extent, organizations need to invest not just in building Big and Bigger Data capabilities, but also an analytics thinking mindset second.

And that’s an area where I see a significant gap. There are few people capable of educating analytics teams, and fewer capable of educating executives.

Image Credits:
1. Infolytics, here

2. Here

3. Here

The Pit, The Fall and The Reichenbach Retreival

The world is abuzz with words like Big Data, Cloud, Efficiency, Real-Time, Analytics, Power, Complex, etc. Most companies are being implored to think about these words. By organizations that are building “capabilities” around it.

Somehow, I think, we are missing the point.

The problem can never be smaller than the tool that solves it. And that to me, has been the bane of the world of analytics/big data/ <fit the new key word> professionals. They create a world where the tool becomes bigger than the end goal it serves. Right from poorly implemented data warehouse solutions, to point-in-time  dashboards that answer a question relevant 5 years back. Do you need to solve your “Big Data” problem? Or, do you need to solve for your business issues?

• Nevertheless, over close to a decade of trying to be an analytics professional, I have seen more examples of organizations trying to latch on to a fad rather than focus on what they have. Social media is just an example.

You’re walking towards a pit, and you should do it only if you’re fond of them and the treks and the views they offer. Not to fall.

If you are just about venturing into the web world, a free plugin of google analytics can reveal a lot to you, to get you started. Instead of a million dollar investment in sophisticated tools and dashboards. Secondly, a good looking dashboard does not always reveal something additional. It reveals in a palatable way. If you’re focused on what you want, that is, if you’ve figured out your business problem, you don’t always need that sexy solution.

Reminds me of that debate we had about two attractive girls – the difference between the two was that the first was sexier, but the second more marriageable. The second had more suitors while the first evoked desire a lot more often.

• A lot of these giant ideas fail. You do fall in those pits. Investments that don’t seem to be worth it. Models which stop being predictive unless fresh blood is pumped into them at regular intervals. Technology that becomes obsolete faster than your ability to eat French fries. You will make mistakes, and I guess that’s not that bad an idea, but the least you need to do is be aware of the costs.

For instance, internet was the in-thing. It still is. But the world is already looking at mobile as the next big thing. Right from iOS to Android enabled devices to extremely interesting content delivered in real-time. For every dotcom that succeeded, there are many that got bust because the fundamental idea itself was not thought through.

Microsoft Excel could handle 65k rows of data with great difficulty at some point. Today, it can handle a million rows with lesser amount of difficulty! And people have started talking about billions of data points. However, a lot of beautiful insights are driven sometimes out one unbiased and strong validated hypotheses. Which often, smartly done, does not take a million rows.

• Last point – it’s difficult to recover from a large investment gone wrong. And I do not always mean monetary investment. Most firms fail to look at executive time investment on half-baked investments as a loss. The opportunity cost of such falls may be significant.

EndNote: The environment today has given us more power in our own hands than most of us are capable of handling. It overwhelms us. We run hither tither and grope around to latch on to the keywords that supposedly enlightened souls are spewing at venomous speeds. No-one is wrong. Yet, the right question for you needs to be the same as it has always been – Is this what the business needs? No. Not wants!

In the Indian mythology, the tale of Bhasmasur is fairly popular. Bhasmasur was a demon who practiced austerity of several years in extreme conditions to please the gods. Lord Shiva appeared in front of him and agreed to grant him a boon in return for his perseverance and dedication. Bhasmasur requested for a power that allowed him to burn anything down to ashes (bhasma) that he’d put his hands on. As the powers, and hence, the tyranny of Bhasmasur reached its pinnacle, the other Gods implored Lord Vishnu to save them. Vishnu took the form of a beautiful danseuse (Mohini Avatar), and tricked Bhasmasur into copying his (or her) dance steps. However, as Mohini put her hand on her own  head while dancing, so did Bhasmasur on his head. And thus, Bhasmasur burnt himself down.  Bhasmasur forgot the reason why he aspired for that powerful hand. The hand that burnt him down.