Product analytics is at the heart of our business at Deepnote. We’re trying to build software people love to use, and user feedback tells us whether we are doing a good job. We ask our users for a lot of qualitative feedback with surveys but that only captures a part of the story. The second part is told by metrics, such as retention, engagement and feature adoption.
A few months ago we hit the ceiling of the free-tier limit on our tool of choice, and we found ourselves presented with a nasty surprise. The cheapest tier was going to cost about $12,000 a year, and even more shortly after. So we decided to shop around, looked at several competitors, and asked for their pricing. It was the same story everywhere we looked. Some free tiers were more permissive than others, and the price varied a little, but the order of magnitude was still the same — thousands of dollars per month.
We are in the software business and we have no problem paying for software which brings us a lot of value. However, it seems like the core of the value here is generated by five charts with the most important metrics, and some ad-hoc queries whenever we’re curious about something — and those price tags just seem a bit too much for our stage of the company right now.
> "It seems like the core of the value here is generated by five charts with the most important metrics."
In the end, we decided to go with the tool with the best startup program, which helps us scale for another year — Amplitude. We’re very thankful for that, it is a great tool. Yet, they mention our current package would cost us close to $40,000 a year once the trial is over, and I am still not convinced that is the best use of the money.
I briefly looked at a few open-source applications we could self-host, but those have two caveats. They are not that great: some look awesome but are a bit too simple in what they can do, and others appeared like having plenty of features, but lack a coordinating designer to make it pleasant to use. Secondly, they bring the extra burden of another service to manage, update and secure. The reddit community seems like a cool place though.
There are a few ways to capture events and send them to the warehouse and right now we are sticking to Segment. I really like it because it made switching from Heap to Amplitude a question of several clicks, rather than fixing the entire tracking code, and it was just as easy to start sending the data to a warehouse.
We decided that going forward we will simply store our events in BigQuery — a fully managed solution that’s cheap and simple to connect to other tools, and probably my favourite part of Google Cloud.
The last piece in our puzzle is Deepnote. A collaborative notebook with one-click setup makes it easy to query, model and plot the data, and share the results with the rest of the company.
A short reflection — this might seem extremely obvious to you, and you might wonder why it warrants a blog post because you’ve done it this way a decade before the analytics tool got popular. Fair point, but when I was searching for a solution I never found a single suggestion, I just assumed I needed a dedicated tool.
A nice property of this solution is that you can plug and play. You can write your own solution to capture events if you do not like Segment. You can choose Postgres, Redshift or any other DB/warehouse instead of BigQuery. And you can pick a visualisation tool with buttons if you prefer not to write python — if you have Tableau or Looker then great, but Data Studio is free and also does the job pretty well.
Equally important as having analytics set up is having the company actually look at the numbers to inform their decisions. If the charts and dashboards are hidden in tools where people do not look very often, it might be difficult to form a new habit. Also, even tools as mature as Amplitude just make it really difficult to display the information I need in scheduled emails or on the TV screen in our kitchen.
So far it is only my hypothesis, but I feel like embedding these charts into Notion could help spread the awareness more.
Notion centralizes knowledge and project management across our company and everyone comes here on a daily basis already.
Embedding a live a chart from Data Studio is a matter of pasting a link, and it looks great.
We're also toying with the idea of creating embeddable cell outputs - would you be interested in using that?