Context

There are certain key metrics that matter — especially to David Aronchick as well as the PL (Protocol Labs) leadership team — which relate both to the technical operation of both the public Bacalhau network (as well as, to whatever extent we can infer them, private networks that other folks run), but also to the business/community side of the Bacalhau project as a whole, such as website traffic, Twitter engagement, number of GitHub stars, downloads over time, etc.

We urgently need a consistent, global, view of this, yesterday.

Phases

1. Develop MVP dashboard
2. Add more complex metrics to it such as user cohorts

Tool selection (dashboarding)

Ultimately open to your suggestion on tool selection, we are currently using Grafana for many dashboards however for the more “business” style metrics, i.e. Google Analytics, does Grafana integrate with those? Would something like Looker / Looker Studio (formerly Google Data Studio) be a better fit? Or something you’ve used before that you are quick with!

There’s also a desire for less technical users to be able to create dashboards with no-/low-code integration, assuming we have appropriate data sources plugged in.

Key metrics & their sources

• Number of unique users on the public Bacalhau network
• How many jobs run on the public Bacalhau network
  • Per month, per day
  • Of which, how many are canaries (our test jobs - filter these out by default, but have a way to see them)
  • We can directly connect to the Postgres database behind https://dashboard.bacalhau.org/ (bacalhau/lisbonfishpeople)
• Number of nodes in the public network
  • Can we sample https://dashboard.bacalhau.org/network? Or is this already persisted?
• GitHub stars over time
  • Does the GitHub API give you stars over time or do we need to start sampling this ourselves? If so, where? A cronjob somewhere that runs a python script that puts results into a postgres database? Maybe on the dashboard VM?
• GitHub downloads over time
  • GitHub seems to definitely not give you downloads over time, just total downloads per version. We want total downloads over time, downloads per month/day etc
• Number of external contributors on the GitHub repo
• Website traffic
  • bacalhau.org, docs.bacalhau.org - do these have Google Analytics?
• Number of users in the #bacalhau slack channel
  • Can we get this from the Slack API?