In order to make cenote a full blown big data suite, let's also include a Spark cluster.
For each project (which is our silo), have one page (or tab) that the user could insert his or her own Spark queries and a post button to submit them to the cluster.
For the time being this could be an empty text box and later on we could add helpers and validators.
The Spark could connect to the CockroachDB through SparkSQL using the Postgres driver
In order to make cenote a full blown big data suite, let's also include a Spark cluster.
For each project (which is our silo), have one page (or tab) that the user could insert his or her own Spark queries and a post button to submit them to the cluster.
For the time being this could be an empty text box and later on we could add helpers and validators.
The Spark could connect to the CockroachDB through SparkSQL using the Postgres driver