Moving away from firebase

[lukew3]

Using firebase will become really expensive as more users join. I'd suggest that the backend be moved from firebase to a linux server with mongodb. Queries should be pretty similar between firebase and mongodb and the cost of running the servers will be much lower and more predictable.
Also, it would be nice to know how much it costs to run right now if you're comfortable with sharing.

[Miodec]

Yeah i know, i want to its just a big change to rewrite all the database connections, move the data over without breaking anything and not loosing data.

Right now its approaching 400, mostly due to the amount of data stored.

[Andrew15-5]

So, technically, it is still possible to see future version with offline self-hosting/local capability? I'm not sure what Luke was cooking, but I would be interested to tackle this problem (at some point in the future). I assume the major issue is just that there are many API endpoints? Considering that the queries will probably be unchanged (NoSQL), the problem is to just get time to write not only a local db version, but also so that you can easily switch between them with env vars. At least, that what I think it does right now. Didn't look into the code.

[fehmer]

it is possible, we can discuss in detail when you have time to work on this.

[Andrew15-5]

Should this be a separate issue then? I didn't find any open or closed. Maybe the majority are in discussions.

[fehmer]

you can start a new discussion if you want. this one is four years old and the project has changed a lot since then

[Andrew15-5]

Right, no feature request issues... Here you go: #6823.

[nogweii]

Would you consider supporting remoteStorage? It allows people to store their history somewhere else and you wouldn't have to pay for those users.

[Miodec]

Whats the difference between remote storage and mongo?

[lukew3]

Whats the difference between remote storage and mongo?

From what I've read, remote storage means that each individual person's data is stored in an outside server (such as 5apps or self-hosted). The individual has complete control over their data and can then decide how they want their data to be shared between apps and such. The user would have to create an account on another platform where their data is actually stored. With a mongo server, the data is managed by you, the monkeytype database administrator. Using remote storage could save you, the administrator, money since they are not actually hosting data, but would transfer the costs to the individual/database provider.

For now, I think we should design our own backend powered by mongodb and hosted on something like linode. Remote storage could be added later if enough users plan to use it to deem it worth the effort.

[Miodec]

Yeah i think mongo is the way to go for now. Dunno how it will work with local dev and in general i dont know where to start with the conversion.