Has there been much discussion about setting up a UK Panoramax instance?
The main things needed seem to be funding, and someone to manage the server. Maybe OSM UK could do this?
Please use this thread to discuss it.
Has there been much discussion about setting up a UK Panoramax instance?
The main things needed seem to be funding, and someone to manage the server. Maybe OSM UK could do this?
Please use this thread to discuss it.
I contribute a fair bit* to Mapillary, so a couple of points from that perspective:
I know some people have objections to contributing to Mapillary on the basis that theyāre now owned by Meta (Facebook), but Iāve always seen it as a pretty good symbiotic relationship - I get a good set of tools to help with my mapping, they get a ton of street-level imagery to play computer imaging/AI training withā , OpenStreetMap gets an imagery collection to plunder, and Meta picks up the bill for the storage and infrastructure costs.
Iāve kept copies of a lot of what Iāve uploaded (as opposed to the usual upload-and-delete), with the thought that I might want to contribute them elsewhere too at some point - so youād be welcome to them to kickstart a collection.
My files currently total 38TBā”, so my total contribution to Mapillary is probably 40~50TB. If a single contributor can generate that much content, do not underestimate quite how much the total storage might end up costing!
* 11.2 million images so far: Mapillary
ā If they use the imagery for teaching cars how to drive themselves, Iāll be happy that tiny UK country lanes are well represented.
ā” Iāve 5Mbps upload, so youād have to work out a way of getting them if you want them.
wow, thatās a lot of data, thanks for all your work, and the sobering reminder of the storage requirements
OSM-FR say they have around 100TB of storage for 20M pictures, including redundancy & backup. They recommend setting up a server somewhere instead of cloud due to cost, which is fair, but unfortunately thatās not something I can do (if anyone can, thatād be great).
From what I can find, a 20TB drive is around Ā£400+, and OSM-FR have dual 1070TIs for processing, so a UK instance needs some sort of financial backing.
Basically, it looks like we need:
maybe there are some gov initiatives? if anyone has any ideas itād be great because i have no idea
The other component to this is what is the benefit of offering this. What does it offer aside from not being Mapillary?
Thatās a fair point. I guess itās more future-proofing than anything, what if Meta decides itās not worth keeping any more? Or they start charging for API access? Itād always be better to have this data maintained by a non-profit, and federated via the āgeo-commonsā as Panoramax calls it.
But you might be right, the benefits might not outweigh the costs to set it up yet.
Yeah. Iām not against it, and if it isnāt worth it right now, it is worth revisiting should circumstances change.
Focussing on the positives though, as thereās always a million reasons not to do something, benefits would be:
Thanks for your efforts - Iāve made good use of your uploads to Mapillary in my area!
An active community of developers who are out for new features?
also:
This is also why OSM-FR proposed the start this project.
excluding backups
When I proposed the project on the OSM-FR forum, I did a calculation to have an idea for one dense coverage all over France. With redundancy and backup, the total was around 1 PB.
Storage is really the #1 issue and thatās why we chose to have a decentralized sharing. We chose to self-host our instance to control the costs and we use mostly second life hardware, the only exception are SSDs.
Most of our HDD are 8TB now (we started with 3TB ones), and we can get very good deals on this capacity (around or even less than 10ā¬/TB). They are not new, so we have redundancy (2 disks in each set of 6 disks, all managed using ZFS).
Our hardware investment for the server is around 3500ā¬ so far. Server hosting (colocation) is offered by a Paris area datacenter.
Do not hesitate if you have question, need for advices or help to setup an instance.
The core dev team is working only in english in the gitlab repo and documentations are all available in english.
Do not hesitate to show up on the geocommons forum, english posts are ok even if most of past post are in french.
FYI:
What about a monthly online session in english like the one we currently have in french ?