[MapProxy] MultiMapProxy - concerns about performanse and best approach

classic Classic list List threaded Threaded
2 messages Options
Reply | Threaded
Open this post in threaded view
|

[MapProxy] MultiMapProxy - concerns about performanse and best approach

Ivan Pašić
Hello,

I started using and exploring MapProxy recently and I really like it a lot, it's very interesting and useful technology and it really fits my needs.
However, I am afraid that my lack of experience  could lead to some bad habits and practices so I would appreciate your advice.

So, I managed to create simple configuration file, write some custom middlewares and deploy the application, everything works fine. 
But now I see that I would maybe need more then one configuration file. 
Web GIS app that i develop would serve layers related to lot of different projects (locations) and I would like to have separate .yaml file for each of those locations instead of configuring all layers and sources in one single file because very soon that one file could get very big and hard to modify. Beside that I would like to dynamically edit those files using pyyaml for example so it would probable be even harder. Furthermoe, I would like to keep layers for each location somehow separated because it would make things easier for some other parts of my application.
However, I am not sure if MultiMapProxy is really intended to be used for such purposes and if it is, is there any limit in number of config files that it could handle?
I read in documentation that I can create separate folder where I can put all those files but do we speak here about 5-10 files or it can even be used for example 50 to 100 files? Would there be performance issues in that case? And is there maybe some better way to handle this? I am probably missing something obvious here but I hope you will have patience to explain me.

Thank you very much
Ivan

_______________________________________________
MapProxy mailing list
[hidden email]
http://lists.osgeo.org/mailman/listinfo/mapproxy
Reply | Threaded
Open this post in threaded view
|

Re: [MapProxy] MultiMapProxy - concerns about performanse and best approach

Oliver Tonnhofer-3
Hi,

MultiMapProxy loads the project configurations on-demand, so it doesn’t really matter if you have 10 or 1000 configs. It caches the loaded configs in a LRU cache (Least Recently Used) so most configs should not be loaded with every request.

You can also split configs with the `base` option http://mapproxy.org/docs/nightly/configuration.html#base

Use MultiMapProxy if you need multiple distinct services and use `base` structure your configs and use parts in multiple MapProxy projects. You can also combine both methods.

Regards,
Oliver

--
Oliver Tonnhofer  | Omniscale GmbH & Co KG  | http://omniscale.com
OpenStreetMap WMS and tile services         | http://maps.omniscale.com



> On 24.02.2015, at 17:05, Ivan Pašić <[hidden email]> wrote:
>
> Hello,
>
> I started using and exploring MapProxy recently and I really like it a lot, it's very interesting and useful technology and it really fits my needs.
> However, I am afraid that my lack of experience  could lead to some bad habits and practices so I would appreciate your advice.
>
> So, I managed to create simple configuration file, write some custom middlewares and deploy the application, everything works fine.
> But now I see that I would maybe need more then one configuration file.
> Web GIS app that i develop would serve layers related to lot of different projects (locations) and I would like to have separate .yaml file for each of those locations instead of configuring all layers and sources in one single file because very soon that one file could get very big and hard to modify. Beside that I would like to dynamically edit those files using pyyaml for example so it would probable be even harder. Furthermoe, I would like to keep layers for each location somehow separated because it would make things easier for some other parts of my application.
> However, I am not sure if MultiMapProxy is really intended to be used for such purposes and if it is, is there any limit in number of config files that it could handle?
> I read in documentation that I can create separate folder where I can put all those files but do we speak here about 5-10 files or it can even be used for example 50 to 100 files? Would there be performance issues in that case? And is there maybe some better way to handle this? I am probably missing something obvious here but I hope you will have patience to explain me.
>
> Thank you very much
> Ivan
> _______________________________________________
> MapProxy mailing list
> [hidden email]
> http://lists.osgeo.org/mailman/listinfo/mapproxy

_______________________________________________
MapProxy mailing list
[hidden email]
http://lists.osgeo.org/mailman/listinfo/mapproxy