[Pywps-devel] Parallel processing

Jorge de Jesus jorge.de-jesus at jrc.it
Thu Jan 29 17:52:15 CET 2009


Hi

I have some experience with PP and it is an excellent piece of software,
very simple and usefull.

Nevertheless, it may give some problems importing modules in the
submit() method.  If you have problems try to import the modules inside
your PP function, it will be less efficient but it will work!!!!! (you
will have nProcesses importing the same module at the same time)

I did some PP for interpolations were I created the total grid and
semi-variogram and them split everything into sub grids and interpolated
each sub-grid in different processors.

Also look at the callback example of the PP page it may give you an
ideia of the final class that will assemble the final output
Best
Jorge

Luca Casagrande wrote:
> Hello folks!
> Playing with my PyWPS scripts I wanna modify the r.los process to
> allow parallel processing..the idea is this:
> - the user place a series of point over the map and for each one
> insert the height;
> - each visibility is calculated separately using parallel processing (?);
> - all the results are merged together and output is created;
>
> For this task I am reading some about ParallelPython [1]
> What do you think about my plan?
>
> [1]: http://www.parallelpython.com/
>
>   


-- 
Ph.D. Jorge Samuel Mendes de Jesus

European Commission (EC)
Joint Research Centre Directorate (DG JRC)
Institute for Environment and Sustainability (IES)
TP 441, Via Fermi 1
21020 Ispra (VA)
Italy

Phone: +39 0332 78 3536
Fax:   +39 0332 78 5466

http://rem.jrc.ec.europa.eu

"The views expressed are purely those of the writer and may not in any circumstances be regarded as stating an official position of the European Commission"



More information about the Pywps-devel mailing list