PoD 2.1.1

Finally a new version of PoD has been released.

This time PoD got lots of improvements and most of all the pod-agent - a core module, has been upgraded and now made a use of the thread pool pattern. This gives a much smaller virtual memory footprint and also improves the performance by a huge factor in a network intensive operations (such as a file list validation when thousands of files are in the list and a merging) when many worker nods are used.

All users are kindly asked to stop using all prevues versions of PoD, including betas and move to v2.1.1.

The first reason is that this version is a factor of 10 faster in network intensive operations (like file validation and merging) and a virt. memory footprint of it is now reduced by a factor of 14 in compare to the prevues release + many many more improvements.

The second, since I am the only developer I can't give much support for older versions. So, if you have a problem with PoD the first question would be, "are you using the latest one?"... ;)

BTW, starting from this version, PoD generates a helper header file. The header should help you to automat a PROOF connection string in your scripts.

Read more in user's manual.

There are many more other features added and fixed. You can find more information in the Release Notes.

Find more details on PoD Trac.

PoD 2.0.10 is out

I've just released PoD 2.0.10.

This is a patch release, it addresses a hanging-on-merging issue (which could happen with PoD 2.0.8-2.0.9) and brings some performance improvements.

Find more details on PoD Trac.

PoD 2.0.8 has been released

Just a minute ago I have released version 2.0.8.

The main goal of this development was to reduce resource requirements PoD server need to handle its workers, in terms of a number of threads and memory. It looks like the task was successfully accomplished. Resource requirements were reduced by a factor of 3.

Now, since GSI ALICE group started to use PoD, PoD is tested with an ALICE PROOF-tutorial analysis (an example of a standard ALICE PROOF analysis) using 80 dynamic PROOF workers on LSF batch system.

Find more details on PoD Trac.

Release 2.0.8 2009-06-16

- Switch to $POD_LOCATION instead of $GLITE_PROOF_LOCATION.

- Using PROOFAgent's new configuration file.

- A better handling of multiple PoD workers on the same worker node started in the same time.

- Many minor fixes.

Submodules:

=== GAW v3.2.0

=== PROOFAgent v2.0.0 (2009-06-15) with the following changes:

   - Dramatically reduced a number of threads, which PA produces (on both server and client sides).

   - A slight redesign of the packet forwarder. PA now requires a factor of 3 less resources to handle each worker.

   - Removed the dependency on XERCES-C library.

   - The configuration file has been redesigned. Now using an INI style.

   - The build system has been switched from GNU Autotools to cmake.

   - Due to many bugs in FindBOOST of older versions of cmake we require cmake 2.6.4.

   - Switched from $GLITE_PROOF_LOCATION to $POD_LOCATION.

   - New configuration parameter - client.shutdown_if_idle_for_sec. Shut down a worker if its idle time is higher than this value.

   - Cosmetic changes.

=== PAConsole v1.0.7 (2009-06-15) with the following changes:

   - Source code cleaning.

   - Switched from $GLITE_PROOF_LOCATION to $POD_LOCATION.

   - Using new PROOFAgent's configuration file.

   - Fixed a case when several users run a PoD server and PAConsole couldn't recognize properly whether PoD runs or not.

   - LSF plug-in:

      * use LSF's queue information to limit the maximum number of workers in GUI.

PoD 2.0.7 is OUT

Today PoD 2.0.7 has been released. For some reasons the release was postponed several times... Finally it is out.

From now on PoD supports plug-ins. It provides already LSF and gLite plug-ins. That means you can get your PROOF cluster on the LSF or/and gLite workers just with one click.

PoD - "PROOF cluster on the fly" ;)

Find more details on PoD Trac.

Release notes

PoD

********************* Release 2.0.7 2009-04-30 ************************

- project has been renamed to "PROOF on Demand" (PoD).

- PAConsole now supports job manager plug-ins. Currently gLite and LSF plug-ins are officially supported.

- supporting LSF plug-in an workers on LSF.

- dynamic ports configuration is now sopported on PoD workers and server. PoD chooses ports for XRD, XPROOF and PROOFAgent on the fly during the start of the server of workers.

- cosmetic changes.

- using GAW v.3.2.0, PROOFAgent 1.0.5 and PAConsole 1.0.6 (see apps' ReleaseNotes files for more details).

PAConsole

********************* Release 1.0.6 2009-04-30 ************************

- using new build system - cmake [Trac Ticket #79]

- implemented plug-in system for PAConsole's job managers [Trac Ticket #80]

- implemented gLite job manager plug-in [Trac Ticket #80]

- implemented LSF job manager plug-in [Trac Ticket #81]

GAW and PROOFAgent have not been changed in this release.

PoD with Git

Last week I switched PoD development from SVN to Git. Three years of SVN...what a waste...

I don't want here to start a holy war - Git vs SVN, because there can't be any. Git will win in anyway! I just must say that I do regret that I switched to Git so late ;)

BTW, now I am switching all my development projects to Git, even private ones.

So far I opened only PoD repository for WEB view and for ssh connection. Currently repository can only be accessed using ssh protocol. In the future I am going to open it it for https as well.