PoD 3.16

Anar here...


PoD 3.16 is out: http://pod.gsi.de/download.html

The main Highlight of this release is the support of a configurable tmp directory on worker nodes.
Now PoD uses $TMPDIR as the root directory for temporary PROOF and PoD files.
We also moved to SL 6 and OSX 10.9 as the minimum required systems on WNs.
Plus some minor changes.

Just to keep you informed. As you may know I am working on the successor of PoD - DDS.
DDS is going to be much more generic (will support any user process, not only PROOFs) and a lot more flexible, than PoD.
PoD therefore is now supported on demand only. There will be no new features in PoD unless there is a user requests for it. So, send me your requests if you want to have something in PoD.

Don't forget that we are hosted on github. Report bugs and comments via github issue tracker. You can also subscribe on the project and follow code changes and releases via github system.

please check the release notes for more details.

PoD Home
Release Notes
PROOF Home

PoD 3.12

Anar here...

finally after a very long vacation time and other stuff I am very glad to release a new stable version of PoD.
PoD v3.12 is out and ready for consumption.

Highlights of this release

• Worker packages are now added as a payload to the worker script. (more details on this one you can find in my presentation on the CHEP 2012 also here)
• Added a support for BOOST 1.50 and Boost.Filesystem version3.
• PoD installations are relocatable now.
• Updated User's Manual.
• Many minor bugfixes and further improvements were made.

please check the release notes for more details.

PoD Home
Release Notes
PROOF Home

PoD 3.10

Anar here...

PoD version 3.10 is released and ready for consumption.

Highlights of this release

• Implemented new gLite plug-in.
• Many improvements and bug fixes in PoD modules related to worker-node-side.
• PoD GUI is officially discontinued.
• pod-ssh: for user's convenience it's possible now to use commands without the "--" sign, e.g.: "pod-ssh submit" or "pod-ssh clean".
• pod-ssh: learned a "--for-worker" option to perform an action on given worker nodes.
• pod-remote: got several fixes to better work via SSH open domains.
• Updated User's Manual.
• Many minor bugfixes and further improvements were made.

please check the release notes for more details.

PoD Home

Release Notes

PROOF Home

PoD 3.8

Anar here...

Finally I can announce,  that


PoD version 3.8 is released and ready for consumption.

Highlights of this release

I've been mostly concentrated on pod-ssh and pod-remote during this development cycle. As a result, 

• the pod-ssh command got some new features and many bugs fixed. 
• Users can now define an environment script for WNs in pod-ssh config files. It's so called an inline environment script.
• The pod-remote command has been revamped and is fully functional now (including the ssh open domain option).
• PoD has been successfully tested on MacOSX 10.7.
• PoD WNs support now the older versions of MacOSX (the minimum is 10.5).
• Updated User's Manual.
• Many minor bugfixes and further improvements were made.

please check the release notes for more details.

PoD Home

Release Notes

PROOF Home

PoD 3.6

I'm very glad to announce a new stable release of PoD.

PoD version 3.6 has now been released.

Highlights of this release

• A New great functionality - the pod-remote command.
• PoD officially supports now the LoadLeveler (IBM Tivoli Workload Scheduler) plug-in.
• PoD WN has bin ported to MacOSX (10.6). Now PoD (UI/Server/WN) run on Linux and MacOSX.
• In this version each PoD WN starts its own xproofd daemon. In this case we can control and handle each PoD worker individually.
• The pod-ssh command got several major improvements.
• The build of pod-console is disabled by default. At the moment CLI is much more advanced, powerful and recommend to use over GUI. The GUI is being redesigned and work in progress.
• Updated User's Manual.
• Many minor bugfixes and further improvements were made.

PoD Home

Release Notes

PROOF Home

PoD 3.4

I'm very glad to announce a new stable release of PoD.

PoD version 3.4 has now been released.

Highlights of this release

• Starting with version 3.4, PoD got its version numbering scheme a bit changed. It reflects the fact that PoD is both a production system and a research project. PoD now uses odd minor version numbers to denote development releases and even minor version numbers to denote stable releases.
• Implemented a completely new "pod-info" command, which now works as a client for "pod-agent" and can be used to request information from remote PoD servers.
• The PoD server starter script uses now the new "pod-info" and got significant improvements. It takes now less than a second to start PoD server.
• The PoD worker package is updated automatically if any of its component is updated.
• The SSH plug-in spawns now PROOF workers automatically according to a number of CPU Cores on workers, if a user doesn't request a specific number of workers.
• Updated User's Manual.
• Many minor bugfixes and further improvements were made.

PoD Home

Release Notes

PROOF Home

PoD 3.1.3

Anar here...

While working on a new PoD version I noticed an unpleasant bug, which was introduced with some new stuff in PoD 3.1. I decided to fixe it not only in the PoD master branch, but also back-port fixes to PoD 3.1.

The bug is not critical, but I would strongly recommend all PoD users, who use PoD 3.1 to upgrade to PoD 3.1.3, which has been just released. Otherwise in some cases PoD could leave xproof processes behind and slowly pollute user's environment with unwanted daemons.

Some details about the bug can be found here and here.

I am very sorry for any inconvenience this may have caused.

PoD is being constantly tested in different environments and as soon as a critical bug found a patch will be immediately released.

If you found a bug or have a feature request, please use our new issue tracker to report.

PoD 3.1

Finally a new PoD stable version is ready for consumption.

PoD version 3.1 has now been released.

Those who have been following PoD development know, that a shared installation feature and a Condor plug-in are the main topics of this release.

The Condor plug-in has just joined a long list of supported job managers' plug-ins.

PoD is now shipped with SSH, gLite, LSF, PBSPro/OpenPBS/Torque, Grid Engine and Condor plug-ins.

Highlights of this release

• PoD now supports Condor and is shipped with the Condor plug-in.
• Now PoD supports shared installations.
• PoD server and PoD worker instances clean now precisely only own processes. It makes it possible to start several different PoD workers/servers sessions under the same user ID (this is important for an AliEn integration).
• The PoD server starter script is a factor of 3 faster now.
• Improved idle time-out handling in PoD servers.
• Updated User's Manual.
• Many minor bugfixes and further improvements were made.

PoD Home

Release Notes

PROOF Home

PoD 2.4

I am very glad to announce the release of PoD 2.4.

This version releases many important changes and among others, there is the main event, which is the first stable release of an Oracle Grid Engine (OGE) plug-in for PoD.

OGE is fully supported now in both PoD GUI and PoD CLI. OGE is a great RMS with a lot of sites using it. I think this PoD plug-in will help to convince many potential PoD customers to give our product a try ;)


The OGE plug-in has just joined a list of supported job manager's plug-ins.
PoD is now shipped with gLite, LSF, PBSPro/OpenPBS/Torque, SSH, and OGE plug-ins.

Highlights of this release

• Support of Oracle Grid Engine. PoD is now shipped with the OGE plug-in.
• A new schema of WNs' pre-compiled binaries handling.
• PoD now a bit more smarter and more efficient, when a shared home file system is present on UIs and WNs.
• The startup time of PoD jobs is notably improved.
• Several security issues were fixed.
• This version implements a better logging machinery for PoD workers.
• The Job Manager plug-in system is slightly improved. It now makes it much easier to extend with new plug-ins and to support old ones.
• Updated User's Manual.

PoD Home

Release Notes

PROOF Home

PoD 2.2

Anar here...

After several months of development :) I am pleased to announce the release of PoD 2.2!

Highlights of this release

• A major highlight of this release is the first implementation of the PoD with SSH plug-in (see User's Manual, Chapter 11. SSH plug-in).
• The PoD distribution package is even more smaller now, it is only 3 MB :)
• A heavily revised build system, should help users to build and to install PoD from the source code conveniently.
• PoD doesn't use xrootd anymore. Instead xproofd is used. Starting with ROOT version 5.24/00 an executable named xproofd is also available under $ROOTSYS/bin. The xproofd executable is built out of the same main program used to build the xrootd executable. However, it loads by default the XrdProofdProtocol instead of the data-serving protocol XrdXrootdProtocol. The purpose of this daemon is to simplify the configuration when data-serving is not needed or it is handled differently.
• Implemented an automatic execution of a custom (user specified) environment script on workers before PoD processes start. (see User's Manual, section 5.2.)
• Revised PoD workers package and algorithms helped to reduce requirements and decrease start up time.

PoD Home

Release Notes

PROOF Home

PoD 2.1.4

Anar here...

It is always a pleasure to announce a new release of PoD. Yesterday night I have released PoD 2.1.4.

Some Highlights of this release

• A new build system has been introduced. The source code of sub-modules of PoD is now shipped along with the PoD distribution. Now PoD is much more easer to install and to maintain. Please see a how-to-install page in user's manual.
• Now PoD is shipped with a new plug-in. Starting from this release we implemented and will support a PBS/Torque plug-in. This opens a possibility to our users to submit PoD jobs to PBS resource management system. We support PBS (torque) and PBSPro, with both shared and not shared home file systems.
• PoD got a new command line interface (CLI). Using PoD's CLI users will be able to start, stop PoD server, retrieve its status, submit PoD jobs to a different resource management systems, check status and a number of available PoD/PROOF workers and more... Please see PoD user's manual for more details.
• PoD gLite plug-in and glite-api-wrapper library is now supporting gLite UI 3.2.

PoD Home

Release Notes

PROOF Home

PoD 2.1.3

I am very glad to announce the release of PoD v2.1.3.

Some Highlights of this release

• This version makes it possible to setup a native PROOF client/server connection in PoD environment, rather than to have it packet forwarded. if your workers are behind a firewall than PoD will automatically use its packet forwarding algorithms to maintain the PROOF traffic between server and workers. But if a direct connection is possible, than PoD will setup a native PROOF connection for such a workers. That means, by using PoD you can now setup a dynamic PROOF cluster and get a FULL functionality of PROOF on the native PROOF speed. For example you could now retrieve PROOF logs from a ROOT session or use PROOF's new submerger functionality to speed up the merging phase + all other nice and useful PROOF features.

Minimally required version of ROOT is 5.25.04 or higher. Otherwise PoD will not be able to detect idle status when a native PROOF connection is used and will consider that your session is always idle and will shutdown it after a defined timeout.

PoD Home

Release Notes

PROOF Home

PoD 2.1.1

Finally a new version of PoD has been released.

This time PoD got lots of improvements and most of all the pod-agent - a core module, has been upgraded and now made a use of the thread pool pattern. This gives a much smaller virtual memory footprint and also improves the performance by a huge factor in a network intensive operations (such as a file list validation when thousands of files are in the list and a merging) when many worker nods are used.

All users are kindly asked to stop using all prevues versions of PoD, including betas and move to v2.1.1.

The first reason is that this version is a factor of 10 faster in network intensive operations (like file validation and merging) and a virt. memory footprint of it is now reduced by a factor of 14 in compare to the prevues release + many many more improvements.

The second, since I am the only developer I can't give much support for older versions. So, if you have a problem with PoD the first question would be, "are you using the latest one?"... ;)

BTW, starting from this version, PoD generates a helper header file. The header should help you to automat a PROOF connection string in your scripts.

Read more in user's manual.

There are many more other features added and fixed. You can find more information in the Release Notes.

Find more details on PoD Trac.

PoD 2.0.10 is out

I've just released PoD 2.0.10.

This is a patch release, it addresses a hanging-on-merging issue (which could happen with PoD 2.0.8-2.0.9) and brings some performance improvements.

Find more details on PoD Trac.

PoD 2.0.8 has been released

Just a minute ago I have released version 2.0.8.

The main goal of this development was to reduce resource requirements PoD server need to handle its workers, in terms of a number of threads and memory. It looks like the task was successfully accomplished. Resource requirements were reduced by a factor of 3.

Now, since GSI ALICE group started to use PoD, PoD is tested with an ALICE PROOF-tutorial analysis (an example of a standard ALICE PROOF analysis) using 80 dynamic PROOF workers on LSF batch system.

Find more details on PoD Trac.

Release 2.0.8 2009-06-16

- Switch to $POD_LOCATION instead of $GLITE_PROOF_LOCATION.

- Using PROOFAgent's new configuration file.

- A better handling of multiple PoD workers on the same worker node started in the same time.

- Many minor fixes.

Submodules:

=== GAW v3.2.0

=== PROOFAgent v2.0.0 (2009-06-15) with the following changes:

   - Dramatically reduced a number of threads, which PA produces (on both server and client sides).

   - A slight redesign of the packet forwarder. PA now requires a factor of 3 less resources to handle each worker.

   - Removed the dependency on XERCES-C library.

   - The configuration file has been redesigned. Now using an INI style.

   - The build system has been switched from GNU Autotools to cmake.

   - Due to many bugs in FindBOOST of older versions of cmake we require cmake 2.6.4.

   - Switched from $GLITE_PROOF_LOCATION to $POD_LOCATION.

   - New configuration parameter - client.shutdown_if_idle_for_sec. Shut down a worker if its idle time is higher than this value.

   - Cosmetic changes.

=== PAConsole v1.0.7 (2009-06-15) with the following changes:

   - Source code cleaning.

   - Switched from $GLITE_PROOF_LOCATION to $POD_LOCATION.

   - Using new PROOFAgent's configuration file.

   - Fixed a case when several users run a PoD server and PAConsole couldn't recognize properly whether PoD runs or not.

   - LSF plug-in:

      * use LSF's queue information to limit the maximum number of workers in GUI.

PoD 2.0.7 is OUT

Today PoD 2.0.7 has been released. For some reasons the release was postponed several times... Finally it is out.

From now on PoD supports plug-ins. It provides already LSF and gLite plug-ins. That means you can get your PROOF cluster on the LSF or/and gLite workers just with one click.

PoD - "PROOF cluster on the fly" ;)

Find more details on PoD Trac.

Release notes

PoD

********************* Release 2.0.7 2009-04-30 ************************

- project has been renamed to "PROOF on Demand" (PoD).

- PAConsole now supports job manager plug-ins. Currently gLite and LSF plug-ins are officially supported.

- supporting LSF plug-in an workers on LSF.

- dynamic ports configuration is now sopported on PoD workers and server. PoD chooses ports for XRD, XPROOF and PROOFAgent on the fly during the start of the server of workers.

- cosmetic changes.

- using GAW v.3.2.0, PROOFAgent 1.0.5 and PAConsole 1.0.6 (see apps' ReleaseNotes files for more details).

PAConsole

********************* Release 1.0.6 2009-04-30 ************************

- using new build system - cmake [Trac Ticket #79]

- implemented plug-in system for PAConsole's job managers [Trac Ticket #80]

- implemented gLite job manager plug-in [Trac Ticket #80]

- implemented LSF job manager plug-in [Trac Ticket #81]

GAW and PROOFAgent have not been changed in this release.