Archived

This forum has been archived. Please start a new discussion on GitHub.

Publish to IceStorm with compression

Hi,
I'm testing the compression in IceStorm and I'm not sure if I have a right config.
Here is my case:
  1. the bandwidth between publisher and icestorm server is limited, the communication should be compressed;
  2. the icestorm and subscribers are in local network, compression could be disabled
The publisher is one way batch mode and have config
Ice.Override.Compress = 1

And for the publisher, I have bzip2.jar in class path.

The questions are:
  1. Does the IceStorm config need to add Compress config? I need this config for subscribers too?
  2. Does the uncompression happens in IceStorm server or subscribers, and I need to add bzip2 lib to their path? and for IceStorm, it started from icebox commandline(c++ version?) and I need libbiz2 in PATH?
Thanks in advance!

Comments

  • benoit
    benoit Rennes, France
    Hi,

    Your setting is fine. The publisher will compress the request and it will be un-compressed by IceStorm and forwarded un-compressed to subscribers. You can enable protocol tracing to see if requests/replies are sent compressed or un-compressed. Set the Ice.Trace.Protocol=1 property to enable this tracing.

    Cheers,
    Benoit.
  • Hi Benoit,

    Thanks for your reply, the compression is working now.
    But we see that the memory of icestorm server goes up with this compression config when publishing fast (3-4 Mbps), finally icestorm will eat up all memory.

    Is it because in compress the messages are buffered in icestorm? Without the compress in publish, I didn't see the large memory usage.
    could we reduce the memory in some way?

    Thanks,