Limiting ultrapeer memory for long-term servers?

View: New views
6 Messages — Rating Filter:   Alert me  

Limiting ultrapeer memory for long-term servers?

by Jeff Garzik-3 :: Rate this Message:

Reply to Author | View Threaded | Show Only this Message

As part of a personal effort to promote technologies I like, I just
started running two gtk-gnutella ultrapeer nodes.  No file service; this
exists purely to help gnet stay nice and strong.  Both are running on
Fedora 9, version gtk-gnutella-0.96.5-1.fc9.

So far, after a week on one server, I see memory usage continuing to
slowly creep up.  Is that normal?  :)  Does it ever stop growing?  :)

Since I would like to leave these processes up long term, I would like
to try and plan a bit for their resource usage.

Thanks,

        Jeff




-------------------------------------------------------------------------
Sponsored by: SourceForge.net Community Choice Awards: VOTE NOW!
Studies have shown that voting for your favorite open source project,
along with a healthy diet, reduces your potential for chronic lameness
and boredom. Vote Now at http://www.sourceforge.net/community/cca08
_______________________________________________
gtk-gnutella-users mailing list
gtk-gnutella-users@...
https://lists.sourceforge.net/lists/listinfo/gtk-gnutella-users

Re: Limiting ultrapeer memory for long-term servers?

by Christian Biere :: Rate this Message:

Reply to Author | View Threaded | Show Only this Message

Jeff Garzik wrote:
> As part of a personal effort to promote technologies I like, I just
> started running two gtk-gnutella ultrapeer nodes.  No file service; this
> exists purely to help gnet stay nice and strong.  Both are running on
> Fedora 9, version gtk-gnutella-0.96.5-1.fc9.

Please fetch extra_files/hostiles.txt and extra_files/spam.txt
occasionally (maybe every few weeks) from the SVN repository to reduce
spamming issues.
 
> So far, after a week on one server, I see memory usage continuing to
> slowly creep up.  Is that normal?  :)  Does it ever stop growing?  :)

It should not be ever-growing. The memory usage mostly depends on the
number of ultrapeers and especially leaves connected. With about 32
ultrapeers and 80 leaves, it stabilize around 200 MiB of RAM. If that's
too much, you should rather lower the number of leaves, not the number
of ultrapeer connections.
 
> Since I would like to leave these processes up long term, I would like
> to try and plan a bit for their resource usage.

If you don't care about country code mapping, you can save about 2 MiB
by using an empty file:

touch ~/.gtk-gnutella/geo-ip.txt

--
Christian

-------------------------------------------------------------------------
Sponsored by: SourceForge.net Community Choice Awards: VOTE NOW!
Studies have shown that voting for your favorite open source project,
along with a healthy diet, reduces your potential for chronic lameness
and boredom. Vote Now at http://www.sourceforge.net/community/cca08
_______________________________________________
gtk-gnutella-users mailing list
gtk-gnutella-users@...
https://lists.sourceforge.net/lists/listinfo/gtk-gnutella-users

Re: Limiting ultrapeer memory for long-term servers?

by Jeff Garzik-3 :: Rate this Message:

Reply to Author | View Threaded | Show Only this Message

Christian Biere wrote:
> Jeff Garzik wrote:
>> As part of a personal effort to promote technologies I like, I just
>> started running two gtk-gnutella ultrapeer nodes.  No file service; this
>> exists purely to help gnet stay nice and strong.  Both are running on
>> Fedora 9, version gtk-gnutella-0.96.5-1.fc9.
>
> Please fetch extra_files/hostiles.txt and extra_files/spam.txt
> occasionally (maybe every few weeks) from the SVN repository to reduce
> spamming issues.

Will do.  Two questions,

Does gtk-gnutella automatically notice when those files are updated, or
do I need to restart gtk-gnutella?

Are these files distributed anywhere via gnet (hopefully GPG-signed)?
That would be preferable to polling SVN.


>> So far, after a week on one server, I see memory usage continuing to
>> slowly creep up.  Is that normal?  :)  Does it ever stop growing?  :)
>
> It should not be ever-growing. The memory usage mostly depends on the
> number of ultrapeers and especially leaves connected. With about 32
> ultrapeers and 80 leaves, it stabilize around 200 MiB of RAM. If that's
> too much, you should rather lower the number of leaves, not the number
> of ultrapeer connections.

FWIW, both nodes are set at 40 ultrapeers and 150 leaves, apparently the
default (I let it create config_gnet, then tweaked a few minor things
like bandwidth limit).


>> Since I would like to leave these processes up long term, I would like
>> to try and plan a bit for their resource usage.
>
> If you don't care about country code mapping, you can save about 2 MiB
> by using an empty file:
>
> touch ~/.gtk-gnutella/geo-ip.txt

Thanks!  Yeah, I don't really care about that.

Oh, and another wish list item:  it would be nice to be able to dump
stats about daily search traffic, bandwidth usage, etc. without querying
each individual property.  i.e. like a "all_stats" command or similar.

        Jeff



-------------------------------------------------------------------------
Sponsored by: SourceForge.net Community Choice Awards: VOTE NOW!
Studies have shown that voting for your favorite open source project,
along with a healthy diet, reduces your potential for chronic lameness
and boredom. Vote Now at http://www.sourceforge.net/community/cca08
_______________________________________________
gtk-gnutella-users mailing list
gtk-gnutella-users@...
https://lists.sourceforge.net/lists/listinfo/gtk-gnutella-users

Re: Limiting ultrapeer memory for long-term servers?

by Raphael Manfredi :: Rate this Message:

Reply to Author | View Threaded | Show Only this Message

Quoting Jeff Garzik <jeff@...> from ml.softs.gtk-gnutella.users:
:Does gtk-gnutella automatically notice when those files are updated, or
:do I need to restart gtk-gnutella?

Yes, these files are monitored and will be reloaded whenever they change.

:Are these files distributed anywhere via gnet (hopefully GPG-signed)?
:That would be preferable to polling SVN.

No, unfortunately this is not the case.

:Oh, and another wish list item:  it would be nice to be able to dump
:stats about daily search traffic, bandwidth usage, etc. without querying
:each individual property.  i.e. like a "all_stats" command or similar.

What kind of stats do you want?  Do you want to be able to reset the
stats as well to have daily variations or are you happy with an
ever-increasing count?

Raphael

-------------------------------------------------------------------------
Sponsored by: SourceForge.net Community Choice Awards: VOTE NOW!
Studies have shown that voting for your favorite open source project,
along with a healthy diet, reduces your potential for chronic lameness
and boredom. Vote Now at http://www.sourceforge.net/community/cca08
_______________________________________________
gtk-gnutella-users mailing list
gtk-gnutella-users@...
https://lists.sourceforge.net/lists/listinfo/gtk-gnutella-users

Re: Limiting ultrapeer memory for long-term servers?

by Christian Biere :: Rate this Message:

Reply to Author | View Threaded | Show Only this Message

Jeff Garzik wrote:
> Christian Biere wrote:
> > Please fetch extra_files/hostiles.txt and extra_files/spam.txt
> > occasionally (maybe every few weeks) from the SVN repository to reduce
> > spamming issues.

> Does gtk-gnutella automatically notice when those files are updated, or
> do I need to restart gtk-gnutella?

No, there's no notification mechanism.
 
> Are these files distributed anywhere via gnet (hopefully GPG-signed)?

No.

> That would be preferable to polling SVN.

I'd advise against setting up a cron job in order to pull periodic
updates from the SVN repository. Rather send yourself a reminder.

You can also check the CIA for updates. It provides a RSS feed.
http://cia.vc/stats/project/gtk-gnutella
 
> Oh, and another wish list item:  it would be nice to be able to dump
> stats about daily search traffic, bandwidth usage, etc. without querying
> each individual property.  i.e. like a "all_stats" command or similar.

You could write yourself some script to fetch multiple property values
you're interested in and then preprocess the data with gnuplot or the
like:

cat << EOF | gtk-gnutella --shell
print session_id
print start_stamp
print ul_byte_count
print dl_byte_count
EOF

The "session_id" property allows you to check whether gtk-gnutella was
restarted between two shell commands. At the moment there are not
many statistics available from the shell interface because they are
not implemented as properties and only visible in the GUI.

--
Christian

-------------------------------------------------------------------------
Sponsored by: SourceForge.net Community Choice Awards: VOTE NOW!
Studies have shown that voting for your favorite open source project,
along with a healthy diet, reduces your potential for chronic lameness
and boredom. Vote Now at http://www.sourceforge.net/community/cca08
_______________________________________________
gtk-gnutella-users mailing list
gtk-gnutella-users@...
https://lists.sourceforge.net/lists/listinfo/gtk-gnutella-users

Re: Limiting ultrapeer memory for long-term servers?

by Christian Biere :: Rate this Message:

Reply to Author | View Threaded | Show Only this Message

Some clarification:

Christian Biere wrote:
> Jeff Garzik wrote:
> > Does gtk-gnutella automatically notice when those files are updated, or
> > do I need to restart gtk-gnutella?

Yes, the files are reloaded within about 30 seconds when their modification
timestamp changes on your disk.
 
> No, there's no notification mechanism.

What I meant was, there are no notifications that you should fetch an
update from SVN.

--
Christian

-------------------------------------------------------------------------
Sponsored by: SourceForge.net Community Choice Awards: VOTE NOW!
Studies have shown that voting for your favorite open source project,
along with a healthy diet, reduces your potential for chronic lameness
and boredom. Vote Now at http://www.sourceforge.net/community/cca08
_______________________________________________
gtk-gnutella-users mailing list
gtk-gnutella-users@...
https://lists.sourceforge.net/lists/listinfo/gtk-gnutella-users