Beefy Boxes and Bandwidth Generously Provided by pair Networks
Do you know where your variables are?
 
PerlMonks  

Re: Re: Out Of Memory error at 950MB with 14GB free RAM

by aburker (Sexton)
on Feb 10, 2004 at 10:00 UTC ( #327865=note: print w/replies, xml ) Need Help??


in reply to Re: Out Of Memory error at 950MB with 14GB free RAM
in thread Out Of Memory error at 950MB with 14GB free RAM

wow!

I really didn't expect that much answers past one week of reaserch on that topic and finding not to much, THANKS!

your link really helped and brought me to the conclusion that it is very likely that the perl usemymalloc switch which is set on the server is causing the problem.

Unfortunately the sysadmin won't recompile perl without the switch (he will only use prepacked packages provided by HP)

Probably he will do an upgrade to 5.8 but this can take time... and (after reading the postings in your link) this will not fix the problem!

other answers: *) I can't map this to harddisk (performance issue)
*) I know 950MB is a lot of RAM but I will have to build up a complex Structure made up of small strings. This structure must be FAST handable. So that is why the RAM gets big!
*) And normally RAM is not the problem (why would someone by a server with 8CPUs and 16GB RAM if it's not for performance..., Just bad that perl can't keep scope with that!
*) the 4GB border is not the problem my problem would just need 10% more memory to handle the largest file, but by now all possible tweaks are already done (as I found them :-)

conclusion:
+++++++++++
I will have to rewrite the program and make it slower, but this seems to be less days of work then recompiling perl and checking all other scripts :-((((((

But anyway thanks for your response!

  • Comment on Re: Re: Out Of Memory error at 950MB with 14GB free RAM

Replies are listed 'Best First'.
Re^3:(OT) Out Of Memory error at 950MB with 14GB free RAM
by davis (Vicar) on Feb 10, 2004 at 10:10 UTC

    It's possible you're being bitten by the HP-UX caveat of maxdsiz/maxdsiz64. This variable limits the maximum size any single process can grow to, and no amount of recompiling will fix it. Run "kmtune -q maxdsiz" to see whether the process limit is causing this. If so, then fiddling with kmtune or "Kernel Configuration" from within SAM will allow you to change it.


    davis
    It's not easy to juggle a pregnant wife and a troubled child, but somehow I managed to fit in eight hours of TV a day.
Re: (3) Out Of Memory error at 950MB with 14GB free RAM
by ysth (Canon) on Feb 10, 2004 at 16:36 UTC
    Unfortunately the sysadmin won't recompile perl without the switch (he will only use prepacked packages provided by HP)
    Point the sysadmin to the HP-UX Porting Centre. (It's not immediately clear to me if the perl-5.8.3 package there is 64-bit or not.)
Re: Re: Re: Out Of Memory error at 950MB with 14GB free RAM
by vaevictus (Pilgrim) on Feb 11, 2004 at 23:42 UTC
    Might you just build your own userland build of perl, just for this program?

Log In?
Username:
Password:

What's my password?
Create A New User
Domain Nodelet?
Node Status?
node history
Node Type: note [id://327865]
help
Chatterbox?
and the web crawler heard nothing...

How do I use this? | Other CB clients
Other Users?
Others imbibing at the Monastery: (2)
As of 2022-05-24 22:21 GMT
Sections?
Information?
Find Nodes?
Leftovers?
    Voting Booth?
    Do you prefer to work remotely?



    Results (84 votes). Check out past polls.

    Notices?