[vtkusers] large data sets and memory

thomas jetzfellner thomas.jetzfellner at gsf.de
Wed Nov 21 10:51:53 EST 2007


ok,

i thought that the problem is something like that. I have used VolView 
to take a look at the data set and it did not crash. so i thought it is 
my fault.
do you think a possible solution would be a segmentated loading 
algorithm? so i load only the half dataset and the rest only when 
needed? hay anyone tried something like this?

thanks


XViz wrote:
> Hello Thomas,
>  
> Your problem was disscused many times in this mailing list. One 
> process in Windows x86 (NT based 32 bit) cannot use more than 2Gb of 
> memory, and the system itself - more than 4Gb (usually even less - 
> near 3.2Gb). One possible solution I know is using Windows x64 or some 
> Linux. The other - reducing the size of your dataset. :(
>  
>  
> XViz, D_E at ukr.net 
> <mailto:%3C%21--AID_FROMADDRESS_BEGIN--%3ED_E at ukr.net%3C%21--AID_FROMADDRESS_END--%3E>
> 2007-11-21
>
>     ----- Получено следующее -----
>     *От:* thomas jetzfellner <mailto:thomas.jetzfellner at gsf.de>
>     *Получатель:* vtkusers <mailto:vtkusers at vtk.org>
>     *Время:* 2007-11-21, 16:17:07
>     *Тема:* [vtkusers] large data sets and memory
>
>     hi,
>
>     this is the first time, I write to the list and I think my question
>     could sound a little bit "stupid". my current problem is, when i load
>     large datasets there is a problem with the memory allocation. my
>     programm crashes on the update call of the vtkImageData. I tried
>     it in
>     different ways and none worked on large data sets. small data is
>     processed correctly. Attached you find some code snippeds, on the
>     update
>     call my program dies.
>      
>       vtkImageData* volume= new vtkImageData ;
>       volume->SetInput( centerImage->GetOutput() ) ;
>       volume->Update();
>      
>       vtkImageDataStreamer *ids = vtkImageDataStreamer::New();
>       ids->SetInputConnection(centerImage->GetOutputPort());
>       ids->SetNumberOfStreamDivisions(200);
>       ids->UpdateInformation();
>       ids->GetExtentTranslator()->SetSplitModeToBlock();
>       ids->Update();
>
>       vtkMemoryLimitImageDataStreamer* mlds =
>     vtkMemoryLimitImageDataStreamer::New();
>       mlds->SetInputConnection( centerImage->GetOutputPort() ) ;
>       mlds->SetMemoryLimit ( 10000 ) ;
>       mlds->Update();
>
>     mybe it is a problem in my concept. i want to load a dataset with a
>     resolution of 512 x 512 x 1024, are there other ways to handle such a
>     load of data?
>     my dev environment is visual studio 2005 on winXP SP2
>
>     thanks for any information and suggestions
>     _______________________________________________
>     This is the private VTK discussion list.
>     Please keep messages on-topic. Check the FAQ at:
>     http://www.vtk.org/Wiki/VTK_FAQ
>     Follow this link to subscribe/unsubscribe:
>     http://www.vtk.org/mailman/listinfo/vtkusers
>
>
> ------------------------------------------------------------------------
>
> _______________________________________________
> This is the private VTK discussion list. 
> Please keep messages on-topic. Check the FAQ at: http://www.vtk.org/Wiki/VTK_FAQ
> Follow this link to subscribe/unsubscribe:
> http://www.vtk.org/mailman/listinfo/vtkusers
>   




More information about the vtkusers mailing list