[vtkusers] large data sets and memory

[thomas jetzfellner]

maybe i am getting now a litte bit off topic, but itk was able to load 
the data and i applied some filters on the dataset. would it be possible 
to do all the work with itk and then i give vtk only the needed data to 
visualize?


thomas jetzfellner wrote:
> ok,
>
> i thought that the problem is something like that. I have used VolView 
> to take a look at the data set and it did not crash. so i thought it 
> is my fault.
> do you think a possible solution would be a segmentated loading 
> algorithm? so i load only the half dataset and the rest only when 
> needed? hay anyone tried something like this?
>
> thanks
>
>
> XViz wrote:
>> Hello Thomas,
>>  
>> Your problem was disscused many times in this mailing list. One 
>> process in Windows x86 (NT based 32 bit) cannot use more than 2Gb of 
>> memory, and the system itself - more than 4Gb (usually even less - 
>> near 3.2Gb). One possible solution I know is using Windows x64 or 
>> some Linux. The other - reducing the size of your dataset. :(
>>  
>>  
>> XViz, D_E at ukr.net 
>> <mailto:%3C%21--AID_FROMADDRESS_BEGIN--%3ED_E at ukr.net%3C%21--AID_FROMADDRESS_END--%3E> 
>>
>> 2007-11-21
>>
>>     ----- Получено следующее -----
>>     *От:* thomas jetzfellner <mailto:thomas.jetzfellner at gsf.de>
>>     *Получатель:* vtkusers <mailto:vtkusers at vtk.org>
>>     *Время:* 2007-11-21, 16:17:07
>>     *Тема:* [vtkusers] large data sets and memory
>>
>>     hi,
>>
>>     this is the first time, I write to the list and I think my question
>>     could sound a little bit "stupid". my current problem is, when i 
>> load
>>     large datasets there is a problem with the memory allocation. my
>>     programm crashes on the update call of the vtkImageData. I tried
>>     it in
>>     different ways and none worked on large data sets. small data is
>>     processed correctly. Attached you find some code snippeds, on the
>>     update
>>     call my program dies.
>>            vtkImageData* volume= new vtkImageData ;
>>       volume->SetInput( centerImage->GetOutput() ) ;
>>       volume->Update();
>>            vtkImageDataStreamer *ids = vtkImageDataStreamer::New();
>>       ids->SetInputConnection(centerImage->GetOutputPort());
>>       ids->SetNumberOfStreamDivisions(200);
>>       ids->UpdateInformation();
>>       ids->GetExtentTranslator()->SetSplitModeToBlock();
>>       ids->Update();
>>
>>       vtkMemoryLimitImageDataStreamer* mlds =
>>     vtkMemoryLimitImageDataStreamer::New();
>>       mlds->SetInputConnection( centerImage->GetOutputPort() ) ;
>>       mlds->SetMemoryLimit ( 10000 ) ;
>>       mlds->Update();
>>
>>     mybe it is a problem in my concept. i want to load a dataset with a
>>     resolution of 512 x 512 x 1024, are there other ways to handle 
>> such a
>>     load of data?
>>     my dev environment is visual studio 2005 on winXP SP2
>>
>>     thanks for any information and suggestions
>>     _______________________________________________
>>     This is the private VTK discussion list.
>>     Please keep messages on-topic. Check the FAQ at:
>>     http://www.vtk.org/Wiki/VTK_FAQ
>>     Follow this link to subscribe/unsubscribe:
>>     http://www.vtk.org/mailman/listinfo/vtkusers
>>
>>
>> ------------------------------------------------------------------------
>>
>> _______________________________________________
>> This is the private VTK discussion list. Please keep messages 
>> on-topic. Check the FAQ at: http://www.vtk.org/Wiki/VTK_FAQ
>> Follow this link to subscribe/unsubscribe:
>> http://www.vtk.org/mailman/listinfo/vtkusers
>>   
>
> _______________________________________________
> This is the private VTK discussion list. Please keep messages 
> on-topic. Check the FAQ at: http://www.vtk.org/Wiki/VTK_FAQ
> Follow this link to subscribe/unsubscribe:
> http://www.vtk.org/mailman/listinfo/vtkusers
>