[vtkusers] large data sets and memory

[Jon Johansson]

I'm not sure this actually belongs on the VTK Wiki, but I've 
seen the question come up before so I've added an entry at:

http://www.vtk.org/Wiki/VTK_FAQ#How_can_a_user_process_access_more_than_2_GB
_of_ram_in_32-bit_Windows.3F

I hope this helps,
Jon.

~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
~~   Jon I Johansson, Ph.D.              * Tel.: (780) 492-9304   ~~
~~   jon.johansson at ualberta.ca           * Fax.: (780) 492-1729   ~~
~~                                       * Office: G.S.B. 323C    ~~
~~   Programmer/Analyst          http://sciviz.aict.ualberta.ca   ~~
~~                                                                ~~
~~   Research Computing Support                                   ~~
~~   Room 352, General Services Building                          ~~
~~   Academic Information and Communication Technologies (AICT)   ~~
~~   University of Alberta                                        ~~
~~   Edmonton, Alberta, CANADA, T6G 2H1                           ~~
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
! "This  communication is intended for the use of the recipient to !
! which  it  is addressed, and may contain confidential, personal, !
! and/or  privileged  information.  Please contact  us immediately !
! if you are not the  intended  recipient  of  this communication. !
! If you are not the  intended  recipient  of  this communication, !
! do  not  copy,  distribute,   or   take   action  on   it.   Any !
! communication  received  in  error,  or subsequent reply, should !
! be deleted or destroyed."                                        !
!------------------------------------------------------------------!

From: vtkusers-bounces+jon.johansson=ualberta.ca at vtk.org
[mailto:vtkusers-bounces+jon.johansson=ualberta.ca at vtk.org] On Behalf Of
XViz
Sent: Wednesday, November 21, 2007 8:30 AM
To: vtkusers
Subject: Re: [vtkusers] large data sets and memory

Hello Thomas,
 
Your problem was disscused many times in this mailing list. One process in
Windows x86 (NT based 32 bit) cannot use more than 2Gb of memory, and the
system itself - more than 4Gb (usually even less - near 3.2Gb). One possible
solution I know is using Windows x64 or some Linux. The other - reducing the
size of your dataset. :(
 
 
XViz, D_E at ukr.net
2007-11-21 
----- Получено следующее ----- 
От: thomas jetzfellner 
Получатель: vtkusers 
Время: 2007-11-21, 16:17:07
Тема: [vtkusers] large data sets and memory

hi,

this is the first time, I write to the list and I think my question 
could sound a little bit "stupid". my current problem is, when i load 
large datasets there is a problem with the memory allocation. my 
programm crashes on the update call of the vtkImageData. I tried it in 
different ways and none worked on large data sets. small data is 
processed correctly. Attached you find some code snippeds, on the update 
call my program dies.
 
  vtkImageData* volume= new vtkImageData ;
  volume->SetInput( centerImage->GetOutput() ) ;
  volume->Update();
 
  vtkImageDataStreamer *ids = vtkImageDataStreamer::New();
  ids->SetInputConnection(centerImage->GetOutputPort());
  ids->SetNumberOfStreamDivisions(200);
  ids->UpdateInformation();
  ids->GetExtentTranslator()->SetSplitModeToBlock();
  ids->Update();

  vtkMemoryLimitImageDataStreamer* mlds = 
vtkMemoryLimitImageDataStreamer::New();
  mlds->SetInputConnection( centerImage->GetOutputPort() ) ;
  mlds->SetMemoryLimit ( 10000 ) ;
  mlds->Update();

mybe it is a problem in my concept. i want to load a dataset with a 
resolution of 512 x 512 x 1024, are there other ways to handle such a 
load of data?
my dev environment is visual studio 2005 on winXP SP2

thanks for any information and suggestions
_______________________________________________
This is the private VTK discussion list. 
Please keep messages on-topic. Check the FAQ at:
http://www.vtk.org/Wiki/VTK_FAQ
Follow this link to subscribe/unsubscribe:
http://www.vtk.org/mailman/listinfo/vtkusers