[Imstk-developers] Multiple materials per import

Mon Sep 25 17:11:40 EDT 2017

Hi Nick,
            Case 1 and 2 are very different from physics POV. They are
treated as different bodies and there are formulations that work with
contacts of non-conformal meshes. Yes, we don't encounter many different
materials in physics but if we were to reach high fidelity, we could have
graded physics material property which could mean each element could have a
slightly different material property compared to its neighbors. Having this
generally doesn't come with an additional computational cost.

In this regard, rendering is more flexible. For example non-contiguous
medium (eg: two organs touching each other) can be treated as one by the
rendering is given that one takes care of the details about intersecting
primitives that you mentioned.

As far as the user is concerned he/she is modifying what they are seeing
i.e., the rendering mesh (eg: pattern cutting simulation). But behind the
scenes, all associated mesh representations (physics, collision, rendering)
have to be modified in a *consistent* manner. This essentially means that
we have to modify the geometry maps.

On Mon, Sep 25, 2017 at 4:50 PM, Milef, Nicholas Boris <milefn at rpi.edu>
wrote:

> imo Case 1 and 2 are the same (they share vertices along material edges).
> On mesh import, the vertices will be duplicated along each edge though (it
> works somewhat this way currently for different UV coordinates), so the
> connectivity data gets separated anyway per region at least with the Assimp
> importer. I'm not sure if you currently remesh this data though to
> eliminate duplicates. Maybe with Vega meshes it's different though.
>
> I don't think it's a common use case for deformable meshes to have
> multiple materials. Even if they did, it would likely be a very small
> number of materials, and it could possibly by represented by a custom
> shader. It's more for things like tools/environmental objects. If we map
> geometries, then we need to maintain render mesh data structures as well.
> I'm not sure what's supposed to happen if the user modifies the render mesh
> (or can they?). What do you think?
> ------------------------------
> *From:* Sreekanth Arikatla [sreekanth.arikatla at kitware.com]
> *Sent:* Monday, September 25, 2017 4:23 PM
> *To:* Milef, Nicholas Boris; imstk-developers at imstk.org
>
> *Subject:* Re: [Imstk-developers] Multiple materials per import
>
> Hi Nick,
>             I think there are two cases here:
>
> 1. Representing geometry of a *continuous object *with multiple meshes
> which could otherwise be represented using a single mesh
>
> 
> 2. Representing the body with an assembly of components with different
> meshes.
>
> 
> *Physics*:
>
> For the case 1, physics module can accept this but as a single mesh with
> each region optionally having different material properties. It is possible
> to treat them as separate meshes, but the formulation becomes unnecessarily
> complex. For case 2, each part of the assembly is modeled as a separate
> physics objects; and hence separate scene objects (since for example, the
> car is non-contiguous). The contact interactions between the component
> meshes will have to be defined which is a different matter.
>
> *Rendering*:
>
> I think rendering can also work if each partition is treated as different
> mesh in case 1. If this is done, then there will be a 1-to-many kind of
> geometry map when updating the visual meshes after each physics frame. To
> make this possible we can extend the current maps additionally introducing
> mesh id.
> There could be a rare case of many-to-1 (for car example) but I don't see
> much use for it.
>
>
>
> On Mon, Sep 25, 2017 at 2:25 PM, Milef, Nicholas Boris <milefn at rpi.edu>
> wrote:
>
>> Why couldn't we just split up the mesh on import into multiple
>> (physics/visual) meshes?
>> ------------------------------
>> *From:* Sreekanth Arikatla [sreekanth.arikatla at kitware.com]
>> *Sent:* Monday, September 25, 2017 1:42 PM
>> *To:* Milef, Nicholas Boris
>>
>> *Subject:* Re: [Imstk-developers] Multiple materials per import
>>
>> After this change, single physics mesh can map to a group of rendering
>> meshes. We might have to add the mesh ids to know which render mesh the
>> primitive belongs to.
>>
>> On Mon, Sep 25, 2017 at 12:44 PM, Milef, Nicholas Boris <milefn at rpi.edu>
>> wrote:
>>
>>> Ok we could do that for imstkSceneObject (allow setting of multiple
>>> visual meshes). This would mean that mesh readers could import multiple
>>> geometries. Why would we need mesh IDs though?
>>> ------------------------------
>>> *From:* Sreekanth Arikatla [sreekanth.arikatla at kitware.com]
>>> *Sent:* Monday, September 25, 2017 12:16 PM
>>> *To:* Milef, Nicholas Boris
>>> *Cc:* Alexis Girault; imstk-developers at imstk.org
>>>
>>> *Subject:* Re: [Imstk-developers] Multiple materials per import
>>>
>>> We already support multiple physics materials (thanks to Vega!) within
>>> the same mesh in iMSTK. One can define something called regions and assign
>>> different material properties for each region. Based on your described,
>>> this seems to be not practical for the case of render materials.
>>>
>>> One solution could be to have the visual geometry be composed of
>>> multiple meshes (optionally) while the physics and collision geometries are
>>> composed of one mesh-like now. In that case, we need to add mesh IDs in
>>> addition to primitive ID in the geometry mappers.
>>>
>>> On Mon, Sep 25, 2017 at 11:56 AM, Milef, Nicholas Boris <milefn at rpi.edu>
>>> wrote:
>>>
>>>> @Sreekanth, The meshes wouldn't be numbered contiguously in this case.
>>>> They would just be separate surface meshes. An example would be a car mesh.
>>>> You would have the tires with one material, body with another material,
>>>> windows with another, etc, so they would all belong to a car object but be
>>>> separate meshes. I think this makes sense as well for when you implement
>>>> materials for physics (with different friction coefficients, etc.).
>>>>
>>>> @Alexis, No we shouldn't disassociate the mesh from the material. By
>>>> applying the material per set of points, you risk having noncontiguous
>>>> triangles in this case. Also, down the line it makes it difficult to batch
>>>> draw objects similar materials.
>>>>
>>>> Multiple UV channel support (VTK multitexturing) doesn't relate to this
>>>> problem. In practice, multiple UV coords are only useful for lightmapping
>>>> or some very specialized use cases. Different meshes belonging to a larger
>>>> mesh (object) don't need unique UVs, they just need unique textures.
>>>> ------------------------------
>>>> *From:* Imstk-developers [imstk-developers-bounces at imstk.org] on
>>>> behalf of Sreekanth Arikatla [sreekanth.arikatla at kitware.com]
>>>> *Sent:* Monday, September 25, 2017 11:15 AM
>>>> *To:* Alexis Girault
>>>>
>>>> *Cc:* imstk-developers at imstk.org
>>>> *Subject:* Re: [Imstk-developers] Multiple materials per import
>>>>
>>>> We don't support multiple meshes for the same object in doing the
>>>> physics. However, if two non-connected meshes are numbered contiguously the
>>>> physics treats it as one but still simulates two bodies. This is generally
>>>> not done though since there is not much of a use case. It could happen at
>>>> runtime when one cuts a mesh into two (eg: pattern cutting simulator).
>>>>
>>>> On Mon, Sep 25, 2017 at 11:01 AM, Alexis Girault <
>>>> alexis.girault at kitware.com> wrote:
>>>>
>>>>> We wouldn't want to confuse geometries (mesh, etc...) with objects
>>>>> (scene object), which would be part of a scene graph when the needs come.
>>>>>
>>>>> Sreekanth: wouldn't creating multiple meshes for a unique object be a
>>>>> problem to handle physics?
>>>>>
>>>>> Nick: do we need to dissociate meshes per material? Could we retain a
>>>>> unique mesh and associate materials to a specific set of points/cells? I am
>>>>> remembering of the multi-texture support in VTK, where I had two sets of
>>>>> texture coordinates which allowed me to combine two textures at different
>>>>> parts of a unique mesh.
>>>>>
>>>>> Alexis Girault
>>>>> R&D Engineer in Medical Computing
>>>>> Kitware, Inc.
>>>>>
>>>>> http://www.kitware.com
>>>>> (919) 969-6990 x325
>>>>>
>>>>> On Mon, Sep 18, 2017 at 12:09 PM, Andinet Enquobahrie <
>>>>> andinet.enqu at kitware.com> wrote:
>>>>>
>>>>>> I would think we will need a scene graph support at some point in
>>>>>> iMSTK
>>>>>>
>>>>>> For example,
>>>>>>
>>>>>> https://www.sofa-framework.org/community/doc/main-principles
>>>>>> /scene-graph/
>>>>>>
>>>>>> On Mon, Sep 18, 2017 at 11:39 AM, Milef, Nicholas Boris <
>>>>>> milefn at rpi.edu> wrote:
>>>>>>
>>>>>>> Yes, it's very common to have this functionality, and many meshes we
>>>>>>> have use this. Currently, I have to individually export each material as a
>>>>>>> separate mesh, but this gets tedious when you end up with hundreds of
>>>>>>> meshes and have to separate/export each one individually. Also, managing
>>>>>>> these is a pain. Note that a single face can only have one material
>>>>>>> assigned to it (i.e., not layered materials).
>>>>>>>
>>>>>>> We still don't have the scene graph, but what if we introduce one
>>>>>>> and then when you import a mesh it adds a new node (called MeshGroup) under
>>>>>>> root (the scene) and then nodes (meshes) under the MeshGroup? Or it could
>>>>>>> be called MeshObject or something, etc.
>>>>>>> ------------------------------
>>>>>>> *From:* Sreekanth Arikatla [sreekanth.arikatla at kitware.com]
>>>>>>> *Sent:* Monday, September 18, 2017 11:03 AM
>>>>>>> *To:* Milef, Nicholas Boris
>>>>>>> *Cc:* imstk-developers at imstk.org
>>>>>>> *Subject:* Re: [Imstk-developers] Multiple materials per import
>>>>>>>
>>>>>>> Having mesh split and maintained as separate pieces might complicate
>>>>>>> imstk's geometry mappers. Do you have a use case from one of the projects?
>>>>>>>
>>>>>>> On Mon, Sep 18, 2017 at 10:52 AM, Milef, Nicholas Boris <
>>>>>>> milefn at rpi.edu> wrote:
>>>>>>>
>>>>>>>> This question has a subtle difference compared to a previous
>>>>>>>> question I asked before, but should we add support for mesh files with
>>>>>>>> multiple materials?
>>>>>>>>
>>>>>>>> When the mesh gets imported, the regions with a different material
>>>>>>>> would get split into a new mesh. Or should we introduce a new primitive
>>>>>>>> such as a MeshGroup to handle this? Or should we keep them as separate,
>>>>>>>> unrelated meshes?
>>>>>>>>
>>>>>>>> _______________________________________________
>>>>>>>> Imstk-developers mailing list
>>>>>>>> Imstk-developers at imstk.org
>>>>>>>> http://public.kitware.com/mailman/listinfo/imstk-developers
>>>>>>>>
>>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>> --
>>>>>>> Sreekanth Arikatla, Ph.D.,
>>>>>>> Senior R&D Engineer,
>>>>>>> Kitware, Inc. <http://www.kitware.com>, Carrboro, NC.
>>>>>>>
>>>>>>>
>>>>>>> _______________________________________________
>>>>>>> Imstk-developers mailing list
>>>>>>> Imstk-developers at imstk.org
>>>>>>> http://public.kitware.com/mailman/listinfo/imstk-developers
>>>>>>>
>>>>>>>
>>>>>>
>>>>>>
>>>>>> --
>>>>>> Andinet Enquobahrie, Ph.D., MBA
>>>>>> Director of Medical Computing
>>>>>> Kitware, Inc.
>>>>>>
>>>>>> http://www.kitware.com
>>>>>> (919) 969-6990 x311 <%28919%29%20969-6990%20x311>
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>> _______________________________________________
>>>>>> Imstk-developers mailing list
>>>>>> Imstk-developers at imstk.org
>>>>>> http://public.kitware.com/mailman/listinfo/imstk-developers
>>>>>>
>>>>>>
>>>>>
>>>>> _______________________________________________
>>>>> Imstk-developers mailing list
>>>>> Imstk-developers at imstk.org
>>>>> http://public.kitware.com/mailman/listinfo/imstk-developers
>>>>>
>>>>>
>>>>
>>>>
>>>> --
>>>> Sreekanth Arikatla, Ph.D.,
>>>> Senior R&D Engineer,
>>>> Kitware, Inc. <http://www.kitware.com>, Carrboro, NC.
>>>>
>>>>
>>>
>>>
>>> --
>>> Sreekanth Arikatla, Ph.D.,
>>> Senior R&D Engineer,
>>> Kitware, Inc. <http://www.kitware.com>, Carrboro, NC.
>>>
>>>
>>
>>
>> --
>> Sreekanth Arikatla, Ph.D.,
>> Senior R&D Engineer,
>> Kitware, Inc. <http://www.kitware.com>, Carrboro, NC.
>>
>>
>
>
> --
> Sreekanth Arikatla, Ph.D.,
> Senior R&D Engineer,
> Kitware, Inc. <http://www.kitware.com>, Carrboro, NC.
>
>

-- 
Sreekanth Arikatla, Ph.D.,
Senior R&D Engineer,
Kitware, Inc. <http://www.kitware.com>, Carrboro, NC.
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://public.kitware.com/pipermail/imstk-developers/attachments/20170925/9b2e1377/attachment-0001.html>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: MeshGroup.png
Type: image/png
Size: 165521 bytes
Desc: not available
URL: <http://public.kitware.com/pipermail/imstk-developers/attachments/20170925/9b2e1377/attachment-0002.png>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: partitionedMesh.png
Type: image/png
Size: 59696 bytes
Desc: not available
URL: <http://public.kitware.com/pipermail/imstk-developers/attachments/20170925/9b2e1377/attachment-0003.png>