hand-tracking-controls component detaches children (+fix & ideas)

[coderofsalvation]

• A-Frame Version: 1.5.0
• Platform / Device: Firefox/Brave

Normal/Expected behaviour:

<a-entity laser-controls="hand:left">
  <!-- adding objects here will attach it to the controller just fine -->
</a-entity>

however...after adding hand-tracking-controls

<a-entity laser-controls="hand:left" hand-tracking-controls="hand:left">
  <!-- here the objects no longer show up..neither with controller nor hand-tracking :/ -->
</a-entity>

Fix

This patch will re-attach the children to the wrist.

AFRAME.components['hand-tracking-controls'].Component.prototype.onModelLoaded = function(onModelLoaded){
  return function(e){
    onModelLoaded.apply(this);
    // re-attach children 
    ([...this.el.children]).map( (c) => {
      if( c.object3D ){
        this.el.object3D.getObjectByName("wrist").add(c.object3D)
      }
    })
  }
}(AFRAME.components['hand-tracking-controls'].Component.prototype.onModelLoaded)

I'm not really sure what the right solution is, as not every hand model might contain a 'wrist' object.

I played with several ideas:

• add the code above directly to onModelLoaded of hand-tracking-controls
• introduce an attribute <a-entity hand-tracking-controls="children: 'wrist'"> which is wrist by default e.g.
• introduce an component hand-attach="wrist: #foo; index: #bar which allows for finer-grained parenting

One remaining question is how to deal with switching between hands/laser-controllers.

Hope this helps!

[dmarcos]

What is the scenario you need to switch from laser-controls to hand tracking and viceversa?

[coderofsalvation]

It's more accessibility/flexibility in XR in general:

• wear menu on your lasercontroller (if the user is holding controllers)
• wear menu on your wrist (if the user is using hands)

I think it's important to offer experiences which works both with lasercontrols and hand-tracking (not all XR/VR endusers have handtracking).