Releases: ButzYung/SystemAnimatorOnline
XR Animator 0.30.0 - Windows, Linux and macOS version
Changes
- 💡Support exporting 3D wallpaper to glTF model (video demo)
- 💡Fix VRM joint stiffness issue once and for all that affects some models
- Add "AI model inference device" option for face tracking, supporting switching between CPU and GPU to run the face tracking model
- Improve BVH motion importer and exporter to be more faithful to the format specification
- Reduce head rotation jerkiness caused by the occasional loss of face tracking
- Improve the handling of lost body tracking and prevent T pose from appearing before the loss of tracking
- Improve idle arm's elbow rotation during upper body mocap
- Change animation parameters to fit better with the aspect ratio of the image in the desktop mode of 3D wallpaper
- Fix missing foot frames when exporting motion to BVH or glTF while leg IK is in use
- Fix the display of 3D wallpaper loading complete message
Backports
- Support macOS (BETA testing) (backported from v0.33.3)
- Apply a default, non-mandatory frame rate setting (30) for webcam (backported from v0.33.2)
- Change the behavior of non-default frame rate setting of webcam input to mandatory (NOTE: webcam may not load if the required frame rate is not supported) (backported from v0.33.2)
- Add "Escape" key function to "/" key on virtual numpad in mobile web app, allowing functions such as toggling of UI display and closing of speech bubbles (backported from v0.33.5)
- Send VRM 1.0 blendshape names by default for VRM 1.0 model when using VMC protocol (backported from v0.34.4-b)
- Support 3D wallpaper feature (depth estimation) on browsers without WebGPU (using WASM as fallback) (backported from v0.31.0)
- Improve the animation and performance of "2D-to-3D Wallpaper" app mode (backported from v0.34.2)
- Fix startup error related to an electron-only feature about window position which shouldn't exist in web app mode (backported from v0.34.2)
- Fix bug in which the frame rate setting of webcam was not properly applied (backported from v0.33.2)
- Fix regression in 3D scene builder in which deleting a 3D object would return error (backported from v0.33.3)
- Fix regression regarding 3D camera control in System Animator application outside of XR Animator (backported from v0.34.3)
- Fix webcam listing in web app mode (backported from v0.33.5)
- Fix webcam issue in macOS web app mode (backported from v0.34.2)
- Remove and fix obsolete/redundant files
🧪Beta testing for macOS version🍎
The macOS version of XR Animator is now under beta testing. Make sure that you read the readme included for installation instructions. Please report any bug or issue🙏
🎵Musical instrument mocap🎵
The 3D prop of each supported instrument can be downloaded below.
- Guitar collection (acoustic, electric, bass and ukulele)
- Violin
- Cello
- Piano
- Electric piano
- Flute
- Saxophone
- Harp
❤️Support this project❤️
The future of XR Animator relies on your support🙇 Some IRL family issues have significantly increased my financial burden. While it was fun to develop the app, financial return was next to minimal. Reality forces me to evaluate the sustainability of this project, or soon I will have to give up...😢
If you like XR Animator, please consider making a donation🙇 Or even better, join my membership with perks such as EARLY ACCESS to the latest version XR Animator (at least 5 months ahead of the public release on GitHub), insider stories/tips and other benefits🎁 Sponsor us, and help keep this project free and sustainable🙏
XR Animator 0.29.1-b - Windows, Linux and macOS version
Changes
- 💡Add "Arm IK" option, enforcing the use of IK to calculate arm position and preventing arm jitter when switching between IK and FK (video demo)
- 💡Add "Portrait mode" option, which allows vertical video input from webcam
- 💡Add "Keep worker thread" option for 3D wallpaper, which significantly reduces resident memory usage when set to "No" (default)
- Stabilize upper body mocap when leaning near the camera while standing
- Stabilize prop alignment when getting too close to the target
- Update the parameters of some preset poses
- Improve elbow positioning during upper body mocap
- Fix regression affecting the adjustment of arm position during upper body mocap
- Fix bugs concerning the detaching of prop in which some parameters didn't reset properly
- Update MediaPipe (v0.10.18)
- Update electron (v33.2.0)
Backports
- Support macOS (BETA testing) (backported from v0.33.3)
- Apply a default, non-mandatory frame rate setting (30) for webcam (backported from v0.33.2)
- Change the behavior of non-default frame rate setting of webcam input to mandatory (NOTE: webcam may not load if the required frame rate is not supported) (backported from v0.33.2)
- Add "Escape" key function to "/" key on virtual numpad in mobile web app, allowing functions such as toggling of UI display and closing of speech bubbles (backported from v0.33.5)
- Support 3D wallpaper feature (depth estimation) on browsers without WebGPU (using WASM as fallback) (backported from v0.31.0)
- Improve the animation and performance of "2D-to-3D Wallpaper" app mode (backported from v0.34.2)
- Fix startup error related to an electron-only feature about window position which shouldn't exist in web app mode (backported from v0.34.2)
- Fix bug in which the frame rate setting of webcam was not properly applied (backported from v0.33.2)
- Fix regression in 3D scene builder in which deleting a 3D object would return error (backported from v0.33.3)
- Fix webcam listing in web app mode (backported from v0.33.5)
- Fix webcam issue in macOS web app mode (backported from v0.34.2)
- Remove and fix obsolete/redundant files
🧪Beta testing for macOS version🍎
The macOS version of XR Animator is now under beta testing. Make sure that you read the readme included for installation instructions. Please report any bug or issue🙏
🎵Musical instrument mocap🎵
The 3D prop of each supported instrument can be downloaded below.
- Guitar collection (acoustic, electric, bass and ukulele)
- Violin
- Cello
- Piano
- Electric piano
- Flute
- Saxophone
- Harp
❤️Support this project❤️
The future of XR Animator relies on your support🙇 Some IRL family issues have significantly increased my financial burden. While it was fun to develop the app, financial return was next to minimal. Reality forces me to evaluate the sustainability of this project, or soon I will have to give up...😢
If you like XR Animator, please consider making a donation🙇 Or even better, join my membership with perks such as EARLY ACCESS to the latest version XR Animator (at least 5 months ahead of the public release on GitHub), insider stories/tips and other benefits🎁 Sponsor us, and help keep this project free and sustainable🙏
XR Animator 0.29.0 - Windows, Linux and macOS version
Changes
- 💡Add support for object detection AI, which tracks specific IRL objects on webcam feed (video demo)
- Fix VRM1.0 bone rotation issues when connecting to Warudo via VMC protocol
- Fix scene reset
- Fix settings reset
- Fix bug in "2D-to-3D Wallpaper" for desktop and use default wallpaper when the last used image no longer exists
- Update Transformers.js (v3.0.0)
Backports
- Support macOS (BETA testing) (backported from v0.33.3)
- Apply a default, non-mandatory frame rate setting (30) for webcam (backported from v0.33.2)
- Change the behavior of non-default frame rate setting of webcam input to mandatory (NOTE: webcam may not load if the required frame rate is not supported) (backported from v0.33.2)
- Add "Escape" key function to "/" key on virtual numpad in mobile web app, allowing functions such as toggling of UI display and closing of speech bubbles (backported from v0.33.5)
- Fix startup error related to an electron-only feature about window position which shouldn't exist in web app mode (backported from v0.34.1)
- Fix bug in which the frame rate setting of webcam was not properly applied (backported from v0.33.2)
- Fix regression in 3D scene builder in which deleting a 3D object would return error (backported from v0.33.3)
- Fix webcam listing in web app mode (backported from v0.33.5)
- Remove and fix obsolete/redundant files
🧪Beta testing for macOS version🍎
The macOS version of XR Animator is now under beta testing. Make sure that you read the readme included for installation instructions. Please report any bug or issue🙏
🎵Musical instrument mocap🎵
The 3D prop of each supported instrument can be downloaded below.
- Guitar collection (acoustic, electric, bass and ukulele)
- Violin
- Cello
- Piano
- Electric piano
- Flute
- Saxophone
- Harp
❤️Support this project❤️
The future of XR Animator relies on your support🙇 Some IRL family issues have significantly increased my financial burden. While it was fun to develop the app, financial return was next to minimal. Reality forces me to evaluate the sustainability of this project, or soon I will have to give up...😢
If you like XR Animator, please consider making a donation🙇 Or even better, join my membership with perks such as EARLY ACCESS to the latest version XR Animator (at least 5 months ahead of the public release on GitHub), insider stories/tips and other benefits🎁 Sponsor us, and help keep this project free and sustainable🙏
XR Animator 0.28.1 - Windows/Linux/macOS version
Changes
- 💡Add "Super resolution" option for 3D wallpaper, which uses AI to upscale low-res image input (video demo)
- 💡Add "Create 3D desktop wallpaper shortcut" option for 3D wallpaper, which launches XR Animator in a special 3D-wallpaper-only mode for desktop use
- 💡Add options for 3D wallpaper to switch AI model for depth map generation and super resolution
- Add support for accepting scene JSON input anywhere and anytime after app start
- Add "Image input handler" setting under background image options, which allows handling any image input as wallpaper by default
- Move some calculations of 3D wallpaper from CPU to GPU shader which improves real-time responsiveness
- Reduce unused resource loading when avatar model is not used
- Suppress error message when creating desktop shortcut
- Fix bug which prevented depth map from being applied to 3D wallpaper when depth map was not transformed
- Fix bug and accept video wallpaper only when 3D wallpaper is disabled
- Fix legacy settings window which failed to update when only SELECT inputs changed
- Fix regression which broke file dropping when running in desktop wallpaper mode
- Update three-vrm (v3.1.2)
- Update electron-as-wallpaper (v1.0.8)
- Update transformers.js (v3.0.0-alpha.19)
Backports
- Support macOS (BETA testing) (backported from v0.33.3)
- Apply a default, non-mandatory frame rate setting (30) for webcam (backported from v0.33.2)
- Change the behavior of non-default frame rate setting of webcam input to mandatory (NOTE: webcam may not load if the required frame rate is not supported) (backported from v0.33.2)
- Add "Escape" key function to "/" key on virtual numpad in mobile web app, allowing functions such as toggling of UI display and closing of speech bubbles (backported from v0.33.5)
- Fix bug in which the frame rate setting of webcam was not properly applied (backported from v0.33.2)
- Fix regression in 3D scene builder in which deleting a 3D object would return error (backported from v0.33.3)
- Fix webcam listing in web app mode (backported from v0.33.5)
- Remove and fix obsolete/redundant files
🧪Beta testing for macOS version🍎
The macOS version of XR Animator is now under beta testing. Make sure that you read the readme included for installation instructions. Please report any bug or issue🙏
Instrument mocap
The 3D prop of each supported instrument can be downloaded below.
- Guitar collection (acoustic, bass, stratocaster and ukulele)
- Violin
- Cello
- Piano
- Electric piano
- Flute
- Saxophone
- Harp
❤️Support this project❤️
The future of XR Animator relies on your support🙇 Some IRL family issues have significantly increased my financial burden. While it was fun to develop the app, financial return was next to minimal. Reality forces me to evaluate the sustainability of this project, or soon I will have to give up...😢
If you like XR Animator, please consider making a donation🙇 Or even better, join my membership with perks such as EARLY ACCESS to the latest version XR Animator (at least 3 months ahead of the public release on GitHub), insider stories/tips and other benefits🎁 Sponsor us, and help keep this project free and sustainable🙏
XR Animator 0.28.0 - Windows/Linux/macOS version
Changes
- 💡Add 3D wallpaper support by turning 2D image into 3D backdrop with AI-generated depth map (video demo)
- 💡Enhance "Camera face-locking" feature with customizable options
- Reduce avatar movement jitters during full body mocap
- Fix some options with missing buttons on mouse hover
- Fix bug when using mouse to change option values via buttons which might break the 3D camera control
Backports
- Support macOS (BETA testing) (backported from v0.33.3)
- Apply a default, non-mandatory frame rate setting (30) for webcam (backported from v0.33.2)
- Change the behavior of non-default frame rate setting of webcam input to mandatory (NOTE: webcam may not load if the required frame rate is not supported) (backported from v0.33.2)
- Fix bug in which the frame rate setting of webcam was not properly applied (backported from v0.33.2)
- Fix regression in 3D scene builder in which deleting a 3D object would return error (backported from v0.33.3)
- Remove and fix obsolete/redundant files
🧪Beta testing for macOS version🍎
The macOS version of XR Animator is now under beta testing. Make sure that you read the readme included for installation instructions. Please report any bug or issue🙏
Instrument mocap
The 3D prop of each supported instrument can be downloaded below.
- Guitar collection (acoustic, bass, stratocaster and ukulele)
- Violin
- Cello
- Piano
- Electric piano
- Flute
- Saxophone
- Harp
❤️Support this project❤️
The future of XR Animator relies on your support🙇 Some IRL family issues have significantly increased my financial burden. While it was fun to develop the app, financial return was next to minimal. Reality forces me to evaluate the sustainability of this project, or soon I will have to give up...😢
If you like XR Animator, please consider making a donation🙇 Or even better, join my membership with perks such as EARLY ACCESS to the latest version XR Animator (at least 3 months ahead of the public release on GitHub), insider stories/tips and other benefits🎁 Sponsor us, and help keep this project free and sustainable🙏
XR Animator 0.27.4b - Windows and Linux version
Changes
- (Backported from v0.33.2) Apply a default, non-mandatory frame rate setting (30) for webcam
- (Backported from v0.33.2) Change the behavior of non-default frame rate setting of webcam input to mandatory (NOTE: webcam may not load if the required frame rate is not supported)
- (Backported from v0.33.2) Fix bug in which the frame rate setting of webcam was not properly applied
- (Backported) Remove and fix obsolete/redundant files
Changes from v0.27.4
- Support syncing of prop scaling when connected to Warudo (video demo)
- Improve the ease of use of UI options that require keys (namely ⬅️➡️➕➖) to change value with clickable buttons as alternative to key press
- Improve eye tracking during blinks, especially when eyes are not centered
- Improve 3D scene builder by allowing +/- key input from keyboard without keypad
- Fix "Z-depth scale" option of AI model quality which failed to change on first click when the value was "Medium"
Instrument mocap
The 3D prop of each supported instrument can be downloaded below.
- Guitar collection (acoustic, bass, stratocaster and ukulele)
- Violin
- Cello
- Piano
- Electric piano
- Flute
- Saxophone
- Harp
❤️Support this project❤️
The future of XR Animator relies on your support🙇 Some IRL family issues have significantly increased my financial burden. While it was fun to develop the app, financial return was next to minimal. Reality forces me to evaluate the sustainability of this project, or soon I will have to give up...😢
If you like XR Animator, please consider making a donation🙇 Or even better, join my membership with perks such as EARLY ACCESS to the latest version XR Animator (at least 2 months ahead of the public release on GitHub), insider stories/tips and other benefits🎁 Sponsor us, and help keep this project free and sustainable🙏
XR Animator 0.27.4 - Windows and Linux version
Changes
- Support syncing of prop scaling when connected to Warudo (video demo)
- Improve the ease of use of UI options that require keys (namely ⬅️➡️➕➖) to change value with clickable buttons as alternative to key press
- Improve eye tracking during blinks, especially when eyes are not centered
- Improve 3D scene builder by allowing +/- key input from keyboard without keypad
- Fix "Z-depth scale" option of AI model quality which failed to change on first click when the value was "Medium"
Instrument mocap
The 3D prop of each supported instrument can be downloaded below.
- Guitar collection (acoustic, bass, stratocaster and ukulele)
- Violin
- Cello
- Piano
- Electric piano
- Flute
- Saxophone
- Harp
❤️Support this project❤️
The future of XR Animator relies on your support🙇 Some IRL family issues have significantly increased my financial burden. While it was fun to develop the app, financial return was next to minimal. Reality forces me to evaluate the sustainability of this project, or soon I will have to give up...😢
If you like XR Animator, please consider making a donation🙇 Or even better, join my membership with perks such as EARLY ACCESS to the latest version XR Animator (at least 2 months ahead of the public release on GitHub), insider stories/tips and other benefits🎁 Sponsor us, and help keep this project free and sustainable🙏
XR Animator 0.27.3 - Windows and Linux version
Changes
- Add "Camera auto-zoom" option (video demo)
- Adjust motion parameters of various poses and motions for upper body mocap
- Fix random arm glitches when switching body collider mode from on to off during full body mocap
- Fix "VRM joint stiffness" setting when imported from external settings JSON
- Update MediaPipe Tasks Vision (v0.10.15)
- Update electron (v32.0.1)
Instrument mocap
The 3D prop of each supported instrument can be downloaded below.
- Guitar collection (acoustic, bass, stratocaster and ukulele)
- Violin
- Cello
- Piano
- Electric piano
- Flute
- Saxophone
- Harp
❤️Support this project❤️
The future of XR Animator relies on your support🙇 Some IRL family issues have significantly increased my financial burden. While it was fun to develop the app, financial return was next to minimal. Reality forces me to evaluate the sustainability of this project, or soon I will have to give up...😢
If you like XR Animator, please consider making a donation🙇 Or even better, join my membership with perks such as EARLY ACCESS to the latest version XR Animator (at least 2 months ahead of the public release on GitHub), insider stories/tips and other benefits🎁 Sponsor us, and help keep this project free and sustainable🙏
XR Animator 0.27.2 - Windows and Linux version
Changes
- Add "Mocap data smoothing" option, allowing less smoothing for more motion details (video demo)
- Add new pose (Sit 17)
- Improve background tasking (e.g. VMC-protocol) when app window is minimized
- Increase the precision of video timestamp, which improves the general smoothness of mocap and motion recording
- Increase the sensitivity of blendshape data being recorded during motion recording
- Fix "手捩" bone rotation which could be distorted when its arm was out of screen during full body mocap
- Fix blendshape recording in which data might not be properly reset during motion recording
- Fix the smoothing factor of data filter during motion recording when the recording speed is below 1
- Fix regression which broke the mapping of middle finger naming when importing FBX/glTF motion
- Fix "Rest all settings" option which failed to reset a few settings
- Fix motion config import to allow config of new motion to be imported before the motion is loaded
Instrument mocap
The 3D prop of each supported instrument can be downloaded below.
- Guitar collection (acoustic, bass, stratocaster and ukulele)
- Violin
- Cello
- Piano
- Electric piano
- Flute
- Saxophone
- Harp
❤️Support this project❤️
The future of XR Animator relies on your support🙇 Some IRL family issues have significantly increased my financial burden. While it was fun to develop the app, financial return was next to minimal. Reality forces me to evaluate the sustainability of this project, or soon I will have to give up...😢
If you like XR Animator, please consider making a donation🙇 Or even better, join my membership with perks such as EARLY ACCESS to the latest version XR Animator (at least 2 months ahead of the public release on GitHub), insider stories/tips and other benefits🎁 Sponsor us, and help keep this project free and sustainable🙏
XR Animator 0.27.1 - Windows and Linux version
Changes
- Add "Hip adjustment" support for full body mocap (video demo)
- Add "Chest rotation offset" option for hip adjustment, which appplies a chest rotation offset based on head rotation
- Add "Blink clarity" option for face tracking, which increases the contrast between eye open and close status, making it easier to activate a full blink
- Push the lower limit of "VRM joint stiffness" setting down to 10%
- Offset hip adjustment when using hip camera during upper body mocap
- Change the upper and lower limit of various settings in hip adjustment
- Add eyebrow adjustment into the face tracking calibration process
- Fix motion recording when the position of the center bone might be missing in some cases during upper body mocap
- Update three-vrm (v2.1.3)
Instrument mocap
The 3D prop of each supported instrument can be downloaded below.
- Guitar collection (acoustic, bass, stratocaster and ukulele)
- Violin
- Cello
- Piano
- Electric piano
- Flute
- Saxophone
- Harp
❤️Support this project❤️
The future of XR Animator relies on your support🙇 Some IRL family issues have significantly increased my financial burden. While it was fun to develop the app, financial return was next to minimal. Reality forces me to evaluate the sustainability of this project, or soon I will have to give up...😢
If you like XR Animator, please consider making a donation🙇 Or even better, join my membership with perks such as EARLY ACCESS to the latest version XR Animator (at least 2 months ahead of the public release on GitHub), insider stories/tips and other benefits🎁 Sponsor us, and help keep this project free and sustainable🙏