I want to make anonymous sign language videos without having to go through the effort of manually animating a cartoon. Likewise I don’t want to pay anything for equipment, or have to use proprietary software. I’d prefer not to use anything too difficult to set up, but if that’s how it has to be then I’ll resign myself to it.

So, what sort of software could I use where I could just input a pre-recorded video of myself and have the machine spit out a new video of a different person or character making the same movements? Any names, pros and cons? How do they capture fine movements of the fingers and face?

Linux Mint Xfce on a “gaming laptop” from a few years ago with an Nvidia GPU, by the way.

Posted at 5:30 AM (no sleep)

  • ComradeOohAah [he/him, they/them]@hexbear.netEnglish
    6·
    25 days ago

    Do you have VR? VRChat might be an option. I know you’re not looking to spend money, but if you’re looking to do a bunch of projects like this, it might be worth it. It’s at least possibly much cheaper than a full mocap setup. I recently snagged a Quest Pro off of Facebook Marketplace for a couple hundred bucks and it’s got eye tracking, face tracking, and hand tracking. Of course that’s assuming your gaming laptop can handle it. If it’s 1050ti or newer you might be okay.

    I don’t have any experience personally, but just googling webcam face mocap will give you plenty of options because AR like filter stuff is so plentiful. You might have to roll your own, but it could probably be vibe coded if you’ve got any experience in a specific game engine or something.

    • Erika3sis [she/her, xe/xem]@hexbear.netOPEnglish
      4·
      25 days ago

      I guess if push comes to shove I could get a VR headset and see if I can figure out VRchat, although I do worry a bit about e.g. bumping into things or feeling nauseous. VRchat for signing is a trade-off due to the fewer handshapes but I could probably work around it.

      • ComradeOohAah [he/him, they/them]@hexbear.netEnglish
        4·
        25 days ago

        although I do worry a bit about e.g. bumping into things or feeling nauseous

        There’s a thing called a chaperone that you set up to define your space’s boundaries and then a little glowing wall pops up as you approach them, which can be super helpful. Most folks don’t have nausea issues until they start doing stuff like using the stick to move or a rollercoaster or something. If you’re just moving around in your space you will hopefully be okay.

        As much as I dislike Meta, I do recommend buying their headsets used because for the price point that you can usually find them at, you’re not going to beat it with the feature set they offer. Plus, you can use them with SteamLink for PCVR.

        I know you’re not in the US, but I’ll include the prices I would recommend holding out for in my area so you’ll have a feel for value.

        • Quest 2 (2020, discontinued Dec 2024. Will Receive Feature Updates until Dec 2026 and Security updates until Dec 2027.) is the oldest of the range I would consider still usable. It has Hand Tracking only and very limited pass through. ( Passthrough is the ability to see through the headset cameras with AR placing virtual objects in your real space.) People try to sell them around me for $200 to $300 dollars but they’re not worth that at all and eventually show up for less than $100. $50 - $75 is not out of the question if I’m checking once a day, and I’ve even seen them go for as little as $25 but they go very fast.
        • Quest Pro (2022, also discontinued Dec 2024. Will Receive Feature Updates until Dec 2026 and Security updates until Dec 2027.) Way more features. Better pass through cameras, better (supposedly best) hand tracking, has eye tracking and face tracking. This is what I would recommend if facial expressions are important to you. It was released more as a Developer Kit / Enterprise unit and became popular with VRChat folks because of how much it brought to the table. People around me try to sell them typically $600 to $800 on the high end. But more realistically around $400 or so. A good deal would be $200 to $300. Anything below that would be someone strapped for cash or no idea what they have, and they will go quick.
        • Quest 3 (2023) No face or Eye tracking. Better Hand tracking than Quest 2. Supposed to the best as far as Passthrough cameras go. Better screen than Quest Pro. I have not tried this one or the next yet. On the High end $400 - $600. Realistically around $200 is a good deal, but I’ve seen it for as low as $150 on occasion.
        • Quest 3s (2024) No face or Eye tracking. Better Hand tracking than Quest 2. A much cheaper version of the Quest 3 because they removed a depth sensor, and changed up the lenses. $300 is high. I’ve seen as low as $100, I wouldn’t pay more than $150.

        End info dump. data-laughing