jwa

🌜
🌞

Project White Glove

Cover Image for Project White Glove
Jason
Jason

I recently got an Oculus Quest, maybe not recently but like last year, and even using the passthrough/handsfree gets me excited. It got me started to think about the current devices I use and how interact with them when it comes to controlling things.

Whenever I watch a movie like Her or a show like Black Mirror I’m always so jealous of the technology in these futuristic movies and how natural and fluid they seem/integrate with the surrounding environments. Hand gestures and muffled voices are picked up and understood immediately by these AI and computers and then they do exactly what the user thinks. With a slight grunt and wave of the wand and the main character's workspace clears itself and shuts down. Taking in the context of what the user is doing and then performing the correct task based on the same gesture that could be used for something else is really interesting.

So as a developer the first thing that came to mind was how can I build something like this? How about a browser extension that uses the webcam to track the user's hand gestures to control the web browser? This extension would also use the javascript library webgazerjs to track the users' eyes and trigger certain actions depending on what they’re looking at. While I was thinking about this and researching some things I came across an existing library which basically performed all the functions I wanted. It's called handsfreejs and it is incredible. I was so happy that it already existed and now I got to thinking about the next step, how can I make the physical portion of this?

Looking at the STEM player and the mouse I think there’s an interesting intersection on how we can manipulate inputs and stuff. I think the physical component would be incredible and could even have voice commands.

Physical Version

  • Something that heavily resembles the YEEZY STEM PLAYER and acts as a gesture-based mouse.
  • The camera looks up through the middle to capture hand movements.
  • Would require an environmental sensor for light detection.

my thoughts

Cover Image for Her - Video Game Scene

Her - Video Game Scene

I've watched the movie Her several times. Mainly for the aesthetics, the tech, and inspiration when I'm looking to work on new projects. One of the main things I like about the movie is how the tech is so advanced but doesn't conform to the usual overly futuristic approach. The dystopian type.

Cover Image for I Need An Account-a-bill-ity

I Need An Account-a-bill-ity

I can be terrible at holding myself accountable when it comes to getting things done. Like, I’ll write down so many things I have to get done but they seem to not get done unless I put myself at some risk or there is a reward involved ($$$). I know, shameless. So I thought to myself . . .