getToTheChopin

12개월 전discuss

Thank you! I spent a lot of time tuning the synth parameters in tonejs to try to get something I was happy with.

The scales are based on the Japanese "in" pentatonic scale (sometimes called the Sakura scale), which I find really pretty.

getToTheChopin

작년discuss

here's the demo video on youtube as well: https://youtu.be/XBn5F72aIbg

getToTheChopin

작년discuss

thank you. I thought of this on a roadtrip and was very keen to start building it when I got home.

getToTheChopin

작년discuss

This is a computer vision experiment, using voice + hand gestures to control a shader animation.

This uses a liquid Chladni pattern, with controls for color and wave frequency / amplitude.

Created using threejs, mediapipe computer vision, and web speech API.

getToTheChopin

작년discuss

Thank you for the feedback. I'll continue to work on it!

getToTheChopin

작년discuss

I'll try it, thank you! I separated them into completely different interaction modes to avoid misfires, but there's definitely room for efficiencies

getToTheChopin

작년discuss

It's a shame that computer vision tech like Leap / Eyetoy / Kinect didn't have lasting power. So much fun to build with

getToTheChopin

작년discuss

I made a demo game where you need to dodge the evil bouncing DVD logo by moving your body: https://x.com/measure_plan/status/1924830500541157570

I'm working on a couple other body movement concepts and hope to share soon :)

getToTheChopin

작년discuss

Good points, maybe a second camera (phone?) pointed downwards at the tabletop would be good for that. Then the user can rest their hands in a "normal" position.

Thank you for the feedback!

getToTheChopin

작년discuss

yes I'd love to go further with this concept so that 3D / CAD designers could easily present their models during video calls.

thank you!

getToTheChopin

작년discuss

Sorry about that, the instructions need to be improved.

Does this video demo help?

https://x.com/measure_plan/status/1929900748235550912

If it makes it clearer, I'll upload it to the github repo directly

getToTheChopin

작년discuss

Here's a quick video demo showing how it works: https://x.com/measure_plan/status/1929900748235550912

getToTheChopin

작년discuss

I'm working on it now! thank you

getToTheChopin

작년discuss

3D model control (move, rotate, scale, animate) using hand gestures and voice commands, running in real-time in the browser

Created with threejs, mediapipe computer vision, and web speech API

3D model from Quaternius

Here's the live demo if you want to try: https://rosebud.ai/p/93986db5-4d99-437f-9e8b-c8d742e131da

Any feedback would be appreciated!

getToTheChopin

작년discuss

Created using threejs, mediapipe computer vision, web speech API, and Vasco Asturiano's 3D-force-graph library

getToTheChopin

작년discuss

I made a game. It's called PC versus Mac.

Use your hands to show support for Bill Gates or Steve Jobs.

Created with threejs and mediapipe computer vision.

Game link: https://rosebud.ai/p/8bd0a69f-f009-4af4-b3c6-9e60f356e98f

getToTheChopin

작년discuss

Recreating the Macrodata Refinement game from Severance.

Built with threejs, rosebud AI, mediapipe computer vision for hand tracking, and tone.js for sound effects.

I haven't added any patterns or number puzzles to solve yet, any ideas?

To try the game demo: https://rosebud.ai/p/5f611cac-59e5-44c5-8807-8b41b7c4b6e2

getToTheChopin

작년discuss

Using speech recognition to toggle between drag / rotate / zoom interactions, and hand gestures to move the nodes of the graph

Created with threejs, rosebud AI, mediapipe computer vision, web speech API, and Vasco Asturiano's 3D-force-graph library

Runs in real-time in the browser using a regular laptop + webcam

Live demo (works best on chrome desktop): https://rosebud.ai/p/557dbe2b-b037-42df-a137-249f8a57341d

getToTheChopin

작년discuss

Quick tech demo powered by a regular laptop webcam, cesiumjs, and mediapipe computer vision.

Runs in real-time in the browser.

getToTheChopin

작년discuss

I made a website. It's called "am i a banana?"

it uses your camera and detects bananas in real-time (using COCO dataset / tensor flow).

Demo video: https://x.com/measure_plan/status/1919772316755542200

that's it. have fun!

getToTheChopin

Submissions

Bringing wii-kinect-eyetoy tech to the browser

Show HN: Turning Hand Movement into Music

Show HN: I made 3 cursed captchas

Show HN: Snacker News; a hands-free HN. The more you eat, the more you learn

Show HN: Planking for penguins, a real-time exercise tracking game

Show HN: I made a game which forces me to workout (do a chin-up, save a cat)

Show HN: Do a chin-up, save a cat (mediapipe and threejs real-time browser game)

Show HN: The floor is lava, a body movement + computer vision game

Designing a shader using voice and hand gestures

Show HN: Making music on the web with hand gestures (open source repo)

Show HN: Hand-controlled arpeggiator, drum machine, and audio reactive visuals

Show HN: I'm making a virtual drum machine using webcam / hand gesture controls

Show HN: Controlling 3D models with voice and hand gestures

Show HN: Using hand gestures and voice to control 3D models

3D model control using hand gestures and voice commands

Using hand gestures and voice commands to control a 3D data visualization

PC versus Mac, a computer vision webgame

Macrodata refinement, using hand gestures

Controlling a 3D graph with hand and voice commands

Show HN: DVD dodge, a body movement web game

comments