Project Soli – World’s Tiniest Violin

Created by Design I/O, World’s Tiniest Violin is a 'speed project' that uses Google's Project Soli - Alpha Dev Kit combined with the Wekinator machine learning tool and openFrameworks to detect small movements that look like someone playing a tiny violin and translate that to control the playback and volume of a violin solo.

The team used the Project Soli openFrameworks example provided with the ofxSoli addon and searched for the signal that seemed to correlate closest with the tiny violin gesture. In this case it was the fine displacement signal, which then they fed the delta of to Wekinator via OSC. Theo (Design I/O) then had to train Wekinator on what types of finger movements corresponded to playing the violin and which ones it should reject. So he recorded a few different finger movements and assigned the value of 1.0 on the slider. The slider to 0.0 and recorded gestures were then set which didn't correspond: like pulling your hand away from the sensor, or just holding it there without moving your fingers. After a few minutes of recording these gestures, the 'training' was initiated and they were then able to send back an animated value ranging from 0.0 to 1.0 representing how much Theo’s hand looked like it was trying to play a tiny violin. The last step was to map that number to the volume of the violin sample that was being played back by the openFrameworks app.

Support CreativeApplications.Net

Since 2008, CreativeApplications.Net (CAN) has been a driving force, tirelessly influencing and shaping the conversations surrounding technology, society, and critical making. With a community of 1600+ members and a vast library boasting over 3,500 meticulously curated projects, experiments, texts, and reviews, CAN stands resolute as an unparalleled resource for students, educators, practitioners, curators, and cultural producers.

However, as we navigate the stark reality of independent publishing, we need your help! Please embark on this journey with us, extending your support by joining our community as a Member and contributing to our shared mission of propelling CAN forward.

Joining CAN is only $20 per year! (less than $2 per month) and it includes:

  • Access thousands of projects, scores of essays, interviews and reviews.
  • Post your projects, events, announcements.
  • Join our Discord for events, open calls and even more projects.
  • Tutorials (beginners and advanced) with code examples and downloads.
  • Find employers who have recruited here in the past (over 1,000 jobs).
  • Special offers and giveaways (events, books and media).
  • No advertisements or banners of any kind, ad-free reading!

Joining CAN as an organisation (up to 40 users) is $200 per year and it includes:

    Everything in the 'Standard' option plus:
  • Submit articles/announcements as often as you need, carefully edited and published on the site by our team of writers.
  • Reach thousands of daily CAN readers through articles and social media.
  • Join our Discord to publicise events, open calls or projects.
  • Your activities are boosted on our social media channels.
  • Your events are included in our public calendars.
  • We share ideas, networks, and resources with you.

You can also support CAN by donating

Click continue to donate with Stripe or you can also use PayPal, ETH, Bitcoin or Tezos

/++