SmartFace
[Patented US9734809]
Have you ever dreamed of a third hand to control your effects or the knobs on your synthesizers while playing your instrument ? With the SmartFace software and your webcam or the SmartCam camera, turn the most expressive and emotional part of your body — your face — into a true controller. No longer let a simple sine wave modulate your tremolos, phasers, flangers, or filters, and rediscover the joy of full expressiveness by assigning parameters to your mouth, smile, eyes, or eyebrows. Control multiple parameters at once or modulate your effects with your mouth, far more quickly or subtly than you could with your foot, all while keeping your hands on your instrument. Create a unique emotional connection with your audience and offer them a new experience by linking your facial expressions to your sound. Rest assured, the system is precise enough to avoid unwanted facial expressions and only activates when you decide.
SmartCam
The SmartCam is the ideal camera for SmartFace software, designed to provide minimal latency, optimal precision and high reliability. With a frame rate of over 500 frames per second, it guarantees a latency of less than 5 ms, a threshold below which latency becomes imperceptible to professional musicians. Thanks to its near-infrared recording, it ensures precise facial expression recognition and enables reliable use of the SmartFace software, even in concert settings, regardless of lighting conditions. A discreet articulated arm, equipped with a clamp featuring genuine rubber jaws, allows the camera to be positioned and securely fixed to a guitar, bass, or synthesizer stand without the risk of damaging the instrument.
SmartWah
[Patented US9734809]
The SmartWah is the all-in-one face-controlled effects solution for guitarists, bassists, and keyboardists. It combines the SmartCam with a Wahwah and stereo analog Oberheim-style low-pass filter. These filters can be directly controlled with facial expressions thanks to the integrated SmartFace software and its intuitive touchscreen interface. It also allows you to control your external effects and synthesizers thanks to its multiple outputs (MIDI, Exp, CV, USB, OSC).
Modulate the wahwah with your mouth, much faster and more subtly than with your foot, for striking effects. Create organic synth sounds with a low-pass filter, where the cutoff frequency is controlled by the opening of your mouth, the resonance by your smile and distortion by furrowing your brows. Don’t let a simple sine wave modulate your tremolos, phasers, flangers, or filters: rediscover the pleasure of total expressiveness by assigning parameters to your mouth, smile, eyes, or eyebrows, all while maintaining full control of your instrument.
SmartFace Editor
SmartFace Editor is our facial expression tracking software based on videos, allowing you to transform actor videos into editable facial expression curves for animating 2D or 3D characters. These expression curves can then be exported in various formats for integration into your animation software.
This software was used to create a high-quality database specialized for low-angle shots and near-infrared images, as well as for the training and evaluation of optimized models for the real-time AI algorithm of SmartFace, capable of reaching 500 frames per second.
SerializeJSON
SerializeJSON is a Python library for fast, secure, and human-readable serialization and deserialization of Python objects into JSON, designed as a direct alternative to pickle. serializejson is ideal for long-term data management, ensuring that data remains accessible and modifiable through future software updates and evolutions.
-
Supports all objects compatible with pickle.
-
Efficiently serializes binary data using base64 and Zstandard.
-
Provides a human-readable, editable, and versionable JSON.
-
Securely loads data from untrusted sources.
-
universal file format, eliminating the need for rigid file formats.
