SALSA LipSync v2 Suite

SALSA LipSync Suite v2.5.6 Released!

Sat, 25 Jan 2025 19:57:00 -0600

2025-01-25: v2.5.6.155

This is the latest version. See release notes.

2023-06-08: v2.5.5.135

This and the previous version (v2.5.4.119) fix some very fringe use-case bugs and added some minor usability enhancements. We do have some new features cooking for the v2.6.0 release (TBD).

2021-05-19: v2.5.3.113

This version fixes a problem when applying changes to prefab instances. See the release notes and check the forum for more information.

2020-09-11: v2.5.0

We have been working on this version for quite some time, but v2.5.0 is now available for general use. This is a big release with a lot of new features, enhancements, and fixes. The Eyes module has been completely re-tooled and no longer requires bone/transform fix scaffolding for misaligned bone axes. Implementing this change required quite a bit of change under the hood and as such broke some Eyes API calls. Please note, if you are implementing this new version into an existing project, the Eyes modules will need to be reconfigured. SALSA and EmoteR do not require reconfiguration, breaking changes are strictly limited to the Eyes module. And, if you leveraged the Eyes API in your custom code, there will be some minor modifications required.

As always, backup any existing project before you upgrade SALSA LipSync Suite to any new version.

Suite version 2.5.0 is recommended for new projects and existing projects with the understanding that it is not a drop-in, plug-and-play implementation for existing projects. While upgrading an existing project will take a little effort, we do recommend the upgrade. There are many updates to all core systems (see the release notes for details), but at a minimum the QueueProcessor animation core changes are beneficial to any project, providing much better conflict resolution and smooth transition on component registrations, as well as vastly better auto-detection of external animator influence on your character models. SALSA also has a new processing option which increases perceived accuracy with earlier, more accurate silence detection. All OneClicks required updates for the new Eyes module and received some new settings for SALSA and EmoteR, including the addition of the Advanced Silence Analyzer.

Please see the release notes for details on new features, enhancements, and fixes included in this new version.

Add-ons and OneClicks requiring updates for correct operation with the new Suite version (2.5.0) are like-versioned as 2.5.0. Please note the version number also indicates the minimum SALSA Suite version required. Therefore, any OneClick or add-on with version 2.5.0 requires SALSA LipSync Suite version 2.5.0. If an add-on does not have a 2.5.0 version, no changes were necessary to the add-on to work with version 2.5.0 of the Suite. We have left the older version of add-ons and OneClicks on the server for customers who remain on the 2.4.1 Suite version. Please always ensure you are using the correct add-on or OneClick version for your installed version of SALSA Suite. If you are receiving errors indicating missing references, likely you are using the wrong version of an add-on or OneClick. Feel free to contact us to confirm; however, the downloads section lists the version requirements for each add-on and OneClick.

We have thoroughly tested this new version with add-ons, OneClicks, and demo and test scene implementations over the past few weeks. Due to the sheer number of changes and updates to the core code, it is possible there may be a bug or two lurking in the shadows. Even considering how well the product has matured over the past year and how stable it is, it is just the nature of the beast. Please check the documentation first, but please contact us (preferably via email) if you feel you have found an issue. Include as much detail as possible: platform and version, error messages, behavior, full screenshots of your cofiguration and/or video, and of course, your Invoice number. We cannot provide support without an Invoice number.

Enjoy!
The Minnow Team

TimelineSalsaCore v2.6 Released (includes Eyes Support)

Mon, 27 Sep 2021 12:21:00 -0500

[2021-09-27] An issue has been discovered with the Eyes module where "lookTarget" objects are not saved when loading Unity or scenes. I was unaware Unity had restrictions on storing scene-based objects and requires a different implementation. I have a fix that is currently being tested and should be released soon.

[2021-05-22] TimelineSalsaCore v2.6.0 has been released to address the issues discovered with Unity v2020.LTS+. The EmoterControl module should now work with the recent versions of Unity. The Eyes module also received a new feature to selectively filter settings within a clip. This option adds to the flexibility of applying settings changes for Eyes on the Timeline track. A tutorial video will be available early next week. [darrin]

[2021-05-19] An incompatibility was discovered between the EmoterControl module and Unity v2020.LTS+ where it rendered the entire module inoperable.

[2021-05-13] TimelineSalsaCore v2.5.0 has been released on the downloads portal! This new version includes support for the Eyes module as well as new features for the SALSA and EmoteR modules. See the documentation page for more details and links to video tutorials.

NOTE: The previous (legacy) modules for TimelineSalsaCore (SalsaAudio and Emoter) are now deprecated. They will operate normally alongside the new SalsaControl and EmoterControl track/clips and you can keep them in your existing projects if you like. You may mix the new SalsaControl and EmoterControl tracks with the deprecated versions if you do not wish to convert the old versions to the new. Any new projects should definitely use the new SalsaControl and EmoterControl modules. SalsaAudio and Emoter track/clips are not included in the new package and will receive no further updates or fixes.

Exporting DAZ Characters for use with SALSA Suite v2

Wed, 05 Aug 2020 09:44:00 -0500

Export guide for DAZ 3D characters (i.e. Genesis, Genesis 2, Genesis 3, Genesis 8, Dragon, and Emotiguy character classes). Please see our detailed OneClick documentation for more information.

NOTE: These instructions are legacy and no longer supported. DAZ has changed their ecosystem and while these instructions should get you at least part of the way, they are not guaranteed, nor supported, to provide 100% coverage of exporting and configuring a DAZ model. Please visit the DAZ forums and/or documentation for information on working with DAZ models.

Documentation for SALSA LipSync Suite v2 -- located here.

Warning: Unity has a vertex limit of 65,536 vertices. If you import a model with more vertices than this, Unity will split the mesh, a process that destroys the included BlendShapes. Before purchasing SALSA, verify two things first:

You're using one of the supported Daz character base classes (Genesis, Genesis 2, Genesis 3, Genesis 8, Emotiguy)
You have imported your model into Unity first to verify that unity has not split the mesh because it exceeds Unity's vertex limit. You can verify the BlendShape are intact by adding the character to a scene, and checking the Unity SkinnedMeshRenderer component to verify the BlendShapes are still listed.

Daz Character Export Instructions

Export your model by selecting [File] -> [Export].
Name your file and select [FBX] as the file type.
Verify your export selections match those specified in the following image, then click [Edit Morph Export Rules...] to either add a single rule to export all head BlendShapes, or specify the each shape manually to reduce the total number of shapes. Note: Exported shapes must begin with "head".
- Single rule to include all head BlendShapes:
Click [Accept] on the [FBX Morph Export Rules] window, then [Accept] on the [FBX Export Options] window to complete the export.

Daz Character Unity Import and Material Setup Instructions

Drag your new FBX export file into Unity. This will create folders named [{FILENAME}_base.fbm], and [Materials] in the same location where you import the FBX model.
Open the [{FILENAME}_base.fbm] folder and select the eyelashes texture, my file is called [V5BreeLashes1.jpg]. Check the boxes next to [Alpha from Grayscale] and [Alpha Is Transparency], then click [Apply].
Add the Daz character to a scene, expand the character until you find the child object that contains the SkinnedMeshRenderer with all your BlendShapes, and all the materials for the model. For my character, this was found under [DazGirl] -> [Genesis2Female] -> [Genesis2Female.Shape].
Now we'll setup the following materials.
- Eyelashes
- EyeReflection
- V5BreeInMouthM
- Cornea

NOTE: While every attempt has been made to ensure the safe content and operation of these files, they are provided as-is, without warranty or guarantee of any kind. By downloading and using these files you are accepting any and all risks associated and release Crazy Minnow Studio, LLC of any and all liability.

Download Files

Simple Automated Lip Sync Approximation
~ We look forward to seeing what you create! ~

Buy SALSA on the Asset Store

SALSA with RandomEyes (v1.x) End-of-Life

Mon, 07 Oct 2019 12:45:00 -0500

Out with the Old, In with the New

The legacy version of SALSA (SALSA with RandomEyes v1.x) has reached a ripe old age and is ready to prop up its feet on a nice beach somewhere warm. As of the beginning of the year (2020-01-01), the legacy version (SALSA with RandomEyes) will no longer be supported. Updates for this legacy product ended in June, coinciding with the new release (SALSA LipSync Suite) and there will be no further updates, including feature, bug-fix, or Unity-compatibility updates. There will also be no further updates to add-ons for the Legacy product (SALSA with RandomEyes).

FAQ

What does this mean to SALSA with RandomEyes customers?
SALSA with RandomEyes will continue to be available on the Asset Store for existing customers and, as such, you can continue to use it as long as you wish. Crazy Minnow Studio will simply stop providing support and guidance for the product. Instead, customers will be encouraged to purchase an upgrade to the new product (SALSA LipSync Suite). As mentioned above, updates have already ended, so this is simply the next step in the lifecycle process.

Where can I get help for SALSA with RandomEyes?
SALSA with RandomEyes is pretty easy to use, but in the event you need help with it, the SALSA community may be a good source of information.

Why is Crazy Minnow Studio abandoning SALSA?
What on Earth gave you that idea? We are full-on excited about SALSA, which is why we completely re-wrote and released SALSA LipSync Suite!

SALSA v2.0 devBlog

Thu, 01 Aug 2019 13:57:00 -0500

Submitted to the Asset Store: 2019-06-15
Live on the Asset Store: 2019-06-20
STATUS: SALSA LipSync Suite v2 release development is complete.

Addon/System Integration Status: ALL add-ons and OneClick systems have been updated and are available on the Downloads page

UPDATE (2019-08-01)

API documentation is complete and available for SALSA, EmoteR, and Eyes.

UPDATE (2019-07-25)

SALSA v2.1.0 has been published on the Asset Store and paves the way for the new UMA OneClick (also now available in the Downloads section). The UMA OneClick has also been published in the downloads section. This brings a close to the initial add-on/one-click development efforts and SALSA LipSync Suite v2 now has all previous add-ons updated and available for the platform (except for deprectated packages)!

This update also brings material targeting in multi-material renderers for 2D artists/designers. When more than one material is available on a renderer, an additional option will be presented to select the desired material to apply the texture swaps to.

UPDATE (2019-07-17)

We have almost completed the UMA OneClick/Integration package and hope to be publishing it in the next day or two. This implementation leverages the ExpressionPlayer system and will bring the ability to use the UMA Core Tool - Expression Clip Creator model for Editor/Design-time preview mode!

UPDATE (2019-07-01)

AmplitudeSALSA has been published. Minimum Unity version for SALSA LipSync v2 build on WebGL target platform is 2017.2+. NOTE: This add-on is available only from the Amplitude for WebGL downloads page and, of course, requires Amplitude for WebGL.

UPDATE (2019-06-30)

AmplitudeSALSA has been completed and is being tested. It looks like it's going to have a minimum Unity version of 2017.2 for building SALSA in WebGL. Also, the Autodesk OneClick visemes are completed and it looks pretty nice.

UPDATE (2019-06-26)

DAZ OneClick was updated to support Genesis 1 models. Reallusion iClone/CC3 OneClick has also been published.

UPDATE (2019-06-25)

We've made a lot of progress in a short amount of time. Nearly all of our integrations have been published and we have Fuse and DAZ OneClicks available too! iClone/CC3 is next up and should be available in a day or two. Then AutodeskCG and finally UMA DCS. Check out EmotiGuy sporting his new spicy SALSA LipSync Suiteness!

UPDATE (2019-06-22)

Well, we were not ready for Unity to publish so fast...now we are in serious crunch time and are asking everyone for patience as we get everything implemented. What we've done so far:

A very cursory update to the SALSA landing-page to correct logos, verbiage, and links.
There is a good amount of documentation, but it is a bit rough in spots and unfinished in others. We're working on it...
The statuses of add-ons are being marked 'PUBLISHED' when they have been uploaded to the downloads section.
We are also trying to keep everyone updated of our progress and are posting frequent updates on the forum thread.
Back to work...

By the way, SALSA LipSync Suite is now #5 in popularity rank of almost 54,000 assets! WOW!!!! Thanks everyone!

UPDATE (2019-06-15)

We just pushed the button! SALSA LipSync Suite has been packaged and submitted. We had to get the new documentation framework loaded and live on our site in order to ensure the built-in asset help-links worked. So if you find them, know they are a work in progress! ;) We will continue to clean them up while Unity is reviewing the package. While it is being approved, we will be wrapping up all of the remaining add-ons, documentation, site-updates, etc. There will be a lot of changes coming. Remember, SALSA v1.x is being deprecated in lieu of version 2.0. If you do not want to upgrade to version 2.0, no worries, existing customers will still have access to version 1.x, but there will be no further updates to it. Also as a reminder, the upgrade price to version 2.0 will be $4 (the difference in price between version 1.x and 2.0) for a short time.

UPDATE (2019-06-10)

Unfortunately, life happened this weekend and we weren't able to get the package submitted as planned. However, "life" has been more or less cleaned up and we should be packaging in the next 2 or 3 days.

UPDATE (2019-06-06)

Last night we had a major breakthrough and fixed a problem that surfaced late in the game! Yea!!! We began noticing some glitchiness in eyelid blink animations when we were testing a Fuse model with addon updates. The symptoms were completely illogical and as such, were very illusive. Right as we were wrapping it up and throwing in the towel for the day, it came to me. The fix? A single, very short, line of code. :)

I will be building our last release candidate this morning and posting for our beta testers as we get our submission package in order. Barring any further issues reported, we will be pushing the button very shortly!

UPDATE (2019-05-19)

Our final round (hopefully) of private beta testing of the complete SALSA system began today. If the testers don't find any major issues, we'll likely be submitting to the asset store in the next couple of weeks. As we await feedback from our testers, we'll be working on the remaining 1-click setups, add-on conversions, and documentation and tutorials.

UPDATE (2019-04-28)

The Eyes module is feature complete. We've now transitioned to code clean-up and debugging.

Eyes module progress:

Head bones 3D horizontal and vertical clamping - FINISHED
Head bones 2D rotation clamping - FINISHED
Eye bones 3D horizontal and vertical clamping - FINISHED
Eye bones 2D position clamping - FINISHED
2, 4, and 8 sector eye positions:
- Sprites - FINISHED
- Texture - FINISHED
- Materials - FINISHED
Eye tracking calculation conversion for blendshapes - FINISHED
Scale and sprite axis automatic flipping - FINISHED
Random position generation within a user controlled 3D frustum - FINISHED
Random tracking sacade generation within a perspective aligned rectangle - FINISHED
Eye control templates based on 2D/3D, bone, blend, or sector selection - FINISHED
Optional new parent fixes eye bones that are not Unity coordinate system aligned - FINISHED
Affinity - FINISHED
Eyelid control templates based on 2D/3D, bone, blend, or sector selection - FINISHED
Blink for 2D - FINISHED
Blink for 3D - FINISHED
Eyelid linked tracking for 3D - FINISHED
Eyelid linked tracking for 2D - FINISHED

UPDATE (2019-04-15)

Here's a quick update to demonstrate progress on bone control in the upcoming Eyes module. You can mix and match rotation and position in many combinations for eye and eyelid control. Blendshape conversions will be added next and will support the same ability to mix and match between eyes and eyelids.

UPDATE (2019-04-09)

The first code pass on eyelid control in the Eyes module is done for bone rotations. The plan is to support bone rotation, bone position, and blendshapes directly, and if you're using sector-based sprites, textures, or materials, then you would incorporate your eyelids into your eye sector artwork Eyelid control should support any number of upper and/or lower eyelids. It will have configurable random blink, and eyelids can track eye movement on any non sector-based configuration.

UPDATE (2019-04-03)

SALSA and EmoteR have received some broad-scoped dynamics adjustment settings. SALSA now has a Global Dynamics option when not using Advanced Dynamics. This allows the designer to adjust the maximum range of motion (applicable to all visemes). Programmatically, a developer could adjust the overall lipsync dynamics of the model with a single variable, creating a rapid transition from yelling, to speaking, to whispering representations of mouth movement. EmoteR also gets this capability, but at the individual emote level. This was technically available using the frac parameter when manually triggering an emote in code, but does provide an easier adjustment in edit/design mode. Both options are represented in preview mode.

A new 2D feature adds a lerp rollback option to SALSA switcher controllers (sprite, texture, material). As you may be aware, version 2's 2D animations are capable of dealing with multiple frames of animation in addition to simple on/off style animations. Previously, as visemes changed, based on analysis values, the next viseme simply flipped to the appropriate frame without animation in the "on" direction. This was due to the fact that they shared the same collision controller (SpriteRenderer, etc.) in the QueueProcessor, ultimately meaning they shared the same lerp progression value. A change to the controller classes for the Eyes module opened up the possiblity to adjust the lerp progression value between QueueProcessor registrations for subsequent visemes (to perform some animation to the next viseme instead of simply flipping to it). This creates a much smoother look and feel in the animations. Of course, it is an option and does not need to be enabled if a different overall look-and-feel is desired.

Here is a short video demonstrating the different settings. Each of these SALSA v2 instances is configured with 3 visemes (small, medium, large) just like SALSA v1; however, they all (except the first instance) leverage 10 frames of animation per viseme. The first instance utilizes a single "on" frame, just like SALSA v1. Each SALSA instance is processing the same AudioSource. Instance #2 is simply animating the 10-frame visemes without any special processing. #3 utilizes Advanced Dynamics, which varies the animation based on the computed analysis instead of simply triggering the full viseme. #4 utilizes Advanced Dynamics, but also leverages the new Rollback (blending) option, providing better animation between viseme switches. The Rollback (blending) option is also available without needing Advanced Dynamics -- and looks great as well.
Video Link: https://drive.google.com/file/d/13C8f3kGKUa7pb7_a2yXlNauv5S83Y1CM/view

There have also been quite a few bug-fix updates to SALSA and EmoteR that were discovered as we integrate Eyes into the main code base.

In the Eyes module, we just resolved the last known issue with 2D sector tracking processing. Yea!

UPDATE (2019-02-25)

The Eyes module is progressing well, but as with any development, it's hard to pin down accurate estimates for completion. The module offers linked eye, eyelid, and head control for 2D and 3D. It can manage transform rotations, clamped position changes, blendshape (up, down, left, right), sprite sectors of 2, 3, 5, or 9 zones, and will be able to handle texture and material swaps as well by the time it's done. 2D is being designed to work seemlessly with scale flipping or sprite axis flipping, and the whole system leverages the SALSA animation queue to provide prioritization and conflict resolution. As is the case with the rewrite of SALSA Lipsync and EmoteR expression control, the Eyes module is vastly more flexible and capabile than the previous RandomEyes module, and we are still working through some of the challenges of this improved flexibility. Unlike the other two modules, Eyes requires template selection depending on the configuration type. For example, if you want to use eye blendshapes, a template is created where you can insert your up, right, down, and left shapes, or if you select 9 sector a template is created for your forward, up, upper right, right, lower right, down, lower left, left, and uppder left sprites, materials, or textures.

UPDATE (2019-02-24)

While Mike continues on Eyes, I've created a script to dump out SALSA settings (EmoteR coming soon) that captures the current settings into a text blob. This output can then be pasted into a blank C# script and with a couple of small edits, becomes a new 3D OneClick (for shapes and bones). It does potentially require a basic understanding of regex for advanced usage. However it has already proven super helpful while creating/updating OneClicks for the model systems we support (AGC, Fuse, iClone, and DAZ). In creating the OneClicks for iClone models, I discovered the "bone" controller setup was difficult to work with and did a bit of revamping and bug-fixing to the system. I think it's a lot more intuitive and much easier to set up Expressions using bones.

Similarly, while working with the 2D controller types, I discovered and repaired a couple of bugs and also determined there were some restrictions with Unity's Editor implementation for working with Sprites. Our current Sprite controller allows for a targeted drag-n-drop to add one (or more) sprites to the sequence list. This works great for single sprites listed in the Project window (and similarly for Legacy Packer sprites since they are still listed in the Project window). However, it breaks down when picking sprites from a multi-sprite base and also when working with the new Sprite Atlas system. Dragging a sprite from a mulit-sprite mode base creates a new sprite slot in the controller, however, it automatically selects the first sprite in the multi-sprite. This happens because Unity does not have a method to grab information in the drag-n-drop event indicating which sub-sprite was used, it simply refers to the base sprite asset. Once the slot is created, specific sprites from the list can then be dragged to the slot. So, specific sprites can be selected, but they have a two-step process in the current implementation. And, considering the new Sprite Atlas system in 2017+, it currently isn't supported in the Editor configuration since it appears to be a runtime system. I'm still looking into this to confirm operation, but at present, it's not supported. If it operates similarly to the legacy packer and using the list of sprites in the Project window is actually a reference to the soon-to-be packed sprites, then it will work in its current implementation. TBD

UPDATE (2019-02-15)

As you may have already seen on the Unity forum for SALSA, we still aren't quite there. We have made a lot of progress, but the Eyes module is still undergoing development and integration. The core functionality is complete and said functionality is now being brought into the SALSA family of core modules. This requires some changes to the queue and controller systems as we discover new requirements since Eyes does not work the same as SALSA or EmoteR. Eyes has more randomness requirements, whereas SALSA responds to audio analysis and EmoteR fires off emote expressions according to rules. Eyes continually drives in random or tracking mode, creating new destinations for the same animated objects. We are still able to leverage the queue conflict resolution system which was a major goal and this will benefit designers tremendously. The queue incorporates over-ride rules that allow certain expression types to take over from each other if they share the same core expression components. This allows animated components to be re-used across SALSA LipSync modules (SALSA, EmoteR, and Eyes) and also within each module. SALSA v1 had a strict single-use requirement for each blendshape, otherwise much herky-jerkiness would ensue. SALSA v2 does not have this limitation. None-the-less, we have been working dilligently to ensure the Eyes module utilizes the queue for animation processing to gurantee conflict resolution across the modules. Needless to say, Eyes processing looks great! Tracking now incorporates adjustable saccades to eliminate that robotic, locked-on stare that SALSA v1 had. Sure it was great for its time, but v2 ushers in a new era of cool for spicing up your application characters.

While Mike has been knocking out the Eyes todo's, I've been working with SALSA and EmoteR while creating the 1-click settings for our supported model types. It should come as no surprise that we are dropping 1-click support for MCS characters. You will still be able to use SALSA with the MCS models if you wish; we will simply not be supporting or creating a one-click addon for them. We currently have some (subjectively) pretty good settings for DAZ, iClone, and Fuse. We will probably tweak all of these over time as we discover better looking setups, but out-of-the-gate, they work great. With the loss of MCS, we've seen a lot of chatter in the forums about what character system people are jumping to. UMA DCS and Fuse seem likely candidates. Fuse is easy and we've already set it up. UMA is a bit more difficult in the use of its runtime-generated expression system -- so, we're still working on the best solution to handle it.

We are holding off on converting the codeless systems to SALSA v2 until the Eyes integration is done to prevent having to redo work in the event some of our core API changes. We will be supporting them and will likely have them completed by the time SALSA is generally available or shortly afterward. Once the core SALSA systems (LipSync, EmoteR, and Eyes) are complete, our current plan is to submit and finish up the add-on conversions while SALSA is in Unity's approval queue. This allows us to get it into your hands faster at the expense of potentially not having all of the add-ons completed. We will appreciate your understanding and patience and we will continue to be transparent in our endeavors. This blog diary will list our progress with the add-on conversions until they are complete.

UPDATE (2019-01-31)

We didn't quite make the end of January, but we are really close. We are now targeting the middle of Februrary for submission. That's only a couple of weeks away, and may be optimistic, but we are hopeful. Eyes is getting final features treatment and polish and is looking great! As you can see in the above chart, we're also working on getting as many of the add-ons functional as possible. Some of the existing add-ons will be deprecated since their functionality is no longer needed or is included in the core product. Updating the add-ons has also afforded a new look at the SALSA and EmoteR code and has prompted a few changes and fixes. SALSA and EmoteR rc1 was built today and will facilitate updating the remaining add-ons (which I'm targeting to be completed in the next week).

Our new server is running quite well, we are super happy with the performance and site responsiveness!

UPDATE (2019-01-17)

Not entirely SALSAv2-related, but we wrapped up migrating our server hosting last night. We've been somewhat disappointed with the performance of our previous shared hosting and renewal was coming up so we decided to make the jump. We're now on a VPS server and the performance is quite good. Let us know if you have any issues.

The Eyes module continues the integration process and is nearly done. We are still hopeful for submission by the end of the month, but it may slip a week or two depending on whether we hit any hurdles or not.

UPDATE (2019-01-03)

We have ended the closed-beta testing and received some good feedback. We are now integrating the eyes module in with the main package and expect to have that completed soon. Our current plan is to be submission-ready by the end of this month. In the meantime, we are updating existing add-ons to make them compatible with the new system and getting documentation and tutorials ready for release. Please understand, this is not a promise that we will release the product at the end of January. This is our estimated plan and intent. We are a small team and this is not our only job, so we work with what we have. :)

As we mentioned near the beginning of this development blog/log, we will be increasing the price of SALSA Lip-Sync v2 upon release. The expected release price will be $39. Shortly after release, the price will bump up. Also note, this will be a paid upgrade. As a thank you to those that have supported version 1, we will be offering a price-difference upgrade at launch, so you can continue to purchase version 1 now and upgrade upon release and not pay any extra over waiting for the new version. While the new-purchase price is $39, the upgrade price will be $4. Once the full price changes from $39, the upgrade price will increase and will no longer adhere to the price-difference model. So, get your upgrade quickly!

UPDATE (2018-12-26):

Here's a quick update to show some progress on eye control on a 2D character in SALSA 2.0. The video demonstrates three available methods:

Eye transform animation.
Nine sprites (forward, up, upper right, right, lower right, down, lower left, left, and upper left.
Five sprites (forward, up, right, down, and left)

UPDATE (2018-11-09):

SALSA and EmoteR are pretty much finalized. Documentation is nearly complete. RandomEyes development continues. We are about 3 weeks into our closed-beta test of SALSA and EmoteR and have had some really good, positive feedback thus far. Very few bugs have turned up and our testers are enjoying the new version and its capabilities.

We have added a few new features and modifications from tester requests. One new key feature is blending back to Animator control in the EmoteR module using Bone components. Previoiusly, if a bone was used in an emote, EmoteR would take over animation and then release the animation at a set position, usually resulting in a jarring snap as Unity's Animator takes control back. Now, EmoteR will track the Animator control of the bone and smoothly deactivates its emote towards the updating Animator pos/rot/scale. The result is a seamless transition back to Animator control. There is also an offset mode available which EmoteR uses to apply relative animations to an Animator's animations. It's all good stuff and opens up a lot of great possibilities.

Here is a view of an expanded SALSA inspector (non-configured) and an expanded configured-for-boxHead) implementation.

UPDATE (2018-10-05): Inspector Design

The advanced elements of the SALSA inspector are more or less complete. We've implemented shape, bone/transform, and sprite switcher interface functionality. Additionally, we've been squashing some bugs and optimizing some core code, along with copious amounts of housekeeping and general cleanup. Document rough-drafts are nearly complete for SALSA. Emoter will be next in line for finalized touches, followed by Eyes. Why the huge delay? There are a few reasons, the biggest being trying to implement the inspector interface for the advanced flexibility the suite uses. We've tried to make SALSA 2.0 compatible with as many Unity versions as possible while keeping the inspector up-to-date and fresh enough. That said, our current version cutoff for Unity is planned at v5.6+. Stay tuned for more info, I'll try to post up a new view of the inspector soon!

UPDATE (2018-07-25): Inspector Design, Optimizing, & Unity Timeline

Since the feature set is pretty much complete for SALSA, we have been working on a fresh inspector implementation. The goal is to make the inspector at-a-glance informative, without being cumbersome -- providing feedback for proper implementation and key settings while the sections are completely collapsed. The animation demonstrates some of the interface ideas we have implemented.

We have also been trying out some additional ideas and working through some scenarios to try and ensure the product is as forward looking as possible. This includes optimization and eliminating unnecessary code and libraries. There is still work to be done here, but currently, the profiler is showing zero GC impact and the queue item registration processes in our sample scene are taking just a little over 1ms to process 36 simultaneous SALSA objects! Additionally, the per frame queue process (animation interpolations) for these 36 registered test items are under 1ms!

Finally, we have been ensuring our current code base is compatible with our Timeline add-ons and in fact, we have some added capabilities in Emoter for custom expression firing that are not available in SALSA 1.0, such as shape jitter variation over time when using one-way shape handling.

UPDATE (2018-06-03): technology preview video 2D (progress-to-date)

Here is another technology preview video. This time we used our new combined 2D/3D workflow, our unlimited sprite/texture/material/trigger capability (sprites for this test), and multi-image sprite sequences for each of the eight visemes used to achieve smoother 2D traditional animation. This workflow could also be used to add full lip-sync and emotion expression to low poly 3D characters using texture or material swapping. We think the results look great.

UPDATE (2018-05-23): Refactoring and Fixes

The past few days have been spent refactoring and tweaking, while testing the feature sets currently in-place. Mike has been working with an advanced 2D model from Digital Puppets and it has brought quite a few things to light. SALSA and EmoteR have been more than up for the task and it has simply been a matter of adding to the feature set rather than needing broad sweeping changes. The whole system is very modular in design so it has been quite pleasing to work with. The new 2D array controllers have really opened up the possibilities of what the SALSA suite can do for 2D. We will be putting out some 2D tech video demonstrations soon.

UPDATE (2018-05-18): EmoteR updated

The EmoteR (emote randomizer working name) received some lovin' today. Implemented manual emote triggering as well as random triggering (in addition to the already-implemented emphasizer triggering). There are now three pools of emotes: emphasizer, random, manual. An emote can belong to any/all of these groups (all emotes belong to the manual group). The randomizer functionality can be strictly a random emote, triggered by a percentage chance at random (min/max) intervals. Or it can take on some dynamics of its own with random fractional extents and/or randomized hold (min/max) durations. So, it is pretty flexible, but easy to implement, providing quite a bit of variation.

We foresee some cool value add for developer/designers who wish to create demeanors for their characters. By adding multiple EmoteR components to a character, each could be configured with emotes associated with a demeanor (i.e. "happy" or "angry"). Then, programmatically or via a mechanism like Timeline, the demeanor could be switched so that SALSA triggers "happy" emphasis emotes and EmoteR triggers "happy" random emotes. Or, likewise the demeanor could be switched to "angry" emphasis and random emotes. The possibilities are endless!

UPDATE (2018-05-17): technology preview video (progress-to-date)

UPDATE (2018-05-07):

SALSA 2.0 is shaping up to be an amazing upgrade to the product line. With the new design elements, we have discovered additional possibilities to make the system even more flexible and allows us to give you, the designer, a solution which breathes even more life into your characters without sacrificing SALSA's original goal's: to be simple and automagic! Of course, keep in mind, any sweet, new features we discuss here are not considered set-in-stone until the product ships. In other words, something might come up that prevents us from including a feature in the final product.

Our new sound processing algorithm has allowed us to experiment with some forward looking processing, allowing us to adjust the processing bias forward/backward. The only really useful direction seems to go forward and the benefit is eliminating the apparent processing lag visible in the current version of SALSA. This has a dramatic effect on the perceived lipsync approximation, making it feel even more accurate without having to bake in phoneme maps. We believe this will potentially work for micInput as well, further reducing the visual separation between recording speech and performing lipsync.

In SALSA 1.x, we have a custom shapes interface that allows the designer to include and randomly play emotes on the character in an attempt to give them a little more life and not be so static. Unfortunately, this is somewhat of a double-edged sword and can easily cause the character to look twitchy. SALSA 2.0 goes a few steps further. You will still be able to define shapes and have them randomly play if that is your thing. However, we just introduced a new capability that links SALSA's audio processing algorithm with our new Emoter system, allowing audio timing queues to influence a set of emphasis emotes while the character talks. The result is quite awesome - timing is everything!

Previously, we spoke about the potential of 2D animation arrays (vice single-image switching) and at that point, had not been able to test it. We can now report, the results look pretty amazing. While the system has no limit on the number of mouth shapes, we tested a simple set of 3, 10-frame animations to mimic SALSA 1.x's limit (for small, medium, large mouth shapes - 30 frames total). We will also be testing an advanced 2D character with a larger set of visemes to see how that looks -- SALSA 2.0 imposes no limits on the number of 2D/3D shapes or triggers. We do not have any best-practice recommendations at this point on how many frames are effective for an animation, but the inclusion of this capability should make some 2D enthusiasts super happy! Of course, it all depends on the 'look' you are trying to acheive and 2D is much more artistically motivated (for the most part) than 3D. No matter how you look at it, options are awesome!

The RandomEyes overhaul is also getting lots of love. Movement algorithms are applying some scientific research to the model and, I have to say, eye-movement is looking amazing! In addition to the eyes, head-movement is now a thing. Tying head and eyes together creates an even more compelling character. And similar to SALSA's emphasis emote timing, head movement timing will coordinate with other elements as well, like blinking. Super cool!!!

We realize talk is cheap and to that point, we will be releasing a new teaser shortly, demonstrating just how much life the SALSA package will infuse into your characters with so little effort.

UPDATE (2018-04-19):

We have made some massive progress on SALSA 2.0 over the past couple of weeks. A vast majority of the underlying logic and structure has been completed. We are now confident to say the whole package, in general, is moving to a time-based animation queueing system. As mentioned previously, this queue provides for flexibility and efficiency and is a huge contributor to the new core features of SALSA. In SALSA 1.x, animations conflicted with each other and required limited or zero reuse of shapes (reusing shapes from other triggers and emotes would have caused jittery, push-pull moments and simply wasted processor cycles). Now, the magic of the queue gracefully eliminates this problem by seemlessly tracking and taking over animations using intelligent overrides. Additionally, the queue now operates on time verses speed. Other than allowing for different easing types, this will give cinematic creators a better workflow for timing emotes, being able to separately (and accurately) control animation on, hold, and off times.

We have removed the separate 2D/3D lip-sync elements. Now it is simply SALSA lip synchronization for your 2D or 3D needs. It all uses the same queue and the 2D options have expanded. SALSA 1.x was limited internally to sprite swapping. That process was fine for many customers, but others had different needs, which we were able to accomodate with some bolt-on processes. SALSA 2.0 abstracts the animation control process to a point where we should be able to accomodate any sort of animation or switching needs our customers may have. If it does not come in the box, extending with new functionality is much easier. At present, we have 2D switching processes for sprite, material, and texture. We are even experimenting with an animated array that could offer artists a pathway to smoother 2D animation progression (multiple animation frames per emote or lip-sync trigger). This is still experimental, but the initial results are pretty cool!

One issue some of our customers had with SALSA 1.x was with 3D sound. Basically it broke the lip-sync when the character moved away from the listener. Of course, in true Minnow fashion, we were able to come up with some usable workarounds, but they were not the preferred implementation. Last night, significant progress was made on removing 3D sound shortcomings and implementing a spacially agnostic processing algorithm. Wooohooo!

RandomEyes is getting lots of love as well. We will update on its progress shortly! Stay tuned!!! ;)

UPDATE (2018-01-09):

SALSA v2.0 development continues. The ability to group shapes/expressions within SALSA (from multiple shapes) brings much more flexibility, but certainly can increase complexity within the inspector.The new inspector is shaping up nicely and providing for a much more streamlined user experience. The queue system is also being refined, unifying the ability for SALSA to use blendshapes and bones to drive lipsync or expressions. This added functionality will enhance SALSA's ability to work with even more model systems. Additionally, it may be possible to implement this same functionality for the 2D system or even implement 2D into the same system. Time will tell if that is going to be possible.

Lately, we have received quite a few inquiries on the release date of SALSA v2.0. It is still too early to establish a release date, but there have been a lot of advances in the development.

In addition to SALSA, two more assets should be available on the AssetStore soon that will enhance the functionality of SALSA (versions 1+). Amplitude for WebGL will provide the ability to link up audio analysis in WebGL projects (not specific to SALSA -- but yes, SALSA will work in WebGL with the product)! The second new asset, MorphMixer, will allow developers/designers to create unique blendshape instances where multiple shapes were previously required. The biggest benefit here is the creation of better defined shapes and the elimination of shape conflicts. This will benefit SALSA v1+.

Neither of these two products require SALSA to operate. They were however, inspired by SALSA in their creation. Amplitude will provide audio amplitude analysis functionality to any project/need. And MorphMixer could be used in any project to blend existing blendshapes together to form new shapes - inside the Unity Editor. Both were submitted over 30 days ago, so we are hoping Unity approves them very soon. SALSA owners will be able to purchase both products at a special price for a time.

UPDATE (2017-09-17):

Most of the 3D features are finalized and in place. Now we're focusing on 2D elements. Still no release date -- sorry.

SALSA v2.0 is coming!

Likely you have already seen some of the teaser videos we have published, showing off the quality gains over SALSA 1.x. If not, head over to our YouTube channel to take a peek. The response and excitement for SALSA 2.0 is growing and with that, there are a lot of questions. This post will discuss the most common questions we get and (for now) will serve as a devBlog for the goings on.

When is SALSA v2.0 going to be released?

This is our most frequently asked question. We currently do not have a date we're comfortable sharing. This version is, for the mostpart, a complete re-write of the SALSA core. Development is advancing quickly and nearly all of the advanced feature-set is already prototyped and maturing. Stumbling blocks have pretty much been kicked to the side of the road -- full steam ahead. In other words, we don't know, but check back here for updates.

Is SALSA v2.0 going to be a free upgrade to existing SALSA 1.x owners?

Ahh, the age-old question -- is it free? Nope, it's not. And there are a few reasons behind this decision. First and foremost, SALSA is being re-written. As mentioned earlier, this is a big code change and is not going to be a drop-in replacement for v1.x. Due to Unity's distribution platform, we felt it necessary to ensure projects were not accidentally broken due to an inadvertent upgrade. However, if you already own SALSA, it will be nearly free to upgrade it -- at least initially. After nearly 3 years of support and updates, we've decided the old SALSA needs a face-lift and face-lifts cost money. With the new release will come a price increase and the upgrade cost will be the difference of the increase and the current price of SALSA. SALSA v2.0 is expected to release at $39, meaning the upgrade will cost you $4 ($39 - $35). This upgrade window will likely be pretty narrow and the price will increase again (along with the upgrade cost) shortly after release. We're still working out the details, so some of this may change. Check back here for updates.

What sorts of new features will my hard-earned $4 get me with v2.0?

There are a couple of big changes and you've already seen the biggest one -- better real-time, lip-synciness in the form of vastly superior quality. The Minnow doesn't lie! It looks really good. And the quality doesn't sacrifice the core SALSA values and goals. It's still real-time and the pipeline is still quick and easy. In fact, you can still achieve compelling lip-sync approximation just like the SALSA 1.x with the same 3 shapes you used before. You can even use a single shape if you want -- although you probably wouldn't want to 'cause jaw flapping is just plain ol' ugly. With SALSA 2.0, you can use as many shapes as you want for lip-synchronization (yup! that's new!).

Behind the scenes, there's also a new trigger processing algorythm. This new tech brings a boatload of efficiency and flexibility. With the existing version of SALSA, re-using shapes in different mouth-shapes or even in the custom-shapes can cause unexpected, unattractive results like stuttering of blendshapes. It also meant animations would be pulling over-time on the processor cycles fighting each other. With the new queue-based system, duplicate shapes can be used and much more gracefully transition control and processing. Fewer shapes animating means more processor cycles in your back pocket. Priority-based transitions mean your blendshapes will spend less time duking it out and more time looking deliciously cool.

What about my 1-clicks?

SALSA 2.0 will still have them. In fact, with the new core, 1-clicks will be even more streamlined and efficient. The core engine will handle multiple skinned-mesh-renderers and won't need an additional intermediary to translate and sync things up.

Will upgrading to SALSA 2.0 be difficult?

That's a hard question to answer. It really depends on your existing integration of SALSA. For example, if you're using one of the character systems we support with a respective 1-click setup, you would likely only need to install SALSA 2.0 along with the new 1-click setup scripts. If you implement several group expressions in 1.x, these may need to be setup again in SALSA 2.0. The new 1-click setups will likely add expressions automatically, but it depends on what your needs are and how you've implemented and customized your project.

That's it for now folks! As mentioned, check back for updates!

Dialogue System adds support for SALSA LipSync Suite

Tue, 02 Jul 2019 21:15:00 -0500

I'll admit I was a little skeptical at first. I didn't think its approach to lipsync approximation would be comparable to traditional phoneme-based animation. But it does a fantastic job, and it's much easier to add voiceover to your game. If you're considering adding voiceover, or even just eye focus and facial expressions, look into SALSA. -Pixel Crushers

Dialogue System adds support for SALSA LipSync Suite in version 2.1.8!

Pixel Crushers have built fantastic integration for SALSA LipSync Suite into their v2.1.8 release of Dialogue System for Unity. Read their blog post about this release.

If you check out the product page of their awesome asset, you'll notice that it's garnered much praise and lots of (★★★★★) ratings! As you can imagine, we're super excited about the integrated support in Dialogue System for Unity. It's an awesome pairing of assets that give indie projects a AAA feel.

You can grab it from the Pixel Crushers extras page, and check out the interum documentation here.

Simple Automated Lip Sync Approximation
~ We look forward to seeing what you create! ~

SALSA LipSync in WebGL with Amplitude

Mon, 01 Jul 2019 16:27:00 -0500

AmplitudeSALSA is a free add-on that acts as a bridge between SALSA and Amplitude to allow SALSA Lipsync to work on the WebGL platform. If you aren't familiar with SASLA or Amplitude, you can read about them using the links below. Amplitude is our newest asset that provides amplitude and beat detection on the WebGL platform. Watch the SALSA with Amplitude video below!

SALSA (Required)
https://crazyminnowstudio.com/unity-3d/lip-sync-salsa/

Amplitude (Required)
https://crazyminnowstudio.com/unity-3d/amplitude-webgl/

NOTE: Unity version 2019.4+ is required to build for the WebGL target platform when using SALSA LipSync v2.

UPDATE [2019-07-01] - now available for SALSA LipSync v2, requires Unity version 2019.4+ to build for WebGL. Ensure the SALSA References Section is set to "Use External Analysis" - this should be enabled at runtime if it not enabled at design-time.

Installation Instructions

Install SALSA into your project using your preferred method.
Install Amplitude into your project using your preferred method.
Install the AmplitudeSALSA add-on into your project. Download the package from this page, using the link below.

Usage Instructions

Setup a SALSA character as you normally would.
Add the Amplitude component, link your SALSA AudioSource to the Amplitude.audioSource field, and leave the sample size and absolute values checkbox at their default settings.
Add the AmplitudeSALSA component to the same GameObject where SALSA was added, be sure it auto linked your SALSA and Amplitude components, if not it should link them at runtime, or you can link them manually.
While in the editor, play the scene, play your AudioClip, and adjust the AmplitudeSALSA boost to get the desired results. The results should look similar once compiled to WebGL.
AmplitudeSALSA will automatically unlink the AudioSource from your SALSA component on Awake, since this needs to be unlinked to bypass SALSA's built in audio processing.
1. NOTE: for SALSA LipSync v2, the AudioSource is not linked. Rather, the "Use External Analysis" option is enabled which has the same effect.

Please refer to the image below for a typical Amplitude/SALSA configuration

SALSA must be configured to use External Analysis. If you do not see this option, ensure there is no AudioSource linked (remove it if there is).
For better control, enable scaling of external analysis sources.
Adjust the high end of the cutoff depending on your audio source dynamics, start with 0.8 and adjust if needed. Also see #6 below (Amplitude Boost).
Enable Advanced Dynamics for a better look. See SALSA documentation for more details.
SALSA needs a decent amount of data to get a feel for the dynamics, start with 1024. Using a lower value it typically not recommended.
Adjust the boost higher to increase dynamics if necessary, start with 0.4 and adjust if needed. See also #3 above.
Recommend using absolute values for data.
Of course, ensure all of the slots are linked to the appropriate references, including the AudioSource in Amplitude.

Download Files

Amplitude for WebGL
~ Make your web audio move! ~

Buy Amplitude on the Asset Store

Behavior Designer actions for SALSA LipSync Suite

Sat, 29 Jun 2019 21:06:00 -0500

We're very excited to announce our new free Behavior Designer actions for SALSA LipSync Suite. This free add-on exposes essential SALSA LipSync Suite function to the fantastic Behavior Designer system.

06/29/2019 - v2.0.0 - for SALSA LipSync Suite, initial release.

02/18/2020 - v2.3.1 - Requires SALSA LipSync Suite 2.3.1+.

Behavior Designer add-on for SALSA LipSync Suite

Be sure to install SALSA LipSync Suite and Behavior Designer into your project before importing this addon. This addon includes an example scene that demonstrates our custom actions. The example scene can be found in the following folder:

Crazy Minnow Studio > Examples > Scenes > BehaviorDesigner

For lip sync use the Behavior Designer [Set Audio Clip] and [Play] actions under:

Add Task > Actions > Unity > AudioSource > Set Audio Clip
Add Task > Actions > Unity > AudioSource > Play

All SALSA LipSync Suite Actions can be found under:

Add Task > Actions > SALSA

The available custom actions are described below:

Emoter_Emote
- Activate/deactivate an EmoteR emotion.
Eyes_Blink
- Blink using the default timings or a one-time override.
Eyes_Look
- Set/clear a look target for tracking.
Eyes_SetAffinity
- Set/clear affinity and it's properties.
Eyes_SetRandom
- Set random head, eye, and blink status.
Eyes_EnableAll (2.3.1+ only)
- Enable or disable modules in the Eyes component (head, eye, blink, eyelid tracking).

Download Files

Simple Automated Lip Sync Approximation
~ We look forward to seeing what you create! ~

Buy SALSA on the Asset Store

Adventure Creator actions for SALSA LipSync Suite

Sun, 23 Jun 2019 00:47:00 -0500

We're excited to announce our new free Adventure Creator actions for SALSA LipSync Suite. This free add-on exposes essential SALSA LipSync Suite functions to the fantastic Adventure Creator system. We're also pleased to announce a SalsaTextSync integration option using our new Adventure Creator listener for SalsaTextSync add-on. Together, these systems offer automatic lipsync of dialogue audio and dialogue text using Adventure Creators native Dialogue : Play speech Action, and we think that's pretty cool!

06/21/2019 - v2.0.0 - SALSA LipSync Suite, initial release.

06/22/2019 - v2.0.1 - Added a script to load the SALSA demo scene managers and demo scene. It's available in the following menu:

GameObject/Crazy Minnow Studio/SALSA LipSync Suite/Add-ons/Adventure Creator/Load Demo Scene Managers

02/18/2020 - v2.3.1 - Requires SALSA LipSync Suite 2.3.1+.

Installation, setup, and demo scene

Be sure to install the SALSA LipSync Suite and Adventure Creator Assets into your project before importing this add-on.
Import the [AdventureCreator_2.x.x.unitypackage] add-on.
Open player settings and add the Adventure Creator actions for SALSA LipSync Suite define symbol.
- [File] > [Build Settings...] > [Player Settings...] > [Other Settings] > [Scripting Define Symbols*]
- Scripting Define Symbol: SALSAIsPresent
To inform Adventure Creator about our custom action, open the [AC Game Editor] and select the [Actions] tab. In the [Custom Action scripts] section set the directory to:
- \Assets\Crazy Minnow Studio\Addons\AdventureCreator\Actions
To check out the demo scene, use the [Load Demo Scene Managers] option from the following menu. This will load the SALSA demo scene managers into Adventure Creator, and the SALSA demo scene:
- GameObject/Crazy Minnow Studio/SALSA LipSync Suite/Add-ons/Adventure Creator/Load Demo Scene Managers
- The demo scene has the boxHead character setup as an NPC. He's surrounded by a NPC Hotspot, and has three interactions to demostrate our custom actions:
  - Talk to: Uses the Adventure Creator native [Dialogue: Play speech] action.
  - Use: Uses the [ThirdParty: SALSA_Emoter_Emote] action to trigger an emotion, then performs a one-time override blink using the [ThirdParty: SALSA_Eyes_Blink] action.
  - Look at: Uses the [ThirdParty: SALSA_Eyes_Look] action to set the look target, the [ThirdParty: SALSA_Eyes_SetAffinity] action to activate and set affinity preferences, and the [ThirdParty: SALSA_Eyes_SetRandom] action to set random head, eye, and blink states.

Custom Actions

Once the define symbol and custom actions directory are set, all SALSA LipSync Suite Actions are available in the ActionList Editor under Action type: Third Party. For lipsync, use the native Adventure Creator [Dialogue: Play speech] action.

Emoter_Emote
- Activate/deactivate an EmoteR emotion.
Eyes_Blink
- Blink using the default timings or a one-time override.
Eyes_Look
- Set/clear a look target for tracking.
Eyes_SetAffinity
- Set/clear affinity and it's properties.
Eyes_SetRandom
- Set random head, eye, and blink status.
Eyes_EnableAll (2.3.1+ only)
- Enable or disable modules in the Eyes component (head, eye, blink, eyelid tracking).

Adventure Creator integration option for SalsaTextSync (text-to-lipsync) add-on.

What do you get when you combine SALSA real-time lipsync, our free SalsaTextSync (text-to-lipsync) add-on, and the amazing Adventure Creator system? Seemless lipsync to dialogue audio and dialogue text using only the native Adventure Creator Dialogue : Play speech Action.

Setup interaction and dialogue exchanges using Adventure Creators Dialogue : Play speech Action as you normally would.
Add SALSA to your characters (step depend on characters used).
Add SalsaTextSync to your characters.
Download the [SalsaTextSync-AdventureCreatorListener v2.x.x] add-on from the downloads link below and add it to your project.
Add a [SalsaTextSync_ACListener] prefab to your scene.
1. [GameObject] > [Crazy Minnow Studio] > [SALSA LipSync] > [Add-ons] > [SalsaTextSync_ACListener prefab]
Select the [SalsaTextSync_ACListener] GameObject prefab that's been added to the scene and in the custom Inspector select [Browse] to select the Resources/Speech folder that contains audio dialogue (even if you aren't using audio dialogue).
This add-on subscribes to the Adventure Creator OnStartSpeech and OnStopSpeech events and automaticaly uses SalsaTextSync when your Adventure Creator dialogue does not have an associated audio file in Resources/Speech.

Download Files

Simple Automated Lip Sync Approximation
~ We look forward to seeing what you create! ~

Buy SALSA on the Asset Store

SLATE Cinematic Sequencer ActionClips for SALSA LipSync Suite

Sun, 23 Jun 2019 00:46:00 -0500

We're very excited to announce the release of our SALSA ActionClips for SLATE Cinematic sequencer. This free add-on provides essential SALSA LipSync Suite function access to the fantastic cinematic sequencer by Paradox Notion. If you're not familiar with SLATE, check the developers website for more information.

06/22/2019 - v2.0.0 for SALSA LipSync Suite, initial release.

02/18/2020 - v2.3.1 Requires SALSA LipSync Suite 2.3.1+.

SLATE Cinematic Sequencer add-on for SALSA LipSync Suite

Be sure to install the SALSA LipSync Suite and SLATE Cinamatic Sequencer assets into your project before importing this add-on.

All SALSA LipSync Suite ActionClips are available under Actor Action Tracks\SALSA. For lip sync, use the SLATE [Actor Audio Track].

Emoter_Emote
- Activate/deactivate an EmoteR emotion.
Eyes_Blink
- Blink using the default timings or a one-time override.
Eyes_Look
- Set/clear a look target for tracking.
Eyes_SetAffinity
- Set/clear affinity and it's properties.
Eyes_SetRandom
- Set random head, eye, and blink status.
Eyes_EnableAll (2.3.1+ only)
- Enable or disable modules in the Eyes component (head, eye, blink, eyelid tracking).

Download Files

Simple Automated Lip Sync Approximation
~ We look forward to seeing what you create! ~

Buy SALSA on the Asset Store

SALSA LipSync v2 Suite

SALSA LipSync Suite v2.5.6 Released!

2025-01-25: v2.5.6.155

2023-06-08: v2.5.5.135

2021-05-19: v2.5.3.113

2020-09-11: v2.5.0

As always, backup any existing project before you upgrade SALSA LipSync Suite to any new version.

Please see the release notes for details on new features, enhancements, and fixes included in this new version.

TimelineSalsaCore v2.6 Released (includes Eyes Support)

Exporting DAZ Characters for use with SALSA Suite v2

SALSA with RandomEyes (v1.x) End-of-Life

Out with the Old, In with the New

FAQ

SALSA v2.0 devBlog

UPDATE (2019-08-01)

UPDATE (2019-07-25)

UPDATE (2019-07-17)

UPDATE (2019-07-01)

UPDATE (2019-06-30)

UPDATE (2019-06-26)

UPDATE (2019-06-25)

UPDATE (2019-06-22)

UPDATE (2019-06-15)

UPDATE (2019-06-10)

UPDATE (2019-06-06)

UPDATE (2019-05-19)

UPDATE (2019-04-28)

UPDATE (2019-04-15)

UPDATE (2019-04-09)

UPDATE (2019-04-03)

UPDATE (2019-02-25)

UPDATE (2019-02-24)

UPDATE (2019-02-15)

UPDATE (2019-01-31)

UPDATE (2019-01-17)

UPDATE (2019-01-03)

UPDATE (2018-12-26):

UPDATE (2018-11-09):

UPDATE (2018-10-05): Inspector Design

UPDATE (2018-07-25): Inspector Design, Optimizing, & Unity Timeline

UPDATE (2018-06-03): technology preview video 2D (progress-to-date)

UPDATE (2018-05-23): Refactoring and Fixes

UPDATE (2018-05-18): EmoteR updated

UPDATE (2018-05-17): technology preview video (progress-to-date)

UPDATE (2018-05-07):

UPDATE (2018-04-19):

UPDATE (2018-01-09):

UPDATE (2017-09-17):

SALSA v2.0 is coming!

When is SALSA v2.0 going to be released?

Is SALSA v2.0 going to be a free upgrade to existing SALSA 1.x owners?

What sorts of new features will my hard-earned $4 get me with v2.0?

What about my 1-clicks?

Will upgrading to SALSA 2.0 be difficult?

Dialogue System adds support for SALSA LipSync Suite

Dialogue System adds support for SALSA LipSync Suite in version 2.1.8!

SALSA LipSync in WebGL with Amplitude

Behavior Designer actions for SALSA LipSync Suite

Behavior Designer add-on for SALSA LipSync Suite

Crazy Minnow Studio > Examples > Scenes > BehaviorDesigner

Add Task > Actions > Unity > AudioSource > Set Audio Clip

Add Task > Actions > Unity > AudioSource > Play

Add Task > Actions > SALSA

Emoter_Emote

Activate/deactivate an EmoteR emotion.

Eyes_Blink

Blink using the default timings or a one-time override.

Eyes_Look

Set/clear a look target for tracking.

Eyes_SetAffinity

Set/clear affinity and it's properties.

Eyes_SetRandom

Set random head, eye, and blink status.

Eyes_EnableAll (2.3.1+ only)

Enable or disable modules in the Eyes component (head, eye, blink, eyelid tracking).

Adventure Creator actions for SALSA LipSync Suite

Installation, setup, and demo scene

Custom Actions

Emoter_Emote

Activate/deactivate an EmoteR emotion.