Home Community Blog Buy Now
Blog

Misty Community Forum

2020.04.07 System Update

Greetings, Misty developers!

We’re excited to announce Misty’s next system update. This update adds new API commands for managing audio playback, as well as the ability for Misty to play (and stream!) audio directly from a URL. Other notable changes include bug fixes for shared skill data and cross-skill events, and reliability improvements to Misty’s docking station location. Be sure to see the full list of changes below.

Thanks, as always, for being an early developer for the Misty II platform. We can’t wait to see what you build!

Installing the Update

Misty receives software upgrades as over-the-air (OTA) system updates. This update will be available within the next 24-48 hours (the precise timing varies by region).

Misty automatically checks for new updates each time she boots up. As long as her battery has enough charge, she automatically installs any updates that are available. If your robot doesn’t start to install this update the next time she boots up:

  • Check that Misty is connected to power or sitting on her wireless charging station.
  • Try connecting Misty to the Command Center to make sure she’s still on your Wi-Fi network.

If Misty is charging and connected to the internet, you can check whether an update is available in your region by connecting Misty to the Command Center and looking at the System Updates section.

Note: Misty reboots once during a system update. During an update, Misty ignores all commands except Halt and Stop. If Misty starts installing an update while charging, do not remove the power source until the update is finished and Misty’s eyes are fully open.

If you have issues with a system update or need technical assistance for other reasons, for the quickest response you can:

  • Post a message to the Support category here in the Community forums.
  • Contact the Misty support team through the chat embedded in this site, or by emailing support@mistyrobotics.com.

Release Contents

  • Misty II - Updates
    • Window IoT Core OS Version: 10.0.17134 or higher - No updates
    • Android OS Version: 8.1 - No updates
    • Robot Version: 1.16.0.10487
    • MC Version: 1.16.0.247
    • RT Version: 1.16.0.247
    • Sensory Services App Version: 1.16.0
  • Web-based Tools - Added controls to pause and stop audio playback.
  • Misty JavaScript Extension for VSC - No updates.
  • Misty App - No updates.
  • Documentation - Updated API reference documentation for new audio playback functionality.

New Features

  • Added commands for pausing & stopping audio asset playback. Use the new StopAudio and PauseAudio commands in Misty’s REST API and JavaScript / .NET SDKs to stop or pause audio playback for a given audio file.
  • Added ability to play and stream audio from HTTP, HTTPS, or RTSP URLs. To play audio from a URL, pass the URL of the audio source into the PlayAudio command as the value for the FileName parameter.

Bug Fixes & Improvements

Auto Docking & SLAM

  • Fixed 3D point locations for the docking station to be in the same coordinate frame as the depth sensor during docking station location.
  • Improved filtering on docking station location data to improve reliability of ChargerPoseMessage event data.
  • Updated SLAM status APIs to provide status of docking station detection (added DockingStationDetectorProcessingEnabled and DockingStationDetectorProcessing statuses)
  • Misty’s IR cameras now automatically adjust exposure during docking station detection by default. You can manually disable automatic exposure adjustments when you issue the StartLocatingDockingStation command.

Skill System

  • Potentially Breaking: Added EnableAutoExposure argument to StartLocatingDockingStation command in Misty’s REST API and JavaScript/.NET SDKs. (For the misty.StartLocatingDockingStation() method in the JavaScript API, this argument displaces the prePauseMs and postPauseMs arguments. If you use these arguments in your auto-docking JavaScript code, you may need to update your skill before it will work with this update.)
  • Potentially Breaking: Misty’s shared skill data system no longer uses case-sensitive key string values for reading and writing data. (For example, in earlier software versions, calling misty.Set("KEY", "value") and misty.Set("key", "value") updated two different pieces of data. Now, calling the methods as written in this example writes to the same data.)
  • Fixed a bug where the TriggerEvent command failed to pass data from the user-defined payload into TriggerEvent callback functions.

Audio Playback & Recording

  • Issuing a SetDefaultVolume command while Misty is playing audio now changes volume for the current audio playback. Note: Issuing a SetDefaultVolume command while Misty is speaking an utterance you create with the Speak command does not change the volume of that utterance; however, the next Speak command that Misty receives after you change the default volume will use the newly set system volume.
  • Removed legacy properties from AudioPlayComplete event messages. The audio metadata associated with AudioPlayComplete events now only includes the filename or URL for the completed audio source.
  • Fixed an issue where Misty’s tally light (the blue LED beneath her flashlight) failed to turn when Misty records audio after key phrase recognition.

.NET SDK

  • Updated summaries for event validation methods.
  • The UnregisterEvent method now returns a list of unregistered events in the response.

Web-based Tools

Command Center

  • Added controls for pausing and stopping audio playback.
  • Added option to subscribe to TextToSpeechComplete WebSocket from the Advanced Options modal in the Sensor Data section.

Known Issues

The following is a list of new known issues with this release. For a comprehensive list of the issues we’re tracking, see the Known Issues section of the Community forums.

  • PauseAudio Issue: After you pause playback for an audio file hosted on the web (for example, an .mp3 file at an HTTP or HTTPS URL), Misty doesn’t play the file from the beginning or from the paused location when you issue a PlayAudio command to resume playback. Issuing another (second) PlayAudio command for that audio source after the pause will play the audio source from the beginning.

Awesome progress!

Do you have practical examples of where we might want to disable automatic exposure adjustments?

Flagging @Vlad for a more detailed response than I can provide :slight_smile:

99% of the time you will most likely want to leave this enabled. But for certain scenarios (or if you want to do your own algorithms from scratch) you may want to turn it off so you can manually control the exposure in your skill.

An example where auto-exposure might do the wrong thing would be if you have a dark background behind the charging station and as you get closer the auto-exposure will try to boost the exposure which is not what we want since we want the strongest returns to be from the reflectors. With normal wall colors this is not an issue.

2 Likes

3 posts were split to a new topic: Issues with Set and Get after 2020.04.07 System Update

Hi Jonathan - since the update I’ve experiences a couple of issues with my Concierge skill. Do you want me to post them here or via email?
Example: DevTools failed to load SourceMap: Could not load content for http://sdk.mistyrobotics.com/dependencies/popper/popper.min.js.map: HTTP error: status code 404, net::ERR_HTTP_RESPONSE_CODE_FAILURE

And:
“Failed to get data using key ‘recordingAudio’ and skill namespace ‘500c5e92-2d9c-49a8-85b9-truncated…’” “2020-04-14T15:56:30.0739494Z”

@Cgkocks possibly same error as reported in Issues with `Set` and `Get` after 2020.04.07 System Update ?