Community Blog Buy Now
Blog

Misty Community Forum

2020.02.18 System Update

  • Update 1: This release introduced changes that may have broken certain implementations of the misty.DisplayImage() method in Misty’s JavaScript SDK. We are aware of the issue, and are working on a hotfix to revert the command to its functionality prior to this release. For more detail, see the thread on this topic in the Known Issues category.
  • Update 2: The issue with the DisplayImage command in Misty’s JavaScript SDK is resolved the 2020.02.20 system update.

Greetings, Misty developers!

This is a big release, so let’s cut to the chase. Streaming things first: This update brings a beta implementation of unidirectional audio and video (AV) streaming to the Misty platform. AV streaming has been one of the most requested features since day one, and it gives you more power to solve tough problems and use Misty for important jobs without requiring expert-level knowledge in hardware customization. In other words, it’s exactly the kind of feature we love to share.

And AV streaming isn’t the only new thing to explore. You can now create multiple video recordings, upload your own video assets, and play video assets on Misty’s screen. This last bit comes as part of a larger display system overhaul to give you more control over what Misty shows on her display; related changes include new API commands that you can use to display custom text, animated .gifs, and even webviews.

Other changes include upgrades to the camera service for a better experience when taking pictures, recording videos, and performing computer vision activities, updated tally light notifications, an increased max duration for video recordings, and a handful of other bug fixes and improvements. You can find all the details in the release notes below.

Thanks, as always, for being an early developer for the Misty II platform. We can’t wait to see what you build!

Installing the Update

Misty receives software upgrades as over-the-air (OTA) system updates. This update will be available within the next 24-48 hours (the precise timing varies by region).

Misty automatically checks for new updates each time she boots up. As long as her battery has enough charge, she automatically installs any updates that are available. If your robot doesn’t start to install this update the next time she boots up:

  • Check that Misty is connected to power or sitting on her wireless charging station.
  • Try connecting Misty to the Command Center to make sure she’s still on your Wi-Fi network.

If Misty is charging and connected to the internet, you can check whether an update is available in your region by connecting Misty to the Command Center and looking at the System Updates section.

Note: Misty reboots once during a system update. During an update, Misty ignores all commands except Halt and Stop. If Misty starts installing an update while charging, do not remove the power source until the update is finished and Misty’s eyes are fully open.

If you have issues with a system update or need technical assistance for other reasons, for the quickest response you can:

  • Post a message to the Support category here in the Community forums.
  • Contact the Misty support team through the chat embedded in this site, or by emailing support@mistyrobotics.com.

Release Contents

  • Misty II - Updates
    • Window IoT Core OS version: 10.0.17134 or higher - No updates
    • Android OS: (8.1) - No updates
    • Robot Version: 1.12.7.10330
    • MC Version: 1.12.7.90
    • RT Version: 1.12.7.90
    • Sensory Services App Version: 1.12.7
  • Web-based Tools - Updates (Major changes listed)
  • Misty JavaScript Extension for VSC - No Updates (v1.04)
  • Misty App - Updates (Major changes listed)
  • Documentation - Updates
    • REST and JavaScript API reference documentation for new & updated API commands
    • New conceptual documentation on RGB camera usage and display management
    • Documentation for listed features will be available within 24 - 48 hours of this update.

New Features

Ability to stream audio and video from Misty to an external device. Misty can now use her RGB camera and on-board microphones to transmit an RTMP/RTSP audio and video stream to an external media server, and you can see what Misty sees by viewing the stream in your client of choice. Alternatively, Misty can act as her own media server and publish an RTSP stream you can view in any client on the same network as the robot. Related changes include:

Ability to show videos, .gifs, text, and webviews on Misty’s display. We’ve overhauled the display system to give you more control over what Misty shows on her screen. In addition to displaying images, Misty can now play animated .gifs and videos, display custom text, and show embedded webviews. Related changes include:

  • Implemented display layers for managing content that Misty shows on her screen. You show something new by creating or updating a layer, and you adjust the appearance of your content by updating the settings for the layer on which it is drawn. Layer settings are unique to the type of content (video, text, image, or webview) drawn on that layer.
  • Added the following API commands for updating the display to Misty’s REST API and JavaScript/.NET SDKs:
  • Updated DisplayImage command with ability to show an image hosted on an external web URL.
  • Updated ClearDisplayText command to clear text from the default error text display layer only.

Ability to create and manage multiple video recordings. Misty can now save more than one video recording to the storage on her 820 processor, and the API offers new options for starting a recording and working with recordings that already exist. Related changes include:

  • Added parameters to the StartRecordingVideo command for setting a unique filename, resolution, duration, and mute toggle for each video you record.
  • Increased max duration for a video recording from 10 seconds to 3 minutes.
  • Limited resolution options for video recordings.
  • Added the following API commands for performing operations on video recordings to Misty’s REST API and JavaScript/.NET SDKs:

Ability to upload and manage .mp4 and .wmv video files. Related changes include:

  • Added the following API commands for performing operations on user-uploaded video assets to Misty’s REST API and JavaScript/.NET SDKs:
    • GetVideoList - Obtains a list of existing user-uploaded video assets.
    • DeleteVideo - Deletes a specific user-uploaded video asset.
    • SaveVideo - Uploads a video file to Misty’s storage.
    • GetVideo - Obtains a specific user-uploaded video asset.
  • Deprecated GetVideoFile command in favor of GetVideoRecording. Additionally, the GetVideoFile command now obtains a specific user-uploaded video asset, instead of the most recent video recording. The GetVideoFile command will be removed from Misty’s API in a subsequent release. Read more about these changes in the announcement thread.

Bug Fixes & Improvements

Misty II

Breaking Changes

  • Deprecated GetVideoFile command in favor of GetVideoRecording. Additionally, the GetVideoFile command now obtains a specific user-uploaded video asset, instead of the most recent video recording. The GetVideoFile command will be removed from Misty’s API in a subsequent release. Read more about these changes in the announcement thread.
  • Deprecation notice: To keep naming schemes consistent with the rest of Misty’s API, the REST endpoints for all video assets and video recording management commands will be migrated from /api/video/* to /api/videos/* in a future system update. The deprecated endpoints will be supported for at least 30 days after this update. Use the table below to migrate to the new endpoints:
Command Name HTTP Verb Deprecated Endpoint Current Endpoint
StartRecordingVideo POST api/video/record/start api/videos/recordings/start
StopRecordingVideo POST api/video/record/stop api/videos/recordings/stop
GetVideoRecording (Formerly GetVideoFile) GET api/video api/videos/recordings

Camera

  • Combined camera and computer vision services. This means you can now take pictures, record videos, and use face training, face detection, or face recognition simultaneously.
  • Added a set of allowed native resolutions for taking pictures. Formerly, Misty used the specified width and height to programmatically resize images you captured with the TakePicture command. Now, Misty uses the specified width and height to change the resolution settings for the current camera session, which decreases how long it takes for image data from snapshots to become available for use in your skills and robot applications.

Assets & Display

  • Increased file size limit for all user-uploaded assets (images, videos, and audio files) from 3 MB to 6 MB.
  • Increased request timeout for downloading video recordings to prevent requests for larger recordings from timing out.

Wake Word

  • Reduced latency of key phrase recognition the first time you issue a command to start listening for the wake word.
  • Improved synchronization of wake word notification sound with the start of Misty’s speech capture activities. Formerly, the notification sound could play slightly after speech capture had begun, and the system could recognize the sound as the beginning of speech.
  • Fixed a bug where calling the StopKeyPhraseRecognition command failed to stop the robot listening for the wake word.

Other

  • Misty’s tally light (the blue LED light beneath her flashlight) now automatically turns on during activities where Misty collects personally identifiable information, including taking pictures (RGB, fisheye, and depth), recording video, recording audio, recording speech, recognizing faces, AV streaming, and creating an OCC recording.
  • Adding a trailing / character to the URL for REST API calls to Misty no longer causes the request to fail.

Web-based Tools

Command Center

  • Updated video recording interface to use correct width/height ordering for resolution options.
  • Added functionality to upload, display, and manage video assets using the Image controls under the Assets section.

Misty App

  • Removed login screen. You are no longer required to create an account or log in to use the Misty App.

Known Issues

This list includes new known issues introduced with this release. For a comprehensive list of the issues we’re tracking, see the Known Issues section of the Community forums.

  • This release introduced changes that may have broken certain implementations of the misty.DisplayImage() method in Misty’s JavaScript SDK. We are aware of the issue, and are working on a hotfix to revert the command to it’s functionality prior to this release. For more detail, see the thread on this topic in the Known Issues category.
6 Likes


Misty just keeps getting better and better…Thanks so much for this release!

2 Likes

The versions for my robot are:

Robot Version: 1.0.3.0
Sensory Services Version: 1.0.3
Windows OS Version: 10.0.17763.253

I’ve tried rebooting, changing to a different network, and even tried the targeted update - nothing. When I try [Robot IP]:8080, the standard username/password don’t seem to work either. Any idea what is going on?

Hi @timmydietz, I’ve responded to your thread over in Getting Started :slight_smile:

Responded there. Feel free to delete this comment to prevent duplication.