Home Community Blog Buy Now
Blog

Misty Community Forum

Remote Viewing / Streaming Audio and Video Via Misty

I would like to be able to log in to Misty remotely and see and hear via her cameras and microphones (and talk)

I wouldn’t think this wouldn’t be too difficult. This is available on the Robomaster S1 and its basically a big toy tank

Hey, I was the engineer who made that video streaming demo. Since the Android 820 handles the camera, I just installed https://play.google.com/store/apps/details?id=com.pas.webcam&hl=en on the 820 by downloading the apk from one of the apk download sites you can find by googling and installing it on the 820 using ADB. You can then configure the video stream in the app using Vysor. This post is actually pretty informative about how to do the adb/Vysor stuff Connect Misty to an external speaker

Cheers!

1 Like

I do want to put in a disclaimer. I am not exactly sure how Misty handles resource contention when it comes to things like the camera so perhaps running the ip camera app at the same time as the Misty app on the 820 could cause Misty camera functionality such as face detection to not work. I can imagine one can probably uninstall or stop the ip camera app via Vysor to avoid this. Apologies for any inconveniences.

When will streaming audio from and to Misty be available? Streaming audio should reduce the time it takes to send audio to external services or to receive and play audio from external services. I know your roadmap mentions it might be available within 6 months but is there a more specific date e.g., End of Feb? end of March? etc.

Streaming video would also be very useful :slight_smile:

We don’t have an estimate on implementing this feature but it is highly desired based on the wishlist item here:

I encourage you to vote and comment there. In fact I will move this comment to that topic.

Hi @wspeerbrecker thank you for bringing this topic up. We know it’s been asked by many developers and is very useful in various skills and applications.

As @Ben said we don’t have an estimate yet on implementing this full feature but we have an alpha version that’s a step in that direction. In the next few weeks we hope to release it and have you test it.

Do you have a particular skill in mind that you would like to use it for? That will help us keep this use case in mind when designing this feature.

Thank you again for all your input,

Justin Woo

Hi Justin,

I am trying to think of ways to reduce the latency when calling an external system. For example, if an external system / api can return streaming audio then it would be faster for Misty to play the streaming audio (instead of saving the audio file and then playing it).

Another use case might be to stream an online radio (or podcast, music, etc.) to Misty so the user can listen to it. However there would have to be some way for the user to tell Misty to stop playing it (by voice or touching Misty’s head, etc.).

I have not researched / investigated the technical details but I assume it is possible.

What do you think? will it be possible to do it with Misty?

Wes