Community Blog Buy Now

Misty Community Forum

Custom realtime image processing

Thinking of skills like:

  • follow the light/laser pointer/line on the ground
  • overall light level
  • if sun is shining outside
  • object tracking

Currently we are limited to the builtin face detection or1+ second image captures.

This is probably not easy and requires running on the Android CPU to be realtime enough.
Also Javascript/C# might not be fast enough. GPU acceleration would help.
Maybe a native SDK for image recognition pipelines that process video frames into events that can be subscribed from skill SDK?