Robot Not a Dev? Pre-order Now
Not a Dev?

Misty Community Forum

Future Skill: Screening Moles for Melanoma Skin Cancer

You can’t see your back (or other parts of your body easily) - but Misty II can. So have Misty II take a photo of your area of concern on a regular basis and tell you if she sees any changes in your moles - if so - she recommends a trip to the doctor - also sends off the info to the doctor upon your request.

It could follow the ABCDE algorithm (or others):

The following ABCDEs are important signs of moles that could be skin cancer. If a mole displays any of the signs listed below, have it checked immediately by a dermatologist:

  • Asymmetry: One half of the mole does not match the other half
  • Border: The border or edges of the mole are ragged, blurred, or irregular
  • Color: The mole has different colors or it has shades of tan, brown, black, blue, white, or red
  • Diameter: The diameter of the mole is larger than the eraser of a pencil
  • Evolving: The mole appears different from others and/or changing in size, color, shape

I know - crazy idea.


Like the thinking here!

Hey, finally a skill idea that’s actually interesting :smiley:

This is a pretty interesting idea. Have Misty use a torso detector to detect a human torso and take picture and process. Could put in prompts to have person move to get better coverage. Don’t think Misty’s “flashlight” is strong enough to truly provide good illumination, but could add an external flash or something.

Galaxy detection and identification using deep learning and data

We recently have been in talks in regards with checking for skin cancer at the UHI where we’re based as we’re also getting into the machine learning and processing genomes to find traits to why people after chemo get it again and some don’t.

Both very interesting and worthwhile. Thank you for sharing. Please keep us updated on your progress on both - especially creating a Skill for Misty II for skin cancer detection.

If you have any more information on your talks and feel comfortable sharing - I would love to learn more.

Indeed, I’d be interested if there was a way that we could measure someones ‘gait’. That would be a very useful thing to be able to use. Similar to the old Microsoft Kinnect and the new Azure Kinnect devices thats out there…

There is a lot of opportunity for what I like to call “Misty’s Got Your Back” ideas - essentially providing you views of yourself (along with analysis) that you could never do by yourself (but should be doing).

Thanks Sean - do you think the gait measurement could be used to measure dementia? I’ve heard about something like this.

I think it could @Woo as most types of dementia affect gait and posture, if misty had the azure Kinect software you could easily monitor the patient over time to see how bad they are progressing by uploading images or videos and having machine learning run on the cloud to determine whether it’s got bad or worse, if it has it could make appointments with specialists. This is why I love the misty unit so much as having a misty in the home with these skills especially with the frail could do so much good as a preventive medicine/treatment.

We have a big meeting next week regarding diabetes and the possibility of measuring gait for insoles, and if all goes well then it would mean a possible misty in quite a few homes acting as a preventive treatment plan which would be super cool. However I’ve always said this, misty with the frail and people who suffer dementia could do so much good, like having misty remind them of the past and not only be an interactive friend who tells them when and what pills to take but to also notify appropriate nurses/doctors when the unit notices changes.

I know it sounds like a bold plan but it’s a simple one! Sorry for the long winded answer Justin :joy:

The new Azure Kinect is all self contained so it would be pretty easy to connect one to a Misty. I haven’t handled the new ones to see how heavy they are, but I can’t imagine they are so heavy Misty’s head wouldn’t be able to support it.

The bigger issue might be the height. The viewpoint from 14 inches off the ground is very different than even something at 3-4’. I would expect that trained models at higher heights would have some difficulty at the lower height. Still, it would provide for some very interesting opportunities :slight_smile:

Indeed Vlad, however within an integrated solution the Kinect could be mounted at a proper height and utilised in homes or clinics regardless or not if misty is involved. I have a script that has my Misty at home integrate with various IoT devices via simple messaging querying Azure IoT hub etc and other 3rd parties for work. The possibilities are endless my friend.

This topic is really interesting, and meaningfully beneficial to people. Thanks for posting!

It looks like t he Azure Kinect DK is 440g which is possible to mount to hear head as long as it is well balanced, but is a pretty heavy payload so a bit risky. Given the height concerns @Vlad brought up, it might make sense to mount the Kinect to a backpack with an extension pole. It should be reasonable to elevate the sensor to at least the height of an adult sitting on a chair. Or you could place Misty on a counter for the procedure. :slight_smile:

1 Like

Using the counter for sure would do it.