Skip to content

Commit

Permalink
chapter 5 (microsoft#162)
Browse files Browse the repository at this point in the history
* Update README.md

* chapter 4 (lesson one)

* chapter 4 (lesson 2&4)

* Update pi-camera.md

* Update pi-proximity.md

* chapter 5

* fix

Co-authored-by: Jim Bennett <jim.bennett@microsoft.com>
  • Loading branch information
CinnamonXI and Jim Bennett authored Jul 6, 2021
1 parent 406bd73 commit b3c1142
Show file tree
Hide file tree
Showing 29 changed files with 10 additions and 10 deletions.
2 changes: 1 addition & 1 deletion 5-retail/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -8,7 +8,7 @@ IoT can help with this, using AI models running on IoT devices to count stock, u

In these 2 lessons you'll learn how to train image-based AI models to count stock, and run these models on IoT devices.

> 💁 These lessons will use some cloud resources. If you don't complete all the lessons in this project, make sure you [Clean up your project](../clean-up.md).
> 💁 These lessons will use some cloud resources. If you don't complete all the lessons in this project, make sure you [clean up your project](../clean-up.md).
## Topics

Expand Down
2 changes: 1 addition & 1 deletion 5-retail/lessons/1-train-stock-detector/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -105,7 +105,7 @@ You can train an object detector using Custom Vision, in a similar way to how yo

Call your project `stock-detector`.

When you create your project, make sure to use the `stock-detector-training` resource you created earlier. Use a n*Object Detection* project type, and the *Products on Shelves* domain.
When you create your project, make sure to use the `stock-detector-training` resource you created earlier. Use *Object Detection* project type, and the *Products on Shelves* domain.

![The settings for the custom vision project with the name set to fruit-quality-detector, no description, the resource set to fruit-quality-detector-training, the project type set to classification, the classification types set to multi class and the domains set to food](../../../images/custom-vision-create-object-detector-project.png)

Expand Down
4 changes: 2 additions & 2 deletions 5-retail/lessons/2-check-stock-device/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -116,7 +116,7 @@ You can use bounding boxes combined with probabilities to evaluate how accurate

![Two bonding boxes overlapping a can of tomato paste](../../../images/overlap-object-detection.png)

In the example above, one bounding box indicated a predicted can of tomato paste at 78.3%. A second bounding box is slightly smaller, and is inside the first bounding box with a probability of 64.3%. You code can check the bounding boxes, see they overlap completely, and ignore the lower probability as there is no way one can can be inside another.
In the example above, one bounding box indicated a predicted can of tomato paste at 78.3%. A second bounding box is slightly smaller, and is inside the first bounding box with a probability of 64.3%. Your code can check the bounding boxes, see they overlap completely, and ignore the lower probability as there is no way one can can be inside another.

✅ Can you think of a situation where is it valid to detect one object inside another?

Expand Down Expand Up @@ -157,7 +157,7 @@ Follow the relevant guide below to count stock using the results from the object

Can you detect incorrect stock? Train your model on multiple objects, then update your app to alert you if the wrong stock is detected.

Maybe even take this further and detect stock side by side on the same shelf, and see if something has been put in the wrong place bu defining limits on the bounding boxes.
Maybe even take this further and detect stock side by side on the same shelf, and see if something has been put in the wrong place by defining limits on the bounding boxes.

## Post-lecture quiz

Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -80,7 +80,7 @@ In the image shown above, the bounding boxes have a small overlap. If this overl

### Task - count stock ignoring overlap

1. The Pip package [Shapely](https://pypi.org/project/Shapely/) can be used to calculate the intersection. If you are using a Raspberry Pi, you will need to instal a library dependency first:
1. The Pip package [Shapely](https://pypi.org/project/Shapely/) can be used to calculate the intersection. If you are using a Raspberry Pi, you will need to install a library dependency first:

```sh
sudo apt install libgeos-dev
Expand Down Expand Up @@ -158,6 +158,6 @@ In the image shown above, the bounding boxes have a small overlap. If this overl

1. Run the app with the camera pointing at some stock on a shelf. The output will indicate the number of bounding boxes without overlaps that exceed the threshold. Try adjusting the `overlap_threshold` value to see predictions being ignored.

> 💁 You can find this code in the [code-count/pi](code-count/pi) or [code-count/virtual-device](code-count/virtual-device) folder.
> 💁 You can find this code in the [code-count/pi](code-count/pi) or [code-count/virtual-iot-device](code-count/virtual-iot-device) folder.

😀 Your stock counter program was a success!
Original file line number Diff line number Diff line change
Expand Up @@ -69,6 +69,6 @@ The code you used to classify images is very similar to the code to detect objec

![4 cans of tomato paste on a shelf with predictions for the 4 detections of 35.8%, 33.5%, 25.7% and 16.6%](../../../images/custom-vision-stock-prediction.png)

> 💁 You can find this code in the [code-detect/pi](code-detect/pi) or [code-detect/virtual-device](code-detect/virtual-device) folder.
> 💁 You can find this code in the [code-detect/pi](code-detect/pi) or [code-detect/virtual-iot-device](code-detect/virtual-iot-device) folder.

😀 Your stock counter program was a success!
4 changes: 2 additions & 2 deletions 6-consumer/README.md
Original file line number Diff line number Diff line change
@@ -1,12 +1,12 @@
# Consumer IoT - build a smart voice assistant

The fod has been grown, driven to a processing plant, sorted for quality, sold in the store and now it's time to cook! One of the core pieces of any kitchen is a timer. Initially these started as hour glasses - your food was cooked when all the sand trickled down into the bottom bulb. They then went clockwork, then electric.
The food has been grown, driven to a processing plant, sorted for quality, sold in the store and now it's time to cook! One of the core pieces of any kitchen is a timer. Initially these started as hour glasses - your food was cooked when all the sand trickled down into the bottom bulb. They then went clockwork, then electric.

The latest iterations are now part of our smart devices. In kitchens in homes all throughout the world you'll hear cooks shouting "Hey Siri - set a 10 minute timer", or "Alexa - cancel my bread timer". No longer do you have to walk back to the kitchen to check on a timer, you can do it from your phone, or a call out across the room.

In these 4 lessons you'll learn how to build a smart timer, using AI to recognize your voice, understand what you are asking for, and reply with information about your timer. You'll also add support for multiple languages.

> 💁 These lessons will use some cloud resources. If you don't complete all the lessons in this project, make sure you [Clean up your project](../clean-up.md).
> 💁 These lessons will use some cloud resources. If you don't complete all the lessons in this project, make sure you [clean up your project](../clean-up.md).
## Topics

Expand Down
2 changes: 1 addition & 1 deletion 6-consumer/lessons/1-speech-recognition/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -16,7 +16,7 @@ This video gives an overview of the Azure speech service, a topic that will be c

'Alexa, timer status'

'Alexa set a 8 minute timer called steam broccoli'
'Alexa, set a 8 minute timer called steam broccoli'

Smart devices are becoming more and more pervasive. Not just as smart speakers like HomePods, Echos and Google Homes, but embedded in our phones, watches, and even light fittings and thermostats.

Expand Down

0 comments on commit b3c1142

Please sign in to comment.