Skip to content

Add Nicla Vision Documentation for product launch [PC-395] #77

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 115 commits into from
Mar 8, 2022
Merged
Changes from 1 commit
Commits
Show all changes
115 commits
Select commit Hold shift + click to select a range
752f16f
Add datasheet
sebromero Jan 27, 2022
6f02262
Add content for blob detection tutorial
sebromero Feb 3, 2022
5f65853
Remove unused image
sebromero Feb 3, 2022
ff1c7de
Update content/hardware/05.nicla/boards/nicla-vision/tutorials/blob-d…
sebromero Feb 3, 2022
aa38391
Update content/hardware/05.nicla/boards/nicla-vision/tutorials/blob-d…
sebromero Feb 3, 2022
cf029a6
Update content/hardware/05.nicla/boards/nicla-vision/tutorials/blob-d…
sebromero Feb 3, 2022
72ae36b
Merge pull request #29 from arduino/sebromero/blob-detection-tutorial
sebromero Feb 3, 2022
2c9a2f3
Add dummy product page
sebromero Feb 4, 2022
0fb0c81
Added board illustration
BenjaminDannegard Feb 9, 2022
a82e82f
Added tutorial
BenjaminDannegard Feb 10, 2022
f9d2d15
Add info about histogram
sebromero Feb 11, 2022
5e26b57
Merge pull request #35 from arduino/benjamindannegard/add-nicla-visio…
sebromero Feb 12, 2022
97a70b4
Fix numbering
sebromero Feb 12, 2022
4305b9a
Update content/hardware/05.nicla/boards/nicla-vision/tutorials/gettin…
BenjaminDannegard Feb 14, 2022
4311dcf
Added section on camera
BenjaminDannegard Feb 15, 2022
30c7a00
Update content/hardware/05.nicla/boards/nicla-vision/tutorials/gettin…
BenjaminDannegard Feb 15, 2022
18c0581
Updates based on new OMV FW
BenjaminDannegard Feb 15, 2022
3c9e30e
Merge pull request #36 from arduino/benjamindannegard/getting-started…
BenjaminDannegard Feb 15, 2022
47a395f
Update image names
sebromero Feb 15, 2022
f8ce00e
Updated parts of the product page
BenjaminDannegard Feb 16, 2022
0495634
Add IMU to features
aliphys Feb 17, 2022
0955c1e
Merge pull request #41 from arduino/aliphys/niclaVisionAddIMU
aliphys Feb 17, 2022
8638ed5
Updated features
BenjaminDannegard Feb 17, 2022
1a5bc36
Finished product and features
BenjaminDannegard Feb 17, 2022
ea7edfd
Add schematics
marqdevx Feb 17, 2022
f975334
Fix name
marqdevx Feb 18, 2022
4771bd9
Merge pull request #42 from arduino/marqdevx/NiclaVision/PP-schematics
marqdevx Feb 18, 2022
6047848
Add initial version of tutorial
sebromero Feb 18, 2022
3526d8e
First content
marqdevx Feb 8, 2022
f5a92b8
Fix sketch typo
marqdevx Feb 9, 2022
e95af8f
Add OpenMV section
marqdevx Feb 16, 2022
364290f
Include openMV IDE screenshot
marqdevx Feb 17, 2022
56f99a2
Fix note content
marqdevx Feb 17, 2022
7689f0f
Fix sketch
marqdevx Feb 17, 2022
74a4e10
Align content with the Arduino sketch
marqdevx Feb 17, 2022
0441563
Spell check fix
marqdevx Feb 17, 2022
8fc5a55
Remove unused assets
marqdevx Feb 17, 2022
34855f8
Add board image showing the mic
marqdevx Feb 18, 2022
5895f61
Add Troubleshoot
marqdevx Feb 21, 2022
1ae874f
Fix image MD
marqdevx Feb 21, 2022
8c2676f
Add conclusion
marqdevx Feb 21, 2022
5112b85
Fix structure
marqdevx Feb 21, 2022
12fb63b
Fix typo
marqdevx Feb 21, 2022
cb5f79a
Fix link MD
marqdevx Feb 21, 2022
e9f0789
Proximity: First commit
marqdevx Feb 2, 2022
88120f1
Fix board meta data
marqdevx Feb 2, 2022
6a3c446
Remove template's text
marqdevx Feb 2, 2022
5643317
Change header
marqdevx Feb 4, 2022
fcc0378
Rename tutorial folder
marqdevx Feb 7, 2022
e6cecdf
Fix sketch
marqdevx Feb 7, 2022
3ff2c59
Fix content
marqdevx Feb 7, 2022
3149884
Add snippets' explanation
marqdevx Feb 7, 2022
1b1de09
Fix title case
marqdevx Feb 7, 2022
ea81fe0
Fix title case
marqdevx Feb 7, 2022
93c3fec
Upload Nicla Vision asset
marqdevx Feb 7, 2022
5945da2
Add board preview image
marqdevx Feb 7, 2022
664865b
Update sketch
marqdevx Feb 10, 2022
d6af06b
Update API table
marqdevx Feb 10, 2022
7bfc9d1
Update/Fix content
marqdevx Feb 10, 2022
4a128c4
Fix API table
marqdevx Feb 10, 2022
4fb5b7a
Add ArduinoProTutorials Library note
marqdevx Feb 10, 2022
3a4b6e1
WIP
marqdevx Feb 11, 2022
6999159
Change folder name
marqdevx Feb 18, 2022
13100dd
Add sensor image
marqdevx Feb 18, 2022
c4c7d28
remove unused image
marqdevx Feb 18, 2022
dc0bd55
Add explanation about model robustness
sebromero Feb 22, 2022
b976fb2
Add image captions
sebromero Feb 22, 2022
e27815b
Replace screenshots
sebromero Feb 22, 2022
a6972eb
Update content/hardware/05.nicla/boards/nicla-vision/tutorials/image-…
sebromero Feb 23, 2022
ceb5b8a
Adapt illustration
sebromero Feb 23, 2022
501c88b
Fix incorrect paragraph
sebromero Feb 23, 2022
85cd7a0
Remove old image
sebromero Feb 23, 2022
897645a
Merge pull request #46 from arduino/sebromero/nv-image-classification
sebromero Feb 23, 2022
ab96f9d
Added IMU tutorial
BenjaminDannegard Feb 24, 2022
ad3d1be
Spell fix
BenjaminDannegard Feb 24, 2022
793acca
Update content/hardware/05.nicla/boards/nicla-vision/tutorials/nicla-…
BenjaminDannegard Feb 24, 2022
b6ab152
Small fix
BenjaminDannegard Feb 24, 2022
e5732cb
Update content/hardware/05.nicla/boards/nicla-vision/tutorials/nicla-…
BenjaminDannegard Feb 24, 2022
cf23932
Apply suggestions from code review
marqdevx Feb 24, 2022
771460a
Fix openMV analyzer screenshot
marqdevx Feb 24, 2022
a59cff4
Merge branch 'marqdevx/tutorial/NiclaVision/microphone' of https://gi…
marqdevx Feb 24, 2022
848b5b3
Update content/hardware/05.nicla/boards/nicla-vision/tutorials/proxim…
marqdevx Feb 24, 2022
4005e84
Merge pull request #50 from arduino/benjamindannegard/nicla-vision-IM…
BenjaminDannegard Feb 24, 2022
f7411b9
Fix sketch and add complete sketch
marqdevx Feb 24, 2022
702f0c1
Update metadata
marqdevx Feb 24, 2022
d7d76d6
Remove metadata tag
marqdevx Feb 24, 2022
579fb32
Added some content to the tutorial
BenjaminDannegard Feb 24, 2022
763ad0e
Small fix to headers
BenjaminDannegard Feb 24, 2022
0e21e19
Fixed names of files
BenjaminDannegard Feb 24, 2022
5caf420
Merge pull request #51 from arduino/benjamindannegard/nicla-vision-fi…
BenjaminDannegard Feb 24, 2022
0ba391d
Fix small typos
marqdevx Feb 25, 2022
77e25d1
Fix code blocks
marqdevx Feb 25, 2022
be949c6
Fix skeetch
marqdevx Feb 25, 2022
9bc875a
Merge pull request #52 from arduino/lunnea/nicla-vision-pp
lunnea Feb 25, 2022
33d2151
Fix sketch
marqdevx Feb 25, 2022
4ceb90e
Merge pull request #32 from arduino/marqdevx/tutorial/NiclaVision/mic…
marqdevx Feb 25, 2022
96b4f26
Fix typo
marqdevx Feb 25, 2022
80fb2e1
Merge pull request #26 from arduino/marqdevx/tutorial/NiclaVision/pro…
marqdevx Feb 25, 2022
adfa845
Added pinout files
BenjaminDannegard Feb 25, 2022
cb96e03
Merge pull request #55 from arduino/benjamindannegard/add-nicla-visio…
BenjaminDannegard Feb 25, 2022
16fcdb0
Update content/hardware/05.nicla/boards/nicla-vision/tech-specs.yml
sebromero Mar 7, 2022
13c2fff
Update content/hardware/05.nicla/boards/nicla-vision/tutorials/blob-d…
sebromero Mar 7, 2022
e631fad
Update content/hardware/05.nicla/boards/nicla-vision/tutorials/gettin…
sebromero Mar 7, 2022
1632fce
Update content/hardware/05.nicla/boards/nicla-vision/tutorials/nicla-…
sebromero Mar 7, 2022
e797597
Apply suggestions from code review
sebromero Mar 7, 2022
18bd7d0
Update features.md
martab1994 Mar 7, 2022
56d19cf
Merge pull request #59 from arduino/martab1994-patch-1
martab1994 Mar 7, 2022
60beb49
Update content.md
martab1994 Mar 7, 2022
26ebabd
Merge pull request #60 from arduino/martab1994-patch-1
martab1994 Mar 7, 2022
6911b66
Mic tutorial: Fixes from review
marqdevx Mar 7, 2022
5dbe252
Update content/hardware/05.nicla/boards/nicla-vision/tutorials/microp…
marqdevx Mar 8, 2022
d1a3668
Merge pull request #61 from arduino/marqdevx/niclaVision/microhpone-f…
sebromero Mar 8, 2022
128ed38
Added images
BenjaminDannegard Mar 8, 2022
37e5162
Spelling fix
BenjaminDannegard Mar 8, 2022
2c80989
Merge pull request #62 from arduino/benjamindannegard/nicla-vision-im…
BenjaminDannegard Mar 8, 2022
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
Apply suggestions from code review
Co-authored-by: BenjaminDannegard <benjamin.dannegard@gmail.com>
  • Loading branch information
marqdevx and BenjaminDannegard authored Feb 24, 2022
commit cf23932d0cf5cc425970560d74e0f14acd25112b
Original file line number Diff line number Diff line change
Expand Up @@ -43,17 +43,17 @@ In this tutorial you will use the **Arduino Nicla Vision** board to get the micr

## Set Up

To check that you set up correctly the board please visit our [Getting Started Guide](https://docs.arduino.cc/tutorials/nicla-vision/getting-started) for both **OpenMV** and **Arduino** available instructions.
To check that you correctly set up the board please visit our [Getting Started Guide](https://docs.arduino.cc/tutorials/nicla-vision/getting-started) for both **OpenMV** and **Arduino** instructions.

## OpenMV

Open the program by going to **Examples > Arduino > NanoRP2040 > Audio > Audio_fft.py**.
Open the script by going to **Examples > Arduino > NanoRP2040 > Audio > Audio_fft.py**.

***Using the same sketch as the NanoRP2040, cause both boards access the microhpone the same way***
***Using the same sketch as the NanoRP2040, because both boards access the microhpone in the same way***

Make sure you linked the board by checking the Serial Port and upload the program.
Make sure the board is connected, if the board is connected to OpenMV you should see a green play button in the bottom left corner of the window. If you do not see this icon, try pressing the connect button in the bottom left corner. If there still is some issue to connect the board take another look at the getting started guide.

You will see an spectrum analyzer on the top right panel that reflects the audio readings input.
When the script is running, you will see an spectrum analyzer in the top right panel that reflects the audio readings input. Try making some noise and see how it reacts.

![OpenMV IDE - Spectrum analyzer](assets/OpenMV_spectrumAnalyzer.png)

Expand All @@ -69,10 +69,10 @@ You can run the sketch to see the result, it will show the data that the microph

Now that you can get the microphone data, let's control the built-in RGB LED and change the speed of its blinking depending on the values.

You can access the example sketch at **Examples > PDM > PDMSerialPlotter** and then edit as we shown.
Or the full edited sketch on our **Arduino_Pro_Tutorials** library.
You can access the example sketch at **Examples > PDM > PDMSerialPlotter** and then edit as shown in this tutorial.
Or find the full edited sketch in our **Arduino_Pro_Tutorials** library.

**Sketch**:
### Complete Sketch

```arduino
/*
Expand Down Expand Up @@ -180,13 +180,13 @@ Or the full edited sketch on our **Arduino_Pro_Tutorials** library.

After you have successfully verified and uploaded the sketch to the board, open the Serial Monitor from the menu on the left. You will now see the new values printed.

If you want to test it, the only thing you need to do is to place the board next to a speaker and speak or play some sound to see how the blinking of the RGB LED changes based on the input.
If you want to test it, the only thing you need to do is to speak or play some sounds close to the board and see how the blinking of the RGB LED changes based on the input.

### Troubleshoot

- In case the Serial Monitor freezes, unplug and plug again the board from your computer, and try to upload again the sketch
- In case the Serial Monitor freezes, unplug and then plug the board into your computer again, now try to upload the sketch
- If the sketch is not working, try to double tap the reset button and upload the sketch once again.

## Conclusion

You have learned how to get data from the microphone, it can be used for example as an alarm system to wake up the board and make a screenshot with the Camera.
You have learned how to use the Arduino IDE and OpenMV to get data from the microphone and then use it to change the RGB LED on the board. This can for example be used as an alarm system to wake the board up and take a screenshot with the Camera.