feat: willow llm siri post

content/posts/2023-11-20-whisper-assistant/index.md

@@ -0,0 +1,64 @@
+---
+title: "Open source, locally hosted AI powered Siri replacement"
+author: "Sam McLeod"
+description: "Using an ESP32 S3 Box 3 with Willow, Home Assistant and Large Language Models (LLMs) create a locally hosted, offline, AI powered Siri / Alexa replacement."
+categories: [ Tech, AI, LLM, IoT, ESP32, Hardware ]
+keywords: [ "AI", "LLM", "Siri", "Willow", "Homeassistant", "ESP32", "hardware", "IoT" ]
+date: "2023-11-20T01:00:00Z"
+images: [""]
+featuredImagePreview:
+tags:
+- Tech
+- LLM
+- AI
+- HomeAssistant
+- Willow
+- ESP32
+- IoT
+series: ["AI"]
+hiddenFromHomePage: false
+hiddenFromSearch: false
+toc:
+  enable: true
+  auto: false
+code:
+  copy: true
+  maxShownLines: 200
+math: false
+lightgallery: false
+readingTime: true
+showFullContent: true
+asciinema: false
+mermaid: false
+draft: false
+---
+
+Offline AI / LLM Assistant
+
+{{< youtube "_qft28MiVnc" >}}
+
+More info on this soon but the basic idea was to use Willow, Home Assistant and local LLM models to create a locally hosted, offline, AI powered Siri replacement and interface it with ESP32 S3 Box 3 devices.
+
+<!--more-->
+
+## ESP32 S3 Box 3
+
+The [ESP32 S3 Box 3](https://www.espressif.com/en/news/ESP32-S3-BOX-3) is a small, low cost, ESP32 based board with a microphone, speaker, small touch display, 18650 battery, and a few other nice features.
+
+![](esp32-1.png)
+
+![](esp32-2.jpg)
+
+## Willow
+
+[Willow](https://heywillow.io/) is an open source, locally hosted AI powered voice assistant. It is built with Python and runs on Linux, macOS, and Windows. Willow is designed to be extensible and highly configurable.
+
+## Home Assistant
+
+[Home Assistant](https://www.home-assistant.io/) is an open source home automation platform. It is able to track and control all devices at home and offer a platform for automating control. Home Assistant allows you to control all your devices without storing any of your data in the cloud. We like to keep your privacy private.
+
+## Docker-Compose
+
+Bellow are the various docker-compose and config files relating to the project. As they are - **they will not work**, but may prove useful as a reference / guide.
+
+{{< gist sammcj 4bbcc85d7ffd5ccc76a3f8bb8dee1d2b >}}

content/posts/2023-11-26-llm-intro/index.md

@@ -228,3 +228,9 @@ epsilon_cutoff is a parameter that controls the threshold for early termination
 ### eta_cutoff
 
 eta_cutoff is a parameter that controls the threshold for early termination based on the number of tokens generated during inference. A higher value of eta_cutoff will result in more complete inferences, while a lower value of eta_cutoff will result in faster but potentially incomplete inferences. This parameter can be used to balance accuracy and speed during inference.
+
+## Links
+
+Other potentially useful links:
+
+- https://learnprompting.org/docs/intro