From d3cfee1eb3cd598390f5cb180db75ec89e06066f Mon Sep 17 00:00:00 2001 From: Doug Ware Date: Tue, 30 Jul 2024 16:03:12 -0400 Subject: [PATCH] AntArmyIntro --- docs/Journal/TranscriptionAndDiarization.html | 2 +- docs/Projects/AntArmyPreview.html | 98 +++++++++++++++++++ docs/Projects/toc.html | 3 + docs/Projects/toc.json | 2 +- docs/manifest.json | 35 +++++-- docs/sitemap.xml | 72 +++++++------- docs/toc.html | 2 +- docs/toc.json | 2 +- docs/video/AntArmyIntro.mp4 | 3 + 9 files changed, 173 insertions(+), 46 deletions(-) create mode 100644 docs/Projects/AntArmyPreview.html create mode 100644 docs/video/AntArmyIntro.mp4 diff --git a/docs/Journal/TranscriptionAndDiarization.html b/docs/Journal/TranscriptionAndDiarization.html index c344b03..4b8f71d 100644 --- a/docs/Journal/TranscriptionAndDiarization.html +++ b/docs/Journal/TranscriptionAndDiarization.html @@ -119,7 +119,7 @@

Who said w [SPEAKER_00] : [(00:00:31.980, 00:00:36.160)] : I'm going to hand off to my good friend Jeremy Thake, and he's going to walk you through the first half of this session. Thanks, Barno. I appreciate it. And thank you for coming to Build. [SPEAKER_01] : [(00:00:37.960, 00:00:40.280)] : So I'm Jeremy Thake. I'm a

Identify speaker names using phi-3-medium

-

Often at this point I have to do some manual steps to replace “SPEAKER_00” with a real name because I find that very often, perhaps most of the time, people don’t say their own names or refer to others by name. But still, if I am doing this process, I intend to use the transcript with a language model to get insight from the content.

In this case, Barnam and Jeremy demonstrated excellent presenter skills and the text contains their names. Thanks to this, I can use a language model to extract their names and update the transcript. For this task I used microsoft/Phi-3-medium-4k-instruct-onnx-directml which is a version of Phi-3-medium-4k-instruct optimized for use with ONNX runtime which makes it super fast on my RTX-4090 GPU. Use it if you have a GPU and are using Windows.

+

Often at this point I have to do some manual steps to replace “SPEAKER_00” with a real name because I find that very often, perhaps most of the time, people don’t say their own names or refer to others by name. But still, if I am doing this process, I intend to use the transcript with a language model to get insight from the content.

In this case, Barnam and Jeremy demonstrated excellent presenter skills and the text contains their names. Thanks to this, I can use a language model to extract their names and update the transcript – an perfect example of using a language model to get insight from the content!

For this task I used microsoft/Phi-3-medium-4k-instruct-onnx-directml which is a version of Phi-3-medium-4k-instruct optimized for use with ONNX runtime which makes it super fast on my RTX-4090 GPU. Use it if you have a GPU and are using Windows.

My notebook contains code to pull out a few lines before and after a speaker’s first appearance and build a prompt: 

 # Create the prompt with the current speaker and their context  
         prompt = f"""  
diff --git a/docs/Projects/AntArmyPreview.html b/docs/Projects/AntArmyPreview.html
new file mode 100644
index 0000000..6ad99bc
--- /dev/null
+++ b/docs/Projects/AntArmyPreview.html
@@ -0,0 +1,98 @@
+
+
+  
+    
+      AntArmy – Together we are strong! 
+      
+      
+      
+      
+      
+      
+      
+      
+      
+      
+      
+
+      
+
+      
+      
+  
+
+  
+    

+      
+    

+
+    

+      

+        

+          

+            
Table of Contents

+            
+          

+          

+            
+          

+        

+      

+
+      

+        

+          
+
+          
+        

+
+        

+
AntArmy – Together we are strong!

+
+
  
+

+
+        

+        

+
+        
+        
+      

+
+      

+        
+      

+    

+
+
+    
+  
+
\ No newline at end of file
diff --git a/docs/Projects/toc.html b/docs/Projects/toc.html
index bb53526..79ec7b0 100644
--- a/docs/Projects/toc.html
+++ b/docs/Projects/toc.html
@@ -12,6 +12,9 @@
       

           
           
    
+                
  • 
+                    Ant Army Preview
+                
    • 
                 
  • 
                     Locally and Privately Extracting Meaning from Video with Transcription, Diarization, and LLMs
                 
    • 
diff --git a/docs/Projects/toc.json b/docs/Projects/toc.json
index 564c934..63eac28 100644
--- a/docs/Projects/toc.json
+++ b/docs/Projects/toc.json
@@ -1,2 +1,2 @@
 
-{"items":[{"name":"Locally and Privately Extracting Meaning from Video with Transcription, Diarization, and LLMs","href":"TranscriptionAndDiarization.html","topicHref":"TranscriptionAndDiarization.html"},{"name":"LibreChat Azure Container Apps Bicep","href":"LibreChatBicep.html","topicHref":"LibreChatBicep.html"},{"name":"Convert PDF to Markdown with Azure Document Intelligence and GPT-4","href":"IngestingPdfContent.html","topicHref":"IngestingPdfContent.html"},{"name":"String Extensions","href":"StringExtensions.html","topicHref":"StringExtensions.html"},{"name":"Text Generation Web UI API Helper","href":"OobaboogaAPIHelper.html","topicHref":"OobaboogaAPIHelper.html"},{"name":"Weighted Random Numbers","href":"WeightRandoms.html","topicHref":"WeightRandoms.html"},{"name":"DocFx Site PowerShell and Github Pages","href":"DocBuilder.html","topicHref":"DocBuilder.html"}]}
\ No newline at end of file
+{"items":[{"name":"Ant Army Preview","href":"AntArmyPreview.html","topicHref":"AntArmyPreview.html"},{"name":"Locally and Privately Extracting Meaning from Video with Transcription, Diarization, and LLMs","href":"TranscriptionAndDiarization.html","topicHref":"TranscriptionAndDiarization.html"},{"name":"LibreChat Azure Container Apps Bicep","href":"LibreChatBicep.html","topicHref":"LibreChatBicep.html"},{"name":"Convert PDF to Markdown with Azure Document Intelligence and GPT-4","href":"IngestingPdfContent.html","topicHref":"IngestingPdfContent.html"},{"name":"String Extensions","href":"StringExtensions.html","topicHref":"StringExtensions.html"},{"name":"Text Generation Web UI API Helper","href":"OobaboogaAPIHelper.html","topicHref":"OobaboogaAPIHelper.html"},{"name":"Weighted Random Numbers","href":"WeightRandoms.html","topicHref":"WeightRandoms.html"},{"name":"DocFx Site PowerShell and Github Pages","href":"DocBuilder.html","topicHref":"DocBuilder.html"}]}
\ No newline at end of file
diff --git a/docs/manifest.json b/docs/manifest.json
index 006d434..444ab4f 100644
--- a/docs/manifest.json
+++ b/docs/manifest.json
@@ -1520,7 +1520,7 @@
       "output": {
         ".html": {
           "relative_path": "Journal/TranscriptionAndDiarization.html",
-          "hash": "O0gPPGCTy4eCeLnL5wC6bRYPHEfrT+YxlpVp7I0TyQM="
+          "hash": "1h7VGE95kwwbn5BlRhWNkxoCNkE2w0BmSW769jjdtDs="
         }
       },
       "is_incremental": false,
@@ -1566,6 +1566,18 @@
       "is_incremental": false,
       "version": ""
     },
+    {
+      "type": "Conceptual",
+      "source_relative_path": "Projects/AntArmyPreview.md",
+      "output": {
+        ".html": {
+          "relative_path": "Projects/AntArmyPreview.html",
+          "hash": "Y7VHQuBunSW1waq7+WXkOS3TtP+yTVyBATDtfZZ9NBk="
+        }
+      },
+      "is_incremental": false,
+      "version": ""
+    },
     {
       "type": "Conceptual",
       "source_relative_path": "Projects/DocBuilder.md",
@@ -1674,11 +1686,11 @@
       "output": {
         ".html": {
           "relative_path": "Projects/toc.html",
-          "hash": "vfKM7gJsPdaHhybMofs39VH6C4V9VGix+hekVDjQNgQ="
+          "hash": "ck8DojIOFT4xXb0tXUgtH6OEgFJ+LE9BUB7nDuTOpnY="
         },
         ".json": {
           "relative_path": "Projects/toc.json",
-          "hash": "UsE81BLGq9OiJcLwHaRKomoawmg6iWVdGQwFq3PHlDA="
+          "hash": "oA1pNT9cPi5V6nre/TnxhtWd8HlNNvpUpAB9TWfYAJ8="
         }
       },
       "is_incremental": false,
@@ -1701,11 +1713,22 @@
       "output": {
         ".html": {
           "relative_path": "toc.html",
-          "hash": "mVzJTlPmyn8kMqxDtwHuqN59ey0xZSD2cY1I8N67MeQ="
+          "hash": "HoM52h7f9q2v5hsSYi+FX2sZZP0qiGgC7/5A8nWCzGE="
         },
         ".json": {
           "relative_path": "toc.json",
-          "hash": "cEzeOxJq+Em3Li6baclOJXXxxSt5hqeAhLsA0PaqHTQ="
+          "hash": "+Y+//BuqVvQKGzAAAlWvjGLjvr0CPErPgfZ4xa54yTo="
+        }
+      },
+      "is_incremental": false,
+      "version": ""
+    },
+    {
+      "type": "Resource",
+      "source_relative_path": "video/AntArmyIntro.mp4",
+      "output": {
+        "resource": {
+          "relative_path": "video/AntArmyIntro.mp4"
         }
       },
       "is_incremental": false,
@@ -1726,7 +1749,7 @@
         "ConceptualDocumentProcessor": {
           "can_incremental": false,
           "incrementalPhase": "build",
-          "total_file_count": 30,
+          "total_file_count": 31,
           "skipped_file_count": 0
         },
         "ResourceDocumentProcessor": {
diff --git a/docs/sitemap.xml b/docs/sitemap.xml
index a9f4482..da9d90f 100644
--- a/docs/sitemap.xml
+++ b/docs/sitemap.xml
@@ -1,188 +1,188 @@
 
 
-  
-    https://www.elumenotion.com/index.html
-    2024-06-17T12:19:36-04:00
-    weekly
-    0.1
-  
   
     https://www.elumenotion.com/FeaturedContent/AboutMe.html
-    2024-06-17T12:19:36-04:00
+    2024-07-30T03:59:48-04:00
     weekly
     0.1
   
   
     https://www.elumenotion.com/Journal/April14To162023.html
-    2024-06-17T12:19:36-04:00
+    2024-07-30T03:59:48-04:00
     weekly
     0.1
   
   
     https://www.elumenotion.com/Journal/BuildingDomainSpecificLLMBots.html
-    2024-06-17T12:19:36-04:00
+    2024-07-30T03:59:48-04:00
     weekly
     0.1
   
   
     https://www.elumenotion.com/Journal/ChatGPTCodeInterpreter.html
-    2024-06-17T12:19:36-04:00
+    2024-07-30T03:59:48-04:00
     weekly
     0.1
   
   
     https://www.elumenotion.com/Journal/CopilotStudioThoughts.html
-    2024-06-17T12:19:36-04:00
+    2024-07-30T03:59:48-04:00
     weekly
     0.1
   
   
     https://www.elumenotion.com/Journal/CurrentOpinions.html
-    2024-06-17T12:19:36-04:00
+    2024-07-30T03:59:48-04:00
     weekly
     0.1
   
   
     https://www.elumenotion.com/Journal/DetectingAIGeneratedContent.html
-    2024-06-17T12:19:36-04:00
+    2024-07-30T03:59:48-04:00
     weekly
     0.1
   
   
     https://www.elumenotion.com/Journal/index.html
-    2024-06-17T12:19:36-04:00
+    2024-07-30T03:59:48-04:00
     weekly
     0.1
   
   
     https://www.elumenotion.com/Journal/IngestingPdfContent.html
-    2024-06-17T12:19:36-04:00
+    2024-07-30T03:59:48-04:00
     weekly
     0.1
   
   
     https://www.elumenotion.com/Journal/LibreChatBicep.html
-    2024-06-17T12:19:36-04:00
+    2024-07-30T03:59:48-04:00
     weekly
     0.1
   
   
     https://www.elumenotion.com/Journal/OpenSourceVersusOpenAI.html
-    2024-06-17T12:19:36-04:00
+    2024-07-30T03:59:48-04:00
     weekly
     0.1
   
   
     https://www.elumenotion.com/Journal/PDFMarkdown/mtoExtractedText.html
-    2024-06-17T12:19:36-04:00
+    2024-07-30T03:59:48-04:00
     weekly
     0.1
   
   
     https://www.elumenotion.com/Journal/PDFMarkdown/mtoFromDocIntelOnly.html
-    2024-06-17T12:19:36-04:00
+    2024-07-30T03:59:48-04:00
     weekly
     0.1
   
   
     https://www.elumenotion.com/Journal/PDFMarkdown/mtoGPT4Omni.html
-    2024-06-17T12:19:36-04:00
+    2024-07-30T03:59:48-04:00
     weekly
     0.1
   
   
     https://www.elumenotion.com/Journal/PDFMarkdown/mtoGPT4OmniWithDocIntelOCR.html
-    2024-06-17T12:19:36-04:00
+    2024-07-30T03:59:48-04:00
     weekly
     0.1
   
   
     https://www.elumenotion.com/Journal/PDFMarkdown/mtoGPT4Turbo.html
-    2024-06-17T12:19:36-04:00
+    2024-07-30T03:59:48-04:00
     weekly
     0.1
   
   
     https://www.elumenotion.com/Journal/PDFMarkdown/mtoGPT4TurboWithDocIntelOCR.html
-    2024-06-17T12:19:36-04:00
+    2024-07-30T03:59:48-04:00
     weekly
     0.1
   
   
     https://www.elumenotion.com/Journal/PDFMarkdown/mtoGPT4VisionPreviewAndAzureComputerVisionOCR.html
-    2024-06-17T12:19:36-04:00
+    2024-07-30T03:59:48-04:00
     weekly
     0.1
   
   
     https://www.elumenotion.com/Journal/ProjectedUserExperiencesWithAI.html
-    2024-06-17T12:19:36-04:00
+    2024-07-30T03:59:48-04:00
     weekly
     0.1
   
   
     https://www.elumenotion.com/Journal/SpeechDictation2.html
-    2024-06-17T12:19:36-04:00
+    2024-07-30T03:59:48-04:00
     weekly
     0.1
   
   
     https://www.elumenotion.com/Journal/TranscriptionAndDiarization.html
-    2024-06-17T12:19:36-04:00
+    2024-07-30T03:59:48-04:00
     weekly
     0.1
   
   
     https://www.elumenotion.com/Journal/WritingByTalking.html
-    2024-06-17T12:19:36-04:00
+    2024-07-30T03:59:48-04:00
+    weekly
+    0.1
+  
+  
+    https://www.elumenotion.com/Projects/AntArmyPreview.html
+    2024-07-30T03:59:48-04:00
     weekly
     0.1
   
   
     https://www.elumenotion.com/Projects/DocBuilder.html
-    2024-06-17T12:19:36-04:00
+    2024-07-30T03:59:48-04:00
     weekly
     0.1
   
   
     https://www.elumenotion.com/Projects/index.html
-    2024-06-17T12:19:36-04:00
+    2024-07-30T03:59:48-04:00
     weekly
     0.1
   
   
     https://www.elumenotion.com/Projects/IngestingPdfContent.html
-    2024-06-17T12:19:36-04:00
+    2024-07-30T03:59:48-04:00
     weekly
     0.1
   
   
     https://www.elumenotion.com/Projects/LibreChatBicep.html
-    2024-06-17T12:19:36-04:00
+    2024-07-30T03:59:48-04:00
     weekly
     0.1
   
   
     https://www.elumenotion.com/Projects/OobaboogaAPIHelper.html
-    2024-06-17T12:19:36-04:00
+    2024-07-30T03:59:48-04:00
     weekly
     0.1
   
   
     https://www.elumenotion.com/Projects/StringExtensions.html
-    2024-06-17T12:19:36-04:00
+    2024-07-30T03:59:48-04:00
     weekly
     0.1
   
   
     https://www.elumenotion.com/Projects/TranscriptionAndDiarization.html
-    2024-06-17T12:19:36-04:00
+    2024-07-30T03:59:48-04:00
     weekly
     0.1
   
   
     https://www.elumenotion.com/Projects/WeightRandoms.html
-    2024-06-17T12:19:36-04:00
+    2024-07-30T03:59:48-04:00
     weekly
     0.1
   
diff --git a/docs/toc.html b/docs/toc.html
index 279a254..b4a5bf8 100644
--- a/docs/toc.html
+++ b/docs/toc.html
@@ -16,7 +16,7 @@
                     Journal
                 
                 
  • 
-                    Demonstration Projects
+                    Demonstration Projects
                 
    • 
                 
  • 
                     Code Reference
diff --git a/docs/toc.json b/docs/toc.json
index b1abb69..4619711 100644
--- a/docs/toc.json
+++ b/docs/toc.json
@@ -1,2 +1,2 @@
 
-{"items":[{"name":"Journal","href":"Journal/TranscriptionAndDiarization.html","topicHref":"Journal/TranscriptionAndDiarization.html"},{"name":"Demonstration Projects","href":"Projects/TranscriptionAndDiarization.html","topicHref":"Projects/TranscriptionAndDiarization.html"},{"name":"Code Reference","href":"api/index.html","topicHref":"api/index.html"}]}
\ No newline at end of file
+{"items":[{"name":"Journal","href":"Journal/TranscriptionAndDiarization.html","topicHref":"Journal/TranscriptionAndDiarization.html"},{"name":"Demonstration Projects","href":"Projects/AntArmyPreview.html","topicHref":"Projects/AntArmyPreview.html"},{"name":"Code Reference","href":"api/index.html","topicHref":"api/index.html"}]}
\ No newline at end of file
diff --git a/docs/video/AntArmyIntro.mp4 b/docs/video/AntArmyIntro.mp4
new file mode 100644
index 0000000..2496de8
--- /dev/null
+++ b/docs/video/AntArmyIntro.mp4
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:a3e61b54082c70b86fa71b9663b5387cc3059bc79de4ba9de60151e47f5de62b
+size 14545729