Skip to content

Commit

Permalink
AntArmyIntro
Browse files Browse the repository at this point in the history
  • Loading branch information
douglasware committed Jul 30, 2024
1 parent a6ad191 commit d3cfee1
Show file tree
Hide file tree
Showing 9 changed files with 173 additions and 46 deletions.
2 changes: 1 addition & 1 deletion docs/Journal/TranscriptionAndDiarization.html
Original file line number Diff line number Diff line change
Expand Up @@ -119,7 +119,7 @@ <h3 id="who-said-what-identify-distinct-speakers-using-pyannoteaudio">Who said w
[SPEAKER_00] : [(00:00:31.980, 00:00:36.160)] : I&#39;m going to hand off to my good friend Jeremy Thake, and he&#39;s going to walk you through the first half of this session. Thanks, Barno. I appreciate it. And thank you for coming to Build.
[SPEAKER_01] : [(00:00:37.960, 00:00:40.280)] : So I&#39;m Jeremy Thake. I&#39;m a
</code></pre><h3 id="identify-speaker-names-using-phi-3-medium">Identify speaker names using phi-3-medium</h3>
<p>Often at this point I have to do some manual steps to replace “SPEAKER_00” with a real name because I find that very often, perhaps most of the time, people don’t say their own names or refer to others by name. But still, if I am doing this process, I intend to use the transcript with a language model to get insight from the content.<br><br>In this case, Barnam and Jeremy demonstrated excellent presenter skills and the text contains their names. Thanks to this, I can use a language model to extract their names and update the transcript. For this task I used <a href="https://huggingface.co/microsoft/Phi-3-medium-4k-instruct-onnx-directml">microsoft/Phi-3-medium-4k-instruct-onnx-directml</a> which is a version of Phi-3-medium-4k-instruct optimized for use with <a href="https://onnxruntime.ai/docs/genai/tutorials/phi3-python.html">ONNX runtime</a> which makes it super fast on my RTX-4090 GPU. Use it if you have a GPU and are using Windows. </p>
<p>Often at this point I have to do some manual steps to replace “SPEAKER_00” with a real name because I find that very often, perhaps most of the time, people don’t say their own names or refer to others by name. But still, if I am doing this process, I intend to use the transcript with a language model to get insight from the content.<br><br>In this case, Barnam and Jeremy demonstrated excellent presenter skills and the text contains their names. Thanks to this, I can use a language model to extract their names and update the transcript – an perfect example of using a language model to get insight from the content!<br><br>For this task I used <a href="https://huggingface.co/microsoft/Phi-3-medium-4k-instruct-onnx-directml">microsoft/Phi-3-medium-4k-instruct-onnx-directml</a> which is a version of Phi-3-medium-4k-instruct optimized for use with <a href="https://onnxruntime.ai/docs/genai/tutorials/phi3-python.html">ONNX runtime</a> which makes it super fast on my RTX-4090 GPU. Use it if you have a GPU and are using Windows. </p>
<p>My notebook contains code to pull out a few lines before and after a speaker’s first appearance and build a prompt: </p>
<pre><code> # Create the prompt with the current speaker and their context
prompt = f&quot;&quot;&quot;
Expand Down
98 changes: 98 additions & 0 deletions docs/Projects/AntArmyPreview.html
Original file line number Diff line number Diff line change
@@ -0,0 +1,98 @@
<!DOCTYPE html>
<html>
<head>
<meta charset="utf-8">
<title>AntArmy &#8211; Together we are strong! </title>
<meta name="viewport" content="width=device-width, initial-scale=1.0">
<meta name="title" content="AntArmy &#8211; Together we are strong! ">

<link rel="icon" href="../favicon.ico">
<link rel="stylesheet" href="../styles/docfx.min.css">
<link rel="stylesheet" href="../styles/main.css">
<meta name="docfx:navrel" content="../toc.html">
<meta name="docfx:tocrel" content="toc.html">




<script>
MathJax = {
options: {
processHtmlClass: ['tex2jax_process', 'math']
}
};
</script>

<script type="text/javascript" src="../styles/docfx.min.js"></script>
<script type="text/javascript" src="../styles/main.js"></script>
</head>

<body class="tex2jax_ignore" data-layout="" data-yaml-mime="">
<header class="bg-body border-bottom">
<nav id="autocollapse" class="navbar navbar-expand-md" role="navigation">
<div class="container-xxl flex-nowrap">
<a class="navbar-brand" href="../index.html">
<img id="logo" class="png" src="../logo.png" alt="">

</a>
<button class="btn btn-lg d-md-none border-0" type="button" data-bs-toggle="collapse" data-bs-target="#navpanel" aria-controls="navpanel" aria-expanded="false" aria-label="Toggle navigation">
<i class="bi bi-three-dots"></i>
</button>
<div class="collapse navbar-collapse" id="navpanel">
<div id="navbar">
</div>
</div>
</div>
</nav>
</header>

<main class="container-xxl">
<div class="toc-offcanvas">
<div class="offcanvas-md offcanvas-start" tabindex="-1" id="tocOffcanvas" aria-labelledby="tocOffcanvasLabel">
<div class="offcanvas-header">
<h5 class="offcanvas-title" id="tocOffcanvasLabel">Table of Contents</h5>
<button type="button" class="btn-close" data-bs-dismiss="offcanvas" data-bs-target="#tocOffcanvas" aria-label="Close"></button>
</div>
<div class="offcanvas-body">
<nav class="toc" id="toc"></nav>
</div>
</div>
</div>

<div class="content">
<div class="actionbar">
<button class="btn btn-lg border-0 d-md-none" style="margin-top: -.65em; margin-left: -.8em" type="button" data-bs-toggle="offcanvas" data-bs-target="#tocOffcanvas" aria-controls="tocOffcanvas" aria-expanded="false" aria-label="Show table of contents">
<i class="bi bi-list"></i>
</button>

<nav id="breadcrumb"></nav>
</div>

<article data-uid="">
<h1 id="antarmy--together-we-are-strong">AntArmy – Together we are strong!</h1>

<div><video width="960" height="504" controls=""><source src="../video/AntArmyIntro.mp4" type="video/mp4">Your browser does not support the video tag</source></video></div>
</article>

<div class="contribution d-print-none">
</div>

<div class="next-article d-print-none border-top" id="nextArticle"></div>

</div>

<div class="affix">
<nav id="affix"></nav>
</div>
</main>


<footer class="border-top">
<div class="container-xxl">
<div class="flex-fill">
<span>Follow this project on github <a href="https://github.com/douglasware/ElumenotionSite">Elumenotion Site and Samples</a></span>
</div>
</div>
</footer>
</body>
</html>
3 changes: 3 additions & 0 deletions docs/Projects/toc.html
Original file line number Diff line number Diff line change
Expand Up @@ -12,6 +12,9 @@
<div class="toc" id="toc">

<ul class="nav level1">
<li>
<a href="AntArmyPreview.html" name="" title="Ant Army Preview">Ant Army Preview</a>
</li>
<li>
<a href="TranscriptionAndDiarization.html" name="" title="Locally and Privately Extracting Meaning from Video with Transcription, Diarization, and LLMs">Locally and Privately Extracting Meaning from Video with Transcription, Diarization, and LLMs</a>
</li>
Expand Down
2 changes: 1 addition & 1 deletion docs/Projects/toc.json
Original file line number Diff line number Diff line change
@@ -1,2 +1,2 @@

{"items":[{"name":"Locally and Privately Extracting Meaning from Video with Transcription, Diarization, and LLMs","href":"TranscriptionAndDiarization.html","topicHref":"TranscriptionAndDiarization.html"},{"name":"LibreChat Azure Container Apps Bicep","href":"LibreChatBicep.html","topicHref":"LibreChatBicep.html"},{"name":"Convert PDF to Markdown with Azure Document Intelligence and GPT-4","href":"IngestingPdfContent.html","topicHref":"IngestingPdfContent.html"},{"name":"String Extensions","href":"StringExtensions.html","topicHref":"StringExtensions.html"},{"name":"Text Generation Web UI API Helper","href":"OobaboogaAPIHelper.html","topicHref":"OobaboogaAPIHelper.html"},{"name":"Weighted Random Numbers","href":"WeightRandoms.html","topicHref":"WeightRandoms.html"},{"name":"DocFx Site PowerShell and Github Pages","href":"DocBuilder.html","topicHref":"DocBuilder.html"}]}
{"items":[{"name":"Ant Army Preview","href":"AntArmyPreview.html","topicHref":"AntArmyPreview.html"},{"name":"Locally and Privately Extracting Meaning from Video with Transcription, Diarization, and LLMs","href":"TranscriptionAndDiarization.html","topicHref":"TranscriptionAndDiarization.html"},{"name":"LibreChat Azure Container Apps Bicep","href":"LibreChatBicep.html","topicHref":"LibreChatBicep.html"},{"name":"Convert PDF to Markdown with Azure Document Intelligence and GPT-4","href":"IngestingPdfContent.html","topicHref":"IngestingPdfContent.html"},{"name":"String Extensions","href":"StringExtensions.html","topicHref":"StringExtensions.html"},{"name":"Text Generation Web UI API Helper","href":"OobaboogaAPIHelper.html","topicHref":"OobaboogaAPIHelper.html"},{"name":"Weighted Random Numbers","href":"WeightRandoms.html","topicHref":"WeightRandoms.html"},{"name":"DocFx Site PowerShell and Github Pages","href":"DocBuilder.html","topicHref":"DocBuilder.html"}]}
35 changes: 29 additions & 6 deletions docs/manifest.json
Original file line number Diff line number Diff line change
Expand Up @@ -1520,7 +1520,7 @@
"output": {
".html": {
"relative_path": "Journal/TranscriptionAndDiarization.html",
"hash": "O0gPPGCTy4eCeLnL5wC6bRYPHEfrT+YxlpVp7I0TyQM="
"hash": "1h7VGE95kwwbn5BlRhWNkxoCNkE2w0BmSW769jjdtDs="
}
},
"is_incremental": false,
Expand Down Expand Up @@ -1566,6 +1566,18 @@
"is_incremental": false,
"version": ""
},
{
"type": "Conceptual",
"source_relative_path": "Projects/AntArmyPreview.md",
"output": {
".html": {
"relative_path": "Projects/AntArmyPreview.html",
"hash": "Y7VHQuBunSW1waq7+WXkOS3TtP+yTVyBATDtfZZ9NBk="
}
},
"is_incremental": false,
"version": ""
},
{
"type": "Conceptual",
"source_relative_path": "Projects/DocBuilder.md",
Expand Down Expand Up @@ -1674,11 +1686,11 @@
"output": {
".html": {
"relative_path": "Projects/toc.html",
"hash": "vfKM7gJsPdaHhybMofs39VH6C4V9VGix+hekVDjQNgQ="
"hash": "ck8DojIOFT4xXb0tXUgtH6OEgFJ+LE9BUB7nDuTOpnY="
},
".json": {
"relative_path": "Projects/toc.json",
"hash": "UsE81BLGq9OiJcLwHaRKomoawmg6iWVdGQwFq3PHlDA="
"hash": "oA1pNT9cPi5V6nre/TnxhtWd8HlNNvpUpAB9TWfYAJ8="
}
},
"is_incremental": false,
Expand All @@ -1701,11 +1713,22 @@
"output": {
".html": {
"relative_path": "toc.html",
"hash": "mVzJTlPmyn8kMqxDtwHuqN59ey0xZSD2cY1I8N67MeQ="
"hash": "HoM52h7f9q2v5hsSYi+FX2sZZP0qiGgC7/5A8nWCzGE="
},
".json": {
"relative_path": "toc.json",
"hash": "cEzeOxJq+Em3Li6baclOJXXxxSt5hqeAhLsA0PaqHTQ="
"hash": "+Y+//BuqVvQKGzAAAlWvjGLjvr0CPErPgfZ4xa54yTo="
}
},
"is_incremental": false,
"version": ""
},
{
"type": "Resource",
"source_relative_path": "video/AntArmyIntro.mp4",
"output": {
"resource": {
"relative_path": "video/AntArmyIntro.mp4"
}
},
"is_incremental": false,
Expand All @@ -1726,7 +1749,7 @@
"ConceptualDocumentProcessor": {
"can_incremental": false,
"incrementalPhase": "build",
"total_file_count": 30,
"total_file_count": 31,
"skipped_file_count": 0
},
"ResourceDocumentProcessor": {
Expand Down
Loading

0 comments on commit d3cfee1

Please sign in to comment.