feat: add tools to assistant (#329)

## Motivation

- adds ComfyUI tool to allow assistants to generate images.
- images are stored and multiple images can be generated in one call
(e.g. `prompt: "Write a story with two images"`
- adds RAG as tool and removes previous RAG implementation

## Issues closed

closes #328

package.json

@@ -204,7 +204,8 @@
     "uuid": "^9.0.1",
     "webpack": "^5.91.0",
     "ws": "^8.17.0",
-    "yaml": "^2.4.2"
+    "yaml": "^2.4.2",
+    "zod": "^3.23.8"
   },
   "optionalDependencies": {
     "@swc/core-darwin-arm64": "^1.5.3",

resources/actions/assistant/readme.md

@@ -18,24 +18,10 @@ icon: Assistant
 iconColor: "#4D822F"
 ---
 
-I need AI assistance.
-I want to chat with AI.
-Open the AI chat.
-Launch the AI assistant.
-Start a conversation with the AI.
-Access AI chat functionality.
-Engage in a chat with the AI assistant.
-Initiate AI-based chat.
-Connect with the AI assistant.
-Open the AI-based conversation tool.
-Begin a session with the AI assistant.
-Request AI chat support.
-Activate the AI assistant for help.
-Start chatting with the AI now.
-Open the AI for interactive chat.
-Access the intelligent assistant for conversation.
-Begin a dialogue with the AI.
-Open the virtual assistant chat.
-Start the AI-powered assistant.
-Get AI assistance for my queries.
+App, application, chat with your personal assistant with RAG and tools like generating images.
+The AI Assistant app with Retrieval-Augmented Generation and integrated tools is a solution to enhance productivity and streamline tasks. supported Models include:
+OpenAI: gpt-4o, gpt-4-turbo, gpt-4, gpt-3.5-turbo.
+Anthropic: claude-3-opus, claude-3-sonnet, claude-3-haiku.
+Mistral: mistral-large, mistral-small.
+Google: gemini-1.5-pro.
 

resources/actions/comfy-ui/readme.md

@@ -18,24 +18,5 @@ icon: ResistorNodeIcon
 iconColor: "#353535"
 ---
 
-Open the app comfyUI.
-I want to generate images with stable diffusion.
-Accelerate creative workflows with ComfyUI’s modular stable diffusion GUI.
-Unleash image synthesis power using ComfyUI for txt2img and img2img tasks.
-Navigate advanced node-based interfaces with ease in ComfyUI.
-Optimize image generation with ComfyUI's intuitive stable diffusion tools.
-Harness the full potential of stable diffusion models with ComfyUI.
-Transform digital art processes with ComfyUI’s robust features.
-Empower your image projects with ComfyUI’s dynamic GUI.
-Enhance productivity using ComfyUI's streamlined image creation system.
-Customize stable diffusion operations efficiently with ComfyUI.
-Achieve superior image results through ComfyUI’s innovative technology.
-Deploy ComfyUI for quick, effective stable diffusion model setups.
-Leverage ComfyUI’s flexible architecture for diverse imaging needs.
-Maximize creative output with ComfyUI’s powerful imaging solutions.
-Simplify complex workflows in image processing with ComfyUI.
-Engage ComfyUI for high-performance image generation.
-Utilize ComfyUI for detailed and artistic stable diffusion applications.
-versatile image synthesis options within ComfyUI.
-stable diffusion pipeline using ComfyUI’s smart interface.
-advanced imaging techniques effortlessly with ComfyUI.
+App, application, generate images with stable diffusion.
+ComfyUI is a powerful and modular app designed for managing Stable Diffusion workflows through a node-based graphical user interface (GUI). This app allows users to create and execute complex image generation pipelines without needing to code, using a flowchart-style interface that is intuitive and highly customizable. ComfyUI supports various versions of Stable Diffusion, including SD1.x, SD2.x, and SDXL, and integrates features such as inpainting, control nets, and multiple upscale models. It offers both free online access and enhanced features through the RunComfy service, making it accessible for both casual users and professionals.

resources/actions/dashboard/readme.md

@@ -22,23 +22,4 @@ icon: Dashboard
 iconColor: "#20827c"
 ---
 
-Search for applications with AI precision.
-Display documents relevant to my current project.
-Show images from my latest vacation.
-Find tools and apps that boost my productivity.
-Activate dark mode for evening use.
-Switch to a light theme during the day.
-Recommend new tools based on my usage patterns.
-Organize my files and documents smartly.
-Adjust settings for optimal widget display.
-Customize the dashboard to my visual preferences.
-Update my preferences for more personalized suggestions.
-Guide me through the latest marketplace offerings.
-Enhance privacy settings for secure data processing.
-Integrate seamlessly with installed applications.
-Sort media files by relevance to my interests.
-Use natural language queries for intuitive search.
-Discover hidden features in commonly used apps.
-Tailor the dashboard display to my work habits.
-Explore content with AI-generated summaries.
-Prioritize dashboard content based on my behavior.
+App, application, manage all your creative tools in one place with the Dashboard. This app provides an organized and intuitive interface, showing all installed applications and acting as a central launcher. Users can easily access ComfyUI, Assistant, Generate Images, Live Painting, Explorer, and third-party apps from a single, streamlined dashboard. The Dashboard enhances productivity by allowing quick launching and switching between tools. With its user-friendly design, this app ensures that all your creative and productivity tools are just a click away, simplifying workflow management and boosting efficiency.

resources/actions/explorer/readme.md

@@ -18,24 +18,5 @@ icon: Folder
 iconColor: "#6C5EF5"
 ---
 
-Launch the explorer to browse my documents.
-Show me how to access the finder for photos.
-Open the file explorer to manage my folders.
-Guide me to open the finder for organizing files.
-Command to launch the explorer for viewing images.
-How do I start the explorer with a keyboard shortcut?
-Open my documents directly in the file explorer.
-Find steps to access external storage in the finder.
-Shortcut to open the downloads folder in the explorer.
-Launch the explorer to search for specific file names.
-Discover the quickest way to open recent items in the finder.
-Open the explorer at a particular directory for quick access.
-Use search commands to open specific folders in the explorer.
-Navigate to my cloud files directly through the finder.
-Tips for opening and managing files with the explorer.
-Access shared documents through the explorer.
-Open multiple finder windows for efficient file management.
-Reveal hidden items on the first launch of the explorer.
-Employ search functionalities in the finder for specific queries.
-Organize and search for specific content using the explorer.
+App, application, explore and manage your digital assets efficiently with Explorer. This app features an integrated vector search that allows users to quickly find images, apps, stories, and other documents. Leveraging advanced AI technology, the vector search function provides highly accurate results based on content similarity, making it easy to locate specific items in a large collection. Explorer's intuitive interface ensures seamless navigation and organization of files, enhancing productivity and efficiency. Whether you're searching for creative assets, applications, or documents, this app offers a powerful and user-friendly solution to keep all your resources easily accessible and well-organized.
 

resources/actions/live-painting/readme.md

@@ -19,23 +19,4 @@ icon: Brush
 iconColor: "#D3410C"
 ---
 
-I want to draw an image with AI.
-Make live art from my sketch.
-Create an image from my doodle.
-Let's live paint a picture together.
-Turn my drawing into digital art.
-Help me paint a scene with AI.
-I wish to create art in real-time.
-Transform my sketches into paintings.
-Assist me in making digital illustrations.
-I want to experiment with AI art creation.
-Guide me in drawing with AI technology.
-Enable AI to enhance my painting process.
-Create vibrant images from my concepts.
-I’m looking to design art with AI.
-Draw a masterpiece with AI input.
-How to make a painting with AI collaboration?
-I desire to produce art in fantasy style with AI.
-Let me paint digitally with live AI generations.
-Craft an image based on my basic doodles.
-I aim to live paint with AI enhancements.
+App, application, transform your scribbles into stunning AI-generated art with stable diffusion Live-Paint. This innovative app allows users to live-paint by sketching directly on the screen, which is then enhanced and transformed into detailed artwork using advanced AI. Leveraging ComfyUI's robust capabilities, this application supports predefined styles and LoRAs, enabling users to customize their creations effortlessly. The user-friendly interface ensures an intuitive experience, making it accessible for both beginners and professional artists. With real-time transformation, users can see their ideas come to life instantly, blending creativity and technology seamlessly for an engaging artistic journey.

resources/actions/marketplace/readme.md

@@ -19,23 +19,4 @@ icon: ShoppingBag
 iconColor: "#20827c"
 ---
 
-Install the latest productivity apps directly from our app store.
-Extend your device’s capabilities with specialized apps available in our store.
-Open the app store to explore new and exciting applications.
-Boost your efficiency: download our top-rated apps today.
-Explore new features by installing apps from our digital marketplace.
-Enhance your experience with our curated selection of utility apps.
-Navigate our app store for the latest in software innovations.
-Upgrade your toolkit by installing versatile apps from our store.
-Visit our app store to find apps that simplify your daily tasks.
-Discover how to extend your app functionality with additions from our store.
-Access new tools and features by downloading apps from our marketplace.
-Unlock new possibilities—install our featured apps today.
-Step into our app store to enhance your software suite.
-Browse and install the latest apps to keep your workflow smooth.
-Expand your app capabilities by exploring our extensive app catalog.
-Get the newest apps and updates by visiting our app store now.
-Find and install essential apps to maximize your productivity.
-Enhance your device’s performance with powerful apps from our marketplace.
-Open our app store to start transforming your digital environment.
-Experience the latest in app technology—download from our store today.
+App, application, explore a comprehensive marketplace with Stable Diffusion models, LoRAs, ComfyUI extensions, and third-party apps. The Marketplace app is designed to be a one-stop solution for all your creative needs. Users can browse and acquire various Stable Diffusion models to enhance their image generation capabilities. The marketplace also offers a wide range of LoRAs (Low Rank Adaptation) for specialized tasks and stylistic modifications. Additionally, ComfyUI extensions and third-party applications are available, allowing users to expand their workflow and integrate new functionalities seamlessly. With a user-friendly interface and diverse offerings, the ComfyUI Marketplace ensures that artists and developers have access to the best tools and resources to fuel their creativity and productivity.

resources/actions/settings/readme.md

@@ -19,23 +19,4 @@ icon: Settings
 iconColor: "#717676"
 ---
 
-Adjust the language settings.
-I want dark mode enabled.
-Change API keys for OpenAI integration.
-How can I switch the language?
-Enable light theme for the app.
-Update preferences for visual theme.
-Set application to system default color mode.
-Configure OpenAI API settings.
-Personalize my app experience with preferences.
-Modify configuration for better usability.
-Show me how to enter OpenAI API keys.
-Switch to dark mode for nighttime use.
-Select my preferred language.
-Access advanced settings options.
-Save my custom settings configuration.
-Guide to customizing application interface.
-Steps for changing the app's visual theme.
-Activate dark theme in Captain.
-Update user preferences and keys.
-Customize interface language.
+App, application, customize your Captain experience with the versatile Settings app. This app allows users to change the color theme, toggle between light and dark modes, and select from 11 included locales: German (de), English (en), Spanish (es), French (fr), Italian (it), Japanese (ja), Dutch (nl), Polish (pl), Portuguese (pt), Russian (ru), and Chinese (zh). Additionally, it provides functionality to manage API keys for OpenAI, Anthropic, Google, and Mistral. The Settings app is also the hub for keeping your system up-to-date, allowing you to check for and install the latest updates for Captain. This comprehensive settings management tool ensures a personalized and optimized experience for all users.

resources/actions/story/readme.md

@@ -23,23 +23,4 @@ icon: MenuBook
 iconColor: "#9F6B00"
 ---
 
-Generate a story from this image.
-Tell me a story based on my photo.
-Help me write a story for my kids using this picture.
-Create narratives from my gallery.
-How to turn vacation photos into a storybook.
-Inspire me with a story from my artwork.
-Convert my drawings into digital narratives.
-Transform my photo into a fantasy story.
-Use my picture to write a mystery story.
-Make a story for my classroom presentation.
-Turn this series of images into a connected narrative.
-Craft a love story from our anniversary photo.
-Develop a sci-fi tale from my space-themed image.
-How to create a superhero story with my drawing.
-Share a fairy tale based on my child’s artwork.
-I want a historical narrative for my vintage photo.
-How can I get a motivational story from my personal achievements?
-Create a bedtime story from my kids' drawings.
-Can you generate an adventure story from my travel photos?
-Turn my pet's photos into a funny tale.
+App, application, create captivating stories with Captain Story. This app utilizes a powerful Language Learning Model (LLM) and previously created images to craft engaging narratives, which can be saved for future use. With a user-friendly interface, Captain Story makes story creation accessible and enjoyable. It offers various presets to help users get started quickly, allowing for easy customization and personalization. Whether you're a writer looking for inspiration or simply want to create a visual story, this app provides the tools you need to bring your ideas to life in a seamless and intuitive manner.

resources/actions/text-to-image/readme.md

@@ -18,27 +18,4 @@ icon: Images
 iconColor: "#D3410C"
 ---
 
-I want to draw an image.
-Generate an image from my prompt.
-Perform Text to image conversion.
-Open the txt2img app.
-Create a landscape from my description.
-Turn poetry into visual art.
-Generate a painting based on my dream.
-Visualize historical events from text.
-Convert my short story into an illustration.
-Create fantasy world maps from descriptions.
-Illustrate characters from my novel.
-Generate artwork for my music album cover.
-Turn my ideas into comic book scenes.
-Visualize scientific concepts through art.
-Create abstract art from emotional descriptions.
-Design fashion sketches from style descriptions.
-Generate portraits from character traits.
-Illustrate recipes in a whimsical style.
-Visualize architectural designs from descriptions.
-Create visual metaphors from poetic phrases.
-Generate scenes from movie script excerpts.
-Illustrate concepts for educational materials.
-Create thematic artwork for my blog posts.
-Visualize futuristic technology from sci-fi descriptions.
+App, application, generate stunning images with stable diffusion, featuring a user-friendly interface. The Generate Images app leverages the power of ComfyUI to create visually appealing images with ease. Users can utilize predefined styles and LoRAs (Low Rank Adaptation) to enhance and customize their image generation process. This application simplifies complex workflows into an intuitive interface, allowing users to experiment with different styles and elements without needing advanced technical knowledge. Whether you are a beginner or an experienced artist, this app offers a seamless experience in producing high-quality images tailored to your specific needs.