Integrated a shiny app with the following features:
- Display CGIAR metadata using a treemap from the
apexcharter
library - Display an interactive table from the
reactable
library showing metadata - Generate stories and summaries from text files using OpenAI api
- The repository gets automatically updated through github actions. The weekly pipeline has the following steps:
- Download raw metadata from Dataverse with
get_dataverse_metadata
andget_dataverse_metadata.py
- Clean and process raw Dataverse metadata in a single structured .rda file
(with
process_dataverse_raw
)
- Integrated ChatGPT API with Langchain to produce stories from downloaded dataverse docs
- Added a
NEWS.md
file to track changes to the package.