From 35f5f5cebcbc427a9c3ce6e576a7998498d96449 Mon Sep 17 00:00:00 2001 From: Christian Kadner Date: Fri, 24 Sep 2021 12:18:03 -0700 Subject: [PATCH 1/5] Update asset list in main README.md Resolves: #49 Closes: machine-learning-exchange/mlx#201 Closes: machine-learning-exchange/mlx#218 Signed-off-by: Christian Kadner --- README.md | 73 ++++++++++++++++++++++++++++++++----------------------- 1 file changed, 43 insertions(+), 30 deletions(-) diff --git a/README.md b/README.md index 76d432f..fe078af 100644 --- a/README.md +++ b/README.md @@ -1,47 +1,60 @@ # MLX Katalog -MLX Katalog is a project to hold the default content to bootstrap Machine Learning Exchange. +MLX _Katalog_ is a project to hold the default content to bootstrap the _Machine Learning Exchange_. -# List of Default Katalog Assets +# List of Default Catalog Assets ## Pipelines -* [Trusted AI Pipeline with AI Fairness 360 and Adversarial Robustness 360 components](https://github.com/kubeflow/kfp-tekton/tree/master/samples/trusted-ai) +* [Trusted AI Pipeline with AI Fairness 360 and Adversarial Robustness 360 Components](https://github.com/kubeflow/kfp-tekton/tree/master/samples/trusted-ai) * [Training and Serving Models with Watson Machine Learning](https://github.com/kubeflow/kfp-tekton/tree/master/samples/watson-train-serve#training-and-serving-models-with-watson-machine-learning) -* [Lightweight python components example](https://github.com/kubeflow/kfp-tekton/tree/master/samples/lightweight-component) -* [The flip-coin pipeline](https://github.com/kubeflow/kfp-tekton/tree/master/samples/flip-coin) -* [Hyperparameter tuning using Katib](https://github.com/kubeflow/kfp-tekton/tree/master/samples/katib) -* [Nested pipeline example](https://github.com/kubeflow/kfp-tekton/tree/master/samples/nested-pipeline) -* [Pipeline with Nested loops](https://github.com/kubeflow/kfp-tekton/tree/master/samples/nested-loops) +* [Lightweight Python Component Example](https://github.com/kubeflow/kfp-tekton/tree/master/samples/lightweight-component) +* [The Flip-Coin Pipeline](https://github.com/kubeflow/kfp-tekton/tree/master/samples/flip-coin) +* [Hyperparameter Tuning using Katib](https://github.com/kubeflow/kfp-tekton/tree/master/samples/katib) +* [Nested Pipeline Example](https://github.com/kubeflow/kfp-tekton/tree/master/samples/nested-pipeline) +* [Pipeline with Nested Loops](https://github.com/kubeflow/kfp-tekton/tree/master/samples/nested-loops) + ## Pipeline Components * [Generate Dataset Metadata](component-samples/dax-to-dlf/component.yaml) * [Create Dataset Volume](component-samples/dlf/component.yaml) * [Echo Sample](component-samples/echo/component.yaml) -* [Create Secret - Kubernetes Cluster](component-samples/create-secret/component.yaml) +* [Create Kubernetes Secret](component-samples/create-secret/component.yaml) * [Kubernetes Model Deploy](component-samples/kube-model-deployment/component.yaml) * [Create Model Config](component-samples/model-config/component.yaml) * [Model Fairness Check](https://github.com/Trusted-AI/AIF360/blob/master/mlops/kubeflow/bias_detector_pytorch/component.yaml) * [Adversarial Robustness Evaluation](https://github.com/Trusted-AI/adversarial-robustness-toolbox/blob/main/utils/mlops/kubeflow/robustness_evaluation_fgsm_pytorch/component.yaml) + ## Models -* [Human Pose Estimator](model-samples/max-human-pose-estimator.yaml) -* [Image Caption Generator](model-samples/max-image-caption-generator.yaml) -* [Image Resolution Enhancer](model-samples/max-image-resolution-enhancer.yaml) -* [Object Detector](model-samples/max-object-detector.yaml) -* [Optical Character Recognition](model-samples/max-ocr.yaml) -* [Question Answering](model-samples/max-question-answering.yaml) -* [Recommender System](model-samples/max-recommender.yaml) -* [Text Sentiment Classifier](model-samples/max-text-sentiment-classifier.yaml) -* [Toxic Comment Classifier](model-samples/max-toxic-comment-classifier.yaml) -* [Weather Forecaster](model-samples/max-weather-forecaster.yaml) +* [CodeNet Language Classifier](model-samples/codenet-language-classification/codenet-language-classification.yaml) +* [Human Pose Estimator](model-samples/max-human-pose-estimator/max-human-pose-estimator.yaml) +* [Image Caption Generator](model-samples/max-image-caption-generator/max-image-caption-generator.yaml) +* [Image Resolution Enhancer](model-samples/max-image-resolution-enhancer/max-image-resolution-enhancer.yaml) +* [Named Entity Tagger](model-samples/max-named-entity-tagger/max-named-entity-tagger.yaml) +* [Object Detector](model-samples/max-object-detector/max-object-detector.yaml) +* [Optical Character Recognition](model-samples/max-ocr/max-ocr.yaml) +* [Question Answering](model-samples/max-question-answering/max-question-answering.yaml) +* [Recommender System](model-samples/max-recommender/max-recommender.yaml) +* [Text Sentiment Classifier](model-samples/max-text-sentiment-classifier/max-text-sentiment-classifier.yaml) +* [Toxic Comment Classifier](model-samples/max-toxic-comment-classifier/max-toxic-comment-classifier.yaml) +* [Weather Forecaster](model-samples/max-weather-forecaster/max-weather-forecaster.yaml) + ## Datasets -* [Finance Proposition Bank](dataset-samples/fpb.yaml) -* [Groningen Meaning Bank - Modified](dataset-samples/gmb.yaml) -* [NOAA Weather Data - JFK Airport](dataset-samples/jfk.yaml) -* [PubLayNet](dataset-samples/publaynet.yaml) -* [PubTabNet](dataset-samples/pubtabnet.yaml) -* [IBM Debater® Thematic Clustering of Sentences](dataset-samples/thematic_clustering.yaml) -* [TensorFlow Speech Commands](dataset-samples/tsc.yaml) +* [CodeNet](dataset-samples/codenet/codenet.yaml) +* [CodeNet Language Classification](dataset-samples/codenet_langclass/codenet_langclass.yaml) +* [CodeNet MLM](dataset-samples/codenet_mlm/codenet_mlm.yaml) +* [Finance Proposition Bank](dataset-samples/fpb/fpb.yaml) +* [Groningen Meaning Bank](dataset-samples/gmb/gmb.yaml) +* [NOAA Weather Data - JFK Airport](dataset-samples/jfk/jfk.yaml) +* [PubLayNet](dataset-samples/publaynet/publaynet.yaml) +* [PubTabNet](dataset-samples/pubtabnet/pubtabnet.yaml) +* [Thematic Clustering of Sentences](dataset-samples/thematic_clustering/thematic_clustering.yaml) +* [TensorFlow Speech Commands](dataset-samples/tsc/tsc.yaml) + ## Notebooks -* [AIF360 Bias detection example](notebook-samples/aif-bias.yaml) -* [ART detector model](notebook-samples/art-detector.yaml) -* [ART poisoning attack](notebook-samples/art-poison.yaml) -* [jfk-airport-analysis](notebook-samples/JFK-airport.yaml) +* [AIF360 Bias Detection](notebook-samples/aif-bias.yaml) +* [ART Detector Model](notebook-samples/art-detector.yaml) +* [ART Poisoning Attack](notebook-samples/art-poison.yaml) +* [CodeNet Laguage Classification](notebook-samples/codenet-lang.yaml) +* [CodeNet MLM](notebook-samples/codenet-mlm.yaml) +* [JFK Airport Weather Analysis](notebook-samples/JFK-airport.yaml) +* [Qiskit Quantum Machine Learning](notebook-samples/qiskit-ml.yaml) +* [Qiskit Neural Network Classifier and Regressor](notebook-samples/qiskit-nncr.yaml) From 7f02c9c08884f253f91cf6a25dc60bef6d2d8049 Mon Sep 17 00:00:00 2001 From: Christian Kadner Date: Fri, 24 Sep 2021 12:20:04 -0700 Subject: [PATCH 2/5] Update asset list in dataset-samples/README.md Signed-off-by: Christian Kadner --- dataset-samples/README.md | 18 +++++++++++------- 1 file changed, 11 insertions(+), 7 deletions(-) diff --git a/dataset-samples/README.md b/dataset-samples/README.md index 3f50c71..f940ef2 100644 --- a/dataset-samples/README.md +++ b/dataset-samples/README.md @@ -126,10 +126,14 @@ related_assets: ``` ## List of Sample Datasets -* [Finance Proposition Bank](fpb.yaml) -* [Groningen Meaning Bank - Modified](gmb.yaml) -* [NOAA Weather Data - JFK Airport](jfk.yaml) -* [PubLayNet](publaynet.yaml) -* [PubTabNet](pubtabnet.yaml) -* [IBM Debater® Thematic Clustering of Sentences](thematic_clustering.yaml) -* [TensorFlow Speech Commands](tsc.yaml) + +* [CodeNet](codenet/codenet.yaml) +* [CodeNet Language Classification](codenet_langclass/codenet_langclass.yaml) +* [CodeNet MLM](codenet_mlm/codenet_mlm.yaml) +* [Finance Proposition Bank](fpb/fpb.yaml) +* [Groningen Meaning Bank](gmb/gmb.yaml) +* [NOAA Weather Data - JFK Airport](jfk/jfk.yaml) +* [PubLayNet](publaynet/publaynet.yaml) +* [PubTabNet](pubtabnet/pubtabnet.yaml) +* [Thematic Clustering of Sentences](thematic_clustering/thematic_clustering.yaml) +* [TensorFlow Speech Commands](tsc/tsc.yaml) From 5ab86df67d0137d81b84dbc83635d3136700f238 Mon Sep 17 00:00:00 2001 From: Christian Kadner Date: Fri, 24 Sep 2021 12:21:34 -0700 Subject: [PATCH 3/5] Update asset list in notebook-samples/README.md Signed-off-by: Christian Kadner --- notebook-samples/README.md | 13 +++++++++---- 1 file changed, 9 insertions(+), 4 deletions(-) diff --git a/notebook-samples/README.md b/notebook-samples/README.md index baecaf0..4218396 100644 --- a/notebook-samples/README.md +++ b/notebook-samples/README.md @@ -19,7 +19,12 @@ The [src](src) directory is for hosting some Notebook example source files on Gi 4. Enter a name for the notebook; Otherwise a default will be given ## List of Sample Notebooks -* [AIF360 Bias detection example](aif-bias.yaml) -* [ART detector model](art-detector.yaml) -* [ART poisoning attack](art-poison.yaml) -* [jfk-airport-analysis](JFK-airport.yaml) + +* [AIF360 Bias Detection](aif-bias.yaml) +* [ART Detector Model](art-detector.yaml) +* [ART Poisoning Attack](art-poison.yaml) +* [CodeNet Laguage Classification](codenet-lang.yaml) +* [CodeNet MLM](codenet-mlm.yaml) +* [JFK Airport Weather Analysis](JFK-airport.yaml) +* [Qiskit Quantum Machine Learning](qiskit-ml.yaml) +* [Qiskit Neural Network Classifier and Regressor](qiskit-nncr.yaml) From 0fde9d86b303ea21c26ceebd64e213446b3085d3 Mon Sep 17 00:00:00 2001 From: Christian Kadner Date: Fri, 24 Sep 2021 12:23:26 -0700 Subject: [PATCH 4/5] Update asset list in pipeline-samples/README.md Signed-off-by: Christian Kadner --- pipeline-samples/README.md | 12 ++++++------ 1 file changed, 6 insertions(+), 6 deletions(-) diff --git a/pipeline-samples/README.md b/pipeline-samples/README.md index 6a6b4ba..f9dca6d 100644 --- a/pipeline-samples/README.md +++ b/pipeline-samples/README.md @@ -39,10 +39,10 @@ For an in-depth guide to creating pipelines with Kubeflow, take a look at their ## List of Sample Pipelines -* [Trusted AI Pipeline with AI Fairness 360 and Adversarial Robustness 360 components](https://github.com/kubeflow/kfp-tekton/tree/master/samples/trusted-ai) +* [Trusted AI Pipeline with AI Fairness 360 and Adversarial Robustness 360 Components](https://github.com/kubeflow/kfp-tekton/tree/master/samples/trusted-ai) * [Training and Serving Models with Watson Machine Learning](https://github.com/kubeflow/kfp-tekton/tree/master/samples/watson-train-serve#training-and-serving-models-with-watson-machine-learning) -* [Lightweight python components example](https://github.com/kubeflow/kfp-tekton/tree/master/samples/lightweight-component) -* [The flip-coin pipeline](https://github.com/kubeflow/kfp-tekton/tree/master/samples/flip-coin) -* [Hyperparameter tuning using Katib](https://github.com/kubeflow/kfp-tekton/tree/master/samples/katib) -* [Nested pipeline example](https://github.com/kubeflow/kfp-tekton/tree/master/samples/nested-pipeline) -* [Pipeline with Nested loops](https://github.com/kubeflow/kfp-tekton/tree/master/samples/nested-loops) +* [Lightweight Python Component Example](https://github.com/kubeflow/kfp-tekton/tree/master/samples/lightweight-component) +* [The Flip-Coin Pipeline](https://github.com/kubeflow/kfp-tekton/tree/master/samples/flip-coin) +* [Hyperparameter Tuning using Katib](https://github.com/kubeflow/kfp-tekton/tree/master/samples/katib) +* [Nested Pipeline Example](https://github.com/kubeflow/kfp-tekton/tree/master/samples/nested-pipeline) +* [Pipeline with Nested Loops](https://github.com/kubeflow/kfp-tekton/tree/master/samples/nested-loops) From 45cb85987327f04d65ba5d615f0448d98d6468f1 Mon Sep 17 00:00:00 2001 From: Christian Kadner Date: Fri, 24 Sep 2021 12:25:22 -0700 Subject: [PATCH 5/5] Update asset list in model-samples/README.md Signed-off-by: Christian Kadner --- model-samples/README.md | 23 +++++++++++++---------- 1 file changed, 13 insertions(+), 10 deletions(-) diff --git a/model-samples/README.md b/model-samples/README.md index 0013d04..71dea7c 100644 --- a/model-samples/README.md +++ b/model-samples/README.md @@ -111,13 +111,16 @@ Models can be run based on the metadata specified in the YAML file for a particu ## List of Sample Models -* [Human Pose Estimator](max-human-pose-estimator.yaml) -* [Image Caption Generator](max-image-caption-generator.yaml) -* [Image Resolution Enhancer](max-image-resolution-enhancer.yaml) -* [Object Detector](max-object-detector.yaml) -* [Optical Character Recognition](max-ocr.yaml) -* [Question Answering](max-question-answering.yaml) -* [Recommender System](max-recommender.yaml) -* [Text Sentiment Classifier](max-text-sentiment-classifier.yaml) -* [Toxic Comment Classifier](max-toxic-comment-classifier.yaml) -* [Weather Forecaster](max-weather-forecaster.yaml) + +* [CodeNet Language Classifier](codenet-language-classification/codenet-language-classification.yaml) +* [Human Pose Estimator](max-human-pose-estimator/max-human-pose-estimator.yaml) +* [Image Caption Generator](max-image-caption-generator/max-image-caption-generator.yaml) +* [Image Resolution Enhancer](max-image-resolution-enhancer/max-image-resolution-enhancer.yaml) +* [Named Entity Tagger](max-named-entity-tagger/max-named-entity-tagger.yaml) +* [Object Detector](max-object-detector/max-object-detector.yaml) +* [Optical Character Recognition](max-ocr/max-ocr.yaml) +* [Question Answering](max-question-answering/max-question-answering.yaml) +* [Recommender System](max-recommender/max-recommender.yaml) +* [Text Sentiment Classifier](max-text-sentiment-classifier/max-text-sentiment-classifier.yaml) +* [Toxic Comment Classifier](max-toxic-comment-classifier/max-toxic-comment-classifier.yaml) +* [Weather Forecaster](max-weather-forecaster/max-weather-forecaster.yaml)