Skip to content

ESGF Publication Test

Nicolas Carenton edited this page Aug 22, 2014 · 19 revisions

Prerequisites

Define a test project in /esg/config/esgcet/esg.ini

 thredds_dataset_roots =
 esg_dataroot |  /esg/data
 test |  /esg/data/test 

Download test dataset

mkdir /esg/data/test; cd /esg/data/test
wget -O sftlf.nc http://distrib-coffee.ipsl.jussieu.fr/pub/esgf/dist/externals/sftlf.nc

Execution user

Must be different from root. Must have recrursive write permission to /esg/content/thredds/esgcet

groupadd publication
useradd -G publication esg-user
chown -R tomcat.publication /esg/content/thredds/esgcet/
chmod -R g+rw /esg/content/thredds/esgcet/

Mapfile generation

 su esg-user
 source /etc/esg.env
 export ESGINI=/esg/config/esgcet/esg.ini
 esgscan_directory --dataset ipsl.fr.test.mytest --project test /esg/data/test > test_mapfile.txt 

Publication step 1 - Data Node Local Thredds Server

 esgpublish --service fileservice --map test_mapfile.txt --project test --thredds

Then check http://my-data-node/thredds/esgcet/catalog.html

Publication step 2 - Peer Index Node

Authenticate with an ESGF user which has publisher permissions (or rootAdmin). See http://my-index-node/esgf-web-fe/adminview logged as rootAdmin for giving such roles and permissions.

 myproxy-logon -T -s [idp_node] -p 7512 -l [login] -o ~/.globus/certificate-file -b

Publish

 esgpublish --service fileservice --map test_mapfile.txt --project test --publish

Then check http://my-index-node/esgf-web-fe/

Unpublish

 esgunpublish --map  test_mapfile.txt  --database-delete