DL WORK PROGRAM

LEVELS OF DL EXPERTISE 

In terms of expertise, these would be the levels to go 

USE OF GLOBAL  DL 

     For this there is enough of an introduction at iridl.ldeo.columbia.edu at 

http://iridl.ldeo.columbia.edu/dochelp/Tutorial/index.html

There are sections on manipulating data, visualization data and undertaking statistical analysis. This is where most Users shall be. While iridl is customized for SL and MV a lot, and there is a lot of data that was previoiusly added for SL and MV, we still need to add our updated local data so that we can make the best use of it. 

When you get something to work, always save this in a URL. For those who want a simple html editor which is as intuitive as Word, we recommend

Seamonkey - we can exchange work as html files.

HH should also capture all  her working links in html and sort it out. 

SETTING UP LOCAL DL (DV, SS, CG to pick this up thoroughly and later AA, DS, PE should do so) 

The IRI had developed what they called "Data Library in a Box" which is a hard disk with the Linux operating system Fedora version and a basic Data Library without much data in a 500 Mb hard drive. This is what we have at Digana and Akurana.

Instructions for these are somewhere in Word Files - (these have to be included both in the OSF and Blogs - by DV and HH - along with notes that JV prepared).

I want all of you particularly the IT oriented to know how to turn on the DL and troubleshoot basic problems - we can do an FAQ on this.

Once the DL is turned on, any computer on the wifi can access it via a numbered url - you should know that.

The IT and DATA folks also need to access the hard-drive to add data, geometries and work on setting up a maproom.

To accomplish this conveniently, it is best done through a terminal set up through remote login - this has to be documented in OSF and the blog

ADDING DATA  

(DV, SS, CG to pick this up thoroughly) 

This is where we shall need to work in a disciplined way. Like other things in the DL, take it a small piece at a time and master it before moving on. 

We have a set of 4 examples, which go from simple to a bit more complex ways to add data
   - Adding a script to the DL in expert mode
   - Reading that same script from a stored file
   - Reading a script in the DL while adding a single column file
   - Reading multi column files
   - Reading a data set with meta data and multiple single column files
   - Reading a data set with multiple variables and multiple input files 

   - As above with binary files

CREATING FILES FOR EXPORT 

(DV, SS, CG to pick this up thoroughly) 

   - we have standardize the binary file format that we use as netcdf 

   there shall be some documentation on this. 

   - it is a good way to interchange files between DL and with CDT etc.  

-------------------------------------------------whats below this line shall not get done this week -----------------------------

CREATING EMBEDDED DL PAGES 

(DV and SS can pick this up later on) 

Already DL pages have been embedded by CG, AA and DS as they prepared the drought portals for mv and sl. More can be done. 

CLIMATE AND OTHER REPORTS
Javascript was used to make our weekly and monthly WMS and Maldives Climate report by our staff and turn it into a pdf  There is a lot of potential there. 

We are having some debugging needed in these scripts 

(DV and CG to do this next week) 

SETTING UP MAPROOMS 

           We should be setting up maprooms - this is generally what non-DL experts like and can use. You can see maproom examples at iridl.ldeo.columbia

http://iridl.ldeo.columbia.edu/maproom/index.html

EXPORTING FROM LOCAL DL TO KAGE OR IRIDL 

As at present, our DL in a box is not accessible outside, I shall try to add polished scripts that you develop locally in the DL at Columbia. 

I have an account on Kage -

http://kage.ldeo.columbia.edu:81/expert/home/.OTHER/.lareef/

Due to security reasons, they have made it difficult to access this account even for me, out of Columbia. So I can use this to upload your files here. 

Note KAGE is an older version of the DL. But the functionality is adequate. It also does not have as many data sets stored as IRIDL but there are scripts to import data. 

AUTOMATICALLY UPDATING DATA 

We should be able to automatically run scripts to bring online data such as in ID and get the DL to read this updated data automatically. This for the future.  

INCORPORATING THE DL IN A BOX TO OUR SERVERS

What we have on our server is a different OS - but it is  possible to bring those files on to the server. It may be tricky so one needs a bit of expertise before doing this. 

PUTTING OUR DL ONLINE 

If we can get the DL added to the server then we can access our local DL online. The examples we have for the data library in countries such as Tanzania is simply with the above done. 

----------------------------------------------

INFORMATION RESOURCES 

BLOGS

There is some information at fectdl.blogspot.com on some specific projects and as time goes on we can 

have those who focus on it, populate it further. There are some relevant posts in the fectit page which HH should copy over to fectdl

OSF 

 We have some relevant OSF pages where there is some links - even this email can be included in the wiki page and expanded. 

BOOKS 

There is one outdate bound book in our librayr which gives the index of functions. 

ONLINE 

Tutorial 

Statistic Tutorial 

Books on DL - we have one book printed in our library 

Youtube - there are some instruction Videos posted 

Tumblr examples from IRI 

IRI Wiki Pages 

       ABOUT THE IT BEHIND DL

                      See iridl.ldeo.columbia.edu/ontologies