This post will describe how to transfer a local file to Ranger [1] using Airavata Client.
NOTE: This post assumes that AiravataClient, GFac and the local_file will be in the same machine.
Create a Service description as follows.
Application Description
NOTE: This post assumes that AiravataClient, GFac and the local_file will be in the same machine.
1. Before starting Airavata server, configure repository.properties file by modifying default fake values for following properties.
trusted.cert.location=path to certificates for ranger myproxy.server=myproxy.teragrid.org myproxy.user=username myproxy.pass=password myproxy.life=3600
Configure your certificate location and my proxy credentials and start Jackrabbit instance and airavata server with all the services.
2. To create a workflow to run on ranger you need to create Host Description, Application Description and a Service Description. If you don’t know know how to create them refer airavata 10 minutes article [2] to understand how to create those documents. Once you become familiar with XBaya UI, use following values for fields given below and create documents using XBaya GUI.
Host Description
- Host Address - gatekeeper.ranger.tacc.teragrid.org
Click on the check box - Define this host as Globus host, then following two entries will enable to fillup.
- Globus Gate Keeper Endpoint - gatekeeper.ranger.tacc.teragrid.org:2119/jobmanager-sge
- Grid FTP Endpoint - gsiftp://gridftp.ranger.tacc.teragrid.org:2811/
Service Description
Create a Service description as follows.
| IO | Parameter Name | Type |
| input | echo_input | URI |
|---|---|---|
| output | echo_output | URI |
Application Description
- Executable path - /share/home/01437/ogce/airavata-test/dir/file-breed.sh
- Temporary Directory - /scratch/01437/ogce/test
Select the above created service descriptor and host Descriptor.. When you select the above created host descriptor you will see a new button Gram Configuration .. now click on that and fill following values.
- Job Type - Single
- Project Account Number - You will see this when you login to ranger, put your project Account number in this field
- Project Description - Description of the project - not mandetory
- Queue Type - development
Click on Update button and save the Application Description.
3. Running the workflow.
i) Using XBaya
Then Compose your workflow using the service created in Application Services. Now hit the red colored play button to run the workflow. It will prompt for a input file. Then give the input file path in following format (The file which you want to copy to Ranger).
file:/home/heshan/Dev/testing/airavata/temp.txt
Save the workflow in the registry (Xbaya Menu → Export → To Registry). This will be used when invoking the workflow using the AiravataClient.
ii) Using Airavata Client
public class AiravataClientTest {
@Test
public void testInvokeWorkflowString() {
try {
AiravataClient airavataClient = new AiravataClient("xbaya.properties");
List<String> workflowTemplateIds = airavataClient.getWorkflowTemplateIds();
Iterator<String> iterator = workflowTemplateIds.iterator();
while(iterator.hasNext()) {
String next = iterator.next();
System.out.println("workflow : " + next);
List<WorkflowInput> workflowInputs = airavataClient.getWorkflowInputs(next);
Iterator<WorkflowInput> workflowInputIterator = workflowInputs.iterator();
while(workflowInputIterator.hasNext()) {
WorkflowInput input = workflowInputIterator.next();
System.out.println("Name :" + input.getName());
System.out.println("Type :" + input.getType());
System.out.println("Value :" + input.getValue());
System.out.println("Default Value :" + input.getDefaultValue());
// System.out.println("input " + input);
}
}
String workflowTemplateId = "GridFtp-local-workflow";
List<WorkflowInput> workflowInputs = airavataClient.getWorkflowInputs(workflowTemplateId);
String topicId = airavataClient.runWorkflow(workflowTemplateId, workflowInputs);
WorkflowExecution workflowExecutionData = airavataClient.getWorkflowExecutionData(topicId);
} catch (RegistryException e1) {
e1.printStackTrace(); //To change body of catch statement use File | Settings | File Templates.
} catch (IOException e1) {
e1.printStackTrace(); //To change body of catch statement use File | Settings | File Templates.
} catch (Exception e) {
e.printStackTrace(); //To change body of catch statement use File | Settings | File Templates.
}
}
}
[1] - http://www.tacc.utexas.edu/user-services/user-guides/ranger-user-guide
[2] - http://incubator.apache.org/airavata/documentation/system/airavata-in-10-minutes.html
