Skip to main content

Sun Grid Engine : SGE : Basic Commands


http://www.ats.ucla.edu/clusters/common/computing/batch/sge.htm

http://web.njit.edu/topics/HPC/basement/sge/SGE.html

http://star.mit.edu/cluster/docs/0.92rc2/guides/sge.html




0. First see available q : qstat -g c

1. ALWAYS USE -q queuename

2. To use any particular node use -l hostname (  -l hostname=himem03 )



qsub   -q  normal.q   -e pythonTeswt.err -o pythonTeswt.out   -cwd -S /bin/bash   -l hostname=himem03  testSingledataprep.sh


## using specific node

qsub   -q  normal.q   -e pythonTeswt.err -o pythonTeswt.out   -cwd -l hostname=himem03  -S /bin/bash   -l hostname=himem03  testSingledataprep.sh


python mafParser.py $mafRoot  $dataRoot  $fNameSpecies $fNameSubEXONLncrna  $fnmStatCount $fnmStatPrcnt $fnmStatSub $fnmSUBEXONStatDETECT  $fnapslncBed

/// check my submitted jobs

qstat
// alluser

qstat -u "*"

///// all details of user and nodes

userstat

/// details of queues

qstat -g c

// delete jobs

qdel jobID

// node informations
qhost

--------  RUN any binary installed in path -----------------------

qsub -q  normal.q -cwd -b y -o 1.out -e 1.err -q normal.q -N job1 binary
------------------  JAVA  -------------------------
#!/bin/sh
qsub -q  normal.q -e myErr.err -o myOut.out -S  /usr/bin/java Test.class

-------------------- PYTHON ----------------
#!/bin/sh
qsub -q  normal.q   -e myErr.err -o myOut.out  -s /usr/bin/python  test.py

--------------------  To run in cluster using several nodes ------------
-pe smp 32
// it will try to assign 32 nodes for this job

Comments

Popular posts from this blog

MATLAB cross validation

// use built-in function samplesize = size( matrix , 1); c = cvpartition(samplesize,  'kfold' , k); % return the indexes on each fold ///// output in matlab console K-fold cross validation partition              N: 10    NumTestSets: 4      TrainSize: 8  7  7  8       TestSize: 2  3  3  2 ////////////////////// for i=1 : k    trainIdxs = find(training(c,i) ); %training(c,i);  // 1 means in train , 0 means in test    testInxs  = find(test(c,i)       ); % test(c,i);       // 1 means in test , 0 means in train    trainMatrix = matrix (  matrix(trainIdxs ), : );    testMatrix  = matrix (  matrix(testIdxs  ), : ); end //// now calculate performance %%  calculate performance of a partition     selectedKfoldSen=[];selectedKfoldSpe=[];selectedKfoldAcc=[];     indexSen=1;indexSpe=1;indexAcc=1;     if ( kfold == (P+N) )% leave one out         sensitivity = sum(cvtp) /( sum(cvtp) + sum(cvfn) )         specificity = sum(cvtn) /( sum(cvfp) + sum(cvtn) )         acc

R tutorial

Install R in linux ============ In CRAN home page, the latest version is not available. So, in fedora, Open the terminal yum list R  --> To check the latest available version of r yum install R --> install R version yum update R --> update current version to latest one 0 find help ============ ?exact topic name (  i.e.   ?mean ) 0.0 INSTALL 3rd party package  ==================== install.packages('mvtnorm' , dependencies = TRUE , lib='/home/alamt/myRlibrary/')   #  install new package BED file parsing (Always use read.delim it is the best) library(MASS) #library(ggplot2) dirRoot="D:/research/F5shortRNA/TestRIKEN/Rscripts/" dirData="D:/research/F5shortRNA/TestRIKEN/" setwd(dirRoot) getwd() myBed="test.bed" fnmBed=paste(dirData, myBed, sep="") # ccdsHh19.bed   tmp.bed ## Read bed use read.delim - it is the  best mybed=read.delim(fnmBed, header = FALSE, sep = "\t", quote = &q