allpaths 使用

软件下载与说明：http://www.broadinstitute.org/software/allpaths-lg/blog/?page_id=12

原始数据的深度要达到100以上。

至少要两个库，大库和小库，

小库的一对reads要有重叠部分。并且小库的插入片段大小分布差异要在20%以内。

大库插入片段要接近3000，并且长度分布可以有较大的差异。

ALLPATHS‐LG requires a minimum of 2 paired‐end libraries – one short and one long. The short library average separation size must be slightly less than twice the read size, such that the reads from a pair will likely overlap – for example, for 100 base reads the insert size should be 180 bases. The distribution of sizes should be as small as possible, with a standard deviation of less than 20%. The long library insert size should be approximately 3000 bases long and can have a larger size distribution. Additional optional longer insert libraries can be used to help disambiguate larger repeat structures and may be generated at lower coverage.

A fragment library is a library with a short insert separation, less than twice the read length, so that the reads may overlap (e.g., 100bp Illumina reads taken from 180bp inserts.) A jumping library has a longer separation, typically in the 3kbp‐10kbp range, and may include sheared or EcoP15I libraries or other jumping‐library construction; ALLPATHS can handle read chimerism in jumping libraries. Note that fragment reads should be long enough to ensure the overlap.

A fragment library is a library with a short insert separation, less than twice the read length, so that the reads may overlap (e.g., 100bp Illumina reads taken from 180bp inserts.) A jumping library has a longer separation, typically in the 3kbp‐10kbp range, and may include sheared or EcoP15I libraries or other jumping‐library construction; ALLPATHS can handle read chimerism in jumping libraries. Note that fragment reads should be long enough to ensure the overlap.

现在也可以加入pacbio数据，但是只针对真菌基因组。

如果你有reference genome就提供

allpaths需要的输入文件：

1， DATA directory里的base,quality score, and pairing information files.like that:

<REF>/<DATA>/frag_reads_orig.fastb
<REF>/<DATA>/frag_reads_orig.qualb
<REF>/<DATA>/frag_reads_orig.pairs
<REF>/<DATA>/jump_reads_orig.fastb
<REF>/<DATA>/jump_reads_orig.qualb
<REF>/<DATA>/jump_reads_orig.pairs

2, a ploidy file must also be present.the file polidy file is a single-line file containing a number.The specfic file name is :

<REF>/<DATA>/ploidy

如何产生这些输入文件呢：

用自带的perl脚本： PrepareALLPaths.pl。用这个脚本需要提供两个配置文件：

in_groups.csv和 in_libs.csv。

csv的意思是： comma-separated-values

首先来看in_groups.csv文件：

group_name: a UNIQUE nickname for this specific data set.
library_name: the library to which the data set belongs.
file_name: the absolute path to the data file.

再看in_libs.csv文件：这个文件是描述你的library的。

library_name: matches the same field in in_groups.csv.
project_name: a string naming the project.
organism_name: the organism.
type: fragment, jumping, EcoP15, etc. This field is only informative.
paired: 0: Unpaired reads; 1: paired reads.
frag_size: average number of bases in the fragments (only defined for FRAGMENT libraries).
frag_stddev: estimated standard deviation of the fragments sizes (only defined for FRAGMENT libraries).
insert_size: average number of bases in the inserts (only defined for JUMPING libraries; if larger than 20 kb, the library is considered to be a LONG JUMPING library).
insert_stddev: estimated standard deviation of the inserts sizes (only defined for JUMPING libraries).
read_orientation: inward or outward. Outward oriented reads will be reversed.
genomic_start: index of the FIRST genomic base in the reads. If non‐zero, all the bases before genomic_start will be trimmed out.
genomic_end: index of the LAST genomic base in the reads. If non‐zero, all the bases after genomic_end will be trimmed out.

这两个文件准备好以后，就可以run 这个perl脚本了

mkdir sht_genome

cd sht_genome

mkdir mydata

PrepareALLPathsInputs.pl \

DATA_DIR='full path to REFERENCE DIR'/mydata \

PICARD_TOOLS_DIR='path to picard tools' \

IN_GROUPS_CSV=in_groups.csv（在当前目录可以不指定） \

IN_LIBS_CSV=in_libs.csv（在当前目录可以不指定） \

INCLUDE_NON_PF_READS=1（默认） \

PHRED_64 = 0(默认) \

PLOIDY = 2 \

DATA_DIR: is the location of the ALLPATHS DATA directory where the converted reads will be placed.

PICARD_TOOLS_DIR: is the path to the Picard tools needed for data conversion, if your data is in BAM format.

IN_GROUPS_CSV: 编辑的in_groups.csv的文件位置，如果在当前目录，可以不写。

IN_LIBS_CSV: 编辑的in_libs.csv的文件位置，如果在当前目录，可以不写。

INCLUDE_NON_PF_READS:  if the read passed the signal purity filter.  "0" means the read did not pass filter and "1" means that it did.

PHRED_64： 0表示碱基质量是按照phred_33，1表示碱基质量按照phred_64

PLOIDY： 产生polidy文件，是单倍体就是1，二倍体是2.

这个脚本执行完后，ALLPATHS所需的输入文件就都准备好了~

来说说目录结构：

我所在的目录： /share/bioinfo/miaochenyong/ZLS_HEGU_genome_assembly/try_assemble_allpaths

我就准备在这个目录下进行allpath拼接。

REFERENCE/DATA/RUN/ASSEMBLIES/SUBDIR

REFERENCE就是你的物种的名字，同时如果有参考基因组的话，转换格式Fasta2Fastb后，放进去，参考序列的命名：genome.fasta and genome.fastb.。提前创建好这个目录。Fasta2Fastb IN=genome.fasta

DATA：The DATA directory contains the original read data used in a particular assembly attempt. (This data is stored in internal ALLPATHS formats: fastb, qualb, pairs.) It also contains intermediate files derived from the original data that are independent of the particular assembly attempt – typically files used in evaluation.提前创建好这个目录

Each DATA directory may contain many RUN directories, each representing a particular attempt to assemble the original data using a different set of parameters.

RUN：The RUN directory contains all the non‐localized assembly files, that is, those intermediate files generated from the original read data in preparation for the final assembly stage (LocalizeReadsLG and beyond). It may also contain intermediate files used in evaluation that are dependent on the assembly parameters chosen.

在执行runallpathlg时，用RUN=来指定。

ASSEMBLIES：The ASSEMBLIES directory contains the actual assembly (or assemblies). There is no argument for naming this directory. It is actually named ASSEMBLIES.这个目录的名字是没法指定的，就叫ASSEMBLIES。

SUBDIR：The SUBDIR directory is where the localized assembly is generated, along with some assembly intermediate and evaluation files.在执行runallpathlg时，用SUBDIR=来指定。

下一步，运行ALLPATHS，

Once the read data has been imported you may run the ALLPATHS pipeline as often as desired, each time with different assembly parameters. Each time you run the ALLPATHS pipeline it will determine which modules need to run (or re‐run) depending on the parameters you have chosen. Unless you want to overwrite your previous assembly, specify a new RUN directory each time.

RunAllPathsLG
PRE=<user pre>
DATA_SUBDIR=mydata
RUN=myrun
REFERENCE_NAME=staph
TARGETS=standard（the value of the TARGETS parameter determines the operations performed by the pipeline:TARGETS=full_eval:Runs a version of the pipeline that includes additional evaluation modules.TARGETS=standard:Runs a streamlined version of the pipeline that skips many of the evaluation modules.）

This will create (if it doesn’t already exist) the following pipeline directory structure:
<user pre>/staph/mydata/myrun

Where staph is the REFERENCE directory, mydata is the DATA directory containing the imported data, and myrun is the RUN directory.

实际使用时的命令：

nohup RunAllPathsLG \

PRE=/share/bioinfo/miaochenyong/ZLS_HEGU_genome_assembly/try_assemble_allpaths \

REFERENCE_NAME=sht_genome \

DATA_SUBDIR=mydata \

RUN=myrun \

EVALUATION=STANDARD \

TARGETS=full_eval \

SUBDIR=MCY_ASB \

THREADS=40 \

OVERWRITE=True  &

freemao

FAFU