Exclude individual probes before normalization
2
0
Entering edit mode
@dana-wohlbach-1873
Last seen 10.3 years ago
Does anyone know of a way to exclude individual probes before normalizing using a method like RMA? In other words, I have identified certain probes in my CEL files that I don't want included in the normalization procedure. Is there a way to use Bioconductor to make this happen? Thanks, Dana
Normalization Normalization • 1.2k views
ADD COMMENT
0
Entering edit mode
@james-w-macdonald-5106
Last seen 2 days ago
United States
Dana Wohlbach wrote: > Does anyone know of a way to exclude individual probes before > normalizing using a method like RMA? In other words, I have > identified certain probes in my CEL files that I don't want included > in the normalization procedure. Is there a way to use Bioconductor > to make this happen? See ?rma(), in particular the 'subset' argument. Best, Jim > > Thanks, > Dana > > _______________________________________________ > Bioconductor mailing list > Bioconductor at stat.math.ethz.ch > https://stat.ethz.ch/mailman/listinfo/bioconductor > Search the archives: http://news.gmane.org/gmane.science.biology.informatics.conductor -- James W. MacDonald University of Michigan Affymetrix and cDNA Microarray Core 1500 E Medical Center Drive Ann Arbor MI 48109 734-647-5623 ********************************************************** Electronic Mail is not secure, may not be read every day, and should not be used for urgent or sensitive issues.
ADD COMMENT
0
Entering edit mode
Hi Jim, Do you know if using the 'subset' argument of rma() has any effect on the memory it uses? I'm not sure if it would decrease the memory requirements by working with less data, or actually increase it by doing a subsetting step somewhere. Thanks, Jenny At 07:37 AM 9/9/2006, James W. MacDonald wrote: >Dana Wohlbach wrote: > > Does anyone know of a way to exclude individual probes before > > normalizing using a method like RMA? In other words, I have > > identified certain probes in my CEL files that I don't want included > > in the normalization procedure. Is there a way to use Bioconductor > > to make this happen? > >See ?rma(), in particular the 'subset' argument. > >Best, > >Jim > > > > > > Thanks, > > Dana > > > > _______________________________________________ > > Bioconductor mailing list > > Bioconductor at stat.math.ethz.ch > > https://stat.ethz.ch/mailman/listinfo/bioconductor > > Search the archives: > http://news.gmane.org/gmane.science.biology.informatics.conductor > > >-- >James W. MacDonald >University of Michigan >Affymetrix and cDNA Microarray Core >1500 E Medical Center Drive >Ann Arbor MI 48109 >734-647-5623 > > > >********************************************************** >Electronic Mail is not secure, may not be read every day, and should not >be used for urgent or sensitive issues. > >_______________________________________________ >Bioconductor mailing list >Bioconductor at stat.math.ethz.ch >https://stat.ethz.ch/mailman/listinfo/bioconductor >Search the archives: >http://news.gmane.org/gmane.science.biology.informatics.conductor Jenny Drnevich, Ph.D. Functional Genomics Bioinformatics Specialist W.M. Keck Center for Comparative and Functional Genomics Roy J. Carver Biotechnology Center University of Illinois, Urbana-Champaign 330 ERML 1201 W. Gregory Dr. Urbana, IL 61801 USA ph: 217-244-7355 fax: 217-265-5066 e-mail: drnevich at uiuc.edu
ADD REPLY
0
Entering edit mode
Hi Jenny, I have never needed to use the subset argument, so don't know for sure. However, the subsetting appears to be done at the C level rather than at the R level, so I would bet there isn't much copying being done, which is the only way I know that more memory would be required. My bet is that it would take less memory. Ben Bolstad would know for sure, since he wrote the C code. Best, Jim Jenny Drnevich wrote: > Hi Jim, > > Do you know if using the 'subset' argument of rma() has any effect on the > memory it uses? I'm not sure if it would decrease the memory requirements > by working with less data, or actually increase it by doing a subsetting > step somewhere. > > Thanks, > Jenny > > At 07:37 AM 9/9/2006, James W. MacDonald wrote: > >>Dana Wohlbach wrote: >> >>>Does anyone know of a way to exclude individual probes before >>>normalizing using a method like RMA? In other words, I have >>>identified certain probes in my CEL files that I don't want included >>>in the normalization procedure. Is there a way to use Bioconductor >>>to make this happen? >> >>See ?rma(), in particular the 'subset' argument. >> >>Best, >> >>Jim >> >> >> >>>Thanks, >>>Dana >>> >>>_______________________________________________ >>>Bioconductor mailing list >>>Bioconductor at stat.math.ethz.ch >>>https://stat.ethz.ch/mailman/listinfo/bioconductor >>>Search the archives: >> >>http://news.gmane.org/gmane.science.biology.informatics.conductor >> >> >>-- >>James W. MacDonald >>University of Michigan >>Affymetrix and cDNA Microarray Core >>1500 E Medical Center Drive >>Ann Arbor MI 48109 >>734-647-5623 >> >> >> >>********************************************************** >>Electronic Mail is not secure, may not be read every day, and should not >>be used for urgent or sensitive issues. >> >>_______________________________________________ >>Bioconductor mailing list >>Bioconductor at stat.math.ethz.ch >>https://stat.ethz.ch/mailman/listinfo/bioconductor >>Search the archives: >>http://news.gmane.org/gmane.science.biology.informatics.conductor > > > Jenny Drnevich, Ph.D. > > Functional Genomics Bioinformatics Specialist > W.M. Keck Center for Comparative and Functional Genomics > Roy J. Carver Biotechnology Center > University of Illinois, Urbana-Champaign > > 330 ERML > 1201 W. Gregory Dr. > Urbana, IL 61801 > USA > > ph: 217-244-7355 > fax: 217-265-5066 > e-mail: drnevich at uiuc.edu > > _______________________________________________ > Bioconductor mailing list > Bioconductor at stat.math.ethz.ch > https://stat.ethz.ch/mailman/listinfo/bioconductor > Search the archives: http://news.gmane.org/gmane.science.biology.informatics.conductor -- James W. MacDonald, M.S. Biostatistician Affymetrix and cDNA Microarray Core University of Michigan Cancer Center 1500 E. Medical Center Drive 7410 CCGC Ann Arbor MI 48109 734-647-5623 ********************************************************** Electronic Mail is not secure, may not be read every day, and should not be used for urgent or sensitive issues.
ADD REPLY
0
Entering edit mode
It definitely does not increase memory usage. The subsetting of the data is actually done at the R level (via a call using pm() accessor on an AffyBatch with a subset argument). Given that you are pulling out a smaller chunk of data from the AffyBatch and at the C level the code tries to be fairly parsimonious about any additional memory it requires I would also guess that it is less memory (this is speaking without making any attempts to bench mark it). Best, Ben On Mon, 2006-09-11 at 12:22 -0400, James W. MacDonald wrote: > I have never needed to use the subset argument, so don't know for sure. > However, the subsetting appears to be done at the C level rather than at > the R level, so I would bet there isn't much copying being done, which > is the only way I know that more memory would be required. My bet is > that it would take less memory. > > Ben Bolstad would know for sure, since he wrote the C code. > Jenny Drnevich wrote: > > Do you know if using the 'subset' argument of rma() has any effect on the > > memory it uses? I'm not sure if it would decrease the memory requirements > > by working with less data, or actually increase it by doing a subsetting > > step somewhere. > > -- Ben Bolstad <bmb at="" bmbolstad.com=""> http://bmbolstad.com
ADD REPLY
0
Entering edit mode

The subset argument is not implemented yet. When I set it to the probes I am interested in, the result is the same as not specifying any probes. Is there any other way?

ADD REPLY
0
Entering edit mode
Jenny Drnevich ★ 2.2k
@jenny-drnevich-382
Last seen 10.3 years ago
Hi Dana, If you want to remove individual probes instead of entire probesets, see the response I sent to Donald Schwartz on this last Friday - it has some code to modify the cdf for your chip by removing individual probes and/or entire probe sets. Cheers, Jenny At 12:04 PM 9/8/2006, Dana Wohlbach wrote: >Does anyone know of a way to exclude individual probes before >normalizing using a method like RMA? In other words, I have >identified certain probes in my CEL files that I don't want included >in the normalization procedure. Is there a way to use Bioconductor >to make this happen? > >Thanks, >Dana > >_______________________________________________ >Bioconductor mailing list >Bioconductor at stat.math.ethz.ch >https://stat.ethz.ch/mailman/listinfo/bioconductor >Search the archives: >http://news.gmane.org/gmane.science.biology.informatics.conductor Jenny Drnevich, Ph.D. Functional Genomics Bioinformatics Specialist W.M. Keck Center for Comparative and Functional Genomics Roy J. Carver Biotechnology Center University of Illinois, Urbana-Champaign 330 ERML 1201 W. Gregory Dr. Urbana, IL 61801 USA ph: 217-244-7355 fax: 217-265-5066 e-mail: drnevich at uiuc.edu
ADD COMMENT

Login before adding your answer.

Traffic: 596 users visited in the last hour
Help About
FAQ
Access RSS
API
Stats

Use of this site constitutes acceptance of our User Agreement and Privacy Policy.

Powered by the version 2.3.6