hclust for 13000 genes
2
0
Entering edit mode
avehna ▴ 240
@avehna-3930
Last seen 10.3 years ago
Hi There: I'm trying to cluster 13777 genes that are differentially expressed across three different treatments but I'm getting the following error: ------------------------------------------------ R(32949) malloc: *** mmap(size=1518448640) failed (error code=12) *** error: can't allocate region *** set a breakpoint in malloc_error_break to debug Error: cannot allocate vector of size 1.4 Gb Execution halted ------------------------------------------------- I wonder how could I fix it in order to get the clusters and the heatmap with the expression profile. I would appreciate any suggestion from you!. Thank you so much for your help in advance, Avhena [[alternative HTML version deleted]]
• 2.3k views
ADD COMMENT
0
Entering edit mode
@steve-lianoglou-2771
Last seen 22 months ago
United States
Hi, On Wed, Mar 17, 2010 at 5:59 PM, avehna <avhena at="" gmail.com=""> wrote: > Hi There: > > I'm trying to cluster 13777 genes that are differentially expressed across > three different treatments but I'm getting the following error: > > ------------------------------------------------ > R(32949) malloc: *** mmap(size=1518448640) failed (error code=12) > *** error: can't allocate region > *** set a breakpoint in malloc_error_break to debug > Error: cannot allocate vector of size 1.4 Gb > Execution halted > ------------------------------------------------- > > I wonder how could I fix it in order to get the clusters and the heatmap > with the expression profile. I would appreciate any suggestion from you!. This error is telling you that you don't have enough RAM to do what you are trying to do, so to fix this you'll need a way to either get more RAM or get access to a machine that has more ram. Maybe you have enough RAM already and you're using R in 32 bit mode? You didn't tell us the particulars of your machine, so no way to tell ... -steve -- Steve Lianoglou Graduate Student: Computational Systems Biology | Memorial Sloan-Kettering Cancer Center | Weill Medical College of Cornell University Contact Info: http://cbio.mskcc.org/~lianos/contact
ADD COMMENT
0
Entering edit mode
@michael-watson-iah-c-378
Last seen 10.3 years ago
The first answers is that you need to make sure you computer has enough memory, and that R can access that memory. See memory.size() and memory.limit() for answers. The second answer is: are you *sure* you want to cluster 13,777 genes? That's an awful lot to visualise and interpret..... ________________________________________ From: bioconductor-bounces@stat.math.ethz.ch [bioconductor- bounces@stat.math.ethz.ch] On Behalf Of avehna [avhena@gmail.com] Sent: 17 March 2010 21:59 To: bioconductor at stat.math.ethz.ch Subject: [BioC] hclust for 13000 genes Hi There: I'm trying to cluster 13777 genes that are differentially expressed across three different treatments but I'm getting the following error: ------------------------------------------------ R(32949) malloc: *** mmap(size=1518448640) failed (error code=12) *** error: can't allocate region *** set a breakpoint in malloc_error_break to debug Error: cannot allocate vector of size 1.4 Gb Execution halted ------------------------------------------------- I wonder how could I fix it in order to get the clusters and the heatmap with the expression profile. I would appreciate any suggestion from you!. Thank you so much for your help in advance, Avhena [[alternative HTML version deleted]] _______________________________________________ Bioconductor mailing list Bioconductor at stat.math.ethz.ch https://stat.ethz.ch/mailman/listinfo/bioconductor Search the archives: http://news.gmane.org/gmane.science.biology.informatics.conductor
ADD COMMENT
0
Entering edit mode
Hi again, I'm using a very powerful computer (a Mac Pro) with a huge amount of memory and it's also very fast, that's why I wondered why this error came out. I think the problem is that I'm using R in 32 bit mode. How could I change it? Regarding the amount of genes: For each treatment by separate the amount of genes is smaller, but since I'm interested in making a heatplot to visualize the gene profile across all treatments I'm using the union of all sets. I'm very open to new suggestions from you. Thank you so much for your help, Avhena On Wed, Mar 17, 2010 at 6:09 PM, michael watson (IAH-C) < michael.watson@bbsrc.ac.uk> wrote: > The first answers is that you need to make sure you computer has enough > memory, and that R can access that memory. See memory.size() and > memory.limit() for answers. > > The second answer is: are you *sure* you want to cluster 13,777 genes? > That's an awful lot to visualise and interpret..... > ________________________________________ > From: bioconductor-bounces@stat.math.ethz.ch [ > bioconductor-bounces@stat.math.ethz.ch] On Behalf Of avehna [ > avhena@gmail.com] > Sent: 17 March 2010 21:59 > To: bioconductor@stat.math.ethz.ch > Subject: [BioC] hclust for 13000 genes > > Hi There: > > I'm trying to cluster 13777 genes that are differentially expressed across > three different treatments but I'm getting the following error: > > ------------------------------------------------ > R(32949) malloc: *** mmap(size=1518448640) failed (error code=12) > *** error: can't allocate region > *** set a breakpoint in malloc_error_break to debug > Error: cannot allocate vector of size 1.4 Gb > Execution halted > ------------------------------------------------- > > I wonder how could I fix it in order to get the clusters and the heatmap > with the expression profile. I would appreciate any suggestion from you!. > > Thank you so much for your help in advance, > > Avhena > > [[alternative HTML version deleted]] > > _______________________________________________ > Bioconductor mailing list > Bioconductor@stat.math.ethz.ch > https://stat.ethz.ch/mailman/listinfo/bioconductor > Search the archives: > http://news.gmane.org/gmane.science.biology.informatics.conductor > [[alternative HTML version deleted]]
ADD REPLY
0
Entering edit mode
Avhena, I would recommend that you not use R for this application. For hierarchical clustering of large numbers of genes + visualization I would recommend you try the free MeV program that can handle 20,000 genes easily. David On Wed, 17 Mar 2010, avehna wrote: > Hi again, > > I'm using a very powerful computer (a Mac Pro) with a huge amount of memory > and it's also very fast, that's why I wondered why this error came out. I > think the problem is that I'm using R in 32 bit mode. How could I change it? > > Regarding the amount of genes: For each treatment by separate the amount of > genes is smaller, but since I'm interested in making a heatplot to visualize > the gene profile across all treatments I'm using the union of all sets. I'm > very open to new suggestions from you. > > Thank you so much for your help, > > Avhena > > On Wed, Mar 17, 2010 at 6:09 PM, michael watson (IAH-C) < > michael.watson at bbsrc.ac.uk> wrote: > >> The first answers is that you need to make sure you computer has enough >> memory, and that R can access that memory. See memory.size() and >> memory.limit() for answers. >> >> The second answer is: are you *sure* you want to cluster 13,777 genes? >> That's an awful lot to visualise and interpret..... >> ________________________________________ >> From: bioconductor-bounces at stat.math.ethz.ch [ >> bioconductor-bounces at stat.math.ethz.ch] On Behalf Of avehna [ >> avhena at gmail.com] >> Sent: 17 March 2010 21:59 >> To: bioconductor at stat.math.ethz.ch >> Subject: [BioC] hclust for 13000 genes >> >> Hi There: >> >> I'm trying to cluster 13777 genes that are differentially expressed across >> three different treatments but I'm getting the following error: >> >> ------------------------------------------------ >> R(32949) malloc: *** mmap(size=1518448640) failed (error code=12) >> *** error: can't allocate region >> *** set a breakpoint in malloc_error_break to debug >> Error: cannot allocate vector of size 1.4 Gb >> Execution halted >> ------------------------------------------------- >> >> I wonder how could I fix it in order to get the clusters and the heatmap >> with the expression profile. I would appreciate any suggestion from you!. >> >> Thank you so much for your help in advance, >> >> Avhena >> >> [[alternative HTML version deleted]] >> >> _______________________________________________ >> Bioconductor mailing list >> Bioconductor at stat.math.ethz.ch >> https://stat.ethz.ch/mailman/listinfo/bioconductor >> Search the archives: >> http://news.gmane.org/gmane.science.biology.informatics.conductor >> > > [[alternative HTML version deleted]] > > _______________________________________________ > Bioconductor mailing list > Bioconductor at stat.math.ethz.ch > https://stat.ethz.ch/mailman/listinfo/bioconductor > Search the archives: http://news.gmane.org/gmane.science.biology.informatics.conductor >
ADD REPLY
0
Entering edit mode
Hi, On Wed, Mar 17, 2010 at 9:04 PM, avehna <avhena at="" gmail.com=""> wrote: > Hi again, > > I'm using a very powerful computer (a Mac Pro) with a huge amount of memory That's nice ... but how much memory is that, exactly? > and it's also very fast, that's why I wondered why this error came out. I > think the problem is that I'm using R in 32 bit mode. How could I change it? It depends on how you launch R ... are you using R.app? or are you using R from the command line? Assuming you are using R.app, you'll need to launch the 64bit version. You should have an R64.app, which might have come in the default download ... what version of R are you using? You can actually get all the version of R and R.app necessary from here, too: http://r.research.att.com/ Read that page, and download what you need. Specifically search for the term "64-bit" on that page. -steve -- Steve Lianoglou Graduate Student: Computational Systems Biology | Memorial Sloan-Kettering Cancer Center | Weill Medical College of Cornell University Contact Info: http://cbio.mskcc.org/~lianos/contact
ADD REPLY
0
Entering edit mode
Hi Steve, I installed the 64-bit version for R and hclust was performed efficiently, however I got the following error during heatmap.2() ----------------------------------------------------------------- Error in image.default(z = matrix(z, ncol = 1), col = col, breaks = tmpbreaks, : breaks must all be finite Calls: heatmap.2 -> image -> image -> image.default -------------------------------------------------------------------- Any idea about what's going on? Thanks a lot for your help! Avhena On Wed, Mar 17, 2010 at 11:28 PM, Steve Lianoglou < mailinglist.honeypot@gmail.com> wrote: > Hi, > > On Wed, Mar 17, 2010 at 9:04 PM, avehna <avhena@gmail.com> wrote: > > Hi again, > > > > I'm using a very powerful computer (a Mac Pro) with a huge amount of > memory > > That's nice ... but how much memory is that, exactly? > > > and it's also very fast, that's why I wondered why this error came out. I > > think the problem is that I'm using R in 32 bit mode. How could I change > it? > > It depends on how you launch R ... are you using R.app? or are you > using R from the command line? > > Assuming you are using R.app, you'll need to launch the 64bit version. > You should have an R64.app, which might have come in the default > download ... what version of R are you using? > > You can actually get all the version of R and R.app necessary from here, > too: > > http://r.research.att.com/ > > Read that page, and download what you need. Specifically search for > the term "64-bit" on that page. > > -steve > > -- > Steve Lianoglou > Graduate Student: Computational Systems Biology > | Memorial Sloan-Kettering Cancer Center > | Weill Medical College of Cornell University > Contact Info: http://cbio.mskcc.org/~lianos/contact<http: cbio.mskc="" c.org="" %7elianos="" contact=""> > [[alternative HTML version deleted]]
ADD REPLY
0
Entering edit mode
On Thu, Mar 18, 2010 at 12:05 AM, avehna <avhena at="" gmail.com=""> wrote: > Hi Steve, > > I installed the 64-bit version for R and hclust was performed efficiently, > however I got the following error during heatmap.2() > > ----------------------------------------------------------------- > Error in image.default(z = matrix(z, ncol = 1), col = col, breaks = > tmpbreaks, ?: > ?breaks must all be finite > Calls: heatmap.2 -> image -> image -> image.default > -------------------------------------------------------------------- > > Any idea about what's going on? Hi, Avehna. It's best to include as close to a reproducible example as possible (at least the code that you used), the exact error message, the output of traceback() when possible, and sessionInfo() to maximize the chance that the list can help. Sean
ADD REPLY
0
Entering edit mode
Hi Avehna When I do this, I use limma to fit a model that includes every factor, and the resulting output has both a F statistic and an F statistic p-value. These can be used to identify genes that are changing over any of your experiments However, I often find that even if I use a very stringent multiple testing procedure, I still end up with 10000s of genes to worry about. In my experience, this is not only difficult to visualise, but also to interpret. In the past I have applied other filters, such as the magnitude of change over time; or perhaps the lab scientist who produced the data may have created a time course, but is specifically interested in particular time points, so I filter on those; or sometimes, I just take the top n most changing genes, whether n be 500, 1000, 2000 etc. Thanks Mick From: avehna [mailto:avhena@gmail.com] Sent: 18 March 2010 01:05 To: michael watson (IAH-C); Steve Lianoglou; bioconductor@stat.math.ethz.ch Subject: Re: [BioC] hclust for 13000 genes Hi again, I'm using a very powerful computer (a Mac Pro) with a huge amount of memory and it's also very fast, that's why I wondered why this error came out. I think the problem is that I'm using R in 32 bit mode. How could I change it? Regarding the amount of genes: For each treatment by separate the amount of genes is smaller, but since I'm interested in making a heatplot to visualize the gene profile across all treatments I'm using the union of all sets. I'm very open to new suggestions from you. Thank you so much for your help, Avhena On Wed, Mar 17, 2010 at 6:09 PM, michael watson (IAH-C) <michael.watson@bbsrc.ac.uk<mailto:michael.watson@bbsrc.ac.uk>> wrote: The first answers is that you need to make sure you computer has enough memory, and that R can access that memory. See memory.size() and memory.limit() for answers. The second answer is: are you *sure* you want to cluster 13,777 genes? That's an awful lot to visualise and interpret..... ________________________________________ From: bioconductor-bounces@stat.math.ethz.ch<mailto:bioconductor- bounces@stat.math.ethz.ch=""> [bioconductor- bounces@stat.math.ethz.ch<mailto:bioconductor- bounces@stat.math.ethz.ch="">] On Behalf Of avehna [avhena@gmail.com<mailto:avhena@gmail.com>] Sent: 17 March 2010 21:59 To: bioconductor@stat.math.ethz.ch<mailto:bioconductor@stat.math.ethz.ch> Subject: [BioC] hclust for 13000 genes Hi There: I'm trying to cluster 13777 genes that are differentially expressed across three different treatments but I'm getting the following error: ------------------------------------------------ R(32949) malloc: *** mmap(size=1518448640) failed (error code=12) *** error: can't allocate region *** set a breakpoint in malloc_error_break to debug Error: cannot allocate vector of size 1.4 Gb Execution halted ------------------------------------------------- I wonder how could I fix it in order to get the clusters and the heatmap with the expression profile. I would appreciate any suggestion from you!. Thank you so much for your help in advance, Avhena [[alternative HTML version deleted]] _______________________________________________ Bioconductor mailing list Bioconductor@stat.math.ethz.ch<mailto:bioconductor@stat.math.ethz.ch> https://stat.ethz.ch/mailman/listinfo/bioconductor Search the archives: http://news.gmane.org/gmane.science.biology.informatics.conductor [[alternative HTML version deleted]]
ADD REPLY

Login before adding your answer.

Traffic: 438 users visited in the last hour
Help About
FAQ
Access RSS
API
Stats

Use of this site constitutes acceptance of our User Agreement and Privacy Policy.

Powered by the version 2.3.6