[Bioc-devel] HDF5Array/DelayedArray matrix operations fail on windows

[Pages, Herve]

Hi Kevin,

Running this particular code (e.g. the code in the test-sparsematrix.R 
file) also works for me on our Windows builders. However, trying to run 
the **full suite** of tests does trigger the error. So it seems to be a 
situation where some code in some other tests is altering the state of 
the session in a way that breaks the `scMerge()` calls in 
test-hdf5array.R and test-sparsematrix.R.

I see that you use parallelization a lot. Could it be that some code at 
some point alters the state of the current parallelization backend? All 
these socketConnection() warnings makes me suspect that. This would also 
explain why we only see the problem on Windows. Parallelization problems 
are very platform specific and tend to occur more often on Windows where 
backends like MulticoreParam are not supported.

Best,
H.


On 10/21/19 23:32, Kevin Wang wrote:
> Hi, I am trying to make my package scMerge to be compatible with HDF5Array. While all the checks passed on Linux and Mac, it errored on Windows (https://urldefense.proofpoint.com/v2/url?u=http-3A__bioconductor.org_checkResults_3.10_bioc-2DLATEST_scMerge_&d=DwIGaQ&c=eRAMFD45gAfqt84VtBcfhQ&r=BK7q3XeAvimeWdGbWY_wJYbW0WYiZvSXAJJKaaPhzWA&m=Id_OfFGj844t8jvq9xPxtMaF-nCPVZ5EtPR5nv0Hiwk&s=wQziv6_QxHSybX-rtoi3C555HFUVEY19GZ44tKr3knA&e= ). Upon closer inspection, the failures seem to come a test for compatibility of HDF5Array
> (the script can be viewed here https://urldefense.proofpoint.com/v2/url?u=https-3A__github.com_SydneyBioX_scMerge_blob_master_tests_testthat_test-2Dhdf5array.R&d=DwIGaQ&c=eRAMFD45gAfqt84VtBcfhQ&r=BK7q3XeAvimeWdGbWY_wJYbW0WYiZvSXAJJKaaPhzWA&m=Id_OfFGj844t8jvq9xPxtMaF-nCPVZ5EtPR5nv0Hiwk&s=MWdFZy6IM1p7JLqe93W5_OG0D4kf79BIJm12U2BDS78&e= ). The error message was "non-numeric argument to binary operator” and calls to DelayedArray. I have tried to run this specific line on a Windows machine with Rtools35 installed and there was no error. A similar scenario occurred for sparse matrix (https://urldefense.proofpoint.com/v2/url?u=https-3A__github.com_SydneyBioX_scMerge_blob_master_tests_testthat_test-2Dsparsematrix.R&d=DwIGaQ&c=eRAMFD45gAfqt84VtBcfhQ&r=BK7q3XeAvimeWdGbWY_wJYbW0WYiZvSXAJJKaaPhzWA&m=Id_OfFGj844t8jvq9xPxtMaF-nCPVZ5EtPR5nv0Hiwk&s=ACuxhvv3ZHIB1CXLN0gvFo7LDQmOnaeipbdnstyDdZo&e= ) where the error was "'a' must be a numeric matrix”.
> 
> Any help is greatly appreciated.
> 
> Thank you
> Best Wishes
> Kevin
> The University of Sydney
> 
> 	[[alternative HTML version deleted]]
> 
> _______________________________________________
> Bioc-devel using r-project.org mailing list
> https://urldefense.proofpoint.com/v2/url?u=https-3A__stat.ethz.ch_mailman_listinfo_bioc-2Ddevel&d=DwIGaQ&c=eRAMFD45gAfqt84VtBcfhQ&r=BK7q3XeAvimeWdGbWY_wJYbW0WYiZvSXAJJKaaPhzWA&m=Id_OfFGj844t8jvq9xPxtMaF-nCPVZ5EtPR5nv0Hiwk&s=y023axwxFTrmasaeZ5wAbdc_6HYpjglnD9fb3Jt4gyM&e=
> 

-- 
Hervé Pagès

Program in Computational Biology
Division of Public Health Sciences
Fred Hutchinson Cancer Research Center
1100 Fairview Ave. N, M1-B514
P.O. Box 19024
Seattle, WA 98109-1024

E-mail: hpages using fredhutch.org
Phone:  (206) 667-5791
Fax:    (206) 667-1319