Changelog
All notable changes to this project will be documented in this file.
The format is based on Keep a Changelog, and this project adheres to Semantic Versioning.
Note that CoMorMent containers are organized using several GitHub repositories:
https://github.com/comorment/containers - .sif files, public reference data, documentation, common scripts
https://github.com/comorment/reference - private reference data with access restricted to CoMorMent collaborator
All of the above repositories are covered by this CHANGELOG. They will have the same version tags on github. In addition, we have repositories containing specific tools, e.g. https://github.com/comorment/HDL, which will be covered by their own CHANGELOG.md file.
To identify the version of a .sif file, run md5sum <container>.sif command and find the MD5 checksum in the list below.
If MD5 sum is not listed for a certain release then it means that the container hasn’t been changed from the previous release.
[Unreleased]
Added
Updated
Updates goes here
Fixed
Fixes goes here
Removed
Removed features goes here
Misc
Miscellaneous goes here
1.15.0 - 2026-02-23
Added
Added
OPERAandSMRtools togwas.sifcontainer, with corresponding tests.Added Python and R packages to
python3.sifandr.sifcontainers, with corresponding tests.
1.14.0 - 2025-12-05
Updated
Using Miniforge3 installer (was Mambaforge)
Updated Python (3.10.6 -> 3.12.12) and installed packages in
python3.sifcontainer.
Fixed
Fixed issue with %matplotlib inline magic with IPython/Jupyter in
python3.sifcontainer.
1.13.1 - 2025-11-27
Removed mrcieu.R installer script, prefer installation from GitHub repos.
1.13.0 - 2025-11-27
Added
added misc. R and Python packages to respective containers
added script to install R backages from MRCIEU-Universe
Updated
updated PLINK2 to v2.0.0-a.6.28 (Nov. 23, 2025) across containers
[1.12.0] - 2025-11-26
Fixed
quiet import of
bit64inldpred2.Rto fix broken IDs withattach_snp()functionnot using git LFS for GH actions
Removed
removed shapeit5 installation from
gwas.sifcontainer build
[1.11.0] - 2025-09-17
Added
added some requested R packages to R container.
[1.10.0] - 2025-08-27
Updated
Use Ubuntu 24.04LTS as base image for all container builds for futureproofing/security
Add ‘paramiko’ package to
python3.sifcontainer, updated genomicSEM and added arrow, zlib, mr.raps inr.sifcontainerMore recent posit/cran(@2025-08-01)/bioconductor (3.19->3.22@2025-08-01) packages, removing deprecated packages (zlibbioc)
revised a bunch of tool installer scripts
shapeit5 binaries now use static builds provided by developer
Removed
temporarily remove build of qctool from gwas.sif due to GCC >= 13 issues
[1.9.1] - 2025-03-27
Added
add fastparquet, pyarrow, dask (explicitly) packages and plink2 binary to python3.sif container
Updated
updated scikit-learn, pandas, sksurv, seaborn packages in python3.sif container
updated pull_all_containers.py script
[1.9.0] - 2025-02-20
Added
Add script
./containers/pull_all_containers.pyto pull tagged versions of container builds from GitHub Container Registry, revising folder layout as./containers/<tag>/<image>.sifAdd R packages glmmTMB, hazrd; Python packages shap, pytables, xgboost, pydot, graphviz.
Add argument
--file-drop-snpstoldpred2.Rto drop select SNPs from the PGS calculationAdd R packages AER, MendelianRandomization, gwasurvivr
Add R packages lightgbm, EFAtools, RiskScorescvd, glmnet, survival, caret, PooledCohort, genio, HyPrColoc
Add Python3 packages miniwdl, miniwdl-slurm, dxpy
Add unit test runs as part of the GitHub Actions workflow for building Docker containers
Add Python packages
imbalanced-learn, lightgbm, openpyxl+ PRSice_linux binary topython3.sifcontainerAdd Conda environment file for project dependencies
Add Python packages
scikit-survival, pandas-plink, numba, xmltodict, pyliftover, configparser, intervaltreetopython3.sifcontainerAdd
Haplin,WSpiller/MVMR,noahlorinczcomi/MRBEER packages tor.sifcontainerAdd container build and push actions for all containers:
Action should trigger builds on pushes and pull requests targeting the main branch.
Should build and push Docker and Singularity images for new tags with
v*.*.*pattern in main branch.Revise installation and usage documentation for images.
Buttons added to README.md for Docker build status.
Added options
--extract,--extract-step1,--extract-step2,--exclude,--exclude-step1, and--exclude-step2to thegwas.pyscript to enable inclusion and exclusion of SNPsAdded support for additional customization through
config.yamlfile for association analysesAdded Rstudio-server and R packages info to
r.sifcontainer documentation
Updated
updated documentation throughout, replacing Singularity with Apptainer, reflect new container build directory
updated citation info to published paper
update R to 4.4.1 in
r.sifcontainer (from 4.0.5); update R packages to Posit/CRAN/BioConductor dated 2024.09.01; BioConductor version 3.19 (from 3.12)update testing scripts to support both Docker and Singularity containers
Update REGENIE binary to version 3.6 in
gwas.sifcontainerUpdate LDAK binary to version 6 in gwas.sif (from 5.2)
Rebuilt
gwas.sifcontainer with md5sum checksum:4e295149f3a5e25588cc4a1f1d39876c singularity/gwas.sif
Compile regenie with
HAS_BOOST_IOSTREAM=1andHTSLIB_PATHoptionsChange LDpred2 usage example to use the OpenSNP based datasets
Bundle of sphinx documentation build updates/restructures
Refer to the project as “COSGAP-containers”
Minor changes to documentation + suggestion of TOC
migrate online documentation to cosgap.readthedocs.io
updated documentation to reflect the new project name
added references/urls to software tables in the documentation for singularity containers
update citation info
Fixed
Fixed missing ORAS CLI with
ubuntu-latestrunners in GitHub ActionsFixed broken unit test in
tests/test_LDpred2/scripts/ld.shFixed broken unit test
tests/test_gwas.py::test_gwas_metalwith Apptainer “sandbox” modeWorkaround for pandas import before scipy in python codes via
export LD_LIBRARY_PATH=/usr/local/lib:$LD_LIBRARY_PATHFixed brittle tests if
TMPDIRis not/tmp
Removed
Removed Singularity Image Format (.sif) files from the
singularity/directory. These are now built and stored in the ghcr.io container registry on different formats.Removed Saige support and Saige-related files
[1.8.1] - 2024-03-05
Fixed
Fixed parsing of
IIDfield inpheno.dictFixed issue with files with different suffixes produced by plink2 for binary phenotypes in
gwas.py
[1.8.0] - 2024-02-22
Added
Added scripts to analyze and filter bigSNPR LD matrixes (
scripts/pgs/LDpred2/analyzeLD.R,scripts/pgs/LDpred2/splitLD.R).
[1.7.2] - 2024-02-14
Updated
Rebuilt
r.sifcontainer with md5sum checksum:3d69fc2168ef98d1eda3da05391cd6e4 singularity/r.sif
Added
added
CC-GWASR package tor.sifcontainer
[1.7.1] - 2024-02-06
Fixed
Fixed parsing of
--genomic-build hg18/hg38inldpred2.R
[1.7.0] - 2024-02-02
Added
Added
samtools 1.19.2,bedtools 2.31.1,liftOver (latest)togwas.sifcontainerAdded corresponding unit tests
Updated
Updated the following binaries (not listing apt package updates) in gwas.sif built
bcftools to 1.19
bolt to 2.4.1
gcta to 1.94.1
gctb to 2.04.3
htslib to 1.19.1
king to 2.3.2
minimac4 to 4.1.6
plink to v1.90b7.2 64-bit (11 Dec 2023)
plink2 to v2.00a5.10LM 64-bit Intel (5 Jan 2024)
plink2_avx2 to v2.00a5.10LM AVX2 Intel (5 Jan 2024)
PRSice_linux to 2.3.5
regenie to 3.4.1
vcftools to git SHA: d511f469e87c2ac9779bcdc3670b2b51667935fe (0.1.17dev)
Rebuilt
gwas.sifw. md5sum checksum:a775f4216b15b731471821d0c2a0da43 singularity/gwas.sif
updated installer scripts
Fixed
Broken
docker/scripts/build_docker.shscript
[1.6.0] - 2023-12-12
Added
Added
gdbdebugger,ldakandsnptestbinaries togwas.sifcontainerAdded tests for
ldakandsnptestbinaries ingwas.sifcontainer
Updated
updated
metalto version2020-05-05ingwas.sifupdated
qctooltov2.2.2and added related binariesinthinnerator,hptest,ldbirdandselfmaptogwas.sifrebuilt
gwas.sif(md5 checksum b6104b58d21f862f9d61a86d9d4802a6)
[1.5.1] - 2023-10-20
Fixed
Fixed broken ReadTheDocs documentation build
[1.5.0] - 2023-10-17
Added
Added
<containers>/scripts/pgs/pgs_toolkit, a Python toolkit for computing PGS using LDpred2, PRSice2 or PLINKAdded
<containers>docker/scripts/build_docker.shscript replacing corresponding build statement inMakefileAdded test for
gcta
Updated
Updated
r.sifbuild with many additional R packages, with corresponding updates to build recipes and testsUse
https://packagemanager.posit.co/cran/__linux__/focal/2023-02-16as main R package repor.sifmd5 checksum:1280ba24d99664d450b2e4c4a9c00587 singularity/r.sif
Updated GitHub workflow versions to current versions
Removed
removed logging of
docker build ...indocker/Makefile(issues with piping toteein case of build errors)
[1.4.0] - 2023-10-17
Added
Added phasing/imputation tools
beagle,duohmm,eagle,shapeit5,switchError, togwas.sifcontainer + updated tests
Fixed
Fix issue that shell script wouldn’t capture failing statements
Updated
Updated
gwas.sifDockerfile and installed shell scripts (misc. dependencies updates, installinggctaversion 1.93.3beta2)Rebuilt
gwas.sifusing Docker--no-cacheoption to fix missingminimac4binary, w. md5 checksum:a1dd235221902741bf5773945a584e47 singularity/gwas.sif
Removed
Removed unused
install_miniconda.shscript fromsrc/scriptsfolder
[1.3.9] - 2023-10-17
Added
User-set directory option for temporary files during LDpred2 runs, by default
base::tempdir()
[1.3.8] - 2023-10-17
Fixed
Added
--genomic-build hg18/hg19/hg38option toldpred2.Rto use correct LD reference meta fileposcolumn name
[1.3.7] - 2023-10-17
Added
Added a feature to read and convert BGEN (.bgen) files to
scripts/pgs/LDpred2/createBackingFile.R
[1.3.7] - 2023-10-12
User-set directory for temporary files during LDpred2 runs, by default
base::tempdir()
[1.3.6] - 2023-08-17
Fixed
Ignore LDpred2
--col-bp <column>arg in case--merge-by-rsidis used
[1.3.5] - 2023-08-17
Updated
Updated LDpred2 README file
[1.3.4] - 2023-06-22
Updated
Update regenie to v3.2.8
Fixed
#187 - Regression in gwas.py in handling of info, maf, hwe and geno filters
[1.3.3] - 2023-06-14
Updated
Removed time consuming genotype missingness check from
ldpred2.R.
[1.3.2] - 2023-06-12
Fixed
Fixed misc. issues with cross references in online documentation
[1.3.1] - 2023-06-07
Added
Added unittest for uppercase chromosome column name in sumstats files, that may also contain chromosomes encoded as character(s)
Fixed
Fixed issue with character encoding in sumstats files, in case chromosome column name is uppercase.
[1.3.0] - 2023-05-19
Added
Added to
ldpred2.R: Multi-threading ofsnp_ldsc, arguments for parameters tosnp_ldpred2_auto, and alternative effective sample-size calculation through--n-casesandn-controls.
Fixed
Solved error due to case-sensitive handling of
--col-chrinldpred2.Rand naming of diagnostic plot when using--name-score.
[1.2] - 2023-05-11
Added
Added
RELEASES.mdfile explaining steps needed to make releases.Added
PRSice_linuxtor.sifAdded tests for
gwas.pyAdded package
GWASToolstor.sif.Added confidence intervals to qq plots created by
gwas.pyusingGWASToolsR package.Added status badges and citation.cff file
Updated
Updated file and folder layout, fixing minor documentation issues. Moving from
m2r2toMyst-parserfor Sphinx-generated online docs.Rebuilt the R container
5ecbfc50f96bc6b25f61858927283e2d singularity/r.sif
Rebuilt the R container
23d195a10b84603b15d0e8c42df40fbd singularity/r.sif
Fixed
Set version file info to 1.2.dev (was 0.1.1dev)
Fixed bad parsing of arbitrary length list of args in
usecases/LDpred2/complementSumstats.RMade
usecases/LDpred2/complementSumstats.Rwrite output file by default, not stdout.Fixed print statement in
usecases/LDpred2/complementSumstats.Rcausing crash w.--file-outputarg.Fixed
ldpred2.Rscript in case--file-pheno/--col-pheno/--col-pheno-from-famargs were used, by removing these options altogether.Use packagemanager.rstudio.com/cran/linux/focal/2023-02-16 as main R package repo
gwas.py --variance-standardizeoption now throws an error when applied to columns with no variance
Removed
Removed redundant
usecases/LDpred2_tutorialfiles
Misc
Python code max line length of 120 chars, ignore number of newlines between functions
Misc
Python code max line length of 120 chars, ignore number of newlines between functions
[1.1] - 2022-12-01
Maintenance/feature release with the following main software incorporated into each container:
container |
OS/tool |
version |
license |
|---|---|---|---|
hello.sif |
ubuntu |
20.04 |
|
hello.sif |
plink |
v1.90b6.18 64-bit (16 Jun 2020) |
|
gwas.sif |
ubuntu |
20.04 |
|
gwas.sif |
plink |
v1.90b6.18 64-bit (16 Jun 2020) |
|
gwas.sif |
plink2 |
v2.00a3.6LM 64-bit Intel (14 Aug 2022) |
|
gwas.sif |
plink2_avx2 |
v2.00a3.6LM AVX2 Intel (24 Jan 2020) |
|
gwas.sif |
PRSice_linux |
2.3.3 (2020-08-05) |
|
gwas.sif |
simu_linux |
v0.9.4 |
|
gwas.sif |
bolt |
v2.4 July 22, 2022 |
|
gwas.sif |
gcta64 |
version 1.93.2 beta Linux |
|
gwas.sif |
gctb |
2.02 |
|
gwas.sif |
qctool |
2.0.6, revision 18b8f17 |
|
gwas.sif |
king |
2.2.9 - © |
|
gwas.sif |
metal |
version released on 2011-03-25 |
- |
gwas.sif |
vcftools |
0.1.17 |
|
gwas.sif |
bcftools |
1.12 (using htslib 1.12) |
|
gwas.sif |
flashpca_x86-64 |
2.0 |
|
gwas.sif |
regenie |
v2.0.2.gz |
|
gwas.sif |
GWAMA |
2.2.2 |
|
gwas.sif |
minimac4 |
v4.1.0 |
|
gwas.sif |
bgenix |
1.1.7 |
|
gwas.sif |
cat-bgen |
same version as bgenix |
|
gwas.sif |
edit-bgen |
same version as bgenix |
|
gwas.sif |
HTSlib |
1.12 |
|
gwas.sif |
shapeit4.2 |
v4.2.2 |
|
python3.sif |
ubuntu |
20.04 (LTS) |
|
python3.sif |
python3 |
python 3.10.6 + numpy, pandas, etc. |
|
python3.sif |
LDpred |
1.0.11 |
|
python3.sif |
python_convert |
github commit bcde562 |
|
python3.sif |
plink |
v1.90b6.18 64-bit (16 Jun 2020) |
|
r.sif |
ubuntu |
20.04 |
|
r.sif |
R |
4.0.5 (2021-03-31) + data.table, ggplot, etc. |
|
r.sif |
gcta64 |
version 1.93.2 beta Linux |
|
r.sif |
PRSice_linux |
2.3.3 (2020-08-05) |
|
r.sif |
rareGWAMA |
- |
|
r.sif |
GenomicSEM |
||
r.sif |
TwoSampleMR |
||
r.sif |
GSMR |
v1.0.9 |
|
r.sif |
snpStats |
v1.40.0 |
|
saige.sif |
ubuntu |
16.04 |
|
saige.sif |
SAIGE |
version 0.43 |
Main changes since release version 1.0.0:
Added
add option to append
usecases/LDpred2/ldpred.Rscore output to an existing fileadd script
usecases/LDpred2/complementSumstats.Rto append chromosome and position to summary statisticsadd polygenic score output tests for
usecases/LDpred2/ldpred.Radd
usecases/LDpred2/imputeGenotypes.Rfor imputing genotypes using R-package bigSNPRadd
usecases/LDpred2/calculateLD.Rfor calculation LD using R-package bigSNPR.add autobuilt online documentation from repository sources at https://comorment-containers.readthedocs.io/en/latest/
add R libraries for LDpred2 analysis to
r.sif+ corresponding example.add tests for
metalandqctoolingwas.sifbuildadd basic GitHub actions from https://github.com/precimed/container_template.git
add
FaST-LMM(version 0.6.3) to futurepython3.sif, and corresponding testadd
shapeit4.2binary (shapeit4 v.4.2.2) and HTSlib (1.11) to futuregwas.sifbuilds, and corresponding testadded additional tests for software in
gwas.sif,python3.sifbuildsadd versions identifiers for all explicitly installed software across
hello.sif,gwas.sif,python3.sif,r.sif, listed in docker/README.mdreplaced Ubuntu 18.04 with 20.04 (LTS) as base image for
hello.sif,gwas.sif,python3.sifreplaced
src/scripts/install_miniconda3.shbyscr/scripts/install_mambaforge.shwhich is now used in futurepython3.sifbuildsadd tests for bgenix and Minimac4 software in
gwas.sif, removing build-time dependencies for these from containeradd basic test that KING software runs in
gwas.sifadd Dockerfiles and install scripts for
gwas.sif,hello.sif,python3.sif,r.sif,saige.siffrom gwas.add CHANGELOG.md (this file)
add
gwas.py --analysis saigeoption, allowing to run SAIGE analysisadd
gwas.py --analysis figuresoption, using R qqman for QQ and manhattan plotsadd
gwas.py --pheno-sepand--dict-sepoptions to specify delimiter for the phenotype file and phenotype dictionary fileadd package
qqmantor.sifadd package
yamltopython3.sifadd
gctb_2.0_tutorial.zipreference files underreference/examples/gctb_2.0_tutorialadd
config.yamlfile with configuration options, which can be specified viagwas.py --configoptionadd
--chunk-size-bpand--bimoption, allowing to run SAIGE analysis in smaller chunksadd
--keepand--removeoptions togwas.py, allowing to keep and remove subsets of individuals from analysis; the functions work similarly to plink2 as described here.
Updated
rebuilt the following containers following version pinning in Dockerfiles, install scripts, etc. (see above additions):
bb7a8e0b977e29e03067d75d19803913 singularity/gwas.sif 11ac9e8fe69df07d650bd5e1e7cdeee5 singularity/hello.sif c78d57397471ee802d37837ca5f8b797 singularity/python3.sif e8f26b23a8b44f15f3dfff2b02623780 singularity/r.sif a3f1d8411e1e3cf8670551b7f334a58d singularity/saige.sif
Fixed
usecases/LDpred2/ldpred2.Rerror when sumstats contain characters in chromosome column.use
afterokspec instead ofafteranyin SLURM dependencies so that next steps of the pipeline don’t run if a previous step has failed (fix #26)use SLURM’s
cpus_per_task=1for SAIGE step2, because it doesn’t support –nThreads (see https://github.com/saigegit/SAIGE/issues/9)
Removed
removed
--geno-imputefromusecases/LDpred2/ldpred2.R. Functionality replaced by--geno-impute-zeroandusecases/LDpred2/imputeGenotypes.Rremoved misc. source/data files in /tools/* from container builds
removed unused
libquadmath0library from builds (affecting futuregwas.sif,hello.sif, andpython3.sifbuilds)the following command-line options are removed; instead, they can be specified via
config.yamlfile:--slurm-job-name,--slurm-account,--slurm-time,--slurm-cpus-per-task,--slurm-mem-per-cpu,--module-load,--comorment-folder,--singularity-bind. Note thatconfig.yamlfile is now required.gwas.py --analysis loci manh qqoptions as removed (fix #22)--bed-fit,--bed-test,--bgen-fit,--bgen-testoptions ofgwas.pyare removed; use new options--geno-fit-fileand--geno-fileinsteadremove
regenie.sifandregenie3.sif, because regenie software is also included ingwas.sifremove MiXeR package from
python3.sifcontainer, because MiXeR is now available as a separate container (https://github.com/comorment/mixer). This is also where you will find MiXeR’s use-cases.MAGMA, LAVA and ldblock software is moved to https://github.com/comorment/magma. MAGMA reference files are also moved to this repository.
enigma-cnv.sif and enigma-cnv.sif is moved to https://github.com/comorment/iPsychCNV enigma-cnv.sif is also available here: in https://github.com/ENIGMA-git/ENIGMA-CNV/tree/main/CNVCalling/containers
tryggve_query.sif is moved to https://github.com/comorment/Tryggve_psych
matlabruntime.sifcontainer is moved to https://github.com/comorment/matlabruntime. pleioFDR reference files are also moved to this repository.
[1.0.0] - 2020-10-20
Added
initial release of the following containers:
70502c11d662218181ac79a846a0937a enigma-cnv.sif 1ddd2831fcab99371a0ff61a8b2b0970 gwas.sif b02fe60c087ea83aaf1b5f8c14e71bdf hello.sif 1ab5d82cf9d03ee770b4539bda44a5ba ipsychcnv.sif 6d024aed591d8612e1cc628f97d889cc ldsc.sif 2e638d1acb584b42c6bab569676a92f8 matlabruntime.sif 331688fb4fb386aadaee90f443b50f8c python3.sif cdbfbddc9e5827ad9ef2ad8d346e6b82 r.sif b8c1727227dc07e3006c0c8070f4e22e regenie.sif 97f75a45a39f0a2b3d728f0b8e85a401 regenie3.sif 20e01618bfb4b0825ef8246c5a63aec5 saige.sif 5de579f750fb5633753bfda549822a32 tryggve_query.sif
Here is the list of tools available in prebuilt containers:
container
tool
version
hello.sif
demo example
gwas.sif
plink
v1.90b6.18 64-bit (16 Jun 2020)
gwas.sif
plink2
v2.00a2.3LM 64-bit Intel (24 Jan 2020)
gwas.sif
plink2_avx2
v2.00a2.3LM AVX2 Intel (24 Jan 2020)
gwas.sif
PRSice_linux
2.3.3 (2020-08-05)
gwas.sif
simu_linux
Version v0.9.4
gwas.sif
bolt
v2.3.5 March 20, 2021
gwas.sif
gcta64
version 1.93.2 beta Linux
gwas.sif
gctb
GCTB 2.02
gwas.sif
qctool
version: 2.0.6, revision 18b8f17
gwas.sif
king
KING 2.2.6 - ©
gwas.sif
metal
version released on 2011-03-25
gwas.sif
vcftools
VCFtools (0.1.17)
gwas.sif
bcftools
Version: 1.12 (using htslib 1.12)
gwas.sif
flashpca_x86-64
flashpca 2.0
gwas.sif
regenie
REGENIE v2.0.2.gz
gwas.sif
GWAMA
GWAMA_v2.2.2.zip
gwas.sif
magma
magma_v1.09a_static.zip
gwas.sif
shapeit2
Version : v2.r904
gwas.sif
impute4
impute4.1.2_r300.3
gwas.sif
minimac4
Version: 1.0.2; Built: Fri Sep 3 13:25:51
gwas.sif
bgenix
version: 1.1.7, revision
gwas.sif
cat-bgen
same version as bgenix
gwas.sif
edit-bgen
same version as bgenix
python3.sif
python3
python 3.10 + standard packages (numpy, pandas, etc)
python3.sif
ldpred
?
python3.sif
mixer
mixer v1.3
python3.sif
python_convert
github commit bcde562f0286f3ff271dbb54d486d4ca1d40ae36
r.sif
R
version 4.0.3 + standard packages (data.table, ggplot, etc)
r.sif
seqminer
?
r.sif
rareGWAMA
?
r.sif
GenomicSEM
?
r.sif
TwoSampleMR
?
r.sif
GSMR
v1.0.9
r.sif
LAVA
?
r.sif
LAVA partitioning
?
saige.sif
SAIGE
version 0.43
enigma-cnv.sif
PennCNV
version 1.0.5
ldsc.sif
LDSC
version 1.0.1
ipsychcnv.sif
???
missing Dockerfile
matlabruntime.sif
???
work in progress
regenie.sif
???
?
regenie3.sif
???
?