CRA5
Compression tool
A large compression model for weather and climate data
A large compression model for weather and climate data, which compresses a 400+ TB ERA5 dataset into a new 0.8 TB CRA5 dataset.
32 stars
3 watching
1 forks
Language: Python
last commit: almost 2 years agoauto-encoderdata-compressionera5numerical-weather-forecasting
Related projects:
| Repository | Description | Stars |
|---|---|---|
 nasa/nasaaccess | Generates gridded ascii tables of climate and weather data needed to drive hydrological models | 83 |
 ecmwfcode4earth/deepr | Project aimed at downscaling global climate data to higher resolutions using deep learning techniques. | 24 |
 zmlabe/icevarfigs | Tools and scripts for analyzing climate data and producing visualizations | 82 |
 tsherwen/ac_tools | A package of tools and functions for processing and analyzing atmospheric model output and observational data. | 14 |
 opencomputeproject/project-zipline | Develops a lossless data compression format suitable for cloud datasets | 282 |
 e3sm-project/e3sm_diags | A diagnostics package for climate models that integrates various diagnostic tools and observational datasets. | 43 |
 ropenspain/climaemet | An R package providing an interface to download climatic data from the Spanish Meteorological Agency's API for analysis and visualization. | 42 |
 songhan/deep-compression-alexnet | This project demonstrates a method to compress the size of a neural network model without sacrificing accuracy. | 661 |
 google-research/arco-era5 | A repository of instructions and data for reproducing the ERA5 climate dataset in cloud-optimized and analysis-ready formats. | 335 |
 atomicobject/heatshrink | A data compression library designed for efficient use in resource-constrained systems. | 1,334 |
 yuanchao-xu/hyfo | A package for data analysis and visualization in hydrology and climate forecasting, providing tools for processing and visualizing NetCDF files. | 15 |
 freva-clint/climatereconstructionai | A software framework for training and evaluating models to reconstruct missing values in climate data using a U-Net architecture with partial convolutions. | 78 |
 mikejohnson51/climater | A R package for retrieving gridded climate data by specifying geographic areas of interest | 184 |
 csyhuang/hn2016_falwa | Computes diagnostic metrics from climate data to analyze wave activity in the atmosphere. | 34 |
 anikfal/postwrf | Tools and scripts for visualizing and post-processing atmospheric model data from WRF and ERA5 sources. | 56 |