CRA5
Compression tool
A large compression model for weather and climate data
A large compression model for weather and climate data, which compresses a 400+ TB ERA5 dataset into a new 0.8 TB CRA5 dataset.
24 stars
2 watching
1 forks
Language: Python
last commit: about 1 month ago auto-encoderdata-compressionera5numerical-weather-forecasting
Related projects:
| Repository | Description | Stars |
|---|---|---|
 nasa/nasaaccess | Generates gridded ascii tables of climate and weather data needed to drive hydrological models | 82 |
 ecmwfcode4earth/deepr | Project aimed at downscaling global climate data to higher resolutions using deep learning techniques. | 22 |
 zmlabe/icevarfigs | Tools and scripts for analyzing climate data and producing visualizations | 82 |
 tsherwen/ac_tools | A package of tools and functions for processing and analyzing atmospheric model output and observational data. | 13 |
 opencomputeproject/project-zipline | Develops a lossless data compression format suitable for cloud datasets | 281 |
 e3sm-project/e3sm_diags | Provides diagnostic tools and analysis methods for climate models | 41 |
 ropenspain/climaemet | An R package providing an interface to download climatic data from the Spanish Meteorological Agency's API for analysis and visualization. | 42 |
 songhan/deep-compression-alexnet | This project demonstrates a method to compress the size of a neural network model without sacrificing accuracy. | 657 |
 google-research/arco-era5 | A repository of instructions and data for reproducing the ERA5 climate dataset in cloud-optimized and analysis-ready formats. | 307 |
 atomicobject/heatshrink | A data compression library designed for efficient use in resource-constrained systems. | 1,333 |
 yuanchao-xu/hyfo | A package for data analysis and visualization in hydrology and climate forecasting, providing tools for processing and visualizing NetCDF files. | 15 |
 freva-clint/climatereconstructionai | A software framework for training and evaluating models to reconstruct missing values in climate data using a U-Net architecture with partial convolutions. | 71 |
 mikejohnson51/climater | Provides tools and methods to access geospatial climate data from various datasets | 180 |
 csyhuang/hn2016_falwa | Computes diagnostic metrics from climate data to analyze wave activity in the atmosphere. | 34 |
 anikfal/postwrf | Tools and scripts for visualizing and post-processing atmospheric model data from WRF and ERA5 sources. | 54 |