SPACE
Client Contribution Evaluator
A framework for evaluating contribution of individual clients in federated learning systems.
SPACE: Single-round Participant Amalgamation for Contribution Evaluation in Federated Learning
7 stars
1 watching
3 forks
Language: Python
last commit: over 3 years agoRelated projects:
| Repository | Description | Stars |
|---|---|---|
 hkust-nlp/ceval | An evaluation suite providing multiple-choice questions for foundation models in various disciplines, with tools for assessing model performance. | 1,650 |
 pkunlp-icler/pca-eval | An open-source benchmark and evaluation tool for assessing multimodal large language models' performance in embodied decision-making tasks | 99 |
 chenllliang/mmevalpro | A benchmarking framework for evaluating Large Multimodal Models by providing rigorous metrics and an efficient evaluation pipeline. | 22 |
 mshukor/evalign-icl | Evaluating and improving large multimodal models through in-context learning | 21 |
 olical/conjure | An interactive environment for evaluating code within a running program. | 1,806 |
 ruixiangcui/agieval | Evaluates foundation models on human-centric tasks with diverse exams and question types | 714 |
 kentcdodds/preval.macro | A build-time code evaluation tool for JavaScript | 127 |
 1024pix/pix-editor | An online platform offering innovative evaluation and certification of digital skills | 6 |
 msracver/fcis | An implementation of a fully convolutional instance-aware semantic segmentation framework using CUDA. | 1,567 |
 melodi-lab/divfl | Proposes a method for selecting a diverse subset of clients in federated learning to improve convergence and fairness | 29 |
 freedomintelligence/mllm-bench | Evaluates and compares the performance of multimodal large language models on various tasks | 56 |
 git-disl/scale-fl | An adaptive federated learning framework for heterogeneous clients with resource constraints. | 30 |
 cuis15/fcfl | An implementation of Fair and Consistent Federated Learning using Python. | 20 |
 gomate-community/rageval | An evaluation tool for Retrieval-augmented Generation methods | 141 |
 symbioticlab/oort | This repository provides scripts and instructions for reproducing experiments on efficient federated learning via guided participant selection | 126 |