SPACE
Client Contribution Evaluator
A framework for evaluating contribution of individual clients in federated learning systems.
SPACE: Single-round Participant Amalgamation for Contribution Evaluation in Federated Learning
6 stars
1 watching
3 forks
Language: Python
last commit: over 1 year ago Related projects:
| Repository | Description | Stars |
|---|---|---|
 hkust-nlp/ceval | An evaluation suite providing multiple-choice questions for foundation models in various disciplines, with tools for assessing model performance. | 1,636 |
 pkunlp-icler/pca-eval | An open-source benchmark and evaluation tool for assessing multimodal large language models' performance in embodied decision-making tasks | 100 |
 chenllliang/mmevalpro | A benchmarking framework for evaluating Large Multimodal Models by providing rigorous metrics and an efficient evaluation pipeline. | 22 |
 mshukor/evalign-icl | Evaluating and improving large multimodal models through in-context learning | 20 |
 olical/conjure | An interactive environment for evaluating code within a running program. | 1,785 |
 ruixiangcui/agieval | Evaluates foundation models on human-centric tasks with diverse exams and question types | 708 |
 kentcdodds/preval.macro | A build-time code evaluation tool for JavaScript | 127 |
 1024pix/pix-editor | An online platform offering innovative evaluation and certification of digital skills | 5 |
 msracver/fcis | An implementation of a deep learning framework for instance-aware semantic segmentation | 1,566 |
 melodi-lab/divfl | Proposes a method for selecting a diverse subset of clients in federated learning to improve convergence and fairness | 29 |
 freedomintelligence/mllm-bench | Evaluates and compares the performance of multimodal large language models on various tasks | 55 |
 git-disl/scale-fl | An adaptive federated learning framework for heterogeneous clients with resource constraints. | 29 |
 cuis15/fcfl | An implementation of Fair and Consistent Federated Learning using Python. | 20 |
 gomate-community/rageval | An evaluation tool for Retrieval-augmented Generation methods | 132 |
 symbioticlab/oort | This repository provides scripts and instructions for reproducing experiments on efficient federated learning via guided participant selection | 124 |