VLMEvalKit
/All repositories
Overview
HEALTH SCORE
Healthy*
Partial score (2/3 categories)
52out of 65
Solid maintainer coverage. Development cadence keeps the score from reaching Excellent. Security & Supply Chain is unavailable, so weights were redistributed.
LIFECYCLE
Active
Consistent commits, responsive maintainers, regular releases, and healthy issue triage.
Health breakdown
Healthy*(52/65)
Maintainer availability, known risks and supply chain posture, and whether the project is actively developed or appropriately stable.
Maintainer responsiveness
Median response time is 10 days.
Bus factor
9 active maintainers currently have merge rights.
Organization Diversity
Contributors span 199 organizations.
Project Achievements
LeaderboardsAbout
VLMEvalKit is an evaluation toolkit for large vision language models (VLMs) that provides standardized benchmarking and testing capabilities. It enables comprehensive assessment of VLM performance across multiple dimensions including visual understanding, reasoning, and multimodal capabilities.
First commit
Software value
$5.2M
Tags
chatgpt
claude
clip
computer-vision
evaluation
gemini
gpt
gpt-4v
gpt4
large-language-models
llava
llm
multi-modal
openai
openai-api
pytorch
qwen
vit
vqa
License(s)
Apache-2.0
Data sources
Git
GitHub