blog.roboflow.com2023-10-10about the llava 1.5 familyHN 3 pts · 0 comments1,145 words
Released in October 2023, LLaVA-1.5 accepts image and text input and can be trained on a single 8-A100 GPU node. The model returns object coordinates for zero-shot detection and answers visual questions about scene anomalies and coin denominations but struggles with OCR on real-world images like tire serial numbers, an area where GPT-4V performs better. No current multi-modal model handles the full range of computer vision tasks reliably.written, reviewed, cited
- The model enters an infinite loop when processing the word 'repeat' during text extraction tasks.
- LLaVA-1.5 fails to sum the value of four coins even after correctly identifying their individual denominations.
- Training the model requires only a single 8-A100 GPU node, making it feasible for smaller infrastructure.
llava.hliu.cc2023-10-18about the llava 1.5 familyHN 1 pts · 0 comments