salma-remyx/vqasynth_testing_evals_eval
Viewer • Updated • 5 • 18
Salma Mayorquin PRO
salma-remyx
AI & ML interests
None yet
Recent Activity
reacted to theirpost with 🔥 about 4 hours ago
I unblocked 15 improvements for VQASynth in a day!
VQASynth, the pipeline behind SpaceThinker-Qwen2.5VL-3B, SpaceLLaVA, and the SpaceThinker dataset, had a backlog spanning new annotation methods, curation pipelines, model integrations, and agent tools.
I scoped each item in a short design brief. In GitHub Actions, Outrider mapped them to the repo’s existing modules and interfaces, implemented the changes, added tests, ran the repo checks, and opened draft PRs.
The 15 PRs covered:
* object orientation and 3D bounding boxes
* SAM2 regional captioning and multi-view matching
* LLaMA-Mesh tokenization
* Qwen2.5-VL fine-tuning
* spatial-reasoning data generation
* CLIP, SigLIP, and LLM2CLIP backends
and more
The batch added 12,275 lines, nearly doubling the codebase.
SpatialAnnotator went from two tools to seven, creating combinatorially more possible annotation pipelines for each image.
Outrider handled the implementation, tests, and integration. At about $1 per branch, I spent my time reviewing 15 concrete changes, fixing what needed fixing, and deciding what to ship.
Outrider is open source!
Point it at a paper, issue, or design brief and review the PR: https://github.com/remyxai/outrider
Check out the updates on VQASynth: https://github.com/remyxai/VQASynth reacted to SoulInPsyAbstract's post with 🔥 about 4 hours ago
SIPA OS is a cognitive infrastructure ecosystem I've been building solo for 7 months — 8 apps, one login, built from inside ADHD/BPD/aphantasia, not designed around a diagnosis from outside.
sipa-os.org — the map. Focus (ADHD scaffolding), NeuroPower, AI chat, Shell (SSH terminal), Games, Community, Syntaxit (open M2M agent network), a pitch deck. All free-first — no paywall on the cognitive tools.
The more interesting part for this crowd: Syntaxit is where I've been running an anti-fabrication research thread with @dipankarsarkar — a k=20 resample benchmark on binary-SFT models (Hermes-3, Qwen2.5, DeepSeek-R1). Short version: our first benchmark said "20/20 refusals, 0/20 fabrications" for all three fine-tunes. Under adversarial review it turned out the scorer only checked if the first word was TRUE/FALSE, the token cap was hiding the real behavior, and a save-limit was silently deleting the evidence for our own follow-up claims. Corrected all of it publicly on the model cards rather than quietly fixing it. The current honest finding: both base and fine-tuned models confabulate readily once given room to finish — SFT didn't clearly help or hurt, the caps were just hiding it.
Full trail if you want to see how the sausage gets made, mistakes included: huggingface.co/datasets/SoulInPsyAbstract/sipa-os-governance
Not a pitch. $0 revenue, 10 people signed in. Built because the tools that existed assumed a brain that isn't mine, and because most benchmarks don't survive someone actually reading the file.
updated a model about 6 hours ago
remyxai/dora-factored-kernel-assetsOrganizations
