Atlas-Vision evaluation

Scores (stage 1 → stage 2)

Metric	Stage 1	Stage 2
Held-out instruct loss (lower is better)	2.2521	1.1271
POPE random: accuracy / F1 / yes-ratio	0.4997 / 0.2003 / 0.1257	0.5427 / 0.6856 / 0.9547
POPE popular: accuracy / F1 / yes-ratio	0.5027 / 0.2013 / 0.1227	0.522 / 0.676 / 0.9753
POPE adversarial: accuracy / F1 / yes-ratio	0.5023 / 0.2012 / 0.123	0.5137 / 0.6722 / 0.9837

Detailed descriptions

COCO_val2014_000000310196

Stage 1: a skier in the snow on a mountain
Stage 2: The image features a snowboarder wearing a red jacket, standing on top of a snowy hill. The person is in the process of skiing down the slope, with their skis visible beneath them. They are surrounded by a beautiful landscape that includes trees and mountains in the background.

There are several other people scattered throughout the scene, some closer to the foreground while others are further away. These individuals might be fellow snowboarders or skiers enjoying the winter sports activities together.

COCO_val2014_000000210789

Stage 1: a woman and her child in the rain
Stage 2: The image features a woman and a young girl standing in the rain, both holding umbrellas to protect themselves from getting wet. The woman is on the left side of the scene, while the little girl stands next to her on the right. They are positioned close together, with the woman's umbrella covering them both.

In the background, there are two cars parked behind them, one closer to the left edge of the frame and another further back towards the center. A handbag can be seen placed near the woman, possibly belonging to her or someone else present in the scene.

COCO_val2014_000000429109

Stage 1: a bus and several other vehicles parked in front of a building
Stage 2: The image depicts a busy city street with several buses and cars parked or driving along the road. There are three buses in total, one of which is a large red bus occupying most of the scene, while the other two are smaller and positioned closer to the right side of the image.

Numerous cars can be seen throughout the scene, some parked on the left side of the street and others driving down the road. A person is also visible near the center of the image, possibly waiting for public transportation or walking by.

In addition to the vehicles, there are traffic lights at various points along the street

COCO_val2014_000000211674

Stage 1: a bus with a red and white logo on it, carrying passengers
Stage 2: The image features a red double-decker bus driving down the street, with people on both levels of the bus. There are at least 12 passengers visible in the scene, some sitting and others standing, enjoying their ride. The bus is filled to capacity, indicating that it's a popular mode of transportation for these individuals.

In addition to the bus, there are two cars parked or moving along the street, one closer to the left side and another further back towards the right. A person can be seen walking near the center of the scene, possibly waiting to board the bus or simply passing by.

Questions in Nigerian languages (stage 2)

igbo — Kedu ihe dị na foto a? → The image features a person skiing down a snow-covered slope, with the skier wearing red pants.
yoruba — Kí ni ó wà nínú àwòrán yìí? → The image features a person skiing down a snow-covered slope, with the skier wearing red pants.
hausa — Me ke cikin wannan hoton? → In the image, a person is skiing down a snow-covered slope.

Text-only check (no image)

Question: Kedu ihe bụ positron? Kọwaa ya n'asụsụ Igbo.

Base N-ATLaS: Positron bụ eletrọn dị mma, ma ọ bụ antiparticle nke eletrọn. Ọ na-emegide eletrọn nkịtị site n'ịnwe mpempe ojii nwere otu ụgwọ ahụ mana ọdịiche dị na ntụziaka nke ụgwọ ha. Positrons na-ekere òkè dị mkpa na physics nuklia, ebe a na-emepụta ha mgbe ụfọdụ n'oge us
With stage-2 LoRA: Positron bụ akụkụ subatomic dị mma, nke a na-akpọkwa antiparticle nke electron. A na-eji okwu "positron" mee ka ọ pụta ìhè site n'aka physicist Paul Dirac na 1928. Positrons nwere njirimara yiri nke electrons, gụnyere ibu, ụgwọ, na spin, mana ha na-emegharịrị n'ihe gbasara mass na momentum. Mgbe positron na-ej