utter-project/EuroLLM-1.7B
Text Generation β’ Updated β’ 7.75k β’ 116
Leo Borai PRO
LeoBorai
AI & ML interests
π¦ Rust Software Engineer who enjoys messing around with Data Science and other Computer related topics.
Recent Activity
liked a model about 4 hours ago
utter-project/EuroLLM-1.7B liked a model about 11 hours ago
elte-nlp/Racka-4B updated a dataset about 17 hours ago
LeoBorai/chile-seismological-recordsOrganizations
liked a
model about 4 hours ago
liked a
model about 11 hours ago
updated a
dataset about 17 hours ago
liked 2
models 6 days ago
upvoted a changelog 21 days ago
Hugging Face Changelog
Filter Models page by Hardware
β’ 224
liked 2
models about 1 month ago
liked a
Space about 1 month ago
updated a
Space about 1 month ago
updated a
dataset about 1 month ago
liked a
model about 2 months ago
updated a
dataset about 2 months ago
liked a
model about 2 months ago
liked a
Space about 2 months ago
liked a
model about 2 months ago
reacted to OzTianlu's post with π₯ about 2 months ago
Post
6326
ResNet is Explicit Euler. GPT is Implicit Euler. What Else is Hiding in Plain Sight?
Read online: https://datawhalechina.github.io/learning-terrain/
I wrote an open-source monograph on learning dynamics β The Terrain of Learning. Bilingual (Chinese/English), 4 volumes, 12 chapters, 30+ print-grade figures. Completely free (CC BY-NC-SA 4.0).
The core argument: gradient descent is not optimization. It's terrain motion. The loss function is a landscape. The gradient is the direction of slope. The optimizer is how you choose each step. Once you see it this way, everything clicks:
ResNet = explicit Euler integration on a vector field. The residual branch is the vector field. Each layer takes one Euler step.
GPT autoregression = implicit-state Euler iteration. Stable where explicit Euler explodes. That's why transformers handle long-range dependencies.
DEQ = the Banach fixed-point theorem in production. The forward pass is root-finding. There are no layers to backprop through.
KL divergence = a Bregman divergence on the entropy landscape. Your belief space is curved, not flat.
Chain-of-thought reasoning = hidden states flowing along a reasoning field toward an attractor basin. Correct answers have wide basins. The number of reasoning steps is determined by the terrain, not by the problem.
Diffusion models = systems flowing downhill along a score vector field, from noise to structure, from high energy to low energy.
The book traces one idea across 337 years β from F=ma (Newton, 1687) to H=T+V (Hamilton, 1833) to loss landscape + gradient field (2020s). Hamilton replaced a catalog of forces with one geometric object. This book does the same for deep learning.
GitHub: https://github.com/datawhalechina/learning-terrain
Discussion: https://github.com/datawhalechina/learning-terrain/discussions/2
Convergence is not hope. Convergence is geometry. You see.
Read online: https://datawhalechina.github.io/learning-terrain/
I wrote an open-source monograph on learning dynamics β The Terrain of Learning. Bilingual (Chinese/English), 4 volumes, 12 chapters, 30+ print-grade figures. Completely free (CC BY-NC-SA 4.0).
The core argument: gradient descent is not optimization. It's terrain motion. The loss function is a landscape. The gradient is the direction of slope. The optimizer is how you choose each step. Once you see it this way, everything clicks:
ResNet = explicit Euler integration on a vector field. The residual branch is the vector field. Each layer takes one Euler step.
GPT autoregression = implicit-state Euler iteration. Stable where explicit Euler explodes. That's why transformers handle long-range dependencies.
DEQ = the Banach fixed-point theorem in production. The forward pass is root-finding. There are no layers to backprop through.
KL divergence = a Bregman divergence on the entropy landscape. Your belief space is curved, not flat.
Chain-of-thought reasoning = hidden states flowing along a reasoning field toward an attractor basin. Correct answers have wide basins. The number of reasoning steps is determined by the terrain, not by the problem.
Diffusion models = systems flowing downhill along a score vector field, from noise to structure, from high energy to low energy.
The book traces one idea across 337 years β from F=ma (Newton, 1687) to H=T+V (Hamilton, 1833) to loss landscape + gradient field (2020s). Hamilton replaced a catalog of forces with one geometric object. This book does the same for deep learning.
GitHub: https://github.com/datawhalechina/learning-terrain
Discussion: https://github.com/datawhalechina/learning-terrain/discussions/2
Convergence is not hope. Convergence is geometry. You see.
- 1 reply
updated a
Space about 2 months ago
liked 2
Spaces about 2 months ago