Instructions to use ecloudtech/Erk-32B with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries

How to use ecloudtech/Erk-32B with Transformers:

# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("text-generation", model="ecloudtech/Erk-32B")
messages = [
    {"role": "user", "content": "Who are you?"},
]
pipe(messages)

# pip install -U transformers accelerate
# Load model directly
from transformers import AutoTokenizer, AutoModelForCausalLM

tokenizer = AutoTokenizer.from_pretrained("ecloudtech/Erk-32B")
model = AutoModelForCausalLM.from_pretrained("ecloudtech/Erk-32B", device_map="auto")
messages = [
    {"role": "user", "content": "Who are you?"},
]
inputs = tokenizer.apply_chat_template(
	messages,
	add_generation_prompt=True,
	tokenize=True,
	return_dict=True,
	return_tensors="pt",
).to(model.device)

outputs = model.generate(**inputs, max_new_tokens=256)
print(tokenizer.decode(outputs[0][inputs["input_ids"].shape[-1]:]))

Notebooks
Google Colab
Kaggle
Local Apps Settings

vLLM

How to use ecloudtech/Erk-32B with vLLM:

Install from pip and serve model

# Install vLLM from pip:
pip install vllm
# Start the vLLM server:
vllm serve "ecloudtech/Erk-32B"
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:8000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "ecloudtech/Erk-32B",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Use Docker

docker model run hf.co/ecloudtech/Erk-32B

SGLang

How to use ecloudtech/Erk-32B with SGLang:

Install from pip and serve model

# Install SGLang from pip:
pip install sglang
# Start the SGLang server:
python3 -m sglang.launch_server \
    --model-path "ecloudtech/Erk-32B" \
    --host 0.0.0.0 \
    --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "ecloudtech/Erk-32B",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Use Docker images

docker run --gpus all \
    --shm-size 32g \
    -p 30000:30000 \
    -v ~/.cache/huggingface:/root/.cache/huggingface \
    --env "HF_TOKEN=<secret>" \
    --ipc=host \
    lmsysorg/sglang:latest \
    python3 -m sglang.launch_server \
        --model-path "ecloudtech/Erk-32B" \
        --host 0.0.0.0 \
        --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "ecloudtech/Erk-32B",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Docker Model Runner
How to use ecloudtech/Erk-32B with Docker Model Runner:
```
docker model run hf.co/ecloudtech/Erk-32B
```

aigencydev commited on Sep 30

Commit

92880f3

verified ·

1 Parent(s): ce526fc

egitim/: v2 betikleri ve veri ozetleri

Browse files

Files changed (1) hide show

egitim/fineweb2_parca_sha256.txt +160 -0

egitim/fineweb2_parca_sha256.txt ADDED Viewed

	@@ -0,0 +1,160 @@

+5444a7375ea6f67f6f857daa77f1ac083710d45cdf47ec98056330d8704ba1c4  shard_00100.parquet
+6fee431edfc777b4dcc5f7fbe2a38c9c6bc210d7e982c83061446f3f06fb6aac  shard_00101.parquet
+76edb22f6a5d44b7c44fa4c4c09e169bfde5e061f914f37991a6cea359e70bea  shard_00102.parquet
+402e3e2562c617393c802c17c2af5c98e23f04c89d4839b8961b134929753d5b  shard_00103.parquet
+8d56cf0580b29159251c9cdfe1612be4e55b5312613a5eb86d9b8a2274aa25e7  shard_00104.parquet
+c557bae9137ba0ce727e565e680df33e164a9d09c99fe0aa40ea14fd2ef7a837  shard_00105.parquet
+fd29c8699cf422bb62f4c5d153809c68ab41e1580eb2bdbf1ac988f9e366c91c  shard_00106.parquet
+feeee59cacbc42f8ea2193525aabe2bcb7d4545f18acfb020d3bb56e024b3a41  shard_00107.parquet
+e349365b15851b2cc884bdb38ce67281a0b621ebe95d76eb56212eafa146e449  shard_00108.parquet
+c2c5fb9c00ff100bc4b3734e1ecf845846f6502d1d6c686bf9c091f9ac35f363  shard_00109.parquet
+4b231558559c75993ce9fb75a5146aedac51abf3c48271e20580162c33255c7e  shard_00110.parquet
+f73d382a0237a841bb4975b083320def9e38b543e41188cf56a284e8d03b9521  shard_00111.parquet
+39a7c528ea82fc2bd48ad25eadb3d2e64d116766e55f353ef182ce1e1b4a229b  shard_00112.parquet
+f9581d0f99b2973459b966aa98ad3dea40b4df5629a8ff250fc9523ca6b09e3f  shard_00113.parquet
+dd9665099b2a1ada5980081e3497a6ca135673bbf47724a744dd71eb67a50ba1  shard_00114.parquet
+8f04a95ebce3be4fa3679831963bd6d45c09b7e1d4fb42ce0342afe64c6e8974  shard_00115.parquet
+a72f78276ba16d457308366beb951b1682cb00311af442fc9a12c84b177c183e  shard_00116.parquet
+8d6da8c9a4aff4f3082cd583c5e3954a43c2bd16d29303df75ef95c16ec5c0c4  shard_00117.parquet
+ca636515a427e8743efffe1c094e3a6e28d4f7f3dfca57c4b0aa8a4b760995a5  shard_00118.parquet
+3f752b16f2917d89fdb7d20ed44584981f4e00ce8749bc0e5c65a4b9758597df  shard_00119.parquet
+9ed1138c9b527951bedc8ea399d30f5159012b1cc65e739ac0ed8b38fcca9d83  shard_00120.parquet
+b277f9ce0b8ccfcfee8cb8b4cdfd264c6fbe3940048aed1f84ccefe088810f26  shard_00121.parquet
+ff18a9a9270815f94f497141f2486ed11b7068c1b6e53cdfc9c4912060d5e6e7  shard_00122.parquet
+e587b30c25a4d17e022b0224ebac9bb6e6ce6b9e1560572725907c8307c2aac3  shard_00123.parquet
+6b4664a46d14b1db7d4ed8d803e46be3e0bad30b07757e876bed7bf9243a7273  shard_00124.parquet
+d0664605b629781d2beebc41fe37a879fd2cfa79509fe9ef2ff8a4f5142d1ead  shard_00125.parquet
+0e409a70909b3b7a08bd5779e95d3590f3f2ade26c0d836ad63ba6975557b0f4  shard_00126.parquet
+705a227685d4f7ced464d5851e998b5872684e6ae0e43a19d6d7ca636a3e7004  shard_00127.parquet
+ee71d99783c7ba4c5a5db06a5b1c2b020b38bd8cc5e1615d9468fbb5c87de394  shard_00128.parquet
+fd1f64e14666e112fc2cf4c33f0b7b46ad01084a8d8d9a8ae3e4449fdc1c86b9  shard_00129.parquet
+78287957f6e644493d0e224f11800dda9b11a73889c2ad8d005ff55e5548e38b  shard_00130.parquet
+aa3048738ce681cc4e25754fcb369556492b4fccda6fc15739de15f34875c6b3  shard_00131.parquet
+cc1b16c62d170f6c38d9325faa1c0d0359f8ed151078d9ddfa679a9f4dd14239  shard_00132.parquet
+5a5ea2ba67a990d0c1c89c97809fabcaa180c295fed86de9ea87d67f85096967  shard_00133.parquet
+bdd3291097cdc66b62cb0c90fb97ca667aff76cdf9292b30146dcd4d41e4d58b  shard_00134.parquet
+27e239fea6ef807e7a360bbfbb667014147c8cc669c69ae5f26317e614368206  shard_00135.parquet
+679c1f8e8443bad4ed0e83d75a02fd22622d59d1c2bb27cc9c052e88753e86c4  shard_00136.parquet
+0f024220e4b1fde1c7c2326d3f4b6f3669966350fd38882e62e3d6e8cb5584cb  shard_00137.parquet
+9c25300e499cda607dded4f768a3d31cd2458facad2960b826c6e382e4f384de  shard_00138.parquet
+8af21af9b8de6aabe9475a8214d57e5649f990910b9a3c7bc56c237e00529c0f  shard_00139.parquet
+0f276a5a205bf967f82795e4b7f6528efd0c11e0570b394f012ba4e3aab286f0  shard_00140.parquet
+9ebbd4d52aa398779724567fc69d85cc95d1b5531d1d01537a7e14518595ba50  shard_00141.parquet
+44b78177e2deb4320180eabac291a8d3490aa7e95de4e2c554dc3dc81deddc08  shard_00142.parquet
+07078d30bd87f24a8dce0ef7cc0bbacc09684da5d0d521461b2e976cac1e34a2  shard_00143.parquet
+865a55b16be5d9864670214fa43d1b60910d511d2ab58a64499d3a42d9ee4c34  shard_00144.parquet
+4a5fc54abe39efeaa2017aa9204fa5385ea0435f486e7790befeacac44ee88e5  shard_00145.parquet
+e2432aaf820b89a0d97fc9e638237d258be7834a68784be343d03f82aaaaa2d2  shard_00146.parquet
+b492df50a6bc8fde0595df7617b843ed614960d6e8cd12b774be10b019a5ee3c  shard_00147.parquet
+b19792d1395cdbdb67b87b2d71937013a0dc1bba1afb868c61cf8abcc5920fd4  shard_00148.parquet
+a602277bb362397c3f7c9b29fcca7c4c530d4df2bd6712190241f508fd7d6636  shard_00149.parquet
+394a35d3bdf4427e6799bbc7320b381a264d2f69efe18f780e31fb7c84e3ed48  shard_00150.parquet
+2c707b070c7cdf2f7850f7d581c83fe3a48a9ea82b55a17107f173a0f85ed453  shard_00151.parquet
+c6f385653c84d6429f5dee24ee6ba5d95b2c784d23573e99312d2bd52b969356  shard_00152.parquet
+f91857cd08e1ef6322a0da1d9c92bf710e075d54469ffda20465675ce3d57339  shard_00153.parquet
+7a3822ca8ba9b783b99cf8e718aa73c60707d90b7b71c6a12d53743b3843241f  shard_00154.parquet
+d288f0d6fa62320be234589af8636f8d2259b89375872689fd05c58d28893b2e  shard_00155.parquet
+5e14751d982363ddd276b694a82c3b0f206997321e7f392c10be13d5245fab9d  shard_00156.parquet
+2f77a8d3271e46feab109d08efd47577554174c4ec5f920a9b2ee8eb84560032  shard_00157.parquet
+e9fcaf4c66a491ba9360c102e732c3692477b7351bd81af3a9643242ec3f64ff  shard_00158.parquet
+4a65739b6fdd2408da9e888bf2380cb8218533d177522f6e13ffc83dbd517ff5  shard_00159.parquet
+b8d798588666d662c7decd9a7b7077b63a5323101f88b8f9732a1698e1f7a1d3  shard_00160.parquet
+d74d036da79148e9b3232af86bf5de81cf80f0d5fd6982fc78e682172380fdd1  shard_00161.parquet
+1778d556d5c988b1d60b3a696a1ef168cb2feee62c5cabeab672eaf942e5a78a  shard_00162.parquet
+bc6d6622ce315a371742273a1ad67c418a9ccd826899c672669f7e7c11a0b0e3  shard_00163.parquet
+acaae761c539230536f923fdd62bde1b8d53f768b987169a90388c6bca9ee7af  shard_00164.parquet
+695e34cb3bd84d04ef5d68639d1529702bfc9b8a742893f933aaf26382cb3a31  shard_00165.parquet
+1e0a2ee0c8bfa36f0adc6fe574579136f260cb1abca3053efb8cb944e59573de  shard_00166.parquet
+13cc58b239882c659501c13cf81056c7d171fe33263693bac737c21b6803442d  shard_00167.parquet
+08efa46ec3460bfcd54663e9cea8299074d30e55f9487987e088b0819350b696  shard_00168.parquet
+6507f1ffa4c1da117a2dd9d921d4d9c5d4ba3b9e7dff8dae6d40cfd6ec773857  shard_00169.parquet
+f693725b1961ce776fe9de9fe28fcdd6b78f0320cef3e92ed46219598b6ebd6d  shard_00170.parquet
+d24a879fe4f24f6c85c3809f8b1424406bc0f6e4c195245b060014881354a1f1  shard_00171.parquet
+bc3af41b3d21c0f7e7dd924046cb635c68f1c520e7f3a3816c17a46d6ef2be6c  shard_00172.parquet
+22a4c6a323224402bb726f01d893a0ae107c03709ca2f4908681b097cfad3df2  shard_00173.parquet
+6d9a2c41efa90a360f9b9e1fc0ee189e447d1c007343318128bcb8343fdc8b14  shard_00174.parquet
+e60d647c400d6fef0b574dce86c2510e626807e2f8562e4ad1f08a67685917cd  shard_00175.parquet
+dba6d934c0a65452c60d7d04f154a9b74c6327007784efc03507952c6178e0cf  shard_00176.parquet
+ae2436c9ba63d7279f17a5014288f580eabb75b80ddd2d63e606bead71ee86a3  shard_00177.parquet
+ef1ce77e565ec05efcbbe606d343dcb057a8f877ae9a567f53ba32922091032d  shard_00178.parquet
+947f7c83462957e574b290764dc46ffa679de17f79554c069539472d8c4b7eef  shard_00179.parquet
+720e0d8dd1821800d8b3cb0331083570f2f3d70d77886047acfc08a3501f6faa  shard_00180.parquet
+5a06cb226cf3741787cecd5092e73028c7378025a695b48a0f234f743bc5ed45  shard_00181.parquet
+c867a1274839969af433dabf150d94cf66ef30ffbbdedaf40b33f283ca6aa4fa  shard_00182.parquet
+a990e61336cc723f6cf2343c4feba10b561793eda89abf2e329cbaf9b2a7ff05  shard_00183.parquet
+c11bb0097304bcb718d450c91f5826ce815e5ebe91b96c0fa61c016f0b41869c  shard_00184.parquet
+7a1a350a46ecd6fe706ad111e8692dcf69a589c5025f7b1d0b8120040c83f44d  shard_00185.parquet
+bc39885a89fbcd578e9eadd3499d2c4f8f2059500bf82b274bdc71759f212820  shard_00186.parquet
+e4c9bafade268991e078c5e59df7b0274151f6fcdafb67b959e03be68eee9310  shard_00187.parquet
+d19fa11ee91151b1c93cd7669059de40f89ed0211b731de91374767d4c004a93  shard_00188.parquet
+97b5733e9d65df0e4a6128d9d1f73cb4a65b15db17bff23f81bb3773d8ca4519  shard_00189.parquet
+ac9282c5993a4b53fe9d0ac3e373a0c8724b8abdfbc9a869fad067f931434748  shard_00190.parquet
+63f1d886005f86a9b736ef679d8878fea94434fca454454438347619a39bacc8  shard_00191.parquet
+36188ed0b4e8caf228a8f083336a456d12171e93e9219e32d43d9d84516fc78a  shard_00192.parquet
+b367c2d7a8c909eccc02420f7e8ad9df0804b02a651699b238a3f4047e38b32a  shard_00193.parquet
+34a595b6fd8e0cee4747750d0e1e2b2535ded562a2fd52aa80d3468e597171b6  shard_00194.parquet
+2e471fbe9287f421eb783fcbd2911ebec264025bd03d5be4ce30aecfec631269  shard_00195.parquet
+6d03fb8eec348a991573c71b10570d3ff0db0518dfb6b2deaf46c3bbfa666163  shard_00196.parquet
+2b5855ad6edeec544634e830d971075fa24089d7750c486ac13c0167f647a284  shard_00197.parquet
+65be59dfff850ce4dbe114d17438330d551944be6f46f05bec691e02b9982afd  shard_00198.parquet
+89347b82fe0c7188425fd70d976e45e7981ce81c2a7b3d8e89b6a28d3a891b87  shard_00199.parquet
+0119bd692c26994bd2625079152f8d37c52a9f1ea4d4eea6ac73250820c8a335  shard_00200.parquet
+18855b09f514c61f01297216fd519b2a59bf57ee6ac6abb7339b8a492d2e3b9d  shard_00201.parquet
+bc915d62fae8677d6c9e5df1790377c0894b514fb5ca201cb0f6ae33309fed42  shard_00202.parquet
+a609335c616d9904fbb32f76d069cb36c724f48c45621e228660c169ef302f82  shard_00203.parquet
+6257dd2e89ad6940314830f1d4b9457bf28db85389089621ba4a25da870f1556  shard_00204.parquet
+0689f647aecc5a8107350025c8a21c939a36c9c3d78d13a789a591929d2eec06  shard_00205.parquet
+f62758f6c649c9d54e0d033f82bf5f1534f25b521befecd1858a7ed729ec50f3  shard_00206.parquet
+0c070395af3447d6a528453b23b90f5cb2fc4561ac305c9c2582aca29b976df8  shard_00207.parquet
+967b80cd5d0fdd51b25182eee6fa7732a72bcb836ae2689b7d17d288054f8a6b  shard_00208.parquet
+8d5159b2ade5bb57b6c37aa89321aea05b5f0fd05f9603cef8d4f5faa435081c  shard_00209.parquet
+5166adf7ecd6ba92656f7756d5f00a05f4eaaa74cb103948c7bf1af364cd0538  shard_00210.parquet
+e0bf46263c53eacb5d04d35d69d6ada88ffaf3b6002108298d09017d87d27473  shard_00211.parquet
+db4e9e28fdff5a552cf896eec500da17b0e37c76cb35caca02c841f90e423e57  shard_00212.parquet
+baea8b2304d5d9619a822dd3d8009f7df6cb3b0e743246392f4e75075b325a98  shard_00213.parquet
+0188fa699b8315a8cd9fc5cc7593ccb0416e71cb4c55e3ed4dbf5cdfbec1cd03  shard_00214.parquet
+da96803ccc95629d3ebba4f2a76573393cc18e5e85d5943c2cf22dd6b4542d8b  shard_00215.parquet
+ca8b617846175b2046062a6dad428893e24bb3262723bb57913355b2152826b2  shard_00216.parquet
+4c367cfb80eba90b0ae63b0cec9b1e706e14eb74c93626077e71314eac868906  shard_00217.parquet
+eb2a74c4cf876be00220781175963a20b03cc4e1f2390398ebda749d584c41e6  shard_00218.parquet
+b6a275e38e11d31289402d5dbf6c22819b0fc8b78ad6475c77d54ccf3e8f177f  shard_00219.parquet
+d98d5c87d804067762cc0b2ca6e2e403a228acf9a2e12fef4c0002cca57de1c8  shard_00220.parquet
+0de9dfd9435a04b5e62bce1d9c270e9a308798b226e909238c467db98b6b4022  shard_00221.parquet
+207ee0a9a349ebef1b5a9b0904986d0ffacf044295e249a52ef23cab06669923  shard_00222.parquet
+c8f84d5973f4203f7b5a88ca10dff7d4c7063aca459bbb0c0abae189246f719c  shard_00223.parquet
+7159f3e940ae57dd9eb6f1369d2aaf1d62fb36c5e0a7e3f65d6265c53e00a2d0  shard_00224.parquet
+ceff54d4e29586481eba0d8ae42edf45ca9370104d6d845c50f0466a2ecfb5dd  shard_00225.parquet
+871b6cdddfddd2b86755bcdf14c61fd13ad4b577dfb24517b2b1217a0dbe8d9d  shard_00226.parquet
+aada510be35ec6e53c57d61c91ddee8eb813d91339bb5e67c52c1a47fd5247a1  shard_00227.parquet
+a93d7ab6cb1f50fde12b8746d2f06e35f1a360e5677b5e7f6c566677e2b058f9  shard_00228.parquet
+367823f671f1cd82dafbfc17f3944781ff41f08a5ad07b07a4c1f983be7a0ede  shard_00229.parquet
+2d91d3fdaba120b949b9d24d1731e7f28e56d51d4dd4fb92c2c03553f01c45c8  shard_00230.parquet
+d737876bcb1b902d18ad70559f31dcf4d66dd5b2a5fe6ba20fdb645cf8742d0b  shard_00231.parquet
+a6a70de343d22242aaa96da5c06459c6259674791062e97fcad11bac2dab3a27  shard_00232.parquet
+68f3291dd25f73ae508f5cf19a2bd7481fd9f705b3a1b20a9a2dca04ac27c426  shard_00233.parquet
+54bcbd103839f131368acf39a7f362ac8b35252da5fb052de0cac422012d240d  shard_00234.parquet
+c6494b31b9a70210f9b8b53700305fbf3210ae84c9a4132faf3f64ddaa78572c  shard_00235.parquet
+ddad60d3ced405362639c8e577184f775d2c8650121603da912ef5846f7fa6dc  shard_00236.parquet
+bdce504ebc466f02d0397875602c2a9b9d86f9c441a0d4ed8863382e05aa0c0d  shard_00237.parquet
+c5fc9948a1109fc9ed1cf706c30fa04b1f8c862370f2de3aa34479bb94321454  shard_00238.parquet
+5792b2403c338db1f7bedb7786be5c4f9c8317e78b2dedefaa645437b0319d36  shard_00239.parquet
+cd0400f1fd710bc8d783629069650a7b139d04c0fdecdfea27a420983d55dd5e  shard_00240.parquet
+6df69b6ba413fda7f78a0b0854b6e4dd999415b787d4907f9f7e71c90630cbb6  shard_00241.parquet
+291220b920ce1757f9a5cd54b5badafcce2fd533a8cd5348eabb55bf86975c1f  shard_00242.parquet
+80ef163c3b561230431681f6757081fdf44a754c1d32782d65db7cda0bbd83dd  shard_00243.parquet
+5b4d0e789c4438f53ab14c955f2ccaa31e34c9aa867f7624434a1cbe3c10d2d9  shard_00244.parquet
+9f738fdb9fc9e8b881d289c5fb6c087175af4a18c36b998bb1e815c5b4f67062  shard_00245.parquet
+aff7593200cce7d9d5d4abe92b7b338f670d1036fd6e355d96ef6f86b2362154  shard_00246.parquet
+3c64db28279f18386b4617cb832f6acf049293ca171f7503d1b0bb2c2baf9950  shard_00247.parquet
+c0666feb5d374f377f4d917044044f9c770e936da07c3cfc9091676626531dde  shard_00248.parquet
+c1b03b9b773becf778e0310625039652b34f42bf1e3702dbde4c969bb2778460  shard_00249.parquet
+9e79f3dc852b2dfefd429fc2f28004cd7e3c8c621d0ea99a9017820bff62495a  shard_00250.parquet
+da76134aabde47d7486cb3696b5c9f1ad545ee0dbc1d99500b06e726498f8db2  shard_00251.parquet
+62ab7acc4bb0ca36957bce98b0dee6fc76fc2554651d5594044eb6d8e75cbb58  shard_00252.parquet
+c5d1a5354ce94e9ed97bec39ae079e2696a74a7146bfcfc809f60053b1e213a2  shard_00253.parquet
+6e90db70ce63f03b577909e2b302c50ccc7b1623fd38690b9fb051579cad6d99  shard_00254.parquet
+8cba9f037b0ba748aad79e21e6edd6b91d47aba208faeb88f829db3a4e3dfc93  shard_00255.parquet
+54ae505c26629754745a71b38a4d5e513b3b8bb350b02d1ad2d37777ca9c80ac  shard_00256.parquet
+8207fb093fc76b9544d265283ce138c52f8b15edd458decd5a5e530249de9668  shard_00257.parquet
+22015046d0052046e22dd18d2207a989218493863e2fafb054b591fb5abc8c91  shard_00258.parquet
+827806333dd22db3199c14117910abe24cb5992d0aeef2792cb63b831fc92720  shard_00259.parquet