Instructions to use AJKADZ/PHI_CODER with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- llama.cpp
How to use AJKADZ/PHI_CODER with llama.cpp:
Install (macOS, Linux)
curl -LsSf https://llama.app/install.sh | sh # Start a local OpenAI-compatible server with a web UI: llama serve -hf AJKADZ/PHI_CODER:Q4_K_M # Run inference directly in the terminal: llama cli -hf AJKADZ/PHI_CODER:Q4_K_M
Install from WinGet (Windows)
winget install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama serve -hf AJKADZ/PHI_CODER:Q4_K_M # Run inference directly in the terminal: llama cli -hf AJKADZ/PHI_CODER:Q4_K_M
Use pre-built binary
# Download pre-built binary from: # https://github.com/ggerganov/llama.cpp/releases # Start a local OpenAI-compatible server with a web UI: ./llama-server -hf AJKADZ/PHI_CODER:Q4_K_M # Run inference directly in the terminal: ./llama-cli -hf AJKADZ/PHI_CODER:Q4_K_M
Build from source code
git clone https://github.com/ggerganov/llama.cpp.git cd llama.cpp cmake -B build cmake --build build -j --target llama-server llama-cli # Start a local OpenAI-compatible server with a web UI: ./build/bin/llama-server -hf AJKADZ/PHI_CODER:Q4_K_M # Run inference directly in the terminal: ./build/bin/llama-cli -hf AJKADZ/PHI_CODER:Q4_K_M
Use Docker
docker model run hf.co/AJKADZ/PHI_CODER:Q4_K_M
- LM Studio
- Jan
- Ollama
How to use AJKADZ/PHI_CODER with Ollama:
ollama run hf.co/AJKADZ/PHI_CODER:Q4_K_M
- Unsloth Desktop
- Docker Model Runner
How to use AJKADZ/PHI_CODER with Docker Model Runner:
docker model run hf.co/AJKADZ/PHI_CODER:Q4_K_M
- Lemonade
How to use AJKADZ/PHI_CODER with Lemonade:
Pull the model
# Download Lemonade from https://lemonade-server.ai/ lemonade pull AJKADZ/PHI_CODER:Q4_K_M
Run and chat with the model
lemonade run user.PHI_CODER-Q4_K_M
List all available models
lemonade list
- Atomic Chat
Download phi-coder-hf/llama.cpp/tools/server/webui/src/App.tsx from AJKADZ/PHI_CODER: direct link, hf CLI and curl.
- Browser
- Download file 1.49 kB
-
https://huggingface.co/AJKADZ/PHI_CODER/resolve/main/phi-coder-hf/llama.cpp/tools/server/webui/src/App.tsx
- Command line
-
hf download hf://AJKADZ/PHI_CODER/phi-coder-hf/llama.cpp/tools/server/webui/src/App.tsx
-
curl -L -o App.tsx https://huggingface.co/AJKADZ/PHI_CODER/resolve/main/phi-coder-hf/llama.cpp/tools/server/webui/src/App.tsx
1.49 kB
| import { HashRouter, Outlet, Route, Routes } from 'react-router'; | |
| import Header from './components/Header'; | |
| import Sidebar from './components/Sidebar'; | |
| import { AppContextProvider, useAppContext } from './utils/app.context'; | |
| import ChatScreen from './components/ChatScreen'; | |
| import SettingDialog from './components/SettingDialog'; | |
| import { Toaster } from 'react-hot-toast'; | |
| import { ModalProvider } from './components/ModalProvider'; | |
| function App() { | |
| return ( | |
| <ModalProvider> | |
| <HashRouter> | |
| <div className="flex flex-row drawer lg:drawer-open"> | |
| <AppContextProvider> | |
| <Routes> | |
| <Route element={<AppLayout />}> | |
| <Route path="/chat/:convId" element={<ChatScreen />} /> | |
| <Route path="*" element={<ChatScreen />} /> | |
| </Route> | |
| </Routes> | |
| </AppContextProvider> | |
| </div> | |
| </HashRouter> | |
| </ModalProvider> | |
| ); | |
| } | |
| function AppLayout() { | |
| const { showSettings, setShowSettings } = useAppContext(); | |
| return ( | |
| <> | |
| <Sidebar /> | |
| <main | |
| className="drawer-content grow flex flex-col h-screen mx-auto px-4 overflow-auto bg-base-100" | |
| id="main-scroll" | |
| > | |
| <Header /> | |
| <Outlet /> | |
| </main> | |
| { | |
| <SettingDialog | |
| show={showSettings} | |
| onClose={() => setShowSettings(false)} | |
| /> | |
| } | |
| <Toaster /> | |
| </> | |
| ); | |
| } | |
| export default App; | |