Instructions to use anilsuthar2004/qwen-bot with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- llama.cpp
How to use anilsuthar2004/qwen-bot with llama.cpp:
Install (macOS, Linux)
curl -LsSf https://llama.app/install.sh | sh # Start a local OpenAI-compatible server with a web UI: llama serve -hf anilsuthar2004/qwen-bot # Run inference directly in the terminal: llama cli -hf anilsuthar2004/qwen-bot
Install from WinGet (Windows)
winget install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama serve -hf anilsuthar2004/qwen-bot # Run inference directly in the terminal: llama cli -hf anilsuthar2004/qwen-bot
Build from source code
git clone https://github.com/ggml-org/llama.cpp.git cd llama.cpp cmake -B build cmake --build build -j --target llama-app # Start a local OpenAI-compatible server with a web UI: ./build/bin/llama serve -hf anilsuthar2004/qwen-bot # Run inference directly in the terminal: ./build/bin/llama cli -hf anilsuthar2004/qwen-bot
Use Docker
docker model run hf.co/anilsuthar2004/qwen-bot
- Llama new
- LM Studio
- Jan
- Ollama
How to use anilsuthar2004/qwen-bot with Ollama:
ollama run hf.co/anilsuthar2004/qwen-bot
- Unsloth Desktop
- Docker Model Runner
How to use anilsuthar2004/qwen-bot with Docker Model Runner:
docker model run hf.co/anilsuthar2004/qwen-bot
- Lemonade
How to use anilsuthar2004/qwen-bot with Lemonade:
Pull the model
# Download Lemonade from https://lemonade-server.ai/ lemonade pull anilsuthar2004/qwen-bot
Run and chat with the model
lemonade run user.qwen-bot-{{QUANT_TAG}}List all available models
lemonade list
- Atomic Chat
File size: 6,598 Bytes
3bbe2d0 | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 93 94 95 96 97 98 99 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 | # CMAKE generated file: DO NOT EDIT!
# Generated by "Unix Makefiles" Generator, CMake Version 3.31
# Delete rule output on recipe failure.
.DELETE_ON_ERROR:
#=============================================================================
# Special targets provided by cmake.
# Disable implicit rules so canonical targets will work.
.SUFFIXES:
# Disable VCS-based implicit rules.
% : %,v
# Disable VCS-based implicit rules.
% : RCS/%
# Disable VCS-based implicit rules.
% : RCS/%,v
# Disable VCS-based implicit rules.
% : SCCS/s.%
# Disable VCS-based implicit rules.
% : s.%
.SUFFIXES: .hpux_make_needs_suffix_list
# Command-line flag to silence nested $(MAKE).
$(VERBOSE)MAKESILENT = -s
#Suppress display of executed commands.
$(VERBOSE).SILENT:
# A target that is always out of date.
cmake_force:
.PHONY : cmake_force
#=============================================================================
# Set environment variables for the build.
# The shell in which to execute make rules.
SHELL = /bin/sh
# The CMake executable.
CMAKE_COMMAND = /usr/local/lib/python3.13/dist-packages/cmake/data/bin/cmake
# The command to remove a file.
RM = /usr/local/lib/python3.13/dist-packages/cmake/data/bin/cmake -E rm -f
# Escaping for special characters.
EQUALS = =
# The top-level source directory on which CMake was run.
CMAKE_SOURCE_DIR = /kaggle/working/llama.cpp
# The top-level build directory on which CMake was run.
CMAKE_BINARY_DIR = /kaggle/working/llama.cpp/build
# Include any dependencies generated for this target.
include examples/eval-callback/CMakeFiles/llama-eval-callback.dir/depend.make
# Include any dependencies generated by the compiler for this target.
include examples/eval-callback/CMakeFiles/llama-eval-callback.dir/compiler_depend.make
# Include the progress variables for this target.
include examples/eval-callback/CMakeFiles/llama-eval-callback.dir/progress.make
# Include the compile flags for this target's objects.
include examples/eval-callback/CMakeFiles/llama-eval-callback.dir/flags.make
examples/eval-callback/CMakeFiles/llama-eval-callback.dir/codegen:
.PHONY : examples/eval-callback/CMakeFiles/llama-eval-callback.dir/codegen
examples/eval-callback/CMakeFiles/llama-eval-callback.dir/eval-callback.cpp.o: examples/eval-callback/CMakeFiles/llama-eval-callback.dir/flags.make
examples/eval-callback/CMakeFiles/llama-eval-callback.dir/eval-callback.cpp.o: /kaggle/working/llama.cpp/examples/eval-callback/eval-callback.cpp
examples/eval-callback/CMakeFiles/llama-eval-callback.dir/eval-callback.cpp.o: examples/eval-callback/CMakeFiles/llama-eval-callback.dir/compiler_depend.ts
@$(CMAKE_COMMAND) -E cmake_echo_color "--switch=$(COLOR)" --green --progress-dir=/kaggle/working/llama.cpp/build/CMakeFiles --progress-num=$(CMAKE_PROGRESS_1) "Building CXX object examples/eval-callback/CMakeFiles/llama-eval-callback.dir/eval-callback.cpp.o"
cd /kaggle/working/llama.cpp/build/examples/eval-callback && /usr/bin/c++ $(CXX_DEFINES) $(CXX_INCLUDES) $(CXX_FLAGS) -MD -MT examples/eval-callback/CMakeFiles/llama-eval-callback.dir/eval-callback.cpp.o -MF CMakeFiles/llama-eval-callback.dir/eval-callback.cpp.o.d -o CMakeFiles/llama-eval-callback.dir/eval-callback.cpp.o -c /kaggle/working/llama.cpp/examples/eval-callback/eval-callback.cpp
examples/eval-callback/CMakeFiles/llama-eval-callback.dir/eval-callback.cpp.i: cmake_force
@$(CMAKE_COMMAND) -E cmake_echo_color "--switch=$(COLOR)" --green "Preprocessing CXX source to CMakeFiles/llama-eval-callback.dir/eval-callback.cpp.i"
cd /kaggle/working/llama.cpp/build/examples/eval-callback && /usr/bin/c++ $(CXX_DEFINES) $(CXX_INCLUDES) $(CXX_FLAGS) -E /kaggle/working/llama.cpp/examples/eval-callback/eval-callback.cpp > CMakeFiles/llama-eval-callback.dir/eval-callback.cpp.i
examples/eval-callback/CMakeFiles/llama-eval-callback.dir/eval-callback.cpp.s: cmake_force
@$(CMAKE_COMMAND) -E cmake_echo_color "--switch=$(COLOR)" --green "Compiling CXX source to assembly CMakeFiles/llama-eval-callback.dir/eval-callback.cpp.s"
cd /kaggle/working/llama.cpp/build/examples/eval-callback && /usr/bin/c++ $(CXX_DEFINES) $(CXX_INCLUDES) $(CXX_FLAGS) -S /kaggle/working/llama.cpp/examples/eval-callback/eval-callback.cpp -o CMakeFiles/llama-eval-callback.dir/eval-callback.cpp.s
# Object files for target llama-eval-callback
llama__eval__callback_OBJECTS = \
"CMakeFiles/llama-eval-callback.dir/eval-callback.cpp.o"
# External object files for target llama-eval-callback
llama__eval__callback_EXTERNAL_OBJECTS =
bin/llama-eval-callback: examples/eval-callback/CMakeFiles/llama-eval-callback.dir/eval-callback.cpp.o
bin/llama-eval-callback: examples/eval-callback/CMakeFiles/llama-eval-callback.dir/build.make
bin/llama-eval-callback: examples/eval-callback/CMakeFiles/llama-eval-callback.dir/compiler_depend.ts
bin/llama-eval-callback: bin/libllama-common.so.0.5.0
bin/llama-eval-callback: bin/libllama.so.0.5.0
bin/llama-eval-callback: bin/libggml.so.0.25.3
bin/llama-eval-callback: bin/libggml-cpu.so.0.25.3
bin/llama-eval-callback: bin/libggml-base.so.0.25.3
bin/llama-eval-callback: common/libllama-common-base.a
bin/llama-eval-callback: examples/eval-callback/CMakeFiles/llama-eval-callback.dir/link.txt
@$(CMAKE_COMMAND) -E cmake_echo_color "--switch=$(COLOR)" --green --bold --progress-dir=/kaggle/working/llama.cpp/build/CMakeFiles --progress-num=$(CMAKE_PROGRESS_2) "Linking CXX executable ../../bin/llama-eval-callback"
cd /kaggle/working/llama.cpp/build/examples/eval-callback && $(CMAKE_COMMAND) -E cmake_link_script CMakeFiles/llama-eval-callback.dir/link.txt --verbose=$(VERBOSE)
# Rule to build all files generated by this target.
examples/eval-callback/CMakeFiles/llama-eval-callback.dir/build: bin/llama-eval-callback
.PHONY : examples/eval-callback/CMakeFiles/llama-eval-callback.dir/build
examples/eval-callback/CMakeFiles/llama-eval-callback.dir/clean:
cd /kaggle/working/llama.cpp/build/examples/eval-callback && $(CMAKE_COMMAND) -P CMakeFiles/llama-eval-callback.dir/cmake_clean.cmake
.PHONY : examples/eval-callback/CMakeFiles/llama-eval-callback.dir/clean
examples/eval-callback/CMakeFiles/llama-eval-callback.dir/depend:
cd /kaggle/working/llama.cpp/build && $(CMAKE_COMMAND) -E cmake_depends "Unix Makefiles" /kaggle/working/llama.cpp /kaggle/working/llama.cpp/examples/eval-callback /kaggle/working/llama.cpp/build /kaggle/working/llama.cpp/build/examples/eval-callback /kaggle/working/llama.cpp/build/examples/eval-callback/CMakeFiles/llama-eval-callback.dir/DependInfo.cmake "--color=$(COLOR)"
.PHONY : examples/eval-callback/CMakeFiles/llama-eval-callback.dir/depend
|