Instructions to use koncsik/code-identifier-classifier with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers.js
How to use koncsik/code-identifier-classifier with Transformers.js:
// npm i @huggingface/transformers import { pipeline } from '@huggingface/transformers'; // Allocate pipeline const pipe = await pipeline('token-classification', 'koncsik/code-identifier-classifier');
|
Download README.md from koncsik/code-identifier-classifier: direct link, hf CLI and curl.
- Browser
- Download file 972 Bytes
-
https://huggingface.co/koncsik/code-identifier-classifier/resolve/main/README.md
- Command line
-
hf download hf://koncsik/code-identifier-classifier/README.md
-
curl -L -H "Authorization: Bearer $HF_TOKEN" -o README.md https://huggingface.co/koncsik/code-identifier-classifier/resolve/main/README.md
972 Bytes
metadata
license: apache-2.0
base_model: microsoft/unixcoder-base
library_name: transformers.js
pipeline_tag: token-classification
tags:
- onnx
- token-classification
- code
Code identifier classifier
Token classifier that tells, for every identifier in a code snippet, whether it
is the project's own name (OWN) or a library/framework name (LIB)
(BIO tags B-OWN I-OWN B-LIB I-LIB O). Used by the Redacto browser extension
to rename a pasted snippet's own identifiers and keep library names readable.
- Base model: microsoft/unixcoder-base (Apache-2.0)
- Format: int8-quantized ONNX (
onnx/model_quantized.onnx) - Training pipeline: https://github.com/BenKoncsik/pii-guardrail-browser-extension/tree/main/tools/identifier-classifier
- Labels: derived automatically from open-source C# and TypeScript projects (Roslyn / TypeScript checker resolution), split by repository.