ajskdlf64 commited on
Commit
46b4e23
·
1 Parent(s): bc8dd0d

add tokenizer

Browse files
Files changed (2) hide show
  1. added_tokens.json +1 -1
  2. tokenizer.json +0 -0
added_tokens.json CHANGED
@@ -1 +1 @@
1
- {"GE헬스케어": 32030, "휴마시스": 32003, "제주맥주": 32001, "큐라클": 32010, "휴온스바이오파마": 32028, "야놀자": 32017, "삼성정밀화학": 32014, "블루런벤처스": 32021, "마그나": 32019, "바이오젠": 32000, "맥스트": 32015, "비보": 32026, "웅진북센": 32006, "신한금융지주": 32020, "가우리안": 32013, "픽사": 32025, "핀다": 32027, "아이도트": 32012, "우드매킨지": 32008, "이그잭스": 32002, "끌림벤처스": 32018, "파미오": 32009, "D램익스체인지": 32024, "모더나": 32004, "우드맥킨지": 32007, "무신사": 32011, "카뱅": 32022, "보령컨슈머헬스케어": 32023, "한미글로벌": 32016, "삼성바이오로직스": 32005, "쏘카": 32029}
 
1
+ {"블루런벤처스": 32021, "끌림벤처스": 32018, "파미오": 32009, "아이도트": 32012, "GE헬스케어": 32030, "마그나": 32019, "신한금융지주": 32020, "우드매킨지": 32008, "핀다": 32027, "가우리안": 32013, "우드맥킨지": 32007, "맥스트": 32015, "이그잭스": 32002, "야놀자": 32017, "큐라클": 32010, "무신사": 32011, "삼성정밀화학": 32014, "삼성바이오로직스": 32005, "한미글로벌": 32016, "웅진북센": 32006, "카뱅": 32022, "휴온스바이오파마": 32028, "바이오젠": 32000, "픽사": 32025, "비보": 32026, "쏘카": 32029, "휴마시스": 32003, "제주맥주": 32001, "모더나": 32004, "D램익스체인지": 32024, "보령컨슈머헬스케어": 32023}
tokenizer.json CHANGED
The diff for this file is too large to render. See raw diff