์ฟ ํ‚ค๋ฅผ ์‚ฌ์šฉํ•ฉ๋‹ˆ๋‹ค. ์ฟ ํ‚ค์™€ ๋ธŒ๋ผ์šฐ์ € ์ €์žฅ์†Œ๋Š” ๋กœ๊ทธ์ธ ์ƒํƒœ๋ฅผ ์œ ์ง€ํ•˜๊ณ  ํ™˜๊ฒฝ์„ค์ •์„ ๊ธฐ์–ตํ•ฉ๋‹ˆ๋‹ค. ๋™์˜ํ•˜์‹œ๋ฉด ์‚ฌ์ดํŠธ ์ด์šฉ ๋ฐฉ์‹๋„ ์ธก์ •ํ•ฉ๋‹ˆ๋‹ค. ์–ธ์ œ๋“ ์ง€ ํ•  ์ˆ˜ ์žˆ์Šต๋‹ˆ๋‹ค. ์ž์„ธํ•œ ๋‚ด์šฉ์€ ์ฟ ํ‚ค ์ •์ฑ…์„ ์ฐธ๊ณ ํ•˜์„ธ์š”.

TheDrummer: UnslopNemo 12B

thedrummer/unslopnemo-12b
ํ…์ŠคํŠธ์ž…๋ ฅ: text1M2024. 11. 8. ์ถ”๊ฐ€๋จ

์ง€๊ธˆ TheDrummer: UnslopNemo 12B ์‚ฌ์šฉํ•ด ๋ณด๊ธฐ

์œ„ ๊ฐ€๊ฒฉ์œผ๋กœ ์ž”์•ก์—์„œ ์ฐจ๊ฐ๋ฉ๋‹ˆ๋‹ค. ์ƒˆ ๊ณ„์ •์€ ๋ฌด๋ฃŒ ์‚ฌ์šฉ๋Ÿ‰์œผ๋กœ ์‹œ์ž‘ํ•ฉ๋‹ˆ๋‹ค.

ํ•˜๋‚˜์˜ API. ๋ชจ๋“  ๋ชจ๋ธ.

์˜ค๋Š˜ ๋ฌด๋ฃŒ ๋ฉ”์‹œ์ง€ 5๊ฐœ ์ค‘ 5๊ฐœ ๋‚จ์Œ, ๋ฌด๋ฃŒ ๊ณ„์ •์„ ๋งŒ๋“ค๋ฉด ๋ฌด๋ฃŒ ์‚ฌ์šฉ๋Ÿ‰๊ณผ API ํ‚ค๊ฐ€ ์ถ”๊ฐ€๋ฉ๋‹ˆ๋‹ค.๋ฌด๋ฃŒ ๊ณ„์ • ๋งŒ๋“ค๊ธฐ๋กœ๊ทธ์ธ

์„ธ์…˜ ๋น„์šฉ US$0.00

TheDrummer: UnslopNemo 12B ํ•œ๋ˆˆ์— ๋ณด๊ธฐ

  • ์ž…๋ ฅ ๊ฐ€๊ฒฉ์ด ํ…์ŠคํŠธ ๋ชจ๋ธ 434๊ฐœ์˜ ์ค‘์•™๊ฐ’๋ณด๋‹ค 11% ๋‚ฎ์Šต๋‹ˆ๋‹ค.
  • 1,024,000 ํ† ํฐ์˜ ์ปจํ…์ŠคํŠธ ์œˆ๋„์šฐ, ๊ธด ๋ฌธ์„œ์™€ ๋ฉ€ํ‹ฐํ„ด ๋Œ€ํ™”์— ์ถฉ๋ถ„ํ•ฉ๋‹ˆ๋‹ค.
  • ์Šคํ‚ค๋งˆ ๊ธฐ๋ฐ˜ ๊ตฌ์กฐํ™”๋œ JSON ์ถœ๋ ฅ์„ ์ง€์›ํ•ฉ๋‹ˆ๋‹ค.
  • ์ผ๋ฐ˜์ ์ธ ์š”์ฒญ(์ž…๋ ฅ 1,000 / ์ถœ๋ ฅ 500 ํ† ํฐ)์˜ ๋น„์šฉ์€ ์•ฝ US$0.00210์ž…๋‹ˆ๋‹ค.

TheDrummer: UnslopNemo 12B ์†Œ๊ฐœ

TheDrummer: UnslopNemo 12B๋Š” Rocinante์˜ ์ œ์ž‘์ž์ธ TheDrummer์˜ ํ…์ŠคํŠธ ๋ชจ๋ธ์ž…๋‹ˆ๋‹ค. ์ œ๊ณต์—…์ฒด๊ฐ€ 2024-11-08์— ์ถœ์‹œํ–ˆ์œผ๋ฉฐ, ์ œ๊ณต์—…์ฒด ์„ค๋ช…์—์„œ๋Š” UnslopNemo v4.1๋กœ ์†Œ๊ฐœํ•ฉ๋‹ˆ๋‹ค. ํ•ด๋‹น ๋ผ์ธ์˜ ์ตœ์‹  ์ถ”๊ฐ€ ๋ชจ๋ธ๋กœ, ๋ชจํ—˜ ๊ธ€์“ฐ๊ธฐ์™€ ์—ญํ• ๊ทน ์‹œ๋‚˜๋ฆฌ์˜ค๋ฅผ ์œ„ํ•ด ์„ค๊ณ„๋˜์—ˆ์Šต๋‹ˆ๋‹ค. ํ…์ŠคํŠธ ์นดํ…Œ๊ณ ๋ฆฌ์— ์†ํ•˜๋ฏ€๋กœ ์ด๋ฏธ์ง€, ์˜ค๋””์˜ค ๋˜๋Š” ๊ธฐํƒ€ ๋ชจ๋‹ฌ๋ฆฌํ‹ฐ๊ฐ€ ์•„๋‹ˆ๋ผ ์–ธ์–ด ์ž‘์—…์„ ๋Œ€์ƒ์œผ๋กœ ํ•ฉ๋‹ˆ๋‹ค.

์ž…๋ ฅ ์ธก๋ฉด์—์„œ ์ด ๋ชจ๋ธ์€ ํ…์ŠคํŠธ๋งŒ ๋ฐ›์•„๋“ค์ด๊ณ  ํ…์ŠคํŠธ๋งŒ ์ƒ์„ฑํ•ฉ๋‹ˆ๋‹ค. ์ปจํ…์ŠคํŠธ ์œˆ๋„๋Š” 1,024,000 ํ† ํฐ์œผ๋กœ ๋งค์šฐ ํฌ๋ฉฐ, ๊ธด ์›๊ณ , ํ™•์žฅ๋œ ์ฑ„ํŒ… ๊ธฐ๋ก ๋˜๋Š” ํฐ ์ฐธ์กฐ ๋ฌธ์„œ๋ฅผ ๋‹จ์ผ ์š”์ฒญ์— ์œ ์ง€ํ•  ์ˆ˜ ์žˆ์Šต๋‹ˆ๋‹ค. ์ตœ๋Œ€ ์ถœ๋ ฅ์€ 819,200 ํ† ํฐ์ด๋ฏ€๋กœ ํ•ด๋‹น ์œˆ๋„ ์•ˆ์—์„œ ๊ธด ์ƒ์„ฑ์ด ๊ฐ€๋Šฅํ•ฉ๋‹ˆ๋‹ค. ์ง€์‹ ์ปท์˜คํ”„๋Š” 2024-04-30์ด๋ฏ€๋กœ, ์ž‘์—…์ด ๊ทธ ๋‚ ์งœ ์ดํ›„์˜ ์‚ฌ๊ฑด์— ์˜์กดํ•œ๋‹ค๋ฉด ์ค‘์š”ํ•ฉ๋‹ˆ๋‹ค. ์ง€์›๋˜๋Š” ์š”์ฒญ ๋งค๊ฐœ๋ณ€์ˆ˜์—๋Š” frequency_penalty, logit_bias, logprobs, max_tokens, presence_penalty, repetition_penalty, seed, stop, structured_outputs, temperature, top_k, top_logprobs ๋ฐ top_p๊ฐ€ ํฌํ•จ๋ฉ๋‹ˆ๋‹ค.

๋ชจํ—˜ ๊ธ€์“ฐ๊ธฐ์™€ ์—ญํ• ๊ทน์— ๋Œ€ํ•œ ๋ช…์‹œ๋œ ์ดˆ์ ์€ ์ด ๋ชจ๋ธ์ด ๊ฐ€์žฅ ์ž˜ ๋งž๋Š” ์šฉ๋„๋ฅผ ์‹œ์‚ฌํ•ฉ๋‹ˆ๋‹ค. ์ธํ„ฐ๋ž™ํ‹ฐ๋ธŒ ํ”ฝ์…˜๊ณผ ํ…์ŠคํŠธ ์–ด๋“œ๋ฒค์ฒ˜๋Š” ์ž์—ฐ์Šค๋Ÿฌ์šด ์กฐํ•ฉ์ž…๋‹ˆ๋‹ค. ๋ชจ๋ธ์ด ๊ธด ์‹œ๋‚˜๋ฆฌ์˜ค๋ฅผ ๊ณ„์† ์ง„ํ–‰ํ•˜๊ณ  ์บ๋ฆญํ„ฐ์— ๋งž๊ฒŒ ์‘๋‹ตํ•  ์ˆ˜ ์žˆ๊ธฐ ๋•Œ๋ฌธ์ž…๋‹ˆ๋‹ค. ๋ฐฉ๋Œ€ํ•œ ๋ฐฐ๊ฒฝ ์ด์•ผ๊ธฐ๋ฅผ ๊ฐ€์ง„ ์ง€์†์ ์ธ ์บ๋ฆญํ„ฐ๋ฅผ ํฌํ•จํ•œ ์—ญํ• ๊ทน ์ฑ„ํŒ…์€ ํฐ ์ปจํ…์ŠคํŠธ ์œˆ๋„์˜ ์ด์ ์„ ๋ฐ›์Šต๋‹ˆ๋‹ค. ์ด์ „ ํ„ด๊ณผ ์„ค์ • ๋ฉ”๋ชจ๋ฅผ ํ”„๋กฌํ”„ํŠธ์— ์œ ์ง€ํ•  ์ˆ˜ ์žˆ๊ธฐ ๋•Œ๋ฌธ์ž…๋‹ˆ๋‹ค. ์—ฐ์žฌ ์ด์•ผ๊ธฐ๋‚˜ ์บ ํŽ˜์ธ ์ž๋ฃŒ ๊ฐ™์€ ์žฅํŽธ ์ฐฝ์ž‘ ๊ธ€์“ฐ๊ธฐ๋„ ํ•ฉ๋ฆฌ์ ์ธ ์šฉ๋„์ž…๋‹ˆ๋‹ค. ์ƒ˜ํ”Œ๋ง ๋งค๊ฐœ๋ณ€์ˆ˜๋Š” ์–ด์กฐ์™€ ๋ฐ˜๋ณต์„ ์ œ์–ดํ•  ์ˆ˜ ์žˆ๊ฒŒ ํ•ด ์ฃผ๋ฏ€๋กœ, ์บ๋ฆญํ„ฐ๋‚˜ ๋‚ด๋ ˆ์ดํ„ฐ์˜ ๋ชฉ์†Œ๋ฆฌ๋ฅผ ๊ธด ์„ธ์…˜ ๋™์•ˆ ์ผ๊ด€๋˜๊ฒŒ ์œ ์ง€ํ•ด์•ผ ํ•  ๋•Œ ๋„์›€์ด ๋ฉ๋‹ˆ๋‹ค. ๊ธฐ๊ณ„๊ฐ€ ์ฝ์„ ์ˆ˜ ์žˆ๋Š” ์‘๋‹ต์„ ์›ํ•˜๊ฑฐ๋‚˜ ๋ชจ๋ธ์ด ๊ฐ ๋‹จ๊ณ„์—์„œ ์–ผ๋งˆ๋‚˜ ํ™•์‹ ํ–ˆ๋Š”์ง€ ๊ฒ€์‚ฌํ•˜๋ ค๋Š” ๊ฒฝ์šฐ structured_outputs์™€ logprobs๋ฅผ ์‚ฌ์šฉํ•  ์ˆ˜ ์žˆ์Šต๋‹ˆ๋‹ค.

๋ชจ๋ธ id "thedrummer/unslopnemo-12b"๋ฅผ ์‚ฌ์šฉํ•ด api14์˜ OpenAI ํ˜ธํ™˜ API๋ฅผ ํ†ตํ•ด ์ด ๋ชจ๋ธ์„ ํ˜ธ์ถœํ•ฉ๋‹ˆ๋‹ค. ์ธํ„ฐํŽ˜์ด์Šค๊ฐ€ OpenAI chat completions ํ˜•ํƒœ๋ฅผ ๋”ฐ๋ฅด๋ฏ€๋กœ, ๊ธฐ์กด OpenAI ํด๋ผ์ด์–ธํŠธ๋ฅผ api14 ๊ธฐ๋ณธ URL๋กœ ์ง€์ •ํ•˜๊ณ  model ํ•„๋“œ์— ํ•ด๋‹น id๋ฅผ ์ „๋‹ฌํ•  ์ˆ˜ ์žˆ์Šต๋‹ˆ๋‹ค. ์œ„์— ๋‚˜์—ด๋œ ์š”์ฒญ ๋งค๊ฐœ๋ณ€์ˆ˜๊ฐ€ ์ง€์›๋˜๋ฏ€๋กœ ํ•„์š”์— ๋”ฐ๋ผ temperature, top_p, top_k, repetition_penalty, presence_penalty, frequency_penalty, max_tokens, stop, seed, logit_bias, logprobs, top_logprobs ๋ฐ structured_outputs๋ฅผ ์„ค์ •ํ•  ์ˆ˜ ์žˆ์Šต๋‹ˆ๋‹ค. seed ๋งค๊ฐœ๋ณ€์ˆ˜๋Š” ํ…Œ์ŠคํŠธ ์ค‘ ์žฌํ˜„ ๊ฐ€๋Šฅํ•œ ์ƒ˜ํ”Œ๋ง์„ ์›ํ•  ๋•Œ ์œ ์šฉํ•ฉ๋‹ˆ๋‹ค.

์ง€์‹ ์ปท์˜คํ”„๋ฅผ ์—ผ๋‘์— ๋‘์‹ญ์‹œ์˜ค. 2024-04-30 ์ดํ›„์˜ ๋‚ด์šฉ์€ ๋ชจ๋ธ์ด ํ•™์Šตํ•œ ๋ฒ”์œ„ ๋ฐ–์ด๋ฏ€๋กœ, ์ตœ์‹  ์ •๋ณด์— ์˜์กดํ•˜๋Š” ์ž‘์—…์—๋Š” ๋‹ค๋ฅธ ์ ‘๊ทผ ๋ฐฉ์‹์ด ํ•„์š”ํ•  ์ˆ˜ ์žˆ์Šต๋‹ˆ๋‹ค. ์ด ๋ชจ๋ธ์€ ํ…์ŠคํŠธ ์ „์šฉ์ด๋ฏ€๋กœ, ์• ํ”Œ๋ฆฌ์ผ€์ด์…˜์ด ์ด๋ฏธ์ง€๋‚˜ ์˜ค๋””์˜ค๋ฅผ ์ฒ˜๋ฆฌํ•ด์•ผ ํ•œ๋‹ค๋ฉด ๋‹ค๋ฅธ ๋ชจ๋ธ์ด ๋” ์ ํ•ฉํ•ฉ๋‹ˆ๋‹ค. ํ…์ŠคํŠธ ์ƒ์„ฑ, ์—ญํ• ๊ทน ๋ฐ ์žฅ๋ฌธ ์ปจํ…์ŠคํŠธ ๊ธ€์“ฐ๊ธฐ ์ž‘์—…์—๋Š” ์‹œ๋„ํ•ด ๋ณผ ์ˆ˜ ์žˆ๋Š” ๊ฐ„๋‹จํ•œ ์˜ต์…˜์ž…๋‹ˆ๋‹ค.

TheDrummer: UnslopNemo 12B API ํ˜ธ์ถœ ๋ฐฉ๋ฒ•

  1. ๋Œ€์‹œ๋ณด๋“œ์—์„œ API ํ‚ค๋ฅผ ๋งŒ๋“œ์„ธ์š”.
  2. ์‚ฌ์šฉํ•˜๋Š” ์–ธ์–ด์˜ ๊ณต์‹ openai SDK๋ฅผ ์„ค์น˜ํ•˜์„ธ์š”.
  3. baseURL์„ https://api14.com/api/v1๋กœ, model์„ "thedrummer/unslopnemo-12b"๋กœ ์„ค์ •ํ•˜์„ธ์š”.
import OpenAI from "openai";

const client = new OpenAI({
  baseURL: "https://api14.com/api/v1",
  apiKey: process.env.API14_API_KEY,
});

const result = await client.chat.completions.create({
  "model": "thedrummer/unslopnemo-12b",
  "messages": [
    {
      "role": "user",
      "content": "Explain vector databases in two sentences."
    }
  ]
});
console.log(result.choices[0].message.content);

์ง€์› ํŒŒ๋ผ๋ฏธํ„ฐ

frequency_penaltylogit_biaslogprobsmax_tokenspresence_penaltyrepetition_penaltyseedstopstructured_outputstemperaturetop_ktop_logprobstop_p

์‚ฌ์–‘

์ปจํ…์ŠคํŠธ ๊ธธ์ด
1,024,000
์ตœ๋Œ€ ์ถœ๋ ฅ
819,200
์ž…๋ ฅ
text
์ถœ๋ ฅ
text
์ง€์‹ ๊ธฐ์ค€์ผ
2024-04-30

api14 ์š”์ฒญ ์ˆ˜ ยท ์ตœ๊ทผ 7์ผ

10-1710-1810-1910-2010-2110-2210-23

TheDrummer: UnslopNemo 12B: ์ž์ฃผ ๋ฌป๋Š” ์งˆ๋ฌธ

TheDrummer: UnslopNemo 12B API ๋น„์šฉ์€ ์–ผ๋งˆ์ธ๊ฐ€์š”?
TheDrummer: UnslopNemo 12B์˜ ๊ฐ€๊ฒฉ์€ ์ž…๋ ฅ US$1.40 / 100๋งŒ ํ† ํฐ์ž…๋‹ˆ๋‹ค. ์„ฑ๊ณตํ•œ ์š”์ฒญ์— ๋Œ€ํ•ด์„œ๋งŒ USD ์ž”์•ก์—์„œ ์ฐจ๊ฐ๋˜๋ฉฐ, ์‹คํŒจํ•œ ์š”์ฒญ์€ ๋ฌด๋ฃŒ์ž…๋‹ˆ๋‹ค.
TheDrummer: UnslopNemo 12B์˜ ์ปจํ…์ŠคํŠธ ์œˆ๋„์šฐ๋Š” ์–ผ๋งˆ์ธ๊ฐ€์š”?
TheDrummer: UnslopNemo 12B๋Š”(์€) ์š”์ฒญ๋‹น ์ตœ๋Œ€ 1,024,000 ํ† ํฐ์„ ์ฝ์Šต๋‹ˆ๋‹ค, ํ”„๋กฌํ”„ํŠธ, ๋Œ€ํ™” ๊ธฐ๋ก, ๋ฌธ์„œ๋ฅผ ๋ชจ๋‘ ํ•ฉ์นœ ์–‘์ž…๋‹ˆ๋‹ค. ์‘๋‹ต๋‹น ์ตœ๋Œ€ 819,200๊ฐœ์˜ ์ถœ๋ ฅ ํ† ํฐ์„ ์ƒ์„ฑํ•ฉ๋‹ˆ๋‹ค.
TheDrummer: UnslopNemo 12B๋Š”(์€) ๋ฌด์—‡์„ ํ•  ์ˆ˜ ์žˆ๋‚˜์š”?
TheDrummer: UnslopNemo 12B๋Š”(์€) text ์ž…๋ ฅ์„ ๋ฐ›์•„ text ์ถœ๋ ฅ์„ ๋ฐ˜ํ™˜ํ•ฉ๋‹ˆ๋‹ค. ์ง€์› ๊ธฐ๋Šฅ: ๊ตฌ์กฐํ™”๋œ JSON ์ถœ๋ ฅ.
์ฝ”๋“œ์—์„œ TheDrummer: UnslopNemo 12B๋ฅผ(์„) ์–ด๋–ป๊ฒŒ ํ˜ธ์ถœํ•˜๋‚˜์š”?
์–ด๋–ค OpenAI SDK๋“  base URL์„ https://api14.com/api/v1๋กœ ์ง€์ •ํ•˜๊ณ  model์„ "thedrummer/unslopnemo-12b"๋กœ ์„ค์ •ํ•˜์„ธ์š”, ๋‹ค๋ฅธ ์ฝ”๋“œ ๋ณ€๊ฒฝ์€ ํ•„์š” ์—†์Šต๋‹ˆ๋‹ค. ์ด ํŽ˜์ด์ง€์˜ ์ฝ”๋“œ ํŒจ๋„์—์„œ ๋ฐ”๋กœ ์“ธ ์ˆ˜ ์žˆ๋Š” ์˜ˆ์ œ๋ฅผ ๋ณต์‚ฌํ•˜์„ธ์š”.
TheDrummer: UnslopNemo 12B์˜ ๋Œ€์•ˆ์€ ๋ฌด์—‡์ธ๊ฐ€์š”?
๋น„์Šทํ•œ ๊ฐ€๊ฒฉ๋Œ€์˜ ํ…์ŠคํŠธ ๋ชจ๋ธ: TheDrummer: Cydonia 24B V4.1, Mistral: Saba, Meta: Llama 3.1 70B Instruct. ๋ชจ๋‘ ๊ฐ™์€ API ํ‚ค๋กœ ์‹คํ–‰๋˜๋ฏ€๋กœ ๋ฌธ์ž์—ด ํ•˜๋‚˜๋งŒ ๋ฐ”๊พธ๋ฉด ์ „ํ™˜๋ฉ๋‹ˆ๋‹ค.

TheDrummer: UnslopNemo 12B ์ปค๋ฎค๋‹ˆํ‹ฐ

์ƒˆ ํ† ํ”ฝ

์ด ์ปค๋ฎค๋‹ˆํ‹ฐ์—๋Š” ์•„์ง ํ† ํ”ฝ์ด ์—†์Šต๋‹ˆ๋‹ค. TheDrummer: UnslopNemo 12B์— ๋Œ€ํ•œ ์ฒซ ํ† ํ”ฝ์„ ์—ด์–ด ๋ณด์„ธ์š”.