{"id":963,"date":"2025-05-04T04:06:11","date_gmt":"2025-05-04T04:06:11","guid":{"rendered":"https:\/\/serhatdiker.com\/?p=963"},"modified":"2025-05-20T12:29:56","modified_gmt":"2025-05-20T12:29:56","slug":"windowsta-llama-3-ile-yerel-dil-modeli-kurulumu","status":"publish","type":"post","link":"https:\/\/serhatdiker.com\/index.php\/2025\/05\/04\/windowsta-llama-3-ile-yerel-dil-modeli-kurulumu\/","title":{"rendered":"Windows&#8217;ta Ollama ile LLaMA 3 Yerel Dil Modeli Kurulumu"},"content":{"rendered":"\n<p>Merhaba,<\/p>\n\n\n\n<p>Yapay zeka tabanl\u0131 dil modelleri art\u0131k yaln\u0131zca b\u00fcy\u00fck bulut sistemlerinde de\u011fil, bireysel geli\u015ftiricilerin yerel bilgisayarlar\u0131nda da \u00e7al\u0131\u015ft\u0131r\u0131labiliyor. Bu yaz\u0131da, <strong>Meta\u2019n\u0131n LLaMA 3 dil modelini<\/strong> bir <strong>Windows bilgisayar<\/strong> \u00fczerinde <strong>Ollama<\/strong> adl\u0131 ara\u00e7 yard\u0131m\u0131yla nas\u0131l \u00e7al\u0131\u015ft\u0131rd\u0131\u011f\u0131m\u0131 ve bu s\u00fcrecin arkas\u0131ndaki motivasyonlar\u0131 detayl\u0131 \u015fekilde payla\u015f\u0131yorum.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\">Neden Yerel Bir Dil Modeli<\/h2>\n\n\n\n<p>Benim hedefim, projemde kullanmak \u00fczere yerel kaynaklarla \u00e7al\u0131\u015fan, internete ihtiya\u00e7 duymadan \u00e7al\u0131\u015ft\u0131rabilece\u011fim bir dil modeli kurmakt\u0131. Bu tercih birka\u00e7 \u00f6nemli avantaj sa\u011fl\u0131yor:<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li><strong>Veri gizlili\u011fi:<\/strong> Girdi verilerim hi\u00e7bir \u015fekilde d\u0131\u015f sunuculara g\u00f6nderilmiyor.<\/li>\n\n\n\n<li><strong>Ba\u011f\u0131ms\u0131zl\u0131k:<\/strong> API limitlerine veya internet ba\u011flant\u0131s\u0131na ba\u011fl\u0131 kalmadan \u00e7al\u0131\u015fma imk\u00e2n\u0131.<\/li>\n\n\n\n<li><strong>Geli\u015ftirici \u00f6zg\u00fcrl\u00fc\u011f\u00fc:<\/strong> Modeli kendi ihtiya\u00e7lar\u0131ma g\u00f6re yap\u0131land\u0131rma ve entegre etme \u015fans\u0131.<\/li>\n<\/ul>\n\n\n\n<h2 class=\"wp-block-heading\">Gerekli Ara\u00e7lar ve Haz\u0131rl\u0131klar<\/h2>\n\n\n\n<p>Kurulum s\u00fcreci boyunca kulland\u0131\u011f\u0131m ara\u00e7lar \u015funlar:<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>Python 3.9+ (baz\u0131 i\u015flemler i\u00e7in gerekli olabilir)<\/li>\n\n\n\n<li><a class=\"\" href=\"https:\/\/ollama.com\"><strong>Ollama<\/strong><\/a> (modeli \u00e7al\u0131\u015ft\u0131ran motor)<\/li>\n\n\n\n<li>huggingface-cli (modeli indirmek i\u00e7in)<\/li>\n\n\n\n<li>Hugging Face hesab\u0131<\/li>\n<\/ul>\n\n\n\n<blockquote class=\"wp-block-quote is-layout-flow wp-block-quote-is-layout-flow\">\n<p><strong>Not:<\/strong> Bu kurulum GGUF formatl\u0131 quantized (k\u00fc\u00e7\u00fclt\u00fclm\u00fc\u015f ve optimize edilmi\u015f) modeller i\u00e7indir. Bu sayede b\u00fcy\u00fck dil modelleri, daha az kaynakla \u00e7al\u0131\u015ft\u0131r\u0131labiliyor.<\/p>\n<\/blockquote>\n\n\n\n<h2 class=\"wp-block-heading\">1. Ollama Nedir ve Neden Se\u00e7tim?<\/h2>\n\n\n\n<p><strong>Ollama<\/strong>, yerel olarak GGUF format\u0131ndaki modelleri \u00e7al\u0131\u015ft\u0131rmak i\u00e7in kullan\u0131lan hafif ve kullan\u0131c\u0131 dostu bir ara\u00e7t\u0131r. GPU ya da g\u00fc\u00e7l\u00fc bir CPU ile olduk\u00e7a verimli \u00e7al\u0131\u015f\u0131r. Docker gibi karma\u015f\u0131k yap\u0131land\u0131rmalara gerek kalmadan model \u00e7al\u0131\u015ft\u0131rmay\u0131 m\u00fcmk\u00fcn k\u0131lar.<\/p>\n\n\n\n<p>Kurulum:<\/p>\n\n\n\n<pre class=\"wp-block-code\"><code>https:&#47;&#47;ollama.com\/download<\/code><\/pre>\n\n\n\n<p>Kurulumdan sonra:<\/p>\n\n\n\n<pre class=\"wp-block-code\"><code>ollama --version<\/code><\/pre>\n\n\n\n<h2 class=\"wp-block-heading\">2. Model Dizinini D Diskine Ta\u015f\u0131mak<\/h2>\n\n\n\n<p>C diskimde yeterli alan olmad\u0131\u011f\u0131ndan, Ollama\u2019n\u0131n model klas\u00f6r\u00fcn\u00fc D diskine ta\u015f\u0131mak istedim. Bunun i\u00e7in Windows\u2019ta <strong>sembolik ba\u011flant\u0131 (symlink)<\/strong> kulland\u0131m. B\u00f6ylece sistem D diskindekini C\u2019deymi\u015f gibi g\u00f6r\u00fcyor. Tabi kurulumda yerel makinenizde yer kaplamas\u0131n\u0131 istemedi\u011finizde bir harici diske de bu \u015fekilde kurulum yapabilirsiniz.<\/p>\n\n\n\n<pre class=\"wp-block-code\"><code>xcopy \"%USERPROFILE%\\.ollama\" \"D:\\IOModels\" \/E \/H \/K\nrmdir \/S \/Q \"%USERPROFILE%\\.ollama\"\nmklink \/D \"%USERPROFILE%\\.ollama\" \"D:\\IOModels\"<\/code><\/pre>\n\n\n\n<p>Bu ad\u0131m opsiyonel ancak b\u00fcy\u00fck modellerde alan \u00e7ok \u00f6nemli hale geliyor.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\">3. Hugging Face Hesab\u0131 ve CLI<\/h2>\n\n\n\n<p>Modeli indirirken Hugging Face API\u2019si \u00fczerinden do\u011frulama gerekiyor. Bunun i\u00e7in:<\/p>\n\n\n\n<pre class=\"wp-block-code\"><code>pip install -U \"huggingface_hub&#91;cli]\"\nhuggingface-cli login<\/code><\/pre>\n\n\n\n<p>Hugging Face \u00fczerinde bir API token olu\u015fturarak giri\u015f yapman\u0131z gerekiyor.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\">4. LLaMA 3 GGUF Modelini \u0130ndirme<\/h2>\n\n\n\n<p>Ben, LLaMA 3\u2019\u00fcn <strong>QuantFactory<\/strong> taraf\u0131ndan haz\u0131rlanm\u0131\u015f olan quantized versiyonunu kulland\u0131m. Bu s\u00fcr\u00fcm daha d\u00fc\u015f\u00fck kaynakla \u00e7al\u0131\u015f\u0131yor.<\/p>\n\n\n\n<pre class=\"wp-block-code\"><code>huggingface-cli download QuantFactory\/Meta-Llama-3-8B-Instruct-GGUF \\\n  --include \"Meta-Llama-3-8B-Instruct.Q4_K_M.gguf\" \\\n  --local-dir \"D:\\IOModels\\llama3\"<\/code><\/pre>\n\n\n\n<p>Bu model yakla\u015f\u0131k 4-5 GB boyutunda.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\">5. Modelfile Tan\u0131mlama<\/h2>\n\n\n\n<p>Ollama, model ba\u015flatmak i\u00e7in bir yap\u0131land\u0131rma dosyas\u0131na ihtiya\u00e7 duyuyor. Bu dosya modelin hangi .gguf dosyas\u0131ndan olu\u015fturulaca\u011f\u0131n\u0131 tan\u0131mlar.<\/p>\n\n\n\n<p>D:\\IOModels\\llama3\\Modelfile i\u00e7eri\u011fi:<\/p>\n\n\n\n<p>FROM Meta-Llama-3-8B-Instruct.Q4_K_M.gguf<\/p>\n\n\n\n<p>Baz\u0131 kaynaklarda PARAMETER num_threads gibi sat\u0131rlar \u00f6neriliyor ama Ollama bu sat\u0131r\u0131 tan\u0131mad\u0131\u011f\u0131 i\u00e7in ben dahil etmedim.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\">6. Modeli Olu\u015fturmak ve \u00c7al\u0131\u015ft\u0131rmak<\/h2>\n\n\n\n<p>Art\u0131k modelimizi olu\u015fturabiliriz:<\/p>\n\n\n\n<pre class=\"wp-block-code\"><code>cd D:\\IOModels\\llama3\nollama create llama3-custom -f Modelfile<\/code><\/pre>\n\n\n\n<p>\u00c7al\u0131\u015ft\u0131rmak i\u00e7in:<\/p>\n\n\n\n<pre class=\"wp-block-code\"><code>ollama run llama3-custom<\/code><\/pre>\n\n\n\n<p>Model ba\u015flat\u0131ld\u0131\u011f\u0131nda, terminal \u00fczerinden metin tabanl\u0131 ileti\u015fim kurabilirsiniz.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\">7. Testler ve Uygulama \u00d6rnekleri<\/h2>\n\n\n\n<pre class=\"wp-block-code\"><code>>>> \"Bu haberi \u00f6zetle: T\u00fcrkiye'de enerji piyasas\u0131nda bug\u00fcn g\u00fcne\u015f enerjisi \u00fcretimi rekor k\u0131rd\u0131. Elektri\u0307k \u00fcretimi\u0307ni\u0307n %40'\u0131 yenilenebilir kaynaklardan sa\u011fland\u0131.\"\n\nHere is a summary of the news:\n\nIn Turkey, a record was broken in the energy market today with solar energy production. According to the latest\ndata, 40% of electricity generated in the country comes from renewable sources.\n\n>>> \"Bu haber hangi alana ait: ekonomi, siyaset, sa\u011fl\u0131k, spor?\"\n\nBu haber ekonomy alan\u0131na aittir.\n\n>>> \"Bu haber hangi alana ait: ekonomi, siyaset, sa\u011fl\u0131k, spor? (Tek kelime ile cevapla)\"\n\nEkonomi\n\n>>> \"Bu haberi \u00f6zetle: T\u00fcrkiye'de enerji piyasas\u0131nda bug\u00fcn g\u00fcne\u015f enerjisi \u00fcretimi rekor k\u0131rd\u0131. Elektri\u0307k \u00fcretimi\u0307ni\u0307n %40'\u0131 yenilenebilir kaynaklardan sa\u011fland\u0131. (T\u00fcrk\u00e7e yan\u0131t ver)\"\n\nBug\u00fcn T\u00fcrkiye'de g\u00fcne\u015f enerjisi \u00fcretimi rekor k\u0131rd\u0131. Elektrik \u00fcretiminin %40'\u0131 yenilenebilir kaynaklardan\nsa\u011flan\u0131yor.<\/code><\/pre>\n\n\n\n<p>Model art\u0131k terminalden \u00e7al\u0131\u015f\u0131yor.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\">8. S\u0131radaki Ad\u0131m: API ile Entegrasyon<\/h2>\n\n\n\n<p>Bu kurulumu tamamlad\u0131ktan sonra, art\u0131k modeli bir web projesi veya uygulamayla entegre edebilirim. Bunun i\u00e7in bir <strong>.NET Core veya Flask<\/strong> tabanl\u0131 basit bir API servisi kurmay\u0131 ve bu servis \u00fczerinden modelle haberle\u015fmeyi hedefliyorum. Tabiki as\u0131l \u00f6nemli nokta ise haberle\u015fmeden \u00f6nce bu projeyi e\u011fitmek olacak. Yani yolculuk yeni ba\u015fl\u0131yor.<\/p>\n\n\n\n<figure class=\"wp-block-image size-full\"><img loading=\"lazy\" decoding=\"async\" width=\"1024\" height=\"1024\" src=\"https:\/\/serhatdiker.com\/wp-content\/uploads\/2025\/05\/LLama3Image.png\" alt=\"\" class=\"wp-image-967\" srcset=\"https:\/\/serhatdiker.com\/wp-content\/uploads\/2025\/05\/LLama3Image.png 1024w, https:\/\/serhatdiker.com\/wp-content\/uploads\/2025\/05\/LLama3Image-300x300.png 300w, https:\/\/serhatdiker.com\/wp-content\/uploads\/2025\/05\/LLama3Image-150x150.png 150w\" sizes=\"auto, (max-width: 1024px) 100vw, 1024px\" \/><\/figure>\n","protected":false},"excerpt":{"rendered":"<p>Merhaba, Yapay zeka tabanl\u0131 dil modelleri art\u0131k yaln\u0131zca b\u00fcy\u00fck bulut sistemlerinde de\u011fil, bireysel geli\u015ftiricilerin yerel bilgisayarlar\u0131nda da \u00e7al\u0131\u015ft\u0131r\u0131labiliyor. Bu yaz\u0131da, Meta\u2019n\u0131n LLaMA 3 dil modelini bir&#46;&#46;&#46;<\/p>\n","protected":false},"author":1,"featured_media":967,"comment_status":"closed","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[1],"tags":[96,105,103,95,102,94,106,97,98,104,100,101,99,93],"class_list":["post-963","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-uncategorized","tag-acik-kaynak-llm","tag-ai-entegrasyonu","tag-dil-modeli-egitimi","tag-gguf-formati","tag-hugging-face","tag-llama-3","tag-llama-windows-kurulumu","tag-ollama","tag-python-nlp","tag-symbolic-link","tag-terminalden-ai-calistirma","tag-windows-kurulum","tag-yapay-zeka-kurulumu","tag-yerel-dil-modeli"],"_links":{"self":[{"href":"https:\/\/serhatdiker.com\/index.php\/wp-json\/wp\/v2\/posts\/963","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/serhatdiker.com\/index.php\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/serhatdiker.com\/index.php\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/serhatdiker.com\/index.php\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/serhatdiker.com\/index.php\/wp-json\/wp\/v2\/comments?post=963"}],"version-history":[{"count":6,"href":"https:\/\/serhatdiker.com\/index.php\/wp-json\/wp\/v2\/posts\/963\/revisions"}],"predecessor-version":[{"id":974,"href":"https:\/\/serhatdiker.com\/index.php\/wp-json\/wp\/v2\/posts\/963\/revisions\/974"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/serhatdiker.com\/index.php\/wp-json\/wp\/v2\/media\/967"}],"wp:attachment":[{"href":"https:\/\/serhatdiker.com\/index.php\/wp-json\/wp\/v2\/media?parent=963"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/serhatdiker.com\/index.php\/wp-json\/wp\/v2\/categories?post=963"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/serhatdiker.com\/index.php\/wp-json\/wp\/v2\/tags?post=963"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}