Local AI Engineering with Ollama

Local AI Engineering with Ollama

Aymen El Amri

45,33 €
IVA incluido
Disponible
Editorial:
FAUN.dev
Año de edición:
2026
Materia
Inteligencia artificial
ISBN:
9782488111089
45,33 €
IVA incluido
Disponible

Selecciona una librería:

  • Librería Samer Atenea
  • Kálamo Books
  • Librería Elías (Asturias)
  • Librería Kolima (Madrid)
  • Librería Proteo (Málaga)

The model you depend on lives on someone else’s hardware. They can change the price, change the rules, or retire it entirely, and you cannot stop them.Local AI Engineering with Ollama is how you stop renting and start owning. You take the model, the price, and the rules back into your own hands: run any model you want, when you want, where you want, and change how it behaves without a meter running.This is a practical book for developers who can run a command and edit a file but have no Machine Learning degree and want none. It skips the marketing and jumps into building things that run, on hardware you already own, with the network unplugged. Every command was executed on a real machine, and every output you see (JSON responses, error messages, token counts, training logs) came from an actual session, not from documentation.This book moves in one direction: from running your first model to shipping an agent that runs on your own hardware. Each chapter ends with something working, and each skill below builds on the one before it. By the end you will be able to:Understand what a model is actually doing: Tokens, predictions, weights, embeddings, attention, and the KV cache, each tied to a setting you will change.Install Ollama and size your hardware honestly: Install the runtime and tell if a model fits your RAM or VRAM before downloading.Pick, pull, and manage models: Read the Ollama and Hugging Face GGUF repos, choose quantization, and manage disk and memory.Drive Ollama from its API: Run models over HTTP from your code, and read tokens-per-second to compare on numbers.Control the context window: Size it so the model stops forgetting, and see what gets sent each turn.Operate a model under real conditions: Tune temperature, top_p, top_k, penalties, seed, keep-alive, and concurrency.Package a custom model with a Modelfile: One job, the same way every time, shipped as a single artifact.Fine-tune a model on your own data: Train Granite for English-to-SQL with QLoRA and Unsloth, then export to GGUF.Build against the Python SDK: Build Python programs with typed responses, ending in a management CLI.Build a working chat loop and see why it forgets: Write a REPL, then watch it fail to recall the last turn.Give the conversation a memory: Resend a running message list so the assistant follows the conversation.Stream replies and accept multi-line input: Print tokens as they arrive, and take multi-line prompts.Keep long chats inside the context window: Drop the oldest turns so the prompt never overflows.Summarize old turns instead of dropping them: Condense earlier messages with a second model through LangChain.Cache replies in Redis: Return repeated questions instantly, cutting latency and wasted compute.Add long-term memory that survives restarts: Wire in mem0 to recall user facts across sessions.Give the model tools to fetch live data: Add function calling, guarded against inventing numbers.Source those tools from an external MCP server: Serve tools over MCP, turning M times N into M plus N.Put a graphical interface in front of Ollama: Run Open WebUI in Docker, chat with your documents, lock it down for a team.If you can run a command and edit a file, you are qualified! Downloadable code included.So what are you waiting for to stop renting, start owning, and get a model running tonight?

Artículos relacionados

  • Artificial Cognition Systems
    ...
  • Cross-Disciplinary Applications of Artificial Intelligence and Pattern Recognition
    Vijay Kumar Mago
    The need for intelligent machines in areas such as medical diagnostics, biometric security systems, and image processing motivates researchers to develop and explore new techniques, algorithms, and applications in this evolving field. Cross-Disciplinary Applications of Artificial Intelligence and Pattern Recognition: Advancing Technologies provides a common platform for researc...
  • Emerging Applications of Natural Language Processing
    Over the last few years, the area of Natural Language Processing has drastically grown in recognition, not only within the research and development community, but also with industry professionals. As NLP continues to be discussed and researched, certain areas continue to grow and mature. As a result, the need for advanced research and information is in high demand. Emerging App...
  • Androids, Cyborgs, and Robots in Contemporary Culture and Society
    Steven John Thompson
    Mankind’s dependence on artificial intelligence and robotics is increasing rapidly as technology becomes more advanced. Finding a way to seamlessly intertwine these two worlds will help boost productivity in society and aid in a variety of ways in modern civilization. Androids, Cyborgs, and Robots in Contemporary Culture and Society is an essential scholarly resource that delve...
  • Deep Learning Innovations and Their Convergence With Big Data
    The expansion of digital data has transformed various sectors of business such as healthcare, industrial manufacturing, and transportation. A new way of solving business problems has emerged through the use of machine learning techniques in conjunction with big data analytics. Deep Learning Innovations and Their Convergence With Big Data is a pivotal reference for the latest sc...
  • Computational Psychoanalysis and Formal Bi-Logic Frameworks
    Giuseppe Iurato
    Computational psychoanalysis is a new field stemming from Freudian psychoanalysis. The new area aims to understand the primary formal structures and running mechanisms of the unconscious while implementing them into computer sciences. Computational Psychoanalysis and Formal Bi-Logic Frameworks provides emerging information on this new field which uses psychoanalysis and the unc...

Otros libros del autor

  • Learn Git in a Day
    Aymen El Amri
    You don’t actually understand Git. You memorized a few commands, and you’ve been getting away with it.Most developers learn Git the same broken way: copy a command from Stack Overflow, paste it, pray. It works until it doesn’t. Then a merge conflict, a detached HEAD, or a mangled history sends you into a panic, because you never understood the real model of what Git is doing un...
    Disponible

    16,01 €

  • GitOps the Hard Way, with Argo CD
    Aymen El Amri
    Most Argo CD tutorials hand you a cluster someone else built, a sample app, one argocd app sync, and a green checkmark. Then you try it at work and the checkmark turns out to have taught you nothing. You do not know why the repo-server rendered that manifest, what a sync wave orders, how an RBAC rule locks a teammate out of the wrong project, or what happens to your running pod...
    Disponible

    32,52 €

  • AWX in Action
    Aymen El Amri
    You know Ansible. Your playbooks work. But your team is drowning in YAML sprawl, missed schedules, untracked changes, and 'who ran what when' questions nobody can answer.AWX fixes this if you know how to wield it.AWX in Action: Ansible Orchestration at Scale is the practical guide for Ansible users ready to graduate from command-line scripts to a production-grade automation pla...
    Disponible

    41,62 €