Skip to Content

How to Run DeepSeek R-1 Locally and Securely

The AI landscape is evolving quickly, and DeepSeek R-1 is one of the latest models capturing attention from both enthusiasts and professionals.

Developed by DeepSeek, this open-source language model has been making waves for its impressive capabilities.

But what exactly is DeepSeek R-1, and how can you use it effectively? Let’s dive in!


How to Run DeepSeek R-1 Locally

Running DeepSeek R-1 locally on your own machine gives you more control over your data, and it’s a great option if you want to avoid dependency on the cloud.

Get Your Free Linux training!

Join our free Linux training and discover the power of open-source technology. Enhance your skills and boost your career! Learn Linux for Free!

Here’s a step-by-step guide on how to set it up:

Step 1: Install Ollama

Ollama is an open-source tool that lets you run large AI models, including DeepSeek R-1, directly on your machine. It’s available for macOS, Linux, and Windows.

  • Download Ollama: Head to the Ollama website and download the version for your operating system.
  • Install Ollama: Follow the installation steps based on your OS. The process is pretty simple and should only take a few minutes.

Step 2: Verify Installation

After installing Ollama, you’ll want to make sure everything is set up properly.

  • Open a Terminal or Command Prompt: For macOS/Linux, open a terminal. On Windows, open Command Prompt or PowerShell.
  • Check the Version: Type this command:
    ollama -v
    

    If the installation is successful, you’ll see the version number. If you encounter an error, review the installation instructions and try again.

Step 3: Download DeepSeek R-1

Once Ollama is up and running, it’s time to download DeepSeek R-1.

  • Launch Ollama: Open the Ollama interface.
  • Search for DeepSeek R-1: Go to the “Models” tab and search for “deepseek.” The deepseek-r1 model should show up.
  • Choose the Model Size: DeepSeek R-1 comes in different sizes, from smaller models with fewer parameters to large ones with billions of parameters. Larger models need more powerful hardware.

For most users, the 8B version (8 billion parameters) should be sufficient and can run on a GPU with at least 8GB of VRAM.

  • Download the Model: To download the 8B version, use the following command:
    ollama run deepseek-r1:8b
    

    The download will be around 4.9GB, so make sure you have enough disk space.

Step 4: Running DeepSeek R-1

Once the model is downloaded, you’re ready to start using it.

  • Run the Model: Open a terminal or command prompt and type:
    ollama run deepseek-r1:8b
    

    You can now start interacting with DeepSeek R-1 by typing prompts, just like you would with an online version.

Example prompt:

  • Question: “What is DeepSeek R-1?”
  • Response: “DeepSeek R-1 is an AI assistant developed by DeepSeek, designed to help with tasks like math, coding, and general problem-solving. It provides detailed reasoning when necessary.”

Since it’s running locally, you don’t need an internet connection to interact with it, and responses are fast.


Why is DeepSeek R-1 Impressive?

DeepSeek R-1 has quickly gained attention for several reasons, largely due to its advanced training methods and unique features.

1. Supervised Fine-Tuning (SFT)

Supervised Fine-Tuning is a method of teaching the AI by providing it with a large dataset of example questions and correct answers. This allows DeepSeek R-1 to respond more accurately, drawing from its training data to generate coherent and relevant answers.

2. Reinforcement Learning (RL)

With Reinforcement Learning, DeepSeek R-1 continuously improves by receiving feedback on its responses. This method is similar to how humans learn by making mistakes, adjusting, and getting better over time. It allows the model to refine its output, making it more reliable and nuanced.


Why is DeepSeek R-1 Gaining Attention?

Here are a few key reasons why DeepSeek R-1 is generating buzz:

  1. Superior Reasoning: Users have noted that DeepSeek R-1 performs exceptionally well when handling complex prompts and providing detailed reasoning, making it stand out against other models like OpenAI’s GPT. This is especially valuable for tasks requiring in-depth analysis, such as technical support or problem-solving.
  2. Open-Source: Unlike many proprietary AI models, DeepSeek R-1 is open-source. This means anyone can access, modify, and integrate it into their own applications. It’s a game-changer for developers, researchers, and hobbyists who want to experiment with cutting-edge AI technology.
  3. Free to Use (For Now): Currently, DeepSeek R-1 is free, which makes it accessible to a broader audience. However, this may change in the future, so running it locally ensures you won’t be affected by usage caps or potential subscription fees.

Conclusion

DeepSeek R-1 is a powerful and versatile AI model that’s worth keeping an eye on. Its open-source nature, advanced reasoning capabilities, and potential for local deployment make it a valuable tool for AI researchers, developers, and anyone interested in cutting-edge AI.

If you value privacy or simply want to have control over your data, running DeepSeek R-1 locally is an excellent choice. Get started today and explore the future of AI with DeepSeek R-1!