大模型带我们来到了自然语言人机交互的时代
1、安装本地大模型进行推理
下载地址:
https://ollama.com/download
部署本地deepseek和嵌入模型
ollama run deepseek-r1:7b
2、制定Linux操作接口指令规范
3、编写大模型对话工具
#!/usr/bin/python3
#coding: utf-8
import json
import requests
model = "llama3"
def chat(messages):
r = requests.post(
"http://localhost:11434/api/chat",
json={"model": model, "messages": messages, "stream": True},
)
r.raise_for_status()
output = ""
for line in r.iter_lines():
body = json.loads(line)
if "error" in body:
raise Exception(body["error"])
if body.get("done") is False:
message = body.get("message", "")
content = message.get("content", "")
output += content
print(content, end="", flush=True)
if body.get("done", False):
message["content"] = output
return message
def main():
messages = []
while True:
user_input = input("Enter a prompt: ")
if not user_input:
exit()
print()
messages.append({"role": "user", "content": user_input})
message = chat(messages)
messages.append(message)
print("\n\n")
if __name__ == "__main__":
main()
4、运行AI Agent查看效果
未完待续