流式响应内容不能流式输出到前端

[jiongjiongJOJO]

📦 部署环境

Docker

📦 部署模式

服务端模式(lobe-chat-database 镜像)

📌 软件版本

v1.68.9

💻 系统环境

Other Linux

🌐 浏览器

Chrome

🐛 问题描述

我本地开了一个openAI格式的API接口（在docker内），在lobechat里也设置了对应的接口。
我是使用docker-compose启动的，这里增加了一个API的容器，并把所有相关的服务放在了一起，所以lobechat只需要访问这个地址就能调用API接口：http://api:port/v1。

[user@localhost lobe-chat]#cat docker-compose.yml 
name: lobe-chat-database
services:
  postgresql:
    image: pgvector/pgvector:pg16
    container_name: lobe-postgres
    ports:
      - '*************:5432'
    volumes:
      - '*************:/var/lib/postgresql/data'
    environment:
      - 'POSTGRES_DB=*************'
      - 'POSTGRES_PASSWORD=*************' # 需要替换为你的 PostgreSQL 数据库密码
    healthcheck:
      test: ['CMD-SHELL', 'pg_isready -U postgres']
      interval: 5s
      timeout: 5s
      retries: 5
    restart: always

  lobe:
    image: lobehub/lobe-chat-database
    container_name: lobe-database
    ports:
      - '*************:3210'
    depends_on:
      - postgresql
    env_file:
      - .env
    restart: always

  nginx:
    image: nginx:latest
    container_name: lobe-nginx
    ports:
      - "*************:80"
      - "*************:443"
    volumes:
      - *************:/etc/nginx/nginx.conf:ro
      - *************:/etc/nginx/ssl:ro
    depends_on:
      - lobe
    restart: always


  api:
    build: /root/API  # 直接指定 Dockerfile 目录
    container_name: API
    restart: unless-stopped

volumes:
  data:
    driver: local

然后配置好之后，可以直接使用这个api服务，但是这个服务的响应似乎不是一个字/Token一个字/Token的输出，从网络请求中可以看出，EventStream是一次性输出了多组信息，然后前端是一次性展示这些内容的。

但是我看api容器的日志，是实时输出的内容。并且我如果在我自己电脑运行这个api容器（不做其他的修改，完全一致），lobechat设置客户端请求的方式，来调用本机的接口（http://localhost:port/v1），是能正常输出Stream信息的。

这就很奇怪，我不确定是不是我docker的问题，但从现象上来看，不太可能是api容器的问题。

📷 复现步骤

这边录制了一个视频，可以直接从视频中查看现象：

lobechat.mp4

🚦 期望结果

流式输出内容

📝 补充信息

暂无需要补充内容，如果有其他需要提供的内容，直接在这个issue内回复补充

[lobehubbot]

👀 @jiongjiongJOJO

Thank you for raising an issue. We will investigate into the matter and get back to you as soon as possible.
Please make sure you have given us as much context as possible.
非常感谢您提交 issue。我们会尽快调查此事，并尽快回复您。 请确保您已经提供了尽可能多的背景信息。

[lobehubbot]

Bot detected the issue body's language is not English, translate it automatically. 👯👭🏻🧑‍🤝‍🧑👫🧑🏿‍🤝‍🧑🏻👩🏾‍🤝‍👨🏿👬🏿

---

📦 Deployment environment

Docker

📦 Deployment mode

Server-side mode (lobe-chat-database mirror)

📌 Software version

v1.68.9

💻 System environment

Other Linux

🌐 Browser

Chrome

🐛 Question description

I opened an openAI format API interface (in docker) locally and set up the corresponding interface in lobechat.
I started it using docker-compose. I added an API container here and put all related services together, so lobechat only needs to access this address to call the API interface: http://api:port/v1.

[user@localhost lobe-chat]#cat docker-compose.yml
name: lobe-chat-database
services:
  postgresql:
    image: pgvector/pgvector:pg16
    container_name: lobe-postgres
    Ports:
      - '*********:5432'
    Volumes:
      - '************:/var/lib/postgresql/data'
    environment:
      - 'POSTGRES_DB=************
      - 'POSTGRES_PASSWORD=***************' # Need to be replaced with your PostgreSQL database password
    healthcheck:
      test: ['CMD-SHELL', 'pg_isready -U postgres']
      interval: 5s
      timeout: 5s
      retries: 5
    restart: always

  lobe:
    image: lobehub/lobe-chat-database
    container_name: lobe-database
    Ports:
      - '************:3210'
    depends_on:
      - postgresql
    env_file:
      - .env
    restart: always

  nginx:
    image: nginx:latest
    container_name: lobe-nginx
    Ports:
      - "************:80"
      - "************:443"
    Volumes:
      - ***************:/etc/nginx/nginx.conf:ro
      - ***************:/etc/nginx/ssl:ro
    depends_on:
      - lobe
    restart: always


  api:
    build: /root/API # directly specify the Dockerfile directory
    container_name: API
    restart: unless-stopped

Volumes:
  data:
    driver: local

Then after configuration, you can use this API service directly, but the response of this service does not seem to be the output of one word/Token, and it can be seen from the network request that EventStream outputs multiple sets of information at one time, and then the front-end displays these contents at one time.

But I see that the logs of the API container are the contents output in real time. And if I run this API container on my own computer (no other modifications are made, it is completely consistent), lobechat sets the client request method to call the local interface (http://localhost:port/v1), which can output Stream information normally.

This is very strange. I'm not sure if it's my docker problem, but from a phenomenon point of view, it's unlikely that it's a problem with the API container.

📷 Reproduction steps

A video was recorded here, and you can view the phenomenon directly from the video:

PixPin_2025-03-06_13-43-26.mp4

🚦 Expected results

Streaming output content

📝 Supplementary information

There is no need to add content yet. If there is any other content that needs to be provided, reply directly in this issue to add

[huangkairan]

same, #6686

[jiongjiongJOJO]

same, #6686

sorry，issue太多了，没搜到这条😥

[lobehubbot]

Bot detected the issue body's language is not English, translate it automatically. 👯👭🏻🧑‍🤝‍🧑👫🧑🏿‍🤝‍🧑🏻👩🏾‍🤝‍👨🏿👬🏿

---

same, #6686

Sorry, there are too many issues, I haven't found this one 😥

[jiongjiongJOJO]

#6686 (comment)

关于这条评论的猜想可能与#5824 有关。
我看了下 #5824 的PR时间，大概在上周。我找了docker上v1.50.0的版本（上个月），退回后发现仍然存在这个问题。所以，这个问题可能与 #5824 无关。

[lobehubbot]

Bot detected the issue body's language is not English, translate it automatically. 👯👭🏻🧑‍🤝‍🧑👫🧑🏿‍🤝‍🧑🏻👩🏾‍🤝‍👨🏿👬🏿

---

#6686 (comment)

The guess about this comment may be related to #5824.
I looked at the PR time of #5824, probably last week. I looked for the version of v1.50.0 on docker (last month) and found that this problem still exists after returning it. So, this question may not be related to #5824.

[jiongjiongJOJO]

Addendum: This issue is a must-have, and it happens every time this API is called

[jiongjiongJOJO]

经测试，只要在服务端请求，且相应结果是流式的，则就会出现这种卡顿。Google的API没有测出来

[lobehubbot]

Bot detected the issue body's language is not English, translate it automatically. 👯👭🏻🧑‍🤝‍🧑👫🧑🏿‍🤝‍🧑🏻👩🏾‍🤝‍👨🏿👬🏿

---

After testing, this kind of stutter will occur as long as the request is requested on the server and the corresponding result is streaming. Google's API has not been tested

[MultipledMe]

+1

[arvinxx]

@jiongjiongJOJO @MultipledMe 测一下 #6831 这个PR 中的预览链接是否修复上述问题？

[lobehubbot]

Bot detected the issue body's language is not English, translate it automatically. 👯👭🏻🧑‍🤝‍🧑👫🧑🏿‍🤝‍🧑🏻👩🏾‍🤝‍👨🏿👬🏿

---

@jiongjiongJOJO @MultipledMe Test #6831 Is the preview link in this PR fixed?

[jiongjiongJOJO]

@jiongjiongJOJO @MultipledMe 测一下 #6831 这个PR 中的预览链接是否修复上述问题？

我是docker部署的，我看下怎么docker build，试试能不能行

[jiongjiongJOJO]

@jiongjiongJOJO @MultipledMe 测一下 #6831 这个PR 中的预览链接是否修复上述问题？

@arvinxx
vercel预览链接好像测不通，是不是因为跨域做了限制，我掉用不了 http://ip:port/v1
另外docker编译我似乎没看明白具体如何操作🙄

我尝试安装一下docker buildx，看看能不能编译成功吧

[arvinxx]

@jiongjiongJOJO 我给你打个镜像把

[lobehubbot]

Bot detected the issue body's language is not English, translate it automatically. 👯👭🏻🧑‍🤝‍🧑👫🧑🏿‍🤝‍🧑🏻👩🏾‍🤝‍👨🏿👬🏿

---

@jiongjiongJOJO I'll give you a mirror

[jiongjiongJOJO]

@jiongjiongJOJO 我给你打个镜像把

OK，感谢！

[lobehubbot]

Bot detected the issue body's language is not English, translate it automatically. 👯👭🏻🧑‍🤝‍🧑👫🧑🏿‍🤝‍🧑🏻👩🏾‍🤝‍👨🏿👬🏿

---

@jiongjiongJOJO I'll give you a mirror

OK, thanks!

[jiongjiongJOJO]

@jiongjiongJOJO 我给你打个镜像把

[xxxx@localhost lobe-chat]#cat /etc/os-release
PRETTY_NAME="Debian GNU/Linux 12 (bookworm)"
NAME="Debian GNU/Linux"
VERSION_ID="12"
VERSION="12 (bookworm)"
VERSION_CODENAME=bookworm
ID=debian
HOME_URL="https://www.debian.org/"
SUPPORT_URL="https://www.debian.org/support"
BUG_REPORT_URL="https://bugs.debian.org/"

[lobehubbot]

Bot detected the issue body's language is not English, translate it automatically. 👯👭🏻🧑‍🤝‍🧑👫🧑🏿‍🤝‍🧑🏻👩🏾‍🤝‍👨🏿👬🏿

---

@jiongjiongJOJO I'll give you a mirror

[xxxx@localhost lobe-chat]#cat /etc/os-release
PRETTY_NAME="Debian GNU/Linux 12 (bookworm)"
NAME="Debian GNU/Linux"
VERSION_ID="12"
VERSION="12 (bookworm)"
VERSION_CODENAME=bookworm
ID=debian
HOME_URL="https://www.debian.org/"
SUPPORT_URL="https://www.debian.org/support"
BUG_REPORT_URL="https://bugs.debian.org/"

[jiongjiongJOJO]

@jiongjiongJOJO 我给你打个镜像把

@arvinxx
这个版本确实不一次性跳出来很多字符了，但是网页的响应结果也还是一次性跳很多的，感官上好了很多，但我不清楚这算不算已经修复了bug。
docker版本：pr-fix-cache-and-search-cc176b127

录像内容：

PixPin_2025-03-09_20-15-15.mp4

[arvinxx]

你本地部署的情况下是否有一个 nginx ？看下这个问题： #531

[jiongjiongJOJO]

你本地部署的情况下是否有一个 nginx ？看下这个问题： #531

感谢，确实是nginx配置问题，现在已经解决了！！

location / {
	proxy_pass http://lobe;
	proxy_set_header Host $host;
	proxy_set_header X-Real-IP $remote_addr;
	proxy_set_header X-Forwarded-Proto $scheme;
	proxy_cache off;  # 关闭缓存
	proxy_buffering off;  # 关闭代理缓冲
	chunked_transfer_encoding on;  # 开启分块传输编码
	tcp_nopush on;  # 开启TCP NOPUSH选项，禁止Nagle算法
	tcp_nodelay on;  # 开启TCP NODELAY选项，禁止延迟ACK算法
	keepalive_timeout 300;  # 设定keep-alive超时时间为65秒
}

[jiongjiongJOJO]

你本地部署的情况下是否有一个 nginx ？看下这个问题： #531

感谢，确实是nginx配置问题，现在已经解决了！！

location / {
	proxy_pass http://lobe;
	proxy_set_header Host $host;
	proxy_set_header X-Real-IP $remote_addr;
	proxy_set_header X-Forwarded-Proto $scheme;
	proxy_cache off;  # 关闭缓存
	proxy_buffering off;  # 关闭代理缓冲
	chunked_transfer_encoding on;  # 开启分块传输编码
	tcp_nopush on;  # 开启TCP NOPUSH选项，禁止Nagle算法
	tcp_nodelay on;  # 开启TCP NODELAY选项，禁止延迟ACK算法
	keepalive_timeout 300;  # 设定keep-alive超时时间为65秒
}

另外，这样调整后也解决了另外一个问题：页面放在后台时（就是屏幕上看不到页面任何内容的情况下，有其他窗口在该页面之上时是正常的），流式内容不输出。