From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mail.openvz.org (mail.openvz.org [69.168.225.77]) by lore.virtuozzo.com (Postfix) with ESMTPS id 064598017D for ; Mon, 16 Nov 2026 15:43:15 +0000 (UTC) Received: from mail.openvz.org (localhost [127.0.0.1]) by mail.openvz.org (8.14.4/8.14.4) with ESMTP id 6AGFg1aR027441; Mon, 16 Nov 2026 18:42:01 +0300 DKIM-Filter: OpenDKIM Filter v2.11.0 mail.openvz.org 6AGFg1aR027441 Authentication-Results: mail.openvz.org; dkim=fail reason="signature verification failed" (2048-bit key) header.d=virtuozzo.com header.i=@virtuozzo.com header.b="h7ILx97i" Received: from mail-wr1-f72.google.com (mail-wr1-f72.google.com [209.85.221.72]) by mail.openvz.org (8.14.4/8.14.4) with ESMTP id 6AGFfRBK027358 (version=TLSv1/SSLv3 cipher=AES128-GCM-SHA256 bits=128 verify=FAIL) for ; Mon, 16 Nov 2026 18:41:27 +0300 DKIM-Filter: OpenDKIM Filter v2.11.0 mail.openvz.org 6AGFfRBK027358 Received: by mail-wr1-f72.google.com with SMTP id ffacd0b85a97d-4915ba023d4so1630785f8f.0 for ; Mon, 16 Nov 2026 07:41:27 -0800 (PST) X-Forwarded-Encrypted: i=2; AL+hErFbSohCvC+T7HpxKo5dopn0VSYHD6Ak2y6i6FBS+g3k5wAoYidr1Jhea2LEXLgHBDm3PH/cLQ==@openvz.org X-Gm-Message-State: APuU4Z8MmeQCw+Qbd23T3EHZ+g36QvT+3qJzOYrMOwf93bOtvglWpM5y KNX9Jl8YUVu5MiChFTRa8+SWkbzP4KCAuNNJCzsnG1utlngJkzEV0miPkQcW35VOk1+1xQ5VyI2 wC/us9NqX17tlL1nluPqfqqOE7mo/LXBmxUmOSAFaUHmpIQIRAYI95w== X-Gm-Gg: AZFdTZcjTXsYWbIk8kiMYkIko4+jojmQmPDP++CxFg+kp+RtIIDpQwcDjD8eSzXN03C l76aA4plxYtSBDTEeXXeoi1xDNIbHBduEiNUdoQLtJmGNg0ai6S3xx+yue5guTX18DaYTsggETh C2ziqNLu/j9/bC04PFXs2ilVuAX8DPkuq1AebzSzjmTy/L6JiVeh5/L2rK3shRmLGnkUxTKav+N uBm1kVgLI0r8feLJC8dB/XIbsFulIkvgruonzQVOnBF6RFTO1FDmEm+NeTkHX9fGr+V4eqxeBIh sL80rSaNevyfsdnqgaWS+wrIVgSnramvuUbfw0xhOY7vAxFLFCvTuWwyG8r2x3t2FxSUVM+LYKX wOaY3GN2Mgv1BIOx+qkfj0zbevCPM X-Received: by 2002:a05:6000:4712:b0:48e:3767:d885 with SMTP id ffacd0b85a97d-49c73164e84mr23057165f8f.53.1794843687055; Mon, 16 Nov 2026 07:41:27 -0800 (PST) X-Received: by 2002:a05:6000:4712:b0:48e:3767:d885 with SMTP id ffacd0b85a97d-49c73164e84mr23057100f8f.53.1794843686405; Mon, 16 Nov 2026 07:41:26 -0800 (PST) ARC-Seal: i=1; a=rsa-sha256; t=1794843686; cv=none; d=google.com; s=arc-20260327; b=qCb1IuHTLiJUZFrfjZF6/pklxAmxA6gwk+V590BVzhAn9mPsMQnu5ygVHiZQE7ezLg CM9Zca/YVQW6RSJEQFn9IiHSJxCkK4bwJyEj19Ylr4PVVCfJfEYxP4OMgmcjpWl22GGR dhpBKbta2YLZNf3Q2tigl5R0Wl2pvHmhE2Uux3fqgII7pBTXy6QBDbn1+V+ZV8m3BpEw mzUr44yhrEKYrwf5aKnTzZ+Svd1xmz//kI0xcJBLAn8bJbQ4143cck/YcMuxMLtfB/cJ 2LVuFTO/cafD8C2UgUc9BSfkq/CqbZNOt7A+/j+qfM5eQTyVqReK9CxpQtblqehHykUm LpTw== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20260327; h=content-transfer-encoding:mime-version:references:in-reply-to :message-id:date:subject:cc:to:from:dkim-signature; bh=z50sJz+SpS6pGFYZ4/66EPr9X3RovC8lgJsbUncDOYc=; fh=CMILZ+goaghq6B4UpCDhf0EQp6kYD0LAlmOkUiVCOvs=; b=B181ly2W74dwUE8u3T+mtw2eDfLMQvTpkw33yzJT2DRaoxRPe65FHOokJER6xIYFHd FtzLCqXXfSALwFhLjSEp8hGzjXU+EBGquynmeNz1qZy7tQQnhnvp7greJK5X6JEGZRGu H938Gx4+BQhyEm6nUOiV/Y1Eit9YQUj4t1HLXpRWtS0gMh+6OeLNQL1ZKnry+kSqUMos zbQ1gGIs6HcMFVajgeVokdM1iPKlegQEM0AoDjHKNssHkVXyoz8iFPj2Iy06kakUA9Wb JCFoEz0oUYHf6rRRhjuoYqDmiFrsPeVlvQ9pI32wetAoQfCWS/R+cwjyKTmXK9j0AKNm L+RQ==; dara=google.com ARC-Authentication-Results: i=1; mx.google.com; dkim=pass header.i=@virtuozzo.com header.s=relay header.b=h7ILx97i; spf=pass (google.com: domain of alexander.ivanov@virtuozzo.com designates 130.117.225.111 as permitted sender) smtp.mailfrom=alexander.ivanov@virtuozzo.com; dmarc=pass (p=QUARANTINE sp=QUARANTINE dis=NONE) header.from=virtuozzo.com Received: from relay.virtuozzo.com (relay.virtuozzo.com. [130.117.225.111]) by mx.google.com with ESMTPS id ffacd0b85a97d-49c636edeb9si21370489f8f.197.2026.11.16.07.41.26 for (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Mon, 16 Nov 2026 07:41:26 -0800 (PST) Received-SPF: pass (google.com: domain of alexander.ivanov@virtuozzo.com designates 130.117.225.111 as permitted sender) client-ip=130.117.225.111; Authentication-Results: mx.google.com; dkim=pass header.i=@virtuozzo.com header.s=relay header.b=h7ILx97i; spf=pass (google.com: domain of alexander.ivanov@virtuozzo.com designates 130.117.225.111 as permitted sender) smtp.mailfrom=alexander.ivanov@virtuozzo.com; dmarc=pass (p=QUARANTINE sp=QUARANTINE dis=NONE) header.from=virtuozzo.com DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=virtuozzo.com; s=relay; h=MIME-Version:Message-ID:Date:Subject:From: Content-Type; bh=z50sJz+SpS6pGFYZ4/66EPr9X3RovC8lgJsbUncDOYc=; b=h7ILx97ihi5g QGeUplhkozEwC/ZwbQ7PXCjVR+OsXhbASo/3WHRtPQ6uM3NSZdtwRPoKLpM4UCCUnHx7jHZ714vh1 TW5eSIYdShKvw6Xpe9Let1eeT5Sk7/rW4FihqaL3DgYJIO225vCPI1g3rQxOYHG+1011PlalXuzoJ YBx4D5X7StVEwX6930ErFmRy9HBtH0S3t4h6ErwXS+Fb9tmPNxXcP2iTc0/d8PIOjseW98uKzCvJ+ p60OKLivrx6773qpeu/Z3iBg71IDLzy0GFKsRQGiavpYF8Sog3aFdDZuk2mt00Clrx3DanTq9zixp vHHqQinxeW0/axP/Z0VPuw==; Received: from ch-vpn.virtuozzo.com ([130.117.225.6] helo=sky) by relay.virtuozzo.com with esmtps (TLS1.3) tls TLS_AES_256_GCM_SHA384 (Exim 4.96) (envelope-from ) id 1xSylS-005tLh-35; Mon, 16 Nov 2026 16:41:17 +0100 From: Alexander Ivanov To: andrey.zhadchenko@virtuozzo.com Date: Mon, 16 Nov 2026 16:41:19 +0100 Message-ID: <20261116154119.2979718-10-alexander.ivanov@virtuozzo.com> X-Mailer: git-send-email 2.53.0 In-Reply-To: <20261116154119.2979718-1-alexander.ivanov@virtuozzo.com> References: <20261116154119.2979718-1-alexander.ivanov@virtuozzo.com> MIME-Version: 1.0 X-OZ-Fwd: true Cc: devel@openvz.org Subject: [Devel] [PATCH hci-8.1 9/9] drivers/vhost/blk: fix a hang on release after the vhost worker is killed X-BeenThere: devel@openvz.org X-Mailman-Version: 2.1.12 Precedence: list List-Id: OpenVZ development List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit Sender: devel-bounces@openvz.org Errors-To: devel-bounces@openvz.org When the owner is killed, vhost_worker_killed() detaches the worker from the vqs. A bio completing after that fails to queue the completion work, so its request stays on llhead and is never removed from req_inflight. vhost_blk_flush() on release then waits forever and the process is stuck in D state. Any kill of a VM with I/O in flight can hit this. If the work cannot be queued, drop the completed requests right in the bio end_io: forget them without writing a status, as there is no guest left to see it. llist_del_all() makes sure a request is dropped once even if it races with the last run of the host kick handler. forget_request() can now run in irq context, so take flush_lock with interrupts disabled. The end_io may run in atomic context and the request buffers may be vmalloc'ed, so free them on release instead: a dropped request is the one left with ->inflight set. Once a request is on llhead, a concurrent consumer may forget it and let release free the request array and blk while the end_io is still using blk_vq. Keep the end_io tail in an RCU read-side section and wait for a grace period before freeing the requests. The same window existed before with the host kick handler as the consumer. https://virtuozzo.atlassian.net/browse/VSTOR-152175 Feature: vhost-blk: in-kernel accelerator for virtio-blk guests Signed-off-by: Alexander Ivanov --- drivers/vhost/blk.c | 52 +++++++++++++++++++++++++++++++++------------ 1 file changed, 39 insertions(+), 13 deletions(-) diff --git a/drivers/vhost/blk.c b/drivers/vhost/blk.c index b95358cdf3bc..b67255580031 100644 --- a/drivers/vhost/blk.c +++ b/drivers/vhost/blk.c @@ -146,6 +146,8 @@ static inline int vhost_blk_set_status(struct vhost_blk_req *req, u8 status) return 0; } +static void vhost_blk_drop_completed(struct vhost_blk_vq *blk_vq); + static void vhost_blk_req_done(struct bio *bio) { struct vhost_blk_req *req = bio->bi_private; @@ -168,8 +170,14 @@ static void vhost_blk_req_done(struct bio *bio) } if (atomic_dec_and_test(&req->bio_nr)) { - llist_add(&req->llnode, &req->blk_vq->llhead); - vhost_vq_work_queue(&req->blk_vq->vq, &req->blk_vq->work); + struct vhost_blk_vq *blk_vq = req->blk_vq; + + /* req and blk may be freed once req is on llhead */ + rcu_read_lock(); + llist_add(&req->llnode, &blk_vq->llhead); + if (!vhost_vq_work_queue(&blk_vq->vq, &blk_vq->work)) + vhost_blk_drop_completed(blk_vq); + rcu_read_unlock(); } } @@ -394,22 +402,34 @@ static inline void vhost_blk_bio_send(struct vhost_blk_req *req) static inline void note_request(struct vhost_blk_req *req) { - spin_lock(&req->blk->flush_lock); + spin_lock_irq(&req->blk->flush_lock); req->req_bin = req->blk->new_req_bin; atomic_inc(&req->blk->req_inflight[req->req_bin]); - spin_unlock(&req->blk->flush_lock); + spin_unlock_irq(&req->blk->flush_lock); } static inline void forget_request(struct vhost_blk_req *req) { struct vhost_blk *blk = req->blk; + unsigned long flags; int zero; - spin_lock(&blk->flush_lock); + spin_lock_irqsave(&blk->flush_lock, flags); zero = atomic_dec_and_test(&blk->req_inflight[req->req_bin]); if (zero && blk->during_flush) wake_up(&blk->flush_wait); - spin_unlock(&blk->flush_lock); + spin_unlock_irqrestore(&blk->flush_lock, flags); +} + +/* Called when the worker is killed: nobody will complete these to the guest */ +static void vhost_blk_drop_completed(struct vhost_blk_vq *blk_vq) +{ + struct vhost_blk_req *req, *tmp; + struct llist_node *llnode; + + llnode = llist_del_all(&blk_vq->llhead); + llist_for_each_entry_safe(req, tmp, llnode, llnode) + forget_request(req); } static int vhost_blk_req_submit(struct vhost_blk_req *req) @@ -688,12 +708,12 @@ static void vhost_blk_flush(struct vhost_blk *blk) { int flush_bin; - spin_lock(&blk->flush_lock); + spin_lock_irq(&blk->flush_lock); WARN_ON(blk->during_flush); blk->during_flush = 1; flush_bin = blk->new_req_bin; blk->new_req_bin = !blk->new_req_bin; - spin_unlock(&blk->flush_lock); + spin_unlock_irq(&blk->flush_lock); vhost_dev_flush(&blk->dev); /* @@ -707,15 +727,15 @@ static void vhost_blk_flush(struct vhost_blk *blk) */ wait_event(blk->flush_wait, !atomic_read(&blk->req_inflight[flush_bin])); - spin_lock(&blk->flush_lock); + spin_lock_irq(&blk->flush_lock); blk->during_flush = 0; - spin_unlock(&blk->flush_lock); + spin_unlock_irq(&blk->flush_lock); } static void vhost_blk_drop_backend(struct vhost_blk *blk) { struct vhost_virtqueue *vq; - int i; + int i, j; if (!blk->backend) return; @@ -729,10 +749,16 @@ static void vhost_blk_drop_backend(struct vhost_blk *blk) } vhost_blk_flush(blk); + synchronize_rcu(); for (i = 0; i < VHOST_BLK_VQ_MAX; i++) { - kvfree(blk->vqs[i].req); - blk->vqs[i].req = NULL; + struct vhost_blk_vq *blk_vq = &blk->vqs[i]; + + for (j = 0; blk_vq->req && j < blk_vq->vq.num; j++) + if (blk_vq->req[j].inflight) + vhost_blk_req_cleanup(&blk_vq->req[j]); + kvfree(blk_vq->req); + blk_vq->req = NULL; } fput(blk->backend); -- 2.53.0 _______________________________________________ Devel mailing list Devel@openvz.org https://lists.openvz.org/mailman/listinfo/devel