From patchwork Fri Mar 27 16:26:52 2020 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 8bit X-Patchwork-Submitter: Arun Isaac X-Patchwork-Id: 20910 Return-Path: X-Original-To: patchwork@mira.cbaines.net Delivered-To: patchwork@mira.cbaines.net Received: by mira.cbaines.net (Postfix, from userid 113) id 71B6727BBEA; Fri, 27 Mar 2020 16:28:18 +0000 (GMT) X-Spam-Checker-Version: SpamAssassin 3.4.2 (2018-09-13) on mira.cbaines.net X-Spam-Level: X-Spam-Status: No, score=-2.8 required=5.0 tests=BAYES_00,DKIM_SIGNED, MAILING_LIST_MULTI,T_DKIM_INVALID,URIBL_BLOCKED autolearn=unavailable autolearn_force=no version=3.4.2 Received: from lists.gnu.org (lists.gnu.org [209.51.188.17]) by mira.cbaines.net (Postfix) with ESMTP id C9F1727BBE4 for ; Fri, 27 Mar 2020 16:28:17 +0000 (GMT) Received: from localhost ([::1]:44152 helo=lists1p.gnu.org) by lists.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1jHrqD-0003eS-DU for patchwork@mira.cbaines.net; Fri, 27 Mar 2020 12:28:17 -0400 Received: from eggs.gnu.org ([2001:470:142:3::10]:42352) by lists.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1jHrq2-0003Qg-46 for guix-patches@gnu.org; Fri, 27 Mar 2020 12:28:07 -0400 Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71) (envelope-from ) id 1jHrq0-0007Ae-FU for guix-patches@gnu.org; Fri, 27 Mar 2020 12:28:06 -0400 Received: from debbugs.gnu.org ([209.51.188.43]:55550) by eggs.gnu.org with esmtps (TLS1.0:RSA_AES_128_CBC_SHA1:16) (Exim 4.71) (envelope-from ) id 1jHrq0-00078A-CH for guix-patches@gnu.org; Fri, 27 Mar 2020 12:28:04 -0400 Received: from Debian-debbugs by debbugs.gnu.org with local (Exim 4.84_2) (envelope-from ) id 1jHrpz-0000X4-9G for guix-patches@gnu.org; Fri, 27 Mar 2020 12:28:03 -0400 X-Loop: help-debbugs@gnu.org Subject: [bug#39258] [PATCH v3 1/3] guix: Generate package metadata cache. Resent-From: Arun Isaac Original-Sender: "Debbugs-submit" Resent-CC: guix-patches@gnu.org Resent-Date: Fri, 27 Mar 2020 16:28:03 +0000 Resent-Message-ID: Resent-Sender: help-debbugs@gnu.org X-GNU-PR-Message: followup 39258 X-GNU-PR-Package: guix-patches X-GNU-PR-Keywords: To: 39258@debbugs.gnu.org Cc: Arun Isaac , mail@ambrevar.xyz, ludo@gnu.org, zimon.toutoune@gmail.com Received: via spool by 39258-submit@debbugs.gnu.org id=B39258.15853264451964 (code B ref 39258); Fri, 27 Mar 2020 16:28:03 +0000 Received: (at 39258) by debbugs.gnu.org; 27 Mar 2020 16:27:25 +0000 Received: from localhost ([127.0.0.1]:33286 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1jHrpN-0000Va-C0 for submit@debbugs.gnu.org; Fri, 27 Mar 2020 12:27:25 -0400 Received: from mugam.systemreboot.net ([139.59.75.54]:36906) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1jHrpE-0000Uo-Nv for 39258@debbugs.gnu.org; Fri, 27 Mar 2020 12:27:19 -0400 DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=systemreboot.net; s=default; h=Content-Transfer-Encoding:Content-Type: MIME-Version:References:In-Reply-To:Message-Id:Date:Subject:Cc:To:From:Sender :Reply-To:Content-ID:Content-Description:Resent-Date:Resent-From: Resent-Sender:Resent-To:Resent-Cc:Resent-Message-ID:List-Id:List-Help: List-Unsubscribe:List-Subscribe:List-Post:List-Owner:List-Archive; bh=8r87CbgSCGqiElc44RBwtu0UE2I72qor0+QbDZom44U=; b=HLobDPTt9fY+UkyrARSke3D0dL dfxG+XkbwTtAu9ugqttjdgWVcHDzBXGWNsjoKCeALbvfnUOif/Sa/fmKCgthAAo217qLNSarIABmK 7g2Kpi8jFnEG/uG8cgzs96FmNoW4Sp8oRLKEcUIzvnDJqaa74TZjTbBRj2Asq6u95GtI=; Received: from [192.168.2.1] (helo=steel.lan) by systemreboot.net with esmtpsa (TLS1.3) tls TLS_AES_256_GCM_SHA384 (Exim 4.93) (envelope-from ) id 1jHrp4-0044U6-LV; Fri, 27 Mar 2020 21:57:06 +0530 From: Arun Isaac Date: Fri, 27 Mar 2020 21:56:52 +0530 Message-Id: <20200327162654.18785-2-arunisaac@systemreboot.net> X-Mailer: git-send-email 2.25.1 In-Reply-To: <20200327162654.18785-1-arunisaac@systemreboot.net> References: <20200327162654.18785-1-arunisaac@systemreboot.net> MIME-Version: 1.0 X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list X-detected-operating-system: by eggs.gnu.org: GNU/Linux 2.2.x-3.x [generic] X-Received-From: 209.51.188.43 X-BeenThere: guix-patches@gnu.org List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: guix-patches-bounces+patchwork=mira.cbaines.net@gnu.org Sender: "Guix-patches" X-getmail-retrieved-from-mailbox: Patches * gnu/packages.scm (%package-metadata-cache-file): New variable. (generate-package-metadata-cache): New function. * guix/channels.scm (package-metadata-cache-file): New function. (%channel-profile-hooks): Add package-metadata-cache-file. --- gnu/packages.scm | 50 ++++++++++++++++++++++++++++++++++++++++++++++- guix/channels.scm | 34 +++++++++++++++++++++++++++++++- 2 files changed, 82 insertions(+), 2 deletions(-) diff --git a/gnu/packages.scm b/gnu/packages.scm index d22c992bb1..c0b527acf0 100644 --- a/gnu/packages.scm +++ b/gnu/packages.scm @@ -4,6 +4,7 @@ ;;; Copyright © 2014 Eric Bavier ;;; Copyright © 2016, 2017 Alex Kost ;;; Copyright © 2016 Mathieu Lirzin +;;; Copyright © 2020 Arun Isaac ;;; ;;; This file is part of GNU Guix. ;;; @@ -64,7 +65,8 @@ specification->location specifications->manifest - generate-package-cache)) + generate-package-cache + generate-package-metadata-cache)) ;;; Commentary: ;;; @@ -426,6 +428,52 @@ reducing the memory footprint." #:opts '(#:to-file? #t))))) cache-file) +(define %package-metadata-cache-file + ;; Location of the package metadata cache. + "/lib/guix/package-metadata.cache") + +(define (generate-package-metadata-cache directory) + "Generate under DIRECTORY a cache of the metadata of all available packages. + +The primary purpose of this cache is to speed up package metadata lookup +during package search so that we don't have to traverse and load all the +package modules." + (define cache-file + (string-append directory %package-metadata-cache-file)) + + (define (package ;;; Copyright © 2018 Ricardo Wurmus ;;; Copyright © 2019 Jan (janneke) Nieuwenhuizen +;;; Copyright © 2020 Arun Isaac ;;; ;;; This file is part of GNU Guix. ;;; @@ -581,9 +582,40 @@ be used as a profile hook." (hook . package-cache)) #:local-build? #t))) +(define (package-metadata-cache-file manifest) + "Build a package metadata cache file for the instance in MANIFEST. This is +meant to be used as a profile hook." + (mlet %store-monad ((profile (profile-derivation manifest + #:hooks '()))) + + (define build + #~(begin + (use-modules (gnu packages)) + + (if (defined? 'generate-package-metadata-cache) + (begin + ;; Delegate package cache generation to the inferior. + (format (current-error-port) + "Generating package metadata cache for '~a'...~%" + #$profile) + (generate-package-metadata-cache #$output)) + (mkdir #$output)))) + + (gexp->derivation-in-inferior "guix-package-metadata-cache" build + profile + + ;; If the Guix in PROFILE is too old and + ;; lacks 'guix repl', don't build the cache + ;; instead of failing. + #:silent-failure? #t + + #:properties '((type . profile-hook) + (hook . package-cache)) + #:local-build? #t))) + (define %channel-profile-hooks ;; The default channel profile hooks. - (cons package-cache-file %default-profile-hooks)) + (cons* package-cache-file package-metadata-cache-file %default-profile-hooks)) (define (channel-instances->derivation instances) "Return the derivation of the profile containing INSTANCES, a list of From patchwork Fri Mar 27 16:26:53 2020 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 8bit X-Patchwork-Submitter: Arun Isaac X-Patchwork-Id: 20908 Return-Path: X-Original-To: patchwork@mira.cbaines.net Delivered-To: patchwork@mira.cbaines.net Received: by mira.cbaines.net (Postfix, from userid 113) id CF4DB27BBE4; Fri, 27 Mar 2020 16:28:12 +0000 (GMT) X-Spam-Checker-Version: SpamAssassin 3.4.2 (2018-09-13) on mira.cbaines.net X-Spam-Level: X-Spam-Status: No, score=-2.8 required=5.0 tests=BAYES_00,DKIM_SIGNED, MAILING_LIST_MULTI,T_DKIM_INVALID,URIBL_BLOCKED autolearn=unavailable autolearn_force=no version=3.4.2 Received: from lists.gnu.org (lists.gnu.org [209.51.188.17]) by mira.cbaines.net (Postfix) with ESMTP id 38B1F27BBEA for ; Fri, 27 Mar 2020 16:28:12 +0000 (GMT) Received: from localhost ([::1]:44146 helo=lists1p.gnu.org) by lists.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1jHrq7-0003Rm-PH for patchwork@mira.cbaines.net; Fri, 27 Mar 2020 12:28:11 -0400 Received: from eggs.gnu.org ([2001:470:142:3::10]:42324) by lists.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1jHrq0-0003P3-Dw for guix-patches@gnu.org; Fri, 27 Mar 2020 12:28:05 -0400 Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71) (envelope-from ) id 1jHrpz-00077W-0l for guix-patches@gnu.org; Fri, 27 Mar 2020 12:28:04 -0400 Received: from debbugs.gnu.org ([209.51.188.43]:55549) by eggs.gnu.org with esmtps (TLS1.0:RSA_AES_128_CBC_SHA1:16) (Exim 4.71) (envelope-from ) id 1jHrpy-00076g-Ta for guix-patches@gnu.org; Fri, 27 Mar 2020 12:28:02 -0400 Received: from Debian-debbugs by debbugs.gnu.org with local (Exim 4.84_2) (envelope-from ) id 1jHrpy-0000Wx-QF for guix-patches@gnu.org; Fri, 27 Mar 2020 12:28:02 -0400 X-Loop: help-debbugs@gnu.org Subject: [bug#39258] [PATCH v3 2/3] guix: Search package metadata cache. Resent-From: Arun Isaac Original-Sender: "Debbugs-submit" Resent-CC: guix-patches@gnu.org Resent-Date: Fri, 27 Mar 2020 16:28:02 +0000 Resent-Message-ID: Resent-Sender: help-debbugs@gnu.org X-GNU-PR-Message: followup 39258 X-GNU-PR-Package: guix-patches X-GNU-PR-Keywords: To: 39258@debbugs.gnu.org Cc: Arun Isaac , mail@ambrevar.xyz, ludo@gnu.org, zimon.toutoune@gmail.com Received: via spool by 39258-submit@debbugs.gnu.org id=B39258.15853264401946 (code B ref 39258); Fri, 27 Mar 2020 16:28:02 +0000 Received: (at 39258) by debbugs.gnu.org; 27 Mar 2020 16:27:20 +0000 Received: from localhost ([127.0.0.1]:33284 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1jHrpH-0000V8-T2 for submit@debbugs.gnu.org; Fri, 27 Mar 2020 12:27:20 -0400 Received: from mugam.systemreboot.net ([139.59.75.54]:36900) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1jHrpD-0000Uk-4S for 39258@debbugs.gnu.org; Fri, 27 Mar 2020 12:27:17 -0400 DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=systemreboot.net; s=default; h=Content-Transfer-Encoding:Content-Type: MIME-Version:References:In-Reply-To:Message-Id:Date:Subject:Cc:To:From:Sender :Reply-To:Content-ID:Content-Description:Resent-Date:Resent-From: Resent-Sender:Resent-To:Resent-Cc:Resent-Message-ID:List-Id:List-Help: List-Unsubscribe:List-Subscribe:List-Post:List-Owner:List-Archive; bh=8009glw+epzSdw5fvr0/RvcHVylaG/W/J8vu/6Gx8iQ=; b=TArhqYsNVyfjNE+iMhCyJ6+Ldf cHHBOZQNPRkdwq4GhNmuazzVUSQzgFlioFNcUpS5JicSer6p0hoADGBPVi893FFqKMwtHGlHKbYeu UBoPMkK0jy0ydl4sxFv57ekWh9ObiunWgWPXm8E4HJB6UDrvWSux0WCb0OlzBBXyi/dI=; Received: from [192.168.2.1] (helo=steel.lan) by systemreboot.net with esmtpsa (TLS1.3) tls TLS_AES_256_GCM_SHA384 (Exim 4.93) (envelope-from ) id 1jHrp5-0044U6-08; Fri, 27 Mar 2020 21:57:07 +0530 From: Arun Isaac Date: Fri, 27 Mar 2020 21:56:53 +0530 Message-Id: <20200327162654.18785-3-arunisaac@systemreboot.net> X-Mailer: git-send-email 2.25.1 In-Reply-To: <20200327162654.18785-1-arunisaac@systemreboot.net> References: <20200327162654.18785-1-arunisaac@systemreboot.net> MIME-Version: 1.0 X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list X-detected-operating-system: by eggs.gnu.org: GNU/Linux 2.2.x-3.x [generic] X-Received-From: 209.51.188.43 X-BeenThere: guix-patches@gnu.org List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: guix-patches-bounces+patchwork=mira.cbaines.net@gnu.org Sender: "Guix-patches" X-getmail-retrieved-from-mailbox: Patches * gnu/packages.scm (search-packages): New function. * guix/packages.scm (): New record type. --- gnu/packages.scm | 38 ++++++++++++++++++++++++++++++++++++++ guix/packages.scm | 32 ++++++++++++++++++++++++++++++++ 2 files changed, 70 insertions(+) diff --git a/gnu/packages.scm b/gnu/packages.scm index c0b527acf0..2510b1fe49 100644 --- a/gnu/packages.scm +++ b/gnu/packages.scm @@ -59,6 +59,7 @@ find-packages-by-name find-package-locations find-best-packages-by-name + search-packages specification->package specification->package+output @@ -474,6 +475,43 @@ package modules." #:opts '(#:to-file? #t))))) cache-file) +(define (search-packages profile regexps) + "Return a list of pairs: objects corresponding to +packages whose name, synopsis, description, or output matches at least one of +REGEXPS sorted by relevance, and its non-zero relevance score." + (define cache-file + (string-append profile %package-metadata-cache-file)) + + (define cache + (catch 'system-error + (lambda () + (map (match-lambda + (#(name version dependencies outputs systems + synopsis description home-page (file line column)) + (make-package-metadata + name version dependencies outputs systems + synopsis description home-page + (location file line column)))) + (load-compiled cache-file))) + (lambda args + (if (= ENOENT (system-error-errno args)) + #f + (apply throw args))))) + + (let ((matches + (filter-map (lambda (package-metadata) + (let ((score (package-relevance package-metadata regexps))) + (and (positive? score) + (cons package-metadata score)))) + cache))) + (sort matches + (lambda (m1 m2) + (match m1 + ((package1 . score1) + (match m2 + ((package2 . score2) + (> score1 score2))))))))) + (define %sigint-prompt ;; The prompt to jump to upon SIGINT. diff --git a/guix/packages.scm b/guix/packages.scm index 70b1478c91..bb06baa1ee 100644 --- a/guix/packages.scm +++ b/guix/packages.scm @@ -5,6 +5,7 @@ ;;; Copyright © 2016 Alex Kost ;;; Copyright © 2017, 2019 Efraim Flashner ;;; Copyright © 2019 Marius Bakke +;;; Copyright © 2020 Arun Isaac ;;; ;;; This file is part of GNU Guix. ;;; @@ -115,6 +116,21 @@ transitive-input-references + package-metadata + make-package-metadata + package-metadata? + this-package-metadata + package-metadata-name + package-metadata-version + package-metadata-dependencies + package-metadata-outputs + package-metadata-synopsis + package-metadata-description + package-metadata-license + package-metadata-home-page + package-metadata-supported-systems + package-metadata-location + %supported-systems %hurd-systems %hydra-supported-systems @@ -310,6 +326,22 @@ name of its URI." package) 16))))) +(define-record-type* + package-metadata make-package-metadata + package-metadata? + this-package-metadata + (name package-metadata-name) + (version package-metadata-version) + (dependencies package-metadata-dependencies) + (outputs package-metadata-outputs) + (supported-systems package-metadata-supported-systems) + (synopsis package-metadata-synopsis) + (description package-metadata-description) + ;; TODO: Add license + ;; (license package-metadata-license) + (home-page package-metadata-home-page) + (location package-metadata-location)) + (define (package-upstream-name package) "Return the upstream name of PACKAGE, which could be different from the name it has in Guix." From patchwork Fri Mar 27 16:26:54 2020 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 8bit X-Patchwork-Submitter: Arun Isaac X-Patchwork-Id: 20909 Return-Path: X-Original-To: patchwork@mira.cbaines.net Delivered-To: patchwork@mira.cbaines.net Received: by mira.cbaines.net (Postfix, from userid 113) id 5948727BBEA; Fri, 27 Mar 2020 16:28:15 +0000 (GMT) X-Spam-Checker-Version: SpamAssassin 3.4.2 (2018-09-13) on mira.cbaines.net X-Spam-Level: X-Spam-Status: No, score=-2.8 required=5.0 tests=BAYES_00,DKIM_SIGNED, MAILING_LIST_MULTI,T_DKIM_INVALID,URIBL_BLOCKED autolearn=unavailable autolearn_force=no version=3.4.2 Received: from lists.gnu.org (lists.gnu.org [209.51.188.17]) by mira.cbaines.net (Postfix) with ESMTP id AB99E27BBE4 for ; Fri, 27 Mar 2020 16:28:14 +0000 (GMT) Received: from localhost ([::1]:44150 helo=lists1p.gnu.org) by lists.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1jHrqA-0003Vf-9S for patchwork@mira.cbaines.net; Fri, 27 Mar 2020 12:28:14 -0400 Received: from eggs.gnu.org ([2001:470:142:3::10]:42349) by lists.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1jHrq2-0003QI-0r for guix-patches@gnu.org; Fri, 27 Mar 2020 12:28:07 -0400 Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71) (envelope-from ) id 1jHrpz-00078h-TY for guix-patches@gnu.org; Fri, 27 Mar 2020 12:28:05 -0400 Received: from debbugs.gnu.org ([209.51.188.43]:55551) by eggs.gnu.org with esmtps (TLS1.0:RSA_AES_128_CBC_SHA1:16) (Exim 4.71) (envelope-from ) id 1jHrpz-00078a-QD for guix-patches@gnu.org; Fri, 27 Mar 2020 12:28:03 -0400 Received: from Debian-debbugs by debbugs.gnu.org with local (Exim 4.84_2) (envelope-from ) id 1jHrpz-0000XD-NS for guix-patches@gnu.org; Fri, 27 Mar 2020 12:28:03 -0400 X-Loop: help-debbugs@gnu.org Subject: [bug#39258] [PATCH v3 3/3] guix: Use package metadata cache for package search. Resent-From: Arun Isaac Original-Sender: "Debbugs-submit" Resent-CC: guix-patches@gnu.org Resent-Date: Fri, 27 Mar 2020 16:28:03 +0000 Resent-Message-ID: Resent-Sender: help-debbugs@gnu.org X-GNU-PR-Message: followup 39258 X-GNU-PR-Package: guix-patches X-GNU-PR-Keywords: To: 39258@debbugs.gnu.org Cc: Arun Isaac , mail@ambrevar.xyz, ludo@gnu.org, zimon.toutoune@gmail.com Received: via spool by 39258-submit@debbugs.gnu.org id=B39258.15853264461970 (code B ref 39258); Fri, 27 Mar 2020 16:28:03 +0000 Received: (at 39258) by debbugs.gnu.org; 27 Mar 2020 16:27:26 +0000 Received: from localhost ([127.0.0.1]:33288 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1jHrpN-0000Vd-O3 for submit@debbugs.gnu.org; Fri, 27 Mar 2020 12:27:26 -0400 Received: from mugam.systemreboot.net ([139.59.75.54]:36920) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1jHrpH-0000V4-9p for 39258@debbugs.gnu.org; Fri, 27 Mar 2020 12:27:20 -0400 DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=systemreboot.net; s=default; h=Content-Transfer-Encoding:Content-Type: MIME-Version:References:In-Reply-To:Message-Id:Date:Subject:Cc:To:From:Sender :Reply-To:Content-ID:Content-Description:Resent-Date:Resent-From: Resent-Sender:Resent-To:Resent-Cc:Resent-Message-ID:List-Id:List-Help: List-Unsubscribe:List-Subscribe:List-Post:List-Owner:List-Archive; bh=+xeMBbi0lnhx5F/Pbxsj5gXUpnAYL2wwHS+Oi9X11KI=; b=Mn/IRFNQScuBTd594sqeuVyXxL Nd4HWtEpXJppFEHuWW6qEiVZ4ILFNmh2UB/9/jqHp4irzu2wYt1pdMEWr/ZJcBYqu+N/bimzcWang 7ZJGrxvjZ/ExSuDiucJjkljp3ywl/GK+vBArd2+Vgp0yxrJZKzQwt05UDEj4bLrDs+qY=; Received: from [192.168.2.1] (helo=steel.lan) by systemreboot.net with esmtpsa (TLS1.3) tls TLS_AES_256_GCM_SHA384 (Exim 4.93) (envelope-from ) id 1jHrp6-0044U6-9U; Fri, 27 Mar 2020 21:57:08 +0530 From: Arun Isaac Date: Fri, 27 Mar 2020 21:56:54 +0530 Message-Id: <20200327162654.18785-4-arunisaac@systemreboot.net> X-Mailer: git-send-email 2.25.1 In-Reply-To: <20200327162654.18785-1-arunisaac@systemreboot.net> References: <20200327162654.18785-1-arunisaac@systemreboot.net> MIME-Version: 1.0 X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list X-detected-operating-system: by eggs.gnu.org: GNU/Linux 2.2.x-3.x [generic] X-Received-From: 209.51.188.43 X-BeenThere: guix-patches@gnu.org List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: guix-patches-bounces+patchwork=mira.cbaines.net@gnu.org Sender: "Guix-patches" X-getmail-retrieved-from-mailbox: Patches * guix/scripts/package.scm (process-query): Call search-packages and display-package-search-results instead of find-packages-by-description and display-search-results respectively. * guix/ui.scm (package-metadata->recutils): New function. (%package-metrics): Use package-metadata record field accessors. (package-relevance): Rename argument package to package-metadata. (display-package-search-results): New function. --- guix/scripts/package.scm | 5 +- guix/ui.scm | 132 ++++++++++++++++++++++++++++++++++++--- 2 files changed, 125 insertions(+), 12 deletions(-) diff --git a/guix/scripts/package.scm b/guix/scripts/package.scm index 110d4f2977..c11f92f5a2 100644 --- a/guix/scripts/package.scm +++ b/guix/scripts/package.scm @@ -7,6 +7,7 @@ ;;; Copyright © 2016 Benz Schenk ;;; Copyright © 2016 Chris Marusich ;;; Copyright © 2019 Tobias Geerinckx-Rice +;;; Copyright © 2020 Arun Isaac ;;; ;;; This file is part of GNU Guix. ;;; @@ -770,9 +771,9 @@ processed, #f otherwise." (_ #f)) opts)) (regexps (map (cut make-regexp* <> regexp/icase) patterns)) - (matches (find-packages-by-description regexps))) + (matches (search-packages (current-profile) regexps))) (leave-on-EPIPE - (display-search-results matches (current-output-port))) + (display-package-search-results matches (current-output-port))) #t)) (('show requested-name) diff --git a/guix/ui.scm b/guix/ui.scm index 1e24fe5dca..934699f065 100644 --- a/guix/ui.scm +++ b/guix/ui.scm @@ -14,6 +14,7 @@ ;;; Copyright © 2019 Chris Marusich ;;; Copyright © 2019 Tobias Geerinckx-Rice ;;; Copyright © 2019 Simon Tournier +;;; Copyright © 2020 Arun Isaac ;;; ;;; This file is part of GNU Guix. ;;; @@ -112,6 +113,7 @@ package-synopsis-string string->recutils package->recutils + package-metadata->recutils package-specification->name+version+output supports-hyperlinks? @@ -122,6 +124,7 @@ relevance package-relevance display-search-results + display-package-search-results with-profile-lock string->generations @@ -1484,6 +1487,75 @@ HYPERLINKS? is true, emit hyperlink escape sequences when appropriate." extra-fields) (newline port)) +(define* (package-metadata->recutils p port #:optional (width (%text-width)) + #:key + (hyperlinks? (supports-hyperlinks? port)) + (extra-fields '())) + "Write to PORT a `recutils' record of object P, arranging +to fit within WIDTH columns. EXTRA-FIELDS is a list of symbol/value pairs to +emit. When HYPERLINKS? is true, emit hyperlink escape sequences when +appropriate." + (define width* + ;; The available number of columns once we've taken into account space for + ;; the initial "+ " prefix. + (if (> width 2) (- width 2) width)) + + ;; Note: Don't i18n field names so that people can post-process it. + (format port "name: ~a~%" (package-metadata-name p)) + (format port "version: ~a~%" (package-metadata-version p)) + (format port "outputs: ~a~%" (string-join (package-metadata-outputs p))) + (format port "systems: ~a~%" + (string-join (package-metadata-supported-systems p))) + (format port "dependencies: ~a~%" + (string-join (package-metadata-dependencies p) " ")) + (format port "location: ~a~%" + (or (and=> (package-metadata-location p) + (if hyperlinks? location->hyperlink location->string)) + (G_ "unknown"))) + + ;; Note: Starting from version 1.6 or recutils, hyphens are not allowed in + ;; field identifiers. + (format port "homepage: ~a~%" (package-metadata-home-page p)) + + ;; TODO: Print license + ;; (format port "license: ~a~%" + ;; (match (package-metadata-license p) + ;; (((? license? licenses) ...) + ;; (string-join (map license-name licenses) + ;; ", ")) + ;; ((? license? license) + ;; (let ((text (license-name license)) + ;; (uri (license-uri license))) + ;; (if (and hyperlinks? uri (string-prefix? "http" uri)) + ;; (hyperlink uri text) + ;; text))) + ;; (x + ;; (G_ "unknown")))) + (format port "synopsis: ~a~%" + (string-map (match-lambda + (#\newline #\space) + (chr chr)) + (or (and=> (package-metadata-synopsis p) P_) + ""))) + (format port "~a~%" + (string->recutils + (string-trim-right + (parameterize ((%text-width width*)) + (texi->plain-text + (string-append "description: " + (or (and=> (package-metadata-description p) P_) + "")))) + #\newline))) + (for-each (match-lambda + ((field . value) + (let ((field (symbol->string field))) + (format port "~a: ~a~%" + field + (fill-paragraph (object->string value) width* + (string-length field)))))) + extra-fields) + (newline port)) + ;;; ;;; Searching. @@ -1528,34 +1600,74 @@ score, the more relevant OBJ is to REGEXPS." (define %package-metrics ;; Metrics used to compute the "relevance score" of a package against a set ;; of regexps. - `((,package-name . 4) + `((,package-metadata-name . 4) ;; Match against uncommon outputs. - (,(lambda (package) + (,(lambda (package-metadata) (filter (lambda (output) (not (member output ;; Some common outpus shared by many packages. '("out" "doc" "debug" "lib" "include" "bin")))) - (package-outputs package))) + (package-metadata-outputs package-metadata))) . 1) ;; Match regexps on the raw Texinfo since formatting it is quite expensive ;; and doesn't have much of an effect on search results. - (,(lambda (package) - (and=> (package-synopsis package) P_)) . 3) - (,(lambda (package) - (and=> (package-description package) P_)) . 2) + (,(lambda (package-metadata) + (and=> (package-metadata-synopsis package-metadata) P_)) . 3) + (,(lambda (package-metadata) + (and=> (package-metadata-description package-metadata) P_)) . 2) (,(lambda (type) - (match (and=> (package-location type) location-file) + (match (and=> (package-metadata-location type) location-file) ((? string? file) (basename file ".scm")) (#f ""))) . 1))) -(define (package-relevance package regexps) +(define (package-relevance package-metadata regexps) "Return a score denoting the relevance of PACKAGE for REGEXPS. A score of zero means that PACKAGE does not match any of REGEXPS." - (relevance package regexps %package-metrics)) + (relevance package-metadata regexps %package-metrics)) + +(define* (display-package-search-results matches port + #:key + (command "guix search")) + "Display MATCHES, a list of /score pairs. If PORT is a +terminal, print at most a full screen of results." + (define first-line + (port-line port)) + + (define max-rows + (and first-line (isatty? port) + (terminal-rows port))) + + (define (line-count str) + (string-count str #\newline)) + + (let loop ((matches matches)) + (match matches + (((package-metadata . score) rest ...) + (let* ((links? (supports-hyperlinks? port)) + (text (call-with-output-string + (lambda (port) + (package-metadata->recutils package-metadata port + #:hyperlinks? links? + #:extra-fields + `((relevance . ,score))))))) + (if (and (not (getenv "INSIDE_EMACS")) + max-rows + (> (port-line port) first-line) ;print at least one result + (> (+ 4 (line-count text) (port-line port)) + max-rows)) + (unless (null? rest) + (display-hint (format #f (G_ "Run @code{~a ... | less} \ +to view all the results.") + command))) + (begin + (display text port) + (loop rest))))) + (() + #t)))) (define* (display-search-results matches port #:key