From patchwork Sat Jan 18 13:42:10 2020 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 8bit X-Patchwork-Submitter: =?utf-8?q?Nicol=C3=B2_Balzarotti?= X-Patchwork-Id: 19872 Return-Path: X-Original-To: patchwork@mira.cbaines.net Delivered-To: patchwork@mira.cbaines.net Received: by mira.cbaines.net (Postfix, from userid 113) id 5885717A2D; Sat, 18 Jan 2020 13:43:11 +0000 (GMT) X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on mira.cbaines.net X-Spam-Level: X-Spam-Status: No, score=-1.9 required=5.0 tests=BAYES_00,FREEMAIL_FROM, T_DKIM_INVALID,URIBL_BLOCKED autolearn=unavailable autolearn_force=no version=3.4.0 Received: from lists.gnu.org (lists.gnu.org [209.51.188.17]) by mira.cbaines.net (Postfix) with ESMTP id E3F0F17884 for ; Sat, 18 Jan 2020 13:43:10 +0000 (GMT) Received: from localhost ([::1]:40444 helo=lists1p.gnu.org) by lists.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1isoNa-00041w-Eq for patchwork@mira.cbaines.net; Sat, 18 Jan 2020 08:43:10 -0500 Received: from eggs.gnu.org ([2001:470:142:3::10]:43462) by lists.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1isoNU-00041U-3S for guix-patches@gnu.org; Sat, 18 Jan 2020 08:43:05 -0500 Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71) (envelope-from ) id 1isoNS-0000pK-MZ for guix-patches@gnu.org; Sat, 18 Jan 2020 08:43:04 -0500 Received: from debbugs.gnu.org ([209.51.188.43]:34744) by eggs.gnu.org with esmtps (TLS1.0:RSA_AES_128_CBC_SHA1:16) (Exim 4.71) (envelope-from ) id 1isoNS-0000pF-Jy for guix-patches@gnu.org; Sat, 18 Jan 2020 08:43:02 -0500 Received: from Debian-debbugs by debbugs.gnu.org with local (Exim 4.84_2) (envelope-from ) id 1isoNS-0007Jk-IS for guix-patches@gnu.org; Sat, 18 Jan 2020 08:43:02 -0500 X-Loop: help-debbugs@gnu.org Subject: [bug#38546] =?utf-8?b?W05pY29sw7I=?= Balzarotti] [PATCH 00/10] Update julia to 1.3.1, fix precompilation, add HTTP.jl In-Reply-To: <87v9qpvbyr.fsf@guixSD.i-did-not-set--mail-host-address--so-tickle-me> Resent-From: anothersms@gmail.com (=?utf-8?q?Nicol=C3=B2?= Balzarotti) Original-Sender: "Debbugs-submit" Resent-CC: guix-patches@gnu.org Resent-Date: Sat, 18 Jan 2020 13:43:02 +0000 Resent-Message-ID: Resent-Sender: help-debbugs@gnu.org X-GNU-PR-Message: followup 38546 X-GNU-PR-Package: guix-patches X-GNU-PR-Keywords: patch To: 38546@debbugs.gnu.org Received: via spool by 38546-submit@debbugs.gnu.org id=B38546.157935494228077 (code B ref 38546); Sat, 18 Jan 2020 13:43:02 +0000 Received: (at 38546) by debbugs.gnu.org; 18 Jan 2020 13:42:22 +0000 Received: from localhost ([127.0.0.1]:40717 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1isoMn-0007Im-8j for submit@debbugs.gnu.org; Sat, 18 Jan 2020 08:42:22 -0500 Received: from mail-wm1-f42.google.com ([209.85.128.42]:40889) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1isoMj-0007IW-Pj for 38546@debbugs.gnu.org; Sat, 18 Jan 2020 08:42:20 -0500 Received: by mail-wm1-f42.google.com with SMTP id t14so10280365wmi.5 for <38546@debbugs.gnu.org>; Sat, 18 Jan 2020 05:42:17 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=from:to:subject:references:date:message-id:mime-version :content-transfer-encoding; bh=bW1S8bDWJbJhqaIS9Jdn2qL5jp0mx9Yn5vHV92cDygE=; b=f/WG3z9595Scw+5nBwAsUjIZtZJOvZ2E/rhhrbVFRu7KernxvlWMCGIEpTy2pQxsfC OVsHovgpKtQheF5AUADiU0h2krVTGNwA3EI7D5VgisLPHAIiOFeRIjRYGXI3vB+jSfze KmEeDg1dw/2iHAGK3gihIGU0iaB2ukkxf5ym0X4wmz8soc7UhNaFIPUp9g5cwa6sz0lx Y6LfwxdrLSK7RE97dRV8tdPpmn971GuS0jKYFNute/w4N4+Z5iNq+aZxku7q4itVDWrP uDJT1SHls0/1//3mCHD4NzQXfcqkqbcGtZKh8umrv6fYEWvR919Z1LDJegT7nDiofryu aLSw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:from:to:subject:references:date:message-id :mime-version:content-transfer-encoding; bh=bW1S8bDWJbJhqaIS9Jdn2qL5jp0mx9Yn5vHV92cDygE=; b=qlaPj75Nu/rsGM8hz88IpVV29ZNllKgnt6+JbfKMLpXyUIgqleErY8HhYZkcMPVc4V x76lvl7OFeOHN5kgpyaVR2mB0RMJ329KOt01ZA4+KfVlU+edEZqX9AKjhNw/izCEQlVB p6E/+cd08BPmqv1WiFDlKTntojyq6qs6hhS/9lMEJQGMALUB/snRnqFt5z1Ewx7W3LLD lmQmF1uu7Y/ibREcLDfqzq5Z1CxIwAgjdK9qR0NmxTjrmBvUBdqcmw0HX5/IRP7/P4R0 ir6u+Zyh0AmY5XpQau21xlPOhCyGf5I0gYrYWxCyQj/6gI9C/xHi9R1QgQF1pz6tdU3T 0n1w== X-Gm-Message-State: APjAAAV1fXfyFT9gSUh8R70PIqA2jlr8CrCnJmAu6gDYLEAOSXrJ7TN1 DYqn3rF2tmdCxAOMH5kUHySR1zP+ X-Google-Smtp-Source: APXvYqwez6mncml5ubP5IehquWyBNv3FwL7xOC2Rfsa0Q94Dt0yez6piqC8HVNoFYWbNm8zODCZPNQ== X-Received: by 2002:a05:600c:1050:: with SMTP id 16mr9853939wmx.20.1579354931688; Sat, 18 Jan 2020 05:42:11 -0800 (PST) Received: from guixSD (host146-19-dynamic.50-79-r.retail.telecomitalia.it. [79.50.19.146]) by smtp.gmail.com with ESMTPSA id p17sm362366wmk.30.2020.01.18.05.42.10 for <38546@debbugs.gnu.org> (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Sat, 18 Jan 2020 05:42:11 -0800 (PST) From: anothersms@gmail.com (=?utf-8?q?Nicol=C3=B2?= Balzarotti) References: <87zhekvqpj.fsf@guixSD.i-did-not-set--mail-host-address--so-tickle-me> Date: Sat, 18 Jan 2020 14:42:10 +0100 Message-ID: <8736ccvq31.fsf@guixSD.i-did-not-set--mail-host-address--so-tickle-me> MIME-Version: 1.0 X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list X-detected-operating-system: by eggs.gnu.org: GNU/Linux 2.2.x-3.x [generic] X-Received-From: 209.51.188.43 X-BeenThere: guix-patches@gnu.org List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: guix-patches-bounces+patchwork=mira.cbaines.net@gnu.org Sender: "Guix-patches" X-getmail-retrieved-from-mailbox: Patches Ok I had time to look at this again. 1. Package installation can be done both the julia way and the guix way 2. SOURCE_DATE_EPOCH is respected in package precompile timestamp. Other fixes are needed to get reproducible builds, but for now that means that package cache is used. 3. This patch adds some first julia package (HTTP.jl and dependencies) 4. Updated julia to 1.3.1 (latest release). It's working great and the build recipe is simplified a lot. However, some test is failing. The "interesting" part is that when running tests alone, they are working. It seems like the problem arise when tests are run on the _same core_ and not on different cores. I opened a issue upstream for this (https://github.com/JuliaLang/julia/issues/34330), I'll have to look further on it, but for now if it's fine for me this is ready to be merged. I'm sending the patch series here. Thanks, Nicolò Ludovic Courtès writes: > Hi, > > (+Cc: bug report.) > > Nicolò Balzarotti skribis: > >> Ludovic Courtès writes: >> >>> Hi! >>> >>> nixo skribis: >>> >>>> This set of patches improve the state of julia-build-system. >>>> >>>> 1. set path JULIA_LOAD_PATH to enable installing packages, and >>>> JULIA_DEPOT_PATH to allow guix-precompiled cache to be recognized by julia. To >>> >>> These two environment variables are supported upstream, right? >> >> Yes, those variables are documented here: >> https://docs.julialang.org/en/v1/manual/environment-variables/index.html > > Great. > >> Should user be allowed to manually install packages in his own private >> home folder manually? (I just tried with R: R recognize the store is RO >> and ask for an alternative path). I'll try to allow "standard" package >> installation and submit the patch again (also, I just read you other >> comments, so I'll fix everything!) > > I think users should have the option to install packages in the normal > Julia way, without Guix. > >>>> do this, a small "hack" with libfaketime was required (julia decides if the >>>> cache is valid by comparing source ".jl" mtime with cache ".ji" file, in which >>>> julia stores a timestamp. We need to force this timestamp to be equal to the >>>> mtime of guix-store files). >>> >>> OK. This hack shouldn’t break “normal” Julia uses (outside of the >>> store), right? >> You are right, the issue is that julia finds its src (.jl) file to have >> a different (although older) timestamp (because guix fixes the >> mtime). This applies only to cache files placed in the store. Other >> cache files (non-guix installed files) have the right timestamp, so are >> not affected (I don't know if this explanation is clear. The TLDR is: >> with this hack store works without double-precompilation, non-store >> works normally, too). >> However, I'll check if I can make it work with SOURCE_DATE_EPOCH. I >> already read the code responsible for precompilation, so hopefully it >> won't take too much time > > Awesome, thanks! > > Ludo’.