2020-09-09 conda-forge core meeting
Zoom link What time is the meeting in my time zone last weeks meeting
Attendeesโ
- Jonathan Helmus
- Eric Dill
- CJ Wright
- Eli Rykoff
- Matthew Becker
- Uwe Korn
- Wolf Vollprecht
- John Kirkham
- Cheng Lee
- Filipe Fernandes
- Marcelo Trevisani
- Marcel Bargull
- Sylvain Corlay
- Isuru Fernando
- Ray Douglass
Agendaโ
Standing itemsโ
-
intros for new folks on the call
- (MRB) Eli R.
-
(CJ) budget
- current approvals are all up to date.
- screenshare and show the doc monthly?
- Link is in Keybase (numfocus_spreadsheets.txt)
- (MRB) AWS cannot use credits to pay our debts
- Should we ask Andy to ask them to forgive the debt directly? Ping Brian Grainger too?
- TODO: Sylvain email Matt Becker to contact Brian Grainger.
- TODO: Eric pay AWS bill and get reimbursement
- If we don't do the above, should we pay it off and then join the numfocus org to obtain access to the credits we have?
- NOTE: Whoever pays the debt will get reimbursement from conda-forge per the vote already passed (plus your credit card points!).
- Should we ask Andy to ask them to forgive the debt directly? Ping Brian Grainger too?
Your new agenda itemsโ
-
(IF) macOS arm64
- Cross compiling python recipes.
requirements:
build:
- cross-python # [build_platform != target_platform]
- python # [build_platform != target_platform]
- pip # [build_platform != target_platform]
- cython # [build_platform != target_platform]
host:
- python
- pip
- cython
run:
- python- Enabling the CDN for osx-arm64 now that conda-build 3.20.0 is out. (Jonathan is looking at this, might not be this week)
- How far do you go with the cross-compilation for macos-arm64?
- conda & conda-build for sure, not sure how much farther
- Jonathan bootstrapped this problem by building a python env and then building the packages inside of that environment (along the lines of https://github.com/jjhelmus/conda_from_scratch)
-
(MRB) Access to DTK from Eli R.
-
a colleague of mine has the chance to get an OSX ARM DTK for testing his scientific software
-
he needs conda/scipy/numpy/etc
-
he is a bit hesitant on making it available to use directly due to this language in the terms:
"Authorized Developers" means Your employees and contractors, members of Your organization or, if You are an educational institution, Your faculty, staff and students, who: (a) have a demonstrable need to know or use the Apple Software or Apple Services in order to develop and test Applications, and (b) to the extent they will access Apple Confidential Information, have written and binding agreements with You that prohibit the unauthorized use and disclosure of such confidential information.
-
is the language above an issue for anaconda inc access to DTK?
- Irrelavent; Anaconda, Inc will use its own DTK.
-
discussion items
- We clearly want to help and engage on this since scientific users are important!
- Do we as conda-forge want to try and get direct access to this for testing our builds?
- Could we do this without violating the terms above?
- How close are we on the scientific stack?
-
Notes
- If Eli is willing, have remote access on the CLI to test package builds
- If we're going to publish packages having been built on the Apple DTK, then need an extremely careful reading of the terms and conditions.
- Eli's perspective is to type some things locally and submit issues.
- Cross-compile and then test the cross-compiler?
- Plans
- Not engage lawyer (expensive and long)
- Try and set up weekly / biweekly sync with Eli to help diagnose issues live via Zoom. Post issues to
- Absolutely don't publish packages to anaconda.org
conda-build -t
on all mac packages. publish log to somewhere- Can we publish logs somewhere? Are created logs confidential because we created them on the DTK machine?
-
-
(ED) Reminder to vote on https://github.com/conda-forge/cfep/pull/37
-
(ED) Computer for Isuru
- Vote passed (14 ๐, 1 ๐)
- https://github.com/conda-forge/conda-forge.github.io/issues/1150
- Things to clarify:
- expectations around usage of machine
- expectations around making machine available to other members of conda-forge
- expectations around returning the machine
- How to actually purchase. Do we have NumFocus credit cards?
-
(MRB) github user @jan-janssen wants to list us in the "affiliated projects" section here https://pyiron.org/collaborators/
- numfocus trademark guidelines are: "allow most uses as long as it is clear the person using the mark does not appear to be the project or endorsed by the project (without specific permission to do so)"
- they say ultimately it is up to us
- are we ok with this user displaying our logo and calling us an "affiliated project"?
-
(MRB) github docker images
- AFAICT we cannot host public docker images on github unless we let anyone in conda-forge make images and push them
- quote from docs (https://docs.github.com/en/packages/managing-container-images-with-github-container-registry/configuring-access-control-and-visibility-for-container-images#configuring-visibility-of-container-images-for-an-organization)
- 'For organization image containers, organizations admins must enable public packages before you can set the visibility to public. For more information, see "Enabling GitHub Container Registry for your organization."'
- (IF) - from the docs it looks like we can't control them adding new packages, but we can control who have access to existing packages.
- I tried pushing an image and could not make it public.
- thus we need a separate org
- I propose
conda-forge-docker
-
(MRB) GCC 9.3.0 migration
-
I want to make sure I understand the list of things to do
-
we've built all of the compilers AFAIK
-
need to do a direct migration in the bot of the gfortran stack
-
do we want to change the libgfortran libs on linux to have the SO version in the library?
-
What am I missing?
-
Active votesโ
- passed! Exception section so that we can package things like black
- passed! Windows build machine for Isuru
Subteam updatesโ
Botโ
ARMโ
POWERโ
CUDAโ
Docsโ
staged-recipesโ
websiteโ
security+systemsโ
CI infrastructureโ
Compiler upgradeโ
CFEP updatesโ
Open PRsโ
-
cfep-04 X11 and CDT policy
- INACTIVE - Merge in with some inactive-esque status?
- Needs new champion. Thanks for your work on this pkgw! Has unaddressed comments from pkgw as from Jan 10, 2020
-
cfep-06 Staged-recipes review lifecycle
- INACTIVE - Merge in with some inactive-esque status?
- Lingering comment from @saraedum. @jakirkham, can you reply? Has unadressed comment from @saraedum from Jan 8, 2020
- (MRB) The stalebot has solved the worst of the issues here. I think we could defer this one permanently.
-
cfep-10 Feedstock statuses, unmaintained
- INACTIVE - Merge in with some inactive-esque status?
- Needs another review. Has unaddressed updates from pkgw as of Jan 11, 2020
-
cfep-12 Removing packages that violate the terms of the source package
- Stalled since May 26, 2020
- Active debate about moving to "broken" vs deleting from conda-forge channel
- Active vote, ends on 2020-03-11
- What were the results of the vote?
- Did we hear back from NumFOCUS?
-
cfep-17 Handling pin backports and dependency rebuilds
- Stalled debate about implementation details between Isuru, CJ and Matt
- UPDATE 2020-07-22: We in principle have agreement to render the extra pinnings needed directly in the feedstock on a temporary basis (i.e., until the migration has ended).
Discussionโ
Check in on previous action itemsโ
Copy previous action items from last meeting agenda.
This meetingโ
Last meetingโ
- (ED) Update governance docs with similar voting model as what got put into conda-tools (+3 with no -1 is a pass)
- (SC) Write jinja template to turn institutional partners yaml into a website https://github.com/conda-forge/conda-forge.github.io/blob/2a2d3caaf7d74eb370ac40c679ba337a73d15c8a/src/inst_partners.yaml
- (SC) Document what needs to be done to create an OVH account and get access
2 meetings agoโ
Docker hub
- (JK) Check in on Azure build workers to see if they have the docker hub limitation. Maybe Azure and docker hub
- (JK) Check in on Azure build workers and see if they have the docker hub limitation
- (JK) work with dockerhub to see if we can get OSS status
- (MRB) start pushing images to quay (https://github.com/conda-forge/docker-images/pull/152)
OVH
- (???) build webpage to credit them (and others)
- If we're adding a logo, will want to make sure that we have permission to use it.
- Shout-out on twitter at some point. "Thanks forOVHCloud for providing a VM", etc. (maybe after we ship qt on windows with it?)
Move to Issue Trackerโ
-
Figure out how to communicate breaking changes to users. Likely should open up an issue immediately for futher discussion. Ping @kkraus, plus capture notes from further up in these meeting notes
-
John K. will update the cuda toolkit feedstock on the git repo to note the NVBug link to the internal NVIDIA issue tracker
-
Jonathan will update docs to note that some non-exhaustive list of packages (like cuda-toolkit, MKL, etc.)
-
Jonathan will review this PR
-
(Kale) schedule conda working group
-
cfep-10 next steps: CJ to call a vote for feedback
-
cfep-06 next steps: Ask staged recipes team to champion this CFEP and move it forward
-
jakirkham & CJ-wright to sync on adding CUDA to the migration bot
-
(Eric) Scheduling Anaconda <-> conda-forge sync on anaconda.org requirements gathering
- Will try and get this scheduled in the next month.
-
(Anthony) Reach out to NumFocus to figure out legal ramifications of not including licenses in files.
-
(Eric) check internally for funding levels for hotels & flying folks from the community in?
-
(Eric) Figure out finances of conda-forge to support themselves?
-
(jjhelmus) Open up CFEP for which python's we're going to support
-
(jakirkham) write a blog post on CUDA stuff we discussed today
-
(jakirkham) update docs on how to add CUDA support to feedstocks
-
(jakirkham) will open an issue on conda-smithy to investigate Drone issues. (ping the aarch team)
-
(ED) Who we are page? Some combination of a FAQ and a who is everyone. FAQ things like:
- who's the POC for CF <> Anaconda, CF <> NumFocus, CF <> Azure
- who's the POC for the various subteams?
- Informal information: roles, day jobs, bios, the whole nine yards, why you're here, etc.
- Public or internal? I don't really care either way. Anyone feel strongly one way or the other?
- opt-in to public bios
- software carpentry has a large number of instructors and has https://carpentries.org/instructors
- some concern about "yet another place to keep stuff up to date"
-
(CJ) Form finance subteam
-
(ED) document strategies for reproducible environments using conda-forge
-
(UK) Static libraries stuff
- Add linting hints to builds to find them
- Recommend how to package them -> CFEP-18
- We should write docs saying we don't provide support and this is a bad idea. -> CFEP-18