Episode 43: Course Correction
20 min

A stripped down episode, this is a heart-to-heart chat between me and you about the Linux community, burnout, detours, and things you never expect to face.

Support Linux For Everyone


Allan Jude
377: Firewall ban-sharing
History of FreeBD: BSDi and USL Lawsuits, Building a Website on Google Compute Engine, Firewall ban-sharing across machines, OpenVPN as default gateway on OpenBSD, Sorting out what the Single Unix Specification is, Switching from Apple to a Thinkpad for development, and more NOTES This episode of BSDNow is brought to you by Tarsnap (https://www.tarsnap.com/bsdnow) Headlines History of FreeBSD : Part 2 : BSDi and USL Lawsuits (https://klarasystems.com/articles/history-of-freebsd-part-2-bsdi-and-usl-lawsuits/) In this second part of our series on the history of FreeBSD, we continue to trace the pre-history of FreeBSD and the events that would eventually shape the project and the future of open source software. Building a Web Site on Google Compute Engine (https://cromwell-intl.com/open-source/google-freebsd-tls/) Here's how I deployed a web site to the Google Cloud Platform. I used FreeBSD for good performance, stability, and minimal complexity. I set up HTTPS with free Let's Encrypt TLS certificates for both RSA and ECC. Then I adjusted the Apache configuration for a good score from the authoritative Qualys server analysis. News Roundup Firewall ban-sharing across machines (https://chown.me/blog/acacia) As described in My infrastructure as of 2019, my machines are located in three different sites and are loosely coupled. Nonetheless, I wanted to set things up so that if an IP address is acting maliciously toward one machine, all my machines block that IP at once so the meanie won't get to try one machine after another. OpenVPN as default gateway on OpenBSD (https://dataswamp.org/~solene/2020-10-27-openbsd-openvpn.html) If you plan to use an OpenVPN tunnel to reach your default gateway, which would make the tun interface in the egress group, and use tun0 in your pf.conf which is loaded before OpenVPN starts? Here are the few tips I use to solve the problems. Sorting out what the Single Unix Specification is and covers (https://utcc.utoronto.ca/~cks/space/blog/unix/SingleUnixSpecificationWhat) Sorting out what the Single Unix Specification is and covers October 8, 2020 I've linked to the Single Unix Specification any number of times, for various versions of it (when I first linked to it, it was at issue 6, in 2006; it's now up to a 2018 edition). But I've never been quite clear what it covered and didn't cover, and how it related to POSIX and similar things. After yesterday's entry got me looking at the SuS site again, I decided to try to sort this out once and for all. Bye-bye, Apple (http://blog.cretaria.com/posts/bye-bye-apple.html) The days of Apple products are behind me. I had been developing on a Macbook for over twelve years, but now, I’ve switched to an ever trending setup: OpenBSD on a Thinkpad. The new platform is a winner. Everything is clean, quick, and configurable. When I ps uaxww, I’m not hogging ‘gigs’ of RAM just to have things up and running. There’s no black magic that derails me at every turn. In short, my sanity has been long restored. Tarsnap This weeks episode of BSDNow was sponsored by our friends at Tarsnap, the only secure online backup you can trust your data to. Even paranoids need backups. Feedback/Questions Chris - small projects (https://github.com/BSDNow/bsdnow.tv/blob/master/episodes/377/feedback/Chris%20-%20small%20projects.md) Jens - ZFS Question (https://github.com/BSDNow/bsdnow.tv/blob/master/episodes/377/feedback/Jens%20-%20ZFS%20Question.md) One pool to rule them all (https://ftfl.ca/blog/2016-09-17-zfs-fde-one-pool-conversion.html) Shroyer - Dotnet on FreeBSD for Jellyfin (https://github.com/BSDNow/bsdnow.tv/blob/master/episodes/377/feedback/Shroyer%20-%20Dotnet%20on%20FreeBSD%20for%20Jellyfin.md) *** Send questions, comments, show ideas/topics, or stories you want mentioned on the show to feedback@bsdnow.tv (mailto:feedback@bsdnow.tv) ***
48 min
Python Bytes
Python Bytes
Michael Kennedy and Brian Okken
#208 Dependencies out of control? Just pip chill.
Sponsored by us! Support our work through: * Our courses at Talk Python Training * Test & Code Podcast * Patreon Supporters Brian #1: pip-chill - Make requirements with only the packages you need * Ricardo Bánffy * Like pip freeze but lists only the packages that are not dependencies of installed packages. * Will be great for creating requirements.txt files that look like the ones you would write by hand. * I wish it had an option to not list itself, but pip-chill | grep -v pip-chill works. * What do I have installed? (foo) $ pip freeze appdirs==1.4.4 black==20.8b1 click==7.1.2 mypy-extensions==0.4.3 ... * No really, what did I myself install? (foo) $ pip-chill black==20.8b1 pip-chill==1.0.0 * Without versions? (foo) $ pip-chill --no-version black pip-chill * What did those things install as dependencies? (foo) $ pip-chill -v --no-version black pip-chill # appdirs # Installed as dependency for black # click # Installed as dependency for black ... Michael #2: Windows update broke NumPy * Sent in by Daniel Mulkey * A recent Windows update broke some behavior that I think OpenBLAS (used by NumPy) relied on. * There's a Developer Community thread here. * I am a NumPy developer. We have been trying to track down a strange issue where after updating to windows 10 2004, suddenly code that worked no longer works. Here is the NumPy issue and here is the corresponding issue in OpenBLAS. The problem can be summarized: when calling fmod, something is changed so that much later calling an OpenBLAS assembly routine fails. The only difference I can see in the registers that visual studio exposes is that after the call to fmod, register ST(0) is set to NAN. * Steve Dower and other Microsoft people have commented. * The fix is slated to take until January 2021 to be released, though there are workarounds for some scenarios. * Matt P. posted a workaround: * For all those at home following along and looking for a quick fix, NumPy has released a bugfix 1.19.3 to work around this issue. The bugfix broke something else on Linux, so we had to revert the fix in release 1.19.4, but you can still install the 1.19.3 via * pip install numpy==1.19.3. * Note this is only works around the way this bug crashes NumPy (technically, in OpenBLAS which is shipped with NumPy), and may not fix all your problems related to this bug, Microsoft’s help is needed to do that. Brian #3: Build Plugins with Pluggy * kracekumar * Blog post related to talks given at PyGotham and PyCon India * Pluggy is the plugin library used by pytest * Article * starts with a CLI application that has one output format. * Need is for more formats, implemented as plugins. * Quick look at pluggy architecture of host/caller/core system and plugin/hook. * Also plugin manager, hook specs, and hook implementations. * Walks through the changes to the application needed to support plugins. * I’ve been waiting for an article on pluggy, and this is nice. * But I admit I’m still a little lost. I guess I need to watch one of the presentations and try to build something with pluggy. Michael #4: LINQ in Python * via Adam: I seem to recall that Michael had a C# background, so this might be of interest: * Bringing LINQ-like expressions to Python with linqit * Example: last_hot_pizza_slice = programmers.where(lambda e:e.experience > 15) .except_for(elon_musk) .of_type(Avi) .take(3) # [[HTML_REMOVED], [HTML_REMOVED], [HTML_REMOVED]] .select(lambda avi:avi.lunch) # [[HTML_REMOVED], [HTML_REMOVED], [HTML_REMOVED]] .where(lambda p:p.is_hot() and p.origin != 'Pizza Hut'). .last() # [HTML_REMOVED] .slices.last() # [HTML_REMOVED] * Also interesting asq: https://github.com/sixty-north/asq Brian #5: Klio : a framework for processing audio files or any binary files, at large scale * Recently open sourced by Spotify * An article about it * Klio is based on Apache Beam and allows * integration with cloud processing engines * open graph of job dependencies * batch and streaming pipelines * goals: * large-file input/output * scalability, reproducibility, efficiency * closer collaboration between researchers and engineers * uses Python * Obviously useful for Spotify, but they are hoping it will help with other audio research and applications. Michael #6: Collapsing code cells in Jupyter Notebooks * via Marco Gorelli * You mentioned in that episode that you'd like to have a way of collapsing code cells in Jupyter Notebooks so you can export them as reports - incidentally, I wrote a little blog post about how to do that - in case it's useful/of interest to you, here it is! * Basically get a static HTML file that is the static notebook output but can start with the code cells collapsed and can toggle their visibility. Extras Michael: * New Apple Silicon macs? * Bot tweets: twitter.com/MichelARenard/status/1324269474544029696 Joke: By Richard Cairns Q: Why did the data scientist get in trouble with Animal Welfare? A: She was caught trying to import pandas. “10e engineeeeeeeeers are the future.” - detahq
30 min
Clear search
Close search
Google apps
Main menu