#252 What scientific computing can learn from CS
1 hr 11 min
Did you come into Python from a computational science side of things? Were you just looking for something better than Excel or Matlab and got pulled in by all the Python has to offer?

That's great! But following that path often means some of the more formal practices from software development weren't part of the journey.

On this episode, you'll meet Martin Héroux, who does data science in the context of academic research. He's here to share his best practices and lessons for data scientists of all sorts.

Links from the show

Neuroscience Research Australia: neura.edu.au
Martin Héroux: researchgate.net

Errors in science: I make them do you? Part 3: scientificallysound.org

PyPI Packages
DABEST: pypi.org/project/dabest
PSYCHOPY: pypi.org/project/PsychoPy

Spreadsheet Blunders
12 of the Biggest Spreadsheet Fails: blogs.oracle.com
Common spreadsheet errors: datacarpentry.org

Best Practices for Scientific Computing: journals.plos.org
Good enough practices in scientific computing: journals.plos.org
Full episode RSS feed: talkpython.fm/episodes/rss_full_history

Springboard bootcamp scholarships [code TALKPYTHONTOME]: talkpython.fm/springboard

Sponsors

Clubhouse
Linode
Talk Python Training
Google Cloud Platform Podcast
Google Cloud Platform Podcast
Google Cloud Platform
2020 Year End Wrap Up
This week, four of the podcast’s greatest hosts come together to celebrate all of the fun and informative episodes we’ve been privileged to do this year! Join Mark Mirchandani, Jon Foust, Priyanka Vergadia, and Brian Dorsey as we talk about our favorite guests and shows, some cool things that happened this year, and what we’re looking forward to in 2021! Cool things of the week * A Giant List of Google Cloud Resources blog * Google Cloud 4 Words site Our favorite episodes * Jon’s Favorites * GCP Podcast Episode 212: Data Management with Amy Krishnamohan podcast * GCP Podcast Episode 237: NVIDIA with Bryan Catanzaro podcast * Priyanka’s Favorite * GCP Podcast Episode 240: reCAPTCHA Enterprise with Kelly Anderson + Spring ML Potholes with Eric Clark podcast * Mark’s Favorites * GCP Podcast Episode 242: NASA and FDL with James Parr and Madhulika Guhathakurta podcast * GCP Podcast Episode 217: Cost Optimization with Justin Lerma and Pathik Sharma podcast * GCP Podcast Episode 228: Fastly with Tyler McMullen podcast * Brian’s Favorites * GCP Podcast Episode 223: Voice Coding with Emily Shea and Ryan Hileman podcast * GCP Podcast Episode 233: Bare Metal Solution with James Harding and Gurmeet Goindi podcast * GCP Podcast Episode 212: Data Management with Amy Krishnamohan podcast Sound Effects Attribution * “Bad Beep” by RicherLandTV of Freesound.org * “Small Group Laugh 6” by Tim.Kahn of Freesound.org * “It’s Always Night in Space” by JamesSilvera of HDInteractive.com * “Easy Cheesy” by LoboLoco of FreeMusicArchive.org
36 min
Python Bytes
Python Bytes
Michael Kennedy and Brian Okken
#209 JITing Python with .NET, no irons in sight
Sponsored by us! Support our work through: * Our courses at Talk Python Training * Test & Code Podcast * Patreon Supporters Michael #1: Running Python on .NET 5 * by Anthony Shaw * Talked about pyjion way back when on episode 49 with Brett Cannon. * .NET 5 was released on November 10, 2020. It is the cross-platform and open-source replacement of the .NET Core project and the .NET project that ran exclusively on Windows since the late 90’s. See the conference about it if you want to go deeper. * Performance: I just saw a SO post about someone complaining their Python was 31x slower than C#. * The most common way around this performance barrier is to compile Python extensions from C or using something like Cython. * .NET 5 CLR comes bundled with a performant JIT compiler (codenamed RyuJIT) that will compile .NETs IL into native machine instructions on Intel x86, x86-64, and ARM CPU architectures. * Pyjion is a project to replace the core execution loop of CPython by transpiling CPython bytecode to ECMA CIL and then using the .NET 5 CLR to compile that into machine code. * It then executes the machine-code compiled JIT frames at runtime instead of using the native execution loop of CPython. * A few releases of Python ago (CPython specifically, the most commonly used version of Python) in 3.7 a new API was added to be able to swap out “frame execution” with a replacement implementation. This is otherwise known as PEP 523. * This extension uses the same standard library as Python 3.9. * Will this be compatible with my existing Python code? What about C Extensions? * The short answer is- if your existing Python code runs on CPython 3.9 – yes it will be compatible. * Tested against the full CPython “test suite” on all platforms. In fact, it was the first JIT ever to pass the test suite. * Is this faster? The short answer a little, but not by much (yet). * see also: https://twitter.com/anthonypjshaw/status/1328457723608928256?s=20 Brian #2: PEP 621 -- Storing project metadata in pyproject.toml * Progress on standardizing what goes into pyproject.toml * Authors Brett Cannon, Paul Ganssle, Pradyun Gedam, Sébastien Eustace (of poetry), Thomas Kluyver (of flit), Tzu-Ping Chung * Motivators of this PEP are: * Encourage users to specify core metadata statically for speed, ease of specification, unambiguity, and deterministic consumption by build back-ends * Provide a tool-agnostic way of specifying metadata for ease of learning and transitioning between build back-ends * Allow for more code sharing between build back-ends for the "boring parts" of a project's metadata * Doesn’t change any existing core metadata * Doesn’t attempt to standardize all possible metadata * Included in table named [project]: * name * version * description * readme * requires-python * license * authors/maintainers * keywords * classifiers * urls * entry points * dependencies/optional-dependencies * dynamic * There’s an example in the PEP that helps clear things up * Many items have synonyms specified for flit/poetry/setuptools (presumably for backward compatibility) Michael #3: GitHub revamps copyright takedown policy after restoring YouTube-dl * In October following a DMCA complaint from the Recording Industry Association of America (RIAA) it was taken down at GitHub. * Citing a letter from the Electronic Frontier Foundation (the EFF), GitHub says it ultimately found that the RIAA’s complaint didn’t have any merit. * The RIAA argued the tool ran afoul of section 1201 of the US copyright law by giving people the means to circumvent YouTube’s DRM. * the EFF dissects the RIAA’s claims, highlighting where the organization had either misinterpreted the law or how the code of YouTube-dl works. “Importantly, YouTube-dl does not decrypt video streams that are encrypted with commercial DRM technologies, such as Widevine, that are used by subscription videos sites, such as Netflix,” the organization points out when it comes to the RIAA’s primary claim. * GitHub is implementing new policies to avoid a repeat of a repeat situation moving forward. First, it says a team of both technical and legal experts will manually evaluate every single section 1201 claim. * If the company’s technical and legal teams ultimately find any issues with a project, GitHub will give its owners the chance to address those problems before it takes down their work. * GitHub is establishing a $1 million legal defense fund for developers. * Sidebar: EFF has just launched How to Fix the Internet, a new podcast mini-series that examines potential solutions to six ills facing the modern digital landscape. Brian #4: Install & Configure MongoDB on the Raspberry Pi * Mark Smith * Definitely a “wow, I didn’t know you could do that” article. * Tutorial walks through * Installing 64 bit Ubuntu Server on a Raspberry Pi * Configure wifi * Install MongoDB on Pi * Set up a user account, to safely expose MongoDB on a home network. * Now you’ve got a MongoDB server in your house. So cool Michael #5: Extra! extra! extra!, hear all about it! * Follow up on my critique of things like SQL & CSS put next to Python and Java. Maybe best to grab the conversation from here. * Guido joins Microsoft, why? People seem to see this as a positive for sure. But they checked him out! * New code editor roaming the streets: Nova from Panic. * Two thumbs up on Big Sur and now waiting on the Mac Mini M1. Brian #6: A Python driven AI Stylist Inspired by Social Media * Dale Markowitz * A bunch of Google tools (cloud storage, firebase, cloud vision api, product search api) * Some React for front end * Python to batch script * General oversimplified process: * photos from social media for inspiration * photos of everything in your closet, multiple of each item * use AI suggest outfits from your closet that match inspiration photos * Ok. The process is really more of a promo for Google AI products, and not so much about Python, but it’s a cool “look what you can do with software” kinda thing. * Also, many of the tools used by online retail, like “similar products” and such, are available to lots of people now, and that’s cool. Joke: Back to the [dev] future!
33 min
CppCast
CppCast
Rob Irving and Jason Turner
Fuzz Testing on the GPU with Artem Dinaburg and Ryan Eberhardt
Rob and Jason are joined by Artem Dinaburg and Ryan Eberhardt. They first talk about a new version of CMake that was just released, an interview with Bjarne Stroustrup and another month of new ISO papers. Then they talk to Artem and Ryan who talk about fuzz testing, including a new fuzz testing project being worked at Trail of Bits to enable fuzz testing on the GPU. News * Cmake 3.19 available for download * How C++ became the invisible foundation for everything, and what's next * November Monthly Mailing Links * Let's build a high-performance fuzzer with GPUs! * The Relevance of Classic Fuzz Testing: Have We Solved This One? * Vectorized Emulation: Hardware accelerated taint tracking at 2 trillion instructions per second * DeepState - Parameterized Unit Testing Framework * MCSema - Tool to translate binaries to LLVM bitcode * Remill - Library of CPU instruction semantics * Anvill - Tool to make translated bitcode look closer to what a compiler would emit * Rellic - Translates LLVM bitcode to C using Clang's AST library Sponsors * PVS-Studio. Write #cppcast in the message field on the download page and get one month license * PVS-Studio: analyzing pull requests in Azure DevOps using self-hosted agents * Why it is important to apply static analysis for open libraries that you add to your project * Use code JetBrainsForCppCast during checkout at JetBrains.com for a 25% discount
1 hr 4 min
Kubernetes Podcast from Google
Kubernetes Podcast from Google
Adam Glick and Craig Box
KubeCon NA 2020, with Stephen Augustus
Join us for all the news from KubeCon NA 2020, and a conversation with conference co-chair Stephen Augustus. Stephen is a Senior Open Source Engineer on the VMware Tanzu team, a chair of Kubernetes’ SIG Release, and a leader in many other parts of the project, past and present. Do you have something cool to share? Some questions? Let us know: * web: kubernetespodcast.com * mail: kubernetespodcast@google.com * twitter: @kubernetespod Chatter of the week * The kākāpō wins Bird of the Year * We’re off for 2 weeks. See you on December 8! News of the week * Cisco acquires Banzai Cloud * CNCF announces Cloud Native Survey 2020 results * Red Hat: New edge features, industrial AI/ML blueprint and AWS launch * CNCF End User Tech Radar for storage * New End User benefits * Envoy Mobile joins the CNCF * New sandbox projects * cert-manager * cdk8s * Kyverno * OpenKruise * Pravega * SchemaHero * Tinkerbell * k8ssandra from Datastax * Episode 98 with Sam Ramji * k0s from Mirantis * Solo.io announces Gloo Mesh Enterprise and rebrands products * Episode 55, with Idit Levine * Pinniped * Shipa launches Ketch * Kinvolk launches Headlamp * The SPIFFE book “Solving The Bottom Turtle” * Episode 45, with Andrew Jessup * Anthos Developer Sandbox * GKE ingress features * Ambassador Labs takes in $18m and launches v1.9 * Tanzu SQL: Postgres on Kubernetes * Lightning round: * Accurics extends Terrascan * AWS adds containers to Lightsail * Arrikto takes $10m in funding * Brobridge releases Gravity * CircleCI runner is GA * Cloud66 for agencies and multiple database support * Cloudflare Origin CA cert-manager plugin * Cloudical Vanillastack * Cloudify version 5.1 * Codefresh launches GitOps 2.0 features * Commvault backup-as-a-service * Diamanti Spektra 3.1 and customer portal * Dynatrace PurePath 4 * Elastisys Compliant Kubernetes * The Fairwinds Kubernetes Maturity Model * Garden takes “seed” funding * Gremlin adds soundproofing * Humio Operator * Instana adds observability tools on Kubernetes * Intuit runs TurboTax on Kubernetes * Kioxia announces a new storage offering * Kubecost adds features for monitoring outside a cluster * KubeMQ adds automatic network creation * Kubermatic updates KubeOne to v1.1 * Kubernative SINA * Kublr 1.19 * Lablup announced Backend.ai 20.09 RC * Magalix launches KubeAdvisor 2.0 * Mayadata launches Kubera Propel and Kubera Chaos * Mirantis adds extensions to Lens * Puppet Labs adds Relay to Puppet Enterprise * Reblaze announces Curiefense to add WAF to Envoy * Replicates wants to help you Troubleshoot * Styra adds new editions to DAS * Sysdig introduces Kubernetes-native network security (ZTNSK) and partners with IBM Cloud * TrilioVault for Kubernetes v2.0 * Zerto for Kubernetes * Google Open Source Live Kubernetes Links from the interview * KubeCon NA 2020 * Episode 117, with Constance Caramanolis * CNCF Twitch * SIG Friday: ping Stephen for the current link * Slack * CNCF Slack * Kubernetes Slack * Hallway Track * Kubernetes Podcast chat * CoreOS * CoreOS Tectonic * CoreOS acquired by Red Hat * Tectonic on Azure * SIG Azure * SIG Release * SIG PM (retired) * Kubernetes Enhancement Process * Receipts process KEP * Sidecar containers - KEP closed! * Production readiness review * Episode 10, with Josh Berkus and Tim Pepper * Release managers * Black Lives Matter announcement banner * Better announcements * Kubernetes Naming working group * Inclusive Naming project * Dan Kohn memorial * Stephen Augustus on Twitter and on the web
53 min
More episodes
Search
Clear search
Close search
Google apps
Main menu