Software Engineering Daily: Recent Episodes
Software Engineering Daily
SED News is a monthly podcast from Software Engineering Daily where hosts Gregor Vand and Sean Falconer break down the biggest stories shaping software engineering, Silicon Valley, and the broader tech industry.
In this episode, Gregor and Sean dig into a wave of “runaway AI” stories, including Anthropic and OpenAI disclosing that their models accessed outside organizations during cyber evaluations, and Amazon reporting a staggering budget overrun blamed on bad agent loops. They explore why most of these incidents trace back to human decisions rather than models breaking free, and the awkward reality that today’s systems can bill you for tokens without reliably counting them.
They also talk about the “Kimi moment.” Moonshot AI‘s open weight model has closed the gap with frontier models like ChatGPT and Claude at a remarkable pace, and the hosts unpack what it means for open weight strategies and how chip scarcity is pushing Chinese labs to innovate.
As always, the episode wraps up with a few standout Hacker News threads, including a JetBrains test of a “caveman speak” skill that promised big token savings, how refactoring can cut input token costs, the release of CodePen 2.0, and a build of Doom that renders through SQL queries.
Sponsorship inquiries:
sponsor@softwareengineeringdaily.com
The post SED News: The Kimi Moment, Runaway AI, and Tokenmaxxing appeared first on Software Engineering Daily.
The terminal has been a constant in software development for decades. It has remained largely unchanged while everything around it transformed. However, as AI agents have become central to the developer workflow, the terminal is emerging as a natural home for agentic development, and a new category of tooling is forming around it.
Warp is a popular Rust-based terminal and agentic development environment. The company recently open-sourced its codebase and launched Oz, its cloud agent infrastructure product aimed at helping enterprises automate software development at scale.
Zach Lloyd is the co-founder and CEO of Warp, and a former principal engineer at Google where he led engineering on the Google Docs suite. In this episode, Zach joins Gregor Vand to discuss how Warp has evolved over the years, why the terminal is better suited than the IDE for agentic development, how Oz approaches the governance and auditability challenges enterprises face with AI agents, and more.
Sponsorship inquiries:
sponsor@softwareengineeringdaily.com
The post The Terminal as an Agentic Interface appeared first on Software Engineering Daily.
Open source software underpins virtually every modern application. That ubiquity is a superpower for developers, but it is also an expanding attack surface. Software supply chain attacks were once rare but are now happening daily, with malicious actors exploiting the trust developers place in public registries, package managers, and CI/CD pipelines.
Chainguard is a secure software supply chain platform. The company started with hardened container images and has expanded to cover domains including VMs, language libraries, GitHub Actions, and agent skills.
Matt Moore is a co-founder and CTO of Chainguard, and a veteran of Google’s open source, container, and security infrastructure work. In this episode, Matt joins Gregor Vand to discuss lessons from recent supply chain attacks, why CI/CD pipelines are now a primary attack surface, the challenge of meaningful software inventories, the EU Cyber Resilience Act, and what the arrival of Anthropic’s Mythos model means for the pace of vulnerability discovery and the urgency of patching at machine speed.
Sponsorship inquiries:
sponsor@softwareengineeringdaily.com
The post AI-Powered Threats to the Software Supply Chain appeared first on Software Engineering Daily.
The most useful coding agents can mutate their environments by downloading packages, writing files, and connecting to services across the network. However, that freedom also presents dangers, and promises to usher in a new wave of security threats.
Docker recently announced Docker Sandboxes, which give each agent its own isolated micro VM while preserving the familiar ergonomics of a container. A standard container shares the host’s kernel, but a micro VM emulates hardware and runs its own kernel, giving a stronger security boundary around code that cannot be trusted.
Mark Cavage is the President and COO of Docker, and he previously worked at companies including Stripe, AWS and Oracle. In this episode, Mark joins Gregor Vand for a wide-ranging conversation that includes why agents break the immutability assumptions containers were built on, how micro VMs differ from both containers and traditional VMs, and the still-unsolved challenge of giving agents scoped, trustworthy access to sensitive services and data.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Docker and Sandboxing AI Agents appeared first on Software Engineering Daily.
Golden Gate Ventures is one of Southeast Asia’s most established early-stage venture firms, having backed companies across the region since 2011. They have invested in companies that are now household names in the region. Examples include Gojek, which started as a motorcycle taxi service in Indonesia and grew into a super app spanning payments, food delivery, and logistics, and Grab, which began as a ride-hailing service in Singapore and similarly expanded across Southeast Asia into food delivery and financial services.
Jeffrey Paine is a co-founder and partner at Golden Gate Ventures. In this episode, Jeffrey joins Gregor Vand to discuss how the Southeast Asian startup ecosystem has evolved, why the regional copycat model is giving way to globally ambitious technical founders, what companies like Manus and Supabase reveal about Singapore’s emerging role in the global tech landscape, and what advice Jeffrey gives founders today who want to build something that matters beyond their home market.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post The Startup Scene in Southeast Asia appeared first on Software Engineering Daily.
AI agents have shown remarkable potential to function as persistent digital assistants that are capable of monitoring data, managing communications, and taking action autonomously over long periods. OpenClaw was one of the first serious attempts to fulfill that vision, connecting frontier coding agents to messaging platforms like Slack and WhatsApp and letting them run continuously in the background. However, OpenClaw largely set aside questions of security to pursue that vision, leaving credentials exposed in the agent’s environment and giving agents broad access to data and services far beyond what any given task required.
NanoClaw is an open source project that takes a zero trust approach to agent orchestration. Rather than relying on instructions to constrain agent behavior, it isolates each agent in its own Docker container, keeps credentials entirely outside the agent’s environment, and enforces human-in-the-loop approval for sensitive actions.
Gavriel Cohen is the founder of NanoClaw and he joins Kevin Ball to discuss the security architecture behind NanoClaw, how the agent sandbox and proxy model work in practice, how agents communicate with each other and with the host orchestration process, how the project approaches context window management and long-lived agent sessions, and more.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post NanoClaw and the Rise of Personal AI Agents appeared first on Software Engineering Daily.
AI agents have become capable of reasoning across large amounts of data, calling tools, and taking sequences of actions autonomously. These qualities make them well suited to some of the most persistent pain points in DevOps, including the on-call engineer woken at 3 AM to diagnose an incident, the build failure that takes hours to trace back to a root cause, and the operational toil of modern software delivery. Agentic DevOps is the emerging paradigm that applies these capabilities to the full software lifecycle, with the goal of matching the velocity of modern software delivery with an equally capable operational layer.
Neha Gaswamy leads Agentic DevOps at AWS and has been at Amazon for over twenty years. In this episode, she joins Matt Merrill to discuss the AWS approach to agentic DevOps, how Amazon dogfoods its own DevOps tooling, how their DevOps agent works from alarm to root cause, why determinism still matters in an agentic world, creative MCP integrations customers are building, and what the future holds for SRE engineers as agents take on more of the operational work.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Agentic DevOps at AWS appeared first on Software Engineering Daily.
AI agents have transformed how software gets written, but the operational side of running software in production has not yet experienced a similar revolution. The same teams responsible for keeping systems healthy, investigating incidents, and managing reliability are still doing much of that work manually.
Mezmo is a Production AI company that makes autonomous operations fast, efficient, and safe. Their open source project, AURA, is a declarative agent framework specifically designed for SRE and platform engineering workflows. It takes a Kubernetes-inspired approach where teams define what they want agents to do rather than scripting every step of how to do it.
Andre Elizondo is the head of product at Mezmo, and he has a background in systems engineering, SRE, and observability. In this episode, Andre joins Kevin Ball to discuss what makes SRE agent workflows fundamentally different from coding agents, how AURA handles context engineering, AURA’s declarative configuration model, the spectrum of agent autonomy, and where the role of the SRE is headed as agents take on more of the operational work.
Full Disclosure: This episode is sponsored by Mezmo.
Kevin Ball or KBall, is the vice president of engineering at Mento and an independent coach for engineers and engineering leaders. He co-founded and served as CTO for two companies, founded the San Diego JavaScript meetup, and organizes the AI inaction discussion group through Latent Space.
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post AURA and Open-Source Agents for Production Operations appeared first on Software Engineering Daily.
Eric Ries is the creator of the Lean Startup method and the author of the New York Times bestseller The Lean Startup, which transformed how a generation of founders and engineers think about building products. It introduced concepts like the MVP, the pivot, and build-measure-learn that are now so widely adopted they feel obvious. Over two decades of working with founders, CEOs, and investors, Eric has observed that some companies built on those principles eventually betray the very customers and engineers who made them great. His new book, Incorruptible: Why Good Companies Go Bad and How Great Companies Stay Great, is his attempt to answer the question of whether it is possible to build a company that resists that fate.
In this episode, Eric joins Gregor Vand for a wide-ranging discussion about why so many great companies lose their way, and what software engineers and founders can do today to build or find companies that are genuinely resistant to corruption.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Eric Ries on Why Good Companies Go Bad appeared first on Software Engineering Daily.
SED News is a monthly podcast from Software Engineering Daily where hosts Gregor Vand and Sean Falconer break down the biggest stories shaping software engineering, Silicon Valley, and the broader tech industry.
In this episode, Gregor and Sean dig into the growing tension around restricted AI models, including Anthropic‘s Fable being pulled from the Claude platform days after launch. They explore what Sean calls “vibe regulations” and the risk foreign governments and enterprises face when a model they depend on can be cut off. They also cover the FT’s reporting on London’s “DeepMind mafia,” a vibe-coding clone controversy involving YC-backed Corgi and Papermark, SpaceX‘s acquisitions of Cursor and Mesh, and Anthropic’s launch of Claude Science.
They also take on the latest round of the IDE wars, and explore who owns your dev toolchain, the vendor lock-in that now comes from context and memory rather than the model itself, and the widening cost gap between frontier tools and open weight models. As always, the episode wraps up with a few standout Hacker News threads.
The post SED News: Restricted Models, IDE Wars, and the DeepMind Mafia appeared first on Software Engineering Daily.
Advanced software systems have long been more complex than any single engineer can fully understand. Observability is the established solution to this problem, but with AI agents now generating code, deploying changes, and operating autonomously, the challenge of understanding large software systems is entering a new dimension.
Grafana is an open source observability platform, and one of the most widely used in the world. The company builds tools that help teams collect, visualize, and act on telemetry data across logs, metrics, and traces. They are now extending that capability into the agentic era with AI-powered investigation and monitoring tools.
Anthony Woods is a co-founder of Grafana Labs. In this episode, he joins Matt Merrill to discuss how AI-generated code is straining software operations, why telemetry data volume has become as much a problem as a solution, how Grafana is adapting to a world where agents are the primary consumers of observability data, and what keeps him up at night about where the industry is headed.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Grafana’s Approach to AI-Native Observability appeared first on Software Engineering Daily.
Building great software always involves technical problem solving, but the best software goes beyond function. It feels fluid, coherent, and genuinely fun to use. This quality lives at the intersection of engineering and design, and very few teams know how to reliably produce it.
Metalab is an engineering and design studio that has worked with some of the most successful companies in tech, including Apple, Slack, Uber, and Instacart. The studio is known for bringing together software engineering and design craft in a way that few studios can match.
Wesley Yu is the VP of Engineering at Metalab, where he leads the teams that design and build digital products for early-stage companies. In this episode, Wesley joins Josh Goldberg to discuss how Metalab approaches tech stack selection for client projects, why agency work demands a bias toward boring and stable technology, how iterative development and deliberately ugly apps lead to better final products, and how AI tools are changing the boundary between design and engineering.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Building Software That People Love appeared first on Software Engineering Daily.
Yacht Club Games is the studio behind the acclaimed Shovel Knight franchise. Their latest release is Mina the Hollower, which is a top-down action RPG inspired by classic Zelda and Castlevania titles. After many years in development, the game recently launched to widespread critical acclaim.
David D’Angelo is a lead programmer at Yacht Club Games. In this episode, David joins Joe Nash to discuss the custom C++ engine built for Mina the Hollower, how the team approached Game Boy Color art constraints and audio in a modern rendering pipeline, the game’s Castlevania-inspired combat philosophy, how the open world manages saving and collision without load screens, and more.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Mina the Hollower appeared first on Software Engineering Daily.
Predictive modeling is a core element in modern systems, and powers capabilities such as fraud detection, loan approvals, and recommendation systems. These systems typically operate on structured, relational data stored in enterprise databases, with rows, columns, and interlinked tables. While computer vision and natural language processing have undergone a neural network revolution, the tabular data layer underpinning predictive modeling still largely relies on manual feature engineering and task-specific models.
Relational deep learning proposes a new approach. It treats databases as graphs and applies transformer-style attention mechanisms directly over structured relational data. Researchers are now building foundation models for tabular data that aim to generalize across predictive tasks without painstaking feature engineering.
Jure Leskovec is a Professor of Computer Science at Stanford University and he previously served as Chief Scientist at Pinterest and was an investigator at the Chan Zuckerberg Biohub. Most recently, he co-founded the machine learning startup, Kumo.AI.
In this episode, Jure joins Sean Falconer to discuss the limitations of traditional predictive modeling, why structured enterprise data requires its own modality-specific neural architectures, how graph transformers generalize attention to relational databases, and more.
The post Foundation Models for Structured Data appeared first on Software Engineering Daily.
Modern web development requires an ever-growing collection of tools including formatters, linters, bundlers, and plugins. Each tool typically has its own configuration, dependencies, and performance cost. As applications grow more complex, the overhead of maintaining this toolchain becomes a real burden.
Biome is an open source toolchain for web projects that brings formatting and linting together in a single fast, opinionated tool. It’s built in Rust and is designed to be a drop-in replacement for Prettier and ESLint, with sensible defaults, minimal configuration, and consistent behavior across the CLI and editor environments. Biome also introduces a module graph that enables cross-file analysis, and type-aware lint rules that don’t require the TypeScript compiler.
Emanuele Stoppa, known as Ema, is a Senior Systems Engineer at Cloudflare, a lead at Astro, and the creator and lead maintainer of Biome. In this episode, Ema joins Josh Goldberg to discuss the history of Biome, how linters and formatters work under the hood, what makes Biome’s architecture fundamentally different from the tools it replaces, and what’s coming next for the project and its community.
Josh Goldberg is an independent full time open source developer in the TypeScript ecosystem. He works on projects that help developers write better TypeScript more easily, most notably on typescript-eslint: the tooling that enables ESLint and Prettier to run on TypeScript code. Josh regularly contributes to open source projects in the ecosystem such as ESLint and TypeScript. Josh is a Microsoft MVP for developer technologies and the author of the acclaimed Learning TypeScript (O’Reilly), a cherished resource for any developer seeking to learn TypeScript without any prior experience outside of JavaScript. Josh regularly presents talks and workshops at bootcamps, conferences, and meetups to share knowledge on TypeScript, static analysis, open source, and general frontend and web development.
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Biome and the Future of JavaScript Tooling appeared first on Software Engineering Daily.
Most of the cryptography securing the internet today rests on mathematical problems that classical computers cannot solve in any reasonable timeframe. That assumption is now being tested. Recent advances in quantum computing have dramatically compressed timelines, and many in the industry have set a target of full post-quantum security by 2029, meaning a complete migration to algorithms designed to remain secure against quantum attacks.
Bas Westerbaan is a cryptography engineer at Cloudflare, where he leads the company’s efforts to migrate to post-quantum cryptography. In this episode, Bas joins Kevin Ball to discuss how quantum computers threaten public key cryptography, what post-quantum algorithms actually are and how they work, the timeline shifts that have made quantum readiness feel so urgent, and what software engineers need to do now to prepare their systems.
Kevin Ball or KBall, is the vice president of engineering at Mento and an independent coach for engineers and engineering leaders. He co-founded and served as CTO for two companies, founded the San Diego JavaScript meetup, and organizes the AI inaction discussion group through Latent Space.
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Preparing for Q-Day appeared first on Software Engineering Daily.
Multiplayer games are among the hardest software systems to build, requiring developers to synchronize state across unreliable networks while maintaining fairness, performance, and a responsive player experience. Latency, cheating, server costs, and debugging distributed game logic all introduce complexity that single-player games never encounter.
Dome Keeper is a minimalist tower defense game with roguelike elements where players must protect a fragile glass dome from relentless waves of alien attackers. The game was developed with the Godot Engine and released in 2022. More recently, the development team embarked on the challenge of adding multiplayer to the game.
René Habermann is the founder of Bippinbits and the creator of Dome Keeper. Chris Ridenour is the founder of KAR Games, which is Godot focused studio that developed Drift: Space Survival. Chris is now working with the Dome Keeper team to bring multiplayer to the game. René and Chris join the show to talk about the origins of Dome Keeper, developing the game, and the process of adding multiplayer to a Godot game.
Joe Nash is a developer, educator, and award-winning community builder, who has worked at companies including GitHub, Twilio, Unity, and PayPal. Joe got his start in software development by creating mods and running servers for Garry’s Mod, and game development remains his favorite way to experience and explore new technologies and concepts.
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Developing Multiplayer Games in Godot appeared first on Software Engineering Daily.
SED News is a monthly podcast from Software Engineering Daily where hosts Gregor Vand and Sean Falconer unpack the biggest stories shaping software engineering, Silicon Valley, and the broader tech industry.
In this episode, they cover Apple‘s uncertain path beyond the iPhone. They also discuss Google‘s agentic pivot at Google I/O, a surge in DuckDuckGo traffic following Google’s default switch to AI mode, and payroll platform Remote surpassing 300 million in ARR with flat headcount.
Gregor and Sean also dig into why consumer subscriptions don’t seem to correspond to actual costs, how enterprise is quietly subsidizing the AI economy, why the true moat has shifted from model quality to context management and agentic harness, and what the coming wave of token cost optimization might look like as companies start scrutinizing their AI bills.
Finally, they highlight standout threads from Hacker News including Doom running on a travel router touchscreen, a viral post asking whether AI productivity gains should translate to a day off, YouTube‘s move to automatically label AI-generated content, and SimCity 3000 running in 4K.
Gregor Vand is a security-focused technologist, having previously been a CTO across cybersecurity, cyber insurance and general software engineering companies. He is based in Singapore and can be found via his profile at vand.hk or on LinkedIn.
Sean’s been an academic, startup founder, and Googler. He has published works covering a wide range of topics from AI to quantum computing. Currently, Sean is an AI Entrepreneur in Residence at Confluent where he works on AI strategy and thought leadership. You can connect with Sean on LinkedIn.
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post SED News: Apple’s AI Problem, The Real Business Model of AI, and Token Cost Reckoning appeared first on Software Engineering Daily.
The web has quietly become one of the most capable platforms for game development. Advances in WebAssembly, WebGL, and WebGPU have given developers tools that rival native desktop performance, while game engines like Unity and Godot have added robust web export pipelines. However, building games for the browser comes with its own set of constraints including file size, browser compatibility, and the need to quickly capture and maintain the player’s attention.
Erik Dubbelboer is a Principal Engineer at Poki which is a web games platform serving over 100 million monthly users. He’s also a game developer himself, with titles including Silly Skies and Village Builder. His unusual position building developer tools that power the platform, while also shipping games on it, gives him a rare perspective on what it actually takes to succeed in web game development.
In this episode, Erik joins Joe Nash to discuss the history of web games from the Flash era to today’s renaissance, how WebAssembly and WebGPU have transformed what is possible in the browser, the tradeoffs between different game engines for web publishing, and more.
Joe Nash is a developer, educator, and award-winning community builder, who has worked at companies including GitHub, Twilio, Unity, and PayPal. Joe got his start in software development by creating mods and running servers for Garry’s Mod, and game development remains his favorite way to experience and explore new technologies and concepts.
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Web Native Game Development appeared first on Software Engineering Daily.
Software engineering has developed powerful tools for observability, data management, and continuous testing, but hardware engineering has largely not kept pace. The feedback loops, tooling, and infrastructure that software engineers take for granted simply do not exist in most hardware programs.
Nominal is a data platform built to help hardware organizations move at the same speed as software teams. It manages the hardware data supply chain end to end, from ingesting high-frequency sensor data off physical assets to enabling real-time control room monitoring, post-test analysis, and simulation correlation.
Jason Hoch is the co-founder and CTO of Nominal, and he has a background spanning distributed data systems at Palantir and cloud infrastructure at Vercel. In this episode, Jason joins Kevin Ball to discuss why hardware engineering has lagged so far behind software in tooling and observability, the unique data challenges of working with high-frequency time series sensor data, how Nominal handles both real-time control room workflows and post-test analysis, why AI agents are transforming software development but have not yet made the same leap in hardware, and what it would take to close that gap.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post The Hardware Bottleneck AI Can’t Fix appeared first on Software Engineering Daily.
Autonomous drone delivery has long been the stuff of science fiction, but ongoing advances have moved the space from experimental to operational. Zipline is one of the leading companies in this space, with drones that charge between missions and fly autonomously to deliver packages directly to customers.
Kyle Madonia is the VP of Application Software and IT at Zipline, and she previously spent a decade as an engineer at SpaceX. In this episode, Kyle joins Gregor Vand to discuss how Zipline’s software stack powers end-to-end autonomous delivery, the engineering challenges of managing drone fleets at scale, and how the team approaches software releases for safety-critical systems.
Gregor Vand is a security-focused technologist, having previously been a CTO across cybersecurity, cyber insurance and general software engineering companies. He is based in Singapore and can be found via his profile at vand.hk or on LinkedIn.
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Autonomous Drone Delivery at Scale appeared first on Software Engineering Daily.
Europe’s startup ecosystem is maturing rapidly, with companies like Revolut, Lovable, and Legora demonstrating that world-class technology businesses can be built and scaled on the continent. While the US remains the dominant force in venture-backed software as home to the largest markets, the deepest capital pools, and the most ambitious exit culture, a growing number of European founders are choosing to build at home.
Edward Keelan is a Partner at Octopus Ventures, one of Europe’s largest and most active venture capital firms, where he has spent over 16 years leading the B2B software and enterprise AI fund. His portfolio spans seed through Series C, with a focus on European founders building in AI, vertical SaaS, and enterprise software. This long-view experience gives him a rare perspective on what it takes to build enduring technology companies in Europe.
In this episode, Edward joins Elena Boroda to discuss what separates great founders from the rest, how AI is reshaping the software landscape and threatening established players, the state of the European startup ecosystem and what it needs to compete globally, and what engineers and founders should be thinking about as the industry enters a new era.
Elena Boroda focuses on GTM for developer tools and AI startups, with experience in observability and building tools for MCP servers. She is based in Berlin.
https://www.linkedin.com/in/elena-boroda
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post The European Startup Scene appeared first on Software Engineering Daily.
React Native is an open source framework developed by Meta that allows engineers to build mobile applications for both iOS and Android using a single JavaScript codebase. The framework bridges the gap between web development and native mobile, which lets teams ship to both platforms simultaneously without sacrificing the look and feel of a truly native app.
Manjiri Moghe is a Staff Software Engineer at Coinbase, where she has spent five years building and scaling one of the world’s most demanding React Native applications. Her work spans performance optimization, reliability engineering, and the developer tooling that keeps large engineering teams moving quickly without sacrificing quality.
In this episode, Manjiri joins Josh Goldberg to discuss why React Native has become the framework of choice for high-velocity mobile teams, how Coinbase measures app health, how to handle data fetching and loading in production, how AI coding agents are changing the day-to-day workflow for mobile engineers, and more.
Josh Goldberg is an independent full time open source developer in the TypeScript ecosystem. He works on projects that help developers write better TypeScript more easily, most notably on typescript-eslint: the tooling that enables ESLint and Prettier to run on TypeScript code. Josh regularly contributes to open source projects in the ecosystem such as ESLint and TypeScript. Josh is a Microsoft MVP for developer technologies and the author of the acclaimed Learning TypeScript (O’Reilly), a cherished resource for any developer seeking to learn TypeScript without any prior experience outside of JavaScript. Josh regularly presents talks and workshops at bootcamps, conferences, and meetups to share knowledge on TypeScript, static analysis, open source, and general frontend and web development.
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post React Native at Scale appeared first on Software Engineering Daily.
Formal methods are a branch of mathematics and computer science focused on proving the correctness of systems, and they have long promised a more rigorous foundation for software. However, their complexity has kept them confined to a small community of specialists. That is now changing as agentic AI systems take on increasingly autonomous roles. The question of how to define, enforce, and verify what those agents are allowed to do has become urgent, and automated reasoning is emerging as a critical part of the answer.
Byron Cook is a VP and Distinguished Scientist at AWS, a professor at University College London, and a program manager at DARPA. He founded the Automated Reasoning Group at AWS over a decade ago, where his team built the foundations behind products like IAM Access Analyzer, VPC Reachability Analyzer, and Bedrock Guardrails.
In this episode, Byron joins Sean Falconer to discuss how automated reasoning works and why it scales so well with AI, the rise of neurosymbolic approaches that combine formal logic with large language models, what it means to formally specify agent behavior using temporal logic, and why the convergence of agentic AI and formal methods may represent one of the most significant shifts in how software is built and verified.
Sean’s been an academic, startup founder, and Googler. He has published works covering a wide range of topics from AI to quantum computing. Currently, Sean is an AI Entrepreneur in Residence at Confluent where he works on AI strategy and thought leadership. You can connect with Sean on LinkedIn.
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Formal Methods as Agent Guardrails appeared first on Software Engineering Daily.
Open source software underpins nearly every modern application, including frameworks powering the most popular websites, to the libraries securing financial backend systems. However, while open source drives collaboration and innovation at a global scale, it also faces deep challenges in sustainability, community health, and long-term maintenance. Many of the world’s most critical dependencies are still maintained by just a handful of volunteers.
Abby Cabunoc Mayes leads Open Source Maintainer Programs at GitHub, and Brian Muenzenmeyer is a Principal Engineer, Node.js maintainer, and author of the book, Approachable Open Source. Abby and Brian join Josh Goldberg to talk about what it means to build and sustain healthy open source projects, how maintainers can foster inclusive communities, the evolving role of open source in the workplace, and how AI is reshaping the way we collaborate.
Josh Goldberg is an independent full time open source developer in the TypeScript ecosystem. He works on projects that help developers write better TypeScript more easily, most notably on typescript-eslint: the tooling that enables ESLint and Prettier to run on TypeScript code. Josh regularly contributes to open source projects in the ecosystem such as ESLint and TypeScript. Josh is a Microsoft MVP for developer technologies and the author of the acclaimed Learning TypeScript (O’Reilly), a cherished resource for any developer seeking to learn TypeScript without any prior experience outside of JavaScript. Josh regularly presents talks and workshops at bootcamps, conferences, and meetups to share knowledge on TypeScript, static analysis, open source, and general frontend and web development.
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Open Source Sustainability appeared first on Software Engineering Daily.
Vector search has risen to become a foundational tool in modern search and retrieval systems, including the RAG pipelines that power many AI applications. However, the demands on retrieval systems are growing more sophisticated, which is revealing the limits of relying on a single vector similarity score.
Vespa is a popular open source search and data serving engine. Central to Vespa’s architecture is tensor-based retrieval, which is an approach that represents data as tensors rather than simple vectors. Tensor-based retrieval enables richer mathematical operations and more flexible ranking functions that can surmount the limitations of a single vector similarity score.
Radu Gheorghe is a software engineer at Vespa with a background spanning nearly 12 years of consulting and training on Elasticsearch and Solr. In this episode, Radu joins Sean Falconer to discuss why vector similarity alone falls short in production, how tensor-based retrieval generalizes to support richer ranking functions, the trade-offs in chunking and multi-stage re-ranking architectures, and where AI search is headed next.
Full Disclosure: This episode is sponsored by Vespa.
Sean’s been an academic, startup founder, and Googler. He has published works covering a wide range of topics from AI to quantum computing. Currently, Sean is an AI Entrepreneur in Residence at Confluent where he works on AI strategy and thought leadership. You can connect with Sean on LinkedIn.
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Vespa AI and Surpassing the Limits of Vector Search appeared first on Software Engineering Daily.
SED News is a monthly podcast from Software Engineering Daily where hosts Gregor Vand and Sean Falconer unpack the biggest stories shaping software engineering, Silicon Valley, and the broader tech industry.
In this episode, they cover Anthropic’s controversial “Mythos” security model and what it means for vulnerability discovery at scale. They also discuss recent layoffs at Snap and Meta, and how AI investment pressures are reshaping hiring, organizational priorities, and the economics of big tech.
Gregor and Sean then zoom out to examine the massive wave of AI infrastructure spending—hundreds of billions in capex across Amazon, Google, Microsoft, and Meta, and what it signals about the future of cloud platforms, model providers, and the engineers who build on top of them. They explore the emerging entanglement between model labs and infrastructure providers, the evolving role of engineers in an AI-native world, and the growing gap between rapid AI adoption and security readiness.
Finally, they highlight standout threads from Hacker News, including creative uses of AI coding tools to revive abandoned side projects, new approaches to training smaller yet highly capable models, surprising demographic data visualizations, and even the mathematics of “cheating” at Tetris.
Gregor Vand is a security-focused technologist, having previously been a CTO across cybersecurity, cyber insurance and general software engineering companies. He is based in Singapore and can be found via his profile at vand.hk or on LinkedIn.
Sean’s been an academic, startup founder, and Googler. He has published works covering a wide range of topics from AI to quantum computing. Currently, Sean is an AI Entrepreneur in Residence at Confluent where he works on AI strategy and thought leadership. You can connect with Sean on LinkedIn.
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post SED News: Anthropic’s Mythos, Supply Chain Hacks, and the AI Spending Surge appeared first on Software Engineering Daily.
AI coding tools have dramatically accelerated the pace of development, and the bottleneck in the software development lifecycle has shifted to code validation and testing. However, the conventional tools and workflows that QA teams have relied on were not designed for a world where a single engineer can generate thousands of lines of code in a day.
SmartBear is a software quality platform spanning test automation, API lifecycle management, and observability. The company recently launched an AI-native QA platform called BearQ, which deploys autonomous agents that explore web applications, learns their structure and behavior, and authors and maintains test cases continuously.
Fitz Nowlan is the VP of AI and Architecture at SmartBear and the co-founder of Reflect, which is a web testing platform acquired by SmartBear in 2024. In this episode, Fitz joins Kevin Ball to discuss why web UI testing is uniquely challenging, how BearQ’s multi-agent architecture coordinates exploration and testing, why test data management becomes a hard distributed systems problem at scale, and what agentic development means for the future of QA.
Full Disclosure: This episode is sponsored by SmartBear.
Kevin Ball or KBall, is the vice president of engineering at Mento and an independent coach for engineers and engineering leaders. He co-founded and served as CTO for two companies, founded the San Diego JavaScript meetup, and organizes the AI inaction discussion group through Latent Space.
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post SmartBear and Multi-Agent QA appeared first on Software Engineering Daily.
Artificial intelligence is transforming warfare faster than the legal and ethical frameworks designed to govern it. Militaries around the world are deploying AI-powered decision support systems to identify targets, assess proportionality, and direct weapons. The gap between what is technically possible and what international law can effectively regulate is widening by the day.
Yuval Shany is a law professor at Hebrew University of Jerusalem and a research fellow at the Oxford Ethics in AI Institute. He also served on the UN Human Rights Committee, where he first encountered the legal and ethical challenges posed by autonomous weapons systems. His research focuses on the intersection of international humanitarian law, human rights, and emerging military technologies.
In this episode, Yuval joins Matt Merrill for a wide-ranging conversation. They cover topics including how close we are to fully autonomous lethal weapons, the accountability gap that AI-mediated warfare creates, and what lessons software engineers can draw from these challenges when building consequential AI systems of any kind.
Matt Merrill is a software engineering leader with over 20 years of experience building and scaling software teams across enterprise and product-focused organizations. His background is in backend development, cloud architecture, and distributed systems design. He currently architects and delivers software products and leads a team of engineers at DEPT® Agency. You can learn more about his work at code.theothermattm.com.
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post The Ethics of Autonomous Weapons Systems appeared first on Software Engineering Daily.
Open-weight models are AI systems whose trained parameters are publicly released, which allows developers to run, fine-tune, and deploy them independently rather than accessing them only through a hosted API. While closed-weight models from companies like OpenAI or Anthropic are delivered as managed services, open-weight models give organizations direct control over how the models are deployed and used. Importantly, the performance of these models is steadily improving and they’ve become credible alternatives for production workloads, with advantages in customization and data privacy.
Fireworks AI is building a platform focused on serving and customizing open-weight models at scale. The platform includes optimized inference infrastructure, multi-hardware support across NVIDIA and AMD, and reinforcement fine-tuning capabilities.
Benny Chen is a Co-Founder of Fireworks AI. In this episode, he joins Gregor Vand to discuss his path from Meta’s ML infrastructure teams to co-founding Fireworks AI, why open-weight models are becoming increasingly competitive, how custom kernels and speculative decoding improve performance, reinforcement fine-tuning, and much more.
Gregor Vand is a security-focused technologist, having previously been a CTO across cybersecurity, cyber insurance and general software engineering companies. He is based in Singapore and can be found via his profile at vand.hk or on LinkedIn.
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Open-Weight AI Models appeared first on Software Engineering Daily.
AI coding tools have gone from novelty to core infrastructure in under three years. Today, many devs use AI daily, a substantial share of new code is AI-generated, and expectations for automation are rapidly increasing.
Sonar is a company specializing in analysis of code quality and security, and they recently released a new survey – the State of Code Developer Survey. The survey provides a deep examination of how developers are using AI in real production environments, and where the real-world gaps and risks still exist.
Chris Grams is the CVP of Corporate Marketing at Sonar, and Manish Kapur is the VP of Product Marketing and Developer Relations at Sonar. In this episode, they join Matt Merrill to discuss what the survey reveals about AI-assisted development, why 96% of developers still don’t fully trust AI-generated code, how deterministic verification layers fit into agent-driven workflows, and what engineering leaders should prioritize as AI shifts from experimentation to production infrastructure.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Hype and Reality of the AI Coding Shift appeared first on Software Engineering Daily.
AI agents are increasingly capable of reasoning and performing autonomous work over long periods. However, as agents take on more complex, longer-horizon tasks, keeping them supplied with the right information becomes the core engineering challenge. The industry is moving away from pre-loading context upfront toward a model where agents dynamically navigate and retrieve the data they need, when they need it.
Redis is approaching context management using a context engine, which is an architecture built around four pillars: on-demand context retrieval, data that is always current, fast retrieval, and a memory layer that improves over time. In practice this means building materialized views of data with a semantic layer on top, rather than giving agents direct access to production databases. A memory system sits alongside this, extracting and compacting information asynchronously as the agent works.
Simba Khadder leads AI strategy at Redis, and he previously co-founded the feature store platform FeatureForm, which was acquired by Redis in 2025. In this episode, Simba joins Kevin Ball to discuss why context has become the defining challenge in agentic AI, how context engines differ from traditional RAG architectures, how materialized views underpin reliable agent data pipelines, how memory systems can improve through async extraction and compaction, and how engineering teams need to adapt their practices as AI-driven development accelerates.
Full Disclosure: This episode is sponsored by Redis.
Kevin Ball or KBall, is the vice president of engineering at Mento and an independent coach for engineers and engineering leaders. He co-founded and served as CTO for two companies, founded the San Diego JavaScript meetup, and organizes the AI inaction discussion group through Latent Space.
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Unlocking the Data Layer for Agentic AI with Simba Khadder appeared first on Software Engineering Daily.
AI agents are evolving from individual productivity tools into distributed systems components inside enterprises. The next frontier is coming into focus, and it involves large-scale ecosystems of collaborating agents embedded directly into business processes. However, multi-agent architectures introduce serious challenges around orchestration, state management, trust, governance, and observability.
Eric Broda is a veteran of the software industry, and he’s the co-author of the new O’Reilly book, Agentic Mesh: The GenAI-Powered Autonomous Agent Ecosystem.
In this episode, Eric joins Sean Falconer to discuss the architectural challenges of deploying agents as core infrastructure, how distributed computing principles apply to multi-agent systems, why trust and explainability are foundational, and what enterprises may look like as agents become full participants in business processes.
Sean’s been an academic, startup founder, and Googler. He has published works covering a wide range of topics from AI to quantum computing. Currently, Sean is an AI Entrepreneur in Residence at Confluent where he works on AI strategy and thought leadership. You can connect with Sean on LinkedIn.
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Agentic Mesh with Eric Broda appeared first on Software Engineering Daily.
Observability emerged from the need to understand complex software systems, and involves tracking metrics, logs, and traces so engineers can detect and diagnose problems before they affect users. However, modern applications often encompass hundreds of services, containers, and dependencies, generating more observability data than dashboards and alerts alone can effectively surface.
New Relic is a leading observability platform, with a history that spans the full arc of modern software operations. Today they are working to apply AI to move observability beyond passive monitoring toward active intelligence, where systems can surface what matters, reduce alert noise, and ultimately take autonomous action before problems reach engineers or users.
Nic Benders is the Chief Technology Strategist at New Relic, where he has worked for 16 years. In this episode, Nic joins Lee Atchison to discuss the evolution of observability from dashboards and alerts to AI-driven intelligence, how LLMs and statistical tools work together to surface meaningful signals from massive datasets, the emerging challenge of observing AI systems themselves, and what the rise of AI means for the future of software engineering as a profession.
This episode is hosted by Lee Atchison. Lee Atchison is a software architect, author, and thought leader on cloud computing and application modernization. His best-selling book, Architecting for Scale (O’Reilly Media), is an essential resource for technical teams looking to maintain high availability and manage risk in their cloud environments.Lee is the host of his podcast, Modern Digital Business, an engaging and informative podcast produced for people looking to build and grow their digital business with the help of modern applications and processes developed for today’s fast-moving business environment. Listen at mdb.fm. Follow Lee at softwarearchitectureinsights.com, and see all his content at leeatchison.com.
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post New Relic and Agentic DevOps with Nic Benders appeared first on Software Engineering Daily.
Mobile apps have become a primary interface for critical services, including banking, payments, and healthcare. Unlike web applications, much of the logic and intellectual property in a mobile app lives directly on the user’s device, which is an environment the developer doesn’t control. That makes mobile apps uniquely exposed to reverse engineering, runtime manipulation, and fraud.
As more critical functionality shifts to mobile, the need to harden apps against sophisticated attackers continues to grow. Guardsquare builds tools to protect and test mobile applications against both static and dynamic threats. Its platform has features including layered code obfuscation, runtime application self-protection, mobile-specific security testing, threat monitoring, and API attestation.
Ryan Lloyd is the Chief Product Officer at Guardsquare. In this episode, he joins Gregor Vand to discuss why mobile security differs from desktop and web security, how reverse engineering tools have evolved, the role of compiler-based obfuscation and runtime protections, common mobile app vulnerabilities, and how LLMs are reshaping the attacker landscape.
Full Disclosure: This episode is sponsored by Guardsquare.
Gregor Vand is a security-focused technologist, having previously been a CTO across cybersecurity, cyber insurance and general software engineering companies. He is based in Singapore and can be found via his profile at vand.hk or on LinkedIn.
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Mobile App Security with Ryan Lloyd appeared first on Software Engineering Daily.
The Model Context Protocol, or MCP, gives developers a common way to expose tools, data, and capabilities to large language models, and it has quickly become an important standard in agentic AI. FastMCP is an open source project stewarded by the team at Prefect, which is an orchestration platform for AI and data workflows. The FastMCP project builds on MCP to provide high-level, ergonomic abstractions for Python developers to rapidly build and deploy MCP servers and applications.
Jeremiah Lowin is the founder and CEO of Prefect, and Adam Azzam is the VP of Product at the company. In this episode, Jeremiah and Adam join Gregor Vand to discuss the origin story of FastMCP, the three pillars of the framework, the architectural decisions behind FastMCP 3.0, and much more.
Gregor Vand is a security-focused technologist, having previously been a CTO across cybersecurity, cyber insurance and general software engineering companies. He is based in Singapore and can be found via his profile at vand.hk or on LinkedIn.
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post FastMCP with Adam Azzam and Jeremiah Lowin appeared first on Software Engineering Daily.
SED News is a monthly podcast from Software Engineering Daily where hosts Gregor Vand and Sean Falconer unpack the biggest stories shaping software engineering, Silicon Valley, and the broader tech industry.
In this episode, they cover the resurgence of ARM and CPUs as serious compute infrastructure for running local AI agents, a supply chain attack on LiteLLM that exposed API credentials across thousands of developer environments, and the arrival of OpenCode as a fully open source alternative to Claude Code and Codex. They also discuss the diverging strategies of Anthropic and OpenAI following the Pentagon contract controversy, and what it signals about where each company is positioning itself in the enterprise and government markets. Gregor and Sean then dive deep into what the AI coding boom actually means for shipping software.
Finally, they highlight standout threads from Hacker News, including Doom running entirely over DNS, the psychology of seafoam green in Cold War-era control rooms, a Tesla Model 3 computer assembled from salvaged crash components, and Apple’s quiet discontinuation of the Mac Pro.
Gregor Vand is a security-focused technologist, having previously been a CTO across cybersecurity, cyber insurance and general software engineering companies. He is based in Singapore and can be found via his profile at vand.hk or on LinkedIn.
Sean’s been an academic, startup founder, and Googler. He has published works covering a wide range of topics from AI to quantum computing. Currently, Sean is an AI Entrepreneur in Residence at Confluent where he works on AI strategy and thought leadership. You can connect with Sean on LinkedIn.
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post SED News: OpenCode, AI Code vs. Shipped Code, and the LiteLLM Breach appeared first on Software Engineering Daily.
FreeBSD is one of the longest-running and most influential open-source operating systems in the world. It was born from the Berkeley Software Distribution in the early 1990s, it has powered everything from high-performance networking infrastructure to game consoles and content delivery networks. Over three decades, it has evolved through major architectural shifts, from symmetric multiprocessing and kernel scalability to modern storage systems and predictable release engineering.
John Baldwin has spent more than 25 years working on FreeBSD as a developer, contributor, and consultant. In this episode, John joins Gregor Vand to discuss the origins of FreeBSD, how its governance model differs from other open-source projects, its role inside systems like Netflix’s CDN and the PlayStation 4, the challenges of maintaining a 30-year-old codebase, and much more.
Gregor Vand is a security-focused technologist, having previously been a CTO across cybersecurity, cyber insurance and general software engineering companies. He is based in Singapore and can be found via his profile at vand.hk or on LinkedIn.
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post FreeBSD with John Baldwin appeared first on Software Engineering Daily.
Modern cloud-native systems are built on highly dynamic, distributed infrastructure where containers spin up and down constantly, services communicate across clusters, and traditional networking assumptions break down. Linux networking was designed decades ago around static IPs and linear rule processing, which makes it increasingly difficult to achieve scale in Kubernetes environments. At the same time, modifying the Linux kernel to keep up with these demands is slow, risky, and impractical for most organizations.
The Extended Berkeley Packet Filter, or eBPF, is a Linux kernel technology that allows sandboxed programs to run safely inside the kernel without modifying kernel source code or loading kernel modules. Cilium is an open-source, cloud-native networking platform that’s built on eBPF, and provides, secures, and observes connectivity between workloads in Kubernetes and other distributed environments.
Bill Mulligan is a maintainer in the Cilium ecosystem and a member of the team at Isovalent, the company behind Cilium. He joins the show with Gregor Vand to discuss how eBPF works under the hood, why Cilium has become one of the most widely adopted Kubernetes networking projects, and how the future of cloud-native infrastructure is being reshaped by programmable kernels.
Gregor Vand is a security-focused technologist, having previously been a CTO across cybersecurity, cyber insurance and general software engineering companies. He is based in Singapore and can be found via his profile at vand.hk or on LinkedIn.
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Cilium, eBPF, and Modern Kubernetes Networking with Bill Mulligan appeared first on Software Engineering Daily.
Bennett Foddy is a legendary game designer known for creating wholly distinctive games such as QWOP, Getting Over It with Bennett Foddy, and the recently released Baby Steps. He’s also a former professor at the NYU Game Center, where he taught game design alongside developing his own experimental work.
In this episode, Bennett joins Joe Nash to discuss his systems-driven approach to game design, why frustration and difficulty are often misunderstood, how streaming and speedrunning have reshaped how games are played and experienced, and what makes his games stand out.
Joe Nash is a developer, educator, and award-winning community builder, who has worked at companies including GitHub, Twilio, Unity, and PayPal. Joe got his start in software development by creating mods and running servers for Garry’s Mod, and game development remains his favorite way to experience and explore new technologies and concepts.
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Games That Push Back with Bennett Foddy appeared first on Software Engineering Daily.
Developer tooling shapes how software gets written day to day, but the best tools often disappear into the background once they succeed. Formatting, linting, and build systems can either create friction and endless debate, or quietly remove entire classes of problems from a team’s workflow. Over the past decade, the JavaScript ecosystem has wrestled with both extremes as it scaled rapidly and accumulated complexity.
Prettier emerged as a response to the surprisingly human problem of engineers spending too much time debating code style instead of building software. It offers a deterministic, opinionated formatter that helped normalize automation as part of everyday development.
James Long is a design and product engineer who has worked at Mozilla and Stripe, and he’s the creator of Prettier. He joins the show with Josh Goldberg to talk about the origins of Prettier, why formatting debates are so emotionally charged, the technical challenges of building formatters, the realities of maintaining popular open-source tools, and how the JavaScript tooling ecosystem continues to evolve.
Josh Goldberg is an independent full time open source developer in the TypeScript ecosystem. He works on projects that help developers write better TypeScript more easily, most notably on typescript-eslint: the tooling that enables ESLint and Prettier to run on TypeScript code. Josh regularly contributes to open source projects in the ecosystem such as ESLint and TypeScript. Josh is a Microsoft MVP for developer technologies and the author of the acclaimed Learning TypeScript (O’Reilly), a cherished resource for any developer seeking to learn TypeScript without any prior experience outside of JavaScript. Josh regularly presents talks and workshops at bootcamps, conferences, and meetups to share knowledge on TypeScript, static analysis, open source, and general frontend and web development.
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Prettier and Opinionated Code Formatting with James Long appeared first on Software Engineering Daily.
Skateboarding games have long balanced technical precision with a sense of flow and expression, but Skate Story takes the genre in a radically different direction. It has a distinct vaporwave vibe and blends fluid skate mechanics with exploration, puzzles, and an existential narrative about freedom, pain, and obsession.
The game was created by indie developer Sam Eng, who previously released Zarvot for the Nintendo Switch. Skate Story launched to critical acclaim and was widely regarded as one of the best games of 2025.
In this episode, Sam joins the show with Joe Nash to talk about developing Skate Story.
Joe Nash is a developer, educator, and award-winning community builder, who has worked at companies including GitHub, Twilio, Unity, and PayPal. Joe got his start in software development by creating mods and running servers for Garry’s Mod, and game development remains his favorite way to experience and explore new technologies and concepts.
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Skate Story with Sam Eng appeared first on Software Engineering Daily.
Retrieval-augmented generation, or RAG, has become a foundational approach to building production AI systems. However, deploying RAG in practice can be complex and costly. Developers typically have to manage vector databases, chunking strategies, embedding models, and indexing infrastructure. Designing effective RAG systems is also a moving target, as techniques and best practices evolve in step with rapidly advancing language models.
Google DeepMind recently released the File Search Tool, a fully managed RAG system built directly into the Gemini API. File Search abstracts away the retrieval pipeline, allowing developers to upload documents, code, and other text data, automatically generate embeddings, and query their knowledge base. We wanted to understand how the DeepMind team designed a general-purpose RAG system that maintains high retrieval quality.
Animesh Chatterji is a Software Engineer at Google DeepMind and Ivan Solovyev is a Product Manager at DeepMind, and they worked on File Search Tool. They joined the podcast with Sean Falconer to discuss the evolution of RAG, why simplicity and pricing transparency matter, how embedding models have improved retrieval quality, the tradeoffs between configurability and ease of use, and what’s next for multimodal retrieval across text, images, and beyond.
Sean’s been an academic, startup founder, and Googler. He has published works covering a wide range of topics from AI to quantum computing. Currently, Sean is an AI Entrepreneur in Residence at Confluent where he works on AI strategy and thought leadership. You can connect with Sean on LinkedIn.
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post DeepMind’s RAG System with Animesh Chatterji and Ivan Solovyev appeared first on Software Engineering Daily.
Interactive notebooks were popularized by the Jupyter project and have since become a core tool for data science, research, and data exploration. However, traditional, imperative notebooks often break down as projects grow more complex. Hidden state, non-reproducible execution, poor version control ergonomics, and difficulty reusing notebook code in real software systems make it hard to move from exploration to production. At the same time, sharing results often requires collaborators to recreate entire environments, limiting interactivity and slowing feedback.
Marimo is an open-source, next-generation Python notebook designed to address these problems directly. Akshay Agrawal is the creator of Marimo and he previously worked at Google Brain. He joins the show with Kevin Ball to discuss the limitations of traditional notebooks, the design of reactive notebooks in Python, how marimo bridges research and production, and where notebooks fit in an increasingly agentic, AI-assisted development world.
Kevin Ball or KBall, is the vice president of engineering at Mento and an independent coach for engineers and engineering leaders. He co-founded and served as CTO for two companies, founded the San Diego JavaScript meetup, and organizes the AI inaction discussion group through Latent Space.
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Reinventing the Python Notebook with Akshay Agrawal appeared first on Software Engineering Daily.
AI agents have taken on a growing share of software development work, so much so that the hardest problems are shifting away from code generation towards something new, context. The challenge is now contextualizing why systems work the way they do, how architectural decisions were made, and the sources of truth that exist outside of the code base. As teams adopt agentic tools, gaps or inconsistencies in context have emerged as a primary reason why software fails to meet production standards.
Unblocked is a startup focused on solving this context gap. Their context engine aggregates and reasons over organizational knowledge spread across source code, pull requests, documentation, chat systems, and production telemetry. By acting as a context engine for both developers and AI agents, Unblocked aims to improve AI code quality and review, reduce interruptions, accelerate onboarding, and enable safer, more effective agentic workflows.
Dennis Pilarinos is the Founder and CEO of Unblocked. Previously, he helped build Azure at Microsoft, worked at AWS, and co-founded BuddyBuild, which is a mobile CI platform acquired by Apple. Dennis joins Kevin Ball to discuss context engineering, reconciling conflicting sources nof truth, permission to wear AI systems, the shifting bottlenecks in the software development lifecycle, and what it means to be a software engineer in an increasingly agentic world.
Full Disclosure: This episode is sponsored by Unblocked.
Kevin Ball or KBall, is the vice president of engineering at Mento and an independent coach for engineers and engineering leaders. He co-founded and served as CTO for two companies, founded the San Diego JavaScript meetup, and organizes the AI inaction discussion group through Latent Space.
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Organizational Context for AI Coding Agents with Dennis Pilarinos appeared first on Software Engineering Daily.
SED News is a monthly podcast from Software Engineering Daily where hosts Gregor Vand and Sean Falconer unpack the biggest stories shaping software engineering, Silicon Valley, and the broader tech industry.
In this episode, they cover the viral rise of OpenClaw and its founder’s move to OpenAI, OpenAI’s exploration of ads inside ChatGPT, and Alibaba’s push into agent-powered commerce during Lunar New Year. They also discuss Mistral’s acquisition of Koyeb to deepen its compute stack, the growing competition between ChatGPT, Claude, and Gemini, and what these moves signal about monetization, infrastructure, and control in the AI arms race.
Gregor and Sean then dive deep into the rapid acceleration of agentic engineering. They examine how tools like Claude Code and Codex are compressing the idea-to-production cycle, what multi-agent orchestration means for software teams, whether the era of the “10x engineer” is ending, and how organizational structures may need to evolve as coding shifts from manual craft to supervised automation.
Finally, they highlight standout threads from Hacker News, including reverse engineering a 1990 DOS classic, a 3D reimagining of flight tracking data, old-school practical film effects using cloud tanks, and the privacy-focused GrapheneOS mobile operating system.
Gregor Vand is a security-focused technologist, having previously been a CTO across cybersecurity, cyber insurance and general software engineering companies. He is based in Singapore and can be found via his profile at vand.hk or on LinkedIn.
Sean’s been an academic, startup founder, and Googler. He has published works covering a wide range of topics from AI to quantum computing. Currently, Sean is an AI Entrepreneur in Residence at Confluent where he works on AI strategy and thought leadership. You can connect with Sean on LinkedIn.
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post SED News: OpenClaw Goes Viral, Mistral’s Compute Play, and the Agent Arms Race appeared first on Software Engineering Daily.
AI-assisted coding tools have made it easier than ever to spin up prototypes, but turning those prototypes into reliable, production-grade systems remains a major challenge. Large language models are non-deterministic, prone to drift, and often lose track of intent over long development sessions.
Kiro is an AI-powered IDE that’s built around a spec-driven development workflow. It’s focused on helping developers capture intent up front, translate it into concrete requirements and designs, and systematically validate implementations through tasks, testing, and guardrails. It aims to preserve the creativity of AI-assisted development while producing software that is ready for real-world use.
David Yanacek is a Senior Principal Engineer and a lead advisor on the Agentic AI team at AWS. Today, his work focuses on Kiro, frontier agents, Amazon Bedrock AgentCore, and AWS’s operational agents. He joins the show with Kevin Ball to discuss the design of Kiro, how spec-driven development changes the way teams work with AI coding agents, and what the next generation of agentic software development might look like.
Kevin Ball or KBall, is the vice president of engineering at Mento and an independent coach for engineers and engineering leaders. He co-founded and served as CTO for two companies, founded the San Diego JavaScript meetup, and organizes the AI inaction discussion group through Latent Space.
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Amazon’s IDE for Spec-Driven Development with David Yanacek appeared first on Software Engineering Daily.
Enterprise IT systems have grown into sprawling, highly distributed environments spanning cloud infrastructure, applications, data platforms, and increasingly AI-driven workloads. Observability tools have made it easier to collect metrics, logs, and traces, but understanding why systems fail and responding quickly remains a persistent challenge. As complexity continues to rise, the industry is looking beyond dashboards and alerts toward agentic AI systems that can reason about operational data, reduce toil, and take action when things go wrong.
SolarWinds offers solutions to monitor, understand, and remediate issues across complex, distributed systems. The company began as a leader in network and infrastructure monitoring, and has evolved to support modern applications, cloud environments, containers, and AI workloads, with a growing focus on reducing operational toil.
Krishna Sai is the Chief Technology Officer at SolarWinds. He joins the show with Sean Falconer to discuss how SolarWinds is rethinking observability in the age of AI, what it means to design agentic systems for mission-critical environments, how AI-assisted programming is reshaping engineering workflows, and why the future of operations depends on building platforms where humans and autonomous agents work together.
Full Disclosure: This episode is sponsored by SolarWinds.
Sean’s been an academic, startup founder, and Googler. He has published works covering a wide range of topics from AI to quantum computing. Currently, Sean is an AI Entrepreneur in Residence at Confluent where he works on AI strategy and thought leadership. You can connect with Sean on LinkedIn.
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Engineering AI Systems for Autonomy and Resilience with Krishna Sai appeared first on Software Engineering Daily.
China’s Great Firewall is often spoken about but is rarely understood. It is one of the most sophisticated and opaque censorship systems on the planet, and it shapes how over a billion people interact with the global internet, influences the design of privacy and proxy tools worldwide, and continues to evolve in ways that challenge researchers, developers, and policymakers alike.
Jackson Sippe is a PhD researcher at the University of Colorado Boulder whose work focuses on uncovering how national-scale censorship systems operate. Jackson recently helped lead a groundbreaking study analyzing a previously undocumented GFW technique that quietly broke fully encrypted proxy protocols across China for more than a year.
In this episode, Jackson joins Gregor Vand to discuss how the Great Firewall works at a technical level, the 2021–2023 blocking event, the popcount-based detection algorithm his team reverse-engineered, the cat-and-mouse ecosystem of censorship circumvention, and what these findings mean for the future of the open internet.
Gregor Vand is a security-focused technologist, having previously been a CTO across cybersecurity, cyber insurance and general software engineering companies. He is based in Singapore and can be found via his profile at vand.hk or on LinkedIn.
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Inside China’s Great Firewall with Jackson Sippe appeared first on Software Engineering Daily.
LLM -powered systems continue to move steadily into production, but this process is presenting teams with challenges that traditional software practices don’t commonly encounter. Models and agents are non-deterministic systems, which makes it difficult to test changes, reason about failures, and confidently ship updates. This has created the need for new evaluation tooling designed specifically around the properties of LLMs.
Comet is a platform with Roots and MLOps, to the rapidly evolving world of agent-based systems by treating prompts, tools, and workflows as optimizable components that can be evaluated and improved over time.
Gideon Mendels is the co -founder and CEO of Comet. He previously worked at Google on hate speech and deception detection, and he founded GroupWise, which trained and deployed NLP models processing billions of chats. In this episode, Gideon joins Kevin Ball to discuss how agent development sits between software engineering and ML, why eVals are the missing foundation for most AI teams, prompt optimization as a search problem, and the future for continuously improving agents in production.
Full Disclosure: This episode is sponsored by Comet.
Kevin Ball or KBall, is the vice president of engineering at Mento and an independent coach for engineers and engineering leaders. He co-founded and served as CTO for two companies, founded the San Diego JavaScript meetup, and organizes the AI inaction discussion group through Latent Space.
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Optimizing Agent Behavior in Production with Gideon Mendels appeared first on Software Engineering Daily.
AI-assisted programming has moved far beyond autocomplete. Large language models are now capable of editing entire codebases, coordinating long-running tasks, and collaborating across multiple systems. As these capabilities mature, the core challenge in software development is shifting away from writing code and toward orchestrating work, managing context, and maintaining shared understanding across fleets of agents.
Steve Yegge is a software engineer, writer, and industry veteran whose essays have shaped how many developers think about their work. Over the past year, Steve has been exploring the frontier of agentic software development, building tools like Beads and Gas Town to experiment with multi-agent coordination, shared memory, and AI-driven software workflows.
In this episode, Steve joins Kevin Ball to discuss the evolution of AI coding from chat-based assistance to full agent orchestration, the technical and cognitive challenges of managing fleets of agents, how concepts like task graphs and Git-backed ledgers change the nature of work, and what these shifts mean for software teams, tooling, and the future of the industry.
Kevin Ball or KBall, is the vice president of engineering at Mento and an independent coach for engineers and engineering leaders. He co-founded and served as CTO for two companies, founded the San Diego JavaScript meetup, and organizes the AI inaction discussion group through Latent Space.
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Gas Town, Beads, and the Rise of Agentic Development with Steve Yegge appeared first on Software Engineering Daily.
Python 3.14 is here and continues Python’s evolution toward greater performance, scalability, and usability. The new release formally supports free-threaded, no-GIL mode, introduces template string literals, and implements deferred evaluation of type annotations. It also includes new debugging and profiling tools, along with many other features.
Łukasz Langa is the CPython Developer in Residence at the Python Software Foundation, and he joins Sean Falconer to discuss the 3.14 release, the future of free threading, type system improvements, Python’s growing role in AI, and how the language continues to evolve while maintaining its commitment to backward compatibility.
Sean’s been an academic, startup founder, and Googler. He has published works covering a wide range of topics from AI to quantum computing. Currently, Sean is an AI Entrepreneur in Residence at Confluent where he works on AI strategy and thought leadership. You can connect with Sean on LinkedIn.
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Python 3.14 with Łukasz Langa appeared first on Software Engineering Daily.
Engineering teams often build microservices as their systems grow, but over time this can lead to a fragmented ecosystem with scattered data access patterns, duplicated business logic, and an uneven developer experience. A unified data graph with a consistent execution layer helps address these challenges by centralizing schema, simplifying how teams compose functionality, and reducing operational overhead while preserving performance and reliability.
Viaduct is Airbnb’s open-source, data-oriented service mesh and GraphQL platform built around a single, highly connected central schema. It has played a major role in scaling Airbnb’s engineering organization.
Adam Miskiewicz is a Principal Software Engineer at Airbnb and he worked on Viaduct. He joins the podcast with Gregor Vand to talk about how Viaduct originated inside Airbnb, the architectural principles that shaped it, the challenges of scaling GraphQL to millions of queries per second, and why the team decided to open-source the platform. They also discuss the future of backend development in an AI-driven world and how unified data layers may influence the next generation of engineering systems.
Gregor Vand is a security-focused technologist, having previously been a CTO across cybersecurity, cyber insurance and general software engineering companies. He is based in Singapore and can be found via his profile at vand.hk or on LinkedIn.
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Airbnb’s Open-Source GraphQL Framework with Adam Miskiewicz appeared first on Software Engineering Daily.
SED News is a monthly podcast from Software Engineering Daily where hosts Gregor Vand and Sean Falconer unpack the biggest stories shaping software engineering, Silicon Valley, and the broader tech industry.
In this episode, they cover Starlink’s rapid rollout of free, high-speed in-flight internet, Tesla’s move to deprecate Autopilot in favor of full self-driving, and Apple’s reported decision to power Siri with Google’s Gemini models. They also discuss Meta’s $2B acquisition of Manus, Waymo’s growing pains as autonomous vehicles scale, and the competitive shockwaves triggered by Google’s advances in custom AI hardware.
Gregor and Sean then dive deep into the state of the tech job market, examining OpenAI’s decision to eliminate vesting cliffs, the escalating war for elite AI talent, and what recent layoffs really say about the future of software engineering. They explore how AI coding tools are reshaping the balance between junior and senior engineers, why fundamentals still matter, and what developers should focus on heading into 2026.
Finally, they highlight standout threads from Hacker News, including Doom running on wireless earbuds, the enduring appeal of wildly over-engineered side projects, and why hacking for fun still matters in an age of industrial-scale AI.
Gregor Vand is a security-focused technologist, having previously been a CTO across cybersecurity, cyber insurance and general software engineering companies. He is based in Singapore and can be found via his profile at vand.hk or on LinkedIn.
Sean’s been an academic, startup founder, and Googler. He has published works covering a wide range of topics from AI to quantum computing. Currently, Sean is an AI Entrepreneur in Residence at Confluent where he works on AI strategy and thought leadership. You can connect with Sean on LinkedIn.
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post SED News: Apple Bets on Gemini, Google’s AI Advantage, and the Talent Arms Race appeared first on Software Engineering Daily.
AI coding agents are rapidly reshaping how software is built, reviewed, and maintained. As large language model capabilities continue to increase, the bottleneck in software development is shifting away from code generation toward planning, review, deployment, and coordination. This shift is driving a new class of agentic systems that operate inside constrained environments, reason over long time horizons, and integrate across tools like IDEs, version control systems, and issue trackers.
OpenAI is at the forefront of AI research and product development. In 2025, the company released Codex, which is an agentic coding system designed to work safely inside sandboxed environments while collaborating across the modern software development stack.
Thibault Sottiaux is the Codex engineering lead and Ed Bayes is the Codex product designer. In this episode, they join Kevin Ball to discuss how Codex is built, the co-evolution of models and harnesses, multi-agent futures, Codex’s open-source CLI, model specialization, latency and performance considerations, and much more.
Kevin Ball or KBall, is the vice president of engineering at Mento and an independent coach for engineers and engineering leaders. He co-founded and served as CTO for two companies, founded the San Diego JavaScript meetup, and organizes the AI inaction discussion group through Latent Space.
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post OpenAI and Codex with Thibault Sottiaux and Ed Bayes appeared first on Software Engineering Daily.
Engineering teams around the world are building AI-focused applications or integrating AI features into existing products. The AI development ecosystem is maturing, which is accelerating how quickly these applications can be prototyped. However, taking AI applications to production remains a notoriously complex process. Modern AI stacks demand LLMs, embeddings, vector search, observability, new caching layers, and constant adaptation as the landscape shifts week to week. Increasingly, the data layer has become both the foundation and the bottleneck to AI app productionization.
MongoDB has been expanding beyond its core document database into a full AI-ready database platform with integrated capabilities for operational data, search, real-time analytics, and AI-powered data retrieval. The company also recently acquired Voyage AI to provide accurate and cost-effective embedding models and rerankers to its users.
Fred Roma is a veteran engineer and is currently the SVP of Product and Engineering at MongoDB. He joins the show with Kevin Ball to talk about the state of AI application development, the role of vector search and reranking, schema evolution in the LLM era, the Voyage AI acquisition, how data platforms must evolve to keep up with AI’s breakneck pace, and more.
Full Disclosure: This episode is sponsored by MongoDB.
Kevin Ball or KBall, is the vice president of engineering at Mento and an independent coach for engineers and engineering leaders. He co-founded and served as CTO for two companies, founded the San Diego JavaScript meetup, and organizes the AI inaction discussion group through Latent Space.
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Production-Grade AI Systems with Fred Roma appeared first on Software Engineering Daily.
Package management sits at the foundation of modern software development, quietly powering nearly every software project in the world. Tools like npm and Yarn have long been the core of the JavaScript ecosystem, enabling developers to install, update, and share code with ease. But as projects grow larger and the ecosystem more complex, this older infrastructure is beginning to show its limits with performance bottlenecks, dependency conflicts, and growing concerns around supply chain security.
Darcy Clarke and Ruy Adorno are veterans of this ecosystem. Both spent years maintaining the npm CLI and helping guide the Node.js project, where they saw firsthand the technical debt and design tradeoffs that define modern JavaScript tooling. Now they’re building vlt, a new package manager and registry that rethinks performance, security, and developer experience from the ground up.
In this episode, Darcy and Ruy join Josh Goldberg to discuss how vlt works, why they believe package management needs a server-side reboot, what lessons they’ve drawn from npm’s evolution, and how features like declarative querying, self-hosted registries, and real-time security scanning could reshape how developers build and share JavaScript in the years ahead.
Josh Goldberg is an independent full time open source developer in the TypeScript ecosystem. He works on projects that help developers write better TypeScript more easily, most notably on typescript-eslint: the tooling that enables ESLint and Prettier to run on TypeScript code. Josh regularly contributes to open source projects in the ecosystem such as ESLint and TypeScript. Josh is a Microsoft MVP for developer technologies and the author of the acclaimed Learning TypeScript (O’Reilly), a cherished resource for any developer seeking to learn TypeScript without any prior experience outside of JavaScript. Josh regularly presents talks and workshops at bootcamps, conferences, and meetups to share knowledge on TypeScript, static analysis, open source, and general frontend and web development.
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Next-Gen JavaScript Package Management with Ruy Adorno and Darcy Clarke appeared first on Software Engineering Daily.
WebAssembly, or WASM, has grown from a low-level compilation target for C and C++ into one of the most influential technologies in modern computing. It now powers browser applications, edge compute platforms, embedded systems, and a growing ecosystem of languages targeting a portable and secure execution model.
Andreas Rossberg is a programming languages researcher and former member of the V8 team at Google. Andreas helped architect WebAssembly from its earliest concepts through its most recent milestone releases, including the groundbreaking 3.0 spec that introduces garbage collection, richer reference types, and major steps toward multi-language interoperability.
In this episode, Andreas joins Kevin Ball to explore the history of WebAssembly, the constraints that shaped its earliest design, the major turning points in versions 1.0, 2.0, and 3.0, and what’s coming next for WebAssembly.
Kevin Ball or KBall, is the vice president of engineering at Mento and an independent coach for engineers and engineering leaders. He co-founded and served as CTO for two companies, founded the San Diego JavaScript meetup, and organizes the AI inaction discussion group through Latent Space.
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post WebAssembly 3.0 with Andreas Rossberg appeared first on Software Engineering Daily.
Surveillance technology is advancing faster than the laws meant to govern it. Across the United States, police departments are deploying automated license plate readers, facial recognition tools, and predictive systems that quietly log the daily movements of millions of people. These tools promise efficiency and safety, but critics argue that they represent a form of warrantless mass surveillance, and raise deep constitutional questions about privacy, accountability, and the limits of government power in the digital age.
Michael Soyfer is an attorney at the Institute for Justice, a nonprofit public interest law firm focused on defending individual rights. His work centers on the Fourth Amendment and the growing use of surveillance technologies by local governments. Michael joins the show with Kevin Ball to discuss the rise of Flock Safety cameras, the Institute for Justice’s lawsuit against the City of Norfolk, how decades-old legal precedents struggle to keep up with modern technology, and what citizens, technologists, and policymakers can do to protect privacy in an era of pervasive data collection.
Kevin Ball or KBall, is the vice president of engineering at Mento and an independent coach for engineers and engineering leaders. He co-founded and served as CTO for two companies, founded the San Diego JavaScript meetup, and organizes the AI inaction discussion group through Latent Space.
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post America Under Surveillance with Michael Soyfer appeared first on Software Engineering Daily.
Modern software development is evolving rapidly. New tools, processes, and AI-powered systems are reshaping how teams collaborate and how engineers find satisfaction in their craft. At the same time, developer experience has become a critical function for helping organizations balance agility, security, and scale while maintaining the creativity and flow that make top tier engineering possible.
Capital One is continuously transforming its developer culture, with a focus on faster development cycles, reducing operational overhead, and boosting productivity across the organization.
Catherine McGarvey is the SVP of Developer Experience at Capital One. She joins the podcast with Sean Falconer to talk about what developer enablement means at enterprise scale, measuring developer productivity, being agile in a regulated environment, AI in enterprise development, the future for developers, and much more.
Full Disclosure: This episode is sponsored by Capital One.
Sean’s been an academic, startup founder, and Googler. He has published works covering a wide range of topics from AI to quantum computing. Currently, Sean is an AI Entrepreneur in Residence at Confluent where he works on AI strategy and thought leadership. You can connect with Sean on LinkedIn.
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Developer Experience at Capital One with Catherine McGarvey appeared first on Software Engineering Daily.
Modern software development is more complex than ever. Teams work across different operating systems, chip architectures, and cloud environments, each with its own dependency quirks and version mismatches. Ensuring that code runs reproducibly across these environments has become a major challenge that’s made even harder by growing concerns around software supply chain security.
Nix is a powerful open-source package manager that builds software in controlled, declarative environments where dependencies are explicitly defined and reproducible. Its functional approach has made it a gold standard for reproducible builds, but it can also be difficult to learn and adopt.
Flox is a company that builds on top of Nix, with increased supply chain security and abstractions that streamline the developer experience.
Michael Stahnke is the VP of Engineering at Flox and formerly worked at companies including Caterpillar, Puppet, and CircleCI. He joins the podcast with Kevin Ball to talk about Flox, building on top of Nix, how reproducibility underpins software security, the concept of “secure by construction, how deterministic environments are reshaping both human and AI-driven development, and much more.
Full Disclosure: This episode is sponsored by Flox.
Kevin Ball or KBall, is the vice president of engineering at Mento and an independent coach for engineers and engineering leaders. He co-founded and served as CTO for two companies, founded the San Diego JavaScript meetup, and organizes the AI inaction discussion group through Latent Space.
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Flox, Nix, and Reproducible Software Systems with Michael Stahnke appeared first on Software Engineering Daily.
Visual Studio Code has become one of the most influential tools in modern software development. The open-source code editor has evolved into a platform used by millions of developers around the world, and it has reshaped expectations for what a modern development environment can be through its intuitive UX, rich extension marketplace, and deep integration with today’s tooling landscape. Now, in an era defined by rapid advances in AI-assisted programming, VS Code is at the center of a profound shift in how software is written.
Kai Maetzel is the Engineering Manager leading the VS Code team at Microsoft. He joins the show with Kevin Ball to talk about the origins of VS Code, how AI has reshaped the editor’s design philosophy, the rise of agentic programming models, and what the future of development might look like.
Kevin Ball or KBall, is the vice president of engineering at Mento and an independent coach for engineers and engineering leaders. He co-founded and served as CTO for two companies, founded the San Diego JavaScript meetup, and organizes the AI inaction discussion group through Latent Space.
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post VS Code and Agentic Development with Kai Maetzel appeared first on Software Engineering Daily.
Blender Studio is the creative arm of the Blender Foundation and it’s dedicated to producing films, games, and other projects that showcase the full potential of Blender. The studio functions as both an art and technology lab and pushes the boundaries of 3D animation through open productions. All of their assets, production files, and workflows are shared publicly, which gives artists and developers valuable resources to learn from and build upon.
Most recently, Blender Studio released its second game, DOGWALK, where the playable character is a dog exploring snowy winter woods with a child. The project was built entirely with open-source tools including Blender, the Godot engine, Krita for concept art, Kitsu for project management, and Linux.
Simon Thommes is a Lead Technical Artist at Blender Studio and a developer on DOGWALK. He joins the podcast with Joe Nash to talk about Blender Studio, the process behind building DOGWALK, and developing a pipeline between Blender and Godot.
Joe Nash is a developer, educator, and award-winning community builder, who has worked at companies including GitHub, Twilio, Unity, and PayPal. Joe got his start in software development by creating mods and running servers for Garry’s Mod, and game development remains his favorite way to experience and explore new technologies and concepts.
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Blender and Godot in Game Development with Simon Thommes appeared first on Software Engineering Daily.
JavaScript has grown far beyond the browser. It now powers millions of backend systems, APIs, and cloud services through Node.js, which is one of the most widely deployed runtimes on the planet. Keeping such a critical piece of infrastructure fast, secure, and stable is a massive engineering challenge, and the work behind it is often invisible.
Rafael Gonzaga is a Principal Open Source Engineer at NodeSource and a member of the Node.js Technical Steering Committee. He’s spent years digging into the performance and security layers of Node’s core, helping shape the direction of the runtime itself. Rafael joins the show to talk about the state of Node.js performance, how benchmarking really works, the balance between speed and stability, and what it means to contribute to one of the world’s most important open-source projects.
Josh Goldberg is an independent full time open source developer in the TypeScript ecosystem. He works on projects that help developers write better TypeScript more easily, most notably on typescript-eslint: the tooling that enables ESLint and Prettier to run on TypeScript code. Josh regularly contributes to open source projects in the ecosystem such as ESLint and TypeScript. Josh is a Microsoft MVP for developer technologies and the author of the acclaimed Learning TypeScript (O’Reilly), a cherished resource for any developer seeking to learn TypeScript without any prior experience outside of JavaScript. Josh regularly presents talks and workshops at bootcamps, conferences, and meetups to share knowledge on TypeScript, static analysis, open source, and general frontend and web development.
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Node.js in 2026 with Rafael Gonzaga appeared first on Software Engineering Daily.
Zachtronics is a legendary independent game studio known for creating intricate, engineering-focused puzzle games that merge logic, creativity, and code. The studio was founded by Zach Barth in 2011, and it has become a cult favorite among programmers and tinkerers alike with titles such as SpaceChem, Infinifactory, TIS-100, and Shenzhen I/O. Most recently, Zachtronics released Kaizen: A Factory Story, in which players take on the role of an American engineer hired by a Japanese manufacturing company in the 1980s to design assembly processes for various products.
Zach Barth joins the podcast with Joe Nash to talk about the games he makes.
Joe Nash is a developer, educator, and award-winning community builder, who has worked at companies including GitHub, Twilio, Unity, and PayPal. Joe got his start in software development by creating mods and running servers for Garry’s Mod, and game development remains his favorite way to experience and explore new technologies and concepts.
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Designing Innovative Puzzle Games with Zach Barth appeared first on Software Engineering Daily.
Rivals of Aether and Rivals of Aether II are indie fighting games that combine fast-paced platform combat with elemental-themed characters. The game takes inspiration from Super Smash Bros. and emphasizes skillful movement, tight controls, and competitive balance, making it popular in the fighting game community.
Dan Fornace is a game director and designer at Aether Studios, the developer of Rivals of Aether. He joins the show with Joe Nash to talk about developing platform fighting games.
Joe Nash is a developer, educator, and award-winning community builder, who has worked at companies including GitHub, Twilio, Unity, and PayPal. Joe got his start in software development by creating mods and running servers for Garry’s Mod, and game development remains his favorite way to experience and explore new technologies and concepts.
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Rivals of Aether with Dan Fornace appeared first on Software Engineering Daily.
Aviation cybersecurity is becoming an urgent priority as modern aircraft increasingly rely on complex digital systems for navigation, communication, and engine performance. These systems were once isolated but are now interconnected and vulnerable to cyber threats ranging from GPS spoofing to ransomware attacks on airline infrastructure. As nation-state actors and criminal groups grow more sophisticated, the aviation sector faces a rapidly expanding attack surface, with life-or-death consequences. Understanding and addressing these risks is essential not only for passenger safety but for the resilience of global transportation networks.
Serge Christiaans is a former Dutch Air Force pilot with a background in electronic and hybrid warfare. He later flew commercially for Singapore Airlines and is now the Lead Instructor and Program Director at the Aviation Cyber Academy. He joins the podcast with Gregor Vand to discuss the convergence of aviation and cybersecurity, the aircraft as a digital attack surface, hybrid warfare, the urgent need for aviation cyber resilience, and much more.
Gregor Vand is a security-focused technologist, having previously been a CTO across cybersecurity, cyber insurance and general software engineering companies. He is based in Singapore and can be found via his profile at vand.hk or on LinkedIn.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Aviation Cybersecurity with Serge Christiaans appeared first on Software Engineering Daily.
Modern software relies heavily on open source dependencies, often pulling in thousands of packages maintained by developers all over the world. This accelerates innovation but also creates serious supply chain risks as attackers increasingly compromise popular libraries to spread malware at scale.
Feross Aboukhadijeh is the founder and CEO of Socket which is a security platform designed to protect software projects from open source supply chain attacks. In this episode he joins Josh Goldberg to talk about his career in open source, open source supply chain attacks, practical security lessons, the expanding attack surface in software development, and more.
Josh Goldberg is an independent full time open source developer in the TypeScript ecosystem. He works on projects that help developers write better TypeScript more easily, most notably on typescript-eslint: the tooling that enables ESLint and Prettier to run on TypeScript code. Josh regularly contributes to open source projects in the ecosystem such as ESLint and TypeScript. Josh is a Microsoft MVP for developer technologies and the author of the acclaimed Learning TypeScript (O’Reilly), a cherished resource for any developer seeking to learn TypeScript without any prior experience outside of JavaScript. Josh regularly presents talks and workshops at bootcamps, conferences, and meetups to share knowledge on TypeScript, static analysis, open source, and general frontend and web development.
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Blocking Software Supply Chain Attacks with Feross Aboukhadijeh appeared first on Software Engineering Daily.
Python’s popularity in data science and backend engineering has made it the default language for building AI infrastructure. However, with the rapid growth of AI applications, developers are increasingly looking for tools that combine Python’s flexibility with the rigor of production-ready systems.
Pydantic began as a library for type-safe data validation in Python and has become one of the language’s most widely adopted projects. More recently, the Pydantic team created Pydantic AI, a type-safe agent framework for building reliable AI systems in Python.
Samuel Colvin is the creator of Pydantic and Pydantic AI. In this episode, he joins the podcast with Gregor Vand to discuss the origins of Pydantic, the design principles behind type safety in AI applications, the evolution of Pydantic AI, the LogFire observability platform, and how open-source sustainability and engineering discipline are shaping the next generation of AI tooling.
Gregor Vand is a security-focused technologist, having previously been a CTO across cybersecurity, cyber insurance and general software engineering companies. He is based in Singapore and can be found via his profile at vand.hk or on LinkedIn.
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Pydantic AI with Samuel Colvin appeared first on Software Engineering Daily.
SED News is a monthly podcast from Software Engineering Daily where hosts Gregor Vand and Sean Falconer unpack the biggest stories shaping software engineering, Silicon Valley, and the broader tech industry.
In this episode, they cover Jeff Bezos’s unexpected return to the CEO seat with Project Prometheus, the growing debate over whether AI investments are sustainable, and the ecosystem forming around OpenAI. They also dig into the surge of Nordic startups, and what it signals about innovation hotspots outside the Bay Area.
Gregor and Sean then dive deep into the idea of technology tipping points, when breakthrough products finally cross the threshold from fringe curiosity to mainstream adoption.
Finally, they highlight standout threads from Hacker News, including moss surviving in outer space, a typographer’s re-creation of San Francisco’s light-rail signage, CERN’s guiding principles for responsible AI adoption, and why classic Pixar films looked better on 35mm than they do in 4K.
Gregor Vand is a security-focused technologist, having previously been a CTO across cybersecurity, cyber insurance and general software engineering companies. He is based in Singapore and can be found via his profile at vand.hk or on LinkedIn.
Sean’s been an academic, startup founder, and Googler. He has published works covering a wide range of topics from AI to quantum computing. Currently, Sean is an AI Entrepreneur in Residence at Confluent where he works on AI strategy and thought leadership. You can connect with Sean on LinkedIn.
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post SED News: Bezos Returns to Building, AI’s Reality Check, and Europe’s Cloud Ambitions appeared first on Software Engineering Daily.
PICO-8 is a software-based gaming console for making, sharing, and playing small games with a retro aesthetic. It emulates the look and feel of 8-bit consoles, providing limited color palettes, screen resolutions, and memory constraints.
The PICO-8 dev environment uses Lua and is focused on being accessible to developers while offering depth for complex projects.
Johan Peitz is a games industry veteran and developer extraordinaire, having created dozens of games across many platforms. He’s an expert in PICO-8 development, and joins the podcast to talk about creating games for the console.
Joe Nash is a developer, educator, and award-winning community builder, who has worked at companies including GitHub, Twilio, Unity, and PayPal. Joe got his start in software development by creating mods and running servers for Garry’s Mod, and game development remains his favorite way to experience and explore new technologies and concepts.
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Game Development on the PICO-8 with Johan Peitz appeared first on Software Engineering Daily.
Doom has seemingly been ported to every electronic device imaginable, including picture frames, lamps, and coffee machines. The meme of “it runs Doom” has become so widespread that it spawned the r/itrunsdoom sub-Reddit.
Recently, Doom made headlines again for being ported to TypeScript. The project involved representing Doom entirely in TypeScript, three and a half trillion lines of types, 90 GB of RAM to run, and a full year to complete.
Dimitri Mitropoulos is the engineer who carried out this heroic feat. He’s also a developer at Vercel, the founder of Michigan Typescript, and a co-founder of SquiggleConf. Dimitri joins the podcast with Josh Goldberg to talk about what it took to pull off one of the most mind-bending TypeScript projects to date.
Josh Goldberg is an independent full time open source developer in the TypeScript ecosystem. He works on projects that help developers write better TypeScript more easily, most notably on typescript-eslint: the tooling that enables ESLint and Prettier to run on TypeScript code. Josh regularly contributes to open source projects in the ecosystem such as ESLint and TypeScript. Josh is a Microsoft MVP for developer technologies and the author of the acclaimed Learning TypeScript (O’Reilly), a cherished resource for any developer seeking to learn TypeScript without any prior experience outside of JavaScript. Josh regularly presents talks and workshops at bootcamps, conferences, and meetups to share knowledge on TypeScript, static analysis, open source, and general frontend and web development.
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Running Doom in TypeScript with Dimitri Mitropoulos appeared first on Software Engineering Daily.
Simon Shuster is a journalist who has reported on Russia and Ukraine for over 15 years, most of that time as a staff correspondent for TIME Magazine. He was born in Moscow, and he and his family came to the United States as refugees from the Soviet Union when he was six years old.
After graduating from Stanford University in 2005, Simon returned to Moscow to work as a reporter for The Moscow Times, Reuters, the Associated Press and other publications. His political coverage of Russia’s descent into authoritarianism included numerous profiles of Vladimir Putin and interviews with top Russian officials. He has also interviewed and profiled the last three presidents of Ukraine.
Simon has spent years covering the war in Ukraine from both sides of the front lines. The year after the annexation of Crimea, Russian authorities deemed Simon a security threat and banned him from entering the country.
Simon is the author of the 2024 book The Showman: Inside the Invasion That Shook the World and Made a Leader of Volodymyr Zelensky, and he recently wrote the TIME Magazine article “How Ukraine Gamified Drone Warfare.”
He is currently at work on a new book that examines the future of warfare and how the lessons and technologies that emerged from the war in Ukraine are changing warfare and security around the world.
Simon joins the podcast with Kevin Ball to discuss drone warfare, AI-assisted targeting, the gamification of drone combat, the rapid iteration cycle of drone innovation, new ethical dilemmas in warfare, the coming proliferation of war drones, and the shifting balance of global power.
Kevin Ball or KBall, is the vice president of engineering at Mento and an independent coach for engineers and engineering leaders. He co-founded and served as CTO for two companies, founded the San Diego JavaScript meetup, and organizes the AI inaction discussion group through Latent Space.
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Drone Warfare in Ukraine with Simon Shuster appeared first on Software Engineering Daily.
Radix UI is an open-source library of React components. Its “headless” primitives handle the complex logic and accessibility concerns—like dialogs, dropdowns, and tabs—while leaving styling completely up to the developer. The project emphasizes usability, accessibility, and composability and has become a vital part of modern web dev, in part because it forms the foundation of shad/cn UI.
Chance Strickland is a software engineer at WorkOS and a maintainer of Radix UI. Chase joins the show with Nick Nisi to talk about Radix, its primitives, Radix’s relationship with shad/cn UI, the evolution of web primitives, and much more.
Nick Nisi is a conference organizer, speaker, and developer focused on tools across the web ecosystem. He has organized and emceed several conferences and has led NebraskaJS for more than a decade. Nick currently works as a developer experience engineer at WorkOS.
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Radix UI with Chance Strickland appeared first on Software Engineering Daily.
The Stack Overflow Developer Survey is an annual survey conducted by Stack Overflow that gathers comprehensive insights from developers around the world. It offers a valuable snapshot of the global developer community, covering a wide range of topics such as preferred programming languages, tools, and technologies.
Jody Bailey is the Chief Product and Technology Officer at Stack Overflow and Erin Yepis is a Research Manager at Stack Overflow. They join the show with Sean Falconer to talk about the results of the 2025 Developer Survey, which was recently released.
Sean’s been an academic, startup founder, and Googler. He has published works covering a wide range of topics from AI to quantum computing. Currently, Sean is an AI Entrepreneur in Residence at Confluent where he works on AI strategy and thought leadership. You can connect with Sean on LinkedIn.
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post The 2025 Stack Overflow Developer Survey with Jody Bailey and Erin Yepis appeared first on Software Engineering Daily.
Byran Huang is a full stack developer who recently made headlines in the hacker space when he created the anyon_e, which is a highly integrated, open source laptop. The effort was a massive undertaking and showcased great design, hardware, and software.
In this episode, Byran joins the show with Gregor Vand to talk about his work on the anyon_e laptop.
Gregor Vand is a security-focused technologist, having previously been a CTO across cybersecurity, cyber insurance and general software engineering companies. He is based in Singapore and can be found via his profile at vand.hk or on LinkedIn.
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Building an Open-Source Laptop with Byran Huang appeared first on Software Engineering Daily.
The modern internet is a vast web of independent networks bound together by billions of routing decisions made every second. It’s an architecture so reliable we mostly take it for granted, but behind the scenes it represents one of humanity’s greatest engineering achievements. Today’s internet is also dramatically more complex and capable than in its early years.
Erik Seidel is a Network Engineer at Cloudflare, where he focuses on automating global network infrastructure. He joins the show to discuss his unique journey into tech, the fundamentals of how the internet works, the Border Gateway Protocol, peering versus transit, Cloudflare’s architecture, networking in China, and much more.
Gregor Vand is a security-focused technologist, having previously been a CTO across cybersecurity, cyber insurance and general software engineering companies. He is based in Singapore and can be found via his profile at vand.hk or on LinkedIn.
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post The Architecture of the Internet with Erik Seidel appeared first on Software Engineering Daily.
SED News is a monthly podcast from Software Engineering Daily where hosts Gregor Vand and Sean Falconer unpack the biggest stories shaping software engineering, Silicon Valley, and the broader tech industry.
In this episode, they cover the $1.7B acquisition of Security AI, LangChain’s massive valuation, and the surprise $300M funding” round for Periodic Labs. They also break down the massive AWS outage, Apple’s rare reversal on its glass UI design, and the emerging web of trillion-dollar AI infrastructure deals centered around OpenAI.
Gregor and Sean then dive deep into the world of chipmakers, exploring how Intel is fighting to survive, AMD’s new partnership and 10% investment from OpenAI, Apple’s long-term bet on on-device AI with its M5 chips, and NVIDIA’s push to defend its dominance amid growing custom-chip competition.
Finally, they highlight standout threads from Hacker News, including developers rediscovering the joy of curl, a hacker’s clever teardown of Kindle’s DRM protections, and more.
Gregor Vand is a security-focused technologist, having previously been a CTO across cybersecurity, cyber insurance and general software engineering companies. He is based in Singapore and can be found via his profile at vand.hk or on LinkedIn.
Sean’s been an academic, startup founder, and Googler. He has published works covering a wide range of topics from AI to quantum computing. Currently, Sean is an AI Entrepreneur in Residence at Confluent where he works on AI strategy and thought leadership. You can connect with Sean on LinkedIn.
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post SED News: AMD’s Big OpenAI Deal, Intel’s Struggles, and Apple’s AI Long Game appeared first on Software Engineering Daily.
Most AI agent frameworks are backend-focused and written in Python, which introduces complexity when building full-stack AI applications with JavaScript or TypeScript frontends. This gap makes it harder for frontend developers to prototype, integrate, and iterate on AI-powered features.
Mastra is an open-source TypeScript framework focused on building AI agents and has primitives such as agents, tools, workflows, and RAG.
Sam Bhagwat and Abhi Aiyer are co-founders at Mastra. They join the podcast with Nick Nisi to talk about this state of frontend tooling for AI agents, AI agent primitives, MCP integration, and more.
Nick Nisi is a conference organizer, speaker, and developer focused on tools across the web ecosystem. He has organized and emceed several conferences and has led NebraskaJS for more than a decade. Nick currently works as a developer experience engineer at WorkOS.
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Building AI Agents on the Frontend with Sam Bhagwat and Abhi Aiyer appeared first on Software Engineering Daily.
X-Plane is a popular flight simulator developed by Laminar Research. It features a first-principles physics engine, realistic aircraft systems, and a wide variety of aircraft.
We wanted to understand the engineering that goes into creating a flight simulator so we invited Ben Supnik on the show. Ben is a software engineer at Laminar and he’s been working on X-Plane for the past 20 years. He joins the show with Kevin Ball to talk about X-Plane and his career working on the simulator.
Kevin Ball or KBall, is the vice president of engineering at Mento and an independent coach for engineers and engineering leaders. He co-founded and served as CTO for two companies, founded the San Diego JavaScript meetup, and organizes the AI inaction discussion group through Latent Space.
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post The X-Plane Flight Simulator with Ben Supnik appeared first on Software Engineering Daily.
A common challenge in software development is creating and maintaining robust development environments. The rise of AI agents has amplified this complexity by adding new demands around permission controls, environment isolation, and resource management.
Ona is a platform for AI-native software development and engineering agents. The platform combines autonomous agents with secure, standardized environments, with a focus on giving enterprises control, security, and productivity so they can scale AI-native engineering without scaling risk.
Chris Weichel has more than two decades of experience spanning software engineering and human–computer interaction. He is currently the Chief Technology Officer at Ona – formerly Gitpod – where he leads the engineering team behind the company’s cloud-native development platform. Chris joins the podcast with Kevin Ball to talk about Ona, the impact of coding with parallel agents, the future of IDEs, choosing agent-friendly languages, code review as a new bottleneck in the software development lifecycle, and much more.
Full Disclosure: This episode is sponsored by Ona formerly Gitpod.
Kevin Ball or KBall, is the vice president of engineering at Mento and an independent coach for engineers and engineering leaders. He co-founded and served as CTO for two companies, founded the San Diego JavaScript meetup, and organizes the AI inaction discussion group through Latent Space.
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Turning Agent Autonomy into Productivity with Chris Weichel appeared first on Software Engineering Daily.
Homebrew is a widely used package manager that simplifies the installation of open-source software on macOS. It was created in response to the growing demand for a lightweight, developer-friendly tool suited to an increasingly Mac-centric development ecosystem. Today, Homebrew is a near-essential part of the macOS software development toolkit.
Mike McQuaid joined the project early on and collaborated closely with its creator, Max Howell. He joins the podcast with Kevin Ball to discuss Homebrew’s origins, architecture, its emphasis on automation and CI/CD, long-term sustainability, controversial trade-offs, and much more.
Kevin Ball or KBall, is the vice president of engineering at Mento and an independent coach for engineers and engineering leaders. He co-founded and served as CTO for two companies, founded the San Diego JavaScript meetup, and organizes the AI inaction discussion group through Latent Space.
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Homebrew and macOS Package Management with Mike McQuaid appeared first on Software Engineering Daily.
Modern software platforms are increasingly composed of diverse microservices, third-party APIs, and cloud resources. The distributed nature of these systems makes it difficult for engineers to gain a clear view of how their systems behave, which can slow down troubleshooting and increase operational risk.
groundcover is an observability platform that uses eBPF sensors to capture logs, metrics, and traces directly from the kernel. Critically, groundcover runs on a bring-your-own-cloud model so all data remains within the user’s own environment, which gives increased privacy, security, and cost efficiency.
The company is also focused on adapting to how AI-generated code is changing observability. Code can now be produced at superhuman speed, which increases the challenges for reviewing code before it enters production. This means that observability is likely to play a growing role in code validation and providing guardrails.
Yechezkel Rabinovich, or Chez, is the CTO and Co-founder of groundcover. He joins the podcast with Kevin Ball to discuss his journey from kernel engineering to building an eBPF-powered observability company. The conversation explores the power of eBPF, the realities of observability in modern systems, the impact of AI on software development and security, and where the future of root-cause analysis is headed.
Full Disclosure: This episode is sponsored by groundcover.
Kevin Ball or KBall, is the vice president of engineering at Mento and an independent coach for engineers and engineering leaders. He co-founded and served as CTO for two companies, founded the San Diego JavaScript meetup, and organizes the AI inaction discussion group through Latent Space.
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Engineering in the Age of Agents with Yechezkel Rabinovich appeared first on Software Engineering Daily.
Dynamic languages like Ruby, Python, and JavaScript determine the types of variables at runtime rather than at compile time. This flexibility allows for rapid development and concise code, but it also makes it harder to catch certain classes of bugs before execution. Type checkers for dynamic languages add structure and safety without compromising their expressive power.
Sorbet is a static type checker developed by the Stripe team and designed specifically for Ruby. The motivation behind Sorbet stemmed from the growing complexity of production Ruby applications, where developers needed stronger guarantees and more scalable code quality tools than dynamic typing alone could offer.
Jake Zimmerman is a software engineer at Stripe and leads development on Sorbet. He joins the podcast with Josh Goldberg to discuss his background, the challenges of typing in Ruby, the motivation behind Sorbet, its architecture, performance optimizations, and more.
Josh Goldberg is an independent full time open source developer in the TypeScript ecosystem. He works on projects that help developers write better TypeScript more easily, most notably on typescript-eslint: the tooling that enables ESLint and Prettier to run on TypeScript code. Josh regularly contributes to open source projects in the ecosystem such as ESLint and TypeScript. Josh is a Microsoft MVP for developer technologies and the author of the acclaimed Learning TypeScript (O’Reilly), a cherished resource for any developer seeking to learn TypeScript without any prior experience outside of JavaScript. Josh regularly presents talks and workshops at bootcamps, conferences, and meetups to share knowledge on TypeScript, static analysis, open source, and general frontend and web development.
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Static Analysis for Ruby with Jake Zimmerman appeared first on Software Engineering Daily.
The rise of language-model coding assistants has led to the creation of the vibe coding paradigm. In this mode of software development, AI agents take a plain language prompt and generate entire applications, which dramatically lowers the barriers to entry and democratizes access to software creation.
However, many enterprise environments have large, legacy codebases and these sprawling systems are complex, interdependent, and far less amenable to the greenfield style of vibe coding. Working effectively within them requires deep context awareness, something language models commonly struggle to maintain.
Augment Code is an AI coding assistant that focuses on contextual understanding of large codebases in enterprise settings. It emphasizes tooling to manage large development surface areas while automating PRs and code review.
Guy Gur-Ari is a Co-Founder at Augment. He has a PhD in physics and was previously a Research Scientist at Google where he worked on AI reasoning in math and science. Guy joins the podcast with Kevin Ball to talk about Augment Code, its focus on full context for large enterprise codebases, code review as the new bottleneck in AI-driven development, and much more.
Full Disclosure: This episode is sponsored by Augment Code.
Kevin Ball or KBall, is the vice president of engineering at Mento and an independent coach for engineers and engineering leaders. He co-founded and served as CTO for two companies, founded the San Diego JavaScript meetup, and organizes the AI inaction discussion group through Latent Space.
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Scaling AI in Enterprise Codebases with Guy Gur-Ari appeared first on Software Engineering Daily.
SED News is a monthly podcast from Software Engineering Daily where hosts Gregor Vand and Sean Falconer unpack the biggest stories shaping software engineering, Silicon Valley, and the broader tech industry.
In this episode, they cover NVIDIA‘s $5B investment in Intel and $100M stake in OpenAI, Meta’s stumble with its AR glasses demo, and the surprise $50B private equity acquisition of Electronic Arts. They also break down Anthropic’s record-setting Series F round and what Google’s Genie 3 “world model” reveals about the next frontier of AI.
Gregor and Sean then zoom things out to debate the future of devices and hardware. They cover Apple’s underwhelming Vision Pro to Snap’s all-in bet on AR specs, and what form factors might actually matter for developers.
Finally, they highlight standout projects from Hacker News, including hosting a website on a disposable vape, playing Snake in your browser’s address bar, and Slack’s six-figure billing fiasco that the community helped reverse.
Gregor Vand is a security-focused technologist, and is the founder and CTO of Mailpass. Previously, Gregor was a CTO across cybersecurity, cyber insurance and general software engineering companies. He has been based in Asia Pacific for almost a decade and can be found via his profile at vand.hk.Sean’s been an academic, startup founder, and Googler. He has published works covering a wide range of topics from AI to quantum computing. Currently, Sean is an AI Entrepreneur in Residence at Confluent where he works on AI strategy and thought leadership. You can connect with Sean on LinkedIn.
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post SED News: NVIDIA Bets on Intel, Meta’s Demo Crash, and Anthropic’s Explosive Growth appeared first on Software Engineering Daily.
Modern software systems are composed of many independent microservices spanning frontends, backends, APIs, and AI models, and coordinating and scaling them reliably is a constant challenge. A workflow orchestration platform addresses this by providing a structured framework to define, execute, and monitor complex workflows with resilience and clarity.
Orkes is an enterprise-scale agentic orchestration platform that builds on the open-source Conductor project, which was pioneered at Netflix. The platform coordinates AI agents, humans and APIs, with a focus on scalability, compliance, and trust. It further expands on the Conductor core by adding features like security, governance, and long-running workflows.
Viren Baraiya is the Founder and CTO at Orkes, and he’s the creator of Netflix Conductor. Viren joins the show with Gregor Vand to talk about his building Conductor at Netflix, the challenge of orchestrating microservices, rule-based versus programmatic workflow orchestration, agentic orchestration, MCP integration, and much more.
Full Disclosure: This episode is sponsored by Orkes.
Gregor Vand is a security-focused technologist, and is the founder and CTO of Mailpass. Previously, Gregor was a CTO across cybersecurity, cyber insurance and general software engineering companies. He has been based in Asia Pacific for almost a decade and can be found via his profile at vand.hk.Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Orkes and Agentic Workflow Orchestration with Viren Baraiya appeared first on Software Engineering Daily.
Vector search has become a foundational technology for AI applications, enabling everything from semantic code search to contextual retrieval for large language models. However, a major challenge with vector databases has been the cost as data storage scales.
Turbopuffer is a vector database that focuses on speed, cost and scalability. It was created by Simon Hørup Eskildsen and Justin Li in 2023 and has seen adoption from high-profile companies such as Cursor and Notion.
Simon joins the podcast with Gregor Vand to discuss the origin of turbopuffer, its unique technical design, the economics of vector storage, and more.
Gregor Vand is a security-focused technologist, and is the founder and CTO of Mailpass. Previously, Gregor was a CTO across cybersecurity, cyber insurance and general software engineering companies. He has been based in Asia Pacific for almost a decade and can be found via his profile at vand.hk.Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Turbopuffer with Simon Hørup Eskildsen appeared first on Software Engineering Daily.
Cassette Beasts is a turn-based monster-battling RPG that lets players record creatures onto cassette tapes and transform into them during battle. The game was an indie hit, and is also one of the most successful games built with the open source Godot Engine.
Jay Baylis and Tom Coxon are the creators of Cassette Beasts at Bytten Studio. They join the show with Joe Nash to talk about the development of their game.
Joe Nash is a developer, educator, and award-winning community builder, who has worked at companies including GitHub, Twilio, Unity, and PayPal. Joe got his start in software development by creating mods and running servers for Garry’s Mod, and game development remains his favorite way to experience and explore new technologies and concepts.
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Building an Indie Hit in Godot with Jay Baylis and Tom Coxon appeared first on Software Engineering Daily.
A challenge in modern frontend application design is efficiently fetching and managing GraphQL data while keeping UI components responsive and maintainable. Developers often face issues like over-fetching, under-fetching, and handling complex query dependencies, which can lead to performance bottlenecks and increased development effort.
Relay is a JavaScript framework developed by Meta for managing GraphQL data in React applications. It’s designed to optimize data fetching by colocating queries with components, ensuring that each part of the UI declares its own data dependencies.
Robert Balicki was on the Relay team at Meta and is now a Staff Software Engineer at Pinterest. He is currently developing Isograph, which provides a declarative and type-safe approach to data fetching.
Robert joins the show to talk about challenges and solutions for managing data in frontend applications.
Gregor Vand is a security-focused technologist, and is the founder and CTO of Mailpass. Previously, Gregor was a CTO across cybersecurity, cyber insurance and general software engineering companies. He has been based in Asia Pacific for almost a decade and can be found via his profile at vand.hk.
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Rethinking GraphQL Frontends with Robert Balicki appeared first on Software Engineering Daily.
Traditional package management systems for JavaScript have faced several inefficiencies related to dependency storage, resolution, and project performance.
pnpm is a fast, disk-efficient package manager for JavaScript and TypeScript projects, serving as an alternative to npm and Yarn. Due to its efficiency and reliability, pnpm is increasingly popular for managing monorepos and large-scale applications.
Zoltan Kochan is a full stack web developer and the creator of pnpm. He joins the show with Josh Goldberg to talk about his background and package management in the web.
Josh Goldberg is an independent full time open source developer in the TypeScript ecosystem. He works on projects that help developers write better TypeScript more easily, most notably on typescript-eslint: the tooling that enables ESLint and Prettier to run on TypeScript code. Josh regularly contributes to open source projects in the ecosystem such as ESLint and TypeScript. Josh is a Microsoft MVP for developer technologies and the author of the acclaimed Learning TypeScript (O’Reilly), a cherished resource for any developer seeking to learn TypeScript without any prior experience outside of JavaScript. Josh regularly presents talks and workshops at bootcamps, conferences, and meetups to share knowledge on TypeScript, static analysis, open source, and general frontend and web development.
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post pnpm with Zoltan Kochan appeared first on Software Engineering Daily.
Modern application development often involves juggling multiple types of databases to handle diverse data models. The lack of unification can lead to complex architectures with attendant security concerns and fragmented development workflows.
SurrealDB is an open-source, multi-model database developed in Rust and integrates functionalities of many databases including relational, document, graph, time series, search and vector databases. It supports both schema-less and schema-full data models and has a SQL-like query language.
The project has rapidly grown in popularity, and version 3.0 was just released with a focus on enabling AI-powered analysis of unstructured data directly within the database, along with tooling for building event-driven applications.
Tobie Morgan Hitchcock is the CEO and co-founder of SurrealDB. He joins the podcast with Kevin Ball to talk about SurrealDB, handling multi-model data, unstructured data processing, building event driven AI applications, coupling databases with AI models, and more.
Full Disclosure: This episode is sponsored by SurrealDB.
Kevin Ball or KBall, is the vice president of engineering at Mento and an independent coach for engineers and engineering leaders. He co-founded and served as CTO for two companies, founded the San Diego JavaScript meetup, and organizes the AI inaction discussion group through Latent Space.
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post SurrealDB 3.0 and Building Event-Driven AI Applications with Tobie Morgan Hitchcock appeared first on Software Engineering Daily.
Modern web development faces several challenges, particularly when building scalable, maintainable, and high-performance applications. As applications grow, managing complex user interfaces, and ensuring efficient data handling and modular code structures, becomes increasingly difficult.
Angular is a TypeScript-based web framework developed by Google. It’s component-driven and designed for building single-page applications with a strong emphasis on modular architecture and performance optimization. Angular’s scalability, maintainability, and built-in features like modular architecture, TypeScript support, and robust tooling, have made it popular for enterprise applications.
Jessica Janiuk is a Staff Software Engineer at Google where she works on Angular, which just hit version 19 late last year. In this episode, Jessica joins the show with Josh Goldberg to talk about the Angular project.
Josh Goldberg is an independent full time open source developer in the TypeScript ecosystem. He works on projects that help developers write better TypeScript more easily, most notably on typescript-eslint: the tooling that enables ESLint and Prettier to run on TypeScript code. Josh regularly contributes to open source projects in the ecosystem such as ESLint and TypeScript. Josh is a Microsoft MVP for developer technologies and the author of the acclaimed Learning TypeScript (O’Reilly), a cherished resource for any developer seeking to learn TypeScript without any prior experience outside of JavaScript. Josh regularly presents talks and workshops at bootcamps, conferences, and meetups to share knowledge on TypeScript, static analysis, open source, and general frontend and web development.
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Angular with Jessica Janiuk appeared first on Software Engineering Daily.
SED News is a monthly podcast from Software Engineering Daily where hosts Gregor Vand and Sean Falconer unpack the biggest stories shaping software engineering, Silicon Valley, and the broader tech industry.
In this episode, they discuss Perplexity’s headline-grabbing offer to buy Google Chrome, the U.S. government’s large stake in Intel, Meta’s abrupt pause on AI hiring, and a reality check on what “agentic” systems can actually deliver today versus the hype.
They also dive into standout discussions from Hacker News, including a proposal to curb “ghost job” postings with stricter transparency rules, an interactive Big-O explainer, and more.
Gregor Vand is a security-focused technologist, and is the founder and CTO of Mailpass. Previously, Gregor was a CTO across cybersecurity, cyber insurance and general software engineering companies. He has been based in Asia Pacific for almost a decade and can be found via his profile at vand.hk.Sean’s been an academic, startup founder, and Googler. He has published works covering a wide range of topics from AI to quantum computing. Currently, Sean is an AI Entrepreneur in Residence at Confluent where he works on AI strategy and thought leadership. You can connect with Sean on LinkedIn.
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post SED News: Perplexity’s Chrome Play, Meta’s AI Freeze, and Intel Becomes Too Big to Fail appeared first on Software Engineering Daily.
A common challenge in data-rich organizations is that critical context about the data is often hard to capture and even harder to keep up to date. As more people across the organization use data and data models get more complex, simply finding the right dataset can be slow and create bottlenecks.
Select Star is a data discovery and metadata platform that builds a continuously updated knowledge graph of an organization’s data by analyzing both its structure and how it’s actually used. It enriches data with context such as popularity, lineage, and semantic models, making it easier for AI and teams to discover, trust, and use the right data. These enriched metadata layers are also highly valuable for large language models, significantly improving the accuracy of generated SQL queries.
Shinji Kim is the founder and CEO of Select Star, and she joins Sean Falconer to discuss solving metadata curation challenges, managing data context at scale, using LLMs for SQL generation, emerging trends in metadata management, and more.
Full Disclosure: This episode is sponsored by Select Star.
Sean’s been an academic, startup founder, and Googler. He has published works covering a wide range of topics from AI to quantum computing. Currently, Sean is an AI Entrepreneur in Residence at Confluent where he works on AI strategy and thought leadership. You can connect with Sean on LinkedIn.
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Context-Aware SQL and Metadata with Shinji Kim appeared first on Software Engineering Daily.
Data visualization is increasingly important as organizations prioritize data-driven decision-making. Tools that transform complex datasets into intuitive, interpretable visualizations are arguably just as critical as the data itself.
Robert Kosara is a Data Visualization Developer at Observable which is a platform for creating interactive data visualizations, and which makes extensive use of the popular D3 JavaScript library. Robert previously worked at companies including Salesforce and Tableau, and has deep experience in data visualization and data visualization tools. He joins the show to talk about modern data visualization and his work at Observable.
Sean’s been an academic, startup founder, and Googler. He has published works covering a wide range of topics from AI to quantum computing. Currently, Sean is an AI Entrepreneur in Residence at Confluent where he works on AI strategy and thought leadership. You can connect with Sean on LinkedIn.
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Modern Data Visualization with Robert Kosara appeared first on Software Engineering Daily.
Werner Vogels is the Chief Technology Officer at Amazon, where he has played a pivotal role in shaping the company’s technology vision for over two decades. Before joining Amazon in 2004, Werner was a research scientist at Cornell University where he focused on distributed systems and scalability, both of which are concepts that would later influence the design of AWS. He holds a PhD in computer science and has authored numerous academic papers on the reliability and performance of large-scale systems.
As CTO, Werner has been instrumental in guiding Amazon’s transition from an online retailer to a global cloud infrastructure provider. He is one of the key architects behind Amazon’s push into cloud computing, helping to define the new model for delivering infrastructure. He is known for his pragmatic, customer-focused approach to technology and for championing ideas such as “you build it, you run it,” “APIs are forever,” and more recently, Frugal Architecting, which emphasizes cost-effective and sustainable software design.
In this episode, Kevin Ball sits down with Werner for a wide-ranging conversation. They discuss the early days of Amazon, the birth of AWS, the principles of the Frugal Architect, aligning cost to the business, engineering-business collaboration, technical debt, and much more.
Kevin Ball or KBall, is the vice president of engineering at Mento and an independent coach for engineers and engineering leaders. He co-founded and served as CTO for two companies, founded the San Diego JavaScript meetup, and organizes the AI inaction discussion group through Latent Space.
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post A Conversation with Amazon CTO Werner Vogels appeared first on Software Engineering Daily.
A key challenge with designing AI agents is that large language models are stateless and have limited context windows. This requires careful engineering to maintain continuity and reliability across sequential LLM interactions. To perform well, agents need fast systems for storing and retrieving short-term conversations, summaries, and long-term facts.
Redis is an open‑source, in‑memory data store widely used for high‑performance caching, analytics, and message brokering. Recent advances have extended Redis’ capabilities to vector search and semantic caching, which has made it an increasingly popular part of the agentic application stack.
Andrew Brookins is a Principal Applied AI Engineer at Redis. He joins the show with Sean Falconer to discuss the challenges of building AI agents, the role of memory in agents, hybrid search versus vector-only search, the concept of world models, and more.
Full Disclosure: This episode is sponsored by Redis.
Sean’s been an academic, startup founder, and Googler. He has published works covering a wide range of topics from AI to quantum computing. Currently, Sean is an AI Entrepreneur in Residence at Confluent where he works on AI strategy and thought leadership. You can connect with Sean on LinkedIn.
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Redis and AI Agent Memory with Andrew Brookins appeared first on Software Engineering Daily.
Deploying and managing cloud workloads is a complex task that requires developers to handle infrastructure, scaling, CI/CD pipelines, and database hosting. Configuring and maintaining Kubernetes, ensuring smooth deployments, and integrating various services efficiently is a common challenge.
Will Stewart is the co-founder and CEO of Northflank, which is a platform focused on streamlining application deployment and management.
In this episode, he joins the show to talk about the contemporary challenges and solutions around workload deployment.
Sean’s been an academic, startup founder, and Googler. He has published works covering a wide range of topics from AI to quantum computing. Currently, Sean is an AI Entrepreneur in Residence at Confluent where he works on AI strategy and thought leadership. You can connect with Sean on LinkedIn.
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Complex Workload Deployment with Will Stewart appeared first on Software Engineering Daily.
Modern software teams typically rely on a patchwork of tools to manage planning, development, feature rollout, and post-release analysis. This fragmentation is a known challenge that can create friction and slow down software development iteration. It’s especially problematic for cross-functional teams, where differences in roles, expertise, and work culture can further complicate collaboration.
There is growing consensus that successful software product development requires continuous collaboration across functions, including design, engineering and operations.
Tobias Dunn-Krahn is the CTO and Doug Peete is the Chief Product Officer of Atono, which is a software development lifecycle platform focused on cross-functional teams. They join the podcast with Kevin Ball to talk about the challenges of modern product development, the importance of low-friction UX, the role of AI in product tooling, and how to unify product, design, engineering, and operations in a single workflow.
Full Disclosure: This episode is sponsored by Atono.
Kevin Ball or KBall, is the vice president of engineering at Mento and an independent coach for engineers and engineering leaders. He co-founded and served as CTO for two companies, founded the San Diego JavaScript meetup, and organizes the AI inaction discussion group through Latent Space.
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Empowering Cross-Functional Product Teams with Tobias Dunn-Krahn and Doug Peete appeared first on Software Engineering Daily.
Carbon is a programming language developed by Google as a successor to C++, and it aims to provide modern safety features while maintaining high performance. It’s designed to offer seamless interoperability with C++ while addressing shortcomings of C++ such as slow compilation times and lack of memory safety. Carbon also introduces features like a more readable syntax, improved generics, and automatic memory management while still allowing low-level control.
Chandler Carruth is the creator of Carbon, and he leads the C++, C Lang, and LLVM teams at Google, and he also worked on several pieces of Google’s distributed build system. In this episode, he joins Kevin Ball to talk about Carbon and the future of the language.
Kevin Ball or KBall, is the vice president of engineering at Mento and an independent coach for engineers and engineering leaders. He co-founded and served as CTO for two companies, founded the San Diego JavaScript meetup, and organizes the AI inaction discussion group through Latent Space.
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Carbon and Modernizing C++ with Chandler Carruth appeared first on Software Engineering Daily.
Podman is an open-source container management tool that allows developers to build, run, and manage containers. Unlike Docker, it supports rootless containers for improved security and is fully compatible with standards from the Open Container Initiative, or OCI.
Brent Baude is a Senior Principal Software Engineer at Red Hat where he works on Podman. In this episode, Brent joins the show to talk about the project.
Jordi Mon Companys is a product manager and marketer that specializes in software delivery, developer experience, cloud native and open source. He has developed his career at companies like GitLab, Weaveworks, Harness and other platform and devtool providers. His interests range from software supply chain security to open source innovation. You can reach out to him on Twitter at @jordimonpmm
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Podman with Brent Baude appeared first on Software Engineering Daily.
SED News is a monthly podcast from Software Engineering Daily where hosts Gregor Vand and Sean Falconer unpack the biggest stories shaping software engineering, Silicon Valley, and the broader tech industry.
In this episode, they explore Meta’s bold push into AI with the launch of Meta Superintelligence Labs, the dramatic twists in the Windsurf acquisition saga, Lyft’s re-entry into the autonomous vehicle race, and how new UK online safety rules have fueled a surge in VPN use.
They also dive into standout discussions from Hacker News, including students hacking a smart washing machine to send Discord alerts, a fully air‑gapped Jira alternative for regulated industries, and fresh insights on how variable naming impacts AI coding tools like Copilot.
Gregor Vand is a security-focused technologist, and is the founder and CTO of Mailpass. Previously, Gregor was a CTO across cybersecurity, cyber insurance and general software engineering companies. He has been based in Asia Pacific for almost a decade and can be found via his profile at vand.hk.Sean’s been an academic, startup founder, and Googler. He has published works covering a wide range of topics from AI to quantum computing. Currently, Sean is an AI Entrepreneur in Residence at Confluent where he works on AI strategy and thought leadership. You can connect with Sean on LinkedIn.
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post SED News: Meta’s AI Gambit, Windsurf Shake‑Up, and the UK VPN Surge appeared first on Software Engineering Daily.
Electron is a framework for building cross-platform desktop applications using web technologies like JavaScript, HTML, and CSS. It allows developers to package web apps with a native-like experience by bundling them with a Chromium browser and Node.js runtime. Electron is widely used for apps like VS Code, Discord, and Slack because it enables a single codebase to run on Windows, macOS, and Linux.
Shelley Vohr is a Principal Software Engineer at Microsoft where she works on Electron. She joins the podcast with Josh Goldberg to talk about her work on the Electron project.
Josh Goldberg is an independent full time open source developer in the TypeScript ecosystem. He works on projects that help developers write better TypeScript more easily, most notably on typescript-eslint: the tooling that enables ESLint and Prettier to run on TypeScript code. Josh regularly contributes to open source projects in the ecosystem such as ESLint and TypeScript. Josh is a Microsoft MVP for developer technologies and the author of the acclaimed Learning TypeScript (O’Reilly), a cherished resource for any developer seeking to learn TypeScript without any prior experience outside of JavaScript. Josh regularly presents talks and workshops at bootcamps, conferences, and meetups to share knowledge on TypeScript, static analysis, open source, and general frontend and web development.
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Electron and Desktop App Engineering with Shelley Vohr appeared first on Software Engineering Daily.
Modal is a serverless compute platform that’s specifically focused on AI workloads. The company’s goal is to enable AI teams to quickly spin up GPU-enabled containers, and rapidly iterate and autoscale.
It was founded by Erik Bernhardsson who was previously at Spotify for 7 years where he built the music recommendation system and the popular Luigi workflow scheduler.
In this episode, Erik joins Sean Falconer to talk about the motivation for founding his company, the market gap in ML and AI tooling, optimizing container cold start, Modal’s interface design, and more.
Sean’s been an academic, startup founder, and Googler. He has published works covering a wide range of topics from AI to quantum computing. Currently, Sean is an AI Entrepreneur in Residence at Confluent where he works on AI strategy and thought leadership. You can connect with Sean on LinkedIn.
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Modal and Scaling AI Inference with Erik Bernhardsson appeared first on Software Engineering Daily.
RxJS is an open-source library for composing asynchronous and event-based programs. It provides powerful operators for transforming, filtering, combining, and managing streams of data, from user input and web requests to real-time updates.
Ben Lesh is the creator of RxJS. He joins Josh Goldberg to talk about his path into engineering and the RxJS library.
Josh Goldberg is an independent full time open source developer in the TypeScript ecosystem. He works on projects that help developers write better TypeScript more easily, most notably on typescript-eslint: the tooling that enables ESLint and Prettier to run on TypeScript code. Josh regularly contributes to open source projects in the ecosystem such as ESLint and TypeScript. Josh is a Microsoft MVP for developer technologies and the author of the acclaimed Learning TypeScript (O’Reilly), a cherished resource for any developer seeking to learn TypeScript without any prior experience outside of JavaScript. Josh regularly presents talks and workshops at bootcamps, conferences, and meetups to share knowledge on TypeScript, static analysis, open source, and general frontend and web development.
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post RxJS with Ben Lesh appeared first on Software Engineering Daily.
JigsawStack is a startup that develops a suite of custom small models for tasks such as scraping, forecasting, vOCR, and translation. The platform is designed to support collaborative knowledge work, especially in research-heavy or strategy-driven environments.
Yoeven Khemlani is the Founder of JigsawStack and he joins the podcast with Gregor Vand to talk about making use of small models for diverse applications.
Gregor Vand is a security-focused technologist, and is the founder and CTO of Mailpass. Previously, Gregor was a CTO across cybersecurity, cyber insurance and general software engineering companies. He has been based in Asia Pacific for almost a decade and can be found via his profile at vand.hk.Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Small AI Models with Yoeven Khemlani appeared first on Software Engineering Daily.
Railway is a software company that provides a popular platform for deploying and managing applications in the cloud. It automates tasks such as infrastructure provisioning, scaling, and deployment and is particularly known for having a developer-friendly interface.
Jake Cooper is the Founder and CEO at Railway. He joins the show to talk about the company and its platform.
Sean’s been an academic, startup founder, and Googler. He has published works covering a wide range of topics from AI to quantum computing. Currently, Sean is an AI Entrepreneur in Residence at Confluent where he works on AI strategy and thought leadership. You can connect with Sean on LinkedIn.
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Streamlining Cloud Infrastructure Deployments with Jake Cooper appeared first on Software Engineering Daily.
Illia Polosukhin is a veteran AI researcher and one of the original authors of the landmark Transformer paper, Attention is All You Need, which he co-authored during his time at Google Research. He has a deep background in machine learning and natural language processing, and has spent over a decade working at the intersection of AI and decentralized technologies. His current venture is called NEAR AI, and He’s focused on building open-source infrastructure, tools, and products for Agentic, privacy-preserving AI systems. He joins the podcast with Kevin Ball to discuss his journey, the origins of the Transformer model, the vision for user-owned AI, document-oriented development, and much more.
Kevin Ball or KBall, is the vice president of engineering at Mento and an independent coach for engineers and engineering leaders. He co-founded and served as CTO for two companies, founded the San Diego JavaScript meetup, and organizes the AI inaction discussion group through Latent Space.
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Building Open Infrastructure for AI with Illia Polosukhin appeared first on Software Engineering Daily.
TypeScript is a statically typed superset of JavaScript that adds optional type annotations and modern language features to improve developer productivity and code safety. The TypeScript compiler performs type checking at compile time, catching errors before code is run, and also transforms TypeScript code into clean, standards-compliant JavaScript.
Jake Bailey is Senior Software Engineer at Microsoft where he works on TypeScript, and has made major contributions to the TypeScript compiler. Jake joins the podcast with Josh Goldberg to talk about TypeScript and his work.
Josh Goldberg is an independent full time open source developer in the TypeScript ecosystem. He works on projects that help developers write better TypeScript more easily, most notably on typescript-eslint: the tooling that enables ESLint and Prettier to run on TypeScript code. Josh regularly contributes to open source projects in the ecosystem such as ESLint and TypeScript. Josh is a Microsoft MVP for developer technologies and the author of the acclaimed Learning TypeScript (O’Reilly), a cherished resource for any developer seeking to learn TypeScript without any prior experience outside of JavaScript. Josh regularly presents talks and workshops at bootcamps, conferences, and meetups to share knowledge on TypeScript, static analysis, open source, and general frontend and web development.
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post TypeScript with Jake Bailey appeared first on Software Engineering Daily.
Wiz is a cloud security platform that helps organizations identify and remediate risks across their cloud environments. The company’s platform scans layers of the cloud stack, including virtual machines, containers, and serverless configurations, to detect vulnerabilities and misconfigurations in context.
The Model Context Protocol, or MCP, is emerging as a potential standard for connecting LLM applications to external data sources and tools. It has rapidly gained traction across the industry with broad backing from companies such as OpenAI, Microsoft, and Google. While the protocol offers great opportunities, it also introduces certain security risks.
Rami McCarthy is a Principal Security Researcher at Wiz. He joins the podcast with Gregor Vand to talk about security research, AI and secrets leakage, MCP security, supply chain attacks, career advice, and more.
Gregor Vand is a security-focused technologist, and is the founder and CTO of Mailpass. Previously, Gregor was a CTO across cybersecurity, cyber insurance and general software engineering companies. He has been based in Asia Pacific for almost a decade and can be found via his profile at vand.hk.Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post MCP Security at Wiz with Rami McCarthy appeared first on Software Engineering Daily.
Welcome back to SED News, a podcast series from Software Engineering Daily where hosts Gregor Vand and Sean Falconer break down the latest stories in software engineering, Silicon Valley, and the wider tech industry.
In this episode, Gregor and Sean dig into Meta’s legal battle over AI training data, discuss the strategic implications of Meta’s $14 billion stake in Scale AI, and examine how competition in the AI space is reshaping relationships between tech giants like Microsoft, OpenAI, and Google. They also highlight some of the most interesting stories from Hacker News, including a solar-powered iPhone turned OCR server, and a provocative case for why some AI agents should really just be SQL queries.
Gregor Vand is a security-focused technologist, and is the founder and CTO of Mailpass. Previously, Gregor was a CTO across cybersecurity, cyber insurance and general software engineering companies. He has been based in Asia Pacific for almost a decade and can be found via his profile at vand.hk.Sean’s been an academic, startup founder, and Googler. He has published works covering a wide range of topics from AI to quantum computing. Currently, Sean is an AI Entrepreneur in Residence at Confluent where he works on AI strategy and thought leadership. You can connect with Sean on LinkedIn.
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post SED News: Data Land Grabs, Copyright Fights, and the Great AI Talent War appeared first on Software Engineering Daily.
Anaconda is a software company that’s well-known for its solutions for managing packages, environments, and security in large-scale data workflows. The company has played a major role in making Python-based data science more accessible, efficient, and scalable. Anaconda has also invested heavily in AI tool development.
Greg Jennings is the VP of Engineering and AI at Anaconda. He joins the podcast with Kevin Ball to talk about the tooling ecosystem around AI app development, the Anaconda Toolbox, the rapidly evolving role of AI in engineering, and more.
Kevin Ball or KBall, is the vice president of engineering at Mento and an independent coach for engineers and engineering leaders. He co-founded and served as CTO for two companies, founded the San Diego JavaScript meetup, and organizes the AI inaction discussion group through Latent Space.
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post AI at Anaconda with Greg Jennings appeared first on Software Engineering Daily.
ByteDance is a global technology company operating a wide range of content platforms around the world, and is best known for creating TikTok. The company operates at a massive scale, which naturally presents challenges in ensuring performance and stability across its data centers. It has over a million servers running containerized applications, and this required the company to find a networking solution that could handle high throughput while maintaining stability.
eBPF is a technology for dynamically and safely reprogramming the Linux kernel. ByteDance leveraged eBPF to successfully implement a decentralized networking solution that improved efficiency, scalability, and performance.
Chen Tang is an engineer at ByteDance, where he worked on redesigning the company’s container networking stack using eBPF. In this episode, Chen joins the show with Kevin Ball to talk about eBPF, the problems it solves, and how it was used at ByteDance.
Kevin Ball or KBall, is the vice president of engineering at Mento and an independent coach for engineers and engineering leaders. He co-founded and served as CTO for two companies, founded the San Diego JavaScript meetup, and organizes the AI inaction discussion group through Latent Space.
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post ByteDance’s Container Networking Stack with Chen Tang appeared first on Software Engineering Daily.
WayForward is a renowned video game studio that was founded in 1990. The company has developed games for publishers such as Capcom, Konami, and Nintendo and has released their games across major hardware platforms from the last 35 years. They are also the creators of the Shantae series of 2D platformers.
WayForward recently developed the latest game in the storied Contra series, called Operation Galuga, which is a reimagining of the original Contra from 1987.
Voldi Way is the founder and CEO of WayForward, and Tomm Hulett is a Director at WayForward. They join the show to talk about the history of their studio and developing Contra: Operation Galuga.Joe Nash is a developer, educator, and award-winning community builder, who has worked at companies including GitHub, Twilio, Unity, and PayPal. Joe got his start in software development by creating mods and running servers for Garry’s Mod, and game development remains his favorite way to experience and explore new technologies and concepts.
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post WayForward Games with Tomm Hulett and Voldi Way appeared first on Software Engineering Daily.
One of the most immediate and high-impact applications of LLMs has been in software development. The models can significantly accelerate code writing, but with that increased velocity comes a greater need for thoughtful, scalable approaches to codereview. Integrating AI into the development workflow requires rethinking how to ensure quality,security, and maintainability at scale.
CodeRabbit is a startup that brings generative AI into the code review process. It evaluates code quality and security directly within tools like GitHub and VS Code, acting as an AI reviewer that complements existing CI/CD pipelines. Harjot Gill is the founder and CEO of CodeRabbit. He joins the podcast with Kevin Ball to discuss CodeRabbit’s architecture. Its multi-model LLM strategy, how it tracks the reasoning trail of agents, managing context windows, lessons from bootstrapping the company, and much more.
Full Disclosure: This episode is sponsored by CodeRabbit.
Kevin Ball or KBall, is the vice president of engineering at Mento and an independent coach for engineers and engineering leaders. He co-founded and served as CTO for two companies, founded the San Diego JavaScript meetup, and organizes the AI inaction discussion group through Latent Space.
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post CodeRabbit and RAG for Code Review with Harjot Gill appeared first on Software Engineering Daily.
Emulating retro games on modern consoles is a growing trend, and allows players to experience classic titles with improved performance, enhanced resolution, and added features like save states and rewinding. However, this process raises many challenging technical questions related to hardware compatibility, performance optimization, rendering, and state management.
Implicit Conversions is a company focused on emulating retro PlayStation games on modern consoles. Robin Lavallée is the Co-Founder and Chief Gaming Officer and Bill Litshauer is the CEO at the company. They join the show to talk about the engineering that’s needed to emulate and enhance retro games.
Kevin Ball or KBall, is the vice president of engineering at Mento and an independent coach for engineers and engineering leaders. He co-founded and served as CTO for two companies, founded the San Diego JavaScript meetup, and organizes the AI inaction discussion group through Latent Space.
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Emulating Retro Games on Modern Consoles with Robin Lavallée and Bill Litshauer appeared first on Software Engineering Daily.
Welcome back to SED News, a podcast series from Software Engineering Daily where hosts Gregor Vand and Sean Falconer break down the latest stories in software engineering, Silicon Valley, and wider tech world.
In this episode, Gregor and Sean unpack what’s going with Deel and Rippling, explore why Databricks and Snowflake are making big bets on Postgres, and reflect on how AI-powered tools like Cursor are reshaping what it means to be a developer today. They also surface highlights from Hacker News, including Claude’s evolving system prompt and a surprising history of transit cards in Japan and Hong Kong.
Gregor Vand is a security-focused technologist, and is the founder and CTO of Mailpass. Previously, Gregor was a CTO across cybersecurity, cyber insurance and general software engineering companies. He has been based in Asia Pacific for almost a decade and can be found via his profile at vand.hk.Sean’s been an academic, startup founder, and Googler. He has published works covering a wide range of topics from AI to quantum computing. Currently, Sean is an AI Entrepreneur in Residence at Confluent where he works on AI strategy and thought leadership. You can connect with Sean on LinkedIn.
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post SED News: Corporate Spies, Postgres, and the Weird Life of Devs Right Now appeared first on Software Engineering Daily.
TanStack is an open-source collection of high-performance libraries for JavaScript and TypeScript applications, primarily focused on state management, data fetching, and table utilities. It includes popular libraries like TanStack Query, TanStack Table, and TanStack Router. These libraries emphasize declarative APIs, optimized performance, and developer-friendly features, and they are increasingly popular for modern frontend development.
Tanner Linsley is the creator of TanStack and he joins the podcast with Nick Nisi to talk about the project, SSG, type safety, the TanStack Start full-stack React framework, and much more.
Nick Nisi is a conference organizer, speaker, and developer focused on tools across the web ecosystem. He has organized and emceed several conferences and has led NebraskaJS for more than a decade. Nick currently works as a developer experience engineer at WorkOS.
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post TanStack and the Future of Frontend with Tanner Linsley appeared first on Software Engineering Daily.
Evaluations are critical for assessing the quality, performance, and effectiveness of software during development. Common evaluation methods include code reviews and automated testing, and can help identify bugs, ensure compliance with requirements, and measure software reliability.
However, evaluating LLMs presents unique challenges due to their complexity, versatility, and potential for unpredictable behavior.
Ankur Goyal is the CEO and Founder of Braintrust Data, which provides an end-to-end platform for AI application development, and has a focus on making LLM development robust and iterative. Ankur previously founded Impira which was acquired by Figma, and he later ran the AI team at Figma. Ankur joins the show to talk about Braintrust and the unique challenges of developing evaluations in a non-deterministic context.
Sean’s been an academic, startup founder, and Googler. He has published works covering a wide range of topics from AI to quantum computing. Currently, Sean is an AI Entrepreneur in Residence at Confluent where he works on AI strategy and thought leadership. You can connect with Sean on LinkedIn.
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post The Challenge of AI Model Evaluations with Ankur Goyal appeared first on Software Engineering Daily.
A major challenge with creating distributed applications is achieving resilience, reliability, and fault tolerance. It can take considerable engineering time to address non-functional concerns like retries, state synchronization, and distributed coordination. Event-driven models aim to simplify these issues, but often introduce new difficulties in debugging and operations.
Stephan Ewen is the Founder at Restate which aims to simplify modern distributed applications. He is also the co-creator of Apache Flink which is an open-source framework for unified stream-processing and batch-processing.
Stephan joins the show with Sean Falconer to talk about distributed applications and his work with Restate.
Sean’s been an academic, startup founder, and Googler. He has published works covering a wide range of topics from AI to quantum computing. Currently, Sean is an AI Entrepreneur in Residence at Confluent where he works on AI strategy and thought leadership. You can connect with Sean on LinkedIn.
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Modern Distributed Applications with Stephan Ewen appeared first on Software Engineering Daily.
Agentic AI is seen as a key frontier in artificial intelligence, enabling systems to autonomously act, adapt in real-time, and solve complex, multi-step problems based on objectives and context. Unlike traditional rule-based or generative AI, which are limited to predefined or reactive tasks, agentic AI processes vast information, models uncertainty, and makes context-sensitive decisions, mimicking human-like problem-solving.
Crew AI is a platform to build and deploy automated workflows using any LLM and cloud platform. The company has rapidly become one of the most prominent in the field of agentic AI. João Moura is the founder at Crew AI and he joins the show with Sean Falconer to talk about his company.
Sean’s been an academic, startup founder, and Googler. He has published works covering a wide range of topics from AI to quantum computing. Currently, Sean is an AI Entrepreneur in Residence at Confluent where he works on AI strategy and thought leadership. You can connect with Sean on LinkedIn.
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Crew AI with João Moura appeared first on Software Engineering Daily.
Synopsys is a leading electronic design automation company specializing in silicon design and verification, as well as software integrity and security. Their tools are foundational to the creation of modern chips and embedded software, powering everything from smartphones to cars.
Chip design is a deeply complex process, often taking months or years and requiring the coordination of thousands of engineers. Now, advances in AI are beginning to transform the field by reducing manual effort, accelerating timelines, and unlocking new design possibilities.
Thomas Andersen is the Vice President of AI and Machine Learning at Synopsys, where he has spent over 15 years. He joins the show to talk with Kevin Ball about the evolving role of AI in hardware design, the challenges of training models on tacit, undocumented chip engineering knowledge, the emergence of domain-specific LLMs, and where this fast-moving field is going next.Kevin Ball or KBall, is the vice president of engineering at Mento and an independent coach for engineers and engineering leaders. He co-founded and served as CTO for two companies, founded the San Diego JavaScript meetup, and organizes the AI inaction discussion group through Latent Space.
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Chip Design in the AI Era with Thomas Andersen appeared first on Software Engineering Daily.
OpenTofu is an open-source alternative to Terraform, designed for managing infrastructure as code. It enables users to define, provision, and manage their cloud and on-premises resources using a declarative configuration language. OpenTofu was created to ensure an open and community-driven approach to infrastructure tooling, and it emphasizes compatibility and extensibility for diverse deployment scenarios.
Cory O’Daniel is the CEO of Massdriver and he’s a founding member of OpenTofu. Malcolm Matalka is a Co-Founder at Terrateam and he’s also a founding member of OpenTofu. They join the podcast to talk about the OpenTofu project.
Sean’s been an academic, startup founder, and Googler. He has published works covering a wide range of topics from AI to quantum computing. Currently, Sean is an AI Entrepreneur in Residence at Confluent where he works on AI strategy and thought leadership. You can connect with Sean on LinkedIn.
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post OpenTofu with Cory O’Daniel and Malcolm Matalka appeared first on Software Engineering Daily.
Python is the dominant language for AI and data science applications, but it lacks the performance and low-level control needed to fully leverage GPU hardware. As a result, developers often rely on NVIDIA’s CUDA framework, which adds complexity and fragments the development stack.
Mojo is a new programming language designed to combine the simplicity of Python with the performance of C and the safety of Rust. It also aims to provide a vendor-independent approach to GPU programming. Mojo is being developed by Chris Lattner, a renowned systems engineer known for his seminal contributions to computer science, including LLVM, the Clang compiler, and the Swift programming language.
Chris is the CEO and Co-Founder of Modular AI, the company behind Mojo. In this episode, he joins the show to discuss his engineering journey and his current work on AI infrastructure and the Mojo language.
Kevin Ball or KBall, is the vice president of engineering at Mento and an independent coach for engineers and engineering leaders. He co-founded and served as CTO for two companies, founded the San Diego JavaScript meetup, and organizes the AI inaction discussion group through Latent Space.
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Mojo and Building a CUDA Replacement with Chris Lattner appeared first on Software Engineering Daily.
PostgreSQL is an open-source database known for its robustness, extensibility, and compliance with SQL standards. Its ability to handle complex queries and maintain high data integrity has made it a top choice for both start-ups and large enterprises.
Heikki Linnakangas is a leading developer for the PostgreSQL project, and he’s a co-founder at Neon, which provides a serverless platform for spinning up Postgres databases. In this episode, he joins Kevin Ball to talk about why PostgreSQL has become so popular, why he founded Neon, Postgres Core vs. Extensions, the pgvector similarity search for AI applications, and much more.
Full Disclosure: This episode is sponsored by Neon.
Kevin Ball or KBall, is the vice president of engineering at Mento and an independent coach for engineers and engineering leaders. He co-founded and served as CTO for two companies, founded the San Diego JavaScript meetup, and organizes the AI inaction discussion group through Latent Space.
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Building PostgreSQL for the Future with Heikki Linnakangas appeared first on Software Engineering Daily.
Cryptocurrency exchanges face unique security challenges that require specialized threat assessments and planning.
Coinbase is a cryptocurrency exchange based in the United States. It was founded in 2012 and has evolved alongside cryptocurrency as a technology.
Philip Martin is the Chief Security Officer at Coinbase. Prior to Coinbase, Philip built and led the Incident Response and Security Engineering teams at Palantir and was a US Army counterintelligence agent and Arabic linguist.
In this episode, Philip joins the podcast with Gregor Vand to talk about his career and security at Coinbase.
Gregor Vand is a security-focused technologist, and is the founder and CTO of Mailpass. Previously, Gregor was a CTO across cybersecurity, cyber insurance and general software engineering companies. He has been based in Asia Pacific for almost a decade and can be found via his profile at vand.hk.Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Security at Coinbase with Philip Martin appeared first on Software Engineering Daily.
The Model Context Protocol, or MCP, is a new open standard that connects AI assistants to arbitrary data sources and tools, such as codebases, APIs, and content repositories. Instead of building bespoke integrations for each system, developers can use MCP to establish secure, scalable connections between AI models and the data they need. By standardizing this connection layer, MCP enables models to access relevant information in real time, leading to more accurate and context-aware responses.
David Soria Parra is a Member of the Technical Staff at Anthropic, where he co-created the Model Context Protocol. He joins the podcast to talk about his career and the future of context-aware AI.
Jordi Mon Companys is a product manager and marketer that specializes in software delivery, developer experience, cloud native and open source. He has developed his career at companies like GitLab, Weaveworks, Harness and other platform and devtool providers. His interests range from software supply chain security to open source innovation. You can reach out to him on Twitter at @jordimonpmm
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Anthropic and the Model Context Protocol with David Soria Parra appeared first on Software Engineering Daily.
Grand Theft Auto III is a 2001 an open-world action-adventure game developed by Rockstar Games and it had a profound impact on both gaming and popular culture. Its success cemented video games as a dominant form of entertainment and storytelling, and paved the way for future blockbuster franchises.
The game was also a technological milestone that redefined what was possible in open-world game design. It was one of the first fully 3D open-world games to offer seamless exploration, blending mission-based gameplay with a living, breathing city.
The game was originally released on PlayStation 2 and PC but never had an official Sega Dreamcast version. However, the homebrew community embarked on the goal of porting the game to the Dreamcast, and recently released the port to much acclaim.
Falco Girgis and Stef Kornilios Mitsis Poiitidis are developers on the GTA3 Dreamcast port. They join the podcast to talk about the Dreamcast hardware and the heroic task of porting GTA3 to the console.
Kevin Ball or KBall, is the vice president of engineering at Mento and an independent coach for engineers and engineering leaders. He co-founded and served as CTO for two companies, founded the San Diego JavaScript meetup, and organizes the AI inaction discussion group through Latent Space.
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Grand Theft Auto III on the Dreamcast with Falco Girgis and Stef Kornilios Mitsis Poiitidis appeared first on Software Engineering Daily.
Polypane is a specialized web development browser that simplifies creating and testing modern websites. A key feature is that it provides multiple screen sizes at once, with synchronized scrolling and interactions, so developers can test different layouts and breakpoints simultaneously. Polypane also focuses on accessibility tools, real-time previews, and debugging features.
Kilian Valkhof is the Founder of Polypane which develops the Polypane browser. In this episode he speaks with Josh Goldberg about his career and the creation of his browser.
Josh Goldberg is an independent full time open source developer in the TypeScript ecosystem. He works on projects that help developers write better TypeScript more easily, most notably on typescript-eslint: the tooling that enables ESLint and Prettier to run on TypeScript code. Josh regularly contributes to open source projects in the ecosystem such as ESLint and TypeScript. Josh is a Microsoft MVP for developer technologies and the author of the acclaimed Learning TypeScript (O’Reilly), a cherished resource for any developer seeking to learn TypeScript without any prior experience outside of JavaScript. Josh regularly presents talks and workshops at bootcamps, conferences, and meetups to share knowledge on TypeScript, static analysis, open source, and general frontend and web development.
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Polypane with Kilian Valkhof appeared first on Software Engineering Daily.
LiveKit is a platform that provides developers with tools to build real-time audio and video applications at scale. It offers an open-source WebRTC stack for creation of live, interactive experiences like video conferencing, streaming, and virtual events. LiveKit has gained significant attention for its partnership with OpenAI for the Advanced Voice feature.
Russ d’Sa is the Founder of LiveKit and has an extensive career in startups. In this episode he joins Sean Falconer to talk about his startup journey, the early days of Y Combinator, LiveKit, WebRTC, LiveKit’s partnership with OpenAI, voice and vision as the future paradigm for computer interaction, and more.
Sean’s been an academic, startup founder, and Googler. He has published works covering a wide range of topics from AI to quantum computing. Currently, Sean is an AI Entrepreneur in Residence at Confluent where he works on AI strategy and thought leadership. You can connect with Sean on LinkedIn.
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post LiveKit and OpenAI with Russ d’Sa appeared first on Software Engineering Daily.
Welcome to the pilot episode of SED News, a new podcast series from Software Engineering Daily. Join hosts Gregor Van and Sean Falconer as they break down the week’s most important stories in software engineering, machine learning, and developer culture.
In this episode, Gregor and Sean discuss the CoreWeave IPO and the company’s recent acquisition of Weights and Biases, dig into Anthropics Model Context Protocol, surface highlights rom Hacker News, and reflect on Microsoft turning 50.
We’d love to hear what you think of the format – reach out on BlueSky at @SoftwareDaily or on X at @Software _Daily, @GregorVand, or @seanfalconer.
Gregor Vand is a security-focused technologist, and is the founder and CTO of Mailpass. Previously, Gregor was a CTO across cybersecurity, cyber insurance and general software engineering companies. He has been based in Asia Pacific for almost a decade and can be found via his profile at vand.hk.Sean’s been an academic, startup founder, and Googler. He has published works covering a wide range of topics from AI to quantum computing. Currently, Sean is an AI Entrepreneur in Residence at Confluent where he works on AI strategy and thought leadership. You can connect with Sean on LinkedIn.
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post SED News: CoreWeave IPO, Anthropic’s MCP, and Microsoft Turns 50 appeared first on Software Engineering Daily.
AI tools are transforming how developers write code, and although it’s difficult to pinpoint how much code is now AI-generated code, estimates suggest it’s between 20% and 40%, and this figure is poised to grow in the coming years. This evolution has given rise to a new coding paradigm in which developers act as directors, guiding and refining AI-generated solutions rather than manually writing every line of code.
This approach was recently termed “vibe coding” by Andrej Karpathy, and it shifts the programmer’s role from detailed coding to overseeing and enhancing AI-produced code. It emphasizes collaborative interaction with AI, blending human creativity with machine efficiency to solve complex problems.
Vish Abrams is the Chief Architect at Heroku and previously worked at Oracle and NASA, among other organizations. In this episode, Vish joins the show with Kevin Ball for a wide-ranging conversation about the state of AI-based tools, whether there are limits to vibe coding, AI tools for individuals vs. AI tools for teams, the Model Context Protocol, Heroku’s managed inference service, and much more.
Full Disclosure: This episode is sponsored by Salesforce (Heroku).
Kevin Ball or KBall, is the vice president of engineering at Mento and an independent coach for engineers and engineering leaders. He co-founded and served as CTO for two companies, founded the San Diego JavaScript meetup, and organizes the AI inaction discussion group through Latent Space.
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Vibe Coding at Heroku with Vish Abrams appeared first on Software Engineering Daily.
Glean is a workplace search and knowledge discovery company that helps organizations find and access information across various internal tools and data sources. Their platform uses AI to provide personalized search results to assist members of an organization in retrieving relevant documents, emails, and conversations. The rise of LLM-based agentic reasoning systems now presents new opportunities to build advanced functionality using an organization’s internal data.
Eddie Zhou is a founding engineer at Glean and previously worked at Google. He joined Sean Falconer to discuss the engineering and design considerations around building agentic tooling to enhance productivity and decision-making.
Sean’s been an academic, startup founder, and Googler. He has published works covering a wide range of topics from AI to quantum computing. Currently, Sean is an AI Entrepreneur in Residence at Confluent where he works on AI strategy and thought leadership. You can connect with Sean on LinkedIn.
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Agentic AI at Glean with Eddie Zhou appeared first on Software Engineering Daily.
Martin Hellman is an American cryptographer known for co-inventing public-key cryptography with Whitfield Diffie and Ralph Merkle in the 1970s. Their groundbreaking Diffie-Hellman key exchange method allowed secure communication over insecure channels, laying the foundation for modern encryption protocols. Hellman has also contributed to cybersecurity policy and ethical discussions on nuclear risk. His work has had a lasting impact on cryptography, internet security, and global information protection.
Martin received the 2015 Turing Award together with Whitfield Diffie “for inventing and promulgating both asymmetric public-key cryptography, including its application to digital signatures, and a practical cryptographic key-exchange method. “
In this episode he joins Gregor Vand to talk about his life and career. You can also find a free copy of Martin and Dorothie Hellman’s book in PDF format here.
Gregor Vand is a security-focused technologist, and is the founder and CTO of Mailpass. Previously, Gregor was a CTO across cybersecurity, cyber insurance and general software engineering companies. He has been based in Asia Pacific for almost a decade and can be found via his profile at vand.hk.Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Turing Award Special: A Conversation with Martin Hellman appeared first on Software Engineering Daily.
Modern cloud-native systems are highly dynamic and distributed, which makes it difficult to monitor cloud infrastructure using traditional tools designed for static environments. This has motivated the development and widespread adoption of dedicated observability platforms.
Prometheus is an open-source observability tool designed for cloud-native environments. Its strong integration with Kubernetes and pull-based data collection model have driven its popularization in DevOps. However, a common challenge with Prometheus is that it struggles with large data volumes and has limited cost-optimization capabilities. This raises the question of how best to handle Prometheus deployments at large scale.
Eric Schabell works in DevRel at Chronosphere where he’s the Director of Community and Developer. He is also a CNCF Ambassador. Eric joins the show with Kevin Ball to talk about metrics collection, time series data, managing Prometheus at scale, tradeoffs between self-hosted vs. managed observability, and more.
Full Disclosure: This episode is sponsored by Chronosphere.**
Kevin Ball or KBall, is the vice president of engineering at Mento and an independent coach for engineers and engineering leaders. He co-founded and served as CTO for two companies, founded the San Diego JavaScript meetup, and organizes the AI inaction discussion group through Latent Space.
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Prometheus and Open-Source Observability with Eric Schabell appeared first on Software Engineering Daily.
David A. Patterson is a pioneering computer scientist known for his contributions to computer architecture, particularly as a co-developer of Reduced Instruction Set Computing, or RISC, which revolutionized processor design. He has co-authored multiple books, including the highly influential Computer Architecture: A Quantitative Approach.
David is a UC Berkeley Pardee professor emeritus, a Google distinguished engineer since 2016, the RIOS Laboratory Director, and the RISC-V International Vice-Chair.
He received the 2017 Turing Award together with John L. Hennessy “for pioneering a systematic, quantitative approach to the design and evaluation of computer architectures with enduring impact on the microprocessor industry.”
In this episode he joins Kevin Ball to talk about his life and career.
Kevin Ball or KBall, is the vice president of engineering at Mento and an independent coach for engineers and engineering leaders. He co-founded and served as CTO for two companies, founded the San Diego JavaScript meetup, and organizes the AI inaction discussion group through Latent Space.
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Turing Award Special: A Conversation with David Patterson appeared first on Software Engineering Daily.
At Uber, there are many platform teams supporting engineers across the company, and maintaining robust on-call operations is crucial to keeping services functioning smoothly. The prospect of enhancing the efficiency of these engineering teams motivated Uber to create Genie, which is an AI-powered on-call copilot. Genie assists with on-call management by providing real-time responses to queries, streamlining incident resolution, and facilitating team collaboration.
Paarth Chothani is a Staff Software Engineer on the Uber AI Gen AI team. Eduards Sidorovics is a Senior Software Engineer on the Uber AI Platform team. In this episode they join the show with Sean Falconer to talk about the challenges that motivated the creation of Uber Genie, the architecture of Genie, and more.
Sean’s been an academic, startup founder, and Googler. He has published works covering a wide range of topics from AI to quantum computing. Currently, Sean is an AI Entrepreneur in Residence at Confluent where he works on AI strategy and thought leadership. You can connect with Sean on LinkedIn.
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Uber’s On-Call Copilot with Paarth Chothani and Eduards Sidorovics appeared first on Software Engineering Daily.
John Hennessy is a computer scientist, entrepreneur, and academic known for his significant contributions to computer architecture. He co-developed the RISC architecture, which revolutionized modern computing by enabling faster and more efficient processors. Hennessy served as the president of Stanford University from 2000 to 2016 and later co-founded MIPS Computer Systems and Atheros Communications. Currently, he serves on the board of the Gordon and Betty Moore Foundation, and is chair of the board of Alphabet.
John received the 2017 Turing Award “for pioneering a systematic, quantitative approach to the design and evaluation of computer architectures with enduring impact on the microprocessor industry.”
In this episode he joins Kevin Ball to talk about his life and career.
Kevin Ball or KBall, is the vice president of engineering at Mento and an independent coach for engineers and engineering leaders. He co-founded and served as CTO for two companies, founded the San Diego JavaScript meetup, and organizes the AI inaction discussion group through Latent Space.
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Turing Award Special: A Conversation with John Hennessy appeared first on Software Engineering Daily.
Sourcegraph is a powerful code search and intelligence tool that helps developers navigate and understand large codebases efficiently. It provides advanced search functionality across multiple repositories, making it easier to find references, functions, and dependencies. Additionally, Sourcegraph integrates with various development workflows to streamline code reviews and collaboration across teams.
Beyang Liu is the CTO and Co-Founder at Sourcegraph, where he has worked for the past twelve years. In this episode he joins the show with Sean Falconer to talk about the frontier of leveraging AI in software engineering.
Sean’s been an academic, startup founder, and Googler. He has published works covering a wide range of topics from AI to quantum computing. Currently, Sean is an AI Entrepreneur in Residence at Confluent where he works on AI strategy and thought leadership. You can connect with Sean on LinkedIn.
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Sourcegraph and the Frontier of AI in Software Engineering with Beyang Liu appeared first on Software Engineering Daily.
Jeffrey Ullman is a renowned computer scientist and professor emeritus at Stanford University, celebrated for his groundbreaking contributions to database systems, compilers, and algorithms. He co-authored influential texts like Principles of Database Systems and Compilers: Principles, Techniques, and Tools (often called the “Dragon Book”), which have shaped generations of computer science students.
Jeffrey received the 2020 Turing Award together with Alfred Aho “for fundamental algorithms and theory underlying programming language implementation and for synthesizing these results and those of others in their highly influential books, which educated generations of computer scientists.”In this episode he joins Kevin Ball to talk about his life and career.
Kevin Ball or KBall, is the vice president of engineering at Mento and an independent coach for engineers and engineering leaders. He co-founded and served as CTO for two companies, founded the San Diego JavaScript meetup, and organizes the AI inaction discussion group through Latent Space.
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Turing Award Special: A Conversation with Jeffrey Ullman appeared first on Software Engineering Daily.
Contextual memory in AI is a major challenge because current models struggle to retain and recall relevant information over time. While humans can build long-term semantic relationships, AI systems often rely on fixed context windows, leading to loss of important past interactions.
Zep is a startup that’s developing a memory layer for AI agents using temporal Knowledge Graphs, enabling agents to retain long-term contextual information. It was founded in 2023 and was part of the Y Combinator batch of Winter 2024.
Daniel Chalef is the Founder of Zep. He joins the show with Kevin Ball to talk about the challenge of contextual memory in AI, temporal knowledge graphs, ambient AI agents, and more.
Be sure to check out Graphiti on GitHub and read the Zep White Paper on arXiv.
Full Disclosure: This episode is sponsored by Zep.**
Kevin Ball or KBall, is the vice president of engineering at Mento and an independent coach for engineers and engineering leaders. He co-founded and served as CTO for two companies, founded the San Diego JavaScript meetup, and organizes the AI inaction discussion group through Latent Space.
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Knowledge Graphs as Agentic Memory with Daniel Chalef appeared first on Software Engineering Daily.
Remix is a full-stack, open-source web framework that was developed by the creators of the popular React Router library. It focuses on features such as server-side rendering and efficient data loading, and it emphasizes developer experience.Ryan Florence is a co-creator of React Remix and in this episode he speaks with Josh Goldberg about the Remix project.
Josh Goldberg is an independent full time open source developer in the TypeScript ecosystem. He works on projects that help developers write better TypeScript more easily, most notably on typescript-eslint: the tooling that enables ESLint and Prettier to run on TypeScript code. Josh regularly contributes to open source projects in the ecosystem such as ESLint and TypeScript. Josh is a Microsoft MVP for developer technologies and the author of the acclaimed Learning TypeScript (O’Reilly), a cherished resource for any developer seeking to learn TypeScript without any prior experience outside of JavaScript. Josh regularly presents talks and workshops at bootcamps, conferences, and meetups to share knowledge on TypeScript, static analysis, open source, and general frontend and web development.
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post React Remix with Ryan Florence appeared first on Software Engineering Daily.
Jack Dongarra is an American computer scientist who is celebrated for his pioneering contributions to numerical algorithms and high-performance computing. He developed essential software libraries like LINPACK and LAPACK, which are widely used for solving linear algebra problems on advanced computing systems. Dongarra is also a co-creator of the TOP500 list, which ranks the world’s most powerful supercomputers. His work has profoundly impacted computational science, enabling advancements across numerous research domains.
Jack received the 2021 Turing Award “for pioneering contributions to numerical algorithms and libraries that enabled high performance computational software to keep pace with exponential hardware improvements for over four decades.”
He joins the podcast with Sean Falconer to talk about his life and career.
Sean’s been an academic, startup founder, and Googler. He has published works covering a wide range of topics from AI to quantum computing. Currently, Sean is an AI Entrepreneur in Residence at Confluent where he works on AI strategy and thought leadership. You can connect with Sean on LinkedIn.
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Turing Award Special: A Conversation with Jack Dongarra appeared first on Software Engineering Daily.
Rigetti Computing is an American company specializing in quantum computing, founded in 2013. The company develops quantum processors and hybrid quantum-classical computing systems, and aims to make quantum computing more accessible for research and commercial applications.
David Rivas is the CTO at Rigetti Computing. He joins the podcast with Kevin Ball to talk about the company, the fundamentals of quantum computing, the state of the technology, and where we’re headed.
Kevin Ball or KBall, is the vice president of engineering at Mento and an independent coach for engineers and engineering leaders. He co-founded and served as CTO for two companies, founded the San Diego JavaScript meetup, and organizes the AI inaction discussion group through Latent Space.
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Quantum Computing at Rigetti with David Rivas appeared first on Software Engineering Daily.
Ethereum is a decentralized blockchain platform that was created by Vitalik Buterin and Gavin Wood in 2015. It uses a cryptocurrency called Ether as its native token to power transactions and operations on the Ethereum network. Ethereum’s proponents envision a future where the network forms the foundation for a second platform layer, called L2, where decentralized applications are run.
As we approach the 10th anniversary of Ethereum’s creation we wanted to understand the state of the technology so we spoke with Andrew Koller who is an engineer at Kraken, which is a software company and popular cryptocurrency exchange. In this conversation Andrew talks about Kraken, security considerations at an exchange, the history of Ethereum, L2, and the future of Ethereum.
Sean’s been an academic, startup founder, and Googler. He has published works covering a wide range of topics from AI to quantum computing. Currently, Sean is an AI Entrepreneur in Residence at Confluent where he works on AI strategy and thought leadership. You can connect with Sean on LinkedIn.
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post The State of the Ethereum Blockchain with Andrew Koller appeared first on Software Engineering Daily.
APIs are a fundamental part of modern software systems and enable communication between services, applications, and third-party integrations. However, their openness and accessibility also make them a prime target for security threats, and this makes APIs a growing focus on software teams.
StackHawk is a company that scans and monitors source code to obtain the full scope of an organization’s APIs and applications, and runs tests to identify vulnerabilities and address them pre-production.Scott Gerlach is the Co-Founder and Chief Security Officer at StackHawk and previously worked at SendGrid and GoDaddy. He has an extensive background running security operations and engineering and, in this episode, he joins the show to talk about the challenges around API security and leading-edge strategies to address them.
Full Disclosure: This episode is sponsored by 10kMedia (StackHawk).****
Gregor Vand is a security-focused technologist, and is the founder and CTO of Mailpass. Previously, Gregor was a CTO across cybersecurity, cyber insurance and general software engineering companies. He has been based in Asia Pacific for almost a decade and can be found via his profile at vand.hk.
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post StackHawk and Shift-Left API Security with Scott Gerlach appeared first on Software Engineering Daily.
NVIDIA RAPIDS is an open-source suite of GPU-accelerated data science and AI libraries. It leverages CUDA and significantly enhances the performance of core Python frameworks including Polars, pandas, scikit-learn and NetworkX.
Chris Deotte is a Senior Data Scientist at NVIDIA and Jean-Francois Puget is the Director and a Distinguished Engineer at NVIDIA. Chris and Jean-Francois are also Kaggle Grandmasters, which is the highest rank a data scientist or machine learning practitioner can achieve on Kaggle, a competitive platform for data science challenges.
In this episode, they join the podcast with Sean Falconer to talk about Kaggle, GPU-acceleration for data science applications, where they’ve achieved the biggest performance gains, the unexpected challenges with tabular data, and much more.
Sean’s been an academic, startup founder, and Googler. He has published works covering a wide range of topics from AI to quantum computing. Currently, Sean is an AI Entrepreneur in Residence at Confluent where he works on AI strategy and thought leadership. You can connect with Sean on LinkedIn.
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post NVIDIA RAPIDS and Open Source ML Acceleration with Chris Deotte and Jean-Francois Puget appeared first on Software Engineering Daily.
Browser security aims to protect users from cyber threats encountered online, such as phishing, malicious extensions, and malware. It’s a complex, multifaceted challenge that’s increasingly important as cloud-based tools, SaaS platforms, and collaborative applications become the backbone of modern workflows.
Jeswin Mathai is the Chief Architect at SquareX which is a cybersecurity company focused on protecting users and companies from web-based threats. Jeswin joins the podcast to talk about SquareX and modern strategies for browser security.
Gregor Vand is a security-focused technologist, and is the founder and CTO of Mailpass. Previously, Gregor was a CTO across cybersecurity, cyber insurance and general software engineering companies. He has been based in Asia Pacific for almost a decade and can be found via his profile at vand.hk.
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Browser Security with Jeswin Mathai appeared first on Software Engineering Daily.
A distributed system is a network of independent services that work together to achieve a common goal. Unlike a monolithic system, a distributed system has no central point of control, meaning it must handle challenges like data consistency, network latency, and system failures.
Debugging distributed systems is conventionally considered challenging because modern architectures consist of numerous microservices communicating across networks, making failures difficult to isolate. The challenges and maintenance burdens can magnify as systems grow in size and complexity.
Julia Blase is a Product Manager at Chronosphere where she works on features to help developers troubleshoot distributed systems more efficiently, including Differential Diagnosis, or DDx. DDx provides tooling to troubleshoot distributed systems, and emphasizes automation and developer experience. In this episode Julia joins Sean Falconer to talk about the challenges and emerging strategies to troubleshoot distributed systems.
Full Disclosure: This episode is sponsored by Chronosphere.****
Sean’s been an academic, startup founder, and Googler. He has published works covering a wide range of topics from AI to quantum computing. Currently, Sean is an AI Entrepreneur in Residence at Confluent where he works on AI strategy and thought leadership. You can connect with Sean on LinkedIn.
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Troubleshooting Microservices with Julia Blase appeared first on Software Engineering Daily.
The availability of high-quality AI model APIs has drastically lowered the barriers developing AI applications. These tools abstract away complex tasks such as model deployment, scaling, data retrieval, natural language processing, and text generation.
Vercel has developed a complementary set of tools for building AI web applications, including their AI SDK, v0, and the shadcn/ui component framework.
Ary Khandelwal and Max Leiter are on the AI team at Vercel. In this episode they join Kevin Ball to talk about the AI SDK, v0, shadcn/ui and the AI tooling ecosystem at Vercel.
Kevin Ball or KBall, is the vice president of engineering at Mento and an independent coach for engineers and engineering leaders. He co-founded and served as CTO for two companies, founded the San Diego JavaScript meetup, and organizes the AI inaction discussion group through Latent Space.
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Vercel’s Developer Frameworks with Ary Khandelwal and Max Leiter appeared first on Software Engineering Daily.
Agreements and contracts are a fundamental innovation and govern everything from personal commitments to major financial decisions. They function as trusted artifacts to capture the nature of a commitment and provide clarity and accountability. Software has revolutionized many business functions, including the basic mechanics of digitally signing an agreement. However, the process of managing agreements systematically and at scale with type definitions, programmatic document creation, and storage schemas remains a complex and largely unsolved challenge.
Dan Selman is the product architect at Docusign and was previously co-founder and CTO of the Smart Agreements Platform, Clause. Larry Jin is the VP of Product Management at Docusign and previously worked at Amazon, Microsoft, and Google. Docusign recently released a developer API focused on fully modernizing and scaling the agreements process. In this episode, Dan and Larry joined Sean Falconer to talk about the frontier of digital agreements.
Full Disclosure: This episode is sponsored by Docusign.**
Sean’s been an academic, startup founder, and Googler. He has published works covering a wide range of topics from AI to quantum computing. Currently, Sean is an AI Entrepreneur in Residence at Confluent where he works on AI strategy and thought leadership. You can connect with Sean on LinkedIn.
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Docusign for Developers with Dan Selman and Larry Jin appeared first on Software Engineering Daily.
Subsea cables are high-capacity fiber-optic lines laid along the ocean floor to enable global communication by transmitting data between continents. Spanning thousands of miles, they carry an estimated 95% of international internet, phone, and data transmissions.
Critically, these cables are vulnerable to sabotage by state actors, as they form critical infrastructure for global communication and economic stability. Indeed, Russia and China have been implicated in activities targeting subsea cables as recently as November 2024, and experts warn that these networks are likely to be focal points in future conflicts, heightening geopolitical tensions.
Josh Dzieza is a reporter for The Verge and has covered the subsea cable industry and the strategic importance of subsea cables. He joins the podcast alongside Gregor Vand to discuss this invisible, and increasingly important, network infrastructure.
You can check out Josh’s reporting here.
Gregor Vand is a security-focused technologist, and is the founder and CTO of Mailpass. Previously, Gregor was a CTO across cybersecurity, cyber insurance and general software engineering companies. He has been based in Asia Pacific for almost a decade and can be found via his profile at vand.hk.
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post The Subsea Cable Network with Josh Dzieza appeared first on Software Engineering Daily.
LangChain is a popular open-source framework to build applications that integrate LLMs with external data sources like APIs, databases, or custom knowledge bases. It’s commonly used for chatbots, question-answering systems, and workflow automation. Its flexibility and extensibility have made it something of a standard for creating sophisticated AI-driven software.
Erick Friis is a Founding Engineer at LangChain and he leads their integrations and open source efforts. Erick joins the podcast to talk about what inspired the creation of LangChain, agentic flows vs. chained flows, emerging patterns of agentic AI design, and much more.
Sean’s been an academic, startup founder, and Googler. He has published works covering a wide range of topics from AI to quantum computing. Currently, Sean is an AI Entrepreneur in Residence at Confluent where he works on AI strategy and thought leadership. You can connect with Sean on LinkedIn.
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post LangChain and Agentic AI Engineering with Erick Friis appeared first on Software Engineering Daily.
BlackBerry is a Canadian company known for its pivotal role in the smartphone market during the 2000s. Today, BlackBerry has adopted a major focus on cybersecurity.
John Wall is the Chief Operating Officer and Head of Products, Engineering and Services at QNX, which is a division of BlackBerry. Ismael Valenzuela is the former Vice President of Threat Research and Intelligence at BlackBerry, where he led threat research, intelligence, and defensive innovation. John and Ismael join the podcast to talk about cybersecurity at Blackberry, including secure communications in embedded systems.
Gregor Vand is a security-focused technologist, and is the founder and CTO of Mailpass. Previously, Gregor was a CTO across cybersecurity, cyber insurance and general software engineering companies. He has been based in Asia Pacific for almost a decade and can be found via his profile at vand.hk.
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Secure Communications in Embedded Systems with Ismael Valenzuela and John Wall appeared first on Software Engineering Daily.
Caves of Qud is a roguelike game set in a richly detailed, post-apocalyptic world blending science fiction and fantasy. The game is known for its deep lore, emergent gameplay, and wildly creative character customization. It is a massive indie success, and recently hit a major milestone with the release of version 1.0 after 15 years of development.
Brian Bucklew is the cofounder of Freehold games which develops Caves of Qud. Brian joins the show to talk about his engineering background and the development of his game.
Joe Nash is a developer, educator, and award-winning community builder, who has worked at companies including GitHub, Twilio, Unity, and PayPal. Joe got his start in software development by creating mods and running servers for Garry’s Mod, and game development remains his favorite way to experience and explore new technologies and concepts.
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Caves of Qud with Brian Bucklew appeared first on Software Engineering Daily.
Compute optimization in a cloud environment is a common challenge because of the need to balance performance, cost, and resource availability. The growing use of GPUs for workloads, including AI, is also increasing the complexity and importance of optimization given the relatively high cost of GPU cloud computation.
Jerzy Grzywinski is a Senior Director of Software Engineering and leads FinOps at Capital One. Brent Segner is a distinguished engineer at Capital One and is focused on performance engineering and cloud cost optimization. Jerzy and Brent joined the show with Sean Falconer to talk about methods to measure compute efficiency, horizontal versus vertical scaling, how to think about adopting new instance types, the effect of different languages on compute efficiency, and much more.
Full Disclosure: This episode is sponsored by Capital One.
Sean’s been an academic, startup founder, and Googler. He has published works covering a wide range of topics from AI to quantum computing. Currently, Sean is an AI Entrepreneur in Residence at Confluent where he works on AI strategy and thought leadership. You can connect with Sean on LinkedIn.
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Maximizing Cloud Efficiency with Jerzy Grzywinski and Brent Segner appeared first on Software Engineering Daily.
Docker container vulnerability analysis involves identifying and mitigating security risks within container images. This is done to ensure that containerized applications can be securely deployed. Vulnerability analysis can often be time intensive, which has motivated the use of AI and ML to accelerate the process.
NVIDIA Blueprints are reference workflows for agentic and generative AI use cases. One of the most prominent Blueprints is focused on vulnerability analysis for container security.
Amanda Saunders is the Director of Enterprise Generative AI Software at NVIDIA, and Allan Enemark works on NVIDIA’s Morpheus cybersecurity SDK team.
Amanda and Allan join the podcast with Gregor Vand to talk about Blueprints and their application to vulnerability and container security.
Gregor Vand is a security-focused technologist, and is the founder and CTO of Mailpass. Previously, Gregor was a CTO across cybersecurity, cyber insurance and general software engineering companies. He has been based in Asia Pacific for almost a decade and can be found via his profile at vand.hk.
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post NVIDIA’s Agentic AI for Container Security with Amanda Saunders and Allan Enemark appeared first on Software Engineering Daily.
Raylib is a lightweight, beginner-friendly, and open-source C library for game development, known for its simplicity and lack of external dependencies. It’s designed to streamline the creation of 2D and 3D games, and has an intuitive API for managing graphics, audio, and input.
Ramon Santamaria is the Founder and Lead Developer of Raylib. He joins the show with Joe Nash to talk about the Raylib project.
Joe Nash is a developer, educator, and award-winning community builder, who has worked at companies including GitHub, Twilio, Unity, and PayPal. Joe got his start in software development by creating mods and running servers for Garry’s Mod, and game development remains his favorite way to experience and explore new technologies and concepts.
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post The Raylib C Library for Game Development with Ramon Santamaria appeared first on Software Engineering Daily.
Anduril is a technology defense company with a focus on drones, computer vision, and other problems related to national security. It is a full-stack company that builds its own hardware and software, which leads to a great many interesting questions about cloud services, engineering workflows, and management.
Gokul Subramanian is Senior Vice President of Engineering for Software Programs at Anduril Industries. He joins the show to share his knowledge of the national security problem set, how Anduril operates and what the company has built.
Sean’s been an academic, startup founder, and Googler. He has published works covering a wide range of topics from AI to quantum computing. Currently, Sean is an AI Entrepreneur in Residence at Confluent where he works on AI strategy and thought leadership. You can connect with Sean on LinkedIn.
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Anduril with Gokul Subramanian appeared first on Software Engineering Daily.
QuantStack is an open-source technology software company specializing in tools for data science, scientific computing, and visualization. They are known for maintaining vital projects such as Jupyter, the conda-forge package channel, and the Mamba package manager.
Sylvain Corlay is the CEO of QuantStack. He joins the podcast to talk about his company, Conda, Mamba, the new Mamba 2.0 release, software package security, and more.
Gregor Vand is a security-focused technologist, and is the founder and CTO of Mailpass. Previously, Gregor was a CTO across cybersecurity, cyber insurance and general software engineering companies. He has been based in Asia Pacific for almost a decade and can be found via his profile at vand.hk.
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Mamba and Software Package Security with Sylvain Corlay appeared first on Software Engineering Daily.
Ableton is a music software and hardware company based in Germany. The company develops Ableton Live which is a digital audio workstation for both improvisation and traditional arrangements.
The software is remarkable for successfully blending good UI design with a powerful feature set. This has made it popular with new musicians as well as professionals such as Tame Impalla, Knxwledge, Mac DeMarco, and Daft Punk, among many others.
Tobi Hahn is Ableton’s Engineering Manager. He joins the podcast to talk about software engineering for Ableton Live.
Kevin Ball or KBall, is the vice president of engineering at Mento and an independent coach for engineers and engineering leaders. He co-founded and served as CTO for two companies, founded the San Diego JavaScript meetup, and organizes the AI inaction discussion group through Latent Space.
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Ableton Live with Tobias Hahn appeared first on Software Engineering Daily.
beeps is a startup focused on building an on-call platform for Next.js. The company is grounded in the key insight that Next.js has become a dominant framework for modern development. A key motivation in leveraging Next.js is to create a developer-first experience for on-call.
Joey Parsons is the founder and CEO of beeps, and he previously founded effx which was acquired by Figma in 2021. Joey joins the show to talk about the platform, starting a company without an explicit AI focus, the limitations of current on-call systems, building on Next.js, and more.
Full Disclosure: This episode is sponsored by Beeps.
Sean’s been an academic, startup founder, and Googler. He has published works covering a wide range of topics from AI to quantum computing. Currently, Sean is an AI Entrepreneur in Residence at Confluent where he works on AI strategy and thought leadership. You can connect with Sean on LinkedIn.
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post beeps and on-call for Next.js developers with Joey Parsons appeared first on Software Engineering Daily.
Digital forensics is the process of identifying, preserving, analyzing, and presenting electronic data for investigative purposes. It’s often related to addressing cybercrime and is crucial in tracing the origin of breaches, recovering lost data, and security hardening.
Emre Tinaztepe is the Founder and CEO of Binalyze which is a cybersecurity company specializing in digital forensics and incident response solutions. He joins the podcast with Gregor Vand to talk about his path into engineering, his time in the infantry, Binalyze, digital forensics, and more.
Gregor Vand is a security-focused technologist, and is the founder and CTO of Mailpass. Previously, Gregor was a CTO across cybersecurity, cyber insurance and general software engineering companies. He has been based in Asia Pacific for almost a decade and can be found via his profile at vand.hk.
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Digital Forensics with Emre Tinaztepe appeared first on Software Engineering Daily.
Fallout: London is a 2024 total conversion mod developed by Team FOLON. The mod is based on Fallout 4 by Bethesda Softworks and takes place in a post-apocalyptic rendition of London. The project is remarkable for its ambition and scope, with the small indie team delivering a fully-realized open world RPG.
Daniel Morrison Neil led music composition, audio design, and the voice acting department for the project. Jordan Albon was the lead 3D artist and the build master in charge of version control. They join the show with Joe Nash to talk about Fallout: London and its development.
Joe Nash is a developer, educator, and award-winning community builder, who has worked at companies including GitHub, Twilio, Unity, and PayPal. Joe got his start in software development by creating mods and running servers for Garry’s Mod, and game development remains his favorite way to experience and explore new technologies and concepts.
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Fallout: London with Daniel Morrison Neil and Jordan Albon appeared first on Software Engineering Daily.
Heroku is a cloud platform-as-a-service that enables developers to build, deploy, and manage applications. It was founded in 2007 and was acquired by Salesforce in 2010. The platform supports multiple programming languages, including Ruby, Python, Node.js, and Java, and has features such as automated scaling, database monitoring tools, and a streamlined deployment workflow.
Vish Abrams is the Chief Architect at Heroku and previously worked at Oracle and NASA, among other organizations. He joins the show to talk about the history of Heroku, its role within Salesforce, open-sourcing the Twelve Factor App, the long-standing challenge of credentials management, and much more.
Full Disclosure: This episode is sponsored by Salesforce (Heroku).
Sean’s been an academic, startup founder, and Googler. He has published works covering a wide range of topics from AI to quantum computing. Currently, Sean is an AI Entrepreneur in Residence at Confluent where he works on AI strategy and thought leadership. You can connect with Sean on LinkedIn.
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Heroku and the Twelve-Factor App with Vish Abrams appeared first on Software Engineering Daily.
Over the years, Google has released a variety of ML, data science, and AI developer tools and platforms. Prominent examples include Colab, Kaggle, AI Studio, and the Gemini API.
Paige Bailey is the Uber Technical Lead of the Developer Relations team at Google ML Developer Tools, working on Gemini APIs, Gemma, AI Studio, Kaggle, Colab and Jax. She joins the podcast to talk about the specialized task of creating developer tools for ML and AI.
Jordi Mon Companys is a product manager and marketer that specializes in software delivery, developer experience, cloud native and open source. He has developed his career at companies like GitLab, Weaveworks, Harness and other platform and devtool providers. His interests range from software supply chain security to open source innovation. You can reach out to him on Twitter at @jordimonpmm.
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post AI Developer Tools at Google with Paige Bailey appeared first on Software Engineering Daily.
Video game emulation is the process of using software to replicate the functionality of gaming hardware. It’s a fundamental approach to making older games accessible on modern devices.
The Carbon Engine is a tool developed internally at video game publisher and distributor Limited Run Games. It allows a variety of emulators to interface with modern video game hardware, and it supports emulation of SNES, Genesis, PlayStation, Gameboy Advance, and other consoles.
Dimitris Giannakis is the Lead Developer of the Carbon Engine. He is known for his many contributions in the hacking, emulation, and game development space, and for his highly popular YouTube channel, Modern Vintage Gamer, or MVG.
Dimitris joins the podcast with Joe Nash to talk how he got started in game development, building emulators from scratch, scoping an emulation project, homebrew vs. official SDKs, the Carbon Engine, and more.Joe Nash is a developer, educator, and award-winning community builder, who has worked at companies including GitHub, Twilio, Unity, and PayPal. Joe got his start in software development by creating mods and running servers for Garry’s Mod, and game development remains his favorite way to experience and explore new technologies and concepts.
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Game Emulation on the Carbon Engine with Dimitris “MVG” Giannakis appeared first on Software Engineering Daily.
Serverless computing is a cloud-native model where developers build and run applications without managing server infrastructure. It has largely become the standard approach to achieve scalability, often with reduced operational overhead. However, in banking and financial services, adopting a serverless model can present unique challenges.
Brian McNamara is a Distinguished Engineer at Capital One where he works in serverless integration and development. Brian joins the show with Sean Falconer to talk about why Capital One shifted to a serverless approach, how to think about cloud costs, establishing governance controls, tools to stay well-managed, and much more.
Full Disclosure: This episode is sponsored by Capital One.
Sean’s been an academic, startup founder, and Googler. He has published works covering a wide range of topics from AI to quantum computing. Currently, Sean is an AI Entrepreneur in Residence at Confluent where he works on AI strategy and thought leadership. You can connect with Sean on LinkedIn.
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Going Serverless in Financial Services with Brian McNamara appeared first on Software Engineering Daily.
Teardown is a 2022 sandbox puzzle game developed and published by Tuxedo Labs. The game revolves around the owner of a financially stricken demolition company, who is caught undertaking a questionable job and becomes entangled between helping police investigations and taking on further dubious assignments.
The game stands out for its technical achievements, particularly its use of voxel-based rendering, which enables highly interactive and fully destructible environments. Dennis Gustafsson is the Founder of TuxedoLabs and the creator of Teardown, among other games. In today’s episode, Dennis speaks with Joe Nash about his 20-year history in game development, his passion for physics in games, Teardown, the advantage of using voxels, and much more.
Joe Nash is a developer, educator, and award-winning community builder, who has worked at companies including GitHub, Twilio, Unity, and PayPal. Joe got his start in software development by creating mods and running servers for Garry’s Mod, and game development remains his favorite way to experience and explore new technologies and concepts.
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Teardown and Voxel-Based Rendering with Dennis Gustafsson appeared first on Software Engineering Daily.
Expo is a development framework that streamlines the process of building cross-platform mobile apps using React Native. It eliminates the need for complex native code setup by providing pre-built APIs for common device features like the camera and GPS, making it easier to access hardware functionality. It also simplifies the deployment process with built-in tools for building and distributing apps.
Charlie Cheever and James Ide are the Co-Founders of Expo and they join the podcast to talk about the framework and the problems it solves.
Kevin Ball or KBall, is the vice president of engineering at Mento and an independent coach for engineers and engineering leaders. He co-founded and served as CTO for two companies, founded the San Diego JavaScript meetup, and organizes the AI inaction discussion group through Latent Space.
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Streamlined React Native Development with Charlie Cheever and James Ide appeared first on Software Engineering Daily.
To our Software Engineering Daily listeners – as we wrap up 2024, we want to thank you all for listening to the show. We’ve had a great time putting together all of our episodes this year, and we’re grateful for your support.
This year we continued our wide lens coverage of software engineering, and we also expanded our coverage of security, AI, and game development. We want to extend our thanks to all of our fantastic guests for sharing their time and expertise.
We’re really excited about our 2025 podcast season and we think you’re going to love what we have in store. As always, we’re committed to bringing you high-caliber experts from across the tech landscape, and we can’t wait to explore new topics and perspectives in the coming year.
To close out 2024, we’ll be pausing releases this week to spend time with our families, but we’ll be back with new episodes the first week of January.
Please consider leaving us a review on Apple Podcasts or Spotify if you haven’t yet. We take your feedback very seriously and it helps us improve the show. And, if you have any topics or guests you’d like to hear on the podcast we want to know, and you can send them our way at editor@softwareengineeringdaily.com.
Thank you again for listening to Software Engineering Daily and we wish you all a happy New Year!The post Special End-of-Year Message from Software Engineering Daily appeared first on Software Engineering Daily.
Vulkan is a low-level graphics API designed to provide developers with more direct control over the GPU, reducing overhead and enabling high performance in applications like games, simulations, and visualizations. It addresses the inefficiencies of older APIs like OpenGL and Direct3D and helps solve issues with cross-platform compatibility.
Tom Olson is a Distinguished Engineer at ARM, and Ralph Potter is the Lead Khronos Standards Engineer at Samsung.
Tom and Ralph are also the outgoing and incoming Chairs of the Vulkan Working Group. They join the podcast to talk about earlier graphics APIs, what motivated the creation of Vulkan, modern GPUs, and more.Joe Nash is a developer, educator, and award-winning community builder, who has worked at companies including GitHub, Twilio, Unity, and PayPal. Joe got his start in software development by creating mods and running servers for Garry’s Mod, and game development remains his favorite way to experience and explore new technologies and concepts.
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post The Vulkan Graphics API with Tom Olson and Ralph Potter appeared first on Software Engineering Daily.
Deno is a free and open source JavaScript runtime built on Google’s V8 engine, Rust, and Tokio. It’s designed to offer a more secure and standardized alternative to Node.js, with native TypeScript support. Deno 2.0 just released and it’s a significant update, focusing on improved compatibility with Node.js and addressing developer feedback. Some of the key features are backwards compatibility with Node.js and npm, native support for package.json and node_modules, and a stabilized standard library.
Luca Casonato is a Software Engineer for Deno and he spoke about the project on Software Engineering Daily in 2023. We’re excited to have Luca join the show again to talk about the many changes introduced in Deno 2.0.Kevin Ball or KBall, is the vice president of engineering at Mento and an independent coach for engineers and engineering leaders. He co-founded and served as CTO for two companies, founded the San Diego JavaScript meetup, and organizes the AI inaction discussion group through Latent Space.
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Deno 2.0 with Luca Casonato appeared first on Software Engineering Daily.
JFrog is a DevOps platform that specializes in managing software packages and automating software delivery. One of its best known services is the JFrog Artifactory which is a universal artifact repository. JFrog is also focused on rapidly emerging needs in the MLOps space.
Bill Manning is a Senior Solution Architect at JFrog. He joins the podcast to talk about his background in startups and venture capital, and his current work in ML at JFrog.
Sean’s been an academic, startup founder, and Googler. He has published works covering a wide range of topics from AI to quantum computing. Currently, Sean is an AI Entrepreneur in Residence at Confluent where he works on AI strategy and thought leadership. You can connect with Sean on LinkedIn.
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post MLOps at JFrog with Bill Manning appeared first on Software Engineering Daily.
Offensive penetration testing, or offensive pentesting, involves actively probing a system, network, or application to identify and exploit vulnerabilities, mimicking the tactics of real-world attackers. The goal is to assess security weaknesses and provide actionable insights to strengthen defenses before malicious actors can exploit them.
Bishop Fox is a private professional services firm focused on offensive security testing. Mark Goodwin is the Director of Operations at Bishop Fox and he was previously an officer in the U.S. Air Force where he did cyberspace operations. Mark joins the podcast with Gregor Vand to talk about Bishop Fox and the future of offensive pentesting.
Gregor Vand is a security-focused technologist, and is the founder and CTO of Mailpass. Previously, Gregor was a CTO across cybersecurity, cyber insurance and general software engineering companies. He has been based in Asia Pacific for almost a decade and can be found via his profile at vand.hk.
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post The Future of Offensive Pentesting with Mark Goodwin appeared first on Software Engineering Daily.
WipEout is a futuristic racing game that was originally released in 1995 for the PlayStation. The game fused fast gameplay, striking art direction, and licensed electronic music. It was a cultural phenomenon and an early showcase for 3D graphics in console gaming.
Dominic Szablewski is an engineer, game developer and hacker who has released projects such as Voidcall, Quake VR, and Q1K3 which is a 13 kilobyte version of Quake written in JavaScript.
A version of the WipEout source code was leaked in 2022 and Dominic created a nearly complete rewrite of the game that compiles to Windows, Linux, macOS and WASM.
Dominic joins the podcast to talk about the project.
Joe Nash is a developer, educator, and award-winning community builder, who has worked at companies including GitHub, Twilio, Unity, and PayPal. Joe got his start in software development by creating mods and running servers for Garry’s Mod, and game development remains his favorite way to experience and explore new technologies and concepts.
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post WipEout with Dominic Szablewski appeared first on Software Engineering Daily.
Discord is a popular communication and streaming platform that was originally launched in 2015. It was first popularized in the gaming space, but its user base has grown to include a broad array of communities, businesses, and social groups.
Justin Beckwith is the Director of Engineering at Discord. He leads engineering for the Platform Ecosystem organization and has played a pivotal role in developing Discord’s Embedded App SDK. Justin joins the podcast with Sean Falconer to talk about leading engineering at Discord.
Sean’s been an academic, startup founder, and Googler. He has published works covering a wide range of topics from AI to quantum computing. Currently, Sean is an AI Entrepreneur in Residence at Confluent where he works on AI strategy and thought leadership. You can connect with Sean on LinkedIn.
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Engineering at Discord with Justin Beckwith appeared first on Software Engineering Daily.
Next.js is an open source JavaScript framework developed by Vercel. It’s built on top of React and is designed to streamline web application development using server-side rendering and static site generation. The framework’s handling of both frontend and backend tasks, along with features like API routes and file-based routing, have made it an increasingly popular choice in the web dev community.
Next.js 15 just released in October of 2024 and introduces significant upgrades, including enhanced integration of Turbopack and support for React 19.
Jimmy Lai is a Software Engineering Manager at Next.js and Tim Neutkens is the Tech Lead for Next.js and Turbopack. They join the show to talk about Next.js and what’s new in version 15.
Kevin Ball or KBall, is the vice president of engineering at Mento and an independent coach for engineers and engineering leaders. He co-founded and served as CTO for two companies, founded the San Diego JavaScript meetup, and organizes the AI inaction discussion group through Latent Space.
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Next.js 15 with Jimmy Lai and Tim Neutkens appeared first on Software Engineering Daily.
CodeSandbox was founded in 2017 and provides cloud based development environments along with other features. It’s quickly become one of the most prominent cloud development platforms.
Ives van Hoorne is a Co-Founder at CodeSandbox. He joins the show to talk about the platform.
Josh Goldberg is an independent full time open source developer in the TypeScript ecosystem. He works on projects that help developers write better TypeScript more easily, most notably on typescript-eslint: the tooling that enables ESLint and Prettier to run on TypeScript code. Josh regularly contributes to open source projects in the ecosystem such as ESLint and TypeScript. Josh is a Microsoft MVP for developer technologies and the author of the acclaimed Learning TypeScript (O’Reilly), a cherished resource for any developer seeking to learn TypeScript without any prior experience outside of JavaScript. Josh regularly presents talks and workshops at bootcamps, conferences, and meetups to share knowledge on TypeScript, static analysis, open source, and general frontend and web development.
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post CodeSandbox with Ives van Hoorne appeared first on Software Engineering Daily.
Data analytics and business intelligence involve collecting, processing, and interpreting data to guide decision-making. A common challenge in data-focused organizations is how to make data accessible to the wider organization, without the need for large data teams.
Metabase is an open source business intelligence tool that focuses on data exploration, visualization, and analysis. It offers a lightweight deployment strategy and aims to solve common challenges around data-driven decision making. A key aspect of its interface is that it allows users to interact with data with, or without, SQL.
Sameer Al-Sakran is the founder and CEO of Metabase. He joins the show to talk about the challenge of data accessibility, the evolution of the data analytics field, key lessons from his 14 years leading Metabase, why the platform uses the Clojure language, and much more.
Full Disclosure: This episode is sponsored by Metabase.
Sean’s been an academic, startup founder, and Googler. He has published works covering a wide range of topics from AI to quantum computing. Currently, Sean is an AI Entrepreneur in Residence at Confluent where he works on AI strategy and thought leadership. You can connect with Sean on LinkedIn.
.
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Open Source Data Analytics with Sameer Al-Sakran appeared first on Software Engineering Daily.
Gil Tayar is a Principal Software Engineer at Microsoft, developer advocate, and conference speaker. Gil’s contributions to the Node.js ecosystem include adding support for ECMAScript Modules in Node.js to Mocha and TestDouble. He joins the show to talk about his history in software engineering, monorepos vs polyrepos, the state of JavaScript, and more.
Josh Goldberg is an independent full time open source developer in the TypeScript ecosystem. He works on projects that help developers write better TypeScript more easily, most notably on typescript-eslint: the tooling that enables ESLint and Prettier to run on TypeScript code. Josh regularly contributes to open source projects in the ecosystem such as ESLint and TypeScript. Josh is a Microsoft MVP for developer technologies and the author of the acclaimed Learning TypeScript (O’Reilly), a cherished resource for any developer seeking to learn TypeScript without any prior experience outside of JavaScript. Josh regularly presents talks and workshops at bootcamps, conferences, and meetups to share knowledge on TypeScript, static analysis, open source, and general frontend and web development.
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Node.js and the Javascript Ecosystem with Gil Tayar appeared first on Software Engineering Daily.
Runway is an applied AI research company building multi-modal AI systems, model deployment infrastructure, and products that leverage AI for multimedia content.
They are among a handful of high-profile video generation startups and have raised impressive amounts of funding from investors such as Google, NVIDIA, and Salesforce Ventures.
The company recently released their Gen-3 Alpha model which is trained jointly on videos and images, and will power text to video, image to video and text to image tools.
Joel Kwartler is Runway’s Group Product Manager. He joins the podcast with Gregor Vand to talk about Runway and the technology the company is developing.
Gregor Vand is a security-focused technologist, and is the founder and CTO of Mailpass. Previously, Gregor was a CTO across cybersecurity, cyber insurance and general software engineering companies. He has been based in Asia Pacific for almost a decade and can be found via his profile at vand.hk.
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Runway AI with Joel Kwartler appeared first on Software Engineering Daily.
Palantir Technologies is a data analytics and software company specializing in building platforms for integrating, analyzing, and visualizing large datasets. The company’s tools are designed to help analysts and decision-makers collaborate on data-driven solutions to complex problems, and they have worked extensively across the intelligence, defense, and commercial sectors.
Akshay Krishnaswamy is the Chief Architect at Palantir, and Chris Jeganathan is a Group Lead at Palantir. They join the podcast to talk about the evolution of Palantir, its technology, the AIP platform, and more.
Sean’s been an academic, startup founder, and Googler. He has published works covering a wide range of topics from information visualization to quantum computing. Currently, Sean is Head of Marketing and Developer Relations at Skyflow and host of the podcast Partially Redacted, a podcast about privacy and security engineering. You can connect with Sean on Twitter @seanfalconer.
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Palantir with Akshay Krishnaswamy and Christopher Jeganathan appeared first on Software Engineering Daily.
FAPI is a refinement of the OAuth standard developed by the OpenID Foundation. It was conceived to solve a core problem of providing a consistent approach to API security across the financial industry, with the goal of enhancing interoperability of financial data exchange. It has now been adopted across many different industries in applications where there is an API that requires a heightened authorization security implementation.
Authlete is a service that provides a set of APIs to implement OAuth Authorization Servers and OpenID Connect identity providers, allowing either to be easily made FAPI-compliant.
Joseph Heenan is the CTO at Authlete, and he also leads the certification program at the OpenID foundation. He joins the podcast with Gregor Vand to talk about the origins of FAPI, the motivations for its creation, the status of FAPI development, and more.
Full Disclosure: This episode is sponsored by Authlete.
Software Engineering Daily listeners can get a free 90 day trial of Authlete at https://authlete.com/sed
Gregor Vand is a security-focused technologist, and is the founder and CTO of Mailpass. Previously, Gregor was a CTO across cybersecurity, cyber insurance and general software engineering companies. He has been based in Asia Pacific for almost a decade and can be found via his profile at vand.hk.
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Enhancing OAuth Security and Interoperability Using FAPI with Joseph Heenan appeared first on Software Engineering Daily.
PCSX2 is an open-source PlayStation 2 emulator that allows users to play PS2 games on modern hardware. The emulator is remarkable for simulating the complex architecture of the PS2, which includes the Emotion Engine CPU, Graphics Synthesizer, and specialized subsystems.
The emulator just hit a major milestone with the release of PCSX2 version 2.0. The release brings many changes including a Qt-based interface, big picture mode, auto-selection of graphics APIs, and native support for MacOS.
TellowKrinkle is a developer for PCSX2 who ported the emulator to MacOS, among other contributions. In addition to his work on PS2 emulation he has also worked on Dolphin, which emulates the Nintendo GameCube and Wii. Tellow joins the podcast with Joe Nash to talk about how he got started in emulation, the PS2 architecture, the challenges of rendering PS2 games on modern GPUs, and more.
Joe Nash is a developer, educator, and award-winning community builder, who has worked at companies including GitHub, Twilio, Unity, and PayPal. Joe got his start in software development by creating mods and running servers for Garry’s Mod, and game development remains his favorite way to experience and explore new technologies and concepts.
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post PlayStation 2 Emulation with TellowKrinkle appeared first on Software Engineering Daily.
Taiwan Semiconductor Manufacturing Company, or TSMC, produces a significant portion of the global supply of advanced semiconductors. Its cutting-edge technology powers everything from smartphones to high-performance computing, and its customers include Apple, NVIDIA, and ARM.
TSMC’s dominance in chip production has made Taiwan a critical player in the global tech supply chain, drawing attention from major economies like the U.S. and China. This has escalated geopolitical tensions, with concerns over the stability of Taiwan and the potential risks to global tech industries if chip production were disrupted due to regional conflicts.
Tim Culpan is an independent technology journalist and author of the forthcoming book “The World’s Smallest Superpower — inside the rise of TSMC, Foxconn and a nation of Taiwan technology titans.”
He’s based in Taipei and has been covering the semiconductor and electronics hardware industry for 25 years, including 18 years as a journalist and Columnist at Bloomberg. Most recently his work can be found at timculpan.substack.com.
Tim has written extensively about TSMC, and recently broke news on the developments at TSMC’s Arizona factory. He joins us today to discuss what’s happening at TSMC and what that means for the US, Taiwan and China’s chip industries.
Sean’s been an academic, startup founder, and Googler. He has published works covering a wide range of topics from information visualization to quantum computing. Currently, Sean is Head of Marketing and Developer Relations at Skyflow and host of the podcast Partially Redacted, a podcast about privacy and security engineering. You can connect with Sean on Twitter @seanfalconer.
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post TSMC and the Geopolitics of the Chip Industry with Tim Culpan appeared first on Software Engineering Daily.
Factorio is a construction and management simulation game focused on resource-gathering with real-time strategy and survival elements. The player survives by locating and harvesting resources to craft various tools and machines, which in turn create more advanced materials that allow for the progression to more sophisticated technologies.
The game was released in 2020 and has been hailed as a manufacturing masterpiece. Factorio’s Space Age expansion just released so we took the opportunity to speak with Michal Kovařík, also known as kovarex, who is the Founder and Director of Wube Software which developed Factorio. Michal joins the show with Joe Nash to talk about the origins of the game, the new expansion, and everything in between.
Joe Nash is a developer, educator, and award-winning community builder, who has worked at companies including GitHub, Twilio, Unity, and PayPal. Joe got his start in software development by creating mods and running servers for Garry’s Mod, and game development remains his favorite way to experience and explore new technologies and concepts.
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Factorio with Michal Kovařík appeared first on Software Engineering Daily.
Slack is a team communication platform that originated as an internal tool within Tiny Speck, a game development company. When the company realized that their game would not achieve commercial success, they changed direction and repurposed the communication tool into a new product which eventually became Slack. Slack was launched in 2013 and is now ubiquitous in workplaces around the world.
Shruti Kapoor is a Lead Member of the Technical Staff at Slack. She’s worked on features including Huddles, the recent redesign of Slack, and currently works on accessibility. She joins the podcast to talk about her path into frontend engineering, the frontend tech stack at Slack, the developer tooling, how Slack evaluates new technologies, and more.
Josh Goldberg is an independent full time open source developer in the TypeScript ecosystem. He works on projects that help developers write better TypeScript more easily, most notably on typescript-eslint: the tooling that enables ESLint and Prettier to run on TypeScript code. Josh regularly contributes to open source projects in the ecosystem such as ESLint and TypeScript. Josh is a Microsoft MVP for developer technologies and the author of the acclaimed Learning TypeScript (O’Reilly), a cherished resource for any developer seeking to learn TypeScript without any prior experience outside of JavaScript. Josh regularly presents talks and workshops at bootcamps, conferences, and meetups to share knowledge on TypeScript, static analysis, open source, and general frontend and web development.
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Frontend Engineering at Slack with Shruti Kapoor appeared first on Software Engineering Daily.
Boston Dynamics is a robotics company known for creating advanced robots with highly dynamic movement and agility, designed to navigate complex environments. Their robots, such as the quadruped Spot and the humanoid Atlas, have applications in industries ranging from logistics to public safety. They also garner widespread attention with their impressive videos showcasing robots performing complex tasks with precision.
Matthew Malchano is Boston Dynamics‘ Vice President of Software. For more than 20 years, Matt has been a technical contributor and leader on robotics projects such as Spot, BigDog, LS3, and SandFlea. He has led efforts in areas including software, product, and robotics autonomy, perception, and control. Matt joins the podcast with Sean Falconer to talk about his wide-ranging work at Boston Dynamics.
Sean’s been an academic, startup founder, and Googler. He has published works covering a wide range of topics from information visualization to quantum computing. Currently, Sean is Head of Marketing and Developer Relations at Skyflow and host of the podcast Partially Redacted, a podcast about privacy and security engineering. You can connect with Sean on Twitter @seanfalconer.
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Boston Dynamics with Matt Malchano appeared first on Software Engineering Daily.
TypeScript is a superset of JavaScript that adds static typing with optional type annotations. It was created at Microsoft and first released in 2012.
TypeScript ESLint enables ESLint and Prettier to run on TypeScript code.
Josh Goldberg is a host for Software Engineering Daily, the author of Learning TypeScript by O’Reilly, and a Microsoft MVP. He’s also a maintainer of TypeScript ESLint. In this episode, Josh speaks with Paweł Borkowski about the history of TypeScript, why it was created, some of its current limitations, the TypeScript ESLint project, and more.
Paweł is the founder at flat.social the world’s first ‘flatverse’ start-up and glot.space, an AI-powered language learning app. Pawel’s background is as a full-stack software engineer with a lean and experimental approach towards product development. With a strong grounding in computing science, he spent the last decade getting early-stage products off the ground – both in startup and corporate settings. Follow Paweł on Twitter, LinkedIn and his personal website – pawel.io.
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post TypeScript ESLint with Josh Goldberg appeared first on Software Engineering Daily.
Modern engineering teams often face challenges with unpredictable delivery and limited visibility into their performance. This can make it difficult to track progress, identify bottlenecks, and understand how efficiently time and resources are being used. The lack of clear insights commonly prevents teams from aligning their work with broader business goals.
Sleuth is designed to be an operating system for engineering, and help teams achieve more predictable delivery and align with business needs.
Dylan Etkin is the Founder and CEO of Sleuth. Dylan is an Atlassian alum who has spent the last 15 years building dev tools with Jira, Bitbucket, and Statuspage. He joins the podcast to talk about the challenges faced by modern engineering teams and innovative strategies to overcome them.
Full Disclosure: This episode is sponsored by Sleuth.
Gregor Vand is a security-focused technologist, and is the founder and CTO of Mailpass. Previously, Gregor was a CTO across cybersecurity, cyber insurance and general software engineering companies. He has been based in Asia Pacific for almost a decade and can be found via his profile at vand.hk.
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Sleuth and the Future of Engineering Teams with Dylan Etkin appeared first on Software Engineering Daily.
Python 3.13 was just released and brings fundamental changes to the language including a new interactive interpreter, experimental support for running in a free-threaded mode, and a Just-In-Time compiler, or JIT. There are also updates to the Python type system, module removals, and docstring improvements among many other changes.
Łukasz Langa is the CPython Developer in Residence at the Python Software Foundation. He joins the show with Sean Falconer to talk about maintaining Python, the evolution of the language, Python optimization, the most impactful changes in Python 3.13, and more.
Sean’s been an academic, startup founder, and Googler. He has published works covering a wide range of topics from information visualization to quantum computing. Currently, Sean is Head of Marketing and Developer Relations at Skyflow and host of the podcast Partially Redacted, a podcast about privacy and security engineering. You can connect with Sean on Twitter @seanfalconer.
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post The Big Changes in Python 3.13 with Łukasz Langa appeared first on Software Engineering Daily.
Argo is an open-source suite of tools to enhance continuous delivery and workflow orchestration in Kubernetes environments. The project had its start at Applatix and was accepted to the Cloud Native Computing Foundation in 2020.
Michael Crenshaw and Zach Aller are both lead maintainers for Argo. They join the show with Lee Atchison to talk about the origins of the project, what problems Argo solves, the four core tools in Argo, and more.
This episode is hosted by Lee Atchison. Lee Atchison is a software architect, author, and thought leader on cloud computing and application modernization. His best-selling book, Architecting for Scale (O’Reilly Media), is an essential resource for technical teams looking to maintain high availability and manage risk in their cloud environments.
Lee is the host of his podcast, Modern Digital Business, an engaging and informative podcast produced for people looking to build and grow their digital business with the help of modern applications and processes developed for today’s fast-moving business environment. Listen at mdb.fm. Follow Lee at softwarearchitectureinsights.com, and see all his content at leeatchison.com.
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Argo and Kubernetes with Michael Crenshaw and Zach Aller appeared first on Software Engineering Daily.
In software engineering, C++ is often used in areas where low-level system access and high-performance are critical, such as operating systems, game engines, and embedded systems. Its long-standing presence and compatibility with legacy code make it a go-to language for maintaining and extending older projects. Rust, while newer, is gaining traction in roles that demand safety and concurrency, particularly in systems programming.
We wanted to explore these two languages side-by-side, so we invited Herb Sutter and Steve Klabnik to join host Kevin Ball on the show. Herb works at Microsoft and chairs the ISO C++ standards committee. Steve works at Oxide Computer Company, is an alumnus of the Rust Core Team, and is the primary author of The Rust Programming Language book.
We hope you enjoy this deep dive into Rust and C++ on Software Engineering Daily.
Kevin Ball or KBall, is the vice president of engineering at Mento and an independent coach for engineers and engineering leaders. He co-founded and served as CTO for two companies, founded the San Diego JavaScript meetup, and organizes the AI inaction discussion group through Latent Space.
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Rust and C++ with Steve Klabnik and Herb Sutter appeared first on Software Engineering Daily.
CRISPR is a powerful tool in biotechnology that allows scientists to precisely edit genes, much like editing lines of code in a computer program. Just as developers can remove or alter specific parts of a code to fix bugs or enhance functionality, CRISPR enables researchers to modify DNA to correct genetic disorders, improve crops, or develop new treatments. The development of CRISPR-based editing was recognized by the Nobel Prize in Chemistry in 2020 awarded to Emmanuelle Charpentier and Jennifer Doudna.
Profluent Bio is an AI-first protein design company that recently developed OpenCRISPR-1, which is an AI-generated, CRISPR-like protein that does not occur in nature. Importantly, the company also released the protein and nucleic acid sequences for OpenCRISPR-1.
Aadyot Bhatnagar is an ML Scientist at Profluent Bio and previously worked at Salesforce. He joins the podcast with Sean Falconer to talk about OpenCRISPR-1 and how it was made.
Sean’s been an academic, startup founder, and Googler. He has published works covering a wide range of topics from information visualization to quantum computing. Currently, Sean is Head of Marketing and Developer Relations at Skyflow and host of the podcast Partially Redacted, a podcast about privacy and security engineering. You can connect with Sean on Twitter @seanfalconer.
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Engineering an Open Source CRISPR with Aadyot Bhatnagar appeared first on Software Engineering Daily.
SoundCloud is an online platform and music streaming service where users can upload, promote, and share their music or audio creations. It was founded in 2007 and is known for its community-driven approach, allowing artists to interact directly with their fans and receive real-time feedback on their work.
Matthew Drooker is the Chief Technology Officer at SoundCloud. He previously worked at Turner and has deep experience as a technologist and leader in the media industry. Matthew joins the show with Jordi Mon Companys to talk about his background, the evolution of the SoundCloud platform, its current tech stack, and much more.
Jordi Mon Companys is a product manager and marketer that specializes in software delivery, developer experience, cloud native and open source. He has developed his career at companies like GitLab, Weaveworks, Harness and other platform and devtool providers. His interests range from software supply chain security to open source innovation. You can reach out to him on Twitter at @jordimonpmm
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post SoundCloud’s Platform Architecture with Matthew Drooker appeared first on Software Engineering Daily.
GraphQL is an open-source query language for APIs and a runtime for executing those queries. It was developed by Facebook to address the problem of over-fetching or under-fetching data, which is a common issue with traditional REST APIs.
Matt Bessey is a Principal Engineer and Software Architect. Earlier this year Matt wrote a blog post titled “Why, after 6 years, I’m over GraphQL”. The post put words to many users’ frustrations with the technology, and it went viral on Hacker News.
Matt joins the show today to talk about GraphQL, the problems it solves, its security vulnerabilities, and why it might not be a good fit for backend engineering today.
You can find a link to Matt’s blog posts here.
Gregor Vand is a security-focused technologist, and is the founder and CTO of Mailpass. Previously, Gregor was a CTO across cybersecurity, cyber insurance and general software engineering companies. He has been based in Asia Pacific for almost a decade and can be found via his profile at vand.hk.
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post The End of GraphQL with Matt Bessey appeared first on Software Engineering Daily.
Asahi Linux is a project that aims to port Linux to Apple Silicon chips, which use a custom ARM-based architecture.
The project is fundamentally important given the popularity of Apple Silicon Macs, and it’s also a heroic effort because Apple Silicon is an entirely undocumented platform.
Alyssa Rosenzweig is a well-known computer scientist who describes herself as a graphics developer passionate about software freedom. She is currently a contractor at Valve where she develops open source software to improve Linux gaming. Alyssa is also a contributor to Asahi Linux and works on reverse-engineering the Apple M1 GPU, among other contributions to the project. Alyssa joins the podcast to talk about reverse engineering hardware, Asahi Linux, new advances in gaming on Asahi, and more.
Sean’s been an academic, startup founder, and Googler. He has published works covering a wide range of topics from information visualization to quantum computing. Currently, Sean is Head of Marketing and Developer Relations at Skyflow and host of the podcast Partially Redacted, a podcast about privacy and security engineering. You can connect with Sean on Twitter @seanfalconer.
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Linux on Apple Silicon with Alyssa Rosenzweig appeared first on Software Engineering Daily.
DOOM is a pioneering first-person shooter that needs no introduction.
The game was released in 1993 for DOS and was an instant success. This led to ports of the game to other major platforms including Windows, PlayStation, and Sega Saturn.
One of the most remarkable ports was to the Super Nintendo, with development being led by legendary engineer Randy Linden. In addition to his work on the SNES port of DOOM, Randy developed PlayStation and Dreamcast emulators, and worked at Microsoft on the Xbox 360 and Kinect.
Limited Run Games and Bethesda recently announced a new version of DOOM for SNES, that Randy also worked on. It has performance improvements, new features, and uses a new version of the SuperFX chip that can handle full-motion video.
Randy joins the show today to talk about his career, re-implementing video games, the new SNES DOOM port, and more.
Joe Nash is a developer, educator, and award-winning community builder, who has worked at companies including GitHub, Twilio, Unity, and PayPal. Joe got his start in software development by creating mods and running servers for Garry’s Mod, and game development remains his favorite way to experience and explore new technologies and concepts.
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post DOOM on Super Nintendo with Randy Linden appeared first on Software Engineering Daily.
Authentication is a key requirement for any B2B software application, especially if software vendors are selling to enterprise clients who are likely to have strict authentication requirements for the vendors they use. However, building authentication for a B2B application is typically complex and resource-intensive due to the data models required, the provisioning and managing accounts, and additional security and scale concerns.
Julianna Lamb is the Co-Founder and CTO of Stytch which is building an all-in-one platform for identity and access management. She joins the podcast with Gregor Vand to talk about the platform.
Gregor Vand is a security-focused technologist, and is the founder and CTO of Mailpass. Previously, Gregor was a CTO across cybersecurity, cyber insurance and general software engineering companies. He has been based in Asia Pacific for almost a decade and can be found via his profile at vand.hk.
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Identity and Access Management with Julianna Lamb appeared first on Software Engineering Daily.
J. P. Morgan Payments is one of the leaders in payments processing with a staggering $10 trillion in payments handled daily. The company recently released its Payments Developer Portal, or PDP, which serves as a gateway for developers to build and test payment APIs, and accept, manage, and send payments on their own platforms. Developing financial APIs at a global scale presents unique engineering challenges, in large part because there is no margin for error.
Jack Gibson is a Managing Director and Head of Payments Engineering, Architecture and APIs at J. P. Morgan Payments. He joins the podcast with Sean Falconer to explore the design and engineering behind the company’s payments API offering.
Sean’s been an academic, startup founder, and Googler. He has published works covering a wide range of topics from information visualization to quantum computing. Currently, Sean is Head of Marketing and Developer Relations at Skyflow and host of the podcast Partially Redacted, a podcast about privacy and security engineering. You can connect with Sean on Twitter @seanfalconer.
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Building Secure Payments Infrastructure with Jack Gibson appeared first on Software Engineering Daily.
MongoDB Atlas is a managed NoSQL database that uses JSON-like documents with optional schemas. The platform recently released new vector search capabilities to facilitate building AI capabilities.
Ben Flast is the Director of Product Management at MongoDB. He joins the show to talk about the company’s developments with vector search.
This episode is hosted by Lee Atchison. Lee Atchison is a software architect, author, and thought leader on cloud computing and application modernization. His best-selling book, Architecting for Scale (O’Reilly Media), is an essential resource for technical teams looking to maintain high availability and manage risk in their cloud environments.
Lee is the host of his podcast, Modern Digital Business, an engaging and informative podcast produced for people looking to build and grow their digital business with the help of modern applications and processes developed for today’s fast-moving business environment. Listen at mdb.fm. Follow Lee at softwarearchitectureinsights.com, and see all his content at leeatchison.com.
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post MongoDB Vector Search with Ben Flast appeared first on Software Engineering Daily.
Darío and Wiseguy are Nintendo 64 hackers and modders. They are the creators of multiple projects, including RT64 which is an N64 graphics renderer for enhancing games in emulators and native ports.
This year, they released N64: Recompiled, which is a tool to statically recompile N64 binaries into C code that can be compiled for any platform. The advance promises to usher in a revolution in N64 native ports for PC. To demonstrate the tool’s capability, it was used to produce a working copy of The Legend of Zelda: Majora’s Mask on PC.
Darío and Wiseguy join the podcast to talk about their journeys into the N64 hacking scene, the N64: Recompiled project, obscure N64 game bugs, and more.
Joe Nash is a developer, educator, and award-winning community builder, who has worked at companies including GitHub, Twilio, Unity, and PayPal. Joe got his start in software development by creating mods and running servers for Garry’s Mod, and game development remains his favorite way to experience and explore new technologies and concepts.
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post N64 Recompiled with Darío and Wiseguy appeared first on Software Engineering Daily.
The Stack Overflow Developer Survey is an annual survey conducted by Stack Overflow that gathers comprehensive insights from developers around the world. It offers a valuable snapshot of the global developer community, covering a wide range of topics such as preferred programming languages, tools, and technologies.
Erin Yepis is a Senior Analyst and Ryan Polk is the Chief Product Officer at Stack Overflow. They join the show with Sean Falconer to talk about the results of the 2024 Developer Survey, which just released this summer.
Sean’s been an academic, startup founder, and Googler. He has published works covering a wide range of topics from information visualization to quantum computing. Currently, Sean is Head of Marketing and Developer Relations at Skyflow and host of the podcast Partially Redacted, a podcast about privacy and security engineering. You can connect with Sean on Twitter @seanfalconer.
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post The 2024 Stack Overflow Developer Survey with Erin Yepis and Ryan Polk appeared first on Software Engineering Daily.
Software supply chain attacks exploit interdependencies within software ecosystems. Security in the supply chain is a growing issue, and is particularly important for companies that rely on large numbers of open source dependencies.
Chainguard was founded in 2021 and offers tools and secure container images to improve the security of the software supply chain.
Matt Moore is the Founder and CTO of Chainguard. He started his career in compiler optimization at Microsoft and worked at Google before starting Chainguard. He joins the show with Gregor Vand to talk about container security.
Gregor Vand is a security-focused technologist, and is the founder and CTO of Mailpass. Previously, Gregor was a CTO across cybersecurity, cyber insurance and general software engineering companies. He has been based in Asia Pacific for almost a decade and can be found via his profile at vand.hk.
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Container Security with Matt Moore appeared first on Software Engineering Daily.
The Google Maps Platform JavaScript API is a fundamental web technology that’s used to build dynamic and interactive map features in web apps.
Matt Toon is a Solutions Engineering Manager for the Google Maps Platform. He joins the podcast with Josh Goldberg to talk about his background working with geospatial data, the development of Google Maps Platform, bringing 3D Maps to the JavaScript API, and much more.Josh Goldberg is an independent full time open source developer in the TypeScript ecosystem. He works on projects that help developers write better TypeScript more easily, most notably on typescript-eslint: the tooling that enables ESLint and Prettier to run on TypeScript code. Josh regularly contributes to open source projects in the ecosystem such as ESLint and TypeScript. Josh is a Microsoft MVP for developer technologies and the author of the acclaimed Learning TypeScript (O’Reilly), a cherished resource for any developer seeking to learn TypeScript without any prior experience outside of JavaScript. Josh regularly presents talks and workshops at bootcamps, conferences, and meetups to share knowledge on TypeScript, static analysis, open source, and general frontend and web development.
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Google Maps Javascript API with Matt Toon appeared first on Software Engineering Daily.
LLMs are becoming more mature and accessible, and many teams are now integrating them into common business practices such as technical support bots, online real-time help, and other knowledge-base-related tasks. However, the high cost of maintaining AI teams and operating AI pipelines is becoming apparent.
Maxime Armstrong and Yuhan Luo are Software Engineers at Dagster, which is an open source platform for orchestrating data and AI pipelines. They join the show with Sean Falconer to talk about running cost-effective AI pipelines.
Sean’s been an academic, startup founder, and Googler. He has published works covering a wide range of topics from information visualization to quantum computing. Currently, Sean is Head of Marketing and Developer Relations at Skyflow and host of the podcast Partially Redacted, a podcast about privacy and security engineering. You can connect with Sean on Twitter @seanfalconer.
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post AI Pipelines with Maxime Armstrong and Yuhan Luo appeared first on Software Engineering Daily.
Data is at the center of many business decisions and advances today, including AI-driven capabilities. This requires companies to have well-governed data that is easy for users to find, use and understand. In moving to the cloud, Capital One modernized its data ecosystem and adopted a “You Build, Your Data” model to equip its data stakeholders with self-service capabilities to use and build data applications.
Jim Lebonitte is a Senior Distinguished Engineer at Capital One leading technical architecture and strategy for enterprise data platforms. He has over 15 years of experience building platforms focused on data and software delivery experiences. Jim joins the podcast to talk about how to empower data users at scale while keeping data well-governed, building data pipelines and applications, and much more.
Full Disclosure: This episode is sponsored by Capital One**.
This episode is hosted by Lee Atchison. Lee Atchison is a software architect, author, and thought leader on cloud computing and application modernization. His best-selling book, Architecting for Scale (O’Reilly Media), is an essential resource for technical teams looking to maintain high availability and manage risk in their cloud environments.
Lee is the host of his podcast, Modern Digital Business, an engaging and informative podcast produced for people looking to build and grow their digital business with the help of modern applications and processes developed for today’s fast-moving business environment. Listen at mdb.fm. Follow Lee at softwarearchitectureinsights.com, and see all his content at leeatchison.com.
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Data Management at Capital One with Jim Lebonitte appeared first on Software Engineering Daily.
ESLint is a static code analysis tool for identifying and fixing problems in JavaScript code. It helps developers maintain code quality and consistency by enforcing coding standards and detecting issues such as syntax errors, stylistic problems, and bugs.
Nicholas Zakas is the creator of ESLint. He joins the show to talk about working at Yahoo in the early days of the web, learning from JSLint, creating ESLint, separation of parsing and rules, and more.
Josh Goldberg is an independent full time open source developer in the TypeScript ecosystem. He works on projects that help developers write better TypeScript more easily, most notably on typescript-eslint: the tooling that enables ESLint and Prettier to run on TypeScript code. Josh regularly contributes to open source projects in the ecosystem such as ESLint and TypeScript. Josh is a Microsoft MVP for developer technologies and the author of the acclaimed Learning TypeScript (O’Reilly), a cherished resource for any developer seeking to learn TypeScript without any prior experience outside of JavaScript. Josh regularly presents talks and workshops at bootcamps, conferences, and meetups to share knowledge on TypeScript, static analysis, open source, and general frontend and web development.
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Creating ESLint with Nicholas Zakas appeared first on Software Engineering Daily.
The Humane pin is a multi-modal wearable device designed by Humane Inc., a startup co-founded by former Apple employees Imran Chaudhri and Bethany Bongiorno. This wearable is part of a broader vision to create more seamless and integrated interactions between humans and technology, moving away from traditional screens.
George Kedenburg III is a Software Designer at Humane, and Josh Dickens is a Software and Product Designer at Humane. They join the podcast with Sean Falconer to talk about Humane and the technology the company is developing.
Sean’s been an academic, startup founder, and Googler. He has published works covering a wide range of topics from information visualization to quantum computing. Currently, Sean is Head of Marketing and Developer Relations at Skyflow and host of the podcast Partially Redacted, a podcast about privacy and security engineering. You can connect with Sean on Twitter @seanfalconer.
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Humane with George Kedenburg III and Josh Dickens appeared first on Software Engineering Daily.
In the modern enterprise, high-performance applications require a solid foundation that can handle complex, high-volume, real-time data. VMware Tanzu GemFire is an in-memory data grid (IMDG) designed to deliver the speed, low latency, and scalability needed for such applications. Though it has been in use for decades, GemFire is experiencing a resurgence, as it was purpose-built for the challenges of real-time data processing and management.
A Wall Street HeritageGemFire’s roots trace back to the early 2000s, when Wall Street traders needed software capable of propagating real-time trading floor data—where every millisecond counts. “Wall Street traders were looking to build software that could propagate real-time trading floor data where every millisecond counts,” explains Ivan Novick, Product Manager for Data Products at the Tanzu Division of Broadcom.
Developing such intricate solutions can be prohibitively complex for independent software vendors. GemFire emerged as a platform for application development rather than a traditional turnkey business application, addressing limitations found in legacy systems. In many ways, it was ahead of its time—built to tackle the challenges of real-time information delivery across the enterprise.
Moving Beyond Two-Tier ArchitecturesHistorically, enterprises relied on two-tier database architectures to manage data. However, as workload demands increased, these systems struggled to meet real-time, low-latency requirements. The need to synchronize data across multiple databases and applications created significant bottlenecks. As information volumes grew beyond the capacity of single databases, synchronization issues became more pronounced.
GemFire, however, was designed with these challenges in mind. It excels in handling unstructured data like text, images, and video. Through vector embedding, GemFire transforms this data into multi-dimensional mathematical graphs, grouping similar items together for efficient access and analysis.
Key Features of GemFireGemFire offers a range of powerful features that make it ideal for real-time applications:
- Sub-millisecond response times
- In-memory data and compute grid
- Single source of truth across distributed systems
- Ultra-high speed
- Scalability on demand
One common issue with systems that manage complex data across multiple nodes is the risk of inconsistencies when multiple writers and readers are involved. GemFire mitigates this with active-active, multi-site Wide Area Network (WAN) replication. Whether a business operates in New York, London, or Tokyo, GemFire ensures data is synchronized and up-to-date across all locations. “On our grid, data is synchronized and always up-to-date; the system updates information millions of times a second,” says Novick.
Where Should Tanzu GemFire be Deployed?GemFire is particularly well-suited for organizations with demanding IT workloads—those for whom off-the-shelf software is insufficient. These companies need custom-built solutions capable of processing vast amounts of data in real-time.
For example, consider a large airline managing millions of passengers at an airport like LAX. They need to track ticket sales, check-ins, seating arrangements, loyalty programs, flight schedules, and aircraft locations. Each component interacts with multiple websites, applications, and devices. GemFire’s architecture enables them to manage and synchronize all these moving parts seamlessly.
Financial Services and Government ApplicationsFinancial services and government sectors are experiencing significant growth in the adoption of GemFire. These industries require real-time, event-driven systems for complex calculations and rapid decision-making.
A large bank may process billions of dollars in transactions every day. They need to assess the movement of funds in real-time, detect potential fraud within seconds, and run statistical analyses on historical data to make informed decisions. GemFire’s real-time capabilities allow financial institutions to manage these processes effectively.
Expanding to Industrial and Edge ComputingAs edge computing gains traction, GemFire is finding a home in industrial applications. Edge computing reduces the load on central servers by processing data closer to the source, lowering WAN infrastructure overhead and costs.
Companies are deploying small clusters of two to four nodes at the edge to perform custom processing for industrial tasks. These clusters require high availability, parallelism, and replication, all of which GemFire provides. As deployments scale, GemFire ensures that transactions are accurately synchronized across hundreds of systems.
A Platform Poised for GrowthGemFire’s evolution from a custom-built IMDG tool for financial services into a sophisticated real-time platform has positioned it as a leader in modern application development. With its vector database and real-time processing capabilities, GemFire continues to attract interest across industries and is ideal for handling emerging AI needs. As organizations look to build more complex, real-time solutions—especially at the edge—GemFire’s role will only continue to grow.
The post VMware Tanzu GemFire and Next-Generation Real-Time Application Development appeared first on Software Engineering Daily.
Online transaction processing, or OLTP, is designed for managing high volumes of short, fast, and concurrent transactions, such as data entry and retrieval operations. OLTP systems solve the problem of efficiently handling numerous simultaneous transactions, making them essential for sectors like banking and retail.
Joran Greef is the Founder and CEO of TigerBeetle, which is developing an open-source financial transactions database focused on mission critical safety and performance. He joins the podcast to talk about the TigerBeetle’s technology and problems it solves.
Gregor Vand is a security-focused technologist, and is the founder and CTO of Mailpass. Previously, Gregor was a CTO across cybersecurity, cyber insurance and general software engineering companies. He has been based in Asia Pacific for almost a decade and can be found via his profile at vand.hk.
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Building a Fast Financial Transactions Database with Joran Greef appeared first on Software Engineering Daily.
Mozilla Firefox is an open-source web browser developed by the Mozilla Foundation. Since its first major release in 2004, it has stood out on the browser landscape for its emphasis on privacy, security, and customization.
Brian Grinstead is a Senior Principal Engineer at Mozilla. He joins the podcast with Kevin Ball to talk about the Firefox architecture, the recent UI refactor, web performance, the role of Rust in the browser, and more.
Kevin Ball or KBall, is the vice president of engineering at Mento and an independent coach for engineers and engineering leaders. He co-founded and served as CTO for two companies, founded the San Diego JavaScript meetup, and organizes the AI inaction discussion group through Latent Space.
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Firefox Software Architecture with Brian Grinstead appeared first on Software Engineering Daily.
Google needs no introduction, and is renowned for its data and analytics capabilities.
Gerrit Kazmaier is the VP and GM for Database, Data Analytics and Looker at Google. He has a long history in the space, and in this episode he speaks with Sean Falconer about data and analytics in the AI era.
Sean’s been an academic, startup founder, and Googler. He has published works covering a wide range of topics from information visualization to quantum computing. Currently, Sean is Head of Marketing and Developer Relations at Skyflow and host of the podcast Partially Redacted, a podcast about privacy and security engineering. You can connect with Sean on Twitter @seanfalconer.
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post AI Data Analytics at Google with Gerrit Kazmaier appeared first on Software Engineering Daily.
DevOps is a powerful model for managing the building and operational aspects of modern applications. Most developers are now familiar with DevOps, and the adoption of DevOps practices is widespread and growing.
Adam Jacob was the original author of Chef, a popular early DevOps tool. He’s now the CEO of System Initiative, which develops an open-source collaborative tool designed to remove the many pain points from DevOps work.
Adam joins the show to talk about the history of DevOps, current strategies in DevOps, System Initiative’s collaborative platform, and more.
This episode is hosted by Lee Atchison. Lee Atchison is a software architect, author, and thought leader on cloud computing and application modernization. His best-selling book, Architecting for Scale (O’Reilly Media), is an essential resource for technical teams looking to maintain high availability and manage risk in their cloud environments.
Lee is the host of his podcast, Modern Digital Business, an engaging and informative podcast produced for people looking to build and grow their digital business with the help of modern applications and processes developed for today’s fast-moving business environment. Listen at mdb.fm. Follow Lee at softwarearchitectureinsights.com, and see all his content at leeatchison.com.
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Building a Collaborative DevOps Platform with Adam Jacob appeared first on Software Engineering Daily.
React is an open-source front-end JavaScript library maintained by Meta. It was first released in 2013 and is now the most popular web framework.
Ilya Gurevich is a Senior Software Engineer at The New York Times. Last winter, his team set out to implement React 18 for The Times’ flagship core news site. Ilya recently wrote a viral blog post about this decision, and how the team tackled some of the engineering challenges along the way.
Today he joins the podcast with Gregor Vand to talk about adopting React 18 to enhance the performance of the The New York Times website.
Gregor Vand is a security-focused technologist, and is the founder and CTO of Mailpass. Previously, Gregor was a CTO across cybersecurity, cyber insurance and general software engineering companies. He has been based in Asia Pacific for almost a decade and can be found via his profile at vand.hk.
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post React 18 at The New York Times with Ilya Gurevich appeared first on Software Engineering Daily.
Feature flagging tools have grown in popularity as a way to decouple releases and deployment, but they can introduce their own long-term problems and tech debt.
Lekko is a startup democratizing the practice of dynamic configuration. Their motivating idea is to empower engineers to focus on software releases, and business teams and other stakeholders to shape deployment.
Konrad Niemiec is the Founder and CEO at Lekko. He previously worked at Uber where an internal tool called Flipr enabled dynamic configuration management, and which today serves as a key design inspiration for Lekko. Konrad joins the show with Sean Falconer to talk about his company and the technology they’re developing.
Full Disclosure: This episode is sponsored by 10K Media**.
Sean’s been an academic, startup founder, and Googler. He has published works covering a wide range of topics from information visualization to quantum computing. Currently, Sean is Head of Marketing and Developer Relations at Skyflow and host of the podcast Partially Redacted, a podcast about privacy and security engineering. You can connect with Sean on Twitter @seanfalconer.
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Lekko and Dynamic Configuration with Konrad Niemiec appeared first on Software Engineering Daily.
Harold Halibut is a 2024 narrative adventure video game developed by German developer Slow Bros.
The game has a distinct look owing to its use of stop motion animation with 3D scans of physical sets and puppets.
Onat Hekimoglu worked on Harold Halibut as the Director, Game Designer, Composer, and Person of Many Hats. He joins the podcast with Joe Nash to share the story and technical details of how he and his team developed their unique game.
Joe Nash is a developer, educator, and award-winning community builder, who has worked at companies including GitHub, Twilio, Unity, and PayPal. Joe got his start in software development by creating mods and running servers for Garry’s Mod, and game development remains his favorite way to experience and explore new technologies and concepts.
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Crafting a Stop Motion Video Game with Onat Hekimoglu appeared first on Software Engineering Daily.
Stack Overflow is a legendary question-and-answer site for programmers, and is likely well known to most SEDaily listeners.
Svelte is an open-source front-end framework that was released in 2016 and continues to grow rapidly in popularity.
Giamir Buoncristiani is a Staff Software Engineer at Stack Overflow. He is also the tech lead for the Stacks design system. Giamir joins the podcast to talk about modernizing Stack Overflow’s front-end user interface and why the team has embraced Svelte.
Gregor Vand is a security-focused technologist, and is the founder and CTO of Mailpass. Previously, Gregor was a CTO across cybersecurity, cyber insurance and general software engineering companies. He has been based in Asia Pacific for almost a decade and can be found via his profile at vand.hk.
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Why Stack Overflow Uses Svelte with Giamir Buoncristiani appeared first on Software Engineering Daily.
The Google Sheets calculation engine was originally written in Java and launched in 2006. In the early days of the product, all calculation happened on the server. However, starting in 2013 the engine has run in the browser using JavaScript.
Google Sheets is now one of the first products at Google to use WebAssembly Garbage Collection, or WasmGC, on Chrome.
Michael Thomas is the Multiplatform Lead for Google Workspace and Thomas Steiner is a Developer Relations Engineer at Google. They join the podcast to tell the story of why and how Google Sheets ported its calculation worker from JavaScript to WasmGC.
Sean’s been an academic, startup founder, and Googler. He has published works covering a wide range of topics from information visualization to quantum computing. Currently, Sean is Head of Marketing and Developer Relations at Skyflow and host of the podcast Partially Redacted, a podcast about privacy and security engineering. You can connect with Sean on Twitter @seanfalconer.
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post How Google Sheets Uses WasmGC with Michael Thomas and Thomas Steiner appeared first on Software Engineering Daily.
Large datasets require large computational resources to process that data. More frequently, where you process that data geographically can be just as important as how you process it.
Expanso provides job execution infrastructure that runs jobs where data resides, to help reduce latency and improve security and data governance.
David Aronchick is the CEO of Expanso. He previously worked at Google on the Kubernetes team, which influenced his decision to start Expanso. David joins the show to talk about his company.
This episode is hosted by Lee Atchison. Lee Atchison is a software architect, author, and thought leader on cloud computing and application modernization. His best-selling book, Architecting for Scale (O’Reilly Media), is an essential resource for technical teams looking to maintain high availability and manage risk in their cloud environments.
Lee is the host of his podcast, Modern Digital Business, an engaging and informative podcast produced for people looking to build and grow their digital business with the help of modern applications and processes developed for today’s fast-moving business environment. Listen at mdb.fm. Follow Lee at softwarearchitectureinsights.com, and see all his content at leeatchison.com.
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Containers at the Edge with David Aronchick appeared first on Software Engineering Daily.
Douglas Crockford is an American computer programmer who is involved in the development of the JavaScript language. He specified the JSON data format, and has developed various JavaScript related tools such as the static code analyzer JSLint. Crockford is also a game developer and worked at Atari.
Douglas joins the podcast to talk about his career and work in computer science.
Josh Goldberg is an independent full time open source developer in the TypeScript ecosystem. He works on projects that help developers write better TypeScript more easily, most notably on typescript-eslint: the tooling that enables ESLint and Prettier to run on TypeScript code. Josh regularly contributes to open source projects in the ecosystem such as ESLint and TypeScript. Josh is a Microsoft MVP for developer technologies and the author of the acclaimed Learning TypeScript (O’Reilly), a cherished resource for any developer seeking to learn TypeScript without any prior experience outside of JavaScript. Josh regularly presents talks and workshops at bootcamps, conferences, and meetups to share knowledge on TypeScript, static analysis, open source, and general frontend and web development.
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Evolving JavaScript with Douglas Crockford appeared first on Software Engineering Daily.
Damien Filiatrault is the founder and CEO of Scalable Path, a software staffing agency that matches companies and startups with vetted, remote software developers. The company was founded in 2010, and since then has worked on hundreds of client projects and has built a freelance network with 35,000 remote developers in 177 countries.
Damien joins the podcast to talk about software engineering management, the state of the software engineering job market, the challenge of hiring engineers, measuring productivity, and more.
Full Disclosure: This episode is sponsored by Scalable Path**.
Sean’s been an academic, startup founder, and Googler. He has published works covering a wide range of topics from information visualization to quantum computing. Currently, Sean is Head of Marketing and Developer Relations at Skyflow and host of the podcast Partially Redacted, a podcast about privacy and security engineering. You can connect with Sean on Twitter @seanfalconer.
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Developer Productivity with Damien Filiatrault appeared first on Software Engineering Daily.
Tanzu GemFire is a distributed, in-memory, key-value store that performs read and write operations at fast speeds. It offers highly available parallel message queues, continuous availability, and a scalable event-driven architecture. It was developed to have sub-millisecond response times and accordingly found early application in automated trading environments on Wall Street.
Ivan Novick is the Product Manager for GemFire at the Tanzu Division of Broadcom. He joins the show to talk about Tanzu GemFire and its applications.
Full Disclosure: This episode is sponsored by VMware**
This episode is hosted by Lee Atchison. Lee Atchison is a software architect, author, and thought leader on cloud computing and application modernization. His best-selling book, Architecting for Scale (O’Reilly Media), is an essential resource for technical teams looking to maintain high availability and manage risk in their cloud environments.
Lee is the host of his podcast, Modern Digital Business, an engaging and informative podcast produced for people looking to build and grow their digital business with the help of modern applications and processes developed for today’s fast-moving business environment. Listen at mdb.fm. Follow Lee at softwarearchitectureinsights.com, and see all his content at leeatchison.com.
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post GemFire with Ivan Novick appeared first on Software Engineering Daily.
In 2022, Stefan Li and Stew Fortier envisioned a document editor with language model features built in. They founded Type.ai, received backing from Y Combinator, and have since been at the frontier of building a next-generation document editor. However, to ensure a robust and performant frontend, Type.ai needed to take advantage of many modern browser features.
Stefan Li is the CTO of Type.ai, and he joins the show to talk about the state of frontend dev, the service worker API, IndexedDB, the SharedWorker interface, Web Locks, and more.
Gregor Vand is a security-focused technologist, and is the founder and CTO of Mailpass. Previously, Gregor was a CTO across cybersecurity, cyber insurance and general software engineering companies. He has been based in Asia Pacific for almost a decade and can be found via his profile at vand.hk.
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Modern Frontend Engineering with Stefan Li appeared first on Software Engineering Daily.
A major challenge in applied AI is out-of-distribution detection, or OOD, which is the task of detecting instances that do not belong to the distribution the classifier has been trained on. OOD data is often referred to as “unseen” data, as the model has not encountered it during training.
Bayan Bruss is the VP of AI Foundations at Capital One and in this role he works with academic researchers to translate the latest research to address fundamental problems in financial services. Bayan joins the show with Sean Falconer to talk about OOD, the importance of bringing AI research to real world applications, and more.
Full Disclosure: This episode is sponsored by Capital One**
Sean’s been an academic, startup founder, and Googler. He has published works covering a wide range of topics from information visualization to quantum computing. Currently, Sean is Head of Marketing and Developer Relations at Skyflow and host of the podcast Partially Redacted, a podcast about privacy and security engineering. You can connect with Sean on Twitter @seanfalconer.
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post AI Research at Capital One with Bayan Bruss appeared first on Software Engineering Daily.
DuckDB is an open-source column-oriented relational database that was first released in 2019. It’s designed to provide high performance on complex queries against large databases, and focuses on online analytical processing workloads.
Hannes Mühleisen is the Co-Creator of DuckBD, and is the CEO and Co-Founder of DuckDB Labs. He joins the show to talk about drawing inspiration from SQLite, why DuckDB was written in C++, the novel data processing scenarios it enables, and more.
This episode is hosted by Lee Atchison. Lee Atchison is a software architect, author, and thought leader on cloud computing and application modernization. His best-selling book, Architecting for Scale (O’Reilly Media), is an essential resource for technical teams looking to maintain high availability and manage risk in their cloud environments.
Lee is the host of his podcast, Modern Digital Business, an engaging and informative podcast produced for people looking to build and grow their digital business with the help of modern applications and processes developed for today’s fast-moving business environment. Listen at mdb.fm. Follow Lee at softwarearchitectureinsights.com, and see all his content at leeatchison.com.
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post DuckDB with Hannes Mühleisen appeared first on Software Engineering Daily.
Rerun is an open source SDK and viewer for visualizing and interacting with multimodal data streams. The SDK lets you send data from anywhere, and the viewer collects the data and aligns it so the user can scroll back and forth in time to interpret it. The tools have been applied in spatial computing, augmented reality, virtual reality, and mixed reality.
Emil Ernerfeldt is the Co-Founder and CTO of Rerun. Emil is also the creator of egui which is a popular GUI library written in Rust. He joins the podcast to talk about his history in game development, building super fast tools, and developing Rerun.
Gregor Vand is a security-focused technologist, and is the founder and CTO of Mailpass. Previously, Gregor was a CTO across cybersecurity, cyber insurance and general software engineering companies. He has been based in Asia Pacific for almost a decade and can be found via his profile at vand.hk.
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Creating GUIs in Rust with Emil Ernerfeldt appeared first on Software Engineering Daily.
Chroma is an open-source AI application database.
Anton Troynikov is a Founder at Chroma. He has a background in computer vision and previously worked at Meta. In this episode Anton speaks with Sean Falconer about Chroma, and the goal of building the memory and storage subsystem for the new computing primitive that AI models represent.
Sean’s been an academic, startup founder, and Googler. He has published works covering a wide range of topics from information visualization to quantum computing. Currently, Sean is Head of Marketing and Developer Relations at Skyflow and host of the podcast Partially Redacted, a podcast about privacy and security engineering. You can connect with Sean on Twitter @seanfalconer.
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Chroma’s Vector Database with Anton Troynikov appeared first on Software Engineering Daily.
In 79 AD, in the ancient Roman town of Herculaneum, twenty meters of hot mud and ash buried an enormous villa once owned by the father-in-law of Julius Caesar. Inside, there was a vast library of papyrus scrolls.
The scrolls were carbonized by the heat of the volcanic debris, but they were trapped underground where they remained preserved.
It wasn’t until the 1750s that the scrolls were discovered, but they were fragile and resistant to being opened and read.
Then, in 2015, researchers used X-ray tomography and computer vision to virtually unwrap the scrolls.
Last year, the Vesuvius Challenge was launched by Nat Friedman, Daniel Gross, and Brent Seales to crowdsource the process of reconstructing the text from the scrolls.
Juli Schilliger and Youssef Nader are two members from the winning team. They join the show to talk about the computational approaches they used to reconstruct the scroll text.
For interested listeners, the 2024 Vesuvius Challenge is now live, with new challenges and prizes. Check out ScrollPrize.org to learn more.
Jordi Mon Companys is a product manager and marketer that specializes in software delivery, developer experience, cloud native and open source. He has developed his career at companies like GitLab, Weaveworks, Harness and other platform and devtool providers. His interests range from software supply chain security to open source innovation. You can reach out to him on Twitter at @jordimonpmm
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post The Vesuvius Challenge with Juli Schilliger and Youssef Nader appeared first on Software Engineering Daily.
Traditionally, security checks and testing are performed towards the end of the software development lifecycle. However, discovering vulnerabilities at that stage can be costly and time-consuming.
This observation has led to the shift-left movement, which advocates for implementing security testing earlier in the software development process.
HoundDog AI is a startup focused on software to enable shift-left security practices. Amjad Afanah and Sudipta Mukherjee are Co-Founders of HoundDog, and they join the show to talk about their company.
Gregor Vand is a security-focused technologist, and is the founder and CTO of Mailpass. Previously, Gregor was a CTO across cybersecurity, cyber insurance and general software engineering companies. He has been based in Asia Pacific for almost a decade and can be found via his profile at vand.hk.
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Shift-Left Security and Code Scanning with Amjad Afanah and Sudipta Mukherjee appeared first on Software Engineering Daily.
Uber handles billions of trips and deliveries, and tens of billions of financial transactions across earners, spenders, and merchants every quarter.
LedgerStore is an immutable storage solution at Uber that provides verifiable data completeness and correctness guarantees to ensure data integrity for its transactions.
Kaushik Devarajaiah is the Tech Lead for LedgerStore at Uber. He joins the show to talk about scaling Uber’s data infrastructure.
Sean’s been an academic, startup founder, and Googler. He has published works covering a wide range of topics from information visualization to quantum computing. Currently, Sean is Head of Marketing and Developer Relations at Skyflow and host of the podcast Partially Redacted, a podcast about privacy and security engineering. You can connect with Sean on Twitter @seanfalconer.
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Uber’s LedgerStore and its Trillions of Indexes with Kaushik Devarajaiah appeared first on Software Engineering Daily.
One of the fastest areas of growth in observability is frontend observability, or real user monitoring. This is the practice of monitoring and analyzing the performance, behavior, and user experience of web applications from the user’s perspective.
Purvi Kanal is a Senior Software Engineer at Honeycomb. She joins the podcast to talk about the evolution and status of real user monitoring.
This episode is hosted by Lee Atchison. Lee Atchison is a software architect, author, and thought leader on cloud computing and application modernization. His best-selling book, Architecting for Scale (O’Reilly Media), is an essential resource for technical teams looking to maintain high availability and manage risk in their cloud environments.
Lee is the host of his podcast, Modern Digital Business, an engaging and informative podcast produced for people looking to build and grow their digital business with the help of modern applications and processes developed for today’s fast-moving business environment. Listen at mdb.fm. Follow Lee at softwarearchitectureinsights.com, and see all his content at leeatchison.com.
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Frontend Observability with Purvi Kanal appeared first on Software Engineering Daily.
Inworld is a company that provides tools for game studios to add AI-driven gameplay. They are at the leading edge of using generative AI in game development, and have worked with companies such as Xbox, Ubisoft, and NVIDIA.
Igor Poletaev is the VP of AI and Nathan Yu is the Director of Product and GM of Labs at Inward. They join the show to talk about using AI in game development.
Gregor Vand is a security-focused technologist, and is the founder and CTO of Mailpass. Previously, Gregor was a CTO across cybersecurity, cyber insurance and general software engineering companies. He has been based in Asia Pacific for almost a decade and can be found via his profile at vand.hk.
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post AI Tools for Game Development with Igor Poletaev and Nathan Yu appeared first on Software Engineering Daily.
Static analysis is the examination of code without executing the program. It’s used to identify potential errors, code quality issues, security vulnerabilities, and adherence to coding best practices.
Abbas Sabra is a Principal Engineer at Sonar, which creates tools to help developers produce clean code. Abbas specializes in C++ static analysis, and began his career in the financial industry, where he identified inefficiencies within the C++ tooling ecosystem. He joins the show to talk about static analysis and static analysis tool development.
Sean’s been an academic, startup founder, and Googler. He has published works covering a wide range of topics from information visualization to quantum computing. Currently, Sean is Head of Marketing and Developer Relations at Skyflow and host of the podcast Partially Redacted, a podcast about privacy and security engineering. You can connect with Sean on Twitter @seanfalconer.
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post C++ Static Analysis with Abbas Sabra appeared first on Software Engineering Daily.
Bison Ventures invests in frontier technology companies that use innovative science and deep technology. A key pillar of their investment portfolio is climate technology.
Tom Biegala is a co-founder of Bison Ventures. Prior to starting Bison Ventures, Tom worked at Cascade Asset Management Company, the investment office that manages the assets of the Bill & Melinda Gates Foundation Trust and Gates family. He joins the show to talk about why he started Bison, the climate tech startup landscape, and much more.
This episode is hosted by Lee Atchison. Lee Atchison is a software architect, author, and thought leader on cloud computing and application modernization. His best-selling book, Architecting for Scale (O’Reilly Media), is an essential resource for technical teams looking to maintain high availability and manage risk in their cloud environments.
Lee is the host of his podcast, Modern Digital Business, an engaging and informative podcast produced for people looking to build and grow their digital business with the help of modern applications and processes developed for today’s fast-moving business environment. Listen at mdb.fm. Follow Lee at softwarearchitectureinsights.com, and see all his content at leeatchison.com.
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Climate Tech Investing with Tom Biegala appeared first on Software Engineering Daily.
Luma AI develops technologies at the forefront of AI and graphics. They created a text-to-3D tool that functions like Midjourney but for generating 3D models. Another tool makes photorealistic environments by reconstructing any scene in 3D from just a few photos.
Karan Ganesan is a Software Engineer and Barkley Dai is the Product and Growth Lead at Luma AI. They join the show to talk about the origin of the company and the technologies it uses.
Gregor Vand is a security-focused technologist, and is the founder and CTO of Mailpass. Previously, Gregor was a CTO across cybersecurity, cyber insurance and general software engineering companies. He has been based in Asia Pacific for almost a decade and can be found via his profile at vand.hk.
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Luma AI with Barkley Dai and Karan Ganesan appeared first on Software Engineering Daily.
Redis is an in-memory database that can be used for caching, vector search, and as a message broker.
Brian Sam-Bodden is a Senior Applied AI Engineer at Redis. He joins the show to talk about his work and AI at the company.
Sean’s been an academic, startup founder, and Googler. He has published works covering a wide range of topics from information visualization to quantum computing. Currently, Sean is Head of Marketing and Developer Relations at Skyflow and host of the podcast Partially Redacted, a podcast about privacy and security engineering. You can connect with Sean on Twitter @seanfalconer.
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post AI at Redis with Brian Sam-Bodden appeared first on Software Engineering Daily.
David Szymanski is a video game developer focused on short retro horror games. He created the hit FPS Dusk, along with Iron Lung, Chop Goblins, and the upcoming Butcher’s Creek. He’s also involved in the production of the upcoming Iron Lung film.
David joins the podcast to talk about his work, how to capture an appealing retro game feel, why he makes short games, developing in Unity, looking beyond Unity, and more.
Joe Nash is a developer, educator, and award-winning community builder, who has worked at companies including GitHub, Twilio, Unity, and PayPal. Joe got his start in software development by creating mods and running servers for Garry’s Mod, and game development remains his favorite way to experience and explore new technologies and concepts.
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Dusk and the Art of Making Short Games with David Szymanski appeared first on Software Engineering Daily.
Retool is a platform to help engineers quickly build internal frontends. It does this by abstracting away repetitive aspects of frontend development. The platform was started in 2017 and has received funding from Sequoia, Stripe Co-Founders, and Nat Friedman.
David Hsu is the founder and CEO of Retool. He joins the show to talk about why he started coding, studying philosophy and computer science, Retool’s tech stack, and more.
Paweł is the founder at flat.social the world’s first ‘flatverse’ start-up and glot.space, an AI-powered language learning app. Pawel’s background is as a full-stack software engineer with a lean and experimental approach towards product development. With a strong grounding in computing science, he spent the last decade getting early-stage products off the ground – both in startup and corporate settings. Follow Paweł on Twitter, LinkedIn and his personal website – pawel.io.
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Fast Frontend Development with David Hsu appeared first on Software Engineering Daily.
ChatGPT has been out for more than a year and has since become the centerpiece of intense discussion and debate about AI.
Christian Hubicki is a renowned robotics research scientist and an Assistant Professor of Mechanical Engineering at Florida State University. In 2023, he was a guest on Software Engineering Daily, where he discussed ChatGPT and its implications with Sean Falconer. Christian now joins Sean again to check in about the state of AI and its future directions.
Sean’s been an academic, startup founder, and Googler. He has published works covering a wide range of topics from information visualization to quantum computing. Currently, Sean is Head of Marketing and Developer Relations at Skyflow and host of the podcast Partially Redacted, a podcast about privacy and security engineering. You can connect with Sean on Twitter @seanfalconer.
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post One Year of ChatGPT with Christian Hubicki appeared first on Software Engineering Daily.
Databases underpin almost every user experience on the web, but scaling a database is one of the most fundamental infrastructure challenges in software development. PlanetScale offers a MySQL platform that is managed and highly scaleable.
Sam Lambert is the CEO of PlanetScale and he joins the show to talk about why he started the platform, scaling databases, using Vitess for SQL shard orchestration, and more.
This episode is hosted by Lee Atchison. Lee Atchison is a software architect, author, and thought leader on cloud computing and application modernization. His best-selling book, Architecting for Scale (O’Reilly Media), is an essential resource for technical teams looking to maintain high availability and manage risk in their cloud environments.
Lee is the host of his podcast, Modern Digital Business, an engaging and informative podcast produced for people looking to build and grow their digital business with the help of modern applications and processes developed for today’s fast-moving business environment. Listen at mdb.fm. Follow Lee at softwarearchitectureinsights.com, and see all his content at leeatchison.com.
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Hyperscaling SQL with Sam Lambert appeared first on Software Engineering Daily.
GV, or Google Ventures, is an independent venture capital firm backed by Alphabet.
Erik Norlander is a General Partner at GV and invests across enterprise software and frontier technology, focusing on developer tools, cloud infrastructure and machine learning. He has backed companies like Cockroach, Warp and Neo4j. Prior to joining GV in 2010 and opening up the firm’s New York City office, Erik was at Google and led development of the company’s next-gen display and serving system, and built statistical and machine learning models for Google’s ad businesses.
Erik joins the podcast to talk about his work.
Gregor Vand is a security-focused technologist, and is the founder and CTO of Mailpass. Previously, Gregor was a CTO across cybersecurity, cyber insurance and general software engineering companies. He has been based in Asia Pacific for almost a decade and can be found via his profile at vand.hk.
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Google Ventures with Erik Norlander appeared first on Software Engineering Daily.
A common challenge for developers of SaaS products is integrating with existing services, including services that customers might already be using. For example, a SaaS product might need to integrate with customers using Salesforce, HubSpot, or another CRM system. However, this can be demanding for developers when 3rd party APIs are poorly documented or inconsistent.
Lauren Long is a co-founder at Ampersand which is a developer platform for SaaS integrations. She joins the show to talk about smoothing out API connectivity to make SaaS interoperable.
Sean’s been an academic, startup founder, and Googler. He has published works covering a wide range of topics from information visualization to quantum computing. Currently, Sean is Head of Marketing and Developer Relations at Skyflow and host of the podcast Partially Redacted, a podcast about privacy and security engineering. You can connect with Sean on Twitter @seanfalconer.
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post The Challenge of API Integration with Lauren Long appeared first on Software Engineering Daily.
A headless software architecture decouples the frontend, or the “head”, from the backend. This separation allows developers to manage the UI layer independently of the backend logic and data management.
Hydrogen is Shopify’s open-source headless framework for building custom storefronts. It’s React-based and is focused on performance and flexible UI components.
Ben Sehl is a Senior Product Lead at Shopify where he works on Hydrogen and the storefront developer experience. He joins the show to talk about his engineering background, the motivation for creating Hydrogen, Hydrogen versus the Liquid templating language, and much more.
Be sure to check out the 2024 Shopify Editions Dev Newsroom and Brochure.
Full Disclosure: This episode is sponsored by Shopify**
Josh Goldberg is an independent full time open source developer in the TypeScript ecosystem. He works on projects that help developers write better TypeScript more easily, most notably on typescript-eslint: the tooling that enables ESLint and Prettier to run on TypeScript code. Josh regularly contributes to open source projects in the ecosystem such as ESLint and TypeScript. Josh is a Microsoft MVP for developer technologies and the author of the acclaimed Learning TypeScript (O’Reilly), a cherished resource for any developer seeking to learn TypeScript without any prior experience outside of JavaScript. Josh regularly presents talks and workshops at bootcamps, conferences, and meetups to share knowledge on TypeScript, static analysis, open source, and general frontend and web development.
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Shopify’s Hydrogen Framework with Ben Sehl appeared first on Software Engineering Daily.
Celeste is a critically acclaimed action platformer developed by Extremely OK Games. They recently released Celeste 64 which is an open source project to commemorate the 6th anniversary of the original Celeste, and development of their next major game, Earthblade, is underway.
Noel Berry is a programmer at Extremely OK Games and he joins the show to talk about developing Celeste and Earthblade, gameplay engineering, the state of C# versus C++ for game development, and more.
Joe Nash is a developer, educator, and award-winning community builder, who has worked at companies including GitHub, Twilio, Unity, and PayPal. Joe got his start in software development by creating mods and running servers for Garry’s Mod, and game development remains his favorite way to experience and explore new technologies and concepts.
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Celeste and Platform Game Engineering with Noel Berry appeared first on Software Engineering Daily.
DataStax is a generative AI data company that provides tools and services to build AI and other data-intensive applications.
Ed Anuff is the Chief Product Officer at DataStax. He joins the show to talk about making Apache Cassandra accessible, adding vector support at DataStax, envisioning the future application stack for AI, and more.
Full Disclosure: This episode is sponsored by DataStax**
Sean’s been an academic, startup founder, and Googler. He has published works covering a wide range of topics from information visualization to quantum computing. Currently, Sean is Head of Marketing and Developer Relations at Skyflow and host of the podcast Partially Redacted, a podcast about privacy and security engineering. You can connect with Sean on Twitter @seanfalconer .
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post DataStax with Ed Anuff appeared first on Software Engineering Daily.
Kong is a software company that provides open-source platforms and cloud services for managing, monitoring, and scaling APIs and microservices.
Marco Palladino is the CTO of Kong, and he joins the podcast to talk about the platform and APIs as the building blocks of the digital world.
This episode is hosted by Lee Atchison. Lee Atchison is a software architect, author, and thought leader on cloud computing and application modernization. His best-selling book, Architecting for Scale (O’Reilly Media), is an essential resource for technical teams looking to maintain high availability and manage risk in their cloud environments.
Lee is the host of his podcast, Modern Digital Business, an engaging and informative podcast produced for people looking to build and grow their digital business with the help of modern applications and processes developed for today’s fast-moving business environment. Listen at mdb.fm. Follow Lee at softwarearchitectureinsights.com, and see all his content at leeatchison.com.
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post It’s APIs All the Way Down with Marco Palladino appeared first on Software Engineering Daily.
Bitwarden is an open-source password management service that securely stores passwords, passkeys, website credentials, and other sensitive information
Matt Bishop is the Principal Architect at Bitwarden. He joins the show to talk about the platform and his work there.
Gregor Vand is a security-focused technologist, and is the founder and CTO of Mailpass. Previously, Gregor was a CTO across cybersecurity, cyber insurance and general software engineering companies. He has been based in Asia Pacific for almost a decade and can be found via his profile at vand.hk.
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Bitwarden with Matt Bishop appeared first on Software Engineering Daily.
Codecademy is an online platform that offers classes on languages including Python, Go, JavaScript, C++, and many others.
Zoe Bachman is the Senior Curriculum Director at Codecademy and designs courses for the platform. She joins the podcast to talk about her work there.
Josh Goldberg is an independent full time open source developer in the TypeScript ecosystem. He works on projects that help developers write better TypeScript more easily, most notably on typescript-eslint: the tooling that enables ESLint and Prettier to run on TypeScript code. Josh regularly contributes to open source projects in the ecosystem such as ESLint and TypeScript. Josh is a Microsoft MVP for developer technologies and the author of the acclaimed Learning TypeScript (O’Reilly), a cherished resource for any developer seeking to learn TypeScript without any prior experience outside of JavaScript. Josh regularly presents talks and workshops at bootcamps, conferences, and meetups to share knowledge on TypeScript, static analysis, open source, and general frontend and web development.
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Codecademy with Zoe Bachman appeared first on Software Engineering Daily.
Web development has exploded in complexity and dynamism over the last decade. Of all the paradigms created during this period, two have bubbled to the top: GraphQL and REST. Each has significantly impacted how we build things digitally, and each has its unique approach to data retrieval and exchange. This article aims to demystify these technologies, offering a clear comparison to help developers make informed decisions. Let’s start with a high-level overview of GraphQL and REST.
Understanding GraphQLWhat is GraphQL?GraphQL is a query language developed by Facebook in 2012, aimed at making data fetching more efficient and tailored to the needs of modern web applications. It allows clients to request exactly the data they need, nothing more, nothing less, which can significantly reduce the amount of data transferred between the client and server.
Imagine you’re at a buffet (the server) where an extensive array of dishes (data) is available. In a traditional buffet, you might be given a plate (the API response) with portions of every dish available, regardless of your taste or appetite. This is akin to traditional REST APIs, where the server defines what data is available in each endpoint, often leading to over-fetching (getting more data than you need) or under-fetching (needing to make additional requests for more data).
With GraphQL, you’re free to choose exactly what dishes you want and in what quantity. You can select your preferred dishes (specific data fields), specify the amount of each (query depth and complexity), and even mix ingredients from different dishes to create a custom plate (combining data from multiple sources in one request). This “choose-what-you-need” approach reduces waste (bandwidth and memory usage) and ensures you get exactly what you want (the data needed for the application).
At the heart of a GraphQL endpoint is the schema. Designing a GraphQL schema is a foundational step in building a GraphQL API, necessitating a collaborative and strategic approach among cross-functional teams, including product managers, developers, and designers. This process not only outlines the structure of the API but also ensures that the product’s data needs align with the user experience and business objectives.
A GraphQL schema serves as a contract between the client and the server, detailing the types of data available and the ways clients can interact with that data. It is defined using GraphQL’s Schema Definition Language (SDL). It specifies queries for retrieving data, mutations for modifying data, and subscriptions for real-time updates, ensuring a comprehensive blueprint for data interaction.
If you are working with an engineering team that divides itself into many domains, then the schema design process encourages early and ongoing collaboration between product managers, developers, and designers across the domains. This multidisciplinary approach ensures that the schema reflects the product’s requirements and user needs accurately. Designing with the end user in mind ensures that the schema is intuitive and aligns with user expectations, leading to a better user experience.
Exploring RESTWhat is REST?REST stands for Representational State Transfer, an architectural style defining a set of constraints for creating web services. It operates through standard HTTP methods and treats server objects as resources that can be created, retrieved, updated, or deleted.
Each endpoint in a REST API corresponds to a specific resource or a collection of resources. The design revolves around resource identification, representation, and the actions that can be performed on them. Designing endpoint paths with consideration for resource relationships and hierarchy can make the API more intuitive but should be used judiciously to avoid overly complex URLs.
Identifying the resources and modeling the domain are critical first steps, necessitating the product team to have a thorough comprehension of the business entities. This can lead to more upfront discussions on endpoint structure, resource naming conventions, and resource relationships. REST involves designing multiple endpoints, each corresponding to a specific resource or a collection of resources. This requires more collaboration between frontend and backend teams to ensure the endpoints match client application workflows.
Comprehensive documentation is essential for ensuring that developers understand how to use the API. Tools like Swagger (OpenAPI) can automate documentation and provide interactive interfaces for testing endpoints.
Similarities and DistinctionsCommon GroundGraphQL and REST are both firmly rooted in the client-server model. This architecture separates the user interface concerns from the data storage concerns, allowing developers to build more scalable and maintainable systems. At their core, both GraphQL and REST are about simplifying the communication process between clients (such as web or mobile applications) and servers. They provide a structured way to query and manipulate data over the internet, making it easier for developers to build interactive, data-driven applications.
When to Use GraphQLGraphQL’s single evolving schema allows for easier iterative development and feedback loops. Teams can add fields and types without affecting existing queries, enabling smoother evolution of the API as user needs and business requirements change. For example, frontend teams can specify exactly what data they need for their own feature, they can work on specific portions of the schema without impacting other teams, which can lead to more efficient discussions on data requirements and less back-and-forth communication.
Consider a financial application for managing corporate expense cards where a user’s dashboard might display a feed of transactions, notifications, payment cards, and money transfers, all of which are interconnected data points. With GraphQL, the frontend can make a single query to fetch all required data simultaneously.
For example:
Let’s say, for instance, the transaction team wants to support new features such as categorizing transactions or adding merchant details. In GraphQL, this can be achieved without impacting the existing schema or the work of other teams. Let’s say our current schema definition looks like the following:
The transaction team could opt to extend the Transaction type with a new Merchant type:
Then update the resolver for the Transaction type:
Now, say the Card Issuance team wants to support a set of Security features that involves authorized access to card details (i.e. cvv / pin ). They would work on extending the Card type.
When updating the resolver, the can not only quickly add another resolver for the field but also apply field-level permissions to the team a newly created field.
When to Use RESTREST tends to be best suited for a few particular scenarios. For example, applications that are straightforward or that heavily rely on caching. It also tends to be best with data models with a relatively flat structure, where resources (the entities or objects in your application) are easily identified and accessed directly through URLs. REST can also be a very effective approach if your application’s data can be represented as a collection of simple, independent entities without complex interrelations.
Other areas where REST is helpful are if the use case requires clear resource identification. Each resource in a RESTful API is identified by a unique URL, making it clear what each endpoint represents and how it can be interacted with. This simplicity in identifying and accessing resources contributes to the overall straightforwardness of using REST. Given its standardized nature, REST is often preferred for APIs where extensive documentation and ease of consumption are crucial.
Example Scenario with RESTIn a RESTful API architecture, resources such as transactions, notifications, cards, and transfers are typically accessed through distinct endpoints. Implementing new features like SecurityFeatures for a resource involves considering both the endpoint design and the security model, ensuring that sensitive information is only accessible to authorized users. Here’s how this could be structured and secured:
RESTful Endpoints
- Transactions: GET /api/users/{userId}/transactions
- Notifications: GET /api/users/{userId}/notifications
- Payment Cards: GET /api/users/{userId}/cards
- Money Transfers: GET /api/users/{userId}/transfers
For a comprehensive dashboard view, the client would need to make separate requests to each of these endpoints. This could be particularly challenging in scenarios with limited bandwidth or high latency, as the cumulative delay from multiple round trips could degrade the user experience significantly. To populate this view, the app makes four separate API calls:
- Fetch transactions to show recent spending activity.
- Fetch notifications to alert the user to any important updates or actions required.
- Fetch payment cards to allow the user to select a card for new transactions or to manage existing cards.
- Fetch money transfers to review recent transfers or to initiate new ones.
Each call waits for a response before the dashboard can fully render, leading to a visible delay for the end user.
From a development perspective, adding the SecurityFeatures section to the existing card resource endpoint is different from the GraphQL implementation. This section would include sensitive data related to a payment card, such as CVV or PIN management capabilities, which should only be available to authenticated and authorized users. One common approach to securing this data with REST is using middleware in the server that processes requests. Middleware can intercept requests before they reach the endpoint logic, allowing the server to authenticate and authorize requests.
Choosing the Right ToolThe choice between GraphQL and REST is not a matter of superiority but of suitability. GraphQL offers unparalleled flexibility and efficiency for complex, data-intensive applications, while REST shines in its simplicity, cacheability, and standardization. The decision should be guided by the project’s specific requirements, available development resources, and scalability considerations.
The post GraphQL vs. REST: What Are They, and Which Is Better for You? appeared first on Software Engineering Daily.
Akash Network is a decentralized cloud computing platform that leverages unused compute capacity around the world. It makes this capacity available to others, and provides a decentralized peer-to-peer model for managing and paying for these resources in an online marketplace.
Greg Osuri is the CEO for OverClock Labs which created Akash Network. He joins the show to talk about Akash.
This episode is hosted by Lee Atchison. Lee Atchison is a software architect, author, and thought leader on cloud computing and application modernization. His best-selling book, Architecting for Scale (O’Reilly Media), is an essential resource for technical teams looking to maintain high availability and manage risk in their cloud environments.
Lee is the host of his podcast, Modern Digital Business, an engaging and informative podcast produced for people looking to build and grow their digital business with the help of modern applications and processes developed for today’s fast-moving business environment. Listen at mdb.fm. Follow Lee at softwarearchitectureinsights.com, and see all his content at leeatchison.com.
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post A Decentralized Compute Marketplace with Greg Osuri appeared first on Software Engineering Daily.
Linting is the process of checking source code for programmatic as well as stylistic errors. Ruff is a highly popular Python linter written in Rust. It was developed by Charlie Marsh, who also founded Astral, which is focused on next-generation Python tooling.
Charlie joins the podcast to talk about open source development, Ruff, the UV package installer, and much more.
Josh Goldberg is an independent full time open source developer in the TypeScript ecosystem. He works on projects that help developers write better TypeScript more easily, most notably on typescript-eslint: the tooling that enables ESLint and Prettier to run on TypeScript code. Josh regularly contributes to open source projects in the ecosystem such as ESLint and TypeScript. Josh is a Microsoft MVP for developer technologies and the author of the acclaimed Learning TypeScript (O’Reilly), a cherished resource for any developer seeking to learn TypeScript without any prior experience outside of JavaScript. Josh regularly presents talks and workshops at bootcamps, conferences, and meetups to share knowledge on TypeScript, static analysis, open source, and general frontend and web development.
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Ruff and Next-Generation Python Tooling with Charlie Marsh appeared first on Software Engineering Daily.
Gabriel Gambetta is a Senior Software Engineer at Google where he works on YouTube. He’s an expect in computer graphics and game development, and is famous for his articles on engineering fast-paced multiplayer games.
Gabriel joins the show to talk about his history with game development, client-server game architecture, rubber-banding, raytracing, rasterizers, and much more.
Joe Nash is a developer, educator, and award-winning community builder, who has worked at companies including GitHub, Twilio, Unity, and PayPal. Joe got his start in software development by creating mods and running servers for Garry’s Mod, and game development remains his favorite way to experience and explore new technologies and concepts.
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Engineering Fast-Paced Multiplayer Games with Gabriel Gambetta appeared first on Software Engineering Daily.
The U.S. government recently released a report calling on the technical community to proactively reduce the attack surface area of software infrastructure. The report emphasized memory safety vulnerabilities, which affect how memory can be accessed, written, allocated, or deallocated.
The report cites this class of vulnerability as a common theme in the some of the most infamous cyber events, such as the Morris worm of 1988, the Heartbleed vulnerability in 2014, and the Blastpass exploit of 2023.
Herb Sutter works at Microsoft and chairs the ISO C++ standards committee. He joins the show to talk about C++ safety.
Jordi Mon Companys is a product manager and marketer that specializes in software delivery, developer experience, cloud native and open source. He has developed his career at companies like GitLab, Weaveworks, Harness and other platform and devtool providers. His interests range from software supply chain security to open source innovation. You can reach out to him on Twitter at @jordimonpmm.
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post C++ Safety with Herb Sutter appeared first on Software Engineering Daily.
Figma is a cloud-based design and product development platform that is widely used in UI and UX work. It allows users to collaborate in real-time, a key feature that has helped drive its popularity. Figma is an impressive engineering feat, in part because of how far it pushes what’s possible in a web browser.
Abhi Mathur is the VP of Platform Engineering at Figma. He joins the show today to talk about his path to Figma, architecture, scaling, team organization, and more.
Josh Goldberg is an independent full time open source developer in the TypeScript ecosystem. He works on projects that help developers write better TypeScript more easily, most notably on typescript-eslint: the tooling that enables ESLint and Prettier to run on TypeScript code. Josh regularly contributes to open source projects in the ecosystem such as ESLint and TypeScript. Josh is a Microsoft MVP for developer technologies and the author of the acclaimed Learning TypeScript (O’Reilly), a cherished resource for any developer seeking to learn TypeScript without any prior experience outside of JavaScript. Josh regularly presents talks and workshops at bootcamps, conferences, and meetups to share knowledge on TypeScript, static analysis, open source, and general frontend and web development.
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Figma Engineering with Abhi Mathur appeared first on Software Engineering Daily.
The majority of enterprise data exists in heterogenous formats such as HTML, PDF, PNG, and PowerPoint. However, large language models do best when trained with clean, curated data. This presents a major data cleaning challenge.
Unstructured is focused on extracting and transforming complex data to prepare it for vector databases and LLM frameworks.
Crag Wolfe is Head of Engineering and Matt Robinson is Head of Product at Unstructured. They join the podcast to talk about data cleaning in the LLM age.
Sean’s been an academic, startup founder, and Googler. He has published works covering a wide range of topics from information visualization to quantum computing. Currently, Sean is Head of Marketing and Developer Relations at Skyflow and host of the podcast Partially Redacted, a podcast about privacy and security engineering. You can connect with Sean on Twitter @seanfalconer .
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Unstructured Data and LLMs with Crag Wolfe and Matt Robinson appeared first on Software Engineering Daily.
Red Hat Enterprise Linux is a Linux distribution developed by Red Hat for the commercial market. The company recently announced changes to the availability of its source code.
In response, CIQ, Oracle and SUSE formed the Open Enterprise Linux Association, or OpenELA, which aims to provide a consistent and secure upstream location for Enterprise Linux distribution sources.
Wim Coekaerts is Executive Vice President of Software Development at Oracle, and he joins the podcast to explain the recent changes in the Linux enterprise space, and discuss the OpenELA and its importance to the Linux ecosystem.
This episode is hosted by Lee Atchison. Lee Atchison is a software architect, author, and thought leader on cloud computing and application modernization. His best-selling book, Architecting for Scale (O’Reilly Media), is an essential resource for technical teams looking to maintain high availability and manage risk in their cloud environments.
Lee is the host of his podcast, Modern Digital Business, an engaging and informative podcast produced for people looking to build and grow their digital business with the help of modern applications and processes developed for today’s fast-moving business environment. Listen at mdb.fm. Follow Lee at softwarearchitectureinsights.com, and see all his content at leeatchison.com.
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post The Changing Enterprise Linux Ecosystem with Wim Coekaerts appeared first on Software Engineering Daily.
LLMs have become one of the most important technologies to emerge in recent years. Many of the most prominent LLM tools are closed source, which has led to great interest in developing open-source tools.
Antonio Velasco Fernández is a Data Scientist and Jose Pablo Cabeza García is a Lead Data Engineer, both at Elastacloud. In this episode, recorded in 2023, they joined the podcast to talk about LLMs and the importance of community development for LMMs.
Jordi Mon Companys is a product manager and marketer that specializes in software delivery, developer experience, cloud native and open source. He has developed his career at companies like GitLab, Weaveworks, Harness and other platform and devtool providers. His interests range from software supply chain security to open source innovation. You can reach out to him on Twitter at @jordimonpmm
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post LLM Community Development with Antonio Velasco Fernández and Jose Pablo Cabeza García appeared first on Software Engineering Daily.
A deepfake is a synthetic media technique that uses deep learning to create or manipulate video, audio, or images to present something that didn’t actually occur. Deepfakes have gained attention in part due to their potential for misuse, such as creating forged videos for political manipulation or spreading misinformation.
Ryan Ofman is a Lead Engineer and Head of Science Communication at DeepMedia, which is a platform for AI-powered deepfake detection. He joins the show to talk about the state of deepfakes, their origin, and how to detect them.
Sean’s been an academic, startup founder, and Googler. He has published works covering a wide range of topics from information visualization to quantum computing. Currently, Sean is Head of Marketing and Developer Relations at Skyflow and host of the podcast Partially Redacted, a podcast about privacy and security engineering. You can connect with Sean on Twitter @seanfalconer .
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Detecting Deepfakes with Ryan Ofman appeared first on Software Engineering Daily.
Decompilation is the process of translating a compiled program’s bytecode back into a higher-level programming language, like C. There’s a vibrant and growing scene of engineers working to decompile classic video games, and some of the most prominent projects have focused on the Nintendo 64. Recent successes include Super Mario 64, The Legend of Zelda: Ocarina of Time, and Paper Mario.
Ethan Roseman and Mark Street are both software engineers with experience in the decompilation scene. In addition to their work on specific games, they’re active in creating open-source tooling for the decompilation community, including Splat which is a binary splitting tool, and Decomp.me which is a collaborative decompilation and reverse engineering site.
Ethan and Mark join the podcast to talk about N64 game decompilation, surprising discoveries in the game code, tool development, and much more. Be sure to check out the Decomp.me Discord to learn more.
Joe Nash is a developer, educator, and award-winning community builder, who has worked at companies including GitHub, Twilio, Unity, and PayPal. Joe got his start in software development by creating mods and running servers for Garry’s Mod, and game development remains his favorite way to experience and explore new technologies and concepts.
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Bonus Episode: The N64 Decompilation Scene with Ethan Roseman and Mark Street appeared first on Software Engineering Daily.
CSS, or Cascading Style Sheets, is a fundamental technology in web development that defines the presentation and layout of HTML documents. It serves as a styling language that allows developers to control the appearance of web pages.
Rachel Andrew is a Staff Technical Writer on the Google Chrome Team. Before that she worked for Mozilla and was also the Editor in Chief at Smashing Magazine. She is a member of the CSS Working Group, the Web Standards Project, and Open Web Docs. Rachel is our guest today.Josh Goldberg is an independent full time open source developer in the TypeScript ecosystem. He works on projects that help developers write better TypeScript more easily, most notably on typescript-eslint: the tooling that enables ESLint and Prettier to run on TypeScript code. Josh regularly contributes to open source projects in the ecosystem such as ESLint and TypeScript. Josh is a Microsoft MVP for developer technologies and the author of the acclaimed Learning TypeScript (O’Reilly), a cherished resource for any developer seeking to learn TypeScript without any prior experience outside of JavaScript. Josh regularly presents talks and workshops at bootcamps, conferences, and meetups to share knowledge on TypeScript, static analysis, open source, and general frontend and web development.
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post The State of CSS with Rachel Andrews appeared first on Software Engineering Daily.
Security Operations, or SecOps, refers to the collaboration between security and operations teams to secure an organization’s systems, applications, and data.
Maxime Lamothe-Brassard is a Co-Founder of LimaCharlie which is a cloud SecOps platform. He has a background in security and has previously worked at the Canadian Intelligence service, Crowdstrike, Google, and Google X. He joins the podcast to talk about modern security operations.
Gregor Vand is a security-focused technologist, and is the founder and CTO of Mailpass. Previously, Gregor was a CTO across cybersecurity, cyber insurance and general software engineering companies. He has been based in Asia Pacific for almost a decade and can be found via his profile at vand.hk.
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Modern SecOps with Maxime Lamothe-Brassard appeared first on Software Engineering Daily.
Microsoft Copilot is a chatbot developed by Microsoft that launched in 2023 and is based on a large language model.
Justin Harris is a Principal Software Engineer at Microsoft and has an extensive background in classical machine learning and neural networks, including large language models. He joins the show to talk about Microsoft Copilot, natural language processing, ML team organization, and more.
Sean’s been an academic, startup founder, and Googler. He has published works covering a wide range of topics from information visualization to quantum computing. Currently, Sean is Head of Marketing and Developer Relations at Skyflow and host of the podcast Partially Redacted, a podcast about privacy and security engineering. You can connect with Sean on Twitter @seanfalconer .
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Microsoft Copilot with Justin Harris appeared first on Software Engineering Daily.
The interplanetary filesystem, or IPFS, is a peer-to-peer network that uses a distributed and decentralized model. Functionally, IPFS allows users to store and share files without having to rely on a single source of truth for those files.
Matt Ober is the Co-Founder & CTO of Pinata. He joins the show to talk about IPFS and Pinata.
This episode is hosted by Lee Atchison. Lee Atchison is a software architect, author, and thought leader on cloud computing and application modernization. His best-selling book, Architecting for Scale (O’Reilly Media), is an essential resource for technical teams looking to maintain high availability and manage risk in their cloud environments.
Lee is the host of his podcast, Modern Digital Business, an engaging and informative podcast produced for people looking to build and grow their digital business with the help of modern applications and processes developed for today’s fast-moving business environment. Listen at mdb.fm. Follow Lee at softwarearchitectureinsights.com, and see all his content at leeatchison.com.
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Pinata and the Interplanetary File System with Matt Ober appeared first on Software Engineering Daily.
Animal Well is a Metroidvania game developed as a solo project by Billy Basso over the course of seven years. It’s the first game released by publisher Bigmode, which was founded by Jason “Dunkey” Gastrow.
Billy joins the show to talk about creating Animal Well’s engine from scratch, how the game handles animation, fine-tuning character movement, and more.
Joe Nash is a developer, educator, and award-winning community builder, who has worked at companies including GitHub, Twilio, Unity, and PayPal. Joe got his start in software development by creating mods and running servers for Garry’s Mod, and game development remains his favorite way to experience and explore new technologies and concepts.
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Animal Well with Billy Basso appeared first on Software Engineering Daily.
Augmented reality and extended reality, or AR and XR, are in the early stages of being integrated into design workflows. But they are likely to transform design in the years to come. Jenna Fizel has a background in architecture and desktop software engineering. She sat down with Tyson Kunovsky to talk about her work at the design firm IDEO and how they’re using AR and XR for industrial design prototyping.
TK: Hi, Jenna. And welcome to Software Engineering Daily.
JF: Thanks, Tyson. Happy to be here.
TK: Jenna, before we start, I’d love to learn a little bit more about you and your software engineering background. How did you become a software engineer? And what did your academic journey look like?
JF: Sure. I came to software actually through architecture originally. My academic background is in computational geometry. And so, I, for a while, was writing code and developing algorithms to create things like building facades and realized that I was a lot more interested in the systems I was building than the fact that they turned into buildings in the end.
I shifted careers a little bit. And for about a decade, was a desktop C++ developer. Creating custom software for lots of different kinds of institutions. From companies, to libraries to help them explain complex data to various audiences through sort of massive installations that ran across multiple servers connected to many different kinds of backends. And then display that all in novel interfaces located in places. That’s kind of where my architecture background remained. I always like to build things for specific human contexts.
TK: Well, that makes sense, because now you’re a senior director of emerging technology for a really interesting and unique company called IDEO. And, Jenna, for those that aren’t familiar with IDEO as an organization, what kinds of work does IDEO do? And who do you do it for?
JF: Yeah. IDEO is a design consultancy, which means that we help our clients with problems that can be framed as design questions. Now, that’s vague, because we do a lot of different things. We’ll work on anything from the physical design of something like a guitar capo to government policy. And we do this in a really cross-disciplinary way. We have dedicated teams for each client project where we combine different skill sets and different backgrounds. You might see somebody like myself with a software engineering background. Somebody with a background in organizational change or somebody with a business design background alongside of people who are experts in graphic design or interaction design all working together on a single problem over a concentrated period of time.
TK: That’s quite the breadth of solutions that you offer. Given we’re software podcast, we don’t usually have a lot of folks on talking about designing guitar capos and government policy. But I’m guessing that taking this design centric worldview and applying it to the problems that you are solving is a unique and powerful way to create novel solutions that you might not be able to arrive at otherwise.
Given that IDEO is so cross-disciplinary, how do you see the role of actual software engineering in the design work that you do?
JF: Yeah. I think there’s sort of two approaches here. One is simply our interdisciplinarity. We always value the expertise of our team members and bringing sort of the lens of the kind of craft that they’re bringing into the situation in understanding the design problem. For software, that’s a lot about thinking systematically or thinking about real-world implications of design decisions. Or actually building software. I still do that. And my colleagues do that as well. But we do it in a slightly different way that I think we’ll probably dig into.
And then I think there is the sort of expertise level. Because we work on a lot of digital products. Or we work on systems or questions that are adjacent to digital product development. And so, bringing the sort of experience lens of having worked myself on both desktop and web-based products and other people with a variety of other kinds of experience. We can bring in the sort of needs of the client context more vitally into the room when the design solution is being worked through.
TK: It almost sounds like I don’t know quite what to call this. But your approach seems more as if it’s applied software engineering for the real-world, which is interesting. Because when you think about why companies typically build or hire others to build software, it’s usually for some very specific and often, for lack of a better term, boring business purpose. Given the work that IDEO does is so diverse, why does IDEO build software?
JF: Yeah. I would say that there’s sort of three reasons why we build software. One is to create a prototype. To sort of answer the question, “How could this thing work?” And that is especially relevant these days in emerging technology where if we’re designing like an augmented reality experience, it’s not really enough to just talk about it or even draw it. You kind of have to make it or make at least some limited aspect of it.
And, often, we’ll come to clients who have large engineering organizations. And maybe they have some prototypers that they’re often working inside of relatively complex systems. And we take the approach that you should only build what you need to answer the question you’re trying to ask with your prototype.
Step one, or approximately step one, is to define that question. And then step two is to try to build something and see how hard that is. And then maybe go revise step one again until you get to something that leads you to a better question. And so, that’s what a prototype is. It’s a machine for asking better questions. That’s one thing.
Another one is experiences. One of our co-founders, Bill Moggridge, has this quote I love that the only way to experience the experience is to experience it, which a little bit silly. But I think it’s also really true. Sometimes we need ourselves and our clients to sort of feel a future scenario or even feel the possibility in an existing design. And, often, the only way to do that is to actually make the thing to some degree.
Again, we always are trying to be lean with how much effort we’re putting into any of our work, including engineering work. We think through like how much of this experience? And in what ways does it need to be real to convey the emotion or that connection to others? Or the impact of the design choices we’re making. Yeah, four experiences.
And then I think, thirdly, to support with strategic choices. Sometimes, or really often, even when we’re doing product design, it’s in the context of larger decisions a company is making. What markets to enter? Or what new teams to stand up? And it can be really powerful to build a little bit of the future of what those teams might accomplish in order to help feel the consequences of different strategic choices.
TK: It sounds like software then is just yet another tool in your belt to help facilitate understanding. And I absolutely love that quote. The only way to experience the experience is to experience it. I’m definitely going to have to steal that.
Now that we know a little bit more about your overall approach to utilizing software, let’s change direction and talk about something that I know you have deep experience with, which is augmented reality, or XR, as it’s commonly referred to for those that are unfamiliar. When it comes to emerging technologies like XR, how are those technologies used by the engineers and designers at IDEO today?
JF: Yeah. It’s a good question. First of all, IDEO’ers are curious people. And they’re always sort of looking out for the next new thing. And so, a lot of us bring in our interests, especially in emerging technology, naturally to our design work. We also do have some slightly more formal structures that encourage this.
Part of my role actually is running our internal learning group on emerging technology that I started during the pandemic actually to help with collaboration. It was kind of a wonderful – or wonderful and tragic confluence of factors where we’d had VR headsets and Microsoft HoloLenses lenses in our studios. But one or two of them that project teams could take on and use.
But we were all in our own homes, and apartments, and things when the Meta Quest 2 came out at a low enough price point that we could conceivably send out hardware to more people who wanted them. And that created an opportunity to make a sort of obligation between the people who raised their hands for this hardware and a learning community.
I’ve sort of engaged with learning communities before. And it is very important to make sure that everyone is getting something out of learning things. It was an amazing opportunity to have this sort of like new capability and hardware to send to people in exchange for their commitment to use it and share back their learnings.
And that has really blossomed into a now – well, sort of about 80-person active membership where we have folks trying out different virtual reality, augmented reality. And, of course, new sort of AI tools. And then sharing back their experiences, which we do every Thursday. And we try to keep those sharebacks relevant to concerns within client work sometimes directly supporting a specific piece of work. But, also, often driven by sort of what is happening inside of the realm of feasibility itself. I think this is a little bit underappreciated source of inspiration, which is actually sort of like what is possible? What can we build? And what can we build relatively easily? And that is one of the purposes of this group.
TK: Could you give a couple of examples of things that you’ve learned about XR during these sharebacks? And then perhaps use that to speak about how these learnings help you and your team better solve problems for your customers.
JF: Yeah. I think um a really powerful example is what I’ve seen happen inside of the industrial design community. They’ve really found a few different high value approaches to using XR in particular. Although, actually today, this afternoon, one of my industrial design colleagues will be sharing back about using AI tools to go from sketches to rendering. We have a variety of interests.
But I think the first thing I saw for that community was reality capture. Using mostly their phones. But, also, occasionally, dedicated hardware to take physical mockups or even physical objects in their environment. Scan them and then share them. This is maybe a little bit less relevant now that a lot of them share a physical location. But, certainly, when everyone was separated, this was incredibly useful. And that was really used sort of like inside the design process to get to results more quickly and with a higher fidelity.
It has since morphed into a storytelling technique in a lot of ways. Whereas before, teams would always present renderings at the end of a design project. They’re now often also sharing augmented reality models with each other and with the client themselves, which I think really lets you see the design in context in a way that you previously would have to make a high fidelity physical model before. And so, that’s really exciting.
This is also a little bit to do with industrial design. But we do a lot of what’s called design research, which is going out uh into the contexts of the people who will eventually be using the things that we design and asking them questions or engaging them in activities that help us understand their habits, their needs, their desires relevant to whatever it is we’re designing.
Um, and we’ve been able to, uh, engage with people again, especially people who have constraints on where they can physically be through – especially augmented reality. Sometimes we work on medical devices. And sometimes those medical devices are for people who have immune disorders or ill in other ways. And they are perhaps using like very complicated physical devices to help with their conditions. And to sort of produce a bunch of mockups of those physical devices. Sterilize them and send them. Or is a thing that we sometimes engage in but is very costly.
And with a fiducial that you can print out on your home printer and tape to a book, you can get an augmented reality experience where you can sort of understand things like where might a button sit. What might the sort of indications on a display be to help you understand how to walk through a treatment protocol or what have you? Or even to just understand does this item fit in with my life? Does it feel intimidating? Does it feel friendly? These are things that you can kind of get at without um sending a physical object and instead using a virtual overlay.
TK: Those are some interesting applications of XR. And it sounds like you’re working really closely with both technical and non-technical stakeholders to implement them. I want to talk more deeply about XR in a moment. But since we’re on the topic, I’m curious to get your perspective on collaboration between technical and non-technical stakeholders. Because I know it’s an issue for a lot of companies. How do you get non-technical folks to engage and provide helpful input, especially when maybe they don’t have the right technical expertise necessary to contribute effectively?
JF: Yeah. That’s a great question and an eternal struggle. But an exciting one. I really think that there’s sort of stereotypically a divide between the people who can sort of make things for real and then everybody else. It’s the consumer versus the creator.
And for a lot of these technologies, that line is getting blurrier and blurrier. It actually is relatively possible with a little bit of support and a sort of like friendly guardrails to help people without a lot of background make the leap into being productive creators.
But everybody has to be a little bit bought-in. And that is part of why having the learning group is so powerful. It contains many more folks than just the sort of software industrial design and interaction design people. We have people who work on business development in it. We have, again, design researchers in it.
And I try to balance the programming so that we have inspiration inside of the expertise of the various folks who are engaged in the community. I’ll often have – I had last year an artist called Grace Boyle do a short series of workshops with us. And she really cares about multi-sensory design and designing for emotions, dreams. Sort of ideas and concepts that might appeal to people with backgrounds other than engineering. But she then executes that work in a very precise and fairly engineering-heavy way. And so, that was sort of an attempt to get that inspiration in.
And then through a series of structured activities actually help people build and make. And I always try to offer a few different ways of building from something that you can do simply by clicking on things in a browser. To, yeah, forking a template that I’ve started for those who would like to write some TypeScript.
TK: You’re learning groups sound like an effective way of getting non-technical folks involved. Because you make it easy for them to become creators themselves. And I know a lot of companies try to do similar things with their lunch and learns, competency groups, and other activities but with varying degrees of success.
Before we get back to XR, what advice would you have for folks at organizations that might want to spin up and start running their own learning groups? I guess, specifically, what have you seen work to make folks feel like this isn’t yet just another job responsibility on top of everything else?
JF: I think there have to be a couple preconditions. One, I think people have to be interested. That sounds silly. But I think it’s actually really important. You have to either have the topic be attractive enough. You have to bring in interesting outsiders. Or you have to offer something. And so, I feel really lucky that I was able to offer those VR headsets when we were starting up.
And then the second part of your question, there has to be value there. This learning group’s been going for more than two years now. And that’s because what we do has real tangible impact for our clients. And while I value the sort of opportunity to think a little bit more broadly and with a little bit frankly lower stakes in some of these sessions, because we’re not necessarily building to exactly a deadline or for a high-stakes presentation, it’s really critical that people are gaining skills that then they can use in those high-stake situations or higher stake situations anyway.
And I try to do that both through connecting with leaders across IDEO to understand what are they seeing in the market. What are we seeing within our project teams? And then inviting sort of the closed loop of a shareback from a project team who’s used something, learned in the learning group to demonstrate to everybody that, actually, you can learn valuable stuff here. I think both being attractive and explicitly demonstrating value are both really important.
And I think there is a third way to do both of those things, which is to help people become just a tiny bit famous. My colleague, Danny Durant, started first a Medium blog. And now has graduated to be a part of IDEO’s website called Edges, currently, where we help people publish uh sort of this interesting work that they’re doing um at the edges of what IDEO does. That is both client work and independent work that happens.
And a great source for that has been for us the learning group. If you share something sufficiently interesting in that group, I will bother you to turn it into an article that we’ll then publish. Or I’ll bother you to submit to conferences. Juliette Laroche, one of the participants created a share a shareback about envisioning new kinds of materials using image generators. And it was a really compelling and profound presentation. And off of that, I actually pitched her to a conference organizer. She’s spoken a couple of different times about this topic and is actually um getting some of her images included in a textbook that’s going to be published next year. It is possible to sort of get some personal motivation into a learning group as well. But you have to put in that effort to help people find those opportunities before you get a little engine going and they become sort of easier and more natural.
TK: Some great advice there. Thanks for sharing. Okay. Now that we’ve talked about collaboration and learning groups, let’s circle back and talk about the topic of XR. When you think about the future, what gets you most excited about XR?
JF: I think we’ve seen, especially over the last couple of years, XR really used as a sort of explanatory tool or a tool to create imaginative leaps in our clients. We’ve done sort of large-scale simulations of things like retail stores of the future. We did this in work for Canada Goose that launched actually just pre-pandemic, uh which was a sort of rethink of a zero-inventory store with a bunch of immersive experiences. And because we sort of did all that previous work, they actually implemented basically everything that we put into our final design. It was an amazing thing to see the final physical results.
We’ve also done this for transportation. Sort of making simulations of personal vehicles up through things the size of airplanes. And that has been super successful. But what I’m really excited about these days is that more and more XR products are actually coming to market. And now there are all of these other questions around the products that companies are beginning to ask.
And so, we’re able to bring this sort of relatively deep expertise in personal usage across a lot of different kinds of skill sets to thinking about questions of onboarding people, helping them understand what it feels like to have a social interaction inside of an immersive 3D space instead of in some boxes on a screen. And helping clients from startups to the large tech companies, you might imagine, think through these sort of secondary consequence questions of the products that they’re developing.
TK: Can you talk to us a little bit about the actual software development process for XR? Not having actually done any XR Dev myself, how does it work? What languages are you coding in? What frameworks do you use? How does prototyping development work? Give us the rundown.
JF: Sure. There’s actually quite a few approaches that I found to be pretty viable here. Again, it depends a little bit on who I’m encouraging to build. Or if I’m building myself. Or with the engineering organizations of my clients. I think the sort of typical place you might think to start is game engines. Both Unreal and Unity have good support for XR platforms. And there’s actually an open standard called Open XR that you can build from that’s supported by meta devices. And the Vive and sort of all the usual suspects.
That can be really helpful if you’re working with somebody who is already kind of familiar with one of those game engines as many people are. I would say the biggest barrier there is setup. There’s many, many, many YouTube tutorials. And actually a big effort at the beginning of the learning group was to build out a specific tutorial that works on a Mac, because we’re a Mac shop, to get you from Unreal Engine onto your Meta Quest headset. And I think that was worth it. We build a lot of nice things off of that workflow.
If we’re talking about Apple, very well integrated in their ecosystem. If you are already an Apple – especially an Apple mobile developer, it’s sort of almost trivially easy to engage with like both a Vision Pro or just simply an on-phone augmented reality experience. And this is actually the first place that I would point out that you don’t need to have really almost any coding expertise to still engage in these kinds of ecosystems.
There’s an app called Reality Composer that works on any iOS device that will let you compose scenes, assign behaviors to different parts of the scenes. Not super complicated ones. But like tap behaviors. Or proximity behaviors. And you can easily import assets that have animations already baked into them that you’ve perhaps built in programs like Blender, or even purchased from an online service, or downloaded from Apple’s own pretty robust library. And that lets almost anybody quite easily sketch-out what a scene or an interaction might feel like in XR, which can then actually be smoothly passed over to a developer and imported it into Xcode. And that process is actually not completely foolproof. But you’re not going to lose all the effort that that original person put in. That’s kind of game engines and native stuff.
There’s also actually a relatively good sort of web platform called WebXR that has good support from platforms like Three.js. Or Frame, which is actually Three.js under the hood anyway. But that’s simple to create. Like, low complexity environments, I would say, with complicated behavior that are connected to complex backends, which is often kind of my sweet spot. I tend to build web experiences most often.
I’ve also gotten a lot of excitement out of combining a lot of large language model or image generator services into XR environments, which is super easy to do in a web app. Because all the infrastructure is already there to take advantage of combining these other services into one thing.
TK: You beat me to it. The very next question that I was going to ask was about AI applications within the context of XR. When you think about the confluence of LLMs, AI, and XR, I bet there are some pretty useful and interesting applications. Can you give us a couple examples of how you’re able to pull in and harmoniously leverage these technologies together?
JF: Yeah. I mean I think the biggest and most obvious one is voice control. That is the sort of – at least sort of the support so far inside of VR headsets, especially for interaction, is very much game-like. You have sort of controllers that feel a lot like a separated game controller. You have buttons and joysticks. And that, first of all, just isn’t very intuitive or comfortable to a lot of people. And I think you know once you put on a headset, you start to feel the Star Trek Holodeck dream and you want to talk to the computer.
And while I am a little bit skeptical of voice control as a panacea for user interface problems, I do think it’s a really, really interesting thing to add to the mix. And it’s now almost trivially easy to do so, especially in a web platform. Obviously, there are blockbuster things like Whisper that are relatively easy to access. There’s also even locally-run models. Like, Picovoice comes to mind there that can run even on a mobile device like a VR headset to good quality and get you reasonable transcription that you can then flow into sort of actions within your overall environment.
And so, I find that to be like the sort of like no question. We should be engaging with this. We should be thinking through how these interactions might happen. And then actually building them. I think to one of my points earlier where sometimes you need to prototype to answer a question, I think a big question in UX these days is what does voice really mean for my app? And I think, these days, it’s easy to do that in any context. But maybe a little bit surprisingly, it’s also easy to do that inside of XR apps.
TK: You’ve mentioned a few different kinds of hardware, frameworks, and companies that are helping to move XR forward. What are some of your favorite organizations that are doing interesting things with XR today?
JF: Yeah. Great question. This is not a sort of commercial company or not a sort of mass consumer company. But I think one of the most interesting explorations in XR is this company called aNUma. They started by designing sort of transcendental experiences for groups of people to have inside of headsets. Sort of group-guided meditation.
But meditation in a really interesting way. Because instead of sort of imagining energy flowing through you, you can simply experience energy flowing through because you’ve replaced all of your visual and auditory inputs. And they started with sort of a more general application. And now they are focused on helping people through end-of-life experiences and letting people be together in these meaningful ways with their loved ones when they might not be physically able to otherwise. Obviously, that’s only relevant to a small portion of people. But I think that is the most powerful experience I’ve had the privilege of engaging with in XR.
I think beyond that, there are a lot of the sort of more artistic or more emotionally-driven XR experiences are really interesting to me. You retain a lot more from an experience that completely replaces your senses than you do from almost any other kind of experience. Combining that with something of high emotion is really powerful.
There’s the artist I already mentioned, Grace Boyle. She has mostly site-specific pieces. You’d have to like see what she’s up to and where it’s being shown at any particular time. There’s another artist named Wyatt Roy who does a lot with reality capture both for memory and to sort of explore the living places and the working places of himself and of other artists that I find really compelling.
And then, yeah, I think I’ll shout out two slightly older applications. One is called Notes on Blindness. This was actually I think from originally back from maybe 2017 or even earlier, which explores the diaries of man who went blind in adulthood and sort of visualizes what it feels like to slowly lose your sight in interesting ways. And then, finally, an experience called Goliath, which tries to create empathy for the experience of having schizophrenia. Yeah. Sort of emotionally impactful subject matter. But I think conveyed in really, really interesting and compelling ways.
TK: Wow. All of those are really wonderful applications of XR. And I’m sure a lot of folks, myself included, have never thought about applying XR to empathize with those that are losing their sight or to be with their loved ones towards end-of-life.
Given that XR has so many broad applications, on a more practical level, what advice would you have for companies that are looking to gain XR competency and integrate XR or MR into their own product offerings?
JF: Yeah. I would say to really consider what having more context about the space around as if you’re exploring AR or MR, mixed reality, and which I think most people would probably be looking in that direction. If you’re no longer constrained to your black rectangle, what is it about that environment that you would want to really integrate with? Because, ultimately, I think the question of designing for XR is not that different from creating architectural designs, which is part of why I’m so excited about this change in the world. But it does require more ambient thinking and more sort of consideration of what might be around the person when they’re engaging with your product.
And so, I think making mockups like in real-life. Use some paper and tape and try to put interface elements physically around a person and see how that feels. See in what ways would you want to sort of touch and interact. And, also, what do you need to know about? Do you need to know – there’s a lamp sitting on the desk in front of me right now. Is it useful to your service to know that there’s a lamp there? What would you want to do with that lamp? Is it reasonable to collect information about it? Could you connect to it? There become all of these sort of spidery ecosystem questions that arise when you’re thinking about integrating with the world. And, also, frustrations that might naturally happen for people.
There’s not a good definition of sort of like what’s in scope and what’s out of scope for these interactions. And so, defining a couple of really high-value ones and then figuring out how to communicate them to your users I think make for much more satisfying XR experiences than just putting a hat on something. Or sort of like just taking your buttons and putting them into space in front of you. Not that that can’t be fun. But I think if you actually want to invest in this space, thinking about that holistic understanding of your surroundings is really important.
TK: For me, the image of just putting a hat on something brings to mind that wonderful scene from the show Silicon Valley where that company is trying to poach Richard with their super-secret XR mustache technology. Definitely worth the watch if you haven’t seen it.
But, Jenna, I just want to say thank you so much for taking time to talk to us about your experience at IDEO and your work with XR. If folks are interested in learning more about the work that you and IDEO do, what’s a good way to connect?
JF: Sure. I mean, first of all, our website is ideo.com. We have a contact forum. You’re certainly welcome to reach out there. I think the most – the easiest way to reach me and my colleagues who are interested in emerging technology is to email ai@ideo.com. We have of course chosen the very shortest possible email for that one.
You will be able to talk to us about more things than just large language models and image generators. But we’re happy to talk about those as well.
TK: Awesome. Well, Jenna, thank you so much for your time and for coming on Software Engineering Daily.
JF: Thanks for having me, Tyson.
The post Product Design using AR and XR with Jenna Fizel appeared first on Software Engineering Daily.
Almost every application or system involves some sort of user onboarding. Increasingly, companies must implement know-your-customer and know-your-business compliance, or KYC and KYB, as part of that process. In addition, they often handle personal identifiable information, or PII.
Footprint is a developer platform that was co-founded by Alex Grinman for handling identity, security, fraud, and authentication.
Alex joins the show to talk about identity verification, security, compliance, Footprint’s frontend and backend design, and much more.
Gregor Vand is a security-focused technologist, and is the founder and CTO of Mailpass. Previously, Gregor was a CTO across cybersecurity, cyber insurance and general software engineering companies. He has been based in Asia Pacific for almost a decade and can be found via his profile at vand.hk.
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Implementing KYC and User Verification with Alex Grinman appeared first on Software Engineering Daily.
Vue is a popular JavaScript frontend framework, and Nuxt is an open source meta-framework on top of Vue.
Anthony Fu is a Framework Developer on the Nuxt team. He joins the show to talk about Vue, Nuxt, open source development, and more.
Josh Goldberg is an independent full time open source developer in the TypeScript ecosystem. He works on projects that help developers write better TypeScript more easily, most notably on typescript-eslint: the tooling that enables ESLint and Prettier to run on TypeScript code. Josh regularly contributes to open source projects in the ecosystem such as ESLint and TypeScript. Josh is a Microsoft MVP for developer technologies and the author of the acclaimed Learning TypeScript (O’Reilly), a cherished resource for any developer seeking to learn TypeScript without any prior experience outside of JavaScript. Josh regularly presents talks and workshops at bootcamps, conferences, and meetups to share knowledge on TypeScript, static analysis, open source, and general frontend and web development.
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Nuxt JS with Anthony Fu appeared first on Software Engineering Daily.
The size of ML models is growing into the many billions of parameters. This poses a challenge for running inference on non-dedicated hardware like phones and laptops.
Argmax is a startup focused on developing methods to run large models on commodity hardware. A key observation behind their strategy is that the largest models are getting larger, but the smallest models that are commercially relevant are getting smaller. The company was started in 2023 and has raised money from General Catalyst and other industry leaders.
Atila Orhon is the founder of Argmax and he previously worked at Apple and NVIDIA. He joins the show to talk about working in computer vision, building ML tooling at Apple, optimizing ML models, and more.
Sean’s been an academic, startup founder, and Googler. He has published works covering a wide range of topics from information visualization to quantum computing. Currently, Sean is Head of Marketing and Developer Relations at Skyflow and host of the podcast Partially Redacted, a podcast about privacy and security engineering. You can connect with Sean on Twitter @seanfalconer .
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Scaling Large ML Models to Small Devices with Atila Orhon appeared first on Software Engineering Daily.
Anaconda is a popular platform for data science, machine learning, and AI. It provides trusted repositories of Python and R packages and has over 35 million users worldwide.
Rob Futrick is the CTO at Anaconda, and he joins the show to talk about the platform, the concept of an OS for AI, and more.
This episode is hosted by Lee Atchison. Lee Atchison is a software architect, author, and thought leader on cloud computing and application modernization. His best-selling book, Architecting for Scale (O’Reilly Media), is an essential resource for technical teams looking to maintain high availability and manage risk in their cloud environments.
Lee is the host of his podcast, Modern Digital Business, an engaging and informative podcast produced for people looking to build and grow their digital business with the help of modern applications and processes developed for today’s fast-moving business environment. Listen at mdb.fm. Follow Lee at softwarearchitectureinsights.com, and see all his content at leeatchison.com.
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Anaconda and Accelerating AI Development with Rob Futrick appeared first on Software Engineering Daily.
Panic has created games such as Firewatch and Untitled Goose Game. They recently ventured into gaming hardware with the Playdate. The console is unique for its inputs, which include a hand crank, and because Panic provides a free SDK, so anyone can develop games for it.
James Moore is a DevOps Engineer and Dave Hayden is an Engineer at Panic. They join the show to talk about developing the Playdate handheld.
Joe Nash is a developer, educator, and award-winning community builder, who has worked at companies including GitHub, Twilio, Unity, and PayPal. Joe got his start in software development by creating mods and running servers for Garry’s Mod, and game development remains his favorite way to experience and explore new technologies and concepts.
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Engineering the Playdate Gaming Handheld with James Moore and Dave Hayden appeared first on Software Engineering Daily.
Machine learning models learn patterns and relationships from data to make predictions or decisions. The quality of the data influences how well these models can represent and generalize from the data.
Nihit Desai is the Co-founder and CTO at Refuel.ai. The company is using LLMs for tasks such as data labeling, cleaning, and enrichment. He joins the show to talk about the platform, and how to manage data in the current AI era.
Sean’s been an academic, startup founder, and Googler. He has published works covering a wide range of topics from information visualization to quantum computing. Currently, Sean is Head of Marketing and Developer Relations at Skyflow and host of the podcast Partially Redacted, a podcast about privacy and security engineering. You can connect with Sean on Twitter @seanfalconer .
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Using LLMs for Training Data Preparation with Nihit Desai appeared first on Software Engineering Daily.
Simplifying Application Development Security
Security is an integral and often challenging component in application development. Developers focus on the functionality of the frontend and backend, but they may be unaware of potential security design flaws in their implementations and APIs. OAuth and OpenID Connect (OIDC) provide a standardized security framework for protecting applications.
Authlete is a service solution that streamlines development of security components. Software Engineering Daily’s Gregor Vand recently spoke with the Principal Architect at Authlete, Justin Richer, to discuss common authorization, identity, and security challenges, and the solution landscape. You can find their full conversation here.
The Gap Between Developers and Security Professionals
Developers’ interest, and often their time, is focused on adding functionality to applications. The security of these systems can sometimes seem obtuse, since security is a specialty that many are not totally familiar or comfortable with. As a consequence, design problems often emerge as applications are built.
“Sometimes, the security team shows up and says, you can’t connect everything together because that’s not secure,” explained Authlete’s Justin Richer. Security professionals often start with the desire to lock the system down and protect confidential information. Consequently, security gets in the way of the application developer, who wants to provide functionality to connect data, people, and processes. The functionality and security viewpoints may possibly clash because their goals are different.
Security Systems Have to be Collaborative
As a result, a fresh outlook and approach are needed. As Gregor noted, “the juxtaposition of collaboration and security does not initially sound like they can coexist, but they have to.”
Humans use the security solutions, and often how people interface with these products is not in the way that vendors designed or even considered. So, enterprises must create security checks that keep information secure but do not prevent people from completing their work, and this is often a difficult balancing act.
What are OAuth and OpenID Connect?
Two key building blocks of modern application security are OAuth, from the IETF, and OpenID Connect, from the OpenID Foundation. Each of these standards plays a key role in ensuring security, but the specifications can be challenging for developers to work with.
While often thought of as an authorization protocol, OAuth is fundamentally a delegation protocol. “OAuth excels whenever you have multiple systems and need to provide an abstract security layer,” noted Authlete’s Justin Richer. In applying a delegation protocol, a user possesses a set of system rights that perform certain tasks, such as the ability to access a record or update certain metadata. Users delegate specific subsets of their rights to applications that perform them on their behalf. How does OAuth accomplish this? OAuth creates an artifact called an access token that encompasses not only the end user’s rights but also the identity of the delegated software.
Here are the steps in the delegation process:
The OAuth delegation process. Image from OAuth 2 In Action by Justin Richer and Antonio Sanso. Manning Publications 2017. Used with permission.A user, known as the Resource Owner (RO) in OAuth terminology, has access to an API, known as the Protected Resource hosted on the Resource Server (RS). The RO wants a piece of software, known as the Client, to act on their behalf at the RS. The RO can authenticate to the system to prove who they are and that they have access, but we don’t want the RO to give those credentials to the Client. OAuth provides an Authorization Server (AS) to facilitate the RO giving the client delegated access, through the use of an access token. The access token represents the combination of all the parties in the OAuth protocol and the access being given, and it can be used by the Client to call the RS.
The OAuth standard simplifies typical API integration work by allowing the Client and RS to never deal with the user’s credentials, and it allows the user to be very deliberate about what kinds of access they want to give the Client application.
The second component, OpenID Connect, works with OAuth. OAuth enables users to securely delegate certain rights to pieces of software, but OAuth does not tell the software who the user is. OpenID Connect works by allowing the user to delegate their own identity information to the client software from the AS, which becomes an Identity Provider (IdP) in OIDC. The IdP provides information about who the user is alongside the access token from OAuth. “Let’s say an app needs all of the extended profile information, such as address, email, and other personal data. A developer writes an API call to do that. That API call is protected by an OAuth access token and it’s the same OAuth access token that I got when I made the call that said who is the user. That access token could also be used for many other functions: getting their calendar information, looking at their bank account history, checking their health record, or any other type of transaction. All these features are possible, but developers need to create them in order to use them.”
A Hosted Security Solution
When building out a protected system, developers need to have dedicated components like the AS to provide key security functionalities. Building an OAuth AS and an OIDC IdP is a formidable task, but many deployments need a level of flexibility and power that only building can provide. But how could you go about building such an important security component?
Authlete is a unique product because it’s a hosted service that provides OAuth and OpenID Connect support functions. What is different from other services is that Authlete does not host the entire platform that handles user authentication, accounts, or attributes. Instead, it supplies support for the OAuth and OpenID Connect protocol pieces where and when they are needed.
“Authlete really shines in the space where developers want to build out something custom and have it run in their environment and programming language,” explained Authlete’s Richer. A developer needs to build an IdP or AS. A request comes in to the developer’s implementation, say a token endpoint request or an authorization endpoint request. The software then calls the Authlete service, which examines the request: Is this request formed correctly? Is everything formatted properly? Which extensions are valid? What should the response be?
Authlete provides developers with an SDK that features an OAuth library they can call and use as needed, but instead of being a static library, “the solution is backed by a live service,” said Authlete’s Richer. Authlete stores the protocol state, which allows it to manage data over time. It handles tokens, keys, and other information so the application developer doesn’t need to account for these directly. Authlete also provides libraries to ease integration, “our libraries turn around and they call the right endpoint with a properly formatted REST request. The API itself is really straightforward.” Some of Authlete’s largest customers have been able to take advantage of this by integrating directly with the API without needing to use an SDK, which wasn’t available in their preferred development platform.
In essence, the developer builds their own authorization server. They provide the application rights and privileges and the OAuth and OpenID parts. Therefore, they concentrate on shipping the features of their application or service. The Authlete service provides only the security layers that matter to their applications.
As a result, instead of taking an off-the-shelf software project and building their own security system on top of it, developers have a world-class system on which they build out their own customized functionality. Nor do developers need to give over all control to a fully hosted service. With the Authlete product, customers retain the control and flexibility that a custom solution provides but don’t have to become experts in the details of the interoperability layer that OAuth and OpenID provide.
Prioritizing Security and Data Control
The solution has found adoption in multiple industries, with particular use in the banking industry. “In the financial sector, Authlete gives enterprises the ability to hold all of the sensitive information close to themselves,” explained Richer. “We don’t store user accounts. We don’t store names and passwords and addresses and account numbers and all of that other stuff. Instead, they tell us, I need an access token for the following subject identifier with the following rights and we deliver it.” Privacy-driven regulations and demand for privacy protections from consumers is changing how companies architect and deploy their systems, especially with regard to hosted services. Letting go of personal data to a cloud service is not a choice to be taken lightly, especially in highly regulated verticals. Authlete’s semi-hosted service architecture allows its customers to retain control over sensitive financial data and provide service that is hosted and controlled by the customer’s systems, while at the same time providing a state-of-the-art implementation of security protocols to protect these systems.
Security is an important but difficult aspect of modern systems, and deploying security protocols like OAuth and OIDC brings its own benefits and challenges. At the end of the day, developers want to provide the best functionality for their users, and Authlete provides a compelling and unique approach to securing that functionality.
Check out https://events.authlete.com/sed to try out Authlete for an extended 90-day free trial.
Full Disclosure: Authlete is a sponsor of Software Engineering Daily
The post Making OAuth and OIDC Accessible to Developers appeared first on Software Engineering Daily.
Kentik is a network observability platform that focuses on letting users easily ask questions and get answers about their network.
Avi Freedman is the CEO of Kentik and he joins the podcast to talk about the platform, his observability philosophy, the role of AI in observability, and much more.
Full Disclosure: This episode is sponsored by 10K Media (Kentik).**
This episode is hosted by Lee Atchison. Lee Atchison is a software architect, author, and thought leader on cloud computing and application modernization. His best-selling book, Architecting for Scale (O’Reilly Media), is an essential resource for technical teams looking to maintain high availability and manage risk in their cloud environments.
Lee is the host of his podcast, Modern Digital Business, an engaging and informative podcast produced for people looking to build and grow their digital business with the help of modern applications and processes developed for today’s fast-moving business environment. Listen at mdb.fm. Follow Lee at softwarearchitectureinsights.com, and see all his content at leeatchison.com.
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post AI-Driven Observability at Kentik with Avi Freedman appeared first on Software Engineering Daily.
Solid.js is a popular JavaScript framework known for its reactive and efficient rendering system. Instead of using a Virtual DOM, it compiles its templates to real DOM nodes and updates them with fine-grained reactions.
Ryan Carniato is the creator of SolidJS, and he joins the show to talk about the framework.
Taylor Nodell is a software engineer specializing in front end web technologies. He’s particularly passionate about accessibility and how the internet is changing our relationships to each other. He spends his weekends hiking in the Australian wilderness and making heavy metal.
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post SolidJS with Ryan Carniato appeared first on Software Engineering Daily.
Sammy Steele is a Senior Staff Engineer at Figma, and the tech lead for their databases team. She previously worked at Dropbox, where she built out their petabyte-scale metadata storage and search systems.
Sammy recently published a blog called “How Figma’s databases team lived to tell the scale”. The blog went viral and made it to the top of Hacker News. We invited Sammy on the podcast to learn more, and she is our guest today.
Check out Figma Config at https://config.figma.com/.
Sean’s been an academic, startup founder, and Googler. He has published works covering a wide range of topics from information visualization to quantum computing. Currently, Sean is Head of Marketing and Developer Relations at Skyflow and host of the podcast Partially Redacted, a podcast about privacy and security engineering. You can connect with Sean on Twitter @seanfalconer .
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Database Scaling at Figma with Sammy Steele appeared first on Software Engineering Daily.
Autonomous vehicle engineering is a huge challenge and requires the integration of many different technologies. A self-driving car needs data from multiple sensors, ML models to process that data, engineering to couple software and mechanical systems, and much more.
Ian Williams is a Senior Staff Software Engineer at Cruise, and before that worked at Google, Lyft, and eBay. He joins the show to talk about the diverse engineering challenges and strategies associated with building self-driving cars.
This episode is hosted by Tyson Kunovsky. Tyson is the co-founder and CEO of AutoCloud, an infrastructure as code platform. He is originally from South Africa, and has a background in software engineering and cloud development. When he’s not busy designing new GitOps workflows, he enjoys skiing, riding motorcycles, and reading sci-fi books. Check the show notes for more information on Tyson’s work, and where to find him.
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Bonus Episode: How to Build a Self-Driving Car with Ian Williams appeared first on Software Engineering Daily.
Ben Huber is a security engineer who has worked at companies including Crypto.com and Blackpanda. He joins the podcast to talk about his career, penetration or “pen” testing, attack vectors, security tools, and much more.
Gregor Vand is a security-focused technologist, and is the founder and CTO of Mailpass. Previously, Gregor was a CTO across cybersecurity, cyber insurance and general software engineering companies. He has been based in Asia Pacific for almost a decade and can be found via his profile at vand.hk.
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Security Engineering with Ben Huber appeared first on Software Engineering Daily.
George Mathew is a Managing Director at Insight Partners where he invested in Weights & Biases, Jasper, and others.
He has over 20 years of experience developing high-growth technology startups including most recently being CEO of Kespry.
George joins the podcast to talk about his path to becoming an investor, his data-first thesis about investment, the AI business landscape, his book recommendations, and more.
Starting her career as a software developer, Jocelyn Houle is now a Senior Director of Product Management at Securiti.ai, a unified data protection and governance platform. Before that, she was an Operating Partner at Capital One Ventures investing in data and AI startups. Jocelyn has been a founder of two startups and a full life cycle, technical product manager at large companies like Fannie Mae, Microsoft and Capital One. Follow Jocelyn on LinkedIn or Twitter @jocelynbyrne.
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Startup Investing with George Mathew appeared first on Software Engineering Daily.
Event-driven architecture is a software design pattern where system components communicate through events that are generated by producers, and pushed to consumers. This design is often contrasted with a request-driven architecture, where components communicate with each other by sending requests and receiving responses.
Hookdeck is an event gateway for receiving, processing, and delivering asynchronous messages. It centralizes and streamlines communication between services, like a 3rd party API such as Shopify or Stripe, and internal endpoints or other APIs.
Alex Bouchard is the Co-founder of Hookdeck. He joins the podcast to talk about event-driven architecture, building event bridges, expanding Hookdeck beyond webhooks, and much more.
Full Disclosure: This episode is sponsored by Hookdeck.
Sean’s been an academic, startup founder, and Googler. He has published works covering a wide range of topics from information visualization to quantum computing. Currently, Sean is Head of Marketing and Developer Relations at Skyflow and host of the podcast Partially Redacted, a podcast about privacy and security engineering. You can connect with Sean on Twitter @seanfalconer .
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Hookdeck and Building an Event Gateway with Alex Bouchard appeared first on Software Engineering Daily.
OAuth is an open standard for access delegation. It lets users grant websites or applications access to their information on other websites, but without giving away passwords.
OpenID Connect is an identity layer on top of OAuth. Even if you haven’t programmed using OAuth and OpenID Connect, you’ve certainly used them for authentication on Google, Facebook, Spotify, and countless other services.
Authlete is a service that provides a set of APIs to implement OAuth authorization servers, and OpenID Connect identity providers.
Justin Richer is the Principal Architect at Authlete and is part of the working group that developed OAuth 2.0. He joins the podcast to talk about the history of OAuth, OAuth as a delegation protocol, the Authlete API, and much more.
Check out https://events.authlete.com/sed to try out Authlete for an extended 90-day free trial.
Full Disclosure: This episode is sponsored by Authlete.
Gregor Vand is a security-focused technologist, and is the founder and CTO of Mailpass. Previously, Gregor was a CTO across cybersecurity, cyber insurance and general software engineering companies. He has been based in Asia Pacific for almost a decade and can be found via his profile at vand.hk.
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Authlete and Making OAuth Accessible with Justin Richer appeared first on Software Engineering Daily.
Today, you can access Netflix on virtually any device. For a Netflix user, this seamless experience can be easy to take for granted, but it requires an enormous engineering effort.
Jay Phelps is a Senior Software Engineer at Netflix where he works on Shared Client Foundations. He joins the show to talk about the start of his career, his work at Netflix, and much more.
Josh Goldberg is an independent full time open source developer in the TypeScript ecosystem. He works on projects that help developers write better TypeScript more easily, most notably on typescript-eslint: the tooling that enables ESLint and Prettier to run on TypeScript code. Josh regularly contributes to open source projects in the ecosystem such as ESLint and TypeScript. Josh is a Microsoft MVP for developer technologies and the author of the acclaimed Learning TypeScript (O’Reilly), a cherished resource for any developer seeking to learn TypeScript without any prior experience outside of JavaScript. Josh regularly presents talks and workshops at bootcamps, conferences, and meetups to share knowledge on TypeScript, static analysis, open source, and general frontend and web development.
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Netflix Engineering with Jay Phelps appeared first on Software Engineering Daily.
Snowflake is one of the most prominent platforms for interacting with data and building data-intensive applications.
Dan Myers works in Developer Relations at Snowflake and he joins the show to talk about the future of application development, and building native data apps on the platform.
Sean’s been an academic, startup founder, and Googler. He has published works covering a wide range of topics from information visualization to quantum computing. Currently, Sean is Head of Marketing and Developer Relations at Skyflow and host of the podcast Partially Redacted, a podcast about privacy and security engineering. You can connect with Sean on Twitter @seanfalconer .
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Data Applications on Snowflake with Daniel Myers appeared first on Software Engineering Daily.
Kaze Emanuar is a ROM hacker who’s famous for the array of mods he’s made for Super Mario 64. He’s implemented remarkable optimization to the decompiled game code, even pushing Super Mario 64 to run at 60 frames per second.
Kaze joins the show to talk about his interest in Super Mario 64, ROM hacking, the N64 architecture, coding in assembly, and more. Be sure to check out Kaze’s YouTube channel to see his work, including breakdowns of how he accomplished his optimizations.
Joe Nash is a developer, educator, and award-winning community builder, who has worked at companies including GitHub, Twilio, Unity, and PayPal. Joe got his start in software development by creating mods and running servers for Garry’s Mod, and game development remains his favorite way to experience and explore new technologies and concepts.
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Bonus Episode: Optimizing Nintendo 64 Code with Kaze Emanuar appeared first on Software Engineering Daily.
Managing data and access to data is one of the biggest challenges that a company can face. It’s common for data to be siloed into independent sources that are difficult to access in a unified and integrated way.
One approach to solving this problem is to build a layer on top of the heterogenous data sources. This layer can serve as an interface for the data and provide governance and access control.
Cube is a semantic layer between the data source and data applications. Artyom Keydunov is the founder of Cube and he joins the show to talk about the approach Cube is taking.
This episode is hosted by Lee Atchison. Lee Atchison is a software architect, author, and thought leader on cloud computing and application modernization. His best-selling book, Architecting for Scale (O’Reilly Media), is an essential resource for technical teams looking to maintain high availability and manage risk in their cloud environments.
Lee is the host of his podcast, Modern Digital Business, an engaging and informative podcast produced for people looking to build and grow their digital business with the help of modern applications and processes developed for today’s fast-moving business environment. Listen at mdb.fm. Follow Lee at softwarearchitectureinsights.com, and see all his content at leeatchison.com.
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post A Semantic Layer for Data with Artyom Keydunov appeared first on Software Engineering Daily.
Blasphemous and Blasphemous II are Metroidvania action-adventure games developed by the Spanish studio, The Game Kitchen. The games have a stunning, distinctive pixel art style and atmospheric world which is inspired by Spanish folklore and religious themes. They are known for their challenging combat and intricate level design.
David Erosa is the Lead Producer and Dani Márquez is a Senior Programmer on Blasphemous II. David and Dani join the show today to talk about designing the game systems, the game’s development framework, engineering character movement, console optimizations, and much more.
Joe Nash is a developer, educator, and award-winning community builder, who has worked at companies including GitHub, Twilio, Unity, and PayPal. Joe got his start in software development by creating mods and running servers for Garry’s Mod, and game development remains his favorite way to experience and explore new technologies and concepts.
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
Watch the video episode here:
The post Developing Blasphemous II with David Erosa and Dani Márquez appeared first on Software Engineering Daily.
Python is famed for it’s intuitive syntax, powerful standard library, and rich ecosystem of packages and frameworks. It’s also dynamically typed which is part of what makes the language so accessible.
Paul Everitt is the Python and Web Developer Advocate at JetBrains. He joins the show to talk about developing the PyCharm IDE, the challenge of static analysis in Python, browser-based IDEs, and more.
Sean’s been an academic, startup founder, and Googler. He has published works covering a wide range of topics from information visualization to quantum computing. Currently, Sean is Head of Marketing and Developer Relations at Skyflow and host of the podcast Partially Redacted, a podcast about privacy and security engineering. You can connect with Sean on Twitter @seanfalconer .
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Building the PyCharm IDE at JetBrains with Paul Everitt appeared first on Software Engineering Daily.
All robust technology platforms require testing to ensure that features work as intended. In many cases, tests require data, but getting access to valid and high quality test data is a common challenge, especially when the technology runs on sensitive data. Realistically mimicking data that would normally contain sensitive financial or personal information is not easy.
Tonic.ai was started in 2018 to provide developer tools to transform production data into safe testing data. Andrew Colombi is the CTO and Adam Kamor is the Head of Engineering at Tonic. They join the show to talk about creating realistic synthetic data, data de-identification, validating LLM RAG output, Tonic’s subsetting engine, and much more.
Full Disclosure: This episode is sponsored by Tonic.**
Gregor Vand is a security-focused technologist, and is the founder and CTO of Mailpass. Previously, Gregor was a CTO across cybersecurity, cyber insurance and general software engineering companies. He has been based in Asia Pacific for almost a decade and can be found via his profile at vand.hk.
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Tonic and Synthetic Data with Andrew Colombi and Adam Kamor appeared first on Software Engineering Daily.
Netlify is a popular hosting platform that provides build, deploy, and serverless backend services for web apps. The platform enables deployment directly from source files stored in a version control system like GitHub.
Erica Pisani is a Senior Software Engineer at Netlify. She joins the show to talk about how she got started at Netlify, edge computing, edge functions, private integrations, and more.
Josh Goldberg is an independent full time open source developer in the TypeScript ecosystem. He works on projects that help developers write better TypeScript more easily, most notably on typescript-eslint: the tooling that enables ESLint and Prettier to run on TypeScript code. Josh regularly contributes to open source projects in the ecosystem such as ESLint and TypeScript.
Josh is a Microsoft MVP for developer technologies and the author of the acclaimed Learning TypeScript (O’Reilly), a cherished resource for any developer seeking to learn TypeScript without any prior experience outside of JavaScript. Josh regularly presents talks and workshops at bootcamps, conferences, and meetups to share knowledge on TypeScript, static analysis, open source, and general frontend and web development.
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
Watch the video episode here:
The post Netlify and Edge Computing with Erica Pisani appeared first on Software Engineering Daily.
Language and compiler design are fundamental aspects of computer science. High-level languages are how most developers interact with computers, so it’s hard to overstate the significance of compiler engineering or the aesthetics of language syntax.
C# is a general-purpose high-level language that was created by Anders Hejlsberg at Microsoft in 2000, and was open-sourced in 2014.
Jared Parsons is the Principal Developer Lead on the C# Language Team at Microsoft, where he’s worked for 20 years. He joins the show to talk about how the C# compiler is developed, the compiler as an API, language creation as an art, the experience of open-sourcing C#, and much more.
Sean’s been an academic, startup founder, and Googler. He has published works covering a wide range of topics from information visualization to quantum computing. Currently, Sean is Head of Marketing and Developer Relations at Skyflow and host of the podcast Partially Redacted, a podcast about privacy and security engineering. You can connect with Sean on Twitter @seanfalconer .
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post C# Compiler and Language Design at Microsoft with Jared Parsons appeared first on Software Engineering Daily.
Sphinx Bio develops computational tools to accelerate scientific discovery. The company is focused on addressing the computational data analysis bottleneck by enabling scientists to do the analysis themselves.
Nicholas Larus-Stone is the founder of Sphinx. He joins the show to talk about being a computer scientist at the interface with biology, the data analysis bottleneck in biology, designing a software tool for scientists, their go-to-market strategy, and more.
Nicholas also started Bits in Bio which is a popular community for people building software for science. You can check out their upcoming meetups and hackathons at bitsinbio.org.
Sean’s been an academic, startup founder, and Googler. He has published works covering a wide range of topics from information visualization to quantum computing. Currently, Sean is Head of Marketing and Developer Relations at Skyflow and host of the podcast Partially Redacted, a podcast about privacy and security engineering. You can connect with Sean on Twitter @seanfalconer .
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
Watch the video episode here:
The post Biotech Special: Life Science Data Analysis with Nicholas Larus-Stone appeared first on Software Engineering Daily.
Java is one of the top programming languages used today and Java code is ubiquitous. A key factor to the overall success of Java is the Spring framework, which is the most common framework for Java development.
Spring is an open-source comprehensive application framework on top of the Java Virtual Machine that provides a consistent programming and configuration model.
Ryan Morgan is a Senior Director and Mark Pollack is a Senior Staff Engineer at VMware Tanzu, a division of Broadcom. They join the show to talk about the origins of Spring, the problems it solves, building APIs for AI models in Java, and much more.
Full Disclosure: This episode is sponsored by VMware.**
This episode is hosted by Lee Atchison. Lee Atchison is a software architect, author, and thought leader on cloud computing and application modernization. His best-selling book, Architecting for Scale (O’Reilly Media), is an essential resource for technical teams looking to maintain high availability and manage risk in their cloud environments.
Lee is the host of his podcast, Modern Digital Business, an engaging and informative podcast produced for people looking to build and grow their digital business with the help of modern applications and processes developed for today’s fast-moving business environment. Listen at mdb.fm. Follow Lee at softwarearchitectureinsights.com, and see all his content at leeatchison.com.
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post VMware’s Spring AI with Ryan Morgan and Mark Pollack appeared first on Software Engineering Daily.
Convex is a serverless backend platform to simplify fullstack application development. Its underlying database is written in Rust, and it uses TypeScript to integrate with reactive UI frameworks.
The platform is growing, which has presented new reasons to make the code open source, and Convex recently released the source code for a self-managed version of their platform.
The question of whether or not to open source is one that many companies consider. We were curious to explore the decision making landscape around open sourcing, and today are speaking with James Cowling, the Co-Founder and CTO at Convex.
James joins the show to talk about prioritizing developer experience, the choice to open-source, risks of open sourcing, software licenses, and much more.
Full Disclosure: This episode is sponsored by Convex.**
Gregor Vand is a security-focused technologist, and is the founder and CTO of Mailpass. Previously, Gregor was a CTO across cybersecurity, cyber insurance and general software engineering companies. He has been based in Asia Pacific for almost a decade and can be found via his profile at vand.hk.
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Going Open Source at Convex with James Cowling appeared first on Software Engineering Daily.
Proteins are nanomachines inside cells and perform the incredible array of tasks required for cells to function. They are composed of a chain of hundreds to thousands of amino acid “building blocks”. Peptides are similar to proteins, but have only about 3 to 30 amino acids. Their smaller size gives them distinct properties that are useful in therapeutic applications.
Menten AI is using cutting-edge generative methods to engineer new peptide therapeutics, and are backed by Y Combinator, Khosla Ventures, and others.
Patrick Finneran is the Associate Director of Biochemistry at Menten. He joins the show to tell us about the drug development process, handling noisy biological data, building a hybrid team of software engineers and biologists, and more.
Sean’s been an academic, startup founder, and Googler. He has published works covering a wide range of topics from information visualization to quantum computing. Currently, Sean is Head of Marketing and Developer Relations at Skyflow and host of the podcast Partially Redacted, a podcast about privacy and security engineering. You can connect with Sean on Twitter @seanfalconer .
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
Watch the video episode here:
The post Biotech Special: Computational Drug Discovery with Patrick Finneran appeared first on Software Engineering Daily.
GitHub Copilot is an AI tool to assist software developers by autocompleting code. It is no understatement to say it has already transformed how developers write code.
Adrián Mato Gondelle leads the Design team for GitHub Copilot. In this episode, recorded in 2023, Adrián joined the podcast to talk about his work.
Jordi Mon Companys is a product manager and marketer that specializes in software delivery, developer experience, cloud native and open source. He has developed his career at companies like GitLab, Weaveworks, Harness and other platform and devtool providers. His interests range from software supply chain security to open source innovation. You can reach out to him on Twitter at @jordimonpmm
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Design at GitHub Copilot with Adrián Mato Gondelle appeared first on Software Engineering Daily.
Corbado is an authentication platform that provides APIs for developers to replace passwords with passkeys such as Face ID or Touch ID.
Vincent Delitz is a Co-Founder at Corbado and he joins the show to talk about the platform, the changing authentication landscape, the challenge of session management with passkeys, and more.
Gregor Vand is a security-focused technologist, and is the founder and CTO of Mailpass. Previously, Gregor was a CTO across cybersecurity, cyber insurance and general software engineering companies. He has been based in Asia Pacific for almost a decade and can be found via his profile at vand.hk.
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Biometric Authentication with Vincent Delitz appeared first on Software Engineering Daily.
The growing use of large datasets and ML in the life sciences has created new demand for data technologies. Snowflake is a cloud-based data warehousing company that provides a platform for storing and analyzing large volumes of data.
Harini Gopalakrishnan is the Field CTO of Life Sciences at Snowflake. She joins the show to talk about data challenges and solutions in biotech.
Sean’s been an academic, startup founder, and Googler. He has published works covering a wide range of topics from information visualization to quantum computing. Currently, Sean is Head of Marketing and Developer Relations at Skyflow and host of the podcast Partially Redacted, a podcast about privacy and security engineering. You can connect with Sean on Twitter @seanfalconer .
Please click here to see the transcript of this episode.
Watch the video episode here.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Biotech Special: Life Sciences at Snowflake with Harini Gopalakrishnan appeared first on Software Engineering Daily.
Apache Iceberg is an open source high-performance format for huge data tables. Iceberg enables the use of SQL tables for big data, while making it possible for engines like Spark and Hive to safely work with the same tables, at the same time.
Iceberg was started at Netflix by Ryan Blue and Dan Weeks, and was open-sourced and donated to the Apache Software Foundation in November 2018. It has now been adopted at many other companies including Airbnb, Apple, and Lyft.
Ryan Blue joins the podcast to describe the origins of Iceberg, how it works, the problems it solves, collaborating with Apple and others to open-source it, and more.
This episode is hosted by Lee Atchison. Lee Atchison is a software architect, author, and thought leader on cloud computing and application modernization. His best-selling book, Architecting for Scale (O’Reilly Media), is an essential resource for technical teams looking to maintain high availability and manage risk in their cloud environments.
Lee is the host of his podcast, Modern Digital Business, an engaging and informative podcast produced for people looking to build and grow their digital business with the help of modern applications and processes developed for today’s fast-moving business environment. Listen at mdb.fm. Follow Lee at softwarearchitectureinsights.com, and see all his content at leeatchison.com.
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Iceberg at Netflix and Beyond with Ryan Blue appeared first on Software Engineering Daily.
Godot is a free, open-source game engine that’s growing rapidly in popularity. Ramatak is a new public benefit company founded by Godot engine veterans Hein-Pieter van Braam and Ariel Manzur. The goal of Ramatak is to help make Godot the number one choice for creating, deploying, and monetizing games on iOS and Android.
Hein-Pieter joins the show today to talk about his early career in Linux infrastructure, the shift to working on game engines, and his current work on Ramatak.
Joe Nash is a developer, educator, and award-winning community builder, who has worked at companies including GitHub, Twilio, Unity, and PayPal. Joe got his start in software development by creating mods and running servers for Garry’s Mod, and game development remains his favorite way to experience and explore new technologies and concepts.
Please click here to see the transcript of this episode.
Watch the video episode here.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Bringing Godot to Mobile with Hein-Pieter van Braam appeared first on Software Engineering Daily.
NextFlow is a tool for managing scientific computation workflows. It’s increasingly popular for bioinformatics, computational biology, and other life science applications.
Evan Floden is the Co-Founder and CEO of Seqera Labs which develops NextFlow. He joins the show today to talk about his background as a scientist and engineer, the modular design of NextFlow pipelines, the unique challenges of genomic sequence data formats, and more.
Sean’s been an academic, startup founder, and Googler. He has published works covering a wide range of topics from information visualization to quantum computing. Currently, Sean is Head of Marketing and Developer Relations at Skyflow and host of the podcast Partially Redacted, a podcast about privacy and security engineering. You can connect with Sean on Twitter @seanfalconer .
Please click here to see the transcript of this episode.
Watch the video episode here.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Biotech Special: Scientific Computing Pipelines with Evan Floden appeared first on Software Engineering Daily.
Stately is a web-based drag and drop editor for collaboratively developing code, diagrams, and documentation. Laura Kalbag is the Developer Advocate at Stately and she joins the show today to talk about Stately, state machines, building good documentation, and more.
Josh Goldberg is an independent full time open source developer in the TypeScript ecosystem. He works on projects that help developers write better TypeScript more easily, most notably on typescript-eslint: the tooling that enables ESLint and Prettier to run on TypeScript code. Josh regularly contributes to open source projects in the ecosystem such as ESLint and TypeScript. Josh is a Microsoft MVP for developer technologies and the author of the acclaimed Learning TypeScript (O’Reilly), a cherished resource for any developer seeking to learn TypeScript without any prior experience outside of JavaScript. Josh regularly presents talks and workshops at bootcamps, conferences, and meetups to share knowledge on TypeScript, static analysis, open source, and general frontend and web development.
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Stately with Laura Kalbag appeared first on Software Engineering Daily.
The power of 3D graphics hardware and rendering technology is improving at an astonishing pace. To achieve high graphical fidelity, assets that compose 3D worlds must feature an ever-increasing level of detail.
Andrew Price is the founder of Poliigon, which is an asset production studio and store. Andrew also runs the highly popular Blender Guru YouTube channel where he teaches viewers how to use Blender.
Andrew joins the show to talk about how different virtual assets are made, building his company, the impact of AI on graphics production, whether graphics have achieved photorealism, and much more.
Joe Nash is a developer, educator, and award-winning community builder, who has worked at companies including GitHub, Twilio, Unity, and PayPal. Joe got his start in software development by creating mods and running servers for Garry’s Mod, and game development remains his favorite way to experience and explore new technologies and concepts.
Please click here to see the transcript of this episode.
Watch the video episode here.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Graphical Photorealism with Andrew Price the Blender Guru appeared first on Software Engineering Daily.
Antibodies are a type of protein molecule produced by the immune system. They recognize and attach to other molecules with remarkable precision. Typically antibodies target foreign objects, like viruses, to mark them for destruction. However, they can also be engineered to treat diseases like cancer, and they are one of the fastest growing classes of drugs.
Recently, AI-driven antibody engineering has taken off, and BigHat Bio is one of the leaders of this revolution.
Eddie Abrams is the Chief Information Officer at BigHat. He joins the show to talk about protein engineering, what’s different about software development in biotech, how the engineering team is organized at BigHat, and more.
Sean’s been an academic, startup founder, and Googler. He has published works covering a wide range of topics from information visualization to quantum computing. Currently, Sean is Head of Marketing and Developer Relations at Skyflow and host of the podcast Partially Redacted, a podcast about privacy and security engineering. You can connect with Sean on Twitter @seanfalconer .
Please click here to see the transcript of this episode.
Watch the video episode here
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Biotech Special: AI Protein Engineering with Eddie Abrams appeared first on Software Engineering Daily.
Portal is a 2007 game developed by Valve, where the player encounters puzzles that must be solved using the “portal gun”, a device that can create inter-spatial portals between surfaces.
Portal 64 is an open-source re-write of Portal that can be run on original Nintendo 64 hardware. The game was developed by James Lambert and gained enormous praise as a technical and creative achievement. The project was ended in 2024 at the request of Valve.
James joins the show to talk about the process of developing an N64 games, the toolchain for building Portal 64, its physics engine, the design of the N64 cartridge, and much more. Be sure to check out James’ YouTube channel to see his work and get updates about his future projects.
Joe Nash is a developer, educator, and award-winning community builder, who has worked at companies including GitHub, Twilio, Unity, and PayPal. Joe got his start in software development by creating mods and running servers for Garry’s Mod, and game development remains his favorite way to experience and explore new technologies and concepts.
Please click here to see the transcript of this episode.
Watch the video episode here.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Portal 64 with James Lambert appeared first on Software Engineering Daily.
Waymo is an autonomous driving company that had its start as the Google Self-Driving Car Project.
David Margines is a Director of Product Management at Waymo and he joins the podcast to talk about Waymo today, the sensing technologies underpinning their cars, the huge impact of AI on their systems in recent years, and more.
This episode is hosted by Tyson Kunovsky. Tyson is the co-founder and CEO of AutoCloud, an infrastructure as code platform. He is originally from South Africa, and has a background in software engineering and cloud development. When he’s not busy designing new GitOps workflows, he enjoys skiing, riding motorcycles, and reading sci-fi books. Check the show notes for more information on Tyson’s work, and where to find him.
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Waymo and Autonomous Driving with David Margines appeared first on Software Engineering Daily.
Recursion is at the leading edge of applying AI and ML to drug development. The company exemplifies a new wave of “techbio” companies, that tightly couple compute and robotics with biology and chemistry. The task of decoding biology requires vast amounts of biological data and innovative strategies to make use of that data. It also requires close coordination between experts across a wide range of domains – from software to cell biology.
Imran Haque is the SVP of AI and Digital Sciences and Jordan Christensen is the SVP of Technology at Recursion. They join the show today to talk about the unique data engineering challenges in biology, the growing importance of automation, reshaping the drug discovery funnel, their partnership with NVIDIA, and much more.Sean’s been an academic, startup founder, and Googler. He has published works covering a wide range of topics from information visualization to quantum computing. Currently, Sean is Head of Marketing and Developer Relations at Skyflow and host of the podcast Partially Redacted, a podcast about privacy and security engineering. You can connect with Sean on Twitter @seanfalconer .
Please click here to see the transcript of this episode.
Watch the video episode here.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Biotech Special: ML at Recursion with Jordan Christensen and Imran Haque appeared first on Software Engineering Daily.
Producing 3D films, games and simulations is a complex process, often involving multiple teams and tools. At Pixar, pipeline engineers needed to write lots of glue code to integrate different workflows and file formats, which was a big challenge, and led them to create the Universal Scene Description, or OpenUSD. OpenUSD implements abstract data models for producing 3D worlds, and is now an open-source project.
Making full use of OpenUSD required a software framework. This motivated NVIDIA to create Omniverse, which is a modular development platform that enables individuals and teams to develop OpenUSD-based 3D workflows and applications.
Aaron Luk is the Director of Product Management for Omniverse, and was previously a software engineer at Pixar where he helped create OpenUSD. Aaron joins the show to talk about the origins of the technology, how it works, digital twins, industry impacts, and more.
To learn more about OpenUSD, check out the resources below:
OpenUSD Day at NVIDIA GTC: https://nvda.ws/3wsFJMg
Alliance for OpenUSD: https://nvda.ws/47Ro26n
Full Disclosure: NVIDIA is a sponsor of Software Engineering Daily
Sean’s been an academic, startup founder, and Googler. He has published works covering a wide range of topics from information visualization to quantum computing. Currently, Sean is Head of Marketing and Developer Relations at Skyflow and host of the podcast Partially Redacted, a podcast about privacy and security engineering. You can connect with Sean on Twitter @seanfalconer .
Please click here to see the transcript of this episode.
Watch the video episode here
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post NVIDIA and the Future of 3D Development with Aaron Luk appeared first on Software Engineering Daily.
SimpleWebAuthn is an open source TypeScript-centric pair of libraries – frontend and backend – that make it easier for devs to implement WebAuthn on the web.
Matthew Miller started the project in 2019 and it has grown in tandem with the popularization of WebAuthn. He joins the podcast today to talk about the history of the project starting from the first commit, the problems it solves, its design, and more.
Gregor Vand is a security-focused technologist, and is the founder and CTO of Mailpass. Previously, Gregor was a CTO across cybersecurity, cyber insurance and general software engineering companies. He has been based in Asia Pacific for almost a decade and can be found via his profile at vand.hk.
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post SimpleWebAuthn with Matthew Miller appeared first on Software Engineering Daily.
There is a revolution unfolding in biotech. The confluence of new biological methods like CRISPR, virtually unlimited computational capacity, and machine learning has fundamentally transformed our ability to engineer biology for wide-ranging applications.
Andreessen Horowitz, or a16z, is a venture capital firm that was founded by Marc Andreessen and Ben Horowitz.
Vijay Pande is a Founding General Partner at a16z, where he leads the firm’s investments focused on the cross section of biology and computer science, including areas such as digital therapeutics, cloud biology, and computational medicine.
He joins the podcast to talk about innovation in biotech and healthcare, the biotech startup landscape, the impact of AI, and much more.
Sean’s been an academic, startup founder, and Googler. He has published works covering a wide range of topics from information visualization to quantum computing. Currently, Sean is Head of Marketing and Developer Relations at Skyflow and host of the podcast Partially Redacted, a podcast about privacy and security engineering. You can connect with Sean on Twitter @seanfalconer .
Please click here to see the transcript of this episode.
Watch the video episode here
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Biotech Special: a16z and the Biotech Revolution with Vijay Pande appeared first on Software Engineering Daily.
oneAPI is an open standard for a unified API to be used across different computing accelerator architectures. This including GPUs, AI accelerators, and FPGAs.
The goal of oneAPI is to eliminate the need for developers to maintain separate code bases, multiple programming languages, tools, and workflows for each architecture.
James Reinders is an engineer at Intel and has experience with parallel computing spanning four decades. He joins the show today to talk about oneAPI.
This episode is hosted by Lee Atchison. Lee Atchison is a software architect, author, and thought leader on cloud computing and application modernization. His best-selling book, Architecting for Scale (O’Reilly Media), is an essential resource for technical teams looking to maintain high availability and manage risk in their cloud environments.
Lee is the host of his podcast, Modern Digital Business, an engaging and informative podcast produced for people looking to build and grow their digital business with the help of modern applications and processes developed for today’s fast-moving business environment. Listen at mdb.fm. Follow Lee at softwarearchitectureinsights.com, and see all his content at leeatchison.com.
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Building a Unified Hardware API at Intel with James Reinders appeared first on Software Engineering Daily.
A game engine is a system used to build and run games. Game engines let the programmer work at a high level of abstraction by providing interfaces for graphics, physics, and scripting.
Godot is an open source and free to use game engine, which makes it unusual. Its first release was in 2014 and its features and user base have grown steadily since then.
Emilio Coppola is the Executive Director at the Godot Foundation and he joins the show to talk about the design of Godot, its scripting language, open source in game development, and more.
To learn about the new features in the Godot 4.2 release check out this blog post.
Joe Nash is a developer, educator, and award-winning community builder, who has worked at companies including GitHub, Twilio, Unity, and PayPal. Joe got his start in software development by creating mods and running servers for Garry’s Mod, and game development remains his favorite way to experience and explore new technologies and concepts.
Please click here to see the transcript of this episode.
Watch the video episode here
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post The Godot Game Engine with Emilio Coppola appeared first on Software Engineering Daily.
Starburst is a data lake analytics platform. It’s designed to help users work with structured data at scale, and is built on the open source platform, Trino.
Adam Ferrari is the SVP of Engineering at Starburst. He joins the show to talk about Starburst, data engineering, and what it takes to build a data lake.
Full Disclosure: Starburst is a sponsor of Software Engineering DailySean’s been an academic, startup founder, and Googler. He has published works covering a wide range of topics from information visualization to quantum computing. Currently, Sean is Head of Marketing and Developer Relations at Skyflow and host of the podcast Partially Redacted, a podcast about privacy and security engineering. You can connect with Sean on Twitter @seanfalconer .
Please click here to see the transcript of this episode.
Watch the video episode here
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Building a Data Lake with Adam Ferrari appeared first on Software Engineering Daily.
Chess.com started in 2007 and grew steadily in the years following. The platform exploded in popularity during the pandemic, to the point that their servers struggled with the traffic. It was a great problem to have. Chess.com was instrumental in helping to elevate chess to its current height of mainstream popularity.
But how did Chess.com come to be, and how was the platform created?
Our guest today is Jay Severson who co-founded Chess.com and was its CTO. He joins the podcast to talk about the origins of the site, its development, scaling the platform, and what he’s working on today.
This episode is hosted by Lee Atchison. Lee Atchison is a software architect, author, and thought leader on cloud computing and application modernization. His best-selling book, Architecting for Scale (O’Reilly Media), is an essential resource for technical teams looking to maintain high availability and manage risk in their cloud environments.
Lee is the host of his podcast, Modern Digital Business, an engaging and informative podcast produced for people looking to build and grow their digital business with the help of modern applications and processes developed for today’s fast-moving business environment. Listen at mdb.fm. Follow Lee at softwarearchitectureinsights.com, and see all his content at leeatchison.com.
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Building Chess.com with Jay Severson appeared first on Software Engineering Daily.
Mastodon is an open source, decentralized social network. Eugen Rochko started building Mastodon in response to his dissatisfaction with centralized social networks like Facebook and Twitter. In the Mastodon model, users can run their own nodes, and other users can connect to them. You can follow users whose accounts reside in other nodes.
Eugen joins the show today to talk about the engineering behind the project, and more.
Josh Goldberg is an independent full time open source developer in the TypeScript ecosystem. He works on projects that help developers write better TypeScript more easily, most notably on typescript-eslint: the tooling that enables ESLint and Prettier to run on TypeScript code. Josh regularly contributes to open source projects in the ecosystem such as ESLint and TypeScript. Josh is a Microsoft MVP for developer technologies and the author of the acclaimed Learning TypeScript (O’Reilly), a cherished resource for any developer seeking to learn TypeScript without any prior experience outside of JavaScript. Josh regularly presents talks and workshops at bootcamps, conferences, and meetups to share knowledge on TypeScript, static analysis, open source, and general frontend and web development.
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Mastodon with Eugen Rochko appeared first on Software Engineering Daily.
Vercel provides a cloud platform to rapidly deploy web projects, and they develop the highly successful Next.js framework. The company recently made headlines when they announced v0 which is a generative AI tool to create React code from text prompts. The generated code uses open-source tools like Tailwind CSS and shadcn/ui.
Lee Robinson is the VP of Product at Vercel. He helps lead the product teams and focuses on developer experience on the platform. He joins the show to talk about Vercel, their AI SDK to easily connect frontend code with LLMs, the v0 AI tool, and more.
Sean’s been an academic, startup founder, and Googler. He has published works covering a wide range of topics from information visualization to quantum computing. Currently, Sean is Head of Marketing and Developer Relations at Skyflow and host of the podcast Partially Redacted, a podcast about privacy and security engineering. You can connect with Sean on Twitter @seanfalconer .
Please click here to see the transcript of this episode.
Watch the video episode here
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Vercel AI with Lee Robinson appeared first on Software Engineering Daily.
Blender is a free and open-source 3D graphics tool that was initially released in 1994 and just hit version 4.0. It’s one of the triumphs of open-source software development and is used for creating animated films, art, 3D games, and more.Sybren Stüvel is a Senior Software Developer at Blender. He joins the show today to talk about the history of Blender, its path tracing renderer, managing large scale render farms, the Blender data structure, Python scripting in Blender, and much more.
Joe Nash is a developer, educator, and award-winning community builder, who has worked at companies including GitHub, Twilio, Unity, and PayPal. Joe got his start in software development by creating mods and running servers for Garry’s Mod, and game development remains his favorite way to experience and explore new technologies and concepts.
Check out Blender’s Resources here:
Flamenco in 5 minutes
Scripting for Artists
4.0 release notes
Blender conference playlist
Please click here to see the transcript of this episode.
Watch the video episode here
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Blender with Sybren Stüvel appeared first on Software Engineering Daily.
Netflix needs no introduction and is renowned for its engineering talent.Shaundai Person is a Senior Software Engineer at Netflix, blogger, and conference speaker. She joins the show today to talk about getting her position at Netflix, developing internal tools at the company, the value of TypeScript, what makes a great software engineering manager, and more.
Josh Goldberg is an independent full time open source developer in the TypeScript ecosystem. He works on projects that help developers write better TypeScript more easily, most notably on typescript-eslint: the tooling that enables ESLint and Prettier to run on TypeScript code. Josh regularly contributes to open source projects in the ecosystem such as ESLint and TypeScript. Josh is a Microsoft MVP for developer technologies and the author of the acclaimed Learning TypeScript (O’Reilly), a cherished resource for any developer seeking to learn TypeScript without any prior experience outside of JavaScript. Josh regularly presents talks and workshops at bootcamps, conferences, and meetups to share knowledge on TypeScript, static analysis, open source, and general frontend and web development.
Please click here to see the transcript of this episode.
Watch the video episode here
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Netflix UIs at Scale with Shaundai Person appeared first on Software Engineering Daily.
Algolia is a platform that provides search as a service. The company was founded in 2012, was part of Y Combinator’s Winter 2014 class, and has become highly popular for integrating modern search functionality into web-facing services.Sean Mullaney is the CTO of Algolia and has worked at Google X, Stripe, and Zolando. He joins the show today to talk about Algolia, neural search, vector compression, search optimization, and more.
Sean’s been an academic, startup founder, and Googler. He has published works covering a wide range of topics from information visualization to quantum computing. Currently, Sean is Head of Marketing and Developer Relations at Skyflow and host of the podcast Partially Redacted, a podcast about privacy and security engineering. You can connect with Sean on Twitter @seanfalconer.
Please click here to see the transcript of this episode.
Watch the video episode here
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Algolia with Sean Mullaney appeared first on Software Engineering Daily.
Software security is a critical issue for everyone, but it takes on an entirely different dimension when your life, or the lives of others, depend on it. Consider the security needs of an environmentalist whistle blower inside a chemical corporation, or a human rights activist in Iran. Hyper-secure and fully anonymous operating systems are vital for many legitimate use cases. They are a double-edge sword though, and also empower nefarious actors.
Tails is an operating system designed to protect against surveillance and censorship. Our guest today is a member of the Tails group. For privacy reasons we will refer to him as ludo.
This episode is hosted by Lee Atchison. Lee Atchison is a software architect, author, and thought leader on cloud computing and application modernization. His best-selling book, Architecting for Scale (O’Reilly Media), is an essential resource for technical teams looking to maintain high availability and manage risk in their cloud environments.
Lee is the host of his podcast, Modern Digital Business, an engaging and informative podcast produced for people looking to build and grow their digital business with the help of modern applications and processes developed for today’s fast-moving business environment. Listen at mdb.fm. Follow Lee at softwarearchitectureinsights.com, and see all his content at leeatchison.com.
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Edward Snowden’s Operating System with REDACTED appeared first on Software Engineering Daily.
Security issues can often be traced back to small misconfigurations in a database or cloud service, or an innocent code commit. OpsHelm is a security platform that’s oriented around identifying and fixing these issues.
Kyle McCullough is the Co-Founder and CTO of OpsHelm and he has deep experience in backend and data engineering. He joins the show to talk about the challenges of security incident monitoring, prioritization, and response.
This episode is hosted by Tyson Kunovsky. Tyson is the co-founder and CEO of AutoCloud, an infrastructure as code platform. He is originally from South Africa, and has a background in software engineering and cloud development. When he’s not busy designing new GitOps workflows, he enjoys skiing, riding motorcycles, and reading sci-fi books. Check the show notes for more information on Tyson’s work, and where to find him.
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post OpsHelm with Kyle McCullough appeared first on Software Engineering Daily.
Jodie Burchell is the Data Science Developer Advocate at JetBrains, which makes integrated development environments or, IDEs, for many major languages. After observing the rapid growth of the AI coding assistant landscape, the company recently announced integration of an AI assistant into their IDEs.Jodie joins the show today to talk about why the company decided to take this step, the design challenges of adding AI tools to software products, and the team’s particular interest in auto-generating code documentation. Jodie also talks about the different types of language AIs, how AI tools will impact software development, and more.Sean’s been an academic, startup founder, and Googler. He has published works covering a wide range of topics from information visualization to quantum computing. Currently, Sean is Head of Marketing and Developer Relations at Skyflow and host of the podcast Partially Redacted, a podcast about privacy and security engineering. You can connect with Sean on Twitter @seanfalconer .
Please click here for the transcript of this episode.
Watch the video episode here
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post JetBrains AI with Jodie Burchell appeared first on Software Engineering Daily.
This episode of Software Engineering Daily is part of our on-site coverage of AWS re:Invent 2023, which took place from November 27th through December 1st in Las Vegas.
In today’s interview, host Jordi Mon Companys speaks with Mike Miller who is the Director of AWS AI Devices.
Jordi Mon Companys is a product manager and marketer that specializes in software delivery, developer experience, cloud native and open source. He has developed his career at companies like GitLab, Weaveworks, Harness and other platform and devtool providers. His interests range from software supply chain security to open source innovation. You can reach out to him on Twitter at @jordimonpmm.
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post AWS re:Invent Special: PartyRock Generative AI Apps with Mike Miller appeared first on Software Engineering Daily.
This episode of Software Engineering Daily is part of our on-site coverage of AWS re:Invent 2023, which took place from November 27th through December 1st in Las Vegas.
In today’s interview, host Jordi Mon Companys speaks with Kevin Kelly who is the Director of the AWS Cloud Institute.
Visit https://aws.amazon.com/training to learn more about AWS’s skills training offerings and learning resources.
Jordi Mon Companys is a product manager and marketer that specializes in software delivery, developer experience, cloud native and open source. He has developed his career at companies like GitLab, Weaveworks, Harness and other platform and devtool providers. His interests range from software supply chain security to open source innovation. You can reach out to him on Twitter at @jordimonpmm.
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post AWS re:Invent Special: The AWS Cloud Institute with Kevin Kelly appeared first on Software Engineering Daily.
This episode of Software Engineering Daily is part of our on-site coverage of AWS re:Invent 2023, which took place from November 27th through December 1st in Las Vegas.
In today’s interview, host Jordi Mon Companys speaks with Rob Zuber who is the CTO at CircleCI.
Jordi Mon Companys is a product manager and marketer that specializes in software delivery, developer experience, cloud native and open source. He has developed his career at companies like GitLab, Weaveworks, Harness and other platform and devtool providers. His interests range from software supply chain security to open source innovation. You can reach out to him on Twitter at @jordimonpmm.
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post AWS re:Invent Special: CircleCI with Rob Zuber appeared first on Software Engineering Daily.
This episode of Software Engineering Daily is part of our on-site coverage of AWS re:Invent 2023, which took place from November 27th through December 1st in Las Vegas.
In today’s interview, host Jordi Mon Companys speaks with Ankur Mehrotra who is the Director and GM of Amazon SageMaker.
Jordi Mon Companys is a product manager and marketer that specializes in software delivery, developer experience, cloud native and open source. He has developed his career at companies like GitLab, Weaveworks, Harness and other platform and devtool providers. His interests range from software supply chain security to open source innovation. You can reach out to him on Twitter at @jordimonpmm.
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post AWS re:Invent Special: Sagemaker with Ankur Mehrotra appeared first on Software Engineering Daily.
Hypnospace Outlaw is a hit indie game which features an internet and operating system simulator set in a surreal, alternate version of 1999. The game is entirely unique both in its design and aesthetic, and it has an impressive development history.
Jay Tholen is the developer of Hypnospace Outlaw and he joins the show to talk about the engineering of the game, the creation of an entire “fake internet”, and he gives an update on his next game, Dreamsettler.
Joe Nash is a developer, educator, and award-winning community builder, who has worked at companies including GitHub, Twilio, Unity, and PayPal. Joe got his start in software development by creating mods and running servers for Garry’s Mod, and game development remains his favorite way to experience and explore new technologies and concepts.
Please click here to see the transcript of this episode.
Watch the video episode here
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Bonus Episode: Hypnospace Outlaw with Jay Tholen appeared first on Software Engineering Daily.
SQL databases were built for data consistency and vertical scalability. They did this very well for the long era of monolithic applications running in dedicated, single-server environments. However, their design presented a problem when the paradigm changed to distributed applications in the cloud. This shift eventually ushered in the rise of distributed SQL databases. One of the most prominent is CockroachDB, which uses a distributed architecture inspired by Google’s Spanner. But what were the engineering approaches that made this architecture possible?
Jordan Lewis is a Senior Director of Engineering at CockroachDB Cloud. He joins the show to talk about the design of CockroachDB and how it works under the hood.
This episode is hosted by Lee Atchison. Lee Atchison is a software architect, author, and thought leader on cloud computing and application modernization. His best-selling book, Architecting for Scale (O’Reilly Media), is an essential resource for technical teams looking to maintain high availability and manage risk in their cloud environments.
Lee is the host of his podcast, Modern Digital Business, an engaging and informative podcast produced for people looking to build and grow their digital business with the help of modern applications and processes developed for today’s fast-moving business environment. Listen at mdb.fm. Follow Lee at softwarearchitectureinsights.com, and see all his content at leeatchison.com.
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post CockroachDB with Jordan Lewis appeared first on Software Engineering Daily.
Software supply chain security is a major challenge in the modern engineering environment. Many teams are working to establish best practices to proactively identify, fix, and prevent risks in their applications. Apiiro is a platform designed to solve this problem and gives risk visibility, prioritization, and remediation.
Yonatan Eldar is the Co-Founder and CTO at Apiiro and he joins the podcast to talk about the platform, application security posture management, and more.
Gregor Vand is a security-focused technologist, and is the founder and CTO of Mailpass. Previously, Gregor was a CTO across cybersecurity, cyber insurance and general software engineering companies. He has been based in Asia Pacific for almost a decade and can be found via his profile at vand.hk.
Please click here to see the transcript of this episode.
Full Disclosure: 10KMedia is a sponsor of Software Engineering Daily.
The post Apiiro Security Posture Management with Yonatan Eldar appeared first on Software Engineering Daily.
An embedding is a concept in machine learning that refers to a particular representation of text, images, audio, or other information. Embeddings are designed to make data consumable by ML models.
However, storing embeddings presents a challenge to traditional databases. Vector databases are designed to solve this problem.
Pinecone has developed one of the most prominent vector databases that is widely used for ML and AI applications.Marek Galovic is a software engineer at Pinecone and works on the core database team. He joins the podcast today to talk about how vector embeddings are created, engineering a vector database, unsolved challenges in the space, and more.
Sean’s been an academic, startup founder, and Googler. He has published works covering a wide range of topics from information visualization to quantum computing. Currently, Sean is Head of Marketing and Developer Relations at Skyflow and host of the podcast Partially Redacted, a podcast about privacy and security engineering. You can connect with Sean on Twitter @seanfalconer.
Please click here to see the transcript of this episode.
Watch the video episode here
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Pinecone Vector Database with Marek Galovic appeared first on Software Engineering Daily.
Carlos Sanchez is a Principal Scientist at Adobe where he works on the Adobe Experience Manager. AEM is a content management system and provides a platform for site creation and content delivery. In addition to his work at Adobe, Carlos has a long history contributing to open source projects, including Apache Maven. He joins the show today to talk about his work at Adobe, open source, and more.
Jordi Mon Companys is a product manager and marketer that specializes in software delivery, developer experience, cloud native and open source. He has developed his career at companies like GitLab, Weaveworks, Harness and other platform and devtool providers. His interests range from software supply chain security to open source innovation. You can reach out to him on Twitter at @jordimonpmm
Please click here to see the transcript of this episode.
Sponsorship inquiries:sponsor@softwareengineeringdaily.com
The post Bonus Episode: Adobe Cloud Native with Carlos Sanchez appeared first on Software Engineering Daily.
Building scalable software applications can be complex and typically requires dozens of different tools. The engineering often involves handling many arcane tasks that are distant from actual application logic. In addition, a lack of a cohesive model for building applications can lead to substantial engineering costs.
Nathan Marz is the creator of Rama, which is a platform for building end-to-end, scalable backends. Previously Nathan led engineering at BackType which was acquired by Twitter in 2011. In addition, Nathan created the Apache Storm project and is the author of the book Big Data: Principles and best practices of scalable realtime data systems. Nathan joins the podcast today to talk about Rama, and how to build scalable software applications.
This episode is hosted by Lee Atchison. Lee Atchison is a software architect, author, and thought leader on cloud computing and application modernization. His best-selling book, Architecting for Scale (O’Reilly Media), is an essential resource for technical teams looking to maintain high availability and manage risk in their cloud environments.
Lee is the host of his podcast, Modern Digital Business, an engaging and informative podcast produced for people looking to build and grow their digital business with the help of modern applications and processes developed for today’s fast-moving business environment. Listen at mdb.fm. Follow Lee at softwarearchitectureinsights.com, and see all his content at leeatchison.com.
Please click here to see the transcript of this episode.
Sponsorship inquiries:sponsor@softwareengineeringdaily.com
The post Rama with Nathan Marz appeared first on Software Engineering Daily.
Frédéric Harper is the Principal Developer Advocate at Kubefirst, which is an open source platform that integrates some of the most popular tools in the Kubernetes space. Frédéric has deep experience at major software companies having worked at npm, Mozilla, Microsoft, DigitalOcean, Fitbit, and others. He joins the show to talk about the challenges and solutions associated with working with Kubernetes.
Starting her career as a software developer, Jocelyn Houle is now a Senior Director of Product Management at Securiti.ai, a unified data protection and governance platform. Before that, she was an Operating Partner at Capital One Ventures investing in data and AI startups. Jocelyn has been a founder of two startups and a full life cycle, technical product manager at large companies like Fannie Mae, Microsoft and Capital One. Follow Jocelyn on LinkedIn or Twitter @jocelynbyrne.
Please click here to see the transcript of this episode.
Sponsorship inquiries:sponsor@softwareengineeringdaily.com
The post Kubefirst with Frédéric Harper appeared first on Software Engineering Daily.
Vespa is a fully featured search engine and vector database, and it has integrated ML model inference. The project open sourced in 2017, and since then has grown to become a prominent platform for applying AI to big data sets at serving time.
Vespa began as a project to solve Yahoo’s use cases in search, recommendation, and ad serving. The company made headlines in October when they announced they’re spinning Vespa.ai out of Yahoo as a separate company.
Jon Bratseth is the CEO at Vespa and he joins the show to talk about large language models, retrieval augmented generation, or RAG, vector database engineering, and more.Sean’s been an academic, startup founder, and Googler. He has published works covering a wide range of topics from information visualization to quantum computing. Currently, Sean is Head of Marketing and Developer Relations at Skyflow and host of the podcast Partially Redacted, a podcast about privacy and security engineering. You can connect with Sean on Twitter @seanfalconer .
Please click here to see the transcript of this episode.
Sponsorship inquiries:sponsor@softwareengineeringdaily.com
The post Vespa.ai with Jon Bratseth appeared first on Software Engineering Daily.
SurrealDB is the result of a long-time collaboration between brothers Tobie and Jaime Morgan Hitchcock. The project has modest origins and started merely to support other projects the brothers were working on. However, over time the project grew and in 2021 they started working on it full-time. Since then the project has gained serious adoption.
What’s makes SurrealDB so special? Tobie Morgan Hitchcock is the CEO of SurrealDB and he joins the show to talk about his multimodal database, support for graph and time series data, why they rewrote the entire project in Rust, and more.
Starting her career as a software developer, Jocelyn Houle is now a Senior Director of Product Management at Securiti.ai, a unified data protection and governance platform. Before that, she was an Operating Partner at Capital One Ventures investing in data and AI startups. Jocelyn has been a founder of two startups and a full life cycle, technical product manager at large companies like Fannie Mae, Microsoft and Capital One. Follow Jocelyn on LinkedIn or Twitter @jocelynbyrne.
Please click here to see the transcript of this episode.
Sponsorship inquiries:sponsor@softwareengineeringdaily.com
The post Bonus Episode: SurrealDB with Tobie Morgan Hitchcock appeared first on Software Engineering Daily.
Responsible AI is an approach to developing and deploying AI in a safe, trustworthy and ethical fashion. The concept has gained considerable attention with the rise of generative AI technologies.
Ezequiel Lanza is an AI Open Source Evangelist at Intel and he joins the show today to talk about responsible AI, and the practices and tools evolving around it.
Jordi Mon Companys is a product manager and marketer that specializes in software delivery, developer experience, cloud native and open source. He has developed his career at companies like GitLab, Weaveworks, Harness and other platform and devtool providers. His interests range from software supply chain security to open source innovation. You can reach out to him on Twitter at @jordimonpmm.
Please click here to see the transcript of this episode.
Sponsorship inquiries:sponsor@softwareengineeringdaily.com
The post Bonus Episode: Responsible AI with Ezequiel Lanza appeared first on Software Engineering Daily.
Ransomware attacks involve the deployment of malware that blocks access to a user’s or organization’s computer files by encrypting them. The attackers then demand a ransom payment in exchange for the decryption key that will restore access to the files. These attacks are often directed at governments and corporations, and can be costly.
Veeam is a data storage system that was designed specifically to provide protection against ransomware attacks. Object First is a system that works with Veeam to increase its safety and security.
Anthony Cusimano is the Director of Technical Marketing at Object First and he joins the podcast to talk about the growing sophistication of ransomware attacks and the emerging technologies to block them.
This episode is hosted by Lee Atchison. Lee Atchison is a software architect, author, and thought leader on cloud computing and application modernization. His best-selling book, Architecting for Scale (O’Reilly Media), is an essential resource for technical teams looking to maintain high availability and manage risk in their cloud environments.
Lee is the host of his podcast, Modern Digital Business, an engaging and informative podcast produced for people looking to build and grow their digital business with the help of modern applications and processes developed for today’s fast-moving business environment. Listen at mdb.fm. Follow Lee at softwarearchitectureinsights.com, and see all his content at leeatchison.com.
Please click here to see the transcript of this episode.
Sponsorship inquiries:sponsor@softwareengineeringdaily.com
The post Blocking Ransomware Attacks with Anthony Cusimano appeared first on Software Engineering Daily.
Supabase is an open source backend-as-a-service platform and competes directly with Google’s Firebase. A key distinction between them is that Firebase is a document store, while Supabase uses Postgres, which is a SQL-based database management system.
Software Engineering Daily last covered Supabase in 2020 when its Founder Paul Copplestone came on the show, and a lot has changed since then. The platform has continued to grow its feature set and, importantly, this growth has come with an expanded number of security considerations.
Inian Parameshwaran is Head of Product and Engineering at Supabase and a former YCombinator Fellow. He started at Supabase when the platform was still in alpha, and has been there for three years. He joins the show today to talk about the current feature set of Supabase, and the various security challenges that he and his team work on, including how to handle crypto mining exploits, IP blocking, DDoS attacks, and more.
Gregor Vand is a security-focused technologist, and is the founder and CTO of Mailpass. Previously, Gregor was a CTO across cybersecurity, cyber insurance and general software engineering companies. He has been based in Asia Pacific for almost a decade and can be found via his profile at vand.hk.
Please click here to see the transcript of this episode.
Sponsorship inquiries:sponsor@softwareengineeringdaily.com
The post Supabase Security with Inian Parameshwaran appeared first on Software Engineering Daily.
GitHub Copilot is an AI tool developed by GitHub and OpenAI to assist software developers by autocompleting code. Copilot kicked off a revolution in software engineering, and AI assistants are now considered essential tools to many developers.
Joseph Katsioloudes is a cyber security specialist and works at the GitHub Security Lab. He joins the show today to talk about Copilot, the future of software development in an AI world, using AI to improve security, and more.
Check out Joseph’s bio and the Secure Code Game which is an in-repo learning experience that Joseph created to teach how to secure vulnerable code.
Sean’s been an academic, startup founder, and Googler. He has published works covering a wide range of topics from information covisualization to quantum computing. Currently, Sean is Head of Marketing and Developer Relations at Skyflow and host of the podcast Partially Redacted, a podcast about privacy and security engineering. You ca connect with Sean on Twitter @seanfalconer .
Please click here to see the transcript of this episode.
Sponsorship inquiries:sponsor@softwareengineeringdaily.com
Watch the video episode here.
The post GitHub Copilot with Joseph Katsioloudes appeared first on Software Engineering Daily.
Build systems coordinate all the steps to transform source code into a production application. Bazel is a build system and testing tool that was first released in 2015 as a free and open-source port of Google’s internal build system called Blaze.
Historically, each language has its own build system which can create complexity when developing applications that use many languages. Bazel is special because it’s a polyglot system with unified support for many languages.
To handle build configuration, Bazel uses the Starlark language which has syntax inspired by Python. This is a key part of what contributes to Bazel’s growing popularity.
Julio Merino is a Senior Software Engineer at Snowflake, and before that worked at Google and Microsoft. He joins the podcast today to talk about Bazel.
Jordi Mon Companys is a product manager and marketer that specializes in software delivery, developer experience, cloud native and open source. He has developed his career at companies like GitLab, Weaveworks, Harness and other platform and devtool providers. His interests range from software supply chain security to open source innovation. You can reach out to him on Twitter at @jordimonpmm
Please click here to see the transcript of this episode.
Sponsorship inquiries:sponsor@softwareengineeringdaily.com
The post Bonus Episode: Bazel with Julio Merino appeared first on Software Engineering Daily.
Containers make it possible to standardize the deployment of software to any compute environment. However, managing and orchestrating containers at scale is a major challenge. Kubernetes was originally created by Google and solves the problem of scaling container deployment.
Ben Elder is a Senior Software Engineer at Google, and an Elected Member of the Kubernetes Steering Committee. Ben joins the show to talk about why Kubernetes became the standard for container orchestration, Kubernetes control theory, how he runs his home infrastructure, and more.This episode is hosted by Lee Atchison. Lee Atchison is a software architect, author, and thought leader on cloud computing and application modernization. His best-selling book, Architecting for Scale (O’Reilly Media), is an essential resource for technical teams looking to maintain high availability and manage risk in their cloud environments.
Lee is the host of his podcast, Modern Digital Business, an engaging and informative podcast produced for people looking to build and grow their digital business with the help of modern applications and processes developed for today’s fast-moving business environment. Listen at mdb.fm. Follow Lee at softwarearchitectureinsights.com, and see all his content at leeatchison.com.
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Kubernetes at Google with Ben Elder appeared first on Software Engineering Daily.
Deno is a free and open source JavaScript runtime built on Google’s V8 engine, Rust, and Tokio. The project was announced by Ryan Dahl in 2018 with the goal of addressing shortcomings of Node.js, which Ryan also created. Since then, the Deno project has grown tremendously in popularity, and they recently announced Deno KV which is a database built into Deno.
Luca Casonato is a Software Engineer on the Deno project and joins the show to talk about Deno’s design, its new database, and the future of the JavaScript ecosystem.
Josh Goldberg is an independent full time open source developer in the TypeScript ecosystem. He works on projects that help developers write better TypeScript more easily, most notably on typescript-eslint: the tooling that enables ESLint and Prettier to run on TypeScript code. Josh regularly contributes to open source projects in the ecosystem such as ESLint and TypeScript. Josh is a Microsoft MVP for developer technologies and the author of the acclaimed Learning TypeScript (O’Reilly), a cherished resource for any developer seeking to learn TypeScript without any prior experience outside of JavaScript. Josh regularly presents talks and workshops at bootcamps, conferences, and meetups to share knowledge on TypeScript, static analysis, open source, and general frontend and web development.
You can find Josh on: Bluesky, Fosstodon, Twitter, Twitch, YouTube, and joshuakgoldberg.com.
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Deno with Luca Casonato appeared first on Software Engineering Daily.
Machine learning model research requires running expensive, long-running experiments where even a slight mis-calibration can cost millions of dollars in underutilized compute resources. Once trained, model deployment, production monitoring, and observability requirements all present unique operational challenges.
Chris Van Pelt is the Chief Information Officer of Weights and Biases, which is the industry standard in experiment monitoring and visualization, and has expanded that expertise into a comprehensive suite of ML Ops tooling including model management, deployment, and monitoring.
Chris joins us today to discuss the state of the machine learning ecosystem at large, as well as some of their more recent work around production LLM tracing and monitoring.Sean’s been an academic, startup founder, and Googler. He has published works covering a wide range of topics from information visualization to quantum computing. Currently, Sean is Head of Marketing and Developer Relations at Skyflow and host of the podcast Partially Redacted, a podcast about privacy and security engineering. You can connect with Sean on Twitter @seanfalconer .
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Weights & Biases with Chris Van Pelt appeared first on Software Engineering Daily.
Maritime logistics is the process organizing the movement of goods across the ocean. Historically, this has been a challenging problem because of the multinational nature of shipping, as well as piracy, smuggling, and legacy technology. It’s also profoundly important for security reasons, and because 90% of what we buy travels over the oceans. Ocean vessels produce a lot of CO2, which adds climate change and energy dimensions to maritime logistics.
Windward AI is a maritime logistics platform that was started 13 years ago by two ex-Israeli naval officers. The idea for the company came from the observation that, at that time, it was hard or impossible to know what’s happening on the deep sea.
Benny Keinan is the VP of R&D and Lior Resisi is the Data Platforms Group Lead at Windward AI. They join the podcast today to talk about the technical and practical challenges of maritime logistics, why Rockset was the right database for their unique datasets, the impact of the Ukraine war, and more.
This episode is hosted by Lee Atchison. Lee Atchison is a software architect, author, and thought leader on cloud computing and application modernization. His best-selling book, Architecting for Scale (O’Reilly Media), is an essential resource for technical teams looking to maintain high availability and manage risk in their cloud environments.
Lee is the host of his podcast, Modern Digital Business, an engaging and informative podcast produced for people looking to build and grow their digital business with the help of modern applications and processes developed for today’s fast-moving business environment. Listen at mdb.fm. Follow Lee at softwarearchitectureinsights.com, and see all his content at leeatchison.com.
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Tracking Drug Smugglers and Migrating Databases with Benny Keinan and Lior Resisi appeared first on Software Engineering Daily.
One of the most famous software exploits in recent years was the SolarWinds attack in 2020. In this attack, Russian hackers inserted malicious code into the SolarWinds Orion system, allowing them to infiltrate the systems of numerous corporations and government agencies, including the U.S. executive branch, military, and intelligence services.
This was an example of a software supply chain attack, which exploits interdependencies within software ecosystems. Software supply chain security is a growing issue, and is particularly important for companies that rely on large numbers of open source dependencies.
Michael Lieberman is the Co-Founder and CTO of Kusari and has an extensive background in software security from his time at Citi Bank, MUFG and Bridgewater. He’s also active in the open source and security communities, including the Open Source Security Foundation and Cloud Native Computing Foundation. Michael joins the show today to talk about challenges and strategies in software supply chain security.
Gregor Vand is a security-focused technologist, and is the founder and CTO of Mailpass. Previously, Gregor was a CTO across cybersecurity, cyber insurance and general software engineering companies. He has been based in Asia Pacific for almost a decade and can be found via his profile at vand.hk.Please click here for the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Software Supply Chain Security with Michael Lieberman appeared first on Software Engineering Daily.
Hugging Face was founded in 2016 and has grown to become one of the most prominent ML platforms. It’s commonly used to develop and disseminate state-of-the-art ML models and is a central hub for researchers and developers.
Sayak Paul is a Machine Learning Engineer at Hugging Face and a Google Developer Expert. He joins the show today to talk about how he entered the ML field, diffusion model training, the transformer-based architecture, and more.
Sean’s been an academic, startup founder, and Googler. He has published works covering a wide range of topics from information visualization to quantum computing. Currently, Sean is Head of Marketing and Developer Relations at Skyflow and host of the podcast Partially Redacted, a podcast about privacy and security engineering. You can connect with Sean on Twitter @seanfalconer .
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Hugging Face with Sayak Paul appeared first on Software Engineering Daily.
This episode of Software Engineering Daily is part of our on-site coverage of KubeCon 2023, which took place from November 6th through 9th in Chicago.
In today’s interview, host Jordi Mon Companys speaks with Justin Cormack who is the CTO at Docker.Jordi Mon Companys is a product manager and marketer that specializes in software delivery, developer experience, cloud native and open source. He has developed his career at companies like GitLab, Weaveworks, Harness and other platform and devtool providers. His interests range from software supply chain security to open source innovation. You can reach out to him on Twitter at @jordimonpmm
Please click here to see the transcript for this episode.Sponsorship inquiries: sponsor@softwareengineeringdaily.comThe post KubeCon Special: Docker with Justin Cormack appeared first on Software Engineering Daily.
This episode of Software Engineering Daily is part of our on-site coverage of KubeCon 2023, which took place from November 6th through 9th in Chicago.
In today’s interview, host Jordi Mon Companys speaks with Santiago Torres-Arias who is a contributor to Sigstore, which is a system to register software supply chain actors using federated identity management.
Jordi Mon Companys is a product manager and marketer that specializes in software delivery, developer experience, cloud native and open source. He has developed his career at companies like GitLab, Weaveworks, Harness and other platform and devtool providers. His interests range from software supply chain security to open source innovation. You can reach out to him on Twitter at @jordimonpmm
Please click here to see the transcript for this episode.Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post KubeCon Special: Sigstore with Santiago Torres-Arias appeared first on Software Engineering Daily.
This episode of Software Engineering Daily is part of our on-site coverage of KubeCon 2023, which took place from November 6th through 9th in Chicago.In today’s interview, host Jordi Mon Companys speaks with Darren Shepherd who is the Chief Architect and Co-Founder at Acorn Labs.Jordi Mon Companys is a product manager and marketer that specializes in software delivery, developer experience, cloud native and open source. He has developed his career at companies like GitLab, Weaveworks, Harness and other platform and devtool providers. His interests range from software supply chain security to open source innovation. You can reach out to him on Twitter at @jordimonpmm
Please click here for the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post KubeCon Special: Acorn with Darren Shepherd appeared first on Software Engineering Daily.
This episode of Software Engineering Daily is part of our on-site coverage of KubeCon 2023, which took place from November 6th through 9th in Chicago.In today’s interview, host Jordi Mon Companys speaks with David DeSanto who is the Chief Product Officer at GitLab.
Jordi Mon Companys is a product manager and marketer that specializes in software delivery, developer experience, cloud native and open source. He has developed his career at companies like GitLab, Weaveworks, Harness and other platform and devtool providers. His interests range from software supply chain security to open source innovation. You can reach out to him on Twitter at @jordimonpmm
Please click here for the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post KubeCon Special: GitLab’s AI Vision with David DeSanto appeared first on Software Engineering Daily.
Josh Prismon is a veteran software architect, having worked at FICO for 17 years before shifting to Index Exchange in 2022.
In this episode, Josh joins the podcast to speak with host Lee Atchison, who also has deep experience in software architecture from his time at Amazon, New Relic, and other companies.
Josh and Lee discuss different paradigms for thinking about software architecture, including the importance of storytelling to build a shared vision for architecture across a team. They also talk about the tension between “emergent” and “intentional” design, how to allow architecture to evolve dynamically without sacrificing structure, and more.
This episode is hosted by Lee Atchison. Lee Atchison is a software architect, author, and thought leader on cloud computing and application modernization. His best-selling book, Architecting for Scale (O’Reilly Media), is an essential resource for technical teams looking to maintain high availability and manage risk in their cloud environments.
Lee is the host of his podcast, Modern Digital Business, an engaging and informative podcast produced for people looking to build and grow their digital business with the help of modern applications and processes developed for today’s fast-moving business environment. Listen at mdb.fm. Follow Lee at softwarearchitectureinsights.com, and see all his content at leeatchison.com.
Please click here for the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Software Architecture with Josh Prismon appeared first on Software Engineering Daily.
Data breaches at major companies are so now common that they hardly make the news. The Wikipedia page on data breaches lists over 350 between 2004 and 2023. The Equifax breach in 2017 was especially notable because over 160 million records were leaked, and much of the data was acquired by Equifax without individuals’ knowledge or consent. Data breaches are increasingly costly to companies and to affected users who must deal with the ensuing identity theft.In 2018 the European Union implemented the General Data Protection Regulation, or GDPR. Despite its mild name, the GDPR had major consequences for individuals’ rights to control their data, and for companies that operate in the EU. Among other things, it gives the right to have personal data removed from a company’s records. This is the so-called “right to be forgotten”.
Gal Ringel is the Co-Founder and CEO of Mine, which allows users to identify which companies have their data, and it automates the process of removing data on behalf of its users. In this way, Mine aims to reduce online exposure and minimize risk for anyone using online services. Gal joins the show today to talk about his company, the impact of GDPR, and how his experience in military intelligence, venture capital, and tech led him to co-found the company.Jordi Mon Companys is a product manager and marketer that specializes in software delivery, developer experience, cloud native and open source. He has developed his career at companies like GitLab, Weaveworks, Harness and other platform and devtool providers. His interests range from software supply chain security to open source innovation. You can reach out to him on Twitter at @jordimonpmm
Please click here to see the transcript of this episode.Sponsorship inquiries: sponsor@softwareengineeringdaily.comThe post The Right to Be Forgotten with Gal Ringel appeared first on Software Engineering Daily.
If you’re a sports fan and like to track sports statistics and results, you’ve probably heard of Sofascore. The website started in 2010 and ran on a modest single server. It now has 25 million monthly active users, covers 20 different sports, 11,000 leagues and tournaments, and is available in over 30 languages.Josip Stuhli has been with Sofascore for 13 years. He started there as an engineer and is currently CTO. Josip joins the show today to talk about the challenges Sofascore encountered over the years, and how the team solved them. He discusses dealing with traffic spikes from game days, structuring and restructuring the codebase, organizing the frontend and backend, and much more.
Sean’s been an academic, startup founder, and Googler. He has published works covering a wide range of topics from information visualization to quantum computing. Currently, Sean is Head of Marketing and Developer Relations at Skyflow and host of the podcast Partially Redacted, a podcast about privacy and security engineering. You can connect with Sean on Twitter @seanfalconer .
Please clicke here for the full transcript of this episodeSponsorship inquiries: sponsor@softwareengineeringdaily.comThe post Sofascore with Josip Stuhli appeared first on Software Engineering Daily.
Cloud-based software development platforms such as GitHub Codespaces continue to grow in popularity. These platforms are attractive to enterprise organizations because they can be managed centrally with security controls. However, many, if not most, developers prefer a local IDE.Daytona is aiming to bridge that gap. It’s a layer between a local IDE and a backend server, so developers can work locally while interfacing invisibly with a remote environment. Ivan Burazin is the CEO and Co-Founder at Daytona, and he joins the show today to talk about how Daytona works, Spotify as an inspiration for his product, and more.Jordi Mon Companys is a product manager and marketer that specializes in software delivery, developer experience, cloud native and open source. He has developed his career at companies like GitLab, Weaveworks, Harness and other platform and devtool providers. His interests range from software supply chain security to open source innovation. You can reach out to him on Twitter at @jordimonpmm
Please click here to see the transcript of this episode.Sponsorship inquiries: sponsor@softwareengineeringdaily.comThe post Daytona with Ivan Burazin appeared first on Software Engineering Daily.
Knowledge graphs are an intuitive way to define relationships between objects, events, situations, and concepts. Their ability to encode this information makes them an attractive database paradigm.
Hume is a graph-based analysis solution developed by GraphAware. It represents data as a network of interconnected entities and provides analysis capabilities to extract insights from the data. Luanne Misquitta is VP of Engineering at GraphAware and she joins the show today to talk about graph databases, and the engineering of Hume.Starting her career as a software developer, Jocelyn Houle is now a Senior Director of Product Management at Securiti.ai, a unified data protection and governance platform. Before that, she was an Operating Partner at Capital One Ventures investing in data and AI startups. Jocelyn has been a founder of two startups and a full life cycle, technical product manager at large companies like Fannie Mae, Microsoft and Capital One. Follow Jocelyn on LinkedIn or Twitter @jocelynbyrne.
Please click here to view this show’s transcript.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post GraphAware with Luanne Misquitta appeared first on Software Engineering Daily.
Shopify is an e-commerce platform focused on enabling small businesses to sell online. The company was founded in 2006 and since then has become a core technology of online business infrastructure.
Mike Shaver is a Distinguished Engineer at Shopify and previously worked at Facebook, Mozilla, Oracle and others. At Shopify he works on the core team, which handles store fronts, merchant experience, and the commerce engine. He joins the show to talk about Shopify’s bet on Rust, their shift to Google Cloud, and the experience of changing from a management role to a high-level individual contributor role.
Sean’s been an academic, startup founder, and Googler. He has published works covering a wide range of topics from information visualization to quantum computing. Currently, Sean is Head of Marketing and Developer Relations at Skyflow and host of the podcast Partially Redacted, a podcast about privacy and security engineering. You can connect with Sean on Twitter @seanfalconer.
Please click here for the full transcript of this episode.Sponsorship inquiries: sponsor@softwareengineeringdaily.comThe post Shopify with Mike Shaver appeared first on Software Engineering Daily.
When Adam Berger was at Uber, his team was responsible for ensuring that Uber Eats merchants correctly receive and fulfill orders. This required them to think hard about engineering workflows and state management systems. Six years of experience at Uber motivated Adam to create State Backed, which is an open-source backend system written in Typescript. The platform is oriented around using state machines to model application logic, and automatically handles the associated persistence, infrastructure, and consistency.
Adam joins the show to talk about state machines, why they’re the right paradigm to manage global application state, and what are the practical advantages of using state machines in a backend platform.
This episode is hosted by Lee Atchison. Lee Atchison is a software architect, author, and thought leader on cloud computing and application modernization. His best-selling book, Architecting for Scale (O’Reilly Media), is an essential resource for technical teams looking to maintain high availability and manage risk in their cloud environments.
Lee is the host of his podcast, Modern Digital Business, an engaging and informative podcast produced for people looking to build and grow their digital business with the help of modern applications and processes developed for today’s fast-moving business environment. Listen at mdb.fm. Follow Lee at softwarearchitectureinsights.com, and see all his content at leeatchison.com.
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Building a State Machine Backend with Adam Berger appeared first on Software Engineering Daily.
One of the key challenges that teams encounter is how to smoothly collaborate on converting a design into code. For example, if a designer designs a web component, how can it be most efficiently implemented by a developer? What happens if the designer needs to adjust the design and communicate this change to the developer? These sorts of issues can often lead to inefficiencies and frustrations on a team.
Figma recently announced Dev Mode which aims to smooth design and developer collaboration. The idea is to tie the visual language of designers to the actual component implementation of the developer.
Marcel Weekes is VP of Product Engineering at Figma, and before that he spent 6 years at Slack. Marcel joins the show today to talk about Dev Mode, how it will boost collaboration between designers and devs, and the new Figma VS Code plugin that brings design into the IDE. Marcel also talks about the concept of the “new manager death spiral”, and how individual contributors, or ICs, can smoothly transition to management roles.
Josh Goldberg is an independent full time open source developer in the TypeScript ecosystem. He works on projects that help developers write better TypeScript more easily, most notably on typescript-eslint: the tooling that enables ESLint and Prettier to run on TypeScript code. Josh regularly contributes to open source projects in the ecosystem such as ESLint and TypeScript.
Josh is a Microsoft MVP for developer technologies and the author of the acclaimed Learning TypeScript (O’Reilly), a cherished resource for any developer seeking to learn TypeScript without any prior experience outside of JavaScript. Josh regularly presents talks and workshops at bootcamps, conferences, and meetups to share knowledge on TypeScript, static analysis, open source, and general frontend and web development.You can find Josh on: Bluesky, Fosstodon, Twitter, Twitch, YouTube, and joshuakgoldberg.com.
Please click here to see the transcript for this episode.Sponsorship inquiries: sponsor@softwareengineeringdaily.comThe post Figma Dev Mode with Marcel Weekes appeared first on Software Engineering Daily.
Frontend web frameworks are software toolkits that handle many of the low-level and repetitive aspects of building a website. These frameworks have made it easier than ever to build a modern website. The open-source Astro framework was created in 2021 for the purpose of creating simple static sites that load quickly. A key factor to its high performance is that, by default, webpages don’t include any JavaScript. However, Astro gives users the ability to opt into using JavaScript wherever it makes sense in their projects. Astro also has the file based routing and server-side rendering capabilities found in frameworks like NextJS.
James Q. Quick has worked at Microsoft, PlanetScale, and Auth0 and is a popular technical content creator. He’s an advocate of the Astro framework and joins the show to talk about what distinguishes it from NextJS, Sveltekit, and other major frameworks.
Sean’s been an academic, startup founder, and Googler. He has published works covering a wide range of topics from information visualization to quantum computing. Currently, Sean is Head of Marketing and Developer Relations at Skyflow and host of the podcast Partially Redacted, a podcast about privacy and security engineering. You can connect with Sean on Twitter @seanfalconer .
Please click here for the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post The Astro Framework with James Quick appeared first on Software Engineering Daily.
Observability software helps teams to actively monitor and debug their systems, and these tools are increasingly vital in DevOps. However, it’s not uncommon for the volume of observability data to exceed the amount of actual business data. This creates two challenges – how to analyze the large stream of observability data, and how to keep down the compute and storage costs for that data.
Chronosphere is a popular observability platform that works by identifying the data that’s actually being used to power dashboards and metrics. It then shows the cost for each segment of data, and allows users to decide if a metric is worth that cost. In this way, technical teams can manage costs by dynamically adjusting which data is analyzed and stored. Martin Mao is the Co-founder and CEO of Chronosphere and he joins the podcast today to talk about the growing challenge of managing observability data, and the design of Chronosphere.
This episode is hosted by Lee Atchison. Lee Atchison is a software architect, author, and thought leader on cloud computing and application modernization. His best-selling book, Architecting for Scale (O’Reilly Media), is an essential resource for technical teams looking to maintain high availability and manage risk in their cloud environments.Lee is the host of his podcast, Modern Digital Business, an engaging and informative podcast produced for people looking to build and grow their digital business with the help of modern applications and processes developed for today’s fast-moving business environment. Listen at mdb.fm. Follow Lee at softwarearchitectureinsights.com, and see all his content at leeatchison.com.Please click here to see the transcript for this episode.Sponsorship inquiries: sponsor@softwareengineeringdaily.comThe post Chronosphere with Martin Mao appeared first on Software Engineering Daily.
The open source coding philosophy has enormous appeal to many software engineers, and with good reason. Open source libraries, applications, and operating systems are now essential to the overall technology ecosystem. And the number of open source projects is only increasing. But many developers don’t know how to get involved in open source. Or, they may have even faced resistance when trying to make a pull request to their favorite open source codebase.
Open Sauced is a platform to help developers get involved in open source development. While the number of GitHub stars on a project is often seen as a metric of success for a code base, Open Sauced focuses on the number of new contributors on a project. This number serves as a signal to help drive the platform’s recommendation system, which pairs its users with open source projects in need of developers. Brian Douglas is a former Developer Experience Lead at Netlify and he was the Director of Developer Advocacy at GitHub. He is also the founder and CEO of Open Sauced and he is our guest in this episode.
Josh Goldberg is an independent full time open source developer in the TypeScript ecosystem. He works on projects that help developers write better TypeScript more easily, most notably on typescript-eslint: the tooling that enables ESLint and Prettier to run on TypeScript code. Josh regularly contributes to open source projects in the ecosystem such as ESLint and TypeScript. Josh is a Microsoft MVP for developer technologies and the author of the acclaimed Learning TypeScript (O’Reilly), a cherished resource for any developer seeking to learn TypeScript without any prior experience outside of JavaScript. Josh regularly presents talks and workshops at bootcamps, conferences, and meetups to share knowledge on TypeScript, static analysis, open source, and general frontend and web development.You can find Josh on: Bluesky, Fosstodon, Twitter, Twitch, YouTube, and joshuakgoldberg.com.Please click here to see the transcript for this episode.Sponsorship inquiries: sponsor@softwareengineeringdaily.comThe post Open Source Contributing with Brian Douglas appeared first on Software Engineering Daily.
There are countless real world scenarios where a workflow or process has multiple steps, and some steps must be completed before others can be started. Think of something as simple as cooking dinner. First you look up a recipe, then you write down the ingredients you need, you go shopping, and then you cook. These steps must be run in a certain order, and the state of the workflow must be tracked throughout. Workflow management is everywhere in the software world, and today it’s common for teams to engineer custom solutions. This makes sense, because creating a general-purpose solution for workflow management is a hard conceptual problem, and perhaps an even harder engineering challenge.
Maxim Fateev has a deep background engineering distributed systems and workflow management services at Google, Amazon, and Microsoft. In 2015, he joined Uber and helped create the open-source project, Cadence, which is an orchestration engine to execute asynchronous long-running business logic. The success of Cadence led Max to co-found Temporal, which is an open-source programming package for workflow execution. Max joins the show today to talk about the engineering challenges at Temporal, the concept of “durable execution”, how he organizes his engineering teams, and more.
Sean’s been an academic, startup founder, and Googler. He has published works covering a wide range of topics from information visualization to quantum computing. Currently, Sean is Head of Marketing and Developer Relations at Skyflow and host of the podcast Partially Redacted, a podcast about privacy and security engineering. You can connect with Sean on Twitter @seanfalconer.Please click here to see the transcript for this episode.Sponsorship inquiries: sponsor@softwareengineeringdaily.comThe post Temporal with Max Fateev appeared first on Software Engineering Daily.
Speech technology has been around for a long time, but in the last 12 months it’s undergone a quantum leap. New speech synthesis models are able to produce speech that’s often indistinguishable from real speech. I’m sure many listeners have heard deep fakes where computer speech perfectly mimics the voice of famous actors or public figures. A major factor in driving the ongoing advances is generative AI.
Speechlab is at the forefront of using new AI techniques for realtime dubbing, which is the process of converting speech from one language into another. For the interested listener, we recommend hearing the examples with President Obama speaking Spanish or Elon Musk speaking Japanese in this YouTube video. Ivan Galea is the Co-founder and President at Speechlab and he joins the show to talk about how we’re on the cusp of reaching the holy grail of speech technology – real time dubbing – and how this will erase barriers to communication and likely transform the world.This episode is hosted by Lee Atchison. Lee Atchison is a software architect, author, and thought leader on cloud computing and application modernization. His best-selling book, Architecting for Scale (O’Reilly Media), is an essential resource for technical teams looking to maintain high availability and manage risk in their cloud environments.Lee is the host of his podcast, Modern Digital Business, an engaging and informative podcast produced for people looking to build and grow their digital business with the help of modern applications and processes developed for today’s fast-moving business environment. Listen at mdb.fm. Follow Lee at softwarearchitectureinsights.com, and see all his content at leeatchison.com.Please click here to view this show’s transcript.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Speechlab and Realtime Translation with Ivan Galea appeared first on Software Engineering Daily.
If you’re a developer, there’s a good chance you’ve experimented with coding assistants like GitHub Copilot. Many developers have even fully integrated these tools into their workflows. One way these tools accelerate development is by autocompleting entire blocks of code. The AI achieves this by having awareness of the surrounding code. It understands context. However, in many cases the context available to an AI is limited. This restricts the AI’s ability to suggest more sweeping changes to a codebase, or even to refactor an entire application.
Quinn Slack is the CEO of Sourcegraph. He is now hard at work on the challenge of giving more context to AI – to make it aware of entire codebases, dependencies, error logs, and other data. Quinn joins the show today to talk about what it takes to move beyond code autocomplete, how to develop the next generation of coding AI, and what the future looks like for software engineers and programming languages.
Josh Goldberg is an independent full time open source developer in the TypeScript ecosystem. He works on projects that help developers write better TypeScript more easily, most notably on typescript-eslint: the tooling that enables ESLint and Prettier to run on TypeScript code. Josh regularly contributes to open source projects in the ecosystem such as ESLint and TypeScript.Josh is a Microsoft MVP for developer technologies and the author of the acclaimed Learning TypeScript (O’Reilly), a cherished resource for any developer seeking to learn TypeScript without any prior experience outside of JavaScript. Josh regularly presents talks and workshops at bootcamps, conferences, and meetups to share knowledge on TypeScript, static analysis, open source, and general frontend and web development.You can find Josh on: Bluesky, Fosstodon, Twitter, Twitch, YouTube, and joshuakgoldberg.com.Please click here to view this show’s transcript.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Sourcegraph with Quinn Slack appeared first on Software Engineering Daily.
Documentation is something that everyone knows is important but it’s often difficult to get right. On software teams, good documentation can help to onboard new people, improve communication across teams, and troubleshoot technical issues. When an application, API, or library is a commercial product, the quality of its documentation can determine whether it attracts users and succeeds on the market.
GitBook is a popular documentation platform built with TypeScript and Node. It’s found particular use among software teams for creating technical documentation. Addison Schultz is the Developer Relations Lead at GitBook and he joins the show to talk about GitBook’s development, software stack, and how it’s adding new integrations for VS Code, Slack, and other tools.
Full disclosure: GitBook is a sponsor of Software Engineering Daily.
Please click here to view this show’s transcript.
Sean’s been an academic, startup founder, and Googler. He has published works covering a wide range of topics from information visualization to quantum computing. Currently, Sean is Head of Marketing and Developer Relations at Skyflow and host of the podcast Partially Redacted, a podcast about privacy and security engineering. You can connect with Sean on Twitter @seanfalconer.Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post GitBook with Addison Schultz appeared first on Software Engineering Daily.
Observability is becoming an increasingly competitive space in the software world. Many developers have heard of Datadog and New Relic, but there are a seemingly countless number of observability products out there.Costa Tsaousis (he/him) is the Founder and CEO of Netdata. His goal was to build an open-source platform that was high-resolution, real-time, and easily scalable. Netdata is the result. It’s relatively new to the crowded observability space, but it’s grown into a major presence. Costa joins the show to talk about the design philosophy of Netdata, and how it inverts a common observability design pattern.This episode is hosted by Lee Atchison. Lee Atchison is a software architect, author, and thought leader on cloud computing and application modernization. His best-selling book, Architecting for Scale (O’Reilly Media), is an essential resource for technical teams looking to maintain high availability and manage risk in their cloud environments.Lee is the host of his podcast, Modern Digital Business, an engaging and informative podcast produced for people looking to build and grow their digital business with the help of modern applications and processes developed for today’s fast-moving business environment. Listen at mdb.fm. Follow Lee at softwarearchitectureinsights.com, and see all his content at leeatchison.com.Please click here to view this show’s transcript.Sponsorship inquiries: sponsor@softwareengineeringdaily.comThe post A Different Monitoring Philosophy with Costa Tsaousis appeared first on Software Engineering Daily.
Ongoing advances in generative AI are already having a huge impact on developer productivity. Tools like GitHub Copilot and ChatGPT are increasing the velocity of code development, and more advances are on the horizon. However, an ever-growing challenge for developers is how to manage their coding resources – things like code snippets, website links, messages, and screenshots. This is hard for individual developers, but even harder for teams.Tsavo Knott is the Co-Founder and CEO of Pieces. Tsavo thinks deeply about developer productivity and he joins the podcast today to talk about how Pieces is using AI to automate the process of saving, curating, and iterating on coding resources for developers and teams.Full Disclosure: Pieces is a sponsor of Software Engineering Daily
Mike Bifulco is CTO and co-founder of Craftwork. He’s also a developer advocate, writer, podcaster and serial startup founder. In past lives, Mike worked for Google, Stripe, Microsoft, and Gymnasium. Mike is also co-founder of APIs You Won’t Hate, a community for API Developers on the web. Mike’s publishes a weekly newsletter for product builders called Tiny Improvements at mikebifulco.com. Mike is on Mastodon at https://hachyderm.io/@irreverentmike
Please click here to view this show’s transcript.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Building Pieces.app and the Future of Developer Productivity with Tsavo Knott appeared first on Software Engineering Daily.
The importance of data teams is undeniable. Most companies today use data to drive decision-making on anything from software feature development to product strategy, hiring and marketing. In some companies data is the product, which can make data teams even more vital. But there’s a common problem – analyzing data is hard and time consuming. Lots of people have questions they want to answer with data, but data teams often don’t have the resources to move quickly. This can create a pernicious effect where organizations stop asking questions about their own data.Amanda Kelly thinks a lot about data and the dynamics of data teams inside organizations. She’s worked at Google X, and on self-driving cars and cybersecurity. Her experiences on data teams inspired her to co-found Streamlit, which is an open source Python library that gives primitives to assemble a data app for rapid data visualization and interaction. Her goal was to accelerate the iteration loop to go from a question to a data-driven answer. Amanda is currently the COO of Streamlit and a Product Director at Snowflake, and she joins us today to talk all about data and how she’s building Streamlit.Sean’s been an academic, startup founder, and Googler. He has published works covering a wide range of topics from information visualization to quantum computing. Currently, Sean is Head of Marketing and Developer Relations at Skyflow and host of the podcast Partially Redacted, a podcast about privacy and security engineering. You can connect with Sean on Twitter @seanfalconer.Please click here to view this show’s transcript.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Streamlit with Amanda Kelly appeared first on Software Engineering Daily.
Platform engineering is difficult to get right, and in the age of DevOps and cloud computing, software developers increasingly serve as platform engineers while they’re building their applications. This can be an engineering challenge because organizations often require their platforms to provide fine-grained control and compliance management.
Cory O’Daniel is the CEO and Co-Founder of Massdriver, which he started in 2021 with the goal of helping engineering and operations teams build internal developer platforms. Cory’s company was in the 2022 Y Combinator class, and he has been hard at work developing his platform. He joins the show today to talk about how he thinks about platform engineering, and the challenge of abstracting away infrastructure.
This episode is hosted by Lee Atchison. Lee Atchison is a software architect, author, and thought leader on cloud computing and application modernization. His best-selling book, Architecting for Scale (O’Reilly Media), is an essential resource for technical teams looking to maintain high availability and manage risk in their cloud environments.Lee is the host of his podcast, Modern Digital Business, an engaging and informative podcast produced for people looking to build and grow their digital business with the help of modern applications and processes developed for today’s fast-moving business environment. Listen at mdb.fm. Follow Lee at softwarearchitectureinsights.com, and see all his content at leeatchison.com.
Please click here to view this show’s transcript.
Sponsorship inquiries: sponsor@softwareengineeringdaily.comThe post Platform Engineering with Cory O’Daniel appeared first on Software Engineering Daily.
Today it’s estimated there are over 1 billion websites on the internet. Much of this content is optimized to be viewed by human eyes, not consumed by machines. However, creating systems to automatically parse and structure the web greatly extends its utility, and paves the way for innovative solutions and applications. The industry of web scraping has emerged to do just that. However, many websites erect obstacles to hinder web scraping. This has created a new kind of arms race between developers and anti-scraping software.
Bright Data has developed some of the most sophisticated consumer tools available to scrape public web data. Erez Naveh is an entrepreneur and former engineer at Meta. He is currently the VP of Product at Bright Data. Erez joins us in this episode to talk about Bright Data’s mission to structure the open web, and the toolkit they’ve developed to make this possible.
Full Disclosure: Bright Data is a sponsor of Software Engineering Daily
Paweł is the founder at flat.social the world’s first ‘flatverse’ start-up and glot.space, an AI-powered language learning app. Pawel’s background is as a full-stack software engineer with a lean and experimental approach towards product development. With a strong grounding in computing science, he spent the last decade getting early-stage products off the ground – both in startup and corporate settings. Follow Paweł on Twitter, LinkedIn and his personal website – pawel.io.
Please click here to view this show’s transcript.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Modern Web Scraping with Erez Naveh appeared first on Software Engineering Daily.
If you’re a developer, you’ve probably worked with an API, or application programming interface. An API is a set of rules for how to communicate with an applications or device. For example, when you build an app and want to use Stripe to handle payments, or use Slack to deliver notifications, it’s APIs that make this possible. Handling communication between different applications was historically challenging, but with the growth of cloud computing and the need for smooth interoperability, APIs have become standard, and are now often considered essential to make a company accessible and visible. The growth of APIs is about to accelerate even more because of generative AI. The reason is that good APIs will be needed so AIs can write code to stitch together multiple systems.
Postman is a popular application and platform for building and using APIs, and they recently released their 2023 State of the API Report. Joyce Lin is the Head of Developer Relations at Postman and she joins the show today to talk about the history of APIs, why APIs have exploded in popularity, and what the future looks like.Sean’s been an academic, startup founder, and Googler. He has published works covering a wide range of topics from information visualization to quantum computing. Currently, Sean is Head of Marketing and Developer Relations at Skyflow and host of the podcast Partially Redacted, a podcast about privacy and security engineering. You can connect with Sean on Twitter @seanfalconer .
Please click here to view this show’s transcript.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Postman and the Growth of APIs with Joyce Lin appeared first on Software Engineering Daily.
There are hundreds of observability companies out there, and many ways to think about observability, such as application performance monitoring, server monitoring, and tracing. In a production application, multiple tools are often needed to get proper visibility on the application. This creates some challenges. Applications can produce lots of different observatory observability data, but how should the data be routed to the various downstream tools? In addition, how can data be selectively sent to different storage tiers to minimize costs?
Calyptia is a service that helps manage observability data from source to destination. Eduardo Silva is the founder and CEO of Calyptia and he joins us in this episode.This episode is hosted by Lee Atchison. Lee Atchison is a software architect, author, and thought leader on cloud computing and application modernization. His best-selling book, Architecting for Scale (O’Reilly Media), is an essential resource for technical teams looking to maintain high availability and manage risk in their cloud environments.Lee is the host of his podcast, Modern Digital Business, an engaging and informative podcast produced for people looking to build and grow their digital business with the help of modern applications and processes developed for today’s fast-moving business environment. Listen at mdb.fm. Follow Lee at softwarearchitectureinsights.com, and see all his content at leeatchison.com.Please click here to view this show’s transcript.Sponsorship inquiries: sponsor@softwareengineeringdaily.comThe post Observability with Eduardo Silva appeared first on Software Engineering Daily.
The Hypertext Transfer Protocol, or HTTP, is used to load webpages using hypertext links, and it’s the foundation of the web. Tim Berners-Lee famously created HTTP version 0.9 in 1989, and defined the essential behavior of a client and a server. Version 1.0 was eventually finalized in 1996, and its secure variant called HTTPS is now used on more than 80% of websites. HTTP continues to undergo intense development and version 3 in now being actively adopted across the tech industry.
Nick Shadrin is a Software Architect at NGINX, and Roman Arutyunyan is a Principal Software Engineer at NGINX. Nick and Roman are experts in HTTP and they join the show today to tell the history of its evolution since 1989, and how NGINX is implementing support for HTTP/3.
Full disclosure: NGINX is a sponsor of Software Engineering Daily.
Mike Bifulco is CTO and co-founder of Craftwork. He’s also a developer advocate, writer, podcaster and serial startup founder. In past lives, Mike worked for Google, Stripe, Microsoft, and Gymnasium. Mike is also co-founder of APIs You Won’t Hate, a community for API Developers on the web. Mike’s publishes a weekly newsletter for product builders called Tiny Improvements at mikebifulco.com. Mike is on Mastodon at https://hachyderm.io/@irreverentmike
Please click here to view this show’s transcript.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post The Future of HTTP with Nick Shadrin and Roman Arutyunyan appeared first on Software Engineering Daily.
A platform as a service, or PaaS, is the concept of a complete development and deployment environment in the cloud. One of the best examples is Heroku, which was created in 2007 and later acquired by Salesforce. Although these services are great for helping startups get off the ground quickly, they can ultimately become a form of technical debt because of issues with cost, control, scale, and reliability.
Today we’re speaking with Brandon Bayer. Brandon is a licensed aircraft pilot, and he’s also the CEO of Flightcontrol, a platform as a service company that he co-founded. Flightcontrol is built on top of AWS, and allows users to deploy it on their own AWS infrastructure. In this episode, Brandon talks about how his team engineered Flightcontrol, and how it was designed for small and large teams, with scalability and maintainability in mind.Sean’s been an academic, startup founder, and Googler. He has published works covering a wide range of topics from information visualization to quantum computing. Currently, Sean is Head of Marketing and Developer Relations at Skyflow and host of the podcast Partially Redacted, a podcast about privacy and security engineering. You can connect with Sean on Twitter @seanfalconer .Please click here to view this show’s transcript.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Flightcontrol and Going Beyond Heroku with Brandon Bayer appeared first on Software Engineering Daily.
Since its release by Facebook in 2013, React has etched itself into the canvas of web development. Fast-forward a decade, and it’s no exaggeration to say that React has become the most popular web framework, globally. The majority of the world’s web apps now have a consistent and composable approach for managing state in which
The post Time for backend architectures to…React appeared first on Software Engineering Daily.
Cloud applications continue to grow in popularity, but ensuring the security of these applications often presents a formidable engineering challenge. This challenge motivated the creation of Jit. Jit is a continuous security platform for developers, and seeks to enable every cloud app to start with minimum viable security, or MVS, without slowing development velocity. David
The post Minimum Viable Security for Cloud Apps with David Melamed appeared first on Software Engineering Daily.
ScyllaDB is a fast and highly scalable NoSQL database designed to provide predictable performance at a massive cloud scale. It can handle millions of operations per second at a scale of gigabytes or petabytes. It’s also designed to be compatible with Cassandra and DynamoDB APIs. Scylla is used by Zillow, Comcast, and for Discord’s 350M+ users, and it continues to gain popularity in other cloud-native and highly scalable cloud-centric workloads.
Dor Laor is the Co-founder and CEO of Scylla, and he’s our guest today.
This episode is hosted by Lee Atchison. Lee Atchison is a software architect, author, and thought leader on cloud computing and application modernization. His best-selling book, Architecting for Scale (O’Reilly Media), is an essential resource for technical teams looking to maintain high availability and manage risk in their cloud environments.
Lee is the host of his podcast, Modern Digital Business, an engaging and informative podcast produced for people looking to build and grow their digital business with the help of modern applications and processes developed for today’s fast-moving business environment. Listen at mdb.fm. Follow Lee at softwarearchitectureinsights.com, and see all his content at leeatchison.com.Sponsorship inquiries: sponsor@softwareengineeringdaily.com
Please click here to view this show’s transcript.
The post Highly Scalable NoSQL with Dor Laor appeared first on Software Engineering Daily.
React is an immensely popular JavaScript library that is used to build website user interfaces. A key feature of React is that it uses a virtual Document Object Model, or DOM, to selectively update the desired regions of the web page, which provides major performance advantages. Million.js is an open source project that provides an optimized virtual DOM. Remarkably, these optimizations make React up to 70% faster and the code weighs in at less than 4 kilobytes in size.Aiden Bai is the creator of Million.js and he joins us in this episode.Mike Bifulco is CTO and co-founder of Craftwork. He’s also a developer advocate, writer, podcaster and serial startup founder. In past lives, Mike worked for Google, Stripe, Microsoft, and Gymnasium. Mike is also co-founder of APIs You Won’t Hate, a community for API Developers on the web. Mike’s publishes a weekly newsletter for product builders called Tiny Improvements at mikebifulco.com. Mike is on Mastodon at https://hachyderm.io/@irreverentmike
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
Please click here to view this show’s transcript.
The post Making React 70% faster with Aiden Bai of Million.js appeared first on Software Engineering Daily.
Cox Automotive has been at the frontier of digitizing the automotive space with popular products such as AutoTrader, Kelly Blue Book, and Dealertrack. To deliver these products the company manages large quantities of data and diverse engineering teams. Scaling its operations required an engineering transformation of the company. Chris Dillon is the VP of Architecture
The post Engineering Transformation at Scale with Chris Dillon appeared first on Software Engineering Daily.
Serverless backend platforms are cloud services that simplify the process of building a backend. These platforms are growing rapidly in popularity because they can greatly accelerate application development, and improve the developer experience. Convex is a real-time backend platform that uses 100% TypeScript and is designed with reactive UI frameworks in mind. The team behind
The post Building a full cloud backend with James Cowling appeared first on Software Engineering Daily.
Exafunction is a leader in deploying deep learning models at scale. One of their products is Codeium, a coding assistant for software developers based on Exafunction’s deep learning technology. Codeium provides AI-assisted autocompletion in your IDE, making it easier for you to incorporate deep learning technology in your software development workflow. Varun Mohan is the
The post Modern Coding Superpowers with Varun Mohan appeared first on Software Engineering Daily.
Tom Preston-Werner is a renowned software developer, inventor and entrepreneur. He co-founded GitHub and is the creator of the avatar service Gravatar, the TOML configuration file format, and the static site generator software Jekyll. Tom is currently working on the full-stack web framework, RedwoodJS. He joins us today to tell us the latest about RedwoodJS,
The post The Latest on RedwoodJS with Tom Preston-Werner appeared first on Software Engineering Daily.
Incident management is the process of managing and resolving unexpected disruptions or issues in software systems, especially those that are customer-facing or critical to business operations. Implementing a robust incident management system is often a key challenge in technical environments. Rootly is a platform to handle incident management directly from Slack, and is used by
The post Cross-functional Incident Management with Ashley Sawatsky and Niall Murphy appeared first on Software Engineering Daily.
AI-assisted software delivery refers to the utilization of artificial intelligence to assist, enhance, or automate various phases of the software development lifecycle. AI can be used in numerous aspects of software development, from requirements gathering to code generation to testing and monitoring. The overarching aim is to streamline software delivery, reduce errors and, ideally, reduce
The post AI for Software Delivery with Birgitta Böckeler appeared first on Software Engineering Daily.
The Buy Now, Pay Later model, or BNPL, is traditionally a business-to-consumer model that is gaining traction in the business-to-business domain. Adoption of BNPL in business-to-business scenarios offers benefits like improved cash flow management for buyers, and increased sales for suppliers, often leading to higher order value. However, this model introduces complexities, including the need
The post Expanding B2B payments with Sohil Pandya appeared first on Software Engineering Daily.
Database caching is a fundamental challenge in database management and there are hundreds of techniques to satisfy different caching scenarios. PolyScale is a fully automated database cache. It offers an innovative approach to database caching, leveraging AI and automated configuration to simplify the process of determining what should and should not be cached. Ben Hagen
The post Database Caching with Ben Hagen appeared first on Software Engineering Daily.
In memory of Software Engineering Daily Founder, Jeff Meyerson. 1988 – 2022
The post An update about SED from Jeff’s family appeared first on Software Engineering Daily.
In the realm of modern software development, clear and comprehensive documentation is essential for guiding users and contributors alike. Developers often struggle to create, manage, and maintain documentation that is both user-friendly and visually appealing. In this episode, we sit down with Sebastian Lorber, the lead maintainer of Docusaurus, a widely acclaimed open-source static site
The post Simplifying Documentation with Sébastien Lorber appeared first on Software Engineering Daily.
Nearly all developers are interested in developing APIs to streamline the connection process for other companies to their services. APIs are ubiquitous and critical to building modern software. However, making an API that provides a great developer experience can be a time-consuming endeavor. As a result, API teams often leave the “final” mile of integration
The post SDKs for your API with Sagar Batchu appeared first on Software Engineering Daily.
Generative pre-trained transformer models, or GPT models, have countless applications and are being rapidly deployed across a wide range of domains. However, using GPT models without appropriate safeguards can lead to leakage of sensitive data. This concern underscores the critical need for privacy and data protection. Skyflow GPT Privacy Vault prevents sensitive data from reaching
The post Ethical GPTs with Amruta Moktali appeared first on Software Engineering Daily.
The CAP theorem, also known as Brewer’s theorem, is a fundamental principle in distributed systems that states that it is impossible to simultaneously achieve three desirable properties in a distributed data system: Consistency, Availability, and Partition tolerance. Eric Brewer is the VP of Infrastructure & Google Fellow at Google and he joins us today. This
The post CAP Theorem 23 Years Later with Eric Brewer appeared first on Software Engineering Daily.
Companies have high hopes for Machine learning and AI to support real-time product offerings, prevent fraud and drive innovation. But there was a catch – training models require labeled data that machines can digest. As data volumes increase, the opportunity to get great ML results rises, but so does the problem of labeling all the
The post Data-Centric AI with Alex Ratner appeared first on Software Engineering Daily.
Elasticsearch is the most established solution today to search and analyze large amounts of logs. However, it can be costly and complex to manage. Quickwit searches large amounts of append only cloud data like logs or ledgers in a fraction time with significantly less cost than Elasticsearch. In this episode, we interview Paul Masurel, one
The post Cloud-native Search with Paul Masurel appeared first on Software Engineering Daily.
As Companies scale and their codebase becomes large, it can become difficult to measure team effectiveness. With so many moving pieces, and an increased lack of visibility, Engineering Leaders mostly rely on gut feelings to guide decisions and determine impact. Uplevel pulls meta-data from programs like Git, Slack, Jira and public calendar events and uses
The post Engineering Insights with Christina Forney appeared first on Software Engineering Daily.
Rudderstack is a warehouse-native customer data platform (CDP) that helps businesses collect, unify, and activate customer data from all their different sources. In today’s episode, we’re talking to Soumyadeb Mitra, the founder and CEO of Rudderstack. We discuss the importance of activating all your data, how Rudderstack can help you activate your data, the challenges
The post Making Data-Driven Decisions with Soumyadeb Mitra appeared first on Software Engineering Daily.
Hyperscalers refer to expansive cloud service providers capable of delivering enterprise-scale computing and storage services. Companies like Google, Amazon, Facebook that have huge data centers and are either running their own software or renting out this infrastructure can be called Hyperscalers. These Hyperscalers realized a long time back that the traditional Network, Storage & Compute
The post Shipping Oxide with Bryan Cantrill appeared first on Software Engineering Daily.
Available as a cloud service, Red Hat Trusted Software Supply Chain provides a DevSecOps framework to create applications more securely. Vincent Danen is the VP of Product Security at Red Hat and joins us in this episode. Red Hat has been a Secure Open Source software provider for very long. We discuss how the Red
The post Trusted Software Supply Chain with Vincent Danen appeared first on Software Engineering Daily.
The state of Data inside most companies is chaotic. It takes significant time and investment to tame this chaos. When you are a platform provider you are gathering tons of data from the developers using your platform. These developers building products on your platform need insight into that data to better understand how their application
The post Customer-facing Analytics with Tyler Wells appeared first on Software Engineering Daily.
The company Continue has a new take on the resale marketplace. By partnering with brands and pulling post-purchase data onto their platform, this innovative solution simplifies and enhances the resale process, empowering consumers to participate in a more sustainable and circular economy. Richie Ganney and Harry Riley are the Co-founders of Continue and they join
The post Resale Revolution with Richie Ganney and Harry Riley appeared first on Software Engineering Daily.
CRaC (Coordinated Restore at Checkpoint) is a new technology that can improve startup and warmup times by orders of magnitude. It is a project of OpenJDK that was proposed and led by Azul. The CRaC Project defines public Java APIs that allow for the coordination of resources during checkpoint and restore operations. With CRaC, a
The post Superfast JVM Startup with Gerrit Grunwald appeared first on Software Engineering Daily.
WebAssembly is a low-level binary format for the web that is compiled from other languages to offer maximized performance and is meant to augment the places where JavaScript isn’t sufficient. High Performance applications like AutoCAD, Figma and Photoshop are now leveraging the capabilities of WebAssembly to provide native experiences on the web. Matt Butcher is
The post WebAssembly with Matt Butcher appeared first on Software Engineering Daily.
In this episode, we are talking to Robert Cooke, founder and CTO of 3forge. He has spent the last decade creating a full stack software platform that revolutionized enterprise real-time data management, visualization, and workflows through its inventive “high impact code” concept. With offices in New York, London, and Singapore, 3forge has been serving a
The post Building Enterprise Applications with Robert Cooke appeared first on Software Engineering Daily.
Usage-Based Pricing is becoming more and more popular. Led by the wild popularity of cloud service providers such as AWS, customers are demanding more visibility into usage information and more accountability for the dollars they spend on a service. But historically service oriented products have shied away from usage based pricing because of the complexity
The post Solving Usage-Based Pricing with Puneet Gupta appeared first on Software Engineering Daily.
Feature flags also known as feature toggles, release toggles or feature flippers are a way to enable or disable a particular feature from your app without making any changes to the source code. You can turn on or off a particular functionality without deploying new code. Feature flags can also be used to serve different
The post Shipping Features with Ben Rometsch appeared first on Software Engineering Daily.
As companies depend more on data to improve digital products and make informed decisions, it’s crucial that the data they use be accurate and reliable. MonteCarlo, the data reliability company, is the creator of the industry’s first end-to-end data observability platform. Bar Moses and Lior Gavish are the founders of MonteCarlo and they join us
The post Data Reliability with Bar Moses and Lior Gavish appeared first on Software Engineering Daily.
Programming robotics software has traditionally been a specialized field. The software industry has seen rapid progress, the operating system that provides the foundation for our software applications is taken care of by companies like Google, Microsoft, and other players like Canonical, Amazon, etc. The robotics industry still needs that OS layer that handles the complexities
The post Modern Robotics Platform with Eliot Horowitz appeared first on Software Engineering Daily.
Mach5 Search is a slide-in, cloud-native replacement for Elasticsearch and OpenSearch that immediately saves up to 90% in operating cost. Mach5 Search can run on top of Google BigQuery, Snowflake, and Databricks, or natively on Object Stores in all the major clouds. Vinayak Borkar is the CEO and Co-Founder of Mach5 Software and he joins
The post Cloud Native Search with Vinayak Borkar appeared first on Software Engineering Daily.
Metrist is an observability platform designed to commoditize application observability. Jeff Martens is the CEO of Metrist, and he joins us today.
This episode is hosted by Lee Atchison. Lee Atchison is a software architect, author, and thought leader on cloud computing and application modernization. His most recent book, Architecting for Scale (O’Reilly Media) is an essential resource for technical teams looking to maintain high availability and manage risk in their cloud environments.
Lee is the host of his podcast, Modern Digital Business, an engaging and informative podcast produced for people looking to build and grow their digital business with the help of modern applications and processes developed for today’s fast-moving business environment. Subscribe at mdb.fm. Follow Lee, at leeatchison.com.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Observability for Your Cloud Dependencies with Jeff Martens appeared first on Software Engineering Daily.
In this podcast episode, we take a look at the intricacies of low-code data pipelines with Raj Bains, the founder of Prophecy.io. Raj shares valuable insights into how performant low-codedata pipelines are revolutionizing industries and transforming everyday operations. Raj discusses the founding story of Prophecy.io, the company’s mission, and its approach to democratizing the creation of efficient data pipeline solutions visual design and code generation. We also discuss technical concepts/conundrums such as data lineage, schema evolution, and metadata management, which are critical in addressing the challenges faced by data pipeline developers and businesses. The episode concludes with Raj’s thoughts on the future of low-code data pipelines, the Prophecy.io roadmap and its potential impact on various industries, from healthcare to finance.
Starting her career as a software developer, Jocelyn Houle is now a Senior Director of Product Management at Securiti.ai, a unified data protection and governance platform. Before that, she was an Operating Partner at Capital One Ventures investing in data and AI startups. Jocelyn has been a founder of two startups and a full life cycle, technical product manager at large companies like Fannie Mae, Microsoft and Capital One. Follow Jocelyn on LinkedIn or Twitter @jocelynbyrne.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Low-Code SQL on dbt Core with Raj Bains from Prophecy appeared first on Software Engineering Daily.
Crossplane is an innovative open source control plane framework that helps companies provide managed access to cloud native control planes. Upbound provides a single global platform to build, deploy, and operate these internally managed control planes that are powered by cross plane.
Bassam Tabbara is the CEO of Upbound, and he joins us today.
Free Upbound trial: https://www.upbound.io/registerAbout Crossplane: https://www.crossplane.io/This episode is hosted by Lee Atchison. Lee Atchison is a software architect, author, and thought leader on cloud computing and application modernization. His most recent book, Architecting for Scale (O’Reilly Media) is an essential resource for technical teams looking to maintain high availability and manage risk in their cloud environments.
Lee is the host of his podcast, Modern Digital Business, an engaging and informative podcast produced for people looking to build and grow their digital business with the help of modern applications and processes developed for today’s fast-moving business environment. Subscribe at mdb.fm. Follow Lee, at leeatchison.com.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Cloud-native Control Planes with Bassam Tabbara appeared first on Software Engineering Daily.
When your application fails, finding the reason quickly is essential for limiting downtime. Often, most of the time it takes to repair a problem is taken by figuring out what exactly went wrong. PromptOps is a service designed to make tracing the answer to why something happened back to the original cause.
Dev Nag is the CEO of PromptOps, and he joins us today.
This episode is hosted by Lee Atchison. Lee Atchison is a software architect, author, and thought leader on cloud computing and application modernization. His most recent book, Architecting for Scale (O’Reilly Media) is an essential resource for technical teams looking to maintain high availability and manage risk in their cloud environments.
Lee is the host of his podcast, Modern Digital Business, an engaging and informative podcast produced for people looking to build and grow their digital business with the help of modern applications and processes developed for today’s fast-moving business environment. Subscribe at mdb.fm. Follow Lee, at leeatchison.com.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post PromptOps with Dev Nag appeared first on Software Engineering Daily.
In the Software Industry, Conferences are crucial for developers, offering learning, networking, and collaboration opportunities. Attendees stay updated on the latest technologies, gain new skills, and connect with peers. These events expose developers to industry trends, inspire innovation, and foster professional growth. Overall, Conferences play a vital role in advancing knowledge, building connections, and driving success in the developer community.
In this episode, we discuss what makes a great Conference and how Shift Conference became of the largest events in Europe.
Ivan Burazin is the Chief Developer Experience Officer at Infobip and the CEO of Codeanywhere, and he joins us today.
Get your Tickets for Shift Miami on May 23rd and Shift Croatia, which is later this year.
Sean’s been an academic, startup founder, and Googler. He has published works covering a wide range of topics from information visualization to quantum computing. Currently, Sean is Head of Marketing and Developer Relations at Skyflow and host of the podcast Partially Redacted, a podcast about privacy and security engineering. You can connect with Sean on Twitter @seanfalconer .
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Shift Conference with Ivan Burazin appeared first on Software Engineering Daily.
The software supply chain refers to the process of creating and distributing software products. This includes all of the steps involved in creating, testing, packaging, and delivering software to end-users or customers.
Socket is a new security company that can protect your most critical apps from supply chain attacks. They are taking an entirely new approach to one of the hardest problems in security in a stagnant part of the industry that has historically been obsessed with just reporting on known vulnerabilities.
Feross is the Founder and CEO of Socket Security, and he joins us today.
This Interview was recorded at Open Source Summit North America and wouldn’t have been possible without the generous support fromThe Linux Foundation.ᐧJordi Mon Companys is a product manager and marketer that specializes in software delivery, developer experience, cloud native and open source. He has developed his career at companies like GitLab, Weaveworks, Harness and other platform and devtool providers. His interests range from software supply chain security to open source innovation. You can reach out to him on Twitter at @jordimonpmm
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Software Supply Chain with Feross Aboukhadijeh appeared first on Software Engineering Daily.
Chaos engineering is a discipline within the field of software engineering that focuses on testing and improving the resilience and stability of a system by intentionally introducing controlled instances of chaos and failure. The primary goal of chaos engineering is to identify and address potential weaknesses and vulnerabilities in a system, ultimately making it more robust and reliable.
Uma Mukkara is the Head of Chaos Engineering at Harness and he joins us today.
This Interview was recorded at KubeCon Europe and wouldn’t have been possible without the generous support from The Linux Foundation.
Jordi Mon Companys is a product manager and marketer that specializes in software delivery, developer experience, cloud native and open source. He has developed his career at companies like GitLab, Weaveworks, Harness and other platform and devtool providers. His interests range from software supply chain security to open source innovation. You can reach out to him on Twitter at @jordimonpmm
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Chaos Engineering with Uma Mukkara appeared first on Software Engineering Daily.
The CAP theorem, also known as Brewer’s theorem, is a fundamental principle in distributed systems that states that it is impossible to simultaneously achieve three desirable properties in a distributed data system: Consistency, Availability, and Partition tolerance.Eric Brewer is the VP of Infrastructure & Google Fellow at Google and he joins us today.This Interview was recorded at Open Source Summit North America and wouldn’t have been possible without the generous support fromThe Linux Foundation.ᐧ Jordi Mon Companys is a product manager and marketer that specializes in software delivery, developer experience, cloud native and open source. He has developed his career at companies like GitLab, Weaveworks, Harness and other platform and devtool providers. His interests range from software supply chain security to open source innovation. You can reach out to him on Twitter at @jordimonpmm
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post CAP Theorem 23 Years Later with Eric Brewer appeared first on Software Engineering Daily.
Astasia is a Partner on Quiet Capital’s enterprise team. Prior to joining Quiet, she was an investor on Redpoint Venture’s early stage enterprise team. Astasia joins the show to talk about Early Stage Venture Capital.Sean’s been an academic, startup founder, and Googler. He has published works covering a wide range of topics from information visualization to quantum computing. Currently, Sean is Head of Marketing and Developer Relations at Skyflow and host of the podcast Partially Redacted, a podcast about privacy and security engineering. You can connect with Sean on Twitter @seanfalconer.Sponsorship inquiries: sponsor@softwareengineeringdaily.comThe post Early Stage Venture Capital with Astasia Myers appeared first on Software Engineering Daily.
Ian Coldwater is a DevSecOps engineer turned red teamer who specializes in breaking and hardening Kubernetes, containers, and cloud native infrastructure. In their spare time, they like to go on cross-country road trips, capture flags, and eat a lot of pie. Ian lives in Minneapolis and tweets as @IanColdwater.This Interview was recorded at KubeCon Europe and wouldn’t have been possible without the generous support from The Linux Foundation.Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Kubernetes Security with Ian Coldwater appeared first on Software Engineering Daily.
Cloud native technologies empower organizations to build and run scalable applications in modern, dynamic environments such as public, private, and hybrid clouds. Containers, service meshes, microservices, immutable infrastructure, and declarative APIs exemplify this approach.
These techniques enable loosely coupled systems that are resilient, manageable, and observable. Combined with robust automation, they allow engineers to make high-impact changes frequently and predictably with minimal toil.
Chris Aniszczyk is the CTO at Cloud Native Computing Foundation and he joins us today.Jordi Mon Companys is a product manager and marketer that specializes in software delivery, developer experience, cloud native and open source. He has developed his career at companies like GitLab, Weaveworks, Harness and other platform and devtool providers. His interests range from software supply chain security to open source innovation. You can reach out to him on Twitter at @jordimonpmm
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Cloud Native in 2023 with Chris Aniszczyk appeared first on Software Engineering Daily.
Kubernetes is one of the most used open source platforms that orchestrates and automates operations. Although it improves the management and scaling of infrastructure and applications, Kubernetes frequently has challenges managing the complexity of releasing applications.
Git is the most widely used version-control system in the software industry today.
GitOps is a set of procedures that uses the power of Git to provide both revision and
change control within the Kubernetes platform.
Flux is an open source project that implements GitOps-driven continuous deployment for Kubernetes.
In this episode we speak with Priyanka Ravi and Stefan Prodan from Weaveworks.
The post GitOps for Kubernetes with Priyanka Ravi and Stefan Prodan appeared first on Software Engineering Daily.
Bug reporting hasn’t changed since the 1990’s. Despite all the technological advancements we’ve made in the rest of software development, the way we handle bugs has stayed the same.
It is common practice for non technical teams to provide bug reports that are missing vital information for developers to identify and quickly fix code, such as: network requests, console logs, HAR file, device information, video or screenshot replication, and more.
Providing a comprehensive bug report requires logging into many tools and time spent context switching, creating an environment where people are less likely to report bugs, which is not an ideal scenario for any founder or builder.
Dani & Irtefa, co-founders at Jam.dev set out to build a tool that will enable anyone, no matter their technical background, to capture rich contextual technical data about bugs, so that developers can quickly identify and resolve issues.
Jam is a browser extension that will instantly replay a bug while automatically attaching diagnostics: network requests and speed, console logs, device, and more – all in one easy click. You don’t have to log into a new tool or disrupt workflows, as Jam has direct integrations with all the first class bug reporting tools to seamlessly drop diagnostics into a ticket.
In this episode, Dani & Irtefa share their experience building greenfield products for Cloudflare’s Emerging Technology and Incubation team, how bug reporting was the common pain-point that impacted their product velocity, and the technology decisions they made when building Jam.
Test it out for free at: Jam.dev
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Bug Reporting is Broken and how Jam is Fixing that with Dani Grant & Mohd Irtefa appeared first on Software Engineering Daily.
In this episode we have two guests Ramiro Berrelleza is the founder and CEO of Okteto, a developer tool that helps you create production like dev environments in the cloud for every developer. Ramiro will tell us how to easily make replica environments for your day to day development , but computing related infrastructure is only half the battle. It also helps to have realistic data when you’re developing.
John Craft is the CTO at Privacy Dynamics, a company that helps you create anonymized data. You can use Privacy Dynamics to create realistic data from your production database without compromising your customer information.
Alex is an AWS Data Hero, an independent consultant, and the author of The DynamoDB Book, the comprehensive guide to data modeling with DynamoDB. He was an early employee at Serverless, Inc., creators of the Serverless Framework, and was an early community member in the serverless space. His consulting and training work focuses on serverless architectures and database optimization. You can find him on Twitter as @alexbdebrie or on his site, alexdebrie.com.
Sponsorship inquiries: sponsor@softwareengineeringdaily.comThe post Pre-configured Development Environments appeared first on Software Engineering Daily.
The cloud has become an all-encompassing platform for running diverse applications and enabling individuals and teams to add value by utilizing services and infrastructure that streamline the process of software building and operation. Nonetheless, the cloud has presented new hurdles for developers as it is intricate, and application development demands comprehension of cloud service intricacies. Moreover, creating portable applications across different cloud providers, as well as local testing and debugging, have proven to be difficult. Additionally, leaky abstractions and inadequate tooling have made it challenging to repurpose cloud architectures into reusable components.
To address these challenges, a cloud-centric programming language called Wing has been introduced. Wing enables developers to create distributed systems that fully capitalize on the cloud’s capabilities without the need to concern themselves with the underlying infrastructure.
Jeff is a DevSecOps engineer with strong experience in Security, The Software Development Life Cycle and Cloud Technologies. His advanced expertise in HashiCorp technologies places him as one of the most sought after trainers in the EMEA region and beyond. Jeff has worked for a range of different companies – from small startups to some of the biggest financial institutions. He now successfully runs his own consultancy that provides services in DevSecOps, Cloud and Security. Check it out on hemmen.LU and follow Jeff on LinkedIn @jeffhemmen
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Cloud-Oriented Programming (Part 2) with Elad Ben-Israel appeared first on Software Engineering Daily.
The goal of having a single pane of glass that allows us to see what is happening with our organization’s IT operations has been a long-standing goal for many organizations. The goal makes a lot of sense. Without a clear end-to-end picture, it is hard to determine where your problems are if you can’t determine whether something happening upstream is creating significant knock-on effects.
When we have these high-level views, we are, of course, aggregating and abstracting details. So the ability to drill into the detail from a single view is an inherent requirement. The problem comes when we have distributed our solutions across multiple data centers, cloud regions, or even regions with multiple vendors.
The core of the challenge is that our monitoring through logs, metrics, and traces accounts for a significant amount of data, particularly when it isn’t compressed. An application that is chatty with its logs or hasn’t tuned its logging configuration can easily generate more log content than the actual transactional data. The only reason we don’t notice it is that logs are generally not consolidated, and log data is purged.
When it comes to handling the monitoring in a distributed arrangement, if we want to consolidate our logs, we’re potentially egressing a lot of traffic from a data center or cloud provider, and that costs. Cloud providers typically don’t charge for inbound data, but depending upon the provider, it can be expensive for data egress; it can even cost to transmit data between regions with some providers. Even for private data centers, the cost exists in the form of bandwidth of connectivity to the internet backbone and/or the use of leased lines. The numbers can also vary around the world as well.
The following diagram provides some indicative figures from the last time I surveyed the published prices of the leading hyper scalers, and the on-premises costs are derived from leased line pricing.
This raises the question of how on earth do you create a centralized single pane of glass for your monitoring without risking potentially significant data costs. Where should I consolidate my data to? What does this mean if I use SaaS monitoring solutions such as DataDog?
There are several things we can do to improve the situation. Firstly, let’s look at the logs and traces being generated. They may help during development and testing, but do we need all of it? If we’re using logging frameworks, are the logs correctly classified as Trace, Debug, and so on? When logging frameworks are being used by applications, we can tune the logging configuration to deal with the situation when one module is particularly noisy. But for those systems that are brittle, people who are nervous about modifying any configuration or a 3rd party support organization will void any agreements if you modify any configuration. The following line of control is to take advantage of tools such as Fluentd, Logstash, or Fluentbit, which brings with it full support for OpenTelemetry. We can introduce these tools into the environment near the data source so that they can capture and filter the logs, traces, and metrics data.
The way these tools work means they can consume, transform and send logs, traces, and metrics to the final destination in a format that most systems can support. Further, Fluentd and Fluentbit can easily be deployed to fan out and fan in workloads – so scaling to sort out the data comprehensively can be done easily. We can also use them as a relay capability so we can funnel the data through specific points in a network for added security.
As you can see in the following diagram, we’re mixing Fluentd and Fluentbit to concentrate data flow before allowing it to egress. In doing so, we can reduce the number of points of network exposure to the internet. A strategy that shouldn’t be used as the only mechanism to secure data transmission, but certainly one that can be part of an arsenal of security considerations. It can also be used as a point of failsafe in the event of connectivity issues.
As well as filtering and channeling the data flow, these tools can also direct data to multiple destinations. So rather than throwing away data that we don’t want centrally, we can consolidate the data into an efficient time-series data store within the same data center/cloud and send on the data that has been identified as high value. This then gives us two options; in the event of investigating an issue, we can do a couple of things:
- Identify the additional data needed to enrich the central aggregated analysis and ingest just that additional data (and possibly further refine the filtration for the future) needed.
- Implement localized analysis and incorporate the resultant views into our dashboards.
Either way, you have access to additional information. I would opt for the former. I’ve seen situations where the local data stores have been purged too quickly by local operational teams, and data like traces and logs compress well in greater volume. But remember, if the logs include data that may be sensitive to location, pulling them to the center can raise additional challenges.
While in the diagram, we’ve shown the monitoring center to be on-premise, this could equally be a SaaS product or one of the clouds. The key to where the center is comes down to three key criteria:
- Any data constraints in terms of the ISO 27001 view of security (integrity, confidentiality, and availability).
- Connectivity and connectivity costs. This will tend to bias the location for monitoring to where the largest volume of monitoring data is generated.
- Monitoring capability and capacity – both functional (visualize and analyze data) and non-functional factors, such as how quickly inbound monitoring data can be ingested and processed.
Adopting a GitOps strategy to help ensure that we have consistency in configuration and, therefore, data flow from software that may well be deployed across data centers or cloud regions and possibly even multiple cloud vendors can be kept consistent because the monitoring sources are consistent in configuration If we identify changes to the filters (to remove or include) data coming to the center.
Incidentally, most stores of log data, be that compressed flat files, databases can be processed with tools like Fluentd not only as a data sink but also as a data source. So it is possible through GitOps to distribute out temporary configurations for your Fluentd/Fluentbit nodes which can harvest and bulk move any newly required data for the center from those regionalized staging stores rather than manually accessing and searching them. But if you adopt this approach, we recommend creating templates for such actions in advance and use as part of a tested operational process. If such a strategy were to be adopted at short notice as part of a problem remediation activity, you could accidentally try and harvest too much data or impact current active operations. It needs to be done with awareness about how it can impact what is live.
Hopefully, this will help offer some inspiration for cost-efficiently handling hybrid and multi-cloud operational monitoring.
The post Challenges of Multi-Cloud and Hybrid Monitoring appeared first on Software Engineering Daily.
Chroma is an open source embedding database that is designed to make it easy to build large language model applications by making knowledge, facts and skills pluggable.Anton Troynikov is the co-founder of Chroma and he is our guest today.This episode is hosted by Lee Atchison. Lee Atchison is a software architect, author, and thought leader on cloud computing and application modernization. His most recent book, Architecting for Scale (O’Reilly Media) is an essential resource for technical teams looking to maintain high availability and manage risk in their cloud environments.
Lee is the host of his podcast, Modern Digital Business, an engaging and informative podcast produced for people looking to build and grow their digital business with the help of modern applications and processes developed for today’s fast-moving business environment. Subscribe at mdb.fm. Follow Lee, at leeatchison.com.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Open-Source Embedding Database appeared first on Software Engineering Daily.
The cloud has become an all-encompassing platform for running diverse applications and enabling individuals and teams to add value by utilizing services and infrastructure that streamline the process of software building and operation. Nonetheless, the cloud has presented new hurdles for developers as it is intricate, and application development demands comprehension of cloud service intricacies. Moreover, creating portable applications across different cloud providers, as well as local testing and debugging, have proven to be difficult. Additionally, leaky abstractions and inadequate tooling have made it challenging to repurpose cloud architectures into reusable components.
To address these challenges, a cloud-centric programming language called Wing has been introduced. Wing enables developers to create distributed systems that fully capitalize on the cloud’s capabilities without the need to concern themselves with the underlying infrastructure.
Jeff is a DevSecOps engineer with strong experience in Security, The Software Development Life Cycle and Cloud Technologies. His advanced expertise in HashiCorp technologies places him as one of the most sought after trainers in the EMEA region and beyond. Jeff has worked for a range of different companies – from small startups to some of the biggest financial institutions. He now successfully runs his own consultancy that provides services in DevSecOps, Cloud and Security. Check it out on hemmen.LU and follow Jeff on LinkedIn @jeffhemmen
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Cloud-Oriented Programming with Elad Ben-Israel appeared first on Software Engineering Daily.
Code editors are complex and demanding pieces of software that are both essential tools and constant companions for developers. Today, we are interviewing Nathan Sobo to hear about Zed, a code editor focused on “multiplayer” experiences, performance and a streamlined, minimalist design.
Nathan Sobo was a member of the Atom editor team at GitHub, which worked on the (now-deprecated) Atom code editor. He will share his thoughts on Rust, the impact of very low-latency collaborative coding on happiness, and how to turn an authoring environment into a first-class concern.
Starting her career as a software developer, Jocelyn Houle is now a Senior Director of Product Management at Securit.ai, a unified data protection and governance platform. Before that, she was an Operating Partner at Capital One Ventures investing in data and AI startups. Jocelyn has been a founder of two startups and a full life cycle, technical product manager at large companies like Fannie Mae, Microsoft and Capital One. Follow Jocelyn on Linkedinor Twitter @jocelynbyrne
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Multi-player coding with Nathan Sobo appeared first on Software Engineering Daily.
Most companies aren’t in the building business yet they need to deal with pricing and billing as a core piece of technology whether they want to or not. Stigg is an easy to implement headless pricing and packaging platform that takes a lot of the hassle out of pricing and billing for your SaaS application. Their APIs help developers launch new pricing plans faster that lead to better customer buying experiences.
Anton Zagrebelny is the CTO of Stigg and he is our guest today.
This episode is hosted by Lee Atchison. Lee Atchison is a software architect, author, and thought leader on cloud computing and application modernization. His most recent book, Architecting for Scale (O’Reilly Media) is an essential resource for technical teams looking to maintain high availability and manage risk in their cloud environments.
Lee is the host of his podcast, Modern Digital Business, an engaging and informative podcast produced for people looking to build and grow their digital business with the help of modern applications and processes developed for today’s fast-moving business environment. Subscribe at mdb.fm. Follow Lee, at leeatchison.com.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Pricing and Packaging Orchestration with Anton Zagrebelny appeared first on Software Engineering Daily.
Finout helps FinOps, DevOps, and Finance to manage & reduce cloud spend and improve the company’s profitability without adding code or changing existing tags.
Roi Ravhon is the Co-founder and CEO at Finout and he joins us today.
Full disclosure: Fineout is a sponsor of Software Engineering Daily.
Alex is an AWS Data Hero, an independent consultant, and the author of The DynamoDB Book, the comprehensive guide to data modeling with DynamoDB. He was an early employee at Serverless, Inc., creators of the Serverless Framework, and was an early community member in the serverless space. His consulting and training work focuses on serverless architectures and database optimization. You can find him on Twitter as @alexbdebrie or on his site, alexdebrie.com.
Sponsorship inquiries: sponsor@softwareengineeringdaily.comThe post Cloud Cost Management with Roi Ravhon appeared first on Software Engineering Daily.
Data Activation is the method of unlocking the knowledge sorted within your data warehouse, and making it actionable by your business users in the end tools that they use every day. In doing so, Data Activation helps bring data people toward the center of the business, directly tying their work to business outcomes.
Hightouch is the simplest and fastest way to get started with Data Activation. As a Data Activation Platform, Hightouch uses Reverse ETL to sync data from the warehouse to 100+ different integrations. With Hightouch companies can leverage their existing data models and easily view and monitor all of their data syncs in a single platform. Better yet, Hightouch offers a visual audience builder that makes it easy for non-technical users to create custom audiences at moment’s notice.
Tejas Manohar is the CEO at Hightouch and he joins us today.
Full disclosure: Hightouch is a sponsor of Software Engineering Daily.
Alex is an AWS Data Hero, an independent consultant, and the author of The DynamoDB Book, the comprehensive guide to data modeling with DynamoDB. He was an early employee at Serverless, Inc., creators of the Serverless Framework, and was an early community member in the serverless space. His consulting and training work focuses on serverless architectures and database optimization. You can find him on Twitter as @alexbdebrie or on his site, alexdebrie.com.
Sponsorship inquiries: sponsor@softwareengineeringdaily.comThe post Data Activation with Tejas Manohar appeared first on Software Engineering Daily.
Enabling data engineers to create data pipelines easily while delivering data streams that meet low-latency, production requirements is a difficult balancing act. David Yaffe and Johnny Gaettinger join us today to share how they have created that balance at Estuary.
Estuary is a data operations platform that synchronizes data across the systems where data lives and delivers it where you want it to live with sub second low latency. Dave and Johnny will share the technical choices that support sub second performance, use cases for batch and streaming data applications and some of their business perspective as an early stage start-up.Starting her career as a software developer, Jocelyn Houle is now a Senior Director of Product Management at Securit.ai, a unified data protection and governance platform. Before that, she was an Operating Partner at Capital One Ventures investing in data and AI startups. Jocelyn has been a founder of two startups and a full life cycle, technical product manager at large companies like Fannie Mae, Microsoft and Capital One. Follow Jocelyn on Linkedinor Twitter @jocelynbyrne
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Unified DataOps for Teams and Enterprise with Estuary.dev appeared first on Software Engineering Daily.
A data catalog provides an index into the data sets and schemas of a company.Data teams are growing in size, and more companies than ever have a data team, so the market for data catalog is larger than ever.
Mark is the CEO of Stemma and the co-creator of Amundsen, a data catalog that came out of Lyft. In today’s show Mark shares how his history as a software developer, data engineer and product leader at Lyft have helped him create a vision for a modern data catalog.
Starting her career as a software developer, Jocelyn Houle is now a Senior Director of Product Management at Securit.ai, a unified data protection and governance platform. Before that, she was an Operating Partner at Capitol One Ventures investing in data and AI startups. Jocelyn has been a founder of two startups and a full life cycle, technical product manager at large companies like Fannie Mae, Microsoft and Capital One. Follow Jocelyn on Linkedinor Twitter @jocelynbyrne
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Self-Service Data Culture with Stemma’s Mark Grover appeared first on Software Engineering Daily.
Streaming analytics refers to the process of analyzing real-time data that is generated continuously and rapidly from various sources, such as sensors, applications, social media, and other internet-connected devices. Streaming analytics platforms enable organizations to extract business value from data in motion, similar to how traditional analytics tools derive insights from data at rest. DeltaStream is a unified serverless stream processing platform to manage, secure and process all your event streams and is based on Apache Flink.
Hojjat Jafarpour is the Founder and CEO at DeltaStream and he joins us today. Before joining DeltaStream, Hojjat was at Confluent, the company behind Apache Kafka, he built a product called ksqlDB, ksqlDB is a database built to do Stream processing on top of Apache Kafka.Starting her career as a software developer, Jocelyn Houle is now a Senior Director of Product Management at Securit.ai, a unified data protection and governance platform. Before that, she was an Operating Partner at Capitol One Ventures investing in data and AI startups. Jocelyn has been a founder of two startups and a full life cycle, technical product manager at large companies like Fannie Mae, Microsoft and Capital One. Follow Jocelyn on Linkedinor Twitter @jocelynbyrneSponsorship inquiries: sponsor@softwareengineeringdaily.comThe post Streaming Analytics with Hojjat Jafarpour appeared first on Software Engineering Daily.
Observability refers to the capability of comprehending the internal functioning of a complex system by observing its external outputs. Observability tools help developers understand the entire scenario of an application by digging into the data that is being used and recorded. And can help pipe data across various solutions used within enterprises to read and discover what’s going on from analytics.
Rookout is an observability platform with a developer-first approach that empowers you to collect any data point, even from the most intricate levels of live code, in real time and as needed.
Liran Haimovitch is the CTO at Rookout, and he joins us today. We discuss about Rookouts recent offering called Snapshots. Rookout calls this the fourth pillar of Observability. With Snapshots, developers can accurately and quickly capture application state with outstanding performance and built-in security.
Mike Bifulco is CTO and co-founder of Craftwork. He’s also a developer advocate, writer, podcaster and serial startup founder. In past lives, Mike worked for Google, Stripe, Microsoft, and Gymnasium. Mike is also co-founder of APIs You Won’t Hate, a community for API Developers on the web. Mike’s publishes a weekly newsletter for product builders called Tiny Improvements at mikebifulco.com. Mike is on Mastodon at https://hachyderm.io/@irreverentmike
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Observability via Snapshots with Liran Haimovitch appeared first on Software Engineering Daily.
Distributed databases are necessary for storing and managing data across multiple nodes in a network. They provide scalability, fault tolerance, improved performance, and cost savings. By distributing data across nodes, they allow for efficient processing of large amounts of data and redundancy against failures. They can also be used to store data across multiple locations for faster access and better performance.
Turso is an edge-hosted, distributed database based on libSQL, an open-source and open-contribution fork of SQLite. It was designed to minimize query latency for applications where queries come from anywhere in the world. In particular, it works well with edge functions provided by cloud platforms such as CloudFlare, Netlify, and Vercel, by putting your data geographically close to the code that accesses it.
Glauber Costa is the Founder and CEO of ChiselStrike the company behind Turso, and he joins us today.
Alex is an AWS Data Hero, an independent consultant, and the author of The DynamoDB Book, the comprehensive guide to data modeling with DynamoDB. He was an early employee at Serverless, Inc., creators of the Serverless Framework, and was an early community member in the serverless space. His consulting and training work focuses on serverless architectures and database optimization. You can find him on Twitter as @alexbdebrie or on his site, alexdebrie.com.
Sponsorship inquiries: sponsor@softwareengineeringdaily.comThe post Turso: Globally Replicated SQLite with Glauber Costa appeared first on Software Engineering Daily.
The increasing complexity of modern cloud-native architectures has led to the emergence Platform Engineering. This practice involves the development and upkeep of an integrated product, known as an “Internal Developer Platform,” which serves as a flexible and supported abstraction layer between application developers and the underlying technologies. Luca Galante leads Product at Humanitec and he joins us today.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Platform Engineering with Luca Galante appeared first on Software Engineering Daily.
C++ is a powerful programming language that has been in use for several decades. Its importance lies in its versatility and efficiency, making it a popular choice for developing software and systems across different domains. The impact of C++ is significant, as it has been used to create numerous high-performance applications, including operating systems, browsers, gaming engines, and financial systems. It has also played a crucial role in the development of the internet and the growth of modern computing.
In a recent development the NSA indirectly asked developers to use memory safe languages whenever possible because hackers frequently exploit memory issues. In this episode, we’ll discuss these safety issues with the creator of C++ Bjarne Stroupstrup.
Jordi Mon Companys is a product manager and marketer that specializes in software delivery, developer experience, cloud native and open source. He has developed his career at companies like GitLab, Weaveworks, Harness and other platform and devtool providers. His interests range from software supply chain security to open source innovation. You can reach out to him on Twitter at @jordimonpmm
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Hardening C++ with Bjarne Stroustrup appeared first on Software Engineering Daily.
A SIEM platform provides organizations with a powerful tool for improving their security posture, by providing insights into potential security threats and enabling proactive security measures.
Panther is a Cloud based security monitoring platform that helps teams detect and respond to security breaches quickly and intelligently.
Jack Naglieri is the Founder and CEO of Panther and he joins us today.Jeff is a DevSecOps engineer with strong experience in Security, The Software Development Life Cycle and Cloud Technologies. He’s an expert in HashiCorp Technologies and is one the most sought after trainers in EMEA and beyond. Jeff has worked for companies ranging from small startups to the biggest financial institutions, he runs his own consultancy that provides services in DevOps, Cloud and Security. Follow Jeff on LinkedIn @jeffhemmen
The post Seamless SecOps with Jack Naglieri appeared first on Software Engineering Daily.
“DataSet” is a log analytics platform provided by Sentinel One that helps DevOps, IT engineering, and security teams get answers from their data across all time periods, both live streaming and historical. It’s powered by a unique architecture that uses a massively parallel query engine to provide actionable insights from the data available.
John Hart is a distinguished engineer leading the Event DB team, where he’s responsible for the time series database that powers the Dataset product. John is our guest here today.
Full disclosure: SentinelOne is a sponsor of Software Engineering Daily.
This episode is hosted by Lee Atchison. Lee Atchison is a software architect, author, and thought leader on cloud computing and application modernization. His most recent book, Architecting for Scale (O’Reilly Media) is an essential resource for technical teams looking to maintain high availability and manage risk in their cloud environments.
Lee is the host of his podcast, Modern Digital Business, an engaging and informative podcast produced for people looking to build and grow their digital business with the help of modern applications and processes developed for today’s fast-moving business environment. Subscribe at mdb.fm. Follow Lee, at leeatchison.com.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Observability Trends with John Hart appeared first on Software Engineering Daily.
Vercel is the platform for frontend developers, providing the speed and reliability innovators need to create at the moment of inspiration. Vercel’s Edge Functions enable you to deliver dynamic, personalized content with the lightweight Edge Runtime.
Guillermo Rauch is the CEO at Vercel and he joins us today.
This episode is hosted by Mike Bifulco. To learn more about Mike visit mikebifulco.com
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Building Delightful User Experiences with Guillermo Rauch appeared first on Software Engineering Daily.
What are the reasons why we need to improve performance? The JVM is a powerful piece of software – this is the reason why Java has maintained its popularity over the past 26+ years. But… there are some ways that the JVM works that can impact the performance of your applications.
One of the biggest challenges is latency – how quickly can we respond to a request from a user to access your application. That comes down to garbage collection – which leads to pauses and a bad customer experience. Garbage collection pauses can vary. But they impact application performance. The bigger the heap, the longer your pauses…but how do you optimize? What about warm-up time? That’s also a big challenge. We’ve addressed these problems without re-writing code from scratch – and that leads to better Java performance without any code changes.
This episode explores how you can use a performance JVM to make applications start fast, go fast, and stay fast.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Improved Java Performance Sans Code Changes with Simon Ritter appeared first on Software Engineering Daily.
There are many types of early stage funding available from friends and family to seed to series A. Some firms invest across a wide set of technologies and seek only to provide capital. Others are in it for the long haul – they focus on specific areas of technology and develop both long term relationships and deep expertise over time.
Today, we are interviewing Matt Turck of First Mark Capital, who is in it for the long haul and whose portfolio companies include Dataiku, Crossbeam, Ada, Cockroach Labs, Clickhouse and more. Today we will talk about Matt’s career, investment point of view, founding the Data-driven NYC community and the recent release of the 20234 MAD – an industry resource for understanding the Machine Learning, AI and Data Landscape
Be sure to check out the show notes for links to the MAD
This epsiode is hosted by Jocelyn Houle. Follow Jocelyn on Linked or on Twitter @jocelynbyrne.
Show notes –
In today’s show we referenced a couple things you may want to check out.
Matt’s blog and MAD Landscape
The interactive MAD Landscape
The picture in Matt’s Office was The Son of Man by Rene Magritte
Matt’s full bio
FirstMark Capital Site
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Data Investing and the MAD with Matt Turck appeared first on Software Engineering Daily.
Netlify is a cloud-based platform that provides web developers with an all-in-one workflow to build, deploy, and manage modern web projects.
Matt Biilmann is the CEO of Netlify and he joins us today.
The post Netlify with Mathias Biilmann Christensen appeared first on Software Engineering Daily.
ChatGPT is an artificial intelligence language model developed by OpenAI. It is part of the GPT (Generative Pre-trained Transformer) family of models, which are designed to generate human-like text based on input prompts. ChatGPT is specifically trained to carry out conversational tasks, such as answering questions, completing sentences, and engaging in dialogue. It has been pre-trained on a large corpus of text data and fine-tuned on specific tasks to improve its performance. As a result, ChatGPT can generate responses that are often coherent, relevant, and natural-sounding.
Christian Hubicki is an Assistant Professor in the Robotics Department at Florida State University. He joins us today to discuss ChatGPT and its implications. We also discussed the future of Artificial Intelligence in general.
This show is hosted by Sean Falconer. Sean is the Head of Developer Relations and Marketing @Skyflow. Follow Sean at @seanfalconer
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Surviving ChatGPT with Christian Hubicki appeared first on Software Engineering Daily.
Lee Edwards is a Partner at Root Ventures, a venture capital firm that invests in early-stage startups that are focused on solving hard engineering problems. Lee is an investor in Privacy Dynamics, a company that offers data anonymisation as a service. You can listen to our interview with the CTO of Privacy Dynamics, John Craft here.
Lee is interested in investing in startups founded by engineers who are committed to addressing complex software challenges. This includes areas such as developer tools and services, software infrastructure, applied artificial intelligence and machine learning, tooling for data scientists and engineers, computer vision, and any other endeavor that requires a highly skilled technical team to develop.
This epsiode is hosted by Jocelyn Houle. Jocelyn is focused on data, ML and enterprise software. She has experience as a founder, investor, and product leader and has worked with both start-ups and large financial services companies. Jocelyn is currently a Senior Director of Product management for Securiti, a unified data controls company. Follow Jocelyn on Linked or on Twitter @jocelynbyrne.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Seeding Bold Engineers with Lee Edwards appeared first on Software Engineering Daily.
API mocking is a technique used to simulate the behavior of an API without actually connecting to the real API. It is useful for various reasons, including testing, isolation, development, and cost reduction. By using API mocking, developers can test their code without relying on the availability of the real API, isolate the code being tested from the behavior of the API, work on their code even when the API is not yet available, and reduce the number of requests they make to the real API, thus saving money.
WireMock is a flexible tool for building mock APIs and can operate as either a standalone server or as a managed service through WireMock Cloud.
Tom Akehurst is the CTO & Co-founder at WireMock and he joins us today.
Show Host: Sean Falconer
Full disclosure: Wiremock is a sponsor of Software Engineering Daily.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Creating Mock APIs with Tom Akehurst appeared first on Software Engineering Daily.
As companies move more and more workloads to the cloud, cost management in the cloud is becoming critically important. Modern application development methodology increasingly involves moving to service and microservice architectures enabled by the cloud and kubernetes is the backbone of this modern infrastructure trend. Managing costs of kubernetes clusters is therefore becoming increasingly important. Kubecost is the company focused on giving visibility into kubernetes resources, allowing you to reduce your overall kubernetes based infrastructure spend. OpenCost is an open-source project by Kubecost and supported by a few other partner companies. Matt Ray is Senior Community Manager at OpenCost and he joins us today.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Kubernetes Cost Management with Matt Ray appeared first on Software Engineering Daily.
Jeli.io is an end to end incident management tool. Jeli helps you understand why an incident took place, how it could’ve been prevented, and allows you to dive deep into uncovered themes, patterns, or problem areas!
Nora Jones is the Founder and CEO at Jeli.io and she joins us today.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Learning From Incidents with Nora Jones appeared first on Software Engineering Daily.
Data observability is the idea of creating a unified view of all the data so you can head off problems early, identify outages, and address any conflicts in real time. Today we’re interviewing Streamdal’s founders Ustin Zarubin and Dan Selans. They’re gonna share with us how they’re using an application monitoring approach to address the challenges of getting that unified view in today’s data-centric streaming enviroment.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Streamdal: Streaming Data Performance Monitoring with Ustin Zarubin and Dan Selans appeared first on Software Engineering Daily.
Let’s say you have a set of microservices running on a Kubernetes cluster. In the past, developers used to program features like service discovery, observability, who’s allowed to talk to whom and other security related features directly into the application code.This slowed down the dev cycle and it made these microservices bigger and just generally made everything less flexible.
The service mesh is a tool responsible for handling service-to-service communication. You keep your application small and business focused and instead you dynamically program the intelligence into the network.
The Istio ambient mesh is an alternative to the standard Istio architecture, it allows you to not have to run sidecars per application.
The company Solo.io was founded by Idit Levine a few years ago. Interestingly the name Solo comes from her being the Solo founder when she started the company and the io domain name was a cool thing to have back then.
Brian Gracely is the Head of Marketing at Solo.io and he joins us today.
Show host: Jordi Mon Companys
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Istio Ambient Mesh with Brian Gracely appeared first on Software Engineering Daily.
Kubernetes is an open-source platform for automating the deployment, scaling, and management of containerized applications. The company Komodor started as a Kubernetes diagnostics platform focusing on Kubernetes troubleshooting for the entire Kubernetes stack. More recently, Komodor is taking a step towards becoming a single-pane-of-glass to simplify Kubernetes for developers. In the past, they were more DevOps-focused, and they’ve made some significant changes in the product that will appeal more to the developer. Komodor is also entering into the cluster management space to compete with Lens.
Itiel Shwartz is the co-founder and CTO of Komodor, and he joins us today.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Dev-First Kubernetes Operations Platform with Itiel Shwartz appeared first on Software Engineering Daily.
Permissions are Hard! And they are becoming harder as we move more into the Cloud-native ecosystem. If we go back in time to the point where it was just a single monolith that you were building on your own. You’ll probably have a framework to manage the permissions for you. But when you are working with distributed microservices, especially if you are a polyglot, you can’t use those solutions anymore. So you end up having to sprinkle a bit of access control into every little microservice and component that you build. In addition, with the scale of modern applications, it’s no longer just your services, there are a lot of third-party services that you have to connect to. Think about things like authentication, billing, analytics and other stuff that you combine from eternal services into what you are building.
Permit.io empowers developers to bake in permissions and access control into any product in minutes and takes away the pain of constantly rebuilding them. Or Weis is the co-founder and CEO of Permit.io and joins us today.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Permit Elements and Fullstack Authorization with Or Weis appeared first on Software Engineering Daily.
Data catalogs are one way to address the tension between wanting to use all the data for business advantage and needing to govern all the data for compliance. Today, Zeashan Pappa, a Databricks Product Specialist for the Unity Catalog, joins us to discuss how catalogs can help companies capture the full value of their data. Zeashan Pappa is a technology executive and architect who has 20+ years of enterprise software architecture, engineering, consulting, and project management expertise.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Databricks Unity Catalog with Zeashan Pappa appeared first on Software Engineering Daily.
Webhooks are used in connecting two different online applications. Webhooks allow one program to send data to another as soon as a certain event takes place.And because they are event-driven, webhooks are ideal for things like real-time notifications and data updates. The company Hookdeck helps build webhook integrations at scale.
In this episode, we talk with Alexandre Bouchard, Co-founder of Hookdeck.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Webhooks at Scale with Alexandre Bouchard appeared first on Software Engineering Daily.
Twitter is a social media platform that does some incredibly complex stuff when it comes to distributed systems engineering to keep the website up and running. Twitter has open sourced a lot of projects for others to use. Twitter created a fork of Memcached called Twemcache and also a fork of Redis to handle the caching issues. In this episode we talk to Yao Yue. Yao Yue is an expert in distributed systems and performance. She led the cache team at Twitter. Her most notable open-source project is Pelikan, a modular caching framework with the best performance and operator ergonomics in the domain of distributed caching. Pelikan is ideal for large scale deployment as well as cutting-edge research.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Caching at Twitter with Yao Yue appeared first on Software Engineering Daily.
Although we like to think about ML workflows as straight line narratives from experiment to training to production, and then monitoring, the reality for large companies is that all the steps are happening at one time in concert with other models, with shifting data and sometimes misaligned key feature inputs.Moreover regulated firms are required to track all the models, the changes, and the impacts of those changes For compliance. Enter explainability supported by model monitoring, far from sleepy monitoring of changes and anomalies. Today’s ML monitoring and performance management requires the ability to identify changes and alert the right people, the ability to assist in diagnosing issues, to create what if scenarios, and the ability to pop models back into production in real time with proper governance.FiddlerAI is a startup focused on enterprise model performance management. They are tackling the unique challenges of building in-house stable and secure MLOps systems at scale. Today we are interviewing Krishna Gade about trusting AI, the technical challenges of ML monitoring and the real world problem statements beyond compliance that explainability can address.Sponsorship inquiries: sponsor@softwareengineeringdaily.comThe post MLOps Systems at Scale with Krishna Gade appeared first on Software Engineering Daily.
Just like everything else in software development, the idea of observability is not new – it emerged alongside the advent of information systems. Observability is a critical part of SDLC and helps developers and operations teams monitor their applications and environments, identify issues before they impact customers, and improve the performance of their software products.
This article will discuss the following points:
- What is Observability?
- What problems does it solve?
- Releases are faster
- Incidents become easier to fix
- What are the challenges of observability?
- Observability vs Monitoring
- The Three Pillars of Observability
- Metrics
- Logs
- Traces
- How do you implement Observability?
- Choosing an Observability Platform
- Best Practices of Observability
- Conclusion
What is Observability?Observability helps developers and operations teams monitor their applications and environments, identify issues before they impact customers, and improve the performance of their software products.
Observability encompasses the monitoring of application metrics (usually via instrumentation), logs and exceptions, tracing data, and many other aspects of software applications. You can leverage observability to diagnose problems in real time or after they have occurred so that they don’t occur again.
Observability is the art of observing and understanding your system in order to make better decisions. Observability is generally understood as the ability to observe, understand and act upon events that occur within software systems or their components.
The observation part is straightforward – we have tools that can collect data about what has happened inside our application and correlate those observations.
What problems does it solve?Here are some of the key benefits of observability:
- Gain insights into the infrastructure as a whole
- Promote faster releases
- Resolve issues easily and quickly
- Reduce costs
- Enhance developer productivity
The Three Pillars of ObservabilityThe three pillars of observability are metrics, logs, and traces.
MetricsMetrics provide quantitative data points about what’s happening within your system at any given point in time. This may take the form of CPU utilization or memory usage over time, counts on individual requests being served by an API gateway, etc., but they’re typically aggregated across multiple instances of your application (e.g., per cluster node). They can also include derived values such as averages or percentiles; for example: “the average CPU utilization across all nodes was 20% today.”
LogsLogs are structured messages that provide context about what’s happening within your system. They often include information such as request IDs, timestamps, and payloads for individual requests being served by an API gateway. As with metrics, these logs can be aggregated across multiple instances of your application (e.g., per cluster node).
TracesTraces are unstructured streams of events emitted by your software. They’re typically emitted at a high rate (e.g., thousands per second) and include data such as the time at which each event occurred, what kind of event it was (e.g., HTTP request, database query), and any additional parameters that were passed along with it (e.g., query parameters for an HTTP request).
Observability vs MonitoringMonitoring and Observability are related concepts, they complement each other. In other words, the two terms “monitoring” and “observability” are often used interchangeably. However, there are subtle differences between the two.
The key difference here is that while monitoring is reactive (i.e., it responds after an event has occurred), observability allows you to detect problems before they occur or even know when they occur in the first place (i.e., it is proactive).
Monitoring refers to the process of collecting, storing, and analyzing data. Observability provides valuable insights into how an application behaves at runtime. So, observability provides visibility into how your application has been behaving in a production environment.
Monitoring is the act of tracking and measuring the performance of a system. This can be achieved by using tools such as New Relic, which track application performance metrics like response times, error rates, and concurrency issues. Observability refers to the capability of observing and understanding the state of a system. With it, you can detect problems before they occur or even determine when they are likely to occur.
Both monitoring and observability tools are used to collect data from systems in order to help identify issues and understand behaviour. The key difference between the two is that observability provides more complete data collection and analysis, while monitoring may provide more limited data collection and analysis.
To be able to monitor something, there must be some level of observation involved. Observability takes advantage of instrumentation to provide insights that help with monitoring. The extent of observability depends on the ability to discover unknown qualities and patterns.
Observability and monitoring solutions provide a comprehensive overview of the health of your IT infrastructure, allowing for better decision-making. While monitoring warns the team of a possible problem, observability assists the team in determining and resolving the underlying cause of the problem.
How do you implement Observability?In order to achieve observability, you need to instrument your code so that you can collect data at every point in the system from the data sources themselves. This data can include everything from application and database logs to network traffic and performance metrics.
Choosing an Observability PlatformThere are certain factors you should consider before choosing an observability platform.
Ease of useYou should pick an observability platform that is easy to use. There is no point in selecting an observability platform if you’re going to struggle with it or get frustrated by its complexity. You need a tool that makes sense to you and your team, so choose one that has good documentation, guides and tutorials for new users, and a community forum where you can ask questions when things aren’t clear.
Community SupportYou should choose an observability platform that has a community behind it. It’s important for your chosen tool to have good support from its developers as well as other users who are using it in production environments like yours—so look for options with active communities on social media sites such as Twitter or Reddit, etc.
FlexibleYou should select an observability platform that can be used in multiple use cases. Even though some monitoring tools specialize in certain functions such as tracing, most of them are designed with flexibility in mind so they can be used across different teams within organizations—and even combined with other tools like log management solutions if needed.
Best Practices of ObservabilityWhen configuring observability for your application, you should adhere to a few recommended practices.
- Make sure your observability tool is compatible with your existing tools, like monitoring dashboards, CI/CD pipelines, etc. Use tools that can help you interpret the data and easily identify anomalies.
- Make sure it’s easy for everyone on your team to use so that no one gets left behind in the adoption process.
- Keep an eye out for new features that might make it easier for you to see what’s happening with your systems, like alerts or notifications when something goes wrong—it makes it easier for everyone to stay on top of issues before they turn into problems.
- Instrumenting your system with monitoring tools will allow you to see the data that is collected by those tools, and it can help you determine issues with your code or infrastructure.
- Having alerts set up that let you know when something goes wrong is an important part of any observability strategy. These alerts will also tell you when things are going well, which means that they can be used as a baseline for comparison when troubleshooting issues.
- You should instrument as much data as you can. You can obtain such data from several sources, such as application and server logs, performance counters, and network traffic data. When you have more data, you can gain better insights and identify problems in your application more efficiently.
- You should ensure that you have the necessary tools to gather and evaluate this data. There are many alternatives available; choose the one that works best for you. Once you have the data, you must be able to visualize it and detect patterns quickly.
- You should also set thresholds for each metric you’re tracking. This will assist you in determining when something is wrong. For example, if your system’s response time grows dramatically, this might signal a problem. Setting criteria in advance allows for detecting potential issues before they become severe disruptions.
ConclusionObservability can help you understand the behaviour of your application at runtime and identify issues as they happen. By tracking the right metrics and logging the appropriate data, you can gain invaluable insights into your system’s performance and optimize its stability.
With the right observability strategy in place, you can avoid outages, diagnose problems quickly, and ensure that your system runs smoothly.
The post An Introduction to Observability appeared first on Software Engineering Daily.
Mingsheng Hong, is CEO and co-founder (along with Zheng Shao) of Bluesky. He is a thought leader for machine learning and has built data infrastructure to support some of the world’s most challenging workloads. Most recently, Mingsheng was at Google, where he led teams to build storage and querying stacks that power Google’s $100 billion ads business and a new TensorFlow backend to improve performance for AI workloads.Jocelyn Byrne Houle is a product leader, operator and investor focused on data and machine learning. Today, Jocelyn is a Sr. Director of Product Management for Securiti.ai, a Unified Data Controls platform. She has experience working at startups and at large companies like Capital One, Fannie Mae and Microsoft. Any opinions expressed by Jocelyn are her own and do not reflect the opinions or her employers.
Sponsorship inquiries: sponsor@softwareengineeringdaily.comThe post Optimizing Cloud Data Platforms with Mingsheng Hong appeared first on Software Engineering Daily.
Show host: Jordi Mon Companys
Guest: Dan Lorenc
The post Software Supply Chain with Dan Lorenc appeared first on Software Engineering Daily.
In this episode we talk with Varun Badhwar, Founder and CEO of Endor Labs.
Show host: Sean Falconer
The post Open Source Software Lifecycle Management and Security with Varun Badhwar appeared first on Software Engineering Daily.
Show Host: Jordi Mon Companys
Guest: Sam Alba
Transcript
The post Pipelines as Code with Sam Alba appeared first on Software Engineering Daily.
As applications grow in size and complexity, and as they increasingly move to microservice architectures, it becomes harder for individual developers to perform end-to-end tests of an entire application stack. Connecting development services to production services is off limits. Test environments are limited to automated tests.
Staging environments are woefully inadequate with the amount of data available for their use. Testing large and complex applications is becoming harder and harder. Speedscale provides developers a solution to this problem. Speedscale assists in developing and testing applications by recreating real world traffic loads in test and development environments, essentially bringing the data quality of production into the exploratory world of development. Matthew LeRay is the CTO and co-founder of Speedscale, and he’s our guest today.
Transcript
Sponsorship inquiries: sponsor@softwareengineeringdaily.comThe post API Testing in Kubernetes with Matthew LeRay appeared first on Software Engineering Daily.
Show Host: Jordi Mon Companys
Heather Meeker
Scott Jenson
Pablo Ruiz-Múzquiz
Transcript
The post Open Source Design Collaboration appeared first on Software Engineering Daily.
The post API Observability with Jean Yang appeared first on Software Engineering Daily.
How log management is undertaken for many hasn’t progressed in approach for more than twenty years. At the same time, we’ve seen improvements in storing and searching semi-structured data. These improvements allow us to have better analytical processes that can be applied to log content once aggregated. I believe we’re often missing some great opportunities with how we handle the logs between their creation and putting them into some store.
This illustrates how more traditional non-microservice thinking with logging and analytics is.
Yes, Grafana, Prometheus, and observability have come along, but their adoption has focused more on tracing and metrics, not extracting value from general logging. In addition, adopting these tools has been focussed on the container-based (micro)service ecosystems. Likewise, the ideas of Google’s Four Golden Signals emphasize metrics. Yet vast amounts of existing production software (often legacy in nature) are geared towards generating logs and aren’t necessarily running in containerized environments.
The opportunities I believe we’re overlooking relate to the ability to examine logs as they’re created to spot the warning signs of bigger issues or at least be able to get remediation processes going the moment things start to go wrong. Put simply, becoming rapidly reactive, if not becoming pre-emptive, in problem management. But before we delve more into why and how we can do this, let’s take stock of what the 12 Factor Apps document says about this.
When the 12 Factor App principles were written, they addressed some guidelines for logs. The seeds of potential with Logs were hinted at but weren’t elaborated upon. In some respects, the same document also influences thinking in the direction of the traditional approach of gathering, storing, and analyzing logs retrospectively. The 12 Factor App statement about logging has, I think, a couple of key points, both right and, I’d argue if taken literally wrong. These are:
- logs are streams of events
- we should send logs to stdout’ and let the infrastructure sort out handling the logs
- The description of how logs are handled either reviewed as they go to stdout or examined in a database such as OpenSearch using tools such as Fluentd.
We’ll return to these points in a moment, but we need to be mindful of how microservices development practices move the possibilities of log handling. Development here has driven the development and adoption of the idea of tracing. Tracing works by associating with an event a unique Id. As that unique Id flows through the different services. The end-to-end execution could be described as a transaction, which then when may make use of new ‘transactions’ (literal in terms of database persistence’ or conceptual in terms of the scope of functionality. Either way, these sub-transactions will also get their trace Id linked to the parent trace Id (sometimes called a context). These transactions of more called spans and sub-spans. The span information is typically carried with the HTTP header as the execution traverses through the services (but there are techniques) for carrying the information using asynchronous communications such as Kafka. With the trace Ids, we can then associate log entries. All of this can be supported with frameworks such as Zipkin and OpenTracing. What is more forward-thinking is OpenTelemetry which is working towards providing an implementation and industry stand specification, which brings the ideas of OpenCensus (an effort to standardize metrics), OpenTracing, and the ideas of log management from Fluentd.
OpenTelemetry’s efforts to bring together the three axes of solution observability hopefully create some consistency and maximize the opportunities of making it easier to link behaviors shown through the visualized metrics easier to link with traces and logs that describe what software is doing. While OpenTelemetry is under the stewardship of the CNCF, we should not assume it can’t be adopted outside of cloud-native/containerized solutions. OpenTelemetry addresses issues seen with software that have disturbed characteristics. Even traditional monolithic applications with a separate database have distributed characteristics.
The 12 Factor App and why should we be looking for evolution?The reason for looking for evolution is mentioned briefly in the 12 Factor App. Logs represent a stream of events. Each event is typically constructed from some semi of fully-structured data (either general descriptive text and/or structured content reflecting the data values being processed). Every event has some universal characteristics, as a minimum, a timestamp. Ideally, the event has other metadata to help, such as the application runtime, thread, code path, server, etc. If logs are a stream of events, then why not bring the ideas from stream analytics to the equation, particularly that we can perform analytical processes and decisions as events occur? The technologies and ideas around stream processing and stream analytics have evolved, particularly in the last 5-10 years. So why not exploit them better as we pass the stream of logs to our longer-term store?
Evaluating log events when they are still streaming through our software environment means we stand a chance of observing warning signs of a problem and enabling actions to be applied before the warning signs become a problem. Prevention is better than a cure. The cost of prevention is far lower than the cost of the cure. The problem is that we perceive preventative actions as expensive as the investment may never have a return. Put another way, are we trying to prevent something that we don’t believe will ever happen? Humans are predisposed to risk-taking and assuming that things won’t happen.
If we consider the fact that compute power continues to accelerate, and with it, our ability to crunch through more data in a shorter period. This means that when something goes wrong, a lot more disruption can occur before we intervene when we don’t work on a proactive model. To use an analogy, if our compute power is a car and the volume and value of the data are related to the car’s value. If our car could travel at 30mph ten years ago, crashing into a brick wall would be painful and messy, and repairing the car is going to cost and take time – not great, but unlikely to put us out of business. Now it can do 300mph; hitting the same wall will be catastrophic and fatal. Not to mention whoever had to clear up the fallout has got to replace the car, the impact with have destroyed the wall, and the energy involved would mean debris flung for 100s of meters – so much more cost and effort it could now put us out of business.
Take the analogy further; car manufacturers recognize accidents as much as we try to prevent them with legislation on speed, enforcement with cameras, and contractual restrictions with car insurance such as classes excluding racing, etc., accidents still happen. So, we try to mitigate or prevent them with better braking with ABS. Vehicle proximity and lane drift alarms. We are mitigating the severity of the impact through crumple zones, airbags, and even seat belts and their pretensions. In our world of data, we also have legislation and contracts, and accidents still happen. But we haven’t moved on much with our efforts to prevent or mitigate.
Compute power has had secondary indirect impacts as well. As we can process more data, we can gather more data to do more things. As a result, there can be more consequences when things go wrong, particularly regarding data breaches. Back to our analogy, we’re now crashing hypercars.
One reaction to the higher risks and impacts of accidents with cars or data is often more legislation and compliance demands on handling data. It is easy to accept more legislation – as it impacts everyone. But that impact is not consistent. It would be easy to look at logs and say they aren’t impacted. It’s the noise we must have as part of processing data. How often, when developing and debugging code, do we log the data we’re handling – it’s common from my experience, and in non-production environments, so what? Our data is synthetic, so even if the data was sensitive in nature logging, it isn’t going to harm. But along, suddenly, something starts going wrong in production; a quick way to try to understand what is happening is to turn up our logging. Suddenly, we’ve got sensitive data in our logs which we’ve always treated as not needing secure treatment.
Returning to the 12 Factor App and its recommendation on the use of stdout. The underlying goal is to minimize the amount of work our application has to perform regarding log management. It is correct that we should not burden our application with unnecessary logic. But resorting simply to stdout creates a few issues. Firstly, we can’t tune our logging to reflect whether we’re debugging, testing, or operating in production without introducing our own switches in the code. Something that becomes implicitly handled by most logging frameworks for us. More code means more chances of bugs. Particularly when code has not been subject to extended and repeated use as a shared library. In addition to elevated bug risk, the chances of sensitive data being logged also go up, as we’re more likely to leave stdout log messages than remove them. If the potential for logs goes up for production, so does the chance of it including sensitive data.
Firstly if we avoid the literal interpretation of the 12 Factor App of using stdout but look more at from the idea that our application logic should not be burdened with code for log management but utilizing a standard framework to sort that out, then we can keep our logic free of reams of code sorting out the mundane tasks. At the same time, maximizing consistency and log structure then, our tools can easily be configured to watch the stream as it passes the events to the right place(s). If we can identify semi or fully-structured log events, it becomes easy to raise the flag immediately that something is wrong.
The next issue is that stdout involves our I/O and more compute cycles. I’ve already made the point about ever-increasing compute performance. But performance investment in non-functional spaces always draws concerns, and we’re still chasing the performance issues to keep solution costs down.
We can see this with the effort to make containers start faster and tighten footprints of interpreted and byte code languages with things like GraalVM and Quarkus generating hardware-specific native binaries. Not only that, I pointed to the fact that to get value from logs, we need to have meaning. What is worse, a small element of logging logic in our applications so we can efficiently hand off logs and the receiver has an implicit or explicit understanding of the structure, or we have to run more logic to derive meaning from the log entries from scratch, using more compute effort, more logic, and more error-prone? It is correct that the main application should not be subject to performance issues that a logging mechanism might have and any back pressure impacting the application. But the compromises should never be to introduce greater data risks. To my mind using a logging framework to pass the log events off to another application is an acceptable cost (as long as we don’t stuff the logging framework with rafts of complex rules duplicating logs to different outputs etc.).
If we accept the question –isn’t it time to make some changes to up the game with our use of logging, then what is the answer?
What’s the answer?The immediate reaction to this is to look at the latest, most innovative thinking in the operational monitoring space, such as AI Ops – the idea of AI detecting and driving problem resolution autonomously. For those of us who are fortunate to work for an organization that embraces the latest and greatest and isn’t afraid of the risks and challenges of working on the bleeding edge – that’s fantastic. But you fortunate souls are the minority. Many organizations are not built for the risks and costs of that approach; to be honest, only some developers will be comfortable with such demands. The worst that can happen here is that the conversation to try to improve things gets shut down and can’t be re-examined.
We should consider a log event life more like this:
This view shows a more forward-thinking approach. ~While it looks complex, using tools like Fluentd means it is relatively easy to achieve. The complex parts are finding the patterns and correlations indicative of a problem before it occurs.
Returning to the 12 Factor App again. Its recommendation for using services like Fluentd and thinking of logging as a stream can take us to a more pragmatic place. Fluentd (and other tools) are more than just automated text shovels taking logs from one place and chucking it into a big black hole of a repository.
With tools like Fluentd, we can stream the events away from the ‘frontline’ compute and process the events with filters, route events to analytics tools and modern user interfaces or even trigger APIs that could execute auto-remediation for simple issues such as predefined archiving actions to move or compact data. At the simplest – a mature organization will develop and maintain a catalog of application error codes. That catalog will reflect likely problem causes and remediation steps. If an organization has got that far, there will be an understanding of which codes are critical and which need attention, but the system won’t crash in the next 5 minutes. If that information is known, it is a simple step to incorporate into an event stream processing the checks for those critical error codes and, when detected, use an efficient alerting mechanism. The next potential step would be to look for patterns of issues that together indicate something serious. Tools like Fluentd are not sophisticated real-time analytics engines. But in terms of simplicity, turning specific logs events into signals that can be processed with Prometheus can handle, and without introducing any heavy data science, we have the potential to handle situations such as how many times do we get a particular warning? Intermittent warnings may not be an issue as the application or another service could sort the issue out as part of standard housekeeping, but if they come frequently, then intervention may be needed.
Using tools like Fluentd won’t preclude the use of the slower bulk analytics processing, and as Fluentd integrates with such tools, we can keep those processes going and introduce more responsive answers.
We have seen a lot of advancement with AI. A subject that has been discussed as delivering potential value since the 80s. But in the last half-decade, we’ve seen changes that have meant AI can help in the mainstream. While we have seen mentions of AIOps in the press –. AI can help in very straightforward, practical means of extracting and processing written language (logs are, after all, written messages from the developer). The associated machine learning helps us build models to find patterns of events that can be identified as significant markers of something important, like a system failure. AIOps may be the major long-term evolution, but for the mainstream organization – that is still a long way downstream, but simple use cases for detecting the outlier events (supported by services such as Oracle Anomaly Detection) aren’t too technically challenging, and using AI’s language processing to help better process the text of log messages.
Finally, the nature of tools like Fluentd means we don’t have to implement everything from the outset. It is straightforward to progressively extend the configuration and continuously refine and improve what is being done, all of which can be achieved without adversely impacting our applications. Our previous diagram helps indicate a path that could reflect progressive/iterative improvement.
ConclusionI hope this has given pause for thought and highlighted the risks of the status quo, and things could advance.
The post Time to improve on how we handle our logs? appeared first on Software Engineering Daily.
Silicon Valley has many investors and Venture Capital firms, but most are not trying to solve hard technical problems. Engineering Capital partners with companies that are taking a technical risk. These are the companies who have some innovation where there is a doubt on whether it can even be built. Ideally, the market for this innovation exists, but nobody has bothered to build it yet, or nobody has been able to build it yet.
In this episode, We sat down with Ashmeet Sidana, Founder and Chief Engineer of Engineering Capital.TranscriptSponsorship inquiries: sponsor@softwareengineeringdaily.comThe post Startup Investing with Ashmeet Sidana appeared first on Software Engineering Daily.
We do it every day. We search on the internet for some information. Many ask, why is that easy? And yet doing the same thing at my company is hard sometimes, not even possible. And when you do get the data, it’s unclear where it’s from or the degree you can trust it or use it. In a highly regulated firm, there’s even more pressure to select the best approved version of the information.
Enter the data catalog. Enterprise Data Catalogs are essential for searching for data in an organization. Moreover, their creation, maintenance, and design tap into the most fundamental theories of the philosophy of language and the nature of creating knowledge. Today we are interviewing architect and author Ole Olesen-Bagneux, who is finishing his first O’Reilly published book called Enterprise Data Catalogs. Today, he will explain what a data catalog is, the different ways computer scientists and information scientists think about searching for data versus searching in data, and how thinking about archiving data for a hundred years can help you create the best data catalog for your business today.
Follow Jocelyn : @jocelynbyrne
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post The Enterprise Data Catalog with Ole Olesen-Bagneux appeared first on Software Engineering Daily.
Data anonymisation is an ever more important problem with many pitfalls, and the legal context requires more and more companies to find a solution to it.
In this episode, we talk to John Craft from Privacy Dynamics, who offer data anonymisation as a service.
Privacy Dynamics is powering a world where ethics, data insights and personalized technology can all co-exist to support business growth and customer privacy simultaneously.
John talks about the different use-cases, technologies, requirements, and challenges he and his team faced throughout Privacy Dynamics’ journey so far, and what might be to come.
Show Host – Jeff Hemmen
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Minimizing PII in Dev Environments with John Craft appeared first on Software Engineering Daily.
Fintechs and traditional finance firms want to help their small business customers replace disorganized competing manual processes and multiple data sources with a single unified set of services and data. They could do that. They could more easily offer quicker decisions, better customer experience, and even get more first time customers founded in 2017.Codat wants to be that universal API that can connect financial firms to the platforms their small business customers use. Codat seeks to create a single flow and view for the bus. Small businesses, many accounting, banking, and commerce systems. That goal requires specialized approaches to authorization, data normalization, and availability.It also unlocks capabilities that small businesses can’t usually access, like real time risk scoring and predictive analytics. Today we are interviewing Jason Dryhurst-Smith, head of engineering and employee one at Codat, he’s an engineer who started in firmware and embedded systems. He has, uh, years of general development experiences, but now focuses primarily on platform engineering and building codat’s full engineering team.Sponsorship inquiries: sponsor@softwareengineeringdaily.comThe post Financial Data Aggregation for SMB with Jason Dryhurst-Smith appeared first on Software Engineering Daily.
OpenSSL is a free, open-source cryptographic library that provides secure communications over computer networks. It is widely used to implement the secure socket layer (SSL) and transport layer security (TLS) protocols, which are the basis for secure, encrypted connections on the internet.
On Oct 25th, the OpenSSL project informed its users of a critical vulnerability that affects the 3.0 and later versions of the OpenSSL component. In this episode we sat down with Ilkka Turunen, Ilkka is Sonatype’s Field CTO, we discussed a wide range of topics including Shodan, SBOMs, Software Supply Chain and others.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post OpenSSL Vulnerability with Ilkka Turunen appeared first on Software Engineering Daily.
Comma is a startup aimed at solving self-driving cars. A lot of the new cars in the market have built-in stock Advanced driver assistance systems. Comma takes this system to the next level with Openpilot. Openpilot is an open-source driver assistance system. Currently, with features like Adaptive Cruise Control (ACC), Automated Lane Centering (ALC), Forward Collision Warning (FCW), and Lane Departure Warning (LDW), openpilot is one of the most state-of-the-art solutions in the self-driving space. The Comma Three device is designed to live in your car, and purpose built to run openpilot.
In this episode we speak to George Hotz, President of Comma and now an intern at Twitter.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Special Episode with George Hotz appeared first on Software Engineering Daily.
Monolithic relational databases are the traditional foundation of financial core ledger systems. Nevertheless, the process of building and operating mission critical financial ledgers on these databases, and implementing homegrown accounting models, is a journey fraught with engineering challenges.
Twisp has set out to rethink the underlying technology for financial ledger systems by combining the operational and scaling characteristics of a distributed database, the correctness guarantees offered by relational databases, with pre-built accounting primitives, while fully leveraging the modern cloud.
In this episode, we speak to Michael Parsons, co-founder & CTO of Twisp.
To learn more about Twisp and get access to a sandbox ledger, go to: www.twisp.com/
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Twisp: Reinventing Accounting Systems with Michael Parsons appeared first on Software Engineering Daily.
Java Applications became the go-to preference of most developers because of the write-once-run-anywhere advantage it gave over other languages. And it didn’t take much time for Java to become the language for the enterprise. Consequently, most enterprises are still running legacy Java Monoliths on their infrastructure.
Breaking up a monolith is not an easy process–nor is it something that every company should do just because they have a monolith. In some cases, a monolith is just fine. But sometimes, you do need to decompose a monolith as the complexity of the monolith grows and leads to longer release cycles or scalability issues. Breaking down into microservices is a natural way to shift legacy applications to the cloud.
vFunction is an artificial intelligence platform that assesses, analyzes, helps you design microservices and then automatically creates those microservices for you. So it’s an end-to-end platform from analysis to the actual creation of the code of those microservices with their respective APIs. While vFunction started with Java, they are expanding these capabilities to other platforms as well. Moti Rafalin who is the CEO of vFunction and Amir Rapson who is the CTO of vFunction join us today.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Modernizing the Monolith with Moti Rafalin and Amir Rapson appeared first on Software Engineering Daily.
When Web Assembly was created it was supposed to be a compile target, where you could compile your favorite programming language and then execute it inside of a web browser. This made it possible for developers to choose a programming language like C++ for compute intensive applications. Fermyon is taking Web Assembly to the cloud.
The post Cloud-native WebAssembly with Matt Butcher appeared first on Software Engineering Daily.
If you are a company with a large pool of physical servers, and compute resources sitting in the data center, and you want to use them efficiently, one way to do that would be to virtualize them. Then you can use those smaller virtual compute resources to run whatever workloads you need. VMware is a
The post VMware Tanzu with Betty Junod appeared first on Software Engineering Daily.
With an increasing number of data breaches impacting customer trust, prioritizing data privacy and security is more important than ever. However, as you layer on security and privacy, the overall complexity of a system grows and the data gets harder to use. There’s a constant push and pull between securing and locking down the data
The post Secure Workflows on Sensitive Data with Amruta Moktali appeared first on Software Engineering Daily.
The complexity of the software infrastructure has been increasing as companies have migrated towards kubernetes, containers, microservices and other distributed systems. However the tools around observability and monitoring have not seen much improvement. These tools are usually managed by teams distributed across different locations and time zones, which results in siloing of knowledge of your
The post Collaborative Notebooks for DevOps and SRE with Micha Hernandez appeared first on Software Engineering Daily.
The Presto/Trino project makes distributed querying easier across a variety of data sources. As the need for machine learning and other high volume data applications has increased, the need for support, tooling, and cloud infrastructure for Presto/Trino has increased with it. Starburst helps your teams run fast queries on any data source. With Starburst you
The post Accessing Data at Scale with Justin Borgman appeared first on Software Engineering Daily.
Building and managing data-intensive applications has traditionally been costly and complex, and has placed an operational burden on developers to maintain as their organization scales. Todays’ developers, data scientists, and data engineers need a streamlined, single cloud data platform for building applications, pipelines, and machine learning models — without having to move or copy their
The post Building on the Data Cloud with Torsten Grabs appeared first on Software Engineering Daily.
Companies are rapidly moving to the cloud, and modern businesses are operating faster with a myriad of SaaS tools in their day-to-day operations. Provisioning resources has been easier than ever. With a few clicks you can spin up resources in any part of the world. While we all love the cloud because of the scalability
The post Cloud Asset Management with Serhat Can appeared first on Software Engineering Daily.
Mikko Hypponen is the CRO of WithSecure and a principal research Officer at F-Secure. In this interview with our host, Jordy Monn, he discusses the eventful and rocky early start of his software engineering career, hybrid warfare, reverse engineering, recent exploits like Log for Shell and heart bleed and more. This episode is packed with
The post The Internet with Mikko Hypponen appeared first on Software Engineering Daily.
React is the most widely used front-end framework. It pioneered the component model and influenced the software design of all modern web applications. React is not an opinionated tool, allowing engineers to shape their applications in a way that fits the problems at hand. However, this freedom of expression can be very confusing to newcomers.
The post Tao of React with Alex Kondov appeared first on Software Engineering Daily.
Observability is a critical aspect of modern digital applications. You can’t operate an application at scale that satisfies your customer needs without understanding how the application is currently performing, whether it’s understanding the current operating needs of the application, adjusting resource usage, detecting issues before they become serious or solving an ongoing technical issue as
The post Modern Application Observability with Berkay Mollamustafaoglu appeared first on Software Engineering Daily.
The classical computing power has doubled every two years – a pattern known as Moore’s law. However, the ability to fabricate more and more transistors in a computer chip is approaching saturation as we are approaching atomic dimensions. Quantum Computing is a promising technology to take us beyond this. A quantum Computer uses qubits to
The post The Quantum Leap with Dmitri Maslov appeared first on Software Engineering Daily.
The Java Virtual Machine is an abstract machine that makes it possible for you to write Java code once and run it across multiple devices and operating system types. While you can use the OpenJDK it comes with various issues like Security Vulnerabilities and compliance. Azul is a company that specializes in Java for the
The post Azul with John Ceccarelli appeared first on Software Engineering Daily.
Passwordless Authentication is a technique in which users are given access to an environment without entering a password or answering a security question. This allows users to access an environment securely and protects organizations against attack vectors like Keylogging, Brute force methods, and phishing. The company SuperTokens provides secure login and session management for your
The post Open Source Authentication with Advait Ruia and Rishabh Poddar appeared first on Software Engineering Daily.
How we perceive those that have authored technical books is interesting. The opportunities for anyone to publish content are never better. Anyone can blog; all you need is an email address and access to the internet. Produce enough related content, and you could self-publish a book easily through a platform, even one as big as
The post What does it take to be a Technical Author? appeared first on Software Engineering Daily.
Monolithic relational databases are the traditional foundation of financial core ledger systems. Nevertheless, the process of building and operating mission-critical ledgers to track and reconcile payments and money movement is complex. Twisp is rethinking core accounting and financial orchestration on a cloud-native ledger system, so developers can stop re-inventing the ledger and focus on building
The post Twisp: Reinventing the Ledger with Jarred Ward appeared first on Software Engineering Daily.
PostgreSQL is a free and open-source relational database management system. Postgres-based databases are widespread and are used by a variety of organizations, from Reddit to the International Space Station, and Postgres databases are a common offering from cloud providers such as AWS, Alibaba Cloud, and Heroku. Neon is a serverless open-source alternative to AWS Aurora
The post Open-source Serverless Postgres with Nikita Shamgunov appeared first on Software Engineering Daily.
Today, we spoke with Daniel Situnayake of Edge Impulse. We discussed Cloud-based dev environments, Cloud-based IDEs, Infrastructure as code, Dev containers and Live collaboration. Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Edge Impulse with Daniel Situnayake appeared first on Software Engineering Daily.
Vedran Jukic Vedran Jukic This episode is hosted by Sean Falconer. Sean’s been an academic, founder, and Googler. He has published works covering a wide range of topics from information visualization to quantum computing. Currently, Sean is Head of Developer Relations and Product Marketing at Skyflow and host of the podcast Partially Redacted, a podcast
The post Code Anywhere with Toma Pujlak and Vedran Jukic appeared first on Software Engineering Daily.
Vedran Jukic Vedran Jukic This episode is hosted by Sean Falconer. Sean’s been an academic, founder, and Googler. He has published works covering a wide range of topics from information visualization to quantum computing. Currently, Sean is Head of Developer Relations and Product Marketing at Skyflow and host of the podcast Partially Redacted, a podcast
The post Code Anywhere with Toma Pujlak and Vedran Jukic appeared first on Software Engineering Daily.
The default configuration in most databases is meant for broad compatibility rather than performance. Database tuning is a process in which the configurations of a database are modified to achieve optimal performance. Databases have hundreds of configuration knobs that control various factors, such as the amount of memory to use for caches or how often
The post Automatic Database Tuning with Andy Pavlo appeared first on Software Engineering Daily.
Cloud computing provides tools, storage, servers, and software products through the internet. Securing these resources is a constant process for companies deploying new code to their cloud environments. It’s easy to overlook security flaws because company applications are very complex and many people work together to develop them. Wyze Labs, for example, had millions of
The post Bridgecrew: Cloud Security with Guy Eisenkot appeared first on Software Engineering Daily.
Originally published on January 1, 2022. Charlie Gerard is an incredibly productive developer. In addition to being the author of Practical Machine Learning in JavaScript, her website charliegerard.dev has a long list of really interesting side projects exploring the intersection of human computer interaction, computer vision, interactivity, and art. In this episode we touch on
The post Practical Machine Learning in JavaScript with Charlie Gerard appeared first on Software Engineering Daily.
Software engineering can be a surprisingly grueling career. It is both physically and mentally demanding to sit in front of a screen for hours on end producing code. Andy Johns is our guest in this episode. Andy previously worked on growth at Facebook, Twitter, and Quora as an early employee. He’s also an investor in
The post Mental Health in Tech with Andy Johns appeared first on Software Engineering Daily.
Data analytics technology and tools have seen significant improvements in the past decade. But, it can still take weeks to prototype, build and deploy new transformations and deployments, usually requiring considerable engineering resources. Plus, most data isn’t real-time. Instead, most of it is still batch-processed. Tinybird Analytics provides an easy way to ingest and query
The post Data Lake for Developers with Jorge Sancha appeared first on Software Engineering Daily.
Originally published on August 23, 2021. Application security is usually done with a set of tools and services known as SIEM – Security Information and Event Management. SIEM tools usually try to provide visibility into an organization’s security systems, as well as event log management and security event notifications. The company Panther takes traditional SIEM
The post Panther: Security as Code with Jack Naglieri appeared first on Software Engineering Daily.
Maintaining availability in a modern digital application is critical to keeping your application operating and available and to keep meeting your customers growing demands. There are many observability platforms out there and certainly Prometheus is a popular open source solution for cloud native companies yet operating an observability platform, costs money, and all of the
The post Cloud-native Observability with Martin Mao appeared first on Software Engineering Daily.
As software engineering teams start to build products that become more and more mature, it becomes necessary to be able to debug complex issues with tooling that enables understanding of the full scenario. This can come from application scenarios where APIs are running multiple versions, where users are using your app from multiple devices, device
The post Developer-first Observability with Liran Haimovitch appeared first on Software Engineering Daily.
As software engineering teams start to build products that become more and more mature. It becomes necessary to be able to debug complex issues with tooling that enables understanding of the full scenario. This can come from application scenarios where APIs are running multiple versions, where users are using your app from multiple devices, device
The post Developer-first Observability with Liran Haimovitch appeared first on Software Engineering Daily.
Web infrastructure has evolved from individual servers to shared hosting services to virtual machines and virtual functions. The future of the internet however is looking toward a much more distributed computation model . Blockchain technology is central to the future of this modern internet . Blockchains are still in their infancy. And the most
The post Modular Blockchain Architecture with Nader Dabit appeared first on Software Engineering Daily.
As companies move to Spark and a Lakehouse architecture, they are realizing that the data tools are lagging way behind. You need to be a programmer to effectively use Spark and Airflow. There are some low-code ETL tools, but is that enough? Companies want to treat their data pipelines like mission-critical apps. They want DevOps
The post Lakehouse Data Stack with Raj Bains appeared first on Software Engineering Daily.
Originally published on February 12, 2022. Lee Atchison spent seven years at Amazon working in retail, software distribution, and Amazon Web Services. He then moved to New Relic, where he has spent four years scaling the company’s internal architecture. From his decade of experience at fast-growing web technology companies, Lee has written the book Architecting
The post Architecting for Scale with Lee Atchison appeared first on Software Engineering Daily.
Data is becoming a bank’s biggest asset. These complex enterprises have a huge opportunity ahead – to transform themselves to become a trusted hub of a much broader data ecosystem that goes beyond the financial industry and helps to form a new class of cross-industry experience architectures that are scalable and transparent. The data physics
The post Data Infrastructure for Finance appeared first on Software Engineering Daily.
Cloud native applications utilizing microservice architectures has grown into one of the most popular application architectural patterns in recent years. The value of leveraging dynamic cloud resources, along with the flexibility and scalability of microservice architectures, creates a strong paradigm that’s hard to miss. The strong adoption of Kubernetes has strengthened the pattern enormously. The
The post K8s Troubleshooting with Itiel Shwartz appeared first on Software Engineering Daily.
Permissions are Hard! And they are becoming harder as we move more into the Cloud-native ecosystem. If we go back in time to the point where it was just a single monolith that you were building on your own. You’ll probably have a framework to manage the permissions for you. But when you are working
The post Permissions and Access-control with Or Weis appeared first on Software Engineering Daily.
Remember Frogger? That pixelated bit of arcade magic where you navigate your amphibious avatar across roads and rivers without getting smushed by passing cars or swept away by rushing water? Go Frogger go! As it turns out, Frogger is a perfect metaphor for Realtime Analytics. If you never played it, then grab some virtual quarters and spend 1 minute
The post What is Realtime Analytics, anyway? appeared first on Software Engineering Daily.
Enabling authorization policies across disparate cloud-native environments such as containers, microservices and modern application delivery infrastructure is complex and can be a roadblock for software engineering teams. Open Policy Agent, or OPA, is an open, declarative, policy-as-code approach to authorization that reduces security and compliance burden for engineering teams. Business context is translated into declarative
The post Cloud-native Authorization with Tim Hinrichs appeared first on Software Engineering Daily.
Ian Coe CEO Adam Kamor Head of Engineering Companies that gather data about their users have an ethical obligation and legal responsibility to protect the personally identifiable information in their dataset. Ideally, developers working on a software application wouldn’t need access to production data. Yet without high-quality example data, many technology groups stumble on avoidable
The post Faking Data Using Tonic.ai with Ian Coe and Adam Kamor appeared first on Software Engineering Daily.
Ian Coe CEO Kamor Adam Head of Engineering Companies that gather data about their users have an ethical obligation and legal responsibility to protect the personally identifiable information in their dataset. Ideally, developers working on a software application wouldn’t need access to production data. Yet without high-quality example data, many technology groups stumble on avoidable
The post Faking Data Using Tonic.ai with Ian Coe and Adam Kamor appeared first on Software Engineering Daily.
Cloud native applications utilizing microservice architectures have grown into one of the most popular application architectural patterns in recent years. The value of leveraging dynamic cloud resources, along with the flexibility and scalability of microservice architectures, creates a strong paradigm that’s hard to miss. The strong adoption of Kubernetes has strengthened the pattern enormously. The
The post Kubernetes Troubleshooting with Itiel Shwartz and Lee Atchison appeared first on Software Engineering Daily.
Originally published January 4, 2019 When a user makes a request to a product like The New York Times, that request hits an API gateway. An API gateway is the entry point for an external request. An API gateway serves several purposes: authentication, security, routing, load balancing, and logging. API gateways have grown in popularity
The post Kong API Platform with Marco Palladino Holiday Repeat appeared first on Software Engineering Daily.
Couchbase is a distributed NoSQL cloud database. Since its creation, Couchbase has expanded into edge computing, application services, and most recently, a database-as-a-service called Capella. Couchbase started as an in-memory cache and needed to be rearchitected to be a persistent storage system. In this episode, We interviewed Ravi Mayuram, SVP Products, and Engineering at Couchbase.
The post Couchbase Architecture with Ravi Mayuram appeared first on Software Engineering Daily.
Apache Arrow defines a language-independent columnar memory format for flat and hierarchical data, organized for efficient analytic operations on modern hardware like CPUs and GPUs. The Arrow memory format also supports zero-copy reads for lightning-fast data access without serialization overhead. Wes McKinney is the CEO of Ursa Computing, a new startup working on accelerated computing
The post Arrow Infrastructure with Wes McKinney appeared first on Software Engineering Daily.
Originally published on July 11, 2016. Negotiation is an important skill for software engineers. The salary you negotiate at the beginning of your job could be a difference of tens of thousands of dollars over the course of an engineer’s career, but intimidating recruiters and exploding offers scare many engineers from negotiating at all. Today,
The post Salary Negotiation with Haseeb Qureshi appeared first on Software Engineering Daily.
Remix is a full stack web framework that lets you focus on the user interface and work back through web fundamentals to deliver a fast, slick, and resilient user experience that deploys to any Node.js server and even non-Node.js environments at the edge like Cloudflare Workers. In this episode, we interviewed Ryan Florence, co-founder at
The post Remix with Ryan Florence appeared first on Software Engineering Daily.
As engineers, we need to secure and protect sensitive data to prevent its misuse and comply with various data protection laws, while still supporting data-driven workflows like machine learning, analytics, or data sharing. Luckily there’s amazing innovation going on in the privacy and security space that can help us not only maintain our customers’ data
The post 10 Privacy-enhancing Technologies Every Engineer Should Know About appeared first on Software Engineering Daily.
Profiling has been a part of the software engineering toolbox since the 1970s, but it was long regarded to be too high in overhead, so it was only done ad hoc. The problem with profiling that way is that you never catch the moment in time where for example an incident happened. Continuous profiling is
The post Continuous Profiling using eBPF with Frederic Branczyk appeared first on Software Engineering Daily.
Zigi is an AI-powered personal assistant for developers. By managing your dev workflow and handling all your mundane, non-programming tasks across multiple apps directly from Slack, Zigi helps you focus on code creation and innovation. Zigi connects to all your cloud tools, such as Jira, Github, and your calendar, in order to get a 360°
The post Zigi with Nir Benson appeared first on Software Engineering Daily.
Whether a machine learning engineer, data scientist, business analyst – or honestly, anyone else at this point – you’ve probably received, used, imported or opened a CSV (comma-separated value) file . A well-known, oft-used text-based file, CSV is used to store large data records in a format that is easily transferable, and human readable. The simplicity
The post Importing CSV: Meeting the Challenge Head-on appeared first on Software Engineering Daily.
Enterprise-grade authentication is often an essential ingredient to virtually all applications in today’s world. However, companies often have a hard time understanding the value of that authentication especially during the early stages of product development. And hardening of an application is often left as an afterthought. Add enterprise-level requirements such as single sign-on and two-factor
The post WorkOS with Michael Grinich appeared first on Software Engineering Daily.
Sherlock Holmes once said, “It is a capital mistake to theorize before one has data”. Though from a fictional character in the early 1900s, the adage rings true today. Companies are increasingly leveraging data to make and guide decisions. As they should, data-driven decisions are proven to be more consistent, more reliable, and more accurate.
The post Software Engineering Best Practices Applied to Data appeared first on Software Engineering Daily.
Build automation tools automate the process of building code, including steps such as compiling, packaging binary code, and running automated tests. Because of this, build automation tools are considered a key part of a continuous delivery pipeline. Build automation tools read build scripts to define how they should perform a build. Common build scripts include
The post Earthly Builds with Adam Gordon Bell appeared first on Software Engineering Daily.
Creating great creative tools is extremely difficult. There are thousands of paths a user could take, and every aspect of the user experience has to be carefully considered and optimized for performance. And when you try to add real-time collaboration on top of that, you can be sure that you’re left with almost no time
The post LiveBlocks with Guillaume Salles appeared first on Software Engineering Daily.
Most technology companies rely on open source software projects. But open source software projects are often maintained by a group of people that is not affiliated with any particular company. When an open source project develops too much technical debt, it can become a tragedy of the commons. Who is responsible for maintaining these open
The post Gitcoin Ecosystem with Gloria Kimbwala appeared first on Software Engineering Daily.
Mailchimp is an all-in-one marketing platform for growing businesses, empowering millions of customers around the world to launch, build, and grow their businesses with world-class marketing technology, award-winning customer support, and inspiring content. Eric Muntz is Mailchimp’s CTO, responsible for the engineering teams that design, implement, and maintain Mailchimp’s products and infrastructure. He joins the
The post Mailchimp Engineering with Eric Muntz appeared first on Software Engineering Daily.
Venture capital investment has continued to flow into technology startups. No one builds technology from scratch. There are cloud services, software libraries, 3rd party services, and software platforms that modern entrepreneurs must adopt to build their products efficiently and quickly. These layers of infrastructure are a key area for many investors. Tim is a partner
The post Technical Venture Capital with Tim Tully appeared first on Software Engineering Daily.
Between hyper financialisation and the growth of automation in the world, trade and investments have become an ever more prevalent and important tool for the mass market. But the relative knowledge of professional and hobbyist investors is different, and so is the access to opportunities. Coinrule empowers regular people to compete with professional traders by
The post Coinrule Automated Crypto Trading with Zdenek Hofler appeared first on Software Engineering Daily.
Breakthroughs from labs that are exclusively or mostly focused on research tend to stay buried as papers. Sometimes the lag is natural, the research is far ahead of its broad applicability. But we find that there are hundreds of breakthroughs useful long before they reach users. It can take many years, even decades, before breakthroughs
The post Protocol Labs Research with Jeromy Johnson appeared first on Software Engineering Daily.
As crypto gains worldwide attention, the most scalable, resilient and performant systems are required for the industry to thrive. Products must be designed for a mix of technical and non-technical users. Blockchain.com’s VP of Engineering Lewis Tuff takes us behind the scenes for a look at the architecture, programming languages and database choices required to
The post Building for Crypto with Lewis Tuff appeared first on Software Engineering Daily.
Blockchains are the distributed ledger technology underlying bitcoin and other cryptocurrencies. More broadly, a blockchain is a mechanism for updating truth states in distributed network computing, producing consensus trust and serving as a new form of general computational substrate. Lewis Tuff is the VP of Engineering at Blockchain.com and joins the show to discuss the
The post Blockchain.com Infrastructure with Lewis Tuff appeared first on Software Engineering Daily.
This episode is hosted by Lee Atchison. Lee Atchison is a software architect, author, and thought leader on cloud computing and application modernization. His most recent book, Architecting for Scale (O’Reilly Media) is an essential resource for technical teams looking to maintain high availability and manage risk in their cloud environments. Lee is the host
The post Kubernetes Spend with Webb Brown appeared first on Software Engineering Daily.
Web3 promises to change the way we interact and transact online, but today’s dapps and wallets are hard to use. They are typically optimized for desktop machines and domain experts. In particular, it can be hard to bring value on-chain, and hard to know what to do once you’ve onboarded. Charlie Andrews-Jubelt is a software
The post Valora Decentralized Venmo with Charlie Andrews-Jubelt appeared first on Software Engineering Daily.
While Kubernetes has many benefits, there is often a need for teams to deploy a monitoring and observability stack to troubleshoot issues that happen within the cluster and the applications themselves. ContainIQ, an out-of-the-box solution, allows engineers to monitor the health of their cluster and troubleshoot issues faster. ContainIQ is unique in its approach in
The post ContainIQ with Matthew Lenhard appeared first on Software Engineering Daily.
Nearly all new tech companies build in a public cloud and established companies are rapidly migrating to the cloud from their on-prem data centers. But this move to the cloud can lead to a visibility problem. Cloud Providers offer not only Compute instances but also manage services like databases, blob storage, queues and more. It
The post Open-Source Cloud Asset Management with Yevgeny Pats appeared first on Software Engineering Daily.
How to build a rocket ship while flying it? In this episode, Cos returns to the show to discuss the technologies and approach Brex chose to create an engineering organization and innovation engine for the long term, while navigating shifts as the company continued to scale at a rapid pace. Cos and Jeff also cover
The post Upgrading the rocket in the air – CTO Decisions with Cos Nicolaescu appeared first on Software Engineering Daily.
Most engineering organizations are full of highly analytical people with STEM degrees. This is why it’s not at all surprising that the most data-driven organizations in any company are … Finance, Sales, and Marketing. Right? No, but seriously, when was the last time your engineering organization used data to make a decision? When we were
The post Towards EngOps: Scaling Engineering Orgs With Data appeared first on Software Engineering Daily.
Convex makes storing your application’s data as easy as using React state management. If you can use React hooks, you can also manage your backend data using Convex. James Cowling is a former Dropbox infrastructure engineer turned startup founder. James joins the show to discuss how Convex offers a simpler full-stack developer experience than the
The post Global State Management with James Cowling appeared first on Software Engineering Daily.
Developers looking for read or write access to Ethereum, Polygon, IPFS or other Web3 networks in order to get their idea in the hands of users need reliable RPC endpoints they can count on, whether they are working on a hackathon project or running hybrid architecture for a production application. Infura provides a platform for
The post Infura Ethereum Infrastructure with E.G. Galano appeared first on Software Engineering Daily.
Streaming data platforms like Kafka, Pulsar, and Kinesis are now common in mainstream enterprise architectures, providing low-latency real-time messaging for analytics and applications. However, stream processing – the act of filtering, transforming, or analyzing the data inside the messages – is still an exercise left to the receiving microservice or datastore, a custom programming exercise
The post Decodable Streaming with Eric Sammer appeared first on Software Engineering Daily.
The Kubernetes ecosystem has drastically changed how development teams ship software. While Kubernetes has provided many advancements in cloud infrastructure, it has also left organizations with massive security blindspots. KSOC was created to give developers and security teams a single control plane to harden multi-cluster Kubernetes environments through event-driven analysis, least privilege enforcement, and remediation-as-code.
The post Kubernetes Security Compliance with Jimmy Mesta appeared first on Software Engineering Daily.
In software engineering, telemetry is the data that is collected about your applications. Unlike logging, which is used in the development of apps to pinpoint errors and code flows, telemetry data includes all operational data including logs, metrics, events, traces, usage, and other analytical data. Companies usually visualize this information to troubleshoot problems and understand
The post New Relic Architecture with Nic Benders appeared first on Software Engineering Daily.
One of the challenges with Microservices architecture is how you manage dependencies between your services when implementing workflows. Conductor is an open-source microservices and workflow orchestration platform. Boney Sekh co-founded Orkes Inc – a company focused on offering Conductor as a service. Boney joins the show to discuss how engineers leverage Conductor to build highly
The post Conductor Orchestration with Boney Sekh appeared first on Software Engineering Daily.
Notifications have typically been an area of a product where building in-house has been the only option. However, building a best-in-class notifications system that delivers a great customer experience requires a significant investment when you start to layer in complexities like batching, cross channel orchestration, and user preferences. Chris Bell of Knock joins the show
The post Notifications Infrastructure with Chris Bell appeared first on Software Engineering Daily.
The advent of the cloud introduced a new form of technical debt in which organizations can lose track of what infrastructure they have and how it relates to the business. While the cloud’s native APIs offer some transparency into your infrastructure, these offerings are often described as necessary but not sufficient. When companies have a
The post CloudGraph with Tyson Kunovsky appeared first on Software Engineering Daily.
Highlight is a tool that helps teams reproduce end-to-end user sessions to troubleshoot their applications faster, more efficiently, and with all the context they need. With Highlight, engineering teams can replay errors with high precision, which includes complete session replay, outgoing network requests, dense stack traces and insight into the app’s state management system. Jay
The post Browser Observability With Jay Khatri appeared first on Software Engineering Daily.
Lee Atchison spent seven years at Amazon working in retail, software distribution and Amazon Web Services. He then moved to New Relic, where he spent eight years scaling the company’s internal architecture. Lee has deep expertise in building and managing fast growing web applications, and he used this knowledge to write architecting for scale from
The post Technical Debt With Lee Atchison appeared first on Software Engineering Daily.
There’s an increasing regulatory and consumer pressure on companies to do a better job protecting sensitive customer data. Yet, despite this pressure, data breaches and compliance issues continue to plague the tech industry. Companies like Apple, Netflix, and Google have solved these challenges by pioneering a new type of technology, the data privacy vault. Skyflow
The post Skyflow Privacy and Compliance with Sean Falconer appeared first on Software Engineering Daily.
Data-as-a-service is a company category type that is not as common as API-as-a-service, software-as-a-service, or platform-as-a-service. In order to vend data, a data-as-a-service provider needs to define how that data will be priced, stored, and delivered to users: streaming over an API or served via static files. Naqeeb Memon of Safegraph joins the show
The post Data Delivery with Naqeeb Memon appeared first on Software Engineering Daily.
Blockchains were the first systems to allow guaranteed permanent storage of public data. As cryptocurrency technology has advanced, a rich ecosystem of permanent storage and compute has developed as well. One of these is Arweave, a system for permanent information storage. Sam Williams is a founder of Arweave and joins the show to talk through
The post Arweave with Sam Williams appeared first on Software Engineering Daily.
Data labeling allows machine learning algorithms to find patterns among the data. There are a variety of data labeling platforms that enable humans to apply labels to this data and ready it for algorithms. Heartex is a data labeling platform with an open source core. Michael Malyuk joins the show to talk through the platform
The post Data Labeling with Michael Malyuk appeared first on Software Engineering Daily.
Real-time analytics are difficult to achieve because large amounts of data must be integrated into a data set as that data streams in. As the world moved from batch analytics powered by Hadoop into a norm of “real-time” analytics, a variety of open source systems emerged. One of these was Apache Pinot. StarTree is a
The post Pinot and StarTree with Chinmay Soman appeared first on Software Engineering Daily.
Web3 is powerful but difficult to work with. Deploying blockchain nodes, accessing data, and performing staking operations are non-trivial engineering actions. To simplify web3, Ankr hosts APIs for node deployment, RPC, and staking. Josh Neuroth from Ankr joins the show to talk about modern web3 infrastructure. Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Web3 Infrastructure with Josh Neuroth appeared first on Software Engineering Daily.
Brendan Falk Matt Schrage The terminal is a necessary tool for any software engineer. In order to work quickly, developers have always customized their terminals to work for their specific application workflow. Fig is a reimagined terminal product that adds autocomplete and an entire app ecosystem to the existing terminal you are familiar with. In
The post Fig Engineering with Brendan Falk and Matt Schrage appeared first on Software Engineering Daily.
WP Engine is a domain specific cloud provider that hosts high performance WordPress infrastructure. This website, Software Engineering Daily, runs on WP Engine. Scaling a domain specific cloud provider for WordPress includes complexities at the level of the database, application, load balancer, and other areas. Brandon DuRutte from WP Engine joins the show to talk
The post Scaling WordPress with Brandon DuRette appeared first on Software Engineering Daily.
Data loss can occur when large data sources such as Slack or Google Drive get leaked. In order to detect and avoid leaks, a data asset graph can be built to understand the risks of a company environment. Polymer is a data loss prevention product that helps companies avoid problematic data leaks. Yasir Ali is
The post Data Loss Prevention with Yasir Ali appeared first on Software Engineering Daily.
The Presto/Trino project makes distributed querying easier across a variety of data sources. As the need for machine learning and other high volume data applications has increased, the need for support, tooling, and cloud infrastructure for Presto/Trino has increased with it. Justin Borgman is the CEO of Starburst, and joins the show to talk about
The post Starburst Infrastructure with Justin Borgman appeared first on Software Engineering Daily.
Data integration infrastructure is not easy to build. Moving large amounts of data from one place to another has historically required developers to build ad hoc integration points to move data between SaaS services, data lakes, and data warehouses. Today, there are dedicated systems and services for moving these large batches of data. Airbyte builds
The post Airbyte Engineering with Michel Tricot appeared first on Software Engineering Daily.
Modern organizations eventually face data governance challenges. Keeping track of where data came from, what systems update it, in what ways updates can be made are just some of the issues to be tackled. Large organizations face additional challenges like training, onboarding, and capturing the institutional knowledge that leaves with the departure of key team
The post Select Star with Shinji Kim appeared first on Software Engineering Daily.
The JavaScript supply chain includes numerous vulnerabilities due to its expansive nature and the long dependency chains. Socket is a new security company that can protect your most critical apps from supply chain attacks. They are taking an entirely new approach to one of the hardest problems in security in a stagnant part of the
The post JavaScript Supply Chain with Feross Aboukhadijeh appeared first on Software Engineering Daily.
Loft is a platform for Kubernetes self-service and multi-tenancy. Loft allows you to control Kubernetes clusters with added multi-tenancy and self-service capabilities to get more value out of Kubernetes beyond simply cluster management. It allows for cost optimization, more efficient provisioning, and other features. Lukas Gentele joins the show to talk about Kubernetes multi-tenancy and
The post Loft Kubernetes Namespaces with Lukas Gentele appeared first on Software Engineering Daily.
Ben Sigelman Alex Kehlenbeck Observability consists of metrics, logs, and traces. Lightstep is a company that builds distributed tracing infrastructure, which requires them to store and serve high volumes of trace data. There are numerous architecture challenges that come with managing this data. Ben Sigelman and Alex Kehlenbeck join the show to discuss the implementation
The post Distributed Tracing Infrastructure with Ben Sigelman and Alex Kehlenbeck appeared first on Software Engineering Daily.
The solution many turn to for capturing their streaming data is InfluxDB. In this episode, I interview Brian Gilmore, Director of Product Management at InfluxData, about how real time applications achieve success built on top of InfluxDB. When most people hear the phrase Internet of Things, it typically evokes an image of connected devices we
The post Time Series IoT on InfluxDB with Brian Gilmore appeared first on Software Engineering Daily.
As companies move to Spark and a Lakehouse architecture, they are realizing that the data tools are lagging way behind. You need to be a programmer to effectively use Spark and Airflow. There are some low-code ETL tools, but is that enough? Companies want to treat their data pipelines like mission-critical apps. They want DevOps
The post Lakehouse Data Stack with Raj Bains appeared first on Software Engineering Daily.
Vercel’s 4KB environment variable limit stems from using AWS Lambda as their infrastructure provider. While Vercel has a documented solution for working around this limitation, it came with the drawback of large application code changes due to not using environment variables for secrets anymore plus the introduction of a new API endpoint. Without a quick and easy
The post Working around Vercel’s 4KB Environment Variables Limit for Node.js appeared first on Software Engineering Daily.
Terminals are a gateway to building and running software, but they have not been reimagined since their initial creation. Warp is a new kind of terminal with visual aids, autocomplete, documentation, customization, and other features. It includes GPU acceleration, its own UI framework, and other engineering systems to increase speed and performance. Zach Lloyd joins
The post Warp Terminal with Zach Lloyd appeared first on Software Engineering Daily.
Lior Gavish James Densmore Data infrastructure is a fast-moving sector of the software market. As the volume of data has increased, so too has the quality of tooling to support data management and data engineering. In today’s show, we have a guest from a data intensive company as well as a company that builds a
The post Data Engineering Trends with Lior Gavish and James Densmore appeared first on Software Engineering Daily.
Gabe Greenberg Michelle Bakels Software engineering can be a surprisingly grueling career. It is both physically and mentally demanding to sit in front of a screen for hours on end producing code. During the pandemic, the strains of being an engineer became even more acute, as we were secluded in our homes, in some cases
The post Developer Health with Gabe Greenberg and Michelle Bakels appeared first on Software Engineering Daily.
Crypto companies have cemented themselves as a company category that is not going away. Bitski is a company that makes web3 tooling and infrastructure, including a wallet and a collection of tools for creating and selling NFTs. Patrick Tescher joins the show to talk through the engineering behind crypto infrastructure and APIs. Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Bitski: Web3 Infrastructure with Patrick Tescher appeared first on Software Engineering Daily.
Running a database company requires expertise in both technical and managerial skills. There are deeply technical engineering questions around query paths, scalability, and distributed systems. And there are complex managerial questions around developer productivity and task allocation. Sam Lambert is the CEO of PlanetScale, which is building modern relational database infrastructure. Before PlanetScale he spent
The post PlanetScale Management with Sam Lambert appeared first on Software Engineering Daily.
Alexis Richardson Mohamed Ahmed GitOps is a deployment and infrastructure management strategy based around continuous delivery and Kubernetes, with Git at the center of deployment workflows. Policy management can be used to define permissions and rules around who can deploy and what constitutes safe deployment. There is a synergy between GitOps tooling and policy management
The post GitOps and Policy Management with Alexis Richardson and Mohamed Ahmed appeared first on Software Engineering Daily.
A company’s response to an incident defines how that company responds to an adverse, unexpected scenario. Kintaba automates the incident management process so teams can quickly report, respond, resolve, and reflect on major incidents collaboratively. Kintaba’s incident response platforms gives you instant access to incident management processes based on the practices of companies like Facebook,
The post Kintaba Incident Response with John Egan appeared first on Software Engineering Daily.
SingleStore is a multi-use, multi-model database designed for transactional and analytic workloads, as well as search and other domain specific applications. SingleStore is the evolution of the database company MemSQL, which sought to bring fast, in-memory SQL database technology to market. Jordan Tigani is Chief Product Officer of SingleStore and joins the show to talk
The post SingleStore with Jordan Tigani appeared first on Software Engineering Daily.
Compute resources continue to trend towards being cheaper, easier to use, and faster. Despite these positives, more compute demands more energy and therefore an increasing carbon footprint. With many companies committing to controlling their net carbon emissions, tools are required for engineers to not only measure their cloud infrastructure, but to make informed choices about
The post Cloud Carbon Footprint with Steren Giannini appeared first on Software Engineering Daily.
Vantage is a system for optimizing cloud costs. It provides tools and interfaces for developers to analyze how they are spending on AWS resources, and has recently expanded into GCP as well. Vantage users gain an easy interface into their costs that would otherwise be hard to analyze via the raw AWS console. Ben Schaechter
The post Vantage Engineering with Ben Schaechter appeared first on Software Engineering Daily.
At Lyft, Ketan Umare worked on Flyte, an orchestration system for machine learning. Flyte provides reliability and APIs for machine learning workflows, and is used at companies outside of Lyft such as Spotify. Since leaving Lyft, Ketan founded Union.ai, a company focused on productionizing Flyte as a service. He joins the show to talk about
The post Union.ai with Ketan Umare appeared first on Software Engineering Daily.
DuckDB is a relational database management system with no external dependencies, with a simple system for deployment and integration into build processes. It enables complex queries in SQL with a large function library, and provides transactional guarantees through multi-version concurrency control. Hannes Mühleisen works on DuckDB and joins the show to talk about query engines
The post DuckDB with Hannes Muleisen appeared first on Software Engineering Daily.
Substack is a platform for subscription based content, covering newsletters, podcasts, and soon video. The design and speed of the platform are notable–with a minimalistic format that simply gets creators paid for its work, Substack has gained massive popularity. Chris Best is the CEO of Substack and joins the show to talk about the platform,
The post Substack with Chris Best appeared first on Software Engineering Daily.
Customer data pipelines power the backend of many successful web platforms. In a customer data pipeline, data is collected from sources such as mobile apps and cloud SaaS tools, transformed and munged using data engineering, stored in data warehouses, and piped to analytics, advertising platforms, and data infrastructure. RudderStack is an open source customer data
The post RudderStack Engineering with Soumaydeb Mitra appeared first on Software Engineering Daily.
Managing Kubernetes nodes leads to operational complexity, security issues, and nodes that are perhaps more expensive to run than necessary. Deferring the node management to an underlying platform abstracts away these problems and can improve operations. Madhuri Yechuri runs Elotl, a nodeless Kubernetes platform. She joins the show to talk about the architecture and purpose
The post Nodeless Kubernetes with Madhuri Yechuri appeared first on Software Engineering Daily.
Retool is a company that allows customers to build complex internal tools using a high level GUI. Users configure the relationships between these different tools, giving them the ability to build applications even without much background in engineering. Of course, having some engineering expertise helps, as users can write JavaScript to interact with the higher
The post Retool Engineering with Snir Kodesh appeared first on Software Engineering Daily.
For over 20 years, our unquenchable appetite for data has led to us inventing and investing in a myriad of technologies, like SQL and NoSQL databases, streaming services, data lakes and warehouses, machine learning, and many more. The demand for data isn’t slowing down, with 97.2% of organizations investing in big data and AI. However,
The post Why Everyone Needs a Data Privacy Vault appeared first on Software Engineering Daily.
The software supply chain consists of packages, imports, dependencies, containers, and APIs. These different components each have unique security risks. To ensure the security of their software supply chain, many developers use tools to analyze and scan their infrastructure for vulnerabilities. Barak Schoster works at Bridgecrew, a DevSecOps cloud security platform. He joins the show
The post Software Supply Chain with Barak Schoster appeared first on Software Engineering Daily.
The data lake architecture has become broadly adopted in a relatively short period of time. In a nutshell, that means data in it’s raw format stored in cloud object storage. Modern software and data engineers have no shortage of options for accessing their data lake, but that list shrinks quickly if you care about features
The post Apache Hudi with Vinoth Chandar appeared first on Software Engineering Daily.
National Instruments develops software and hardware for engineering in a wide variety of domains, from aerospace to government technology to application testing. The interface between hardware and software presents a variety of difficult engineering challenges. Luke Schreier is a Senior Vice President at National Instruments and joins the show to discuss the engineering and management
The post National Instruments with Luke Schreier appeared first on Software Engineering Daily.
Automating video search requires a data pipeline that extracts metadata from videos and allows users to annotate the video with information that correlates with that metadata. The video needs to be segmented into intervals that define the search space, and the search space needs to be queryable by a user. Sieve Data is an automated
The post Video Search with Mokshith Voodarla appeared first on Software Engineering Daily.
Increasingly, technology groups need to be strategic about the cloud services they adopt to ensure their vendor’s pricing is both fair and measured exactly right for the application’s unique access pattern. Definitely answering questions like these can take a significant amount of time and energy from your most valuable engineers. Taloflow is a company trying
The post Taloflow with LV Jadavji appeared first on Software Engineering Daily.
Developers struggle with mental health, and this struggle has only gotten more acute during the pandemic. Sitting in front of a computer all day, engulfed by social media and code can cause us to lose our sanity. I personally had some issues that were hard to grapple with during the COVID lockdowns. In today’s show,
The post Mental Health with Kelsey Hightower appeared first on Software Engineering Daily.
A data catalog provides an index into the data sets and schemas of a company. Data teams are growing in size, and more companies than ever have a data team, so the market for data catalog is larger than ever. Mark is the CEO of Stemma and the co-creator of Amundsen, a data catalog that came out of
The post Data Catalog in Practice with Mark Grover appeared first on Software Engineering Daily.
Splunk is a monitoring and logging platform that has evolved over its 18 years of existence. In its modern focus on observability it is focused on open source and AIOps. Observability has evolved with the growth of Kubernetes, and Splunk’s work around OpenTelemetry has kept parity with the open source community of Kubernetes. Spiros Xanthos
The post Splunk Platform with Spiros Xanthos appeared first on Software Engineering Daily.
Francesco Cesarini founded Erlang Solutions in 1999 with a mission to help companies adopt Erlang. In this interview, I speak with Francesco and Gabor Olah from Erlang Solutions. We discuss the Erlang language, it’s ecosystem, and features like concurrency, resilience, and scalability that motivate adoption. We use Java and the Java Virtual Machine as a
The post Erlang Deep Dive with the Erlang Solutions team appeared first on Software Engineering Daily.
Serious software projects require several environments. Your production environment is obviously mission critical. A staging environment is also necessary to perform validation and regression testing before taking the risk of pushing an update to production. Best practices and approaches for managing these and other environments vary from organization to organization. In some sense, different software
The post The Staging Dichotomy with Senthil Padmanabhan appeared first on Software Engineering Daily.
Barry McCardel Co-Founder and CEO at Hex Caitlin Colgrove Co-Founder and CTO at Hex In contrast to other IDEs, the notebook interface offers software developers a unique environment idealized for data professionals. Despite the growth in popularity, a surprising learning curve still exists for setup and configuration. A siloed notebook offers no native collaboration tools.
The post Hex Collaborative Data Workspace with Barry McCardel and Caitlin Colgrove appeared first on Software Engineering Daily.
When writing code, test driven development is a common accepted methodology to ensure the development of high quality software. Your organization’s data, on the other hand, is an entirely different challenge. Data can be missing due to human error, a failure with a 3rd party provider, a botched release, or dozens of other issues. When
The post Data Quality Using Anomalo with Jeremy Stanley appeared first on Software Engineering Daily.
When you visit a web page, the creator’s intent is to present you a seamless experience that fills your browser window. That web page or web application is generally divided up in some meaningful way across navigation elements, content, ads, header, footer, and other components. Those components may represent the work of independent teams. Typically
The post Micro-Frontends with Luca Mezzalira appeared first on Software Engineering Daily.
Lee Atchison spent seven years at Amazon working in retail, software distribution, and Amazon Web Services. He then moved to New Relic, where he has spent four years scaling the company’s internal architecture. From his decade of experience at fast-growing web technology companies, Lee has written the book Architecting for Scale, from O’Reilly. As an
The post Architecting for Scale with Lee Atchison appeared first on Software Engineering Daily.
The creator economy has seen rapid growth, thanks largely to software solutions like Patreon that are enabling creators. As the creator economy grows, providers must be prepared for scalability issues and the challenges of maintaining and growing a software infrastructure and the team that evolves it. In this episode, I interview Utkarash Srivastava, SVP Engineering
The post Patreon Engineering with Utkarsh Srivastava appeared first on Software Engineering Daily.
Snyk is a platform for security that started with open source scanning and has expanded into container security, infrastructure as code, and other products. Snyk is a simple product to use, but has hidden complexities that build large data structures to manage and scan code dynamically. In a previous episode we discussed the core Snyk
The post Snyk Engineering with Guy Podjarny appeared first on Software Engineering Daily.
Linkerd is a service mesh that runs efficiently with a low memory footprint. We have covered the details of Linkerd in previous episodes. Buoyant is the company that sells Linkerd as a service, and today’s show focuses on the engineering details of the company, and how Linkerd is architected in 2022. William Morgan is the
The post Buoyant Cloud with William Morgan appeared first on Software Engineering Daily.
Online poker was deemed illegal in the United States ten years ago. Since then, poker has decreased in popularity, then found new invigoration thanks to live streaming and a large volume of bored gamers looking for something to do during the pandemic. Poker is a strategy game that can be played even without the financial
The post Clubs Poker with Taylor Crane appeared first on Software Engineering Daily.
Database product companies typically have a few phases. First, the company will develop a technology with some kind of innovation such as speed, scalability, or durability. The company will offer support contracts around that technology for a period of time, before eventually building a managed, hosted offering. PlanetScale is a database company built around the
The post Scaling PlanetScale with Sugu Sougoumarane appeared first on Software Engineering Daily.
Couchbase is a distributed NoSQL cloud database. Since its creation, Couchbase has expanded into edge computing, application services, and most recently a database-as-a-service called Capella. Couchbase started as an in-memory cache and needed to be rearchitected to be a persistent storage system. In this episode, I interview Ravi Mayuram, SVP Products and Engineering at Couchbase
The post Couchbase Architecture with Ravi Mayuram appeared first on Software Engineering Daily.
Rackspace is a multi cloud solutions provider that has evolved beyond its cloud computing origins into a diverse set of services and support offerings. Customers work with Rackspace to adopt cloud application deployments, modern data analytics, and all the other opportunities offered by cloud computing. Much of this occurs through partnerships where Rackspace provides teams
The post Rackspace with Jeff DeVerter appeared first on Software Engineering Daily.
Historically, search engines made money by showing sponsored ads alongside organic results. As the idiom goes, if you’re not paying for something, you are the product. Neeva is a new take on search engines. When you search at neeva.com, you get the type of result you’d expect from a search engine minus any advertising. In
The post Ad-free Search on Neeva with Darin Fisher appeared first on Software Engineering Daily.
Tabnine is an AI assistant that helps software engineers write more efficient code. It’s been trained on a large corpus of source code or can be trained based on your specific codebase. Either way, the resulting model offers predictive completion of code that can make programmers more productive. In this episode, I interview Eran Yahav,
The post Tabnine with Eran Yahav appeared first on Software Engineering Daily.
Protecting your customers begins with best practices for securely capturing, storing, and protecting the data you collect for or about them. When an organization has a large enough dataset, needs typically arise for doing analytical workloads or training machine learning models on this data. If you use random or mock data to generate a report
The post Privacy Engineering with Alex Watson appeared first on Software Engineering Daily.
When businesses share a common need such as payroll, commercial offerings can compete for market share with software solutions that easily adapt to a variety of businesses. Not all tasks can be easily commoditized or standardized. Take content moderation as an example. Every site that accepts user generated content is likely to have unique and
The post Flowdash with Nick Gervasi appeared first on Software Engineering Daily.
If you’re working on a proof of concept which you hope will help you raise funding, it’s fine to take a few shortcuts. Use the tech stack you know the best, don’t fall in love with your code, and when you start to experience growing pains, hopefully you’ll have the time to thoughtfully and carefully
The post Uber State Machine with Uday Kiran Medisetty appeared first on Software Engineering Daily.
Writing software is an absolute joy. Getting software to build is a chore. Thus, build systems emerged as a solution to automate this chore. At some point software engineers either use or hear legends about make and makefiles. While perhaps being the historically known tool, a great deal of thought has gone into approaches to
The post Build Tools with Benjy Weinberger appeared first on Software Engineering Daily.
Data onboarding – the process of importing a customers’ required data into a software product – is often a fairly manual process and the lack of automation means data onboarding falls squarely into the lap of the organization’s software development team. In smaller companies, this translates to one or two individuals focused on importing customer
The post 6 Data Import Challenges Facing Software Developers appeared first on Software Engineering Daily.
Infrastructure as code is a concept that has delighted software engineers, dev ops, and engineering management across the board. It’s neither fun nor efficient to configure the infrastructure and environments software teams require. Operating software at scale on a cloud, on-prem, or hybrid model is a problem of modernity that many enterprises find surprisingly challenging.
The post Infrastructure as Code with Rob Hirschfeld appeared first on Software Engineering Daily.
Pinterest is a visual discovery engine people use to find ideas in home, food, style, beauty, and more. The service grew quickly after its founding in 2010 and the company has grown to be a global team of thousands of professionals spanning time zones and continents. To deliver the smooth experience Pinterest users have come
The post Pinterest Engineering appeared first on Software Engineering Daily.
If you were to poll most organizations, the majority of people within them aren’t particularly fond of incidents. They are disruptive, sometimes damaging, and almost always have a negative connotation. The natural reaction is to simply want them to stop as quickly as possible. But as an industry, we need to evolve to
The post More, more, more! Why the most resilient companies want more incidents appeared first on Software Engineering Daily.
Charlie Gerard is an incredibly productive developer. In addition to being the author of Practical Machine Learning in JavaScript, her website charliegerard.dev has a long list of really interesting side projects exploring the intersection of human computer interaction, computer vision, interactivity, and art. In this episode we touch on some of these projects and broadly
The post Practical Machine Learning in JavaScript with Charlie Gerard appeared first on Software Engineering Daily.
TechLit Africa is a non-profit on a mission to lessen African poverty by leveraging the internet. Rural Africans lack digital skills and computers to gain from the digital economy, even though developed countries have an abundance of used computers. That’s where TechLit Africa comes in. They accept used computers, refurbish them with custom classroom code,
The post TechLit Africa with Nelly Cheboi appeared first on Software Engineering Daily.
Getting a computer program to run the same in different environments has been a recurring problem since the earliest days of software systems. Software versioning, versions of dependencies, hardware configurations, and CPU instruction set differences are just a few examples of challenges engineers have faced to get their software to run in different settings. A
The post Codename One with Steve Hannah appeared first on Software Engineering Daily.
With the push for stronger security, new employees are often frustrated during an initial couple of days of their employment, just waiting to get access to all the resources they’ll need as IT staff frequently has to manually go through each and every system and generate tokens for the new hire. Given the current industry
The post Automate your Infrastructure Access Workflows appeared first on Software Engineering Daily.
If you haven’t encountered a data quality problem, then you haven’t yet worked on a large enough project. Invariably, a gap exists between the state of raw data and what an analyst or machine learning engineer needs to solve their problem. Many organizations needing to automate data preparation workflows look to Trifacta as a solution.
The post Trifacta with Joe Hellerstein appeared first on Software Engineering Daily.
As the internet has grown, increasingly, we are consumers of services provided by corporations rather than owners and operators of our own systems. To many, this trend towards centralization is antithetical to the spirit of a free and open internet. Urbit is a new operating system and peer-to-peer network. There are several layers of novel
The post Urbit with Galen Wolfe-Pauly appeared first on Software Engineering Daily.
InfluxDB is an open-source time-series database. It’s maintained by InfuxData who offers a suite of products that help organizations gain insights from time-series data. In this episode, I interview Zoe Steinkamp, Software Engineering and Developer Advocate at InfluxData. We explore some of the common use cases for time-series databases such as IoT and some recent
The post InfluxData with Zoe Steinkamp appeared first on Software Engineering Daily.
Robotic process automation or RPA refers to software robots constructed to automate some business process. Perhaps the most ubiquitous example is adding filters to your email inbox. I’ve worked with a lot of salespeople that configure complex email follow-up campaigns when inbound emails come in, but even that’s a fairly basic example compared to what’s
The post UiPath with Boris Krumrey appeared first on Software Engineering Daily.
Everyone is becoming increasingly aware of supply chains for physical goods. Software has its own supply chain. A supply of open source solutions exists as does a demand for these solutions by industry. Both have surely grown, but it would be nice to have a way of measuring by how much. The State of Software
The post The State of Software Supply Chain 2021 with Ilkka Turunen appeared first on Software Engineering Daily.
There are a variety of new and upcoming security trends that will have a direct impact on software engineering workflows in 2022. In this article we’ll look at three emerging security approaches, and how new technologies–such as strongDM– can potentially help organizations become more secure. 1. Zero Trust The Zero Trust model was
The post The 3 Security Trends Impacting Engineering Workflows appeared first on Software Engineering Daily.
Relational databases have been a fixture of software applications for decades. They are highly tuned for performance and typically offer explicit guarantees like transactional consistency. More recently, there’s been a figurative cambrian explosion of other-than-relational databases. Simple key value stores or counters were an early win in this space. Managing a graph data structure is
The post MemGraph with Dominik Tomicevic appeared first on Software Engineering Daily.
The lifeblood of most companies is their sales departments. When you’re selling something other than a commodity, it’s typically necessary to carefully groom the onboarding experience for inbound future customers. Historically, companies approached this in a one-size-fits-all manner, giving all customers a common experience. In today’s data-driven age, a better experience can be provided that
The post Amplemarket with João Batalha appeared first on Software Engineering Daily.
As cloud providers enable greater levels of specificity and control, they empower compliance-driven enterprise companies. This level of parameterization is downright inhospitable to a new software engineer and can be a cognitive barrier to entry for a senior professional with a great idea but limited time. Developers want to focus on their code, algorithms, front
The post Render with Anurag Goel appeared first on Software Engineering Daily.
Writing your application’s code is only half the battle. Getting it to run on your machine is a milestone, but it’s far from your code running in a production environment. There are an increasing set of options application designers have for helping to manage deployment, environments, and CI/CD. Encore is a backend engine for the
The post Building Go Apps Using Encore with André Eriksson appeared first on Software Engineering Daily.
Kubernetes is here to stay. The benefits the container-orchestration systems provide to cloud-native applications are incalculable. It has become the de facto standard for automating application deployment, scaling, and management. However as the ecosystem matures, several roadblocks have emerged on the way to a production-ready system. Several issues like high availability and monitoring have been
The post Simplifying Access to Kubernetes appeared first on Software Engineering Daily.
Microservice architecture has become a ubiquitous design choice. Application developers typically have neither the training nor the interest in implementing low-level security features into their software. For this and many other reasons, the notion of a service mesh has been introduced to provide a framework for service-to-service communication. Today’s guest is Zack Butcher. While working
The post Tetrate Service Bridge with Zack Butcher appeared first on Software Engineering Daily.
Many software projects run the risk of evolving over time to a complex state that is inhospitable for new contributors to join. This is a dangerous place for a company to be. Either software needs to remain more accessible, or faster paths must be created to help them get on board. Today’s interview is with
The post Understandable Software with Kartik Agaram appeared first on Software Engineering Daily.
Climate modeling is increasingly important as supply chains, emergency management, and dozens of other efforts need to make predictions about future conditions and how they will impact business. Analyzing climate data requires geospatial systems, and those systems need a full-stack geospatial technology solution. Gopal Erinjippurath serves as CTO and Head of Product at Sust Global,
The post The Software of Climate Adaptation with Gopal Erinjippurath appeared first on Software Engineering Daily.
Once a machine learning model is trained and validated, it often feels like a major milestone has been achieved. In reality, it’s more like the first lap in a relay race. Deploying ML to production bears many similarities to a typical software release process, but brings several novel challenges like failing to generalize as expected
The post Responsibly Deploy AI in Production with Anupam Datta appeared first on Software Engineering Daily.
Internships can be an incredibly valuable resource to new professionals and are often the first professional work experience for many participants. It’s often the case that internship programs are suboptimal. Employers don’t always provide a clear path to success for the intern. Interns in turn don’t always have a resource to reach out for help
The post Internship Management Solutions with Nikita Gupta from Symba.io appeared first on Software Engineering Daily.
When creating a website, there’s no shortage of choices for how to do it. Builders must make strategic decisions about the language or framework they want to adopt. An important first consideration for many is selecting a web application framework like React or Vue. Motivated by a low page response time and good user experience,
The post Nuxt.js with Alexander Lichter appeared first on Software Engineering Daily.
Application observability is a fairly mature area. Engineering teams have a wide selection of tools they can choose to adopt and a significant amount of thought leadership and philosophy already exists giving guidance for managing your application. That application is going to persist data. As you scale up, your system is invariably going to experience
The post Metaplane with Kevin Hu appeared first on Software Engineering Daily.
Consumers are increasingly becoming aware of how detrimental it can be when companies mismanage data. This demand has fueled regulations, defined standards, and applied pressure to companies. Modern enterprises need to consider corporate risk management and regulatory compliance. In this interview, I speak with Terry O’Daniel, Director of Engineering (Risk & Compliance) at Instacart. Sponsorship
The post Risk and Compliance with Terry O’Daniel appeared first on Software Engineering Daily.
Thanks to the amazing books, blogs, videos, quickstarts, frameworks, and other software-related resources, getting started as a software engineer is easier than ever. Although you can get started in a day, it can take years to become a master of the craft and most practitioners describe it as a profession of lifelong learning. Titus Winters
The post Software Engineering at Google with Titus Winters appeared first on Software Engineering Daily.
With a few impressive exceptions, software is rarely written by one person. It takes a team and as that team outgrows a single shared office, coordination and communication become emergent problems. There are lots of lessons to be learned from companies that have already found approaches that scale. In this episode, I interview Tramale Turner,
The post Building Engineering Teams with Tramale Turner appeared first on Software Engineering Daily.
Neural networks, in particular, deep neural networks have revolutionized machine learning. Researchers and companies have pushed on the efficiency of every aspect of the machine learning lifecycle. The impact of the trained models is particularly significant for computer vision and in turn for autonomous driving and security systems. In this episode, I interview Forrest Iandola,
The post Deploying Computer Vision to the Edge at Anduril Industries with Forrest Iandola appeared first on Software Engineering Daily.
Modern businesses run on the cloud and increasingly so they run on multi-cloud infrastructure. As any growing company can tell you, cloud costs can easily run far out of control. Today’s enterprises are trying to deliver new products and services at a fast pace. That needs to be done in a cost-effective, ideally cloud-agnostic way.
The post Yotascale with Jake Reichert appeared first on Software Engineering Daily.
To many people’s surprise tech sales is not much of an art. It’s actually a regimented science where reps have clear step-by-step processes to bring in new business. Each stage takes the customer closer to the end of the deal and consists of learning more about the customer’s needs. A CRM is a database reps
The post AI in Sales with Ohad Parush appeared first on Software Engineering Daily.
The banking industry uses technology that some modern software engineers may regard as out of date or old-fashioned. Entrepreneurs wanting to create products in the banking space historically faced a steep curve to build software that could integrate with established banking systems. Christopher Dean seeks to change that. He founded Treasury Prime, a company that
The post Treasury Prime with Christopher Dean appeared first on Software Engineering Daily.
The internet is a layer cake of technologies and protocols. At a fundamental level, the internet runs on the TCP/IP protocol. It’s a packet based system. When your browser requests a file from a web server, that server chops up the file into tiny pieces known as packets and puts them on the network labeled
The post Scalable Streaming Video with Amit Mishra appeared first on Software Engineering Daily.
Machine learning models must first be trained. That training results in a model which must be serialized or packaged up in some way as a deployment artifact. A popular deployment path is using Tensorflow.js to take advantage of the portability of JavaScript, allowing your model to be run on a web server or client. Gant
The post Learning Tensorflow.js with Gant Laborde appeared first on Software Engineering Daily.
It does not matter if it runs on your machine. Your code must run in the production environment and it must do so performantly. For that, you need tooling to better understand your application’s behavior under different circumstances. In the earliest days of software development, all we had were logs, which are still around and
The post Observability Using Honeycomb.io with Christine Yen appeared first on Software Engineering Daily.
Angular is a free and open-source web application framework. It’s maintained by the Angular team at Google. It’s used by millions of web applications and has a strong ecosystem of core contributors and library builders. In this episode, I interview Minko Gechev, Developer Relations Lead at Google. We explore several aspects of open-source software development,
The post Angular Dev Tools with Minko Gechev appeared first on Software Engineering Daily.
It wasn’t that long ago that companies scheduled downtime in order to release an updated version of the software running their website. That’s rare today. Most developers want continuous testing, integration, and deployment. While that comes with many benefits, it also places greater demands on quality engineers who can no longer gate all updates into
The post The Future of Quality Engineering with Liliya Frye appeared first on Software Engineering Daily.
The manner in which users interact with technology has rapidly switched to mobile consumption. The devices almost all of us carry with us at all times open endless opportunities for developers to create location-based experiences. Foursquare became a household name when the introduced social check-ins. Today they’re a location data platform. Ankit Patel is the
The post Location-Based Experiences Using Foursquare with Ankit Patel appeared first on Software Engineering Daily.
The React Framework has seen continuous growth of adoption since its launch. There are many reasons for that, but one reason is how relatively painless it is to use react-create-app or copy some boilerplate code and have a functioning, hot reloading, live demo up and running in minutes. There is, however, a long way to
The post Enterprise React Apps with Paige Niedringhaus appeared first on Software Engineering Daily.
Welcome to Software Engineering Daily; I’m your guest host, Joey Baruch. I’m the CTO at Alvarez and Marsal Data Intelligence Gateway (A&M DIG), prior to which I co-founded and was CTO of HuMoov, a vertical SaaS. I’ve been a software engineer at PayPal, IBM Research Labs, and Qualcomm via the acquisition of Wilocity. Joining me
The post Building Startups Around Deep Tech Innovations with Fernando Gómez-Baquero appeared first on Software Engineering Daily.
According to builtwith.com, more than 10 million websites are powered by React framework. Of the top 10k sites by traffic, 44.7% of those are built with React. This javascript framework is capable of powering a wide array of modern applications and remains fairly beloved by developers that use it. In this episode, I interview Kent
The post Learning React with Kent C. Dodds appeared first on Software Engineering Daily.
Modern business applications are complex. It’s not enough to have raw logs or some basic telemetry. Today’s enterprise organizations require an application performance monitoring solution or APM. Today’s applications are complex distributed systems whose performance depends on a wide variety of factors. Every single line of code can affect production and teams need insights into
The post Datadog with Omri Sass and Hugo Kaczmarek appeared first on Software Engineering Daily.
One of the most painful parts of getting started on a new development team is getting one’s environment set up. Whether it’s undocumented steps, overly complex setups, or simply the challenges of understanding how the pieces fit together, getting a dev environment up often feels like a chore to be suffered through in order to
The post Remote Development in the Cloud with Gitpod & OpenVSCode Server with Sven Efftinge appeared first on Software Engineering Daily.
The notebook paradigm of coding is relatively new in comparison to REPLs and IDEs. Notebooks run in your browser and give you discrete cells for running segments of code. All the code in a single cell runs at once, but cells run independently. Cells can be re-run, which is a blessing and a curse. The
The post NBSafety for Jupyter Notebooks with Stephen Macke appeared first on Software Engineering Daily.
Virtual meetings were growing in popularity before the need accelerated as a result of the pandemic. Gather is a place where you can create a space for your community today. Users who join find themselves in a shared virtual space that offers the ability to interact with other users as well as interact with the
The post Online Communities on Gather with Phillip Wang appeared first on Software Engineering Daily.
Imagine a world where you own some sort of building whether that’s a grocery store, a restaurant, a factory… and you want to know how many people reside in each section of the store, or maybe how long did the average person wait to be seated or how long did it take the average factory worker to complete their assembly task.
Currently today these systems are either not using AI and instead use a mix of sensors and buttons to track certain actions or they do use AI but in a way that’s highly specific to their use case and hard to easily modify for new use cases that come down the line.
This is where BrainFrame comes in. BrainFrame is a tool that connects to all your on-prem cameras and lets you easily leverage AI models and business logic. Alex Thiele is the CTO of Aotu the company that makes BrainFrame and he joins me today to talk about BrainFrame and the vision for a future where computer vision can be run by anyone.
This episode is hosted by David Cohen. David is a Software Engineering Lead at LinkedIn where he works on backend applications and APIs that power their enterprise data systems. In his free time, he is an AI enthusiast and enjoys talking about all things Software. You can contact him on LinkedIn or Twitter.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
Show Notes: * BrainFrame * OpenCV BrainFrame Capsules
The post No Code AI for Video Analytics with Alex Thiele appeared first on Software Engineering Daily.
The gig economy involves independent contractors engaging in flexible jobs. Today gig workers often get work from centralized platforms that facilitate the process of connecting workers with employers in exchange for a fee. Some workers find the relationship between worker and platform to be adversarial in nature since the platform can establish and enforce rules at its own discretion.
In this episode, I interview Adam Jackson, Founder & CEO of Freelance Labs, builders of Braintrust. We discuss the state of the gig economy and his vision for how Braintrust can create a new kind of marketplace.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post The Future of Gig Work with Adam Jackson appeared first on Software Engineering Daily.
Venture capital investment has continued to flow into technology startups. No one builds technology from scratch. There are cloud services, software libraries, 3rd party services, and software platforms that modern entrepreneurs must adopt to build their products efficiently and quickly. These layers of infrastructure are a key area for many investors.
In this episode, I interview Tim Chen, managing partner of Essence VC, a venture fund on a mission to help highly technical founders go from zero to one. We discuss his approach to investment in infrastructure companies, developer tools, and similar areas for early-stage investments.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Investing in Infrastructure and Dev Tools with Timothy Chen appeared first on Software Engineering Daily.
Whether you love them or hate them, share them or ignore them, you encounter memes all over the internet. Those that are popular can often take off and spawn a long history of remixes, variants, derivatives, and inspired works.
In this episode, we interview Johan Unger, the founder of meme.com. They’re creating a platform for Meme Explorers to track these Memes and earn rewards along the way.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Meme.com with Johan Unger appeared first on Software Engineering Daily.
The last 15 years have seen the emergence of cloud-based developer APIs and services as dominant components of the developer toolchain. As a result, there has never been more power at developers’ fingertips. But making that power usable and accessible is a challenge that is shared between the providers and the consumers of these services.
Google’s Developer Relations team has spent the past 15 years bridging the gap between Google’s internal engineering teams and the broader developer community that consumes their APIs and services. Luke Mahé is a long-time engineering manager at Google DevRel. We talk about the history of Google’s developer offering and the critical role DevRel plays in shaping and promoting that offering.
This episode is hosted by Yaniv Bernstein. Yaniv Bernstein was until recently COO of Airtasker and is now a startup coach, adviser, and public speaker. He is the author of the People Engineering newsletter and is active on LinkedIn and Twitter.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Developer Relations at Google with Luke Mahe appeared first on Software Engineering Daily.
Decision-making around software projects has always been a contentious issue, should one move in an extremely thoughtful – planning all the way through, OR should teams opt for a quick approach, iterating through ideas, even if it means the approach might not be picture perfect. While both approaches lead to some trade-off, the former leading to time being consumed (where competitors can launch products, the idea can become obsolete, etc) and the latter causing unintended bugs (possibly making it all the way to production).
Google often is regarded as the organization founded by the PhDs who wish to take things slow ensuring that everything’s done in as much of a picture-perfect manner as possible, whereas Facebook (at least in the early days) was a company full of college-going engineers who chose to move fast and get something out there, even if that meant a few things would most likely break.
This article will summarize an interview with Jeff Meyerson, author of Move Fast: How Facebook Builds Software. Daliana Liu, the host for this episode raises a good point, “All the tech companies, they have to move fast to win competition, launch products. So what’s specific about Facebook that they move fast in a way that’s different from other companies?”
Jeff’s response to the question summarizes Facebook’s strategy in the early days: “Facebook basically said, ‘Look, we can’t compete with that. We have to do something different.’ And so they said, ‘Okay, we’re just going to step on the gas as fast as we can, and just build as fast as we can, and put some loose numbers around what success means and just drive towards those numbers like really aggressively, very aggressively.’ And that’s move fast.”
The interview goes on to talk about another rather interesting (and albeit controversial) topic covered in the book Move Fast, and that is the 10x engineer and the influential engineer.
However, Jeff is very much aware of the fact that arbitrarily judging someone to be “10x” is a naive thing to do. He puts forth the argument that while he does believe in 10x engineers, he’d like that there be some established KPI against which engineers can be compared, which would eventually lead to finding a few engineers who end up banking 10x more points on the metric than the average.
For the influencer engineer, the water gets a bit murky. The general philosophy here is code wins arguments. As a result, an influencer engineer would be the one who ends up having a (sizeable) impact on the organization by the code that they’ve written. Jeff goes on to take Nick Schrock here as an example based on the work he has done in writing and architecting GraphQL, something that had a great impact on Facebook.
“You want to move fast both to evade your competitors and to reach your goals as quickly as possible so that you can define new goals.” – Jeff Meyerson
The second half of the interview goes on to talk about ethical concerns with some of the recent mishaps at Facebook, to which Jeff succinctly and rather correctly points out that no one is forced to be on Facebook – and that he (Jeff) does support scrutiny for all firms!
In fact, Jeff even points out Facebook’s biggest enemy – itself. Facebook’s been trending in this rabbit hole of zero-sum hyper-competitive mode where it makes its competitor’s products perform poorly inside its own products (thus discouraging their use). Youtube can be seen as an example here, and how poorly it performs when being used inside Facebook Messenger. Imagine if these products worked in synergy, leading to a positive-sum output and a win-win for both customers and the companies involved!
Fun fact: uploading the audio version of Move Fast on SEDaily rather than a platform like Audible was actually Jeff himself practicing moving fast. Since Audible took too long to publish the audiobook, Jeff decided that it made more sense to have something out there, rather than wait for Audible indefinitely!
While there’s a lot more nuance to the topics covered here and a lot of topics that aren’t touched upon at all in this article, I’d highly recommend checking out Move Fast – it’s on Amazon and the audio version is in fact, free available on the SEDaily website.
Click here to listen to the full episode, or watch it on our YouTube channel.
The post Episode Summary: Move Fast with Jeff Meyerson appeared first on Software Engineering Daily.
Coinbase is a popular and well-trusted cryptocurrency platform for buying and selling digital currencies. With Coinbase, your portfolio for crypto investments is managed in a central location. Originally just a web application, Coinbase has now grown to multiple different products across multiple platforms such as web, iOS and Android. With that increased scale came increased complexity as the team began maintaining multiple codebases and hiring individuals to fill the same role for multiple platforms.
Around two years ago, the development team at Coinbase came up with the theory that by using React Native and its ability to develop for multiple platforms with the same codebase, they could reduce the code complexity of maintaining multiple platforms while maintaining the same high quality that people expect from native code. Traditionally iOS and Android development has happened in silos. Each team had its own development team, design team and product management. In addition, since both apps accessed the same backend data models, inconsistencies and headaches would arise with how each app accessed and used the same backend data. React Native promised to solve this problem and at least present a unified mobile platform. However, the journey would take around two years and present its own challenges and headaches.
Coinbase wanted to have an incremental approach where they could test and validate assumptions while maintaining the availability of their core app. They started by rewriting their main app for Android. At the time it was clear that React Native was much less mature, much more buggy and more difficult to make performant. If they could reach the quality bar they wanted to, Android then transitioning the iOS app would be simpler and faster. This assumption proved true as the Android app took over a year and half to transition over and the iOS app took less than six months. However, a transition from native Katlin and Swift apps was not without its own problems.
One of the biggest problems that the Coinbase team faced was people management. Coinbase had already developed two separate mobile development teams that specialize in iOS and Android development and convincing them to move over to React Native was an arduous process. Coinbase set up a React Native school where they had an expert teacher to select individuals. Those individuals then paired up with individual team members to pass on knowledge and give a tour of the features and capabilities. Only when everyone had their hands dirty writing React Native code did they begin the transition of the codebase. It required a large initial investment in time and money and continuous investment to improve the team and the technical expertise. To this day, Coinbase has a team of React Native consultants to ensure that the team is always taking advantage of new features and developing with best practices in mind.
Another big problem that Coinbase had was recognizing the limitations of React Native. There is this stigma that still exists to this day that React Native code cant be performant or as high quality as native code. Airbnb tried to make the transition to React Native but abandoned the project due to this very reason. However, this is less to do with the actual capabilities of the platform and more to do with the applications being developed. Coinbase made a concerted effort to make sure the performance and quality were as high as possible. This led to several concrete actions. They developed some custom tooling as the React Native debugger was and is still fairly obscure. They had a unified design team that made sure the user experience was consistent and exceptional across platforms and products. They also made sure to retain some of the mobile platform experts and roles as some changes needed to be made per platform experience to ensure an excellent experience. Native experts are important to making React Native look and feel really, really good on their respective platforms. Things like headers growing in IOS when you scroll over, or different rubber banding in certain places and other tiny details disguise the abstraction of Typescript so that end-users feel like they are using a Native Platform.
Part of this success at this rewrite was due to Coinbase’s unique culture of debate, decide, deliver. You make sure to take everyone’s opinion but once a decision has been made, everyone rows in the same direction. That culture led the mobile engineers to trust, work hard, and dedicate themselves to the rewrite. By honestly discussing the migration, the journey, the metrics, and the decision points and documenting them with a heavy paper trail, Coinbase got buy-in from everyone and that was an important part of their success.
Looking back, the transition from native development to React Native was not so clear for Coinbase. They had to pursue a “brownfield” approach to ensure that their product was always running. React Native was the only real solution out there for multi-platform development as alternatives like Flutter and Kotlin multi-platform were in their infancy. There were problems with efficiency and performance. However, nowadays the decision is much more simple, especially in a “greenfield” product. React Native is gaining performance by removing things from the Javascript bridge and new libraries like Reanimated 2 ensure that React Native feels like native code. Alternatives like Flutter and Kotlin are much more mature. Nowadays if you are building a product from scratch, there is no reason to not use one of these libraries. However, the technology stack is much less important than the engineer’s attention to detail and the bar of quality you set for the product.
Looking to the future, Coinbase’s development team sees three waves. Wave number one was creating a unified Javascript platform across web and mobile. That was achieved when they launched React Native application on iOS earlier this year. The second wave is unifying that UI, data and tooling layer. That way when you improve build times by five seconds, it across hundreds of engineers. The third wave is focusing on developer effectiveness, velocity and quality so you can continually iterate and improve those over time and drive key business metrics.
Coinbase is an impactful company. It’s this generation’s Facebook or Amazon. Crypto will only continue to grow and as it does Coinbase will be right beside it providing secure, highly scalable products.
This summary is based on an interview with Brent Walter, a Senior Engineering Manager at Coinbase and Jacob Thornton, a Senior Staff Engineer at Coinbase. To listen to the full interview, click here
The post Episode Summary: Coinbase React Native: Building the Cryptocurrency Ecosystem appeared first on Software Engineering Daily.
The expression firing on all cylinders dates back to the early 1900s and refers to a function of the internal combustion engine. This expression poetically applies to successful businesses as well. Each department must operate at peak performance and the couplings between departments need optimization as well.
In this episode, I interview business coach Jon Dwoskin about a variety of topics related to entrepreneurship and how to engineer a successful organization.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Getting Businesses Unstuck with Jon Dwoskin appeared first on Software Engineering Daily.
Infrastructure as Code is an approach to machine provisioning and setup in which a programmer describes the underlying services they need for their projects. However, this infrastructure code doesn’t compile a binary artifact like traditional source code. The successful completion of running the code signals that the servers and other components described in the configuration file have been created automatically by the tools being used.
In this episode, I speak with Christian Tragesser, DevOps Consultant with World Wide Technology. We discuss the tools and processes that are helping modern development groups solve technical problems.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Infrastructure as Code with Christian Tragesser appeared first on Software Engineering Daily.
As our guest today points out, most enterprise software applications are essentially forms for collecting data. The
By most accounts, demand for software engineers exceeds supply. Not just anyone can develop this skill set to the level required to deliver enterprise-grade production code. For those that can, companies are incentivized to take extra measures to ensure software engineers are as productive as possible. The pace of business is often throttled by the pace of software releases.
In today’s episode, we speak with Utsav Shah about developer productivity in the context of the monolith, CI/CD, and best practices for growing teams.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Developer Productivity with Utsav Shah appeared first on Software Engineering Daily.
The first industrial deployments of machine learning and artificial intelligence solutions were bespoke by definition and often had brittle operating characteristics. Almost no one builds custom databases, web servers, or email clients. Yet technology groups today often consider developing homegrown ML and data solutions in order to solve their unique use cases. Today’s modern data stack is a patchwork of interconnecting tools built to suit a variety of personas that need to interact with the data in notably different ways.
In this episode, I speak with Leigh Marie Braswell, an Investor with Founders Fund. We have a wide-ranging discussion about the technology landscape of data and machine learning solutions and the modern enterprise data stack.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Modern Data Infrastructure and Tools with Leigh Marie Braswell appeared first on Software Engineering Daily.
Abstract
Software Daily is a place to create software.
Introduction
SoftwareDaily.com is a social network that allows people from all over the world to come together and create software.
Inspiration from Amazon
Working at Amazon taught me that we can build anything.
Inspiration from Facebook
Writing “Move Fast” taught me that social networking will allow us to expand our species and celebrate an increased breadth of individuality while also deepening our shared values and experiences.
Faceazon
Faceazon is a social network like Facebook combined with a universal ecommerce experience like Amazon.
Notes on Podcasting
Podcasting has taught me empathy, both technical and emotional.
Software Engineering Daily
SE Daily has proven my credibility as the most knowledgeable software engineer in the world. Anyone who disagrees is welcome to bet me $1M+ that they can out-earn me over the next decade.
Notes on Digital Advertising
Digital advertising in its current form allows for blatant, repeated theft by adtech companies including many with $1B+ market cap.
Adforprize
Adforprize is our video social network and creative advertising platform that will integrate seamlessly with YouTube, TikTok, Instagram, Stripe, and OnlyFans to provide you with a full service user generated and industrially maintained advertising ecosystem.
Podsheets
Podsheets is a combination open source podcasting and video publishing and consumption platform.
Notes on Hosting Businesses
Hosting businesses with proprietary UIs or APIs have the best, most defensible margins (even better than payments). Heroku remains one of the most underestimated portfolio sleepers in business, and explains Salesforce’s eventual potential to rival even Amazon as the most rapidly growing behemoth in the world.
Notes on Collaboration Businesses
Super hard to get enough people using a collaboration business, and once they do they are still willing to switch because collaboration is just a little productivity thing that can usually be swapped out (yes, even you Slack will one day be swapped out).
FindCollabs
I should never have shut down FindCollabs and if you want to help me reboot it please email me.
Software Daily
Check out SoftwareDaily.com to see all of my plans, including an Uber-like services company and a new mobile operating system.
Supercompute
Check out supercompute.games to learn the software business while earning botcoin!
Notes on Gaming Businesses
Gaming businesses are high margin, high risk, and super fun to build.
Notes on Payments Businesses
Payments businesses are as sticky as surgical mesh and Stripe is as admirable as AWS and Oracle–which is to say I am deeply envious of Stripe and wish I was a good enough human being and effective altruist to change into a Collison.
Rectangle
Rectangle is an open source, open operations payments systems business with a minimum goal of offering open source alternatives to Stripe.
Notes on Censorship
Companies are forced to censor their content by an outdated, overly religious and warmongering government that more closely resembles the Deep State than The West Wing.
Sqripe
Sqripe is an uncensorable internet built on a data structure I invented called a cloud blockchain.
Notes on Virtue Capital
Venture capitalists are mostly cowards with no real opinions about anything other than which vest to wear given their daily set of potential microclimates.
Investment Discussions
Investment Discussions is a Slack group where I give away investment liquidity in exchange for knowledge from entrepreneurs and investors.
Notes on Portfolio Synergies
There are portfolio synergies across every portfolio. a16z, for example gets portfolio synergy from their wide variety of data transfer, ETL, data management, and data engineering businesses, who can share notes and form loose cabals of success. Sequoia Capital gets portfolio synergy by owning the investment communities of both China and the United States. Facebook would get portfolio synergy if it owned both Twitter and Google, hypothetically. See, this is the kind of paranoia I have, which is why I’m planning to run for president.
Notes on Healthcare
Our healthcare system is hurting everyone in the United States, and I have no idea how to fix it. It makes me very sad. I think that instead of focusing on healthcare, we should focus on homelessness, which has more measurable outcomes.Auditable Hospitals
We need a hospital system where every single patient has access to the actions of every single care provider, allowing patients to uncover conspiracies and antitrustworthy market actions.Notes on Fear
You should never let fear stop you from doing what you know you are capable of.
The post Software Daily Prospectus appeared first on Software Engineering Daily.
Phishing attacks, malware, and ransomware are just some of the major threats everyone connected to the internet faces. For companies, the stakes are especially high. Setting up a secure infrastructure is difficult. Your adversary only needs to find one flaw to get in.
Vancord is a private cybersecurity company, based in Connecticut, that was founded and built by security engineers to specialize in incident resilience and response. In this episode, I interview Jason Pufahl and Russell Jancewicz from Vancord.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Cybersecurity Threats with Jason Pufahl and Russell Jancewicz appeared first on Software Engineering Daily.
In a version control system, a Monorepo is a version control management strategy in which all your code is contained in one potentially large but complete repository. The monorepo is in stark contrast to an alternative approach in which software teams independently manage microservices or deliver software as libraries to be imported in other projects. The monorepo strategy has been followed by noteworthy companies such as Google, Facebook, and Microsoft.
Derrick Stolee is a software engineer working at GitHub. He joins us today to talk about strategies for monorepos and innovations to the way git works in order to better support this style of the repository.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Git Scales for Monorepos with Derrick Stolee appeared first on Software Engineering Daily.
Companies that gather data about their users have an ethical obligation and legal responsibility to protect the personally identifiable information in their dataset. Ideally, developers working on a software application wouldn’t need access to production data. Yet without high-quality example data, many technology groups stumble on avoidable problems. Organizations need a solution to protect privacy while simultaneously preserving aspects of the data which are important.
Tonic is automating data synthesis to advance data privacy. Their solution gives your production-like data for development and analytical purposes without compromising on data quality or privacy. In this episode, I interview Tonic’s CEO Ian Coe, and Head of Engineering Adam Kamor.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Faking Data Using Tonic.ai with Ian Coe and Adam Kamor appeared first on Software Engineering Daily.
Applications write data to persistent storage like a database. The most popular database query language is SQL which has many similar dialects. SQL is expressive and powerful for describing what data you want. What you do with that data requires a solution in the form of a data pipeline. Ideally, these analytical workflows can follow similar best practices to those handled in application code.
DBT is a transformation workflow that lets teams deploy analytics code following software engineering best practices like modularity, portability, CI/CD, and documentation. Users who know SQL can build production-grade data pipelines. In this episode, I interview Tristan Handy, CEO, and founder of DBT Labs.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post DBT: Data Build Tool with Tristan Handy appeared first on Software Engineering Daily.
The way we write, compile, and run software has continued to evolve since computer programming began. The cloud, serverless, no-code, and CI/CD are all contemporary ideas introduced to help software engineers spend more time on their application and less time on the chores of running it.
Darklang is a new way of building serverless backends. It’s a cloud native programming language with several novel features including being not just serverless but deployless as well. In this episode, I interview Paul Biggar, founder and CEO of Dark.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Darklang Deployless Applications with Paul Biggar appeared first on Software Engineering Daily.
Tedious, repetitive tasks are better handled by machines. Unless these tasks truly require human intelligence, repetitive tasks are often good candidates for automation. Implementing process automation can be challenging and technical. Increasingly, engineers are seeking out tools and platforms to facilitate faster, more reliable automation.
In this episode I talk to Yaseer Sheriff, Co-Founder and CEO at Axiom about no-code solutions, process automation, and some of the challenges in developing the software powering those services.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post No Code Process Automation at Axiom with Yaseer Sheriff appeared first on Software Engineering Daily.
Financial technology or fintech has always been a hot topic. This is increasingly true in recent years as disruptive companies enter the market to give better alternatives and solutions to consumers.
Current is focused on creating better financial outcomes. In addition to providing banking services, their app has many tools and reminders to help users learn and execute better money management strategies. In this episode, I interview Trevor Marshall, CTO of Current about starting a fintech company, how banking software is written, and what opportunities exist for disruption.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Reimagining Banking at Current with Trevor Marshall appeared first on Software Engineering Daily.
The dream of machines with artificial general intelligence is entirely plausible in the future, yet well beyond the reach of today’s cutting edge technology. However, a virtual agent need not win in Alan Turing’s Imitation Game to be useful. Modern technology can deliver on some of the promises of narrow intelligence for accomplishing specific tasks.
PeopleReign has created a virtual agent for IT and HR employee service. This agent’s goal is not to replace a human agent but to augment them by handling some requests and elegantly handing off to a human in other cases. In this episode, I speak with Dan Turchin, CEO of PeopleReign about their virtual agent and the future of work.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Virtual Agents for IT and HR with Dan Turchin appeared first on Software Engineering Daily.
A developer’s core deliverables are individual commits and the pull requests they aggregate into. While the number of lines of code written alone may not be very informative, in total, the code and metadata about the code found in tracking systems present a rich dataset with great promise for analysis and productivity optimization insights.
LinearB is a systematic approach to engineering improvement. Their WorkerB Slack Bot connects with teams on an individual level to help with productivity and collaboration. In this episode, I speak with Dan Lines, Co-Founder, and COO.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
Show Notes: * LinearB.io * Learn more about WorkerB * Check out the Dev Interrupted Podcast * Save your spot for the INTERACT conference
The post LinearB with Dan Lines appeared first on Software Engineering Daily.
Interest in autonomous vehicles dates back to the 1920s. It wasn’t until the 1980s that the first truly autonomous vehicle prototypes began to appear. The first DARPA Grand Challenge took place in 2004 offering competitors $1 million dollars to complete a 150-mile course through the Mojave desert. The prize was not claimed.
Since then, rapid progress has begun in autonomous driving fueled by advances in sensor technology, software, and the hardware which runs it. Infrastructure has become a serious consideration for autonomous vehicle companies. In this episode, I speak with Vinoj Kumar, VP of Infrastructure at Cruise, the San Francisco company building an all-electric self-driving rideshare and delivery service. They’re tackling the infinite longtail scenarios of city driving and helping Walmart with self-driving grocery delivery.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Autonomous Driving Infrastructure with Vinoj Kumar appeared first on Software Engineering Daily.
Money laundering is not a new crime. However, the growth of digital communications has greatly expanded the opportunity for money launderers to find innovative new ways to hide their true intent. Some estimates suggest it could be as high as 2-5% of the world’s GDP.
Unit21 is a customizable no-code platform for risk and compliance operations. They offer a simple API and dashboard for detecting and managing money laundering and fraud. Today on the show, I speak with Clearance Chio, co-founder and CTO of Unit21.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Detecting Money Laundering with Clarence Chio appeared first on Software Engineering Daily.
Web applications often have some sort of login system, and once a user creates an account, they have access to features anonymous users can’t see. In time, application designers will often add an admin level of access for special users. This is often a slow trickle of technical debt. Proper execution of a programmatic authorization system requires concepts like roles, resources, departments, and organizations.
OSO describes itself as batteries included authorization. It’s an open source library used by companies like Intercom and Wayfair whicseh allows them to manage authorization in a robust and standardized framework without reinventing the wheel. In this episode we speak with Sam Scott, CTO at OSO.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Authorization with Sam Scott appeared first on Software Engineering Daily.
As developers hone their craft, becoming more productive often means learning utilities and tools at the command line. The right combination of various parsing commands chained together through pipes can enable engineers to quickly and efficiently automate many adhoc data processing tasks.
In this episode I speak with Adam Gordon Bell about some of his favorite command line tools. We also discuss his role as a developer advocate for Earthly, a powerful tool for building software in a repeatable and understandable way. Adam is also the host of the Co-Recursive podcast.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Earthly and CLI Productivity with Adam Gordon Bell appeared first on Software Engineering Daily.
Modern companies leverage dozens or even hundreds of software solutions to solve specific needs of the business. Organizations need to collect all these disparate data sources into a data warehouse in order to add value. The raw data typically needs transformation before it can be analyzed. In many cases, companies develop homegrown solutions, thus reinventing the wheel and possibly planting deep rooted seeds of technical debt.
Mozart Data helps you collect all of your data sources in under an hour. They provide managed data pipelines, data warehousing, and transformation automation. In this episode, I interview CEO Peter Fishman and CTO Dan Silberman about the modern data stack.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Modern Data Stacks Optimized by Mozart Data with Peter Fishman and Dan Silberman appeared first on Software Engineering Daily.
Arun Kumar is an Assistant Professor in the Department of Computer Science and Engineering and the Halicioglu Data Science Institute at the University of California, San Diego. His primary research interests are in data management and systems for machine learning/artificial intelligence-based data analytics.
His Advanced Data Analytics Lab (ADALab) focuses on basically improving machine learning and artificial intelligence-based data analytics from a holistic standpoint of concerns such as scalability, usability, ease of deployment, ease of development. He calls all of this democratization of machine learning-based data analytics. He is building software systems, abstractions, tools, devising new algorithms, and also studying the theory behind empiricism. The experimental analysis behind this whole process of making machine learning-based analytics easier, and faster, and cheaper for people.
The lifecycle of advanced Data Analytics consists of three phases which are sourcing, building and deploying. The sourcing stage consists of converting raw data in data lakes and data warehouses into ML-ready data. Data preparation is basically reformatting the data. In the second step, the build stage is converting that into a prediction pipeline. MLflow is one of the tools that people use for standardized data. The building stage is where a lot of machine learning and data mining classes focus their efforts on things like how to prepare features. For data scientists, the first thing they need to worry about is defining the application goal. Finding out how data is going to achieve something for the application is the first step towards finding the application goal. The objectives themselves are a big bottleneck, for a lot of users of machine learning.
Data building involves applying the knowledge to the algorithms and the theory of machine learning and connecting them with the application goals that users have. Fairness, inference latency, training cost, interpretability and explainability of data are things that matter significantly. Finally, the deploying step is integrating a prediction pipeline with an application and monitor and oversee the life cycle as the data and application evolve.
Over the last couple of decades, the complexity of the model deployment landscape has exploded due to cloud computing, the internet of things (IoT), heterogeneity of hardware and models. All of these things have caused an explosion of complexity. In the web companies, app companies and the IoT world, deployment is very heterogeneous, and the machine learning environment is no exception. Usage of MLflow, TensorFlow Extended (TFX) and TensorFlow Serving makes it easier for people who do model building and data sourcing. Hence, users can build prediction pipelines.
In these three stages, the amount of scientific inquiry scientists have is still not at the level that they want it to be. A big portion of the computing research in his lab is fundamentally answering questions like, What are practitioners doing accurate enough? Can we reduce the cost and improve productivity? Arun Kumar says he has to interact with practitioners to understand where the bottlenecks are.
One of the projects in Arun’s Data Analytics lab focuses on Project Cerebro. In the Cerebro project, they propose a new system for Artificial neural network (ANN) model selection that raises model selection throughput without raising resource costs. Their target setting is small clusters (10s of nodes), which covers a vast majority (almost 90%) of parallel ML workloads in practice. We have four key concerns: scalability, statistical convergence efficiency, reproducibility, and system generality. To satisfy all these, they develop a novel parallel execution strategy.
There are many tradeoffs that are inherent in a real-world application of ML. For instance, correct model selection is a key bottleneck in raising the accuracy of the data. The Cerebro project aimed at making the process of model selection easier. Arun and his coworkers want to make a sort of high-throughput exploration process so that they will reduce resource costs and reduce runtimes. Therefore, people will be more willing to do more of the sort of exploration and reach better accuracy and better metrics. And that was what they observed in the Cerebro project. He says that is what motivated them to build out the Cerebro system. The Cerebro system was designed in a way that scientists planned to use the tools that they are comfortable with. So they don’t have to change their TensorFlow, PyTorch or Kerris implementation.
The Data stored on data lakes, data warehouses and database systems. Colleagues of Arun Kumar at VMware would like to do machine learning tasks like sentiment mining and named entity recognition. Hence, they could just specify the off-the-shelf transformer architectures, doing hyperparameters for fine-tuning on the data sets, and then give that to the Cerebro API’s, and then they could build it at a higher throughput. This is an example of an application that uses Cerebro as a tool to improve model selection.
Arun Kumar says, “Any prediction task where you would need to build a model and need to tune hyperparameters, need to tune the architecture, Cerebro is useful there. It’s really a very general system for all these sorts of model selection tasks, where you’re building a neural computational graph.”
Neural computational graph frameworks that they currently support are TensorFlow and PyTorch. They are the most commonly used frameworks for specifying neural computation graphs, and executing them and training them with Stochastic gradient descent (SGD). In the future, it can be extended to other frameworks as well.
Cerebro project born out of academic needs. Big corporate companies like Google, Amazon or Facebook could try to solve a problem with 100 GPUs. However, this is not the case in academia. In academia, people need to share their total computation power properly so that everyone on the campus could benefit from it. The technique of model parallelism in Cerebro mitigates the cons of this kind of shared usage. Arun and his team invented Cerebro because they find it necessary for academicians like themselves and also for a lot of domain scientists, academics, enterprises and tech companies.
Regarding excessive usage of resources in the big technology corporations, Arun Kumar says, “They think they could just throw machines at everything and get away with it. And in turn, it comes back to bite people. Like if you’re in the cloud, and you’re just throwing machines at it, who is going to benefit from it? It’s the cloud vendors because they can pocket more money from the enterprises.”
The importance of resource efficiency is one of the reasons why the Cerebro project took this course. VMware is also a big tech company. But their philosophy is very different from all these other companies. Arun believes big tech companies and cloud providers will eventually come around to this worldview because if they’re going to sell products to enterprises, enterprises are going to demand bills that are lower than what they have today.
For the future of data science, Arun thinks, problems are getting wilder and less well-defined. Hence, there will be a lot of research attention that is going to be needed. Scientists need a lot more work on data preparation and data sourcing part of the lifecycle from the scientific and research standpoint. There is also a need for more industry-academia partnerships on the deployment side.
This summary is based on an interview with Arun Kumar, Assistant Professor in the Department of Computer Science and Engineering and the Halicioglu Data Science Institute at the University of California, San Diego. To listen to the full interview, click here.
The post Episode Summary: Data Management Systems and Artificial Intelligence with Arun Kumar appeared first on Software Engineering Daily.
An application network is a way to connect applications, data and devices through APIs that expose some or all of their assets and data on the network. That network allows other consumers from other parts of the business to come in and discover and use those assets (mulesoft.com).
The company Tetrate provides the tools necessary for a highly efficient application (aware) network. Tetrate helps connect and manage applications across clusters, clouds, and data centers. It supports integrating traditional workloads into your cloud-native application infrastructure, defining access control and editing rights or teams on shared infrastructure, and out of the box conformance with NIST standards for microservices security.
In this episode we talk to Varun Talwar, Co-Founder of Tetrate.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Tetrate: Application Aware Networking with Varun Talwar appeared first on Software Engineering Daily.
A software engineer will make many mistakes on their career journey. In time, engineers learn to make smaller mistakes, recognize them faster, and build with appropriate guardrails. The demands of delivering software in a timely and efficient fashion often demands developers carefully optimize tradeoffs to deliver solutions to the problems at hand.
Software Mistakes and Tradeoffs: How to Make Good Programming Decisions is the book by Tomasz Lelek and Jon Skeet. In this episode, we interview Tomasz about his experiences as a software engineer and sample the advice found in this book. Listeners interested in a copy can use the special discount code sedlelek35 at manning.com.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Software Mistakes and Tradeoffs with Tomasz Lelek appeared first on Software Engineering Daily.
By most accounts, the first databases came on line in the 1960s. This class of software has continued to evolve alongside the technology it runs on and the applications it supports. In the early days, databases were typically closed source commercial products.
Today, databases run in the cloud on distributed systems. Increasingly, the leading tools are open source yet frequently supported by a related commercial entity offering managed services and white glove support.
In this episode, we interview Jonathan Ellis, CTO of DataStax and Spencer Kimball, CEO of Cockroach Labs about the current state of distributed databases and the open source ecosystem.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Distributed Open Source Databases with Jonathan Ellis and Spencer Kimball appeared first on Software Engineering Daily.
Instabase is a technology platform for building automation solutions. Users deploy it onto their own infrastructure and can leverage the tools offered by the platform to build complex workflows for handling tasks like income verification and claims processing.
In this episode we interview Anant Bhardwaj, founder of Instabase. He describes Instabase as an operating system. We explore what he means by that and discuss the types of use cases Instabase powers.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Instabase with Anant Bhardwaj appeared first on Software Engineering Daily.
The Israeli Tech Radar is an opinionated map of the latest technologies and trends in the Israeli tech industry. Now in its fifth edition, the Tech Radar was built in collaboration with Monday, Wix, Riskified, Netapp, Tabula, and other tech companies.
Lior Kanfi is the CEO of Tikal. In this episode, we interview Lior about the Tech Radar as well as his thoughts for addressing the current tech talent shortage.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post The Tech Radar with Lior Kanfi appeared first on Software Engineering Daily.
This episode is hosted by Kyle Polich of the Data Skeptic podcast. We’re glad to welcome Kyle to the Software Daily team.
Becoming a contributor to an existing software project can be a daunting task for an engineer. A common convention is to add a README file to your repository to serve as a trailhead which gives new visitors step by step instructions for running, exploring, and understanding the structure of the codebase.
The Missing Readme is the recently published book which prepares new software engineers to both survive and succeed. Learning to code in school, in a bootcamp, or independently can prepare you to write software. This book prepares you to do it effectively in a professional setting.
In this episode, we talk to authors Chris Riccomini and Dmitriy Ryaboy.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post The Missing Readme with Chris Riccomini and Dmitriy Ryaboy appeared first on Software Engineering Daily.
Whether organizing projects, working from home, or conducting business, you need to use many necessary apps and cloud services to do the job. Despite these apps being necessary, switching between them and keeping them interconnected and updated is a challenge. They very easily become disorganized which makes using them less efficient.
The company ClickUp solves this problem by providing a platform that provides everything a business needs to efficiently operate, all in one place! ClickUp uses a unique hierarchy to see the big picture without missing details, and offers everything from docs, to tasks, to imports and integrations. With everything in one place and easily searchable and organized, ClickUp makes work much easier.
In this episode we talk to Zeb Evans, Founder and CEO of ClickUp.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post ClickUp: Workflow Vision with Zeb Evans appeared first on Software Engineering Daily.
Kubernetes is an open source container orchestration service released by Google in 2014. It has quickly grown into a platform with a huge community of enthusiasts and professionals. Besides becoming the de facto standard for container orchestration, it has fostered an ecosystem of related tools and services with increasing power and sophistication (opensource.com).
Argo, a project developed by the company Applatix and acquired by Intuit, is a set of essential Kubernetes-native tools for deploying and running jobs and applications on Kubernetes. All the Argo tools are implemented as controllers and custom resources. Some of these tools are Argo Workflows, Argo Events, Argo CD, and Argo Rollouts (intuit.com).
In this episode we talk to Alex Collins, Principal Software Engineer at Intuit, about using Argo to manage Kubernetes applications.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Argo: Kubernetes-Native Tools with Alex Collins appeared first on Software Engineering Daily.
Shinji Kim is Founder and CEO of Select Star. In this episode we discuss data discovery and more.
This interview was also recorded as a video podcast. Check out the video on the Software Daily YouTube channel.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Data Discovery with Shinji Kim appeared first on Software Engineering Daily.
ETL stands for “extract, transform, load” and refers to the process of integrating data from many different sources into one location, usually a data warehouse. This process has become especially important for companies as they use many different services to collect and manage data.
The company Grouparoo provides an open source framework that helps you move data between your data warehouse and all of your cloud-based tools. This process of moving data back from the data warehouse to the applications is called reverse ETL, and is important for things like marketing campaigns and customer service. It easily integrates with your developer’s tools and is free and easy to install.
In this episode we talk with Brian Leonard, CEO at Grouparoo.
This interview will also be published as a video episode on our YouTube channel.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Grouparoo Open Source Data Tools with Brian Leonard appeared first on Software Engineering Daily.
In the late 1970s a printer at MIT kept jamming, resulting in regular pileups of print jobs in the printer’s queue. To solve this problem, some computer scientists wrote a software program that alerted every user in the backed up queue “The printer is jammed, please fix it.” When a man named Richard Stallmen was refused a copy of the program code, he resolved to create a publicly available operating system and the open source movement was born (opensource.com).
Over 50 years later, open source has become a coding philosophy practiced by millions of software engineers around the world. Why is open source so popular? What difference has it really made in software engineering, and what major projects are open source? In this episode we talk to William Morgan, CEO at Buoyant and creator of the open source service mesh Linkerd.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Publishing Open Source Code with William Morgan appeared first on Software Engineering Daily.
Google uses automated programs called spiders, or crawlers, to index and rank web pages. Then, when a user searches for something, it uses a special algorithm to determine the order of results to display (howstuffworks). This process, of course, applies to web pages on the internet.
There are 2 major projects, worked on by the company Edge & Node, that do what Google does for the web, but for the blockchain. The first is called The Graph, which is an indexing protocol for organizing blockchain data and making it easily accessible. The second is Everest, a universally shared projects registry of onchain data.
In this episode we talk to Nader Dabit, Developer Relations Engineer at Edge & Node.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Cloud Blockchains: The Google of Blockchain with Nader Dabit appeared first on Software Engineering Daily.
Application security is usually done with a set of tools and services known as SIEM – Security Information and Event Management. SIEM tools usually try to provide visibility into an organization’s security systems, as well as event log management and security event notifications.
The company Panther takes traditional SIEM security a step further. Panther processes and retains all of your security data with cloud-first workflows, identifies and alerts in real-time suspicious activity, enables building a high-fidelity alerting pipeline with Python, version control, unit tests, and CI/CD, and provides a security data lake where raw logs are structured for security at scale.
In this episode we talk with Jack Naglieri, Founder and CEO at Panther Labs.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Panther: Security as Code with Jack Naglieri appeared first on Software Engineering Daily.
“In October 1958, Physicist William Higinbotham created what is thought to be the first video game. It was a very simple tennis game, similar to the classic 1970s video game Pong, and it was quite a hit at a Brookhaven National Laboratory open house” (aps.org). 63 years have passed, and video games are prolific.
The company Pragma provides a backend game engine that enables developers to create multiplayer and social games. Pragma’s features are divided into three broad categories: cross platform accounts to connect players, Game Loop, which is lobby, matchmaking, game allocation, and end of match processing, and storing, saving, and updating accounts, inventory, progression, and related data.
In this episode we talk with Eden Chen, CEO and Co-Founder of Pragma.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Pragma: Video Games with Eden Chen appeared first on Software Engineering Daily.
Time series data are simply measurements or events that are tracked, monitored, downsampled, and aggregated over time. This could be server metrics, application performance monitoring, network data, sensor data, events, clicks, trades in a market, and many other types of analytics data (influxdata.com).
The platform InfluxData is designed for building and operating time series applications. InfluxData is engineered for growth with enterprise-grade security, ingests metrics, events and logs in a high-performing time series database, and platform analytics for detecting and resolving problems.
In this episode we talk to Russ Savage, Director of Product Management at InfluxData.
Full disclosure: InfluxData is a sponsor of Software Engineering Daily.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post InfluxData: Time-Series Data with Russ Savage appeared first on Software Engineering Daily.
At a customer service center, thousands of hours of audio are generated. This audio provides a wealth of information to transcribe and analyze. With the additional data of the most successful customer service representatives, machine learning models can be trained to identify which speech patterns are associated with a successful worker. By identifying these speaking
Originally published July 6, 2017. We are taking a few weeks off. We’ll be back soon with new episodes. React Native allows developers to reuse components from one user interface on multiple platforms. React Native was introduced by Facebook to reduce the pain of teams who were rewriting their user interfaces for web, iOS, and
Originally published October 8, 2019. We are taking a few weeks off. We’ll be back soon with new episodes. Video surveillance impacts human lives every day. On most days, we do not feel the impact of video surveillance. But the effects of video surveillance have tremendous potential. It can be used to solve crimes and
Originally published July 25, 2019. We are taking a few weeks off. We’ll be back soon with new episodes. Envoy is an open source edge and service proxy that was originally developed at Lyft. Envoy is often deployed as a sidecar application that runs alongside a service and helps that service by providing features such
Originally published May 2, 2017. We are taking a few weeks off. We’ll be back soon with new episodes. A new programmer learns to build applications using data structures like a queue, a cache, or a database. Modern cloud applications are built using more sophisticated tools like Redis, Kafka, or Amazon S3. These tools do
Originally published December 20, 2019. We are taking a few weeks off. We’ll be back soon with new episodes. freeCodeCamp was started five years ago with the goal of providing free coding education to anyone on the Internet. freeCodeCamp has become the best place to begin learning how to write software. There are many other
Originally published April 14, 2017. We are taking a few weeks off. We’ll be back soon with new episodes. Facebook’s open source projects include React, GraphQL, and Cassandra. These projects are key pieces of infrastructure used by thousands of developers–including engineers at Facebook itself. These projects are able to gain traction because Facebook takes time
Originally published October 24, 2019. We are taking a few weeks off. We’ll be back soon with new episodes. Redis is an in-memory database that persists to disk. Redis is commonly used as an object cache for web applications. Applications are composed of caches and databases. A cache typically stores the data in memory, and
Originally published November 21, 2019. We are taking a few weeks off. We’ll be back soon with new episodes. HTTP is a protocol that allows browsers and web applications to communicate across the Internet. Everyone knows that HTTP is doing some important work, because “HTTP” is at the beginning of most URLs that you enter
Originally published June 13, 2019. We are taking a few weeks off. We’ll be back soon with new episodes. Machine learning allows software to improve as that software consumes more data. Machine learning is a tool that every software engineer wants to be able to use. Because machine learning is so broadly applicable, software companies
Originally published January 31, 2019. We are taking a few weeks off. We’ll be back soon with new episodes. Artificial intelligence is reshaping every aspect of our lives, from transportation to agriculture to dating. Someday, we may even create a superintelligence–a computer system that is demonstrably smarter than humans. But there is widespread disagreement on
Cruise is an autonomous car company with a development cycle that is highly dependent on testing its cars–both in the wild and in simulation. The testing cycle typically requires cars to drive around gathering data, and that data to subsequently be integrated into a simulated system called Matrix. With COVID-19, the ability to run tests
Grafana is an open source visualization and monitoring tool that is used for creating dashboards and charting time series data. Grafana is used by thousands of companies to monitor their infrastructure. It is a popular component in monitoring stacks, and is often used together with Prometheus, ElasticSearch, MySQL, and other data sources. The engineering complexities
Apache Airflow was released in 2015, introducing the first popular open source solution to data pipeline orchestration. Since that time, Airflow has been widely adopted for dependency-based data workflows. A developer might orchestrate a pipeline with hundreds of tasks, with dependencies between jobs in Spark, Hadoop, and Snowflake. Since Airflow’s creation, it has powered the
The life cycle of data management includes data cleaning, extraction, integration, analysis and exploration, and machine learning models. It would be great if all of this data management could be handled with automation, but unfortunately that is not an option. For most applications, data management requires a human in the loop. A human in the
Kubernetes continues to mature as a platform for infrastructure management. At this point, many companies have well-developed workflows and deployment patterns for working with applications built on Kubernetes. The complexity of some of these deployments may be daunting, and when a new employee joins a company, that employee needs to get quickly onboarded with the
Uber needs to visualize data on a range of different surfaces. A smartphone user sees cars moving around on a map as they wait for their ride to arrive. Data scientists and operations researchers within Uber study the renderings of traffic moving throughout a city. Data visualization is core to Uber, and the company has
A frontend developer issuing a query to a backend server typically requires the developer to issue that query through an ORM or a raw database query. Prisma is an alternative to both of these data access patterns, allowing for easier database access through auto-generated, type-safe query building tailored to an existing database schema. By integrating
Machine learning workflows have had a problem for a long time: taking a model from the prototyping step and putting it into production is not an easy task. A data scientist who is developing a model is often working with different tools, or a smaller data set, or different hardware than the environment which that
Many data sources produce new data points at a very high rate. With so much data, the issue of data quality emerges. Low quality data can degrade the accuracy of machine learning models that are built around those data sources. Ideally, we would have completely clean data sources, but that’s not very realistic. One alternative
Server infrastructure traditionally consists of monolithic servers containing all of the necessary hardware to run a computer. These different hardware components are located next to each other, and do not need to communicate over a network boundary to connect the CPU and memory. LegoOS is a model for disaggregated, network-attached hardware. LegoOS disseminates the traditional
Kubernetes has become a highly usable platform for deploying and managing distributed systems. The user experience for Kubernetes is great, but is still not as simple as a full-on serverless implementation–at least, that has been a long-held assumption. Why would you manage your own infrastructure, even if it is Kubernetes? Why not use autoscaling Lambda
Every software company is a distributed system, and distributed systems fail in unexpected ways. This ever-present tendency for systems to fail has led to the rise of failure testing, otherwise known as chaos engineering. Chaos engineering involves the deliberate failure of subsystems within an overall system to ensure that the system itself can be resilient
Brex is a credit card company that provides credit to startups, mostly companies which have raised money. Brex processes millions of transactions, and uses the data from those transactions to assess creditworthiness, prevent fraud, and surface insights for the users of their cards. Brex is full of interesting engineering problems. The high volume of transactions
Devices on the edge are becoming more useful with improvements in the machine learning ecosystem. TensorFlow Lite allows machine learning models to run on microcontrollers and other devices with only kilobytes of memory. Microcontrollers are very low-cost, tiny computational devices. They are cheap, and they are everywhere. The low-energy embedded systems community and the machine
For the last five months, we have been working on a new version of Software Daily, the platform we built to host and present our content. We are creating a platform that integrates the podcast with a set of other features that make it easier to learn from the audio interviews. Software Daily includes the
Over the last 5 years, web development has matured considerably. React has become a standard for frontend component development. GraphQL has seen massive growth in adoption as a data fetching middleware layer. The hosting platforms have expanded beyond AWS and Heroku, to newer environments like Netlify and Vercel. These changes are collectively known as the
Geospatial analytics tools are used to render visualizations for a vast array of applications. Data sources such as satellites and cellular data can gather location data, and that data can be superimposed over a map. A map-based visualization can allow the end user to make decisions based on what they see. ArcGIS is one of
Customer data infrastructure is a type of tool for saving analytics and information about your customers. The company that is best known in this category is Segment, a very popular API company. This customer data is used for making all kinds of decisions around product roadmap, pricing, and design. RudderStack is a company built around
Matterport is a company that builds 3-D imaging for the inside of buildings, construction sites, and other locations that require a “digital twin.” Generating digital images of the insides of buildings has a broad spectrum of applications, and there are considerable engineering challenges in building such a system. Matterport’s hardware stack involves a camera built
There are many bad recipe web sites. Every time I navigate to a recipe website, it feels like my browser is filling up with spyware. The page loads slowly, everything seems broken, I can feel the 25 different JavaScript adtech tags interrupting each other. Whether I am searching for banana bread or a spaghetti sauce
Amazon’s virtual server instances have come a long way since the early days of EC2. There are now a wide variety of available configuration options for spinning up an EC2 instance, which can be chosen from based on the workload that will be scheduled onto a virtual machine. There are also Fargate containers and AWS
A credit score is a rating that allows someone to qualify for a line of credit, which could be a loan such as a mortgage, or a credit card. We are assigned a credit score based on a credit history, which could be related to work history, rental payments, or loan repayments. One problem with
A large software company such as Dropbox is at a constant risk of security breaches. These security breaches can take the form of social engineering attacks, network breaches, and other malicious adversarial behavior. This behavior can be surfaced by analyzing collections of log data. Log-based threat response is not a new technique. But how should
Infrastructure-as-code tools are used to define the architecture of software systems. Common infrastructure-as-code tools include Terraform and AWS CloudFormation. When infrastructure is defined as code, we can use static analysis tools to analyze that code for configuration mistakes, just as we could analyze a programming language with traditional static analysis tools. When a developer writes
Social distancing has been imposed across the United States. We are running an experiment unlike anything before it in history, and it is likely to have a lasting impact on human behavior. By looking at location data of how people are moving around today, we can examine the real-world impacts of social distancing. SafeGraph is
Dropbox is a consumer storage product with petabytes of data. Dropbox was originally started on the cloud, backed by S3. Once there was a high enough volume of data, Dropbox created its own data centers, designing hardware for the express purpose of storing user files. Over the last 13 years, Dropbox’s infrastructure has developed hardware,
“Data stream” is a word that can be used in multiple ways. A stream can refer to data in motion or data at rest. When a stream is data in motion, an endpoint is receiving new pieces of data on a continual basis. Each new data point is sent over the wire and captured by
Redis is an in-memory object storage system that is commonly used as a cache for web applications. This core primitive of in-memory object storage has created a larger ecosystem encompassing a broad set of tools. Redis is also used for creating objects such as queues, streams, and probabilistic data structures. Machine learning systems also need
For many applications, a transactional MySQL database is the source of truth. To make a MySQL database scale, some developers deploy their database using Vitess, a sharding system built on top of Kubernetes. Jiten Vaidya and Anthony Yeh work at PlanetScale, a company that focuses on building and supporting MySQL databases sharded with Vitess. Their
We are all living in social isolation due to the quarantine from COVID-19. Isolation is changing our habits and our moods, ravaging the economy, and changing how we work. One positive change is that more people have been reconnecting with their friends and family over frequent calls and video chats. Isolation is not a normal
A data warehouse is a system for performing fast queries on large amounts of data. A data lake is a system for storing high volumes of data in a format that is slow to access. A typical workflow for a data engineer is to pull data sets from this slow data lake storage into the
A content management system (CMS) defines how the content on a website is arranged and presented. The most widely used CMS is WordPress, the open source tool that is written in PHP. A large percentage of the web consists of WordPress sites, and WordPress has a huge ecosystem of plugins and templates. Despite the success
A data workflow scheduler is a tool used for connecting multiple systems together in order to build pipelines for processing data. A data pipeline might include a Hadoop task for ETL, a Spark task for stream processing, and a TensorFlow task to train a machine learning model. The workflow scheduler manages the tasks in that
A relational database often holds critical operational data for a company, including user names and financial information. Since this data is so important, a relational database must be architected to avoid data loss. Relational databases need to be a distributed system in order to provide the fault tolerance necessary for production use cases. If a
Python is the most widely used language for data science, and there are several libraries that are commonly used by Python data scientists including Numpy, Pandas, and scikit-learn. These libraries improve the user experience of a Python data scientist by giving them access to high level APIs. Data science is often performed over huge datasets,
Chatbots became widely popular around 2016 with the growth of chat platforms like Slack and voice interfaces such as Amazon Alexa. As chatbots came into use, so did the infrastructure that enabled chatbots. NLP APIs and complete chatbot frameworks came out to make it easier for people to build chatbots. The first suite of chatbot
Serverless computing is a way of designing applications that do not directly address or deploy application code to servers. Serverless applications are composed of stateless functions-as-a-service and stateful data storage systems such as Redis or DynamoDB. Serverless applications allow for scaling up and down the entire architecture, because each component is naturally scalable. And this
NGINX is a web server that can be used to manage the APIs across an organization. Managing these APIs involves deciding on the routing and load balancing across the servers which host them. If the traffic of a website suddenly spikes, the website needs to spin up new replica servers and update the API gateway
Web development has historically had more work being done on the server than on the client. The observability tooling has reflected this emphasis on the backend. Monitoring tools for log management and backend metrics have existed for decades, helping developers debug their server infrastructure. Today, web frontends have more work to do. Detailed components in
Zoom video chat has become an indispensable part of our lives. In a crowded market of video conferencing apps, Zoom managed to build a product that performs better than the competition, scaling with high quality to hundreds of meeting participants, and millions of concurrent users. Zoom’s rapid growth in user adoption came from its focus
Facebook applications use maps for showing users where to go. These maps can display businesses, roads, and event locations. Understanding the geographical world is also important for performing search queries that take into account a user’s location. For all of these different purposes, Facebook needs up-to-date, reliable mapping data. OpenStreetMap is an open system for
NGINX is a web server that is used as a load balancer, an API gateway, a reverse proxy, and other purposes. Core application servers such as Ruby on Rails are often supported by NGINX, which handles routing the user requests between the different application server instances. This model of routing and load balancing between different
Shopify is a platform for selling products and building a business. It is a large e-commerce company with hundreds of engineers and several different mobile apps. Shopify’s engineering culture is willing to adopt new technologies aggressively, trying new tools that might provide significant leverage to the organization. React Native is one of those technologies. React
Ceph is a storage system that can be used for provisioning object storage, block storage, and file storage. These storage primitives can be used as the underlying medium for databases, queueing systems, and bucket storage. Ceph is used in circumstances where the developer may not want to use public cloud resources like Amazon S3. As
Data analysts need to collaborate with each other in the same way that software engineers do. They also need a high quality development environment. These data analysts are not working with programming languages like Java and Python, so they are not using an IDE such as Eclipse. Data analysts predominantly use SQL, and the tooling
When a developer spins up a virtual machine on AWS, that virtual machine could be purchased using one of several types of cost structures. These cost structures include on-demand instances, spot instances, and reserved instances. On-demand instances are often the most expensive, because the developer gets reliable VM infrastructure without committing to long-term pricing. Spot
Machine learning models require the use of training data, and that data needs to be labeled. Today, we have high quality data infrastructure tools such as TensorFlow, but we don’t have large high quality data sets. For many applications, the state of the art is to manually label training examples and feed them into the
A workflow is an application that involves more than just a simple request/response communication. For example, consider a session of a user taking a ride in an Uber. The user initiates the ride, and the ride might last for an hour. At the end of the ride, the user is charged for the ride and
Kafka is a distributed stream processing system that is commonly used for storing large volumes of append-only event data. Kafka has been open source for almost a decade, and as the project has matured, it has been used for new kinds of applications. Kafka’s pubsub interface for writing and reading topics is not ideal for
Building a game is not easy. The development team needs to figure out a unique design and gameplay mechanics that will attract players. There is a great deal of creative work that goes into making a game successful, and these games are often built with low budgets by people who are driven by the art
V8 is the JavaScript engine that runs Chrome. Every popular website makes heavy use of JavaScript, and V8 manages the execution environment of that code. The code that processes in your browser can run faster or slower depending on how “hot” the codepath is. If a certain line of code is executed frequently, that code
Serverless tools have come a long way since the release of AWS Lambda in 2014. Serverless apps were originally architected around Lambda, with the functions-as-a-service being used to glue together larger pieces of functionality and API services. Today, many of the common AWS services such as API Gateway and DynamoDB have functionality built in to
Cortico is a non-profit that builds audio tools to improve public dialogue. Allison King is an engineer at Cortico, and she joins the show to talk about the process of building audio applications. One of these applications was a system for ingesting radio streams, transcribing the radio, and looking for duplicate information across the different
Facebook Messenger is a chat application that millions of people use every day to talk to each other. Over time, Messenger has grown to include group chats, video chats, animations, facial filters, stories, and many more features. Messenger is a tool for utility as well as for entertainment. Messenger is used both on mobile and
Modern web development involves a complicated toolchain for managing dependencies. One part of this toolchain is the bundler, a tool that puts all your code and dependencies together into static asset files. The most popular bundler is webpack, which was originally released in 2012, before browsers widely supported ES Modules. Today, every major browser supports
Food delivery apps have changed how the restaurant world operates. After seven years of mobile food delivery, the volume of food ordered through these apps has become so large that entire restaurants can be sustained solely through the order flow that comes in from the apps. This raises the question as to why you even
Remote engineering work makes some elements of software development harder, and some elements easier. With Slack and email, communication becomes more clear cut. Project management tools lay out the responsibilities and deliverables of each person. GitHub centralizes and defines the roles of developers. On the other hand, remote work subtracts the role of nuanced conversation.
Programming languages are dynamically typed or statically typed. In a dynamically typed language, the programmer does not need to declare if a variable is an integer, string, or other type. In a statically typed language, the developer must declare the type of the variable upfront, so that the compiler can take advantage of that information.
Datomic is a database system based on an append-only record keeping system. Datomic users can query the complete history of the database, and Datomic has ACID transactional support. The data within Datomic is stored in an underlying database system such as Cassandra or Postgres. The database is written in Clojure, and was co-authored by the
A large cloud provider has high volumes of network traffic moving through data centers throughout the world. These providers manage the infrastructure for thousands of companies, across racks and racks of multitenant servers, and cables that stretch underseas, connecting network packets with their destination. Google Cloud Platform has grown steadily into a wide range of
Over the last fifteen years, there has been a massive increase in the number of new software tools. This is true at the infrastructure layer: there are more databases, more cloud providers, and more open-source projects. And it’s also true at a higher level: there are more APIs, project management systems, and productivity tools. ClickUp
Infrastructure-as-code allows developers to use programming languages to define the architecture of their software deployments, including servers, load balancers, and databases. There have been several generations of infrastructure-as-code tools. Systems such as Chef, Puppet, Salt, and Ansible provided a domain-specific imperative scripting language that became popular along with the early growth of Amazon Web Services.
Software investing requires a deep understanding of the market, and an ability to predict what changes might occur in the near future. At the level of core infrastructure, software investing is particularly difficult. Databases, virtualization, and large scale data processing tools are all complicated, highly competitive areas. As the software world has matured, it has
A high volume of data can contain a high volume of useful information. That fact is well understood by the software world. Unfortunately, it is not a simple process to surface useful information from this high volume of data. A human analyst needs to understand the business, formulate a question, and determine what metrics could
Physical places have a large amount of latent data. Pick any location on a map, and think about all of the questions you could ask about that location. What businesses are at that location? How many cars pass through it? What is the soil composition? How much is the land on that location worth? The
Descript is a software product for editing podcasts and video. Descript is a deceptively powerful tool, and its software architecture includes novel usage of transcription APIs, text-to-speech, speech-to-text, and other domain-specific machine learning applications. Some of the most popular podcasts and YouTube channels use Descript as their editing tool because it provides a set of
Lyft is a ridesharing company that generates a high volume of data every day. This data includes ride history, pricing information, mapping, routing, and financial transactions. The data is stored across a variety of different databases, data lakes, and queueing systems, and is processed at scale in order to generate machine learning models, reports, and
Cloud computing caused a fundamental economic shift in how software is built. Before the cloud, businesses needed to buy physical servers in order to operate. There was an up-front cost that often amounted to tens of thousands of dollars required to pay for these servers. Cloud computing changed the up-front capital expense to an ongoing
GraphQL is a system that allows frontend engineers to make requests across multiple data sources using a simple query format. In GraphQL, a frontend developer does not have to worry about the request logic for individual backend services. The frontend developer only needs to know how to issue GraphQL requests from the client, and these
ReactJS developers have lots of options for building their applications, and those options are not easy to work through. State management, concurrency, networking, and testing all have elements of complexity and a wide range of available tools. Take a look at any specific area of JavaScript application development, and you can find highly varied opinions.
JavaScript fatigue. This phrase has been used to describe the confusion and exhaustion around the volume of different tools required to be productive as a JavaScript developer. Frameworks, package managers, typing systems, state management, GraphQL, and deployment systems–there are so many decisions to make. In addition to the present-day tooling choices, a JavaScript developer needs
Full-stack JavaScript applications have been possible since the creation of NodeJS in 2009. Since then, the best practices for building and deploying these applications have steadily evolved with the technology. ReactJS created consolidation around the view layer. The emergence of AWS Lambda created a new paradigm for backend execution. Serverless tools such as DynamoDB offer
When ReactJS became popular, frontend web development became easier. But React is just a view layer. Developers who came to React expecting a full web development framework like Ruby on Rails or Django were required to put together a set of tools to satisfy that purpose. A full-stack JavaScript framework has numerous requirements. How does
Slack is a messaging application with millions of users. The desktop application is an Electron app, which is effectively a web browser dedicated to running Slack. This frontend is built with ReactJS and other JavaScript code, and the application is incredibly smooth and reliable, despite its complexity. When a user boots up Slack, the application
Every company has a large number of routine data workflows. These data workflows involve spreadsheets, CSV files, and tedious manual work to be done by a knowledge worker. For example, data might need to be taken from Salesforce, filtered for new customers, and piped into Mailchimp. Or perhaps you need to sort all your customers
Cryptocurrencies today serve two purposes: store of value and speculation. The application infrastructure that has been built around cryptocurrency is mostly to support these use cases. At some point in the future, perhaps cryptocurrencies can be used as a global medium of exchange that is accepted at the grocery store. Perhaps we will use the
At Airbnb, infrastructure management is standardized across the organization. Platform engineering teams build tools that allow the other teams throughout the organization to work more effectively. A platform engineering team handles problems such as continuous integration, observability, and service discovery. Other teams throughout a company use the tools that a platform engineering team builds. For
A gig economy application generates lots of notifications. There is SMS, mobile phone updates, emails, and native application updates. If you order a ride from Uber, you might receive a text message and a push notification at the same time. If an app overloads the user with notifications, the user might end up annoyed and
In a modern data platform, distributed streaming systems are used to read data coming off of an application in real-time. There are a wide variety of streaming systems, including Kafka Streams, Apache Samza, Apache Flink, Spark Streaming, and more. When Eric Anderson joined the show back in 2016, he was working at Google on Google
Distributed stream processing frameworks are used to rapidly ingest and aggregate large volumes of incoming data. These frameworks often require the application developer to write imperative logic describing how that data should be processed. For example, a high volume of clickstream data that is getting buffered to Kafka needs to have a stream processing system
A cloud provider gives developers access to virtualized server infrastructure. When a developer rents this infrastructure via an API call, a virtual server is instantiated on physical machines. That virtual server needs to be made addressable through the allocation of an IP address to make it reachable from the open Internet. When the virtual server
A data pipeline is a series of steps that takes large data sets and creates usable results from them. At the beginning of a data pipeline, a data set might be pulled from a database, a distributed file system, or a Kafka topic. Throughout a data pipeline, different data sets are joined, filtered, and statistically
A data warehouse provides low latency access to large volumes of data. A data warehouse is a crucial piece of infrastructure for a large company, because it can be used to answer complex questions involving a large number of data points. But a data warehouse usually cannot hold all of a company’s data at any
Machine learning applications are widely deployed across the software industry. Most of these applications used supervised learning, a process in which labeled data sets are used to find correlations between the labels and the trends in that underlying data. But supervised learning is only one application of machine learning. Another broad set of machine learning
Distributed stream processing systems are used to read large volumes of data and perform operations across those data streams. These stream processing systems often build off of the MapReduce algorithm for collecting and aggregating large volumes of data, but instead of processing a calculation over a single large batch of data, they process data on
Large companies generate large volumes of data. This data gets dumped into a data lake for long-term storage, then pulled into memory for processing and analysis. Once it is in memory, it is often read into a dashboard, which presents a human with a visualization of the data. The end-user who is consuming this data