How to debug code with GitHub Copilot đź’»

🦾Plus: 🎬 Alibaba’s advanced AI video suite

Hey folks! Let’s get into Big Data and AI craziness…

In today's edition: What's Shaping the Future of Data?

  • ⚡Fast columnar JSON decoding with arrow-rs

  • 🔧 Google’s free AI coding assistant

  • 🔍How Core Git Developers Configure Git

  • 🤖Big Data Management with Advanced AI

  • 🎬 Alibaba’s advanced AI video suite

  • 🕹️ Claude plays Pokemon Red live on Twitch

  • 🧠 DeepSeek is rushing to get its next-gen R2 model

  • đź’ˇ AI Tutorial: How to talk to your apps with Concierge AI

  • 🤖 AI Tools and Data Tools to checkout

A lot of data pipelines spend the bulk of their CPU time deserializing JSON. If you want to build a fast stream processing engine, you need to start with a fast JSON deserialization strategy. This post is aimed at helping developers gain some intuition for how to work with columnar data, something many engineers find challenging and unfamiliar with in our typically row-oriented world. It covers batched decoding, column building, streaming extensions, and more.

Google just launched a free version of Gemini Code Assist for individual developers, offering access to advanced AI-powered coding help with usage limits that dwarf competitors like GitHub Copilot. The new tool provides up to 180,000 monthly code completions — 90 times more than GitHub Copilot's free tier limit of 2,000.

This post looks at the settings in git defaults that even the core developers change. In this post, I’ll go through some of the perhaps obscure Git config settings that I have personally globally enabled and go into them to explain what they do and why they should probably be the default settings.

From social media interactions to sensor data from IoT devices, organizations are inundated with vast amounts of information. But how can businesses turn this uncontrolled influx into valuable insights? The answer lies in advanced AI development techniques that are revolutionizing big data management.

Debugging is an essential part of a developer’s workflow—but it’s also one of the most time consuming. What if AI could streamline the process, helping you analyze, fix, and document code faster? Enter GitHub Copilot, your AI-powered coding assistant.

👨‍💻 Data Tools, Libraries

QuickFunctions
Compete to write the fastest function implementations!

gpu.cpp
A lightweight library for portable low-level GPU computation using WebGPU. 

Mazeppa
A modern supercompiler for call-by-value functional languages.

AI News:

An entirely new way to present ideas

Gamma’s AI creates beautiful presentations, websites, and more. No design or coding skills required. Try it free today.

Alibaba's Tongyi Lab just released Wan2.1, an open-source suite of powerful video generation models that outperform SOTA open-source and closed models such as Sora on key benchmarks — while generating videos at 2.5x the speed.

Anthropic just debuted "Claude Plays Pokémon" on Twitch, a continuation of the company’s research showcasing their new AI model Claude 3.7 Sonnet attempting to navigate the classic Game Boy game Pokémon Red in real-time.

AI creates bizarre but superior wireless chips with designs that leave engineers puzzled. Princeton researchers used AI to design complex wireless chips in hours instead of weeks. The results outperformed human designs, but look completely alien.

DeepSeek is looking to maintain the momentum gained by the debut of its R1 reasoning model by rushing its new R2 model to market as quickly as possible. It first planned to launch R2 in early May, but it now wants to move the release date forward. The model will likely have improved coding skills and be able to reason in languages other than English.

AI Tutorial

⚡ How to talk to your apps with Concierge AI

Concierge is the first connected AI Assistant that can read and write to your favorite software tools, by finding and updating information across all your apps in real-time.

Step-by-step:

  1. Create a Concierge account here to get started for free.

  2. Click "Connect" and choose the tools you use — Gmail, Slack, Jira, Notion, HubSpot, or something else.

  3. Type requests like "summarize my unread emails", “create a Jira ticket based on feedback in Slack" or “research these prospects from Salesforce.”

  4. Watch as your AI assistant instantly finds information and takes action across your connected apps.

🔥Top AI tools to increase productivity: 

  1. SheetMagic: Elevate Google Sheets with AI-driven content and web scraping.

  2. StartKit.AI is a boilerplate designed to speed up the development of AI projects.

  3. CollaborativeAI - Build custom self-hosted AI assistants using the latest models like GPT-4, GPT-3.5, Claude and Gemini.

  4. Clarity AI is a state-of-the-art AI Image Upscaler & Enhancer that supports upscaling from 64px to 37 megapixels

  5. Eazl.ai represents a paradigm shift in the way professionals approach their work.

  6. BrickCenter can automatically generate Lego designs from your ideas.

  7. Law Blocks is a legal tech ecosystem, offering secure, accessible and affordable legal solutions with the help of AI

View our database of all the best AI tools for your needs: aitoolsup.com

Have cool resources to share? Submit AI tool

A.I. Generated Image of the Day

đź‘€ Dark fantasy

AI Tools Up NewsletterReceive a weekly email with updates on new AI tools, helpful prompts, and the latest AI developments. Join over 10000 + professionals from Google, OpenAI, Notion, Apple, and more.

SPONSOR US

Get your product in front of Big Data & AI enthusiasts

Our newsletter is read by thousands of tech professionals, investors, engineers, managers, and business owners around the world.

Interested in Sponsoring the Big Data News Weekly Newsletter?Get in touch today

What did you think of today's email?

Your feedback helps me create better emails for you!

Login or Subscribe to participate in polls.