📈 Dremel-Interactive SQL Analysis

🦾Plus: 🔬 Anthropic reveals how Claude ‘thinks’,💰 OpenAI's $40B Funding

In partnership with

Hey folks! Let’s get into Big Data and AI craziness…

In today's edition: What's Shaping the Future of Data?

  • 📊Postgres with Iceberg for High Performance Analytics

  • ⚡Efficient Filter Pushdown in Parquet

  • 🔗Confluent Cloud for Apache Flink - Exploring the API

  • 👁️ Qwen’s QVQ-Max visual reasoning model

  • 💰 OpenAI Close to Finalizing $40B Funding

  • 👥Meta debuts Friends tab

  • 💡 AI Tutorial:Create interactive mind maps in seconds with NotebookLM

  • 🤖 AI Tools and Data Tools to checkout

PostgreSQL is the bedrock on which many of today’s organizations are built. The versatility, reliability, performance, and extensibility of PostgreSQL make it the perfect tool for a large variety of operational workloads.

Instead of trying to predict which party will win, and where to invest afterwards, why not invest in an ‘election-proof’ alternative asset? The sector is currently in a softer cycle, but over the last seven elections (1995-2023) blue-chip contemporary art has outpaced the S&P 500 by 64% even despite the recent dip, regardless of the victors, and we have conviction it will rebound to these levels long-term.

Now, thanks to Masterworks’ art investing platform, you can easily diversify into this asset class without needing millions or art expertise, alongside 65,000+ other art investors. From their 23 exits so far, Masterworks investors have realized representative annualized net returns like +17.6%, +17.8%, and +21.5% (among assets held longer than one year), even despite a recent dip in the art market.*

In today’s data-driven world, databases play a crucial role in storing, managing, and retrieving vast amounts of information. As organizations continue to generate and rely on data for decision-making, the need for a robust data management strategy becomes increasingly important. A unified data management strategy ensures that data is accurate, accessible, and secure across the organization.

How to implement efficient filter pushdown in Parquet readers and why it’s challenging in practice…In the previous post, we discussed how DataFusion prunes Parquet files to skip irrelevant files/row_groups (sometimes also pages). This post discusses how Parquet readers skip irrelevant rows while scanning data…

Google’s Dremel was one of the first systems that combined a set of architectural principles that have become a common practice in today’s cloud-native analytics tools, including disaggregated storage and compute, in situ analysis, and columnar storage for semistructured data…In this paper, we discuss how these ideas evolved in the past decade and became the foundation for Google BigQuery…

The end-to-end encrypted password manager that's taking on the Big Tech companies that sell your data. Sign up for today to Proton Pass and save, store, and autofill passwords without compromising on your online security.

Confluent Cloud for Apache Flink gives you access to run Flink workloads using a serverless platform on Confluent Cloud. After poking around the Confluent Cloud API for configuring connectors I wanted to take a look at the same for Flink. Using the API is useful particularly if you want to script a deployment, or automate a bulk operation that might be tiresome to do otherwise. It’s also handy if you just prefer living in the CLI :)

The first search engine for leads

Leadsforge is the very first search engine for leads. With a chat-like, easy interface, getting new leads is as easy as texting a friend! Just describe your ideal customer in the chat - industry, role, location, or other specific criteria - and our AI-powered search engine will instantly find and verify the best leads for you. No more guesswork, just results. Your lead lists will be ready in minutes!

👨‍💻 Data Tools, Libraries

Map of GitHub (Website)

This site contains a map of more than 400,000 GitHub projects clustered into 1,100 'countries' of technologies.

OpenAuth (GitHub Repo)

OpenAuth is a standards-based auth provider for web apps, mobile apps, single-page apps, APIs, or third-party clients currently in beta. It can be deployed as a standalone service or embedded into existing applications.

AI News:

OpenAI is reportedly finalizing a massive $40B funding round led by SoftBank, which would make it the largest private funding in history — and nearly double the ChatGPT maker's valuation to $300B. SoftBank will invest an initial $7.5B, followed by another $22.5B later this year with other investors including Magnetar Capital, Coatue, and Founders Fund.

Unlock the potential of your growing small business with HubSpot's Starter Customer Platform. For a discounted price of just $20/month, unlock access to the Starter edition of HubSpot’s six core products for marketing, sales, and customer service – powered by HubSpot’s Smart CRM – all for the price of one. Built for businesses like yours, HubSpot Starter has all the essential tools you need to scale.

Click here to claim your small business bundle and start growing your business today!

Alibaba's Qwen team released QVQ-Max, a new visual reasoning model that goes beyond basic image recognition to analyze and reason about visual information across images and videos.

Anthropic released two research papers that reveal how its AI assistant Claude processes information, helping to better understand internal mechanisms that explain capabilities like multilingual reasoning and advanced planning. The researchers developed an "AI microscope" that reveals internal “circuits” in the model, showing how Claude transforms input to output in key tasks.

Microsoft unveiled two innovative AI-powered agents, Researcher and Analyst, within Microsoft 365 Copilot. Researcher synthesizes your organization's internal information with external web and third-party data sources (like Salesforce or Confluence) to produce comprehensive strategies and reports.

Design a custom website with Squarespace's professionally curated layout and styling options designed to sell anything. Start with a flexible designer template or build your own, then customize to fit your style using our drag-and-drop website tool.

Meta has introduced a Friends tab on Facebook to revive the original spirit of the social networking app. The Facebook Friends tab is designed to show users the latest posts from their friends instead of recommended content. It is now available in the US and Canada - there is no word on when it will debut in other countries.

AI Tutorial

Create interactive mind maps in seconds with NotebookLM

Google has recently added interactive mind maps to NotebookLM, enhancing its ability to help users visually navigate complex information and better understand relationships between concepts in their documents.

  1. Go to NotebookLM website 

  2. Select "Create new" and add your sources—they can be PDFs, text, audio, copied text, website and YouTube links, Google Docs, etc. If you already created a notebook, just open it instead.

  3. Once you're in, select the "Mind Map" option.

  4. Open your mind map, and that's it! Explore and enjoy.

Celebrate the season by learning a new language with Babbel. Developed by over 150 expert linguists, Babbel’s premium platform is scientifically proven to help you learn faster. With award-winning lessons, immersive podcasts, addictive games, and their new AI Conversation Partner, you can start speaking a new language in as little as 3 weeks. Plus, Big Data News Weekly readers can get 55% off with this exclusive link.

🔥Top AI tools to increase productivity: 

  1. pre.dev accelerates idea to development.

  2. Trolly AI: Revolutionizing SEO Content Creation with Advanced AI Technology.

  3. 🎥 Videotok is the perfect tool if you want to create viral videos without wasting time editing

  4. Dialzara stands out as the go-to platform for businesses seeking to enhance client communication

  5. Sensey is a platform that enriches market and competitive data with AI.

  6. Robopic by StackForward LLC transforms your digital photography experience

  7. Augment Code - The first AI coding assistant built for professional software engineers and large codebases.

View our database of all the best AI tools for your needs: aitoolsup.com

Have cool resources to share? Submit AI tool

A.I. Generated Image of the Day

👀 Warrior Shriek

AI Tools Up NewsletterReceive a weekly email with updates on new AI tools, helpful prompts, and the latest AI developments. Join over 10000 + professionals from Google, OpenAI, Notion, Apple, and more.

SPONSOR US

Get your product in front of Big Data & AI enthusiasts

Our newsletter is read by thousands of tech professionals, investors, engineers, managers, and business owners around the world.

Interested in Sponsoring the Big Data News Weekly Newsletter?Get in touch today

What did you think of today's email?

Your feedback helps me create better emails for you!

Login or Subscribe to participate in polls.