🌐 Meta releases OpenEQA, open-source dataset

In today's edition:

• 🔍LedgerStore Supports Trillions of Indexes at Uber

• 🔄An introduction to Flow Matching

• 📊 Course in Exploratory Data Analysis

• 🚀 OpenAI Improves GPT-4 and is Back on Top

• 🍏 Apple Macs getting AI overhaul

• ⚡️ Meta unveils powerful new custom AI chip

• 🤖 AI Tools and Data Tools

• 🖼️ A.I. Generated Image of the Day

What Is a Vector Database?

With a vector database, you can quickly and accurately retrieve related data points. Given that the database can only provide approximation, we commonly have to sacrifice accuracy for speed. In other words, the slower the query processing the more accurate the results and vice versa.

Become an AI & ChatGPT Genius in just 3 hours for FREE!  (Early Easter Sale)

Join ChatGPT & AI Workshop (worth $199) at no cost (Offer valid for first 100 people only) 🎁

How LedgerStore Supports Trillions of Indexes at Uber

Uber's LedgerStore provides an immutable storage solution with verifiable data completeness and correctness guarantees to ensure data integrity for the billions of financial transactions processed on its platform. This post covers the significance of LedgerStore indexing and its architecture, which powers trillions of indexes, with a petabyte-scale index storage footprint.

Meta AI releases OpenEQA to spur ’embodied intelligence’ in artificial agents

Meta AI researchers today released OpenEQA, a new open-source benchmark dataset that aims to measure an artificial intelligence system’s capacity for “embodied question answering” — developing an understanding of the real world that allows it to answer natural language questions about an environment.

𝗪𝗵𝗮𝘁 𝗶𝘀 𝗧𝗲𝗿𝗿𝗮𝗳𝗼𝗿𝗺, 𝗮𝗻𝗱 𝗵𝗼𝘄 𝗱𝗼𝗲𝘀 𝗶𝘁 𝘄𝗼𝗿𝗸?

 Terraform is an open-source innovation from HashiCorp that is changing infrastructure management. It enables developers to use a 𝗵𝗶𝗴𝗵-𝗹𝗲𝘃𝗲𝗹 𝗰𝗼𝗻𝗳𝗶𝗴𝘂𝗿𝗮𝘁𝗶𝗼𝗻 𝗹𝗮𝗻𝗴𝘂𝗮𝗴𝗲 𝗳𝗼𝗿 𝗶𝗻𝗳𝗿𝗮𝘀𝘁𝗿𝘂𝗰𝘁𝘂𝗿𝗲 𝗺𝗮𝗻𝗮𝗴𝗲𝗺𝗲𝗻𝘁, paving the way for quicker, 𝗮𝘂𝘁𝗼𝗺𝗮𝘁𝗲𝗱 𝗱𝗲𝗽𝗹𝗼𝘆𝗺𝗲𝗻𝘁𝘀.

An introduction to Flow Matching

Flow matching (FM) is a recent generative modelling paradigm which has rapidly been gaining popularity in the deep probabilistic ML community. Flow matching combines aspects from Continuous Normalising Flows (CNFs) and Diffusion Models (DMs), alleviating key issues both methods have

A Course in Exploratory Data Analysis

This book contains the lecture notes for a course on Exploratory Data Analysis that I taught for many years at Bowling Green State University. I started teaching this course using John Tukey’s EDA book, but there were several issues.

𝗚𝗶𝘁𝗛𝘂𝗯 𝗥𝗲𝗽𝗼𝘀𝗶𝘁𝗼𝗿𝗶𝗲𝘀 𝘁𝗼 𝗔𝗰𝗰𝗲𝗹𝗲𝗿𝗮𝘁𝗲 𝗬𝗼𝘂𝗿 𝗟𝗲𝗮𝗿𝗻𝗶𝗻𝗴 𝗝𝗼𝘂𝗿𝗻𝗲𝘆 𝗶𝗻 𝟮𝟬𝟮𝟰 🧠🤖

Here is curated a list of Data Science, Machine Learning and Python GitHub repositories to boost your skills this year.

👨‍💻 Data Tools, Libraries 

LLocalSearch
LLocalSearch is a completely locally running search aggregator using LLM Agents. The user can ask a question and the system will use a chain of LLMs to find the answer. The user can see the progress of the agents and the final answer. No OpenAI or Google API keys are needed. 

ClangQL
ClangQL is a tool that allow you to run SQL-like query on C/C++ Code instead of database files using the GitQL SDK.

llm.c
LLM training in simple, raw C/CUDA.

unch
Hides message with invisible Unicode characters.

🤖 AI News:

🤗 TikTok’s Virtual Influencers

According to a report by The Verge, TikTok is developing an AI technology to generate virtual influencers that would appear in videos to promote and sell products for advertisers.

This could change how products are advertised on the site, but it's still being developed, and it's not clear yet if they'll be as effective as human influencers.

🚀 OpenAI Improves GPT-4 and is Back on Top

OpenAI has rolled out a new model named "gpt-4-turbo-2024-04-09," specially for its premium users. This updated ChatGPT aims to answer with more clarity and less fluff, making conversations quicker and easier to understand.

🍏 Apple Macs getting AI overhaul

Apple is reportedly gearing up to overhaul its entire lineup of Macs with an upcoming M4 chip family — which will place a heavy emphasis on AI capabilities.

🎶 Udio levels up AI music creation

A new AI-powered music creation app from former Google DeepMind researchers called Udio just launched with the backing of prominent tech and music industry figures.

⚡️ Meta unveils powerful new custom AI chip

Meta just released the next generation of its custom Meta Training and Inference Accelerator (MTIA) AI chip family, delivering significant improvements in compute performance and efficiency.

💡AI Learning

Top 11 AI tools to help you with job search and get your dream job.

💡 Optimize your resume, get insights on your interview answers, use it for negotiation and many more.

 🔥Top AI tools to increase productivity: 

1. pre.dev accelerates idea to development.

2. Trolly AI: Revolutionizing SEO Content Creation with Advanced AI Technology.

3. 🎥 Videotok is the perfect tool if you want to create viral videos without wasting time editing

4. 🖌️ ZMO.AI is a user-friendly AI art generator for creating stunning anime and images.

5. 🖼️ Gencraft is an AI-powered platform that allows users to generate art.

6. Looksmax AI analyzes your physical appearance, and shares AI-generated self-improvement tips

View our database of all the best AI tools for your needs: aitoolsup.com 

Have cool resources to share? Submit AI tool 

A.I. Generated Image of the Day

👀 Midjourney generated pics. (source)

SPONSOR US

Get your product in front of Big Data & AI enthusiasts

Our newsletter is read by thousands of tech professionals, investors, engineers, managers, and business owners around the world.

Interested in Sponsoring the Big Data News Weekly Newsletter? Get in touch today