- Big Data News Weekly
- Posts
- 🤖 Deploying ML/AI systems to production
🤖 Deploying ML/AI systems to production
🦾Plus: 🚀 Runway Gen-3 Alpha is now public
![](https://media.beehiiv.com/cdn-cgi/image/fit=scale-down,format=auto,onerror=redirect,quality=80/uploads/asset/file/cd8a47a1-4a29-40a8-bea9-b537fb564caf/f1136675-3b04-bb4f-17f3-71701da917d9.png?t=1702726252)
Hey folks! Let’s get into Big Data and AI craziness…
In today's edition:
🔍Profiling Big Datasets With Apache Spark and Deequ
📈How To Organize Continuous Delivery of ML/AI Systems
💾Introduction to Kafka Tiered Storage at Uber
🗣️ ElevenLabs launches ‘Iconic Voices’
🎨 Meta's AI Transforms Text into 3D Art
💡 AI Tutorial: Create talking photos with just a selfie
🤖 AI Tools and Data Tools to checkout
![](https://media.beehiiv.com/cdn-cgi/image/fit=scale-down,format=auto,onerror=redirect,quality=80/uploads/asset/file/2aaf386f-8f5c-4c83-a2ec-fd490ce86ec1/image.png?t=1720022829)
Data science is a field that revolves around gaining insights from data, both structured and unstructured. A data scientist uses mathematical, statistical, and other scientific methods and computer algorithms to analyze big data and extract knowledge from it.
![](https://media.beehiiv.com/cdn-cgi/image/fit=scale-down,format=auto,onerror=redirect,quality=80/uploads/asset/file/0dab3370-b06b-4f43-b88d-e4554b7bf9f5/image.png?t=1720022877)
In today's data-driven environment, mastering the profiling of large datasets with Apache Spark and Deequ is crucial for any professional dealing with data analysis, SEO optimization, or similar fields requiring a deep dive into digital content.
![](https://media.beehiiv.com/cdn-cgi/image/fit=scale-down,format=auto,onerror=redirect,quality=80/uploads/asset/file/748d6ed9-c99e-481d-b80e-a8f8f71d516c/image.png?t=1720024189)
This article outlines ten stages of operational maturity for deploying ML/AI systems to production. Which stage are you at? Every production-oriented ML/AI team grapples with the same challenge: how to work with data, code, and models effectively so that projects are readily deployable to production.
![](https://media.beehiiv.com/cdn-cgi/image/fit=scale-down,format=auto,onerror=redirect,quality=80/uploads/asset/file/eca9bb15-6b90-46f5-a030-342348afa8a3/image.png?t=1720024528)
Uber’s Data Pipeline
Apache Kafka® is the cornerstone of Uber’s tech stack. It plays an important role in powering several critical use cases and is the foundation for batch and real-time systems at Uber. Kafka stores the messages in append-only log segments on the broker’s local storage. Each topic can be configured with the targeted retention based on size or time
![](https://media.beehiiv.com/cdn-cgi/image/fit=scale-down,format=auto,onerror=redirect,quality=80/uploads/asset/file/01aca3a5-85cb-48c6-9e7c-808b2386c59c/image.png?t=1720022948)
So, what is Natural Language Processing? NLP involves several steps that help computers process language similarly to humans. Learn more about Natural Language Processing, what it entails and its benefits in general.
👨💻 Data Tools, Libraries
Mako (GitHub Repo)
Mako is a production-grade web bundler. It is used by companies like Ant Group and projects like Umi and Father to make web apps and websites and for bundling. Mako is extremely fast and built in Rust.
SmoothMQ (GitHub Repo)
SmoothMQ is a drop-in replacement for SQS. It has a much smoother developer experience, a functional UI, observability, tracing, message scheduling, and rate-limiting.
OmniParse (GitHub Repo)
OmniParse is a completely local platform that ingests and parses unstructured data into structured, actionable data optimized for GenAI applications.
AI News:
Runway Gen-3 Alpha is now public, revolutionizing video creation with advanced AI. Public release of Runway Gen-3 Alpha; high-quality video generation. Realistic video production from text, images, or videos. Accessible to all, but requires a paid account.
![](https://media.beehiiv.com/cdn-cgi/image/fit=scale-down,format=auto,onerror=redirect,quality=80/uploads/asset/file/2ac63ce2-dfae-408b-a8ae-cb10f14ec749/image.png?t=1720012763)
AI audio company ElevenLabs just announced a new ‘Iconic Voices’ feature for its recently released Reader App, allowing users to have text read by AI-generated voices of famous Hollywood stars.
![](https://media.beehiiv.com/cdn-cgi/image/fit=scale-down,format=auto,onerror=redirect,quality=80/uploads/asset/file/d9e36200-842e-4559-bf92-5ebc25de1030/image.png?t=1720012571)
Meta's 3D Gen leverages two advanced models: AssetGen and TextureGen. AssetGen crafts a 3D object from text in about 30 seconds, while TextureGen refines or creates textures in 20 seconds. This dual-step process, supporting Physical Based Rendering (PBR), ensures high-quality, relightable 3D assets.
![](https://media.beehiiv.com/cdn-cgi/image/fit=scale-down,format=auto,onerror=redirect,quality=80/uploads/asset/file/65ec0138-54c8-430d-9968-f99ecfb7a24f/image.png?t=1720013529)
Figma temporarily disables its new AI design tool following accusations of copying Apple's Weather app, highlighting the ethical challenges in AI-driven design.
![](https://media.beehiiv.com/cdn-cgi/image/fit=scale-down,format=auto,onerror=redirect,quality=80/uploads/asset/file/120a6201-1f4e-45bb-a06b-8a067a9f27f6/image.png?t=1720013948)
Meta plans to bring more generative AI tech into games, specifically VR, AR and mixed reality games, as the company looks to reinvigorate its flagging metaverse strategy.
AI Tutorial
🗣️ Create talking photos with just a selfie
![](https://media.beehiiv.com/cdn-cgi/image/fit=scale-down,format=auto,onerror=redirect,quality=80/uploads/asset/file/5a920395-eb1e-4612-b572-89eae1068ca2/Untitled__58_.png?t=1719946790)
Hedra Labs now transforms static photos into dynamic talking images, bringing your selfies to life with synchronized speech and facial animations.
Step-by-step:
Visit Hedra Labs' website and create a free account.
Upload a high-quality, clear photo of yourself facing the camera directly.
Generate audio by typing text (up to 300 characters) or import your own audio file.
Click "Generate video" to create your talking photo.
Preview, download, or share your animated selfie!
🔥Top AI tools to increase productivity:
Competitor Research keeps you ahead of the game by monitoring your rivals’ websites and social media
Undress AI offers a compelling solution for digital image transformation, driven by advanced AI
Tablepad – Connect any data source and ✨ magically generate stunning charts, transform data, and get insights with AI.
Context Data automates the process and time to deploy data platforms
Secta Labs – Reinventing Photography with authentic AI.
Panem – There’s no excuse for spending unnecessary budget on SaaS subscriptions with Panem.
DreamPetsAI is a cutting-edge tool that leverages advanced AI to create stunning, lifelike portraits of pets
View our database of all the best AI tools for your needs: aitoolsup.com
Have cool resources to share? Submit AI tool
Recommended reading
SPONSOR US
Get your product in front of Big Data & AI enthusiasts
Our newsletter is read by thousands of tech professionals, investors, engineers, managers, and business owners around the world.
Interested in Sponsoring the Big Data News Weekly Newsletter? Get in touch today
What did you think of today's email?Your feedback helps me create better emails for you! |