BDNW Issue -79

#79 - Aug 24, 2023  News, articles on Big Data, AI, Data Science, ML, Cloud, IoT.

View email in your browser

     Together with  In today's edition: 🚀How Federated Learning Protects Privacy ⚡️Implementing DataOps What is Power BI Deployment Pipeline? ⚡️ Open challenges in LLM research 🚀What is Power BI Deployment Pipeline? 💪 89% Of Organizations Benefit From Generative AI 🧠 Increasing misuse of AI in Global politics 💼 IBM study: 40% of workforce may need AI 'reskilling’ 💻 Stability AI introduces ChatGPT lookalike. 🤯 A.I. Tools and News  🖼️ A.I. Generated Image of the Day  Cerebrium: Serverless, Seamless, ML DeploymentCerebrium offers seamless ML Model deployment: Less than 1s cold start, major frameworks (Pytorch, Onnx, XGBoost) supported, 18+ pre-built models, fine-tuning (FlantT5, GPT-Neo, Stable Diffusion), and opportunities for paid projects. Trusted by Twilio, Ramp, and Writesonic. Try Cerebrium for Free![Try For Free] Do Machine Learning Models Memorize or Generalize?Researchers made a striking discovery while training a series of tiny models on toy tasks [1]. They found a set of models that suddenly flipped from memorizing their training data to correctly generalizing on unseen inputs after training for much longer. This phenomenon – where generalization seems to happen abruptly and long after fitting the training data – is called grokking and has sparked a flurry of interest.How Federated Learning Protects PrivacyLarge datasets have made astounding breakthroughs in machine learning possible. But oftentimes data is personal or proprietary, and not meant to be shared, making privacy a critical concern of and barrier to centralized data collection and model training. With federated learning, it’s possible to collaboratively train a model with data from multiple users without any raw data leaving their devices.5 Reasons You Should Consider Implementing DataOpsIn this article, I’ll explain what exactly is DataOps, the differences between DevOps and DataOps and the top reasons to implement a DataOps model now. Read on to find out more.How To Effectively Structure Data Science ProjectsIn a recent blog post, a data science expert has thrown a spotlight on the Problem Statement Worksheet (PSW), a tool that's highly beneficial in consulting and a myriad of IT projects, including data science. The PSW is a comprehensive template that serves to understand a client's needs better, particularly when clients are unable to spare long hours detailing their project's expectations.Whats the point of learning ML theory if industry doesn't care (other than interviews)? [Reddit Discussion]To understand ML theory one needs to have good hold on stats, probability and basic algebra. Deep learning requires extensive knowledge of linear algebra. All of this takes months and months to understand. But in the end all that matters is whether you can implement a model or not.Top Data Scientist Skills You May Need In 2023Since 2012, the data scientist’s role has grown by over 650%, and by 2026, there will be 11.5 million jobs in this field. The field has become more lucrative than before, painting an optimistic picture for the jobs in 2021 and beyond.List of 10 must-read sampling methods papers starting from Introductory to Advanced to Cutting Edge [Twitter / X]While it might be impossible to get this exactly right, i'm going to have a go at this. the main constraints which i've kept in mind are to i) make sure to cover important topics, and ii) make sure that the references are well-written.What is Power BI Deployment Pipeline?With the constant need to develop the Power BI software to make it more accessible and reliable for end users, BI creators need to come together and collaborate often to make these changes happen in the collection of apps and connectors.Open challenges in LLM researchNever before in my life had I seen so many smart people working on the same goal: making LLMs better. After talking to many people working in both industry and academia, I noticed the 10 major research directions that emerged. The first two directions, hallucinations and context learning, are probably the most talked about today.🤖 AI News:💻 Stability AI introduces ChatGPT lookalike.Stability AI has introduced Stable Chat, a platform similar to ChatGPT, but with limitations like lacking chat history and separate sessions. It uses the Stable Beluga model which displays cautious content generation and occasional inconsistencies, making it less refined than ChatGPT.⚙️ Microsoft eyes AI upgrades for WindowsMicrosoft is reportedly adding AI capabilities like object recognition and generative image creation to apps like Photos, Snipping Tool, and even Paint in Windows 11.🛒 Amazon rolls out new AI features.Amazon is introducing an AI feature that summarizes product reviews for customers, giving quick insights into what others are saying. The AI-generated summaries are now available to some U.S. mobile shoppers, with potential expansion based on feedback, as Amazon aims to integrate generative AI into all of its offerings.Google Chrome will soon be able to summarize entire articles for you with built-in generative AI.  Google’s AI-powered article summaries are rolling out for iOS and Android first, before coming to Chrome on the desktop.Tech firms slow lay-offs but hold off on new hires even as AI creates demand for new skills (1 minute read)There has been no ramp-up in hiring in tech despite the surge of interest in AI. However, job cuts have appeared to slow down. There have been over 340,000 job cuts in the tech industry so far this year, well ahead of the around 240,000 for all of 2022. US job openings fell in June to their lowest level since April 2021Google A.I. researcher says he left to build a startup after encountering ‘big company-itis’  Llion Jones, a co-author of Google's pivotal Transformers paper, has left Google to start Sakana AI, a generative AI research lab that will investigate nature-inspired methods of doing things.AI use rising in influence campaigns online, but impact limited - US cyber firmMandiant, a U.S. cybersecurity firm owned by Google, reports an uptick in the use of AI for manipulative online information campaigns. While AI-generated content has been employed in politically motivated influence campaigns, the impact remains limited.Report: Potential NYT lawsuit could force OpenAI to wipe ChatGPT and start overThe New York Times is reportedly considering a lawsuit against OpenAI, which could lead to devastating consequences for OpenAI, including the potential destruction of ChatGPT’s dataset and fines up to $150,000 per infringing content piece.Cerebrium: Serverless, Seamless, ML DeploymentTry Cerebrium for Free!Microsoft’s Satya Nadella is winning Big Tech’s AI war. Here’s how (29 minute read)This article looks at Microsoft's work on AI over the last few decades.Marketing, Customer Care Top List of Generative AI Use CasesGenerative AI in business functions. 28% of businesses have generative AI on their board's agenda, primarily focusing on marketing and sales, product and service development, and service operations.🎵 YouTube launches ‘Music AI Incubator’YouTube just announced a new Music AI Incubator, revealing plans to collaborate with artists to develop generative AI technologies and gather insights.💼 IBM study: 40% of workforce may need AI 'reskilling’A new IBM report estimates 40% of the global workforce will need to ‘reskill’ in the next three years as AI transforms business operations.India enables nation-wide AI-powered voice payments 🗣️💰The Reserve Bank of India (RBI), has put forward the idea of introducing an AI-powered conversational payments system, whereby users can initiate payments with their words alone UK invests $100M to produce AI chips in race for AI dominance🧑‍⚖️ Federal Judge rules AI art can’t be copyrighted🥣 Nestle & Unilever shift focus to AI development💰 AI recruitment sees huge spike in salaries for top-grade talent🩻 Radiographs combined with AI helps determine patient age🤖 AI Ethics: Are Large Language Models a Threat to Digital Public Goods? Evidence from Activity on Stack OverflowHave you ever wondered how the rise of AI language models like ChatGPT might change how we share and access information online? In our recent study, we measured the impact of ChatGPT on Stack Overflow. On this popular online platform, computer programmers ask and answer questions, forming a library of content that anyone with an internet connection can learn from.  AI tools supercharge your productivity:  Cerebrium.ai - A machine learning framework that makes it easier to train, deploy and monitor machine learning models Clay: Data-driven AI prospecting, enrichment & personalization  AgentGPT allows you to configure and deploy Autonomous AI agents. 💼 Claude AI: Your reliable partner for tasks of any scale. 👤 RealismGPT: Elevate conversations with AI-powered realism and lifelike avatars. Browse AI Prebuilt Robots: Automated data extraction and monitoring tool. Gling: Save time editing your video footage. I love how Gling is using AI to tackle a painful problem Wardrobe AI: AI-powered wardrobe advice, straight to your inbox. WavelAI: Instantly clone your voice with just 60 seconds of audio. PodStash: Use this tool to turn any website into a podcast. Choose an article or blog post and this will turn that content into an audio file.View our database of all the best AI tools for your needs:🤖 AI Tools UpHave cool resources to share? Submit a tool or reach us by replying to this email.   Data Tools, LibrariesdifyDify is an easy-to-use LLMOps platform designed to empower more people to create sustainable, AI-native applications.LangUILangUI is an Open Source Tailwind library with free to use components tailored for your AI and GPT projects. Focus on building the next best project and let it handle the UI.postgres_lspA Language Server for Postgres.scaffolderCLI tool to instantly generate skeleton project structure with boilerplate code, that's taken from configurable YAML file, to quickly kick-start your projectZepA long-term memory store for LLM applications.LanceDBDeveloper-friendly, serverless vector database for AI applications.mCaptchaProof of work based, privacy respecting CAPTCHA system with a kicka*s UX. DoculiteDocuLite lets you use SQLite like Firebase Firestore.  Recommended ReadingThe Average JoeThe IKEA instructions for investing to help you to become a better investor. Market trends & insights that are simple, concise, and impactful.Peak PerformanceFor business professionals and entrepreneurs who are interested in learning about starting, growing, and scaling a business. Get free & practical solutions to unlock your full potential in work and life.Design HacksJoin 50,000+ people learning UX/UI design in short, practical lessons. Original illustrated tuts to help you design better websites and apps.    A.I. Generated Image of the Day         UFO Hotel: which will you stay in?(source)                     Want to reach our audience / fellow readers? Consider Sponsoring - grab a spot now.   Big Data | Hadoop News | AI | ML | NoSQL | Education | IoT | Cloud Tips? Suggestions? Feedback? email BDANCurated by @BDAnalyticsnews