Big Data News Weekly - Issue 4

#4  - Sept 28, 2018Curated news, articles and Books related to Big Data.

View email in your browser

    How Big Data Tech Is Changing the Way We Farm Like many other major industries, the farming sector has been substantially influenced by technology. Let’s specifically look at how big data contributes to changes in farming methods.  Optimizing Workplace Efficiency Through Use of Cloud-based Services Maintaining an on-site server and relying upon a more conventional network setup could become a liability, especially in situations where organizations may be required to act or respond with minimal delay.  How Big Data Will Be a Driving Force for 5G The 4G network is familiar to most people who use mobile devices, but now many people are excited about the promise of 5G — a next-generation network capable of blazing-fast speeds and virtually no latency, among other benefits  The Significance of Blockchain in Big Data The World Economic Forum (WEF) defines blockchain as a technology that allows people to transfer assets to one another in a secure way without any intermediaries. It enables transparency, immutability, and autonomous execution of business rules  The What-If Tool: Code-Free Probing of Machine Learning Models Building effective machine learning (ML) systems means asking a lot of questions. It's not enough to train a model and walk away. Instead, good practitioners act as detectives, probing to understand their model better: How would changes to a datapoint affect my model’s prediction?  Learn machine learning with Python: a free curated curriculum How to learn machine learning in Python is a very popular topic: with the rise of artificial intelligence, programmers have been able to do everything from beating human masters at Go to replicating human-like speech.  What Do Data Scientists Need to Know about Containerization? As Little as Possible. Data scientists are not always equipped with the requisite engineering skills to deploy robust code to a production job execution and scheduling system. Yet, forcing reliance on data platform engineers will impede the scientists’ autonomy. If only there was another way.  SQL Query Optimization Meets Deep Reinforcement Learning We show that deep reinforcement learning is successful at optimizing SQL joins, a problem studied for decades in the database community.  Further, on large joins, we show that this technique executes up to 10x faster than classical dynamic programs and 10,000x faster than exhaustive enumeration.  Fast Python Serialization with Ray and Apache Arrow Why is any translation necessary? Well, when you create a Python object, it may have pointers to other Python objects, and these objects are all allocated in different regions of memory, and all of this has to make sense when unpacked by another process on another machine.  LinkedIn open sources TonY, its framework to run TensorFlow on Hadoop LinkedIn on Thursday will announce a new open source project that aims to provide native support for running TensorFlow jobs on Hadoop.        Books       Learning SQL: Master SQL Fundamentals 2nd Edition Updated for the latest database management systems -- including MySQL 6.0, Oracle 11g, and Microsoft's SQL Server 2008 -- this introductory guide will get you up and running with SQL quickly.     Programming Hive: Data Warehouse and Query Language for Hadoop 1st Edition Need to move a relational database application to Hadoop? This comprehensive guide introduces you to Apache Hive, Hadoop’s data warehouse infrastructure. You’ll quickly learn how to use Hive’s SQL dialect—HiveQL—to summarize, query, and analyze large datasets stored in Hadoop’s distributed filesystem.     For a detailed list of books covering Big data Data Science, Machine Learning, AI and associated programming languages check out our big data books page.  Want to reach our audience / fellow readers? Consider sponsoring - grab a spot now.   Big Data | Hadoop News | AI | ML | NoSQL | Education | IoT | Cloud