Machine and Deep Learning SDKs, Tools, Frameworks and Systems

by David I | Jan 12, 2017 | APIs, Big Data, Deep Learning, Developer Relations, DevRelate, Machine Learning |

We’ve seen the rise of multiple big data solutions in the past few years. Building on top of the volume, variety and velocity of data, we’ve seen the growing need for automating business decisions based on the knowledge coming from online systems, sensors and connected devices. In order to take advantage of this wealth of data we’re seeing the rapid rise of a wide range of machine and deep learning SDKs, tools, frameworks, systems, services, and libraries. This blog post highlights some of the available machine learning and deep learning SDKs available from leading platform vendors, hardware vendors, researchers, and open source projects. It’s a great time to be a software engineer and to have all of these technologies provided by developer relations programs.

Machine and Deep Learning SDKs

Here are a few of the many machine learning and deep learning SDKs, tools, frameworks, systems, services, and libraries that are available for developers to use in their cognition-based, big data driven applications. I’ve divided the list up into services/systems, frameworks, libraries and tools (although the distinctions are arbitrary as some provide both a service along with an API, SDK or framework).
  

Services/Systems

• IBM Watson – https://www.ibm.com/watson/
• Amazon Machine Learning – https://aws.amazon.com/machine-learning/
• Google Cloud Prediction API – Prediction’s cloud-based machine learning and pattern recognition tools can help analyze your data to add various features to your applications – https://cloud.google.com/prediction/
• Veles – Open Source (by Samsung) distributed platform for rapid Deep Learning app development – https://velesnet.ml/
• H20 AI – open source machine learning platform for enterprises – http://www.h2o.ai/
• Apache PredictionIO – open source Machine Learning Server built for developers and data scientists to create predictive engines for any machine learning task – http://predictionio.incubator.apache.org/

Frameworks

• Apache Singa – deep learning framework (in the Apache incubator) – https://singa.incubator.apache.org/en/index.html
• Caffe Deep Learning Framework – http://caffe.berkeleyvision.org/
• Oryx2 – Lambda architecture on Apache Spark, Apache Kafka for real-time large scale machine learning – http://oryx.io/
• Neon (Nervana Systems) – Python based Deep Learning Framework – https://github.com/NervanaSystems/neon
• Torch – Scientific Computing Machine Learning framework/algorithms – http://torch.ch/
• PyTorch – A deep learning framework that puts Python first. In an early-release Beta.- http://pytorch.org/
• Accord.net – .NET machine learning framework combined with audio and image processing libraries completely written in C# – http://accord-framework.net/
• MOA (Massive Online Analysis) – open source framework for data stream mining – http://moa.cms.waikato.ac.nz/

Libraries

• TensorFlow – open source library for Machine Learning (from Google) – https://www.tensorflow.org/
• Apache Spark MLlib – library of algorithms for Spark – http://spark.apache.org/mllib/
• Microsoft Azure ML – https://studio.azureml.net/
• Microsoft Distributed Machine Learning Toolkit (DMTK) – http://www.dmtk.io/
• Intel BigDL – BigDL is a distributed deep learning library for Apache Spark; users can write their applications as standard Spark programs, which can directly run on top of existing Spark or Hadoop clusters. – https://github.com/intel-analytics/BigDL
• DeepLearning4j – commercial-grade, open-source, distributed deep-learning library written for Java and Scala – https://deeplearning4j.org/
• Microsoft Cognitive Toolkit – trains deep learning algorithms to learn like the human brain – https://www.microsoft.com/en-us/research/product/cognitive-toolkit/
• Theano – python deep learning library – http://deeplearning.net/software/theano/
• Brainstorm – Fast, flexible and fun neural networks. – https://github.com/IDSIA/brainstorm
• mlPack – scalable machine learning library – http://mlpack.org/
• Shogun – open source machine learning toolbox provides a wide range of unified and efficient Machine Learning (ML) methods – https://github.com/shogun-toolbox/shogun
• OpenNN – open source class library written in C++ programming language which implements neural networks – http://www.opennn.net/

Tools/SDKs

• Intel Deep Learning SDK – Tools to accelerate deep learning training and deployment – https://software.intel.com/en-us/deep-learning-sdk
• NVIDIA Deep Learning SDK – tools and libraries for designing and deploying GPU-accelerated deep learning applications – https://developer.nvidia.com/deep-learning-software

Machine Learning Courses

• Udacity: Introduction to Machine Learning – https://www.udacity.com/course/intro-to-machine-learning–ud120
• Udacity: Deep Learning by Google – Take machine learning to the next level (free course) – https://www.udacity.com/course/deep-learning–ud730
• edX: Machine Learning for Data Science and Analytics – https://www.edx.org/course/machine-learning-data-science-analytics-columbiax-ds102x-0
• Open Classroom: Machine Learning by Andrew Ng – http://openclassroom.stanford.edu/MainFolder/CoursePage.php?course=MachineLearning
• Udacity: Machine Learning Engineer Nanodegree – https://www.udacity.com/course/machine-learning-engineer-nanodegree–nd009
• Udacity: Artificial Intelligence Engineer Nanodegree – https://www.udacity.com/ai

Evans Data’s AI and Big Data Developer Research Report 2016 V2

This report focuses on tools, methodologies, and concerns related to implementing machine learning, deep learning, image recognition, pattern recognition and other forms of artificial intelligence as well as efficiently storing, handling, and analyzing large datasets and databases from a wide range of sources. Artificial intelligence is permeating software development in many ways and many industries, which necessitates a thorough knowledge of how developers are doing this. Big Data, often related, is also becoming a reality for more and more companies; this report provides valuable insight into developer opinions on these topics.

This volume includes research and analysis covering topics such as Perceptions of the AI and Big Data Landscapes, AI & Big Data Developer Demographics, Decision-Making for AI & Big Data, Barriers and Challenges for Data Analytics, AI Concept and Approaches, Conversational Systems & Virtual Assistants, Real-Time Events & Time Series Processing, Big Data & IoT, Collaboration in Big Data & Data Science, Advanced Analytics Tools and Services, Databases & Data Warehousing, Hadoop, Parallelism & Big Data, Operating Systems & Languages, and Tools Used for AI & Big Data.

You can take a look at the AI and Big Data Developer Research report table of contents and sample report pages at http://www.evansdata.com/reports/viewRelease.php?reportID=37

Does your Developer Relations Program provide a Machine or Deep Learning SDK, Tool, Library, Framework or Service?

If you’re looking for additional Machine Learning frameworks, libraries, and software you can check out the “Awesome Machine Learning” curated list of resources on GitHub. You’ll find additional resources for a wide range of programming languages.

Would it be cool if your developer relations program used AI to support your community members? Using AI and bot technology to answer common questions or point developers in the right direction?

Am I missing a machine learning or deep learning library, framework, SDK, tool, service, system or API that your developer relations program provides?  Send me an email if I am missing one or more.

David Intersimone “David I”
Vice President of Developer Communities
Evans Data Corporation
davidi@evansdata.com
Blog: https://www.devrelate.com/blog/
Skype: davidi99
Twitter: @davidi99