An ML Server That Treats Hadoop as a Prerequisite
Apache PredictionIO exists to wrap Spark, HBase, and Elasticsearch into a template-driven framework for recommendation and classification APIs.

What it does Apache PredictionIO is an open-source machine learning framework that collects events, trains models, and serves predictions over REST APIs. It provides ready-made engine templates for recommendations, similar-product matching, and classification, aiming to spare developers from rebuilding the big-data plumbing each time. The project is built on a Lambda Architecture backed by Hadoop, HBase (and other DBs), Elasticsearch, and Spark.
The interesting bit Instead of treating big-data infrastructure as an external concern, PredictionIO embeds the entire stack as a core dependency, using the Lambda pattern to unify batch and real-time processing. The selling point is not a novel algorithm but the scaffolding—turning a sprawling collection of Apache services into a single, queryable ML server.
Key highlights
- Pre-built engine templates for recommendation, similar-product, and classification tasks
- REST API endpoints for querying predictive results after model training and evaluation
- Implements a Lambda Architecture on top of Hadoop, HBase (and other DBs), Elasticsearch, and Spark
- Event collection, algorithm deployment, and evaluation handled within one framework
- Documentation and community support hosted at predictionio.apache.org
Verdict This is worth evaluating if your organization already runs the Hadoop ecosystem and wants a structured, template-driven on-ramp to production ML APIs. Everyone else should weigh the operational footprint before downloading.
Frequently asked
- What is apache/predictionio?
- Apache PredictionIO exists to wrap Spark, HBase, and Elasticsearch into a template-driven framework for recommendation and classification APIs.
- Is predictionio open source?
- Yes — apache/predictionio is open source, released under the Apache-2.0 license.
- What language is predictionio written in?
- apache/predictionio is primarily written in Scala.
- How popular is predictionio?
- apache/predictionio has 12.5k stars on GitHub.
- Where can I find predictionio?
- apache/predictionio is on GitHub at https://github.com/apache/predictionio.