The Big Data Real-time Application is a scenario to return the computation
and analysis results in real time even if there are huge amounts of data.
This is an emerging demand on database applications in recent years.
In the past, because there wasn't a lot of data, the computation was simple,
and few parallelisms, the pressure on the database wasn't great. A high-end
or middle-range database server or cluster could allocate enough resources to
meet the demand. Moreover, in order to rapidly and parallel access to the
current business data and the historic data, users also tended to arrange the
same database server for both the query analysis system and the production
system. This way, the database cost could be lowered, the data management
streamlined, and the parallelism ensured to some extent. We are in the prime
time of database real-time application development.
In Java development, the typical data computation problems are characterized
Long computation procedure requiring a great deal of debugging Data may from
database, or Excel/Txt Data may from multiple databases, instead of just one.
Some computation goals are complex, such as relative position computation,
and set-related computation
Just suppose a sales department needs to make statistics on the top 3
outstanding salesmen ranking by their monthly sales in every month from Jan
to the previous month, based on the order data.
Java alone is difficult to handle such computations... (more)
The data computation layer in between the data persistent layer and the
application layer is responsible for computing the data from data persistence
layer, and returning the result to the application layer. The data
computation layer of Java aims to reduce the coupling between these two
layers and shift the computational workload from them. The typical
computation layer is characterized with below features:
Ability to compute on the data from arbitrary data persistence layers, not
only databases, but also the non-database Excel, Txt, or XML files. Of all
these computations, the... (more)
In the process of development with Java, we will occasionally encounter the
computation similar to data processing in database. For instance, there are
two frequently updated Excel sheets, which are the clients' information and
the orders. We need to query the data of clients who have bought all the
products on the list through entering a dynamic product list.
The "computation similar to data processing in database" refers to structured
data computation of an application without database. Although Java is capable
of handling such computation, the procedure is very cumbersome and v... (more)
Enterprises always have various data sources, for instance, CRM system may
use SQL Server, sales reports adopt Excel, ERP applies Oracle database. When
it comes to actual business analysis, enterprises usually need to conduct
interactive computation, including filter, group, etc among various data
environments. But data Interaction between multiple data sources are not easy
to realize with some traditional statistical computing tools. In order to
solve such kind of problems, esProc which adapts to various data environments
comes into being.
Support of various data sources is an... (more)