The Big Data Real-time Application is a scenario to return the computation
and analysis results in real time even if there are huge amounts of data.
This is an emerging demand on database applications in recent years.
In the past, because there wasn't a lot of data, the computation was simple,
and few parallelisms, the pressure on the database wasn't great. A high-end
or middle-range database server or cluster could allocate enough resources to
meet the demand. Moreover, in order to rapidly and parallel access to the
current business data and the historic data, users also tended to arrange the
same database server for both the query analysis system and the production
system. This way, the database cost could be lowered, the data management
streamlined, and the parallelism ensured to some extent. We are in the prime
time of database real-time application development.
Enterprises always have various data sources, for instance, CRM system may
use SQL Server, sales reports adopt Excel, ERP applies Oracle database. When
it comes to actual business analysis, enterprises usually need to conduct
interactive computation, including filter, group, etc among various data
environments. But data Interaction between multiple data sources are not easy
to realize with some traditional statistical computing tools. In order to
solve such kind of problems, esProc which adapts to various data environments
comes into being.
Support of various data sources is an... (more)
In the process of development with Java, we will occasionally encounter the
computation similar to data processing in database. For instance, there are
two frequently updated Excel sheets, which are the clients' information and
the orders. We need to query the data of clients who have bought all the
products on the list through entering a dynamic product list.
The "computation similar to data processing in database" refers to structured
data computation of an application without database. Although Java is capable
of handling such computation, the procedure is very cumbersome and v... (more)
In Java development, we may encounter the complex set operations. Java alone
is not powerful enough to save programmers' efforts in implementing the
computation details, which is time-consuming and poor in code reuse. In view
of this, programmers usually resort to dynamic calculation script for set
SQL is surely the first kind of script that comes into most programmers'
mind. However, to their disappointments, SQL does not support the explicit
set, and is unable to represent the sets of a set, ordered set, generic set,
and only the result set can be recognized as a set... (more)
What is IOE? I=IBM, O=Oracle, and E=EMC. They represent the typical high-end
database and data warehouse architecture. The high-end servers include HP,
IBM, and Fujitsu, the high-end database software includes Teradata, Oracle,
Greenplum; the high-end storages include EMC, Violin, and Fusion-io.
In the past, such typical high performance database architecture is the
preference of large and middle sized organizations. They can run stably with
superior performance, and became popular when the informatization degree was
not so high and the enterprise application was simple. With the ... (more)