Recently a development team met some difficulties in data source computation
when developing iReport reports. After the use of esProc for cross database
computation, the problem is resolved.
This is a project payment progress report, as part of a project management
system. It's based on an Oracle database. The reports needs to present the
project name, payment amount, contract value, payment progress (in
percentage), and name of the project manager, etc., for all ongoing projects.
Amount these the first 3 items contributes to the difficulties met by the
Note that the project payment record is stored in accounting system, rather
than the Oracle database used by the development team. The accounting system
is built on MSSQL database. The contract value information is also stored in
a separate MSSQL database, used by contract management system. After a... (more)
As we know, the stored procedure is designed to handle computations
involving complex business logics.
In the past, the data structure and business logics were so simple that one
SQL statement was enough to achieve user's computational goal. With the rapid
growing of information industry, users frequently find that they need to
achieve the increasingly complex computational goals to out-perform their
competitors. To address such computations, SQL alone is far from
enough. Database programmers have the additional demands regarding the judge
and loop statements, branches at multip... (more)
Enterprises always have various data sources, for instance, CRM system may
use SQL Server, sales reports adopt Excel, ERP applies Oracle database. When
it comes to actual business analysis, enterprises usually need to conduct
interactive computation, including filter, group, etc among various data
environments. But data Interaction between multiple data sources are not easy
to realize with some traditional statistical computing tools. In order to
solve such kind of problems, esProc which adapts to various data environments
comes into being.
Support of various data sources is an... (more)
In the process of development with Java, we will occasionally encounter the
computation similar to data processing in database. For instance, there are
two frequently updated Excel sheets, which are the clients' information and
the orders. We need to query the data of clients who have bought all the
products on the list through entering a dynamic product list.
The "computation similar to data processing in database" refers to structured
data computation of an application without database. Although Java is capable
of handling such computation, the procedure is very cumbersome and v... (more)
The low efficiency of Hadoop computation is an undeniable truth. We believe,
one of the major reasons is that the underlying computational structure of
MapReduce for Hadoop is basically of the external memory computation. The
external memory computation implements the data exchange through the frequent
external memory read/write. Because the efficiency of file I/O is two orders
of magnitude lower than that of memory, the computational performance of
Hadoop is unlikely high.
While for the normal users, they usually have a small size of cluster with
only tens or scores of nodes. T... (more)