Data is everywhere in the modern business world

Big data used to describe any voluminous amount of structure, semi-structured and unstructured data that has the potential to be minded for information.

Big data can be characterised by 4V’s:

• The extreme volume of data

• The wide variety of data types

• The velocity at which data must be processed

• The Value in term of ROI

Big data  is a powerful information for looking to our world. Big data is more about taking a slice in time across many different channels. However, Big data has limitations and requirements.

Data is causing major problem for organizations and Government departments in term to manage, integrate and analyze these huge data volume.

Big data cannot be integrated easily because it would take too much time and cost to much money to load all the data into a traditional relational database for analysis.

Long data involves looking at information on a much longer timescale. It teaches humankind in general, not just business hoping to sell more. Long data focuses on information with a massive historical sweep that holds tremendous potential for learning about the customer.

The longer term view of the data can provide information that businesses might miss if they examine data that only goes back to a short while. Ignoring customer data and records that go back decades can limit an organisation’s ability to connect with its customers.

Organisations need to decide which long data is worth keeping. The main responsibility of Chief Data Architect role to own that data. The lack of a single role in the organisation to own that data makes things a little more complicated.

Although the demand for big data analytics is high, there is currently shortage of data scientists and other analysts who have experience working with big data in a distributed and open source environment. In the enterprise environment, organisations have responded to this shortage by creating appliances to help them to take advantage of the big and long data.

One solution to address the big and long data is to design and architect “Data Cloud Platform” and “Big Data Analytic Platform”.

If you need further information or initial consultancy, please email mustafa@imexservices.co.uk for details.