Big Data Technology in Investment Banking


Understanding the Fundamental Concepts of Big Data Hadoop

GreySpark Partners presents Big Data Technology in Investment Banking, a report that provides business managers in investment banks with a high-level explanation of Big Data concepts and an overview of the technology framework to help inform their Big Data discussions with IT teams.

Read More

Investment banks, being data-rich organisations, have long had the infrastructure and processes to deal with large volumes of data. However, the volume, velocity and variety of data flowing through banks, in 2016, challenges traditional data management systems, which are limited by inelastic processing power and complex data structures. Big Data technology is increasingly adopted by capital markets’ firms to address these concerns, but before launching into or, indeed, dismissing Big Data technology, business managers must be certain of the benefits to be gleaned from it.

Fundamentally, Big Data has characteristics that make it unsuitable for storage, processing and analysis on a traditional data platform; it could be rapidly streamed, of poor quality or be data that is presented in a variety of formats, such as text and images – or all of the above. Big Data technology is designed to handle such data. That a dataset is large does not, in itself, identify it as ‘Big Data’. Big Data platforms can ingest, store and process structured data – tabulated and formulated – and more problematic unstructured data – for example, textual data. The technology is fault tolerant and can incorporate data that may otherwise be rejected. Additionally, Big Data analysis includes the whole data universe, rather than just a sample as in more traditional platforms, and the analysis is frequently designed to look for correlations and is less fixated on determining causality.

To fully understand the capabilities that Big Data technology can deliver, a business manager and the technical team need to build a bridge of understanding. A step towards achieving this is for the business to grasp the basic concepts of the technology, so that managers can understand what Big Data technology can offer.

Published on: 22 Dec, 2015

Big Data Technology in Investment Banking – Table of Contents

  • 1.0 Introduction: A Sea of Data
    • 1.1. Defining Big Data
    • 1.2. Drivers of Big Data Technology Investment by Banks
    • 1.3. Big Data Usage in Financial Services
  • 2.0 Databases and Data Warehouses
  • 3.0 Big Data Technology
    • 3.1. Key Enabling Technologies
    • 3.2. Big Data Technology Stack
    • 3.3. Big Data Ingestion
    • 3.4. Big Data Orchestration
    • 3.5. Big Data Processing
    • 3.6. Analysis and Discovery
    • 3.7. Big Data Analytics and Visualisation
    • 3.8. Big Data Systems Administration
  • 4.0 Benefits and Challenges of Implementing Big Data
    • 4.1. Running Conventional and Big Data Systems Side-by-side
    • 4.2. Data Lake Issues
    • 4.3. Data Quality
    • 4.4. Secondary Use of Big Data
    • 4.5. Data Protection and Data Ownership
    • 4.6. Data Management and Compliance
    • 4.7. Cultural Obstacles
  • 5.0 Conclusions
  • 6.0 Appendices
    • 6.1. Glossary of Terms
    • 6.2. Table of Figures