Showing posts with label hadoop. Show all posts
Showing posts with label hadoop. Show all posts

Monday, 9 May 2011

To what extent is Hadoop used in finance? - Quora

To what extent is Hadoop used in finance? - Quora: "To what extent is Hadoop used in finance?"

Almost every large bank I've spoken with has either a pilot project or a production cluster running.

Some example use cases that come to mind:
IT log consolidation and analysis (for use in provisioning, forensics, etc.)
Collection and analysis of enterprise service bus messages
Identifying transaction fraud: creating a large data set for model building and backtesting
Consolidating consumer product data warehouses and transaction logs to build a unified risk score across consumer products (retail banking, home loans, auto loans, student loans, credit cards, etc.)
Daily transformation of loan-level data delivered from a service provider in a custom format into a consolidated format suitable for loading into a database
Collection and analysis of simulation logs from a multi-thousand node compute grid
Tiered time series tick database (recent data stored in an in-memory column store, older data stored on Hadoop)
Check image storage and retrieval
Daily processing of equity markets data for compliance purposes
Creation of a equity market historical data repository for model fitting and back testing

Tuesday, 12 April 2011

Hadoop Hue & django

Hadoop Hue is written in a web-framework build in python called django.http://www.djangoproject.com/

Killing and starting the Hadoop datanode deamon

$sudo jps

check the Datanode process ID

$sudo kill -9

$sudo /etc/init.d/hadoop*datanode start

thats it!

Executive Summary: Anthropic's Claude Mythos Model

  What Happened Anthropic announced  Claude Mythos Preview , a new AI model it describes as its most capable ever — and so powerful in cyber...