Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

Page properties


TitleAnalyzing Hyperledger Fabric Ledger, Transactions, and Logs using Elasticsearch and Kibana
Status

Status
colourBlueGreen
titleProject in ProgressCompleted

Difficulty

Status
colourYellow
titleMedium
  


...

Rocketchat id: salmanbaset

Mentee Name and Contact Info

Balazs Prehoda

prehoda.balazs@gmail.com

Rocketchat id: balazsprehoda

Project Deliverables

Overall goals of the project:

...

Week 1

  •  Exploration. Setup Hyperledger Fabric network, connect Hyperledger Explorer to Fabric. Use Filebeat to send data to Kibana.

Week 2

  •  Exploration. Extend Fabric network (Fabric-ca, binary data and json chaincode). Dump ledger data from HL Explorer and visualize it in Kibana.

Week 3

  •  Write Beats agent with configuration that sends data to Elasticsearch.

Week 4

  •  Create operational dashboards similar to HL Explorer. Create data query dashboards.

Week 5

  •  Refine data flow, send every block and transaction data to Elasticsearch. Make keys indexable.

Week 6

  •  Refactor code, prepare the system to receive data from various peers in separate or similar indices. Add peer selection functionality. Add which user issued query in beats agent and in dashboard.
     Modify the application such that: 1) it only writes the most recently added keys to ledger 2) adds a previous key in the data schema, which can be added to key value in addition to hash.

Week 7

  •  Test agent with multiple peers, multiple channels. Each channel may have its own zero or more chaincodes and data schema. It should be possible to specify per channel chaincode data schema in beats agent.

Week 8

  •  Create example HL Fabric network setups and dashboards for different topics and use-cases (supply chain, medicine provenance, etc.)

Week 9

  •  Refine the examples and prepare for submission as Hyperledger Lab. Evaluate how to read data directly from ledger file instead of using peer APIs.

Week 10

  •  Submit the project as Hyperledger Lab. Store and analyze peer / CA logs within Elastic stack.

Week 11

  •  Create Fabric network program that uses private data, create dashboards for private datadumps data into custom output (default implementation is json, but can be implemented for any databases) for exploring analysis possibilities aside from Elasticsearch.

Week 12

  •  Setup ELK with TLS, and send data to it over TLSRefine documentation, evaluate how to replace the ledger file with custom database (CouchDB, MongoDB).

Project Milestones

  •  Write a Beats agent that sends ledger data to Elasticsearch Balazs Prehoda  (1st Quarter)
  •  Prepare the system to receive data from various peers, refine the data flow Balazs Prehoda  (2nd Quarter)
  •  Create examples, prepare for submission as Hyperledger Lab Balazs Prehoda  (3rd Quarter)
  •  Store and analyze peer/CA logs within Elastic stack, create network setup and dashboards for private data, setup TLS Prepare the project for excluding the Beats agent by replacing the ledger file or reading the ledger file directly. Balazs Prehoda  (4th Quarter)

Project Plan

View file
nameProject Plan_plan_final.pdf
pageAnalyzing Hyperledger Fabric Ledger, Transactions, and Logs using Elasticsearch and Kibana
spaceINTERN
height250

Summary Report

Slides

View file
nameHyperledger Mentee Project Presentation - Analyzing Hyperledger Fabric Ledger Transactions using Elasticsearch and Kibana - 2019.pdf
pageAnalyzing Hyperledger Fabric Ledger, Transactions, and Logs using Elasticsearch and Kibana
spaceINTERN
height150

Two short demo videos (without audio):

dummyfile.txt

dummyfile.txt