• (022) 6902 1117

Scraper utk menyimpan real time feeds ke database

 

Target web: https://www.indopremier.com/ipotstock/liveTradeWindowed.php

web tersebut di atas mendapatkan 'kiriman' real time feeds (dalam bentuk JSON data) dari https://www.indopremier.com/module/saham/include/livetrade-streaming.php

Real time feeds akan berjalan dgn jadwal berikut:

  1. Senin - Kamis: 9.15 - 12.15 dan 13.45 - 16.05
  2. Jumat: 9.15 - 11.45 dan 14.15 - 16.05

Scraper merupakan Javascript (pakai EventSource) yg ditulis dalam PHP.

Ketika dijalankan, scraper berfungsi untuk merekam, parsing real time feeds (server mengirimkan dalam bentuk JSON data), dan menyimpan ke dalam database MySQL localhost.

contoh JSON data:

id: 0
data: {"code":"13:31:53","data":{"Time":"13:31:53","TradeCommand":"0","SecurityCode":"SMBR","BoardCode":"RG","TradeNum":"000377613023","Price":"2420","Volume":44,"BuyerCode":"CS","BuyerType":"F","SellerCode":"LG","SellerType":"D","PrevPrice":"2400","TmpVar1":"000842681006","TmpVar2":"000842603483","Chg":"20","TmpVar4":"0","TmpVar5":"1\r","fmtPrice":"2,420 ","fmtChg":"20 ","fmtVolume":"44 ","fmtLabelSector":"basic"}}

Kolom pd tabel database localhost:

  1. Date (YYYY-MM-DD)
  2. Time
  3. TradeCommand
  4. SecurityCode
  5. BoardCode
  6. TradeNum
  7. Price
  8. Volume
  9. BuyerCode
  10. BuyerType
  11. SellerCode
  12. SellerType
  13. PrevPrice
  14. TmpVar1
  15. TmpVar2
  16. Chg
  17. TmpVar4
  18. TmpVar5
  19. fmtPrice
  20. fmtChg
  21. fmtVolume
  22. fmtLabelSector
Dalam PHP ada tombol "START" dan "STOP". START utk memulai aktivitas membangun koneksi, parsing, dan simpan data ke database. STOP utk menghentikan smua aktivitas tersebut.

Tampilan tidak penting. Buat sesederhana mungkin.

Budget <= Rp150.000

saya punya beberapa contoh javascript dalam PHP yg mungkin bs jd acuan dan selanjutnya dikembangkan sendiri. ada di attachment.

MySQL JavaScript PHP Web Scrapping

Published Budget: Rp 150,000
Finish Days: 2
Published Date: 21/11/2016 14:57:52 WIB
Start Date:
Finish Date:
Project Status: No Action
Accepted Worker:
Accepted Budget: Rp 0
Project Ending:

Project Owner

tommytama
    
10.00/10.00
140 Point
#3,796 dari 1,099,394

Accepted Worker

Bid masih terbuka.

Place New Bid

      User Bids

 

Recommended Workers

rakifsul

27,395 points
78 projects
    
10.00/10.00

manakreatif

18,642 points
149 projects
    
9.76/10.00

Muhammad.Rahman

17,917 points
190 projects
    
9.80/10.00

programmerkreatif

12,122 points
53 projects
    
9.61/10.00

arkhan7

10,595 points
190 projects
    
9.82/10.00

Recommended Services

Tiru Website Lain Sesuai Keinginan (Cloning)

Rp 650,000
18 sales
    
9.83/10.00

Jasa Pembuatan website Wordpress + Elementor

Rp 650,000
13 sales
    
10.00/10.00

Jasa pembuatan landing page

Rp 400,000
12 sales
    
9.92/10.00

Script API Mutasi Bank BCA Personal

Rp 2,000,000
3 sales
    
9.00/10.00

Open Projects

Dicari yang bisa bikin plugin wordpress custom

Owner: Kreatif456
Budget: Rp 1,000,000 - 2,000,000

Membuat Web UI Menggunakan Framework Tailwindcss (Versi Terbaru)

Owner: fanvan
Budget: Rp 1,000,000 - 2,000,000

Pembuatan Software untuk Kebutuhan Parkir

Owner: codesbandit
Budget: Rp 10,000,000 - 20,000,000

Cari orang yang ahli optimasi database

Owner: good_owner
Budget: Rp 500,000 - 750,000

Pembuatan Website Undangan Online

Owner: waroenglaris
Budget: Rp 1,000,000 - 2,000,000

 


Live Chat