Free cookie consent management tool by TermsFeed Policy Generator

How to Do Web Scraping in Azure Data Factory

Apresentamos nesse vídeo a técnica de garinpar dados conhecida como web scraping utilizando o Azure Data Factory, extraindo os valores de cotações da bolsa de valores em tabela de página da internet

We will know the steps:

?Create LINKED SERVICE, WEB TABLE;
?Use Integration Runtime Self-hosted (INTEGRATION RUNTIME SELF-HOSTED);
?Set website URL for stock exchange quotes (YAHOO FINANCE);
?Create Source Dataset Web Table (DATASET, WEB TABLE, SOURCE);
?Set the table index and preview the data (INDEX, PREVIEW DATA);
?Create Target Data Set File System (DATASET, FILE SYSTEM, SINK)Set
?the file format type (DELIMITEDTEXT);
?Create Pipeline with PIPELINE, COPY DATA ACTIVITY;
?Map data type of columns (IMPORT SCHEMAS);
?Run by Trigger Pipeline (TRIGGER NOW);
?View the result of the generated file on the on-premises server (CSV, WINDOWS SERVER).

This content contains
  • Content Video
  • Language Portuguese
  • Duration 9m 56s
  • Subtitles Não
  • Reading time 0 min 28 seg
avatar
Fabio Santos

Data Scientist and Consultant for Digital and Analytics Solutions

  • Share
Youtube Channel

@fabioms

Subscribe now