web scraping - Error 500 while webscraping with rvest -
i trying webscrape code below, getting following warning message:
in request_post(session, url = url, body = request$values, encode = request$encode, : internal server error (http 500)
what doing wrong?
library(rvest):
sisben <-html_session("https://wssisbenconsulta.sisben.gov.co/dnp_sisbenconsulta/dnp_sisben_consulta.aspx") form <- html_form(sisben)[[1]] fillform <- set_values(form,"ddltipodocumento" = "cédula de ciudadanía", "tboxnumerodocumento" = "1234") sis <- submit_form(session=sisben, form=fillform)
what data want scrape? me code rather looks if interact page (fill in form , submit), not see rvest code use scrape data.
regarding error: looking @ html source code looks submit label of "tipo de documento", not correct internal value (which numbered)
<option value="-1">seleccione...</option> <option value="1">cédula de ciudadanía</option> <option value="3">cédula de extranjería</option> <option selected="selected" value="4">registro civil</option> <option value="2">tarjeta de identidad</option> i didn't receive error using option value input:
fillform <- set_values(form,"ddltipodocumento" = "1", "tboxnumerodocumento" = "1234") sis <- submit_form(session=sisben, form=fillform) leads output:
submitting 'tboxnumerodocumento'
maybe looking for?
Comments
Post a Comment