web scraping - Error 500 while webscraping with rvest -


i trying webscrape code below, getting following warning message:

in request_post(session, url = url, body = request$values, encode = request$encode, : internal server error (http 500)

what doing wrong?

library(rvest):

sisben <-html_session("https://wssisbenconsulta.sisben.gov.co/dnp_sisbenconsulta/dnp_sisben_consulta.aspx")  form <- html_form(sisben)[[1]]  fillform <- set_values(form,"ddltipodocumento" = "cédula de ciudadanía", "tboxnumerodocumento" = "1234")  sis <- submit_form(session=sisben, form=fillform) 

what data want scrape? me code rather looks if interact page (fill in form , submit), not see rvest code use scrape data.

regarding error: looking @ html source code looks submit label of "tipo de documento", not correct internal value (which numbered)

<option value="-1">seleccione...</option> <option value="1">c&#233;dula de ciudadan&#237;a</option> <option value="3">c&#233;dula de extranjer&#237;a</option> <option selected="selected" value="4">registro civil</option> <option value="2">tarjeta de identidad</option> 

i didn't receive error using option value input:

fillform <- set_values(form,"ddltipodocumento" = "1", "tboxnumerodocumento" = "1234") sis <- submit_form(session=sisben, form=fillform) 

leads output:

submitting 'tboxnumerodocumento'

maybe looking for?


Comments

Popular posts from this blog

neo4j - finding mutual friends in a cypher statement starting with three or more persons -

php - How to remove letter in front of the word laravel -

minify - Minimizing css files -