python - How to set a specific column to a int type with pandas -


i have script writing csv files excel folder:

from pandas.io.excel import excelwriter import pandas import os  path = 'data/' ordered_list = sorted(os.listdir(path), key = lambda x: int(x.split(".")[0]))   excelwriter('my_excel.xlsx') ew:     csv_file in ordered_list:         pandas.read_csv(path + csv_file).to_excel(ew, index = false, sheet_name=csv_file[:-4], encoding='utf-8')

now problem columns (let's g:h) in string format (ex '400 or '10) ' before, think come string because of csv converting them strings, need them int, how can make g:h int?! use python 3, thank you!

ps(this csv sample):

anpis,,,,,,, agentia judeteana pentru plati si inspectie sociala timis,,,,,,, ,,,,,,, macheta comparativa creditori - numai pentru beneficiile caror evidenta se tine si in contabilitate si in aplicatia safir,,,,,,, situatie analitica - nominal la 30.06.2017,,,,,,, 1. alocatia de stat pentru copii,,,,,,, nr. benef,nume prenume,cnp,data constituirii,suma contabilitate,suma safir,differenta suma,explicatii daca exista diferente 1,2,3,4,5,6,7=5-6,8 1,cazacu mihai,133121140,aug 2016,84,84 2,nicoara petru,143152638,"aug 2014, sept 2014",126,84 3,cernea nicolae dan,143354723,dec 2015,84,84 4,ludwig petru,144091376,nov 2014,42,42 5,popa remus,1440915363,iun 2015,84,84 6,bogdan marcel,144154726,"feb 2015, apr 2015, sept 2015, oct 2015, feb 2016",336,336 7,hendre augustin,145054704,feb 2015,42,42 8,cojoc vasile,147050307,"sept 2014, oct 2014",84,84 9,radulescu victor,147352628,"sept 2014, oct 2014, nov 2014, dec 2014",168,168 10,radau dumitru,148054764,"feb 2017, mar 2017",168,168 11,covaciu petru,148054802,iun 2016,84,84 12,bot ioan,14808634,"aug 2014, sept 2014, oct 2014, nov 2014",168,168

^^ , head one:

anpis,,,,,,, agentia judeteana pentru plati si inspectie sociala timis,,,,,,, ,,,,,,, macheta comparativa creditori - numai pentru beneficiile caror evidenta se tine si in contabilitate si in aplicatia safir,,,,,,, situatie analitica - nominal la 30.06.2017,,,,,,, 1. alocatia de stat pentru copii,,,,,,, nr. benef,nume prenume,cnp,data constituirii,suma contabilitate,suma safir,differenta suma,explicatii daca exista diferente 1,2,3,4,5,6,7=5-6,8

you can read each file twice - first header parameter nrows , body skiprows.

then need write twice too.

solution bit complicated, because pandas wrong parse data - not support multtiindex 8 levels. if set no headers, data header joined body , output mess.

with excelwriter('my_excel.xlsx') ew:     csv_file in ordered_list:         df1 = pandas.read_csv(path + csv_file, nrows=8, header=none)         df2 = pandas.read_csv(path + csv_file, skiprows=8, header=none)         df1.to_excel(ew, index = false, sheet_name=csv_file[:-4], encoding='utf-8', header=false)         row = len(df1.index)         df2.to_excel(ew, index = false, sheet_name=csv_file[:-4], encoding='utf-8', startrow=row , startcol=0, header=false)

use apply remove ' strip , cast int astype:

cols = ['g','h']  excelwriter('my_excel.xlsx') ew:     csv_file in ordered_list:         df = pandas.read_csv(path + csv_file)         df[cols] = df[cols].astype(str).apply(lambda x: x.str.strip("'")).astype(int)         print (df.head())         df.to_excel(ew, index = false, sheet_name=csv_file[:-4], encoding='utf-8')

another solution use parameter converters custom function:

cols = ['g','h']  def converter(x):     return int(x.strip("'")) #define each column converters={x:converter x in cols}  excelwriter('my_excel.xlsx') ew:     csv_file in ordered_list:         df = pandas.read_csv(path + csv_file, converters=converters)         print (df.head())         df.to_excel(ew, index = false, sheet_name=csv_file[:-4], encoding='utf-8')

Comments

Post a Comment

Popular posts from this blog

neo4j - finding mutual friends in a cypher statement starting with three or more persons -

Image
i trying build cypher statement neo4j know 2-n starting nodes name , need find node (if any) can reached of starting nodes. at first tought similar "mutual friend" situation handled (start1)-[*..2]->(main)<-[*..2]-(start2) in case have more 2 starting points around 6 know name. so puzzled how can include third, fourth , on node cypher able find commmon root amongst them. in above example neo4j website need path starting 'dilshad', 'becky' , 'cesar' check if have common friend (anders) excluding 'filipa' , 'emil' not friends of three. so far create statement programmatically looks like match (start1 {name:'person1'}), (start2 {name:'person2'}), (start3 {name: 'person3'}), (main) (start1)-[*..2]->(main) , (start2)-[*..2]->(main) , (start3)-[*..2]->(main) return distinct main but wondering if there more elegant / efficient way in cypher possibly use list of names parameter ...
Read more

php - How to remove letter in front of the word laravel -

Image
based on picture above result of var_dump() , dd() of same variable ,when var_dump() , apostrophe (') symbol in black diamond of question mark , when dd() same variable , apostrophe can seen letter 'b' appear in front of words what want can me result : loreal's sdn bhd and @ same time want remove special character ( excluding these 4 symbols (-) ,(_) ,('),(,) ) simply escape special character resolve issue. mysqli_real_escape_string resolve issue. $name = mysqli_real_escape_string($request()->user); or use addslashes function() $name = addslashes($request()->user);
Read more

minify - Minimizing css files -

i want know how css files can minimized. currently, using external sites css minifier compress css files. however, after removing whitespaces, comments, etc, file sizes reduced 10-15%. how frameworks bootstrap manage make minimized versions kilobytes. as example, css is: body { background-color: #ff0; } the reduction goes 28 bytes 22 bytes other css files have lot more characters still smaller this. actually minifying code means it's remove thing code white space characters new line characters comments block delimiters it reduces amount of code has transferred on web , speed site load fastly.but unreadable format.
Read more