Repository for python scripts. These scripts include modules performed for etl, visualisation and excel output.
Contents of ETL folder
| Script name | Descripton |
|---|---|
| csvtodb.py | Script to read csv/pipe separated file , to data frame , and finally load it to oracle db. |
| config/2.txt | Config files : config.txt and config2.txt |
| dbtocsv.py | Script to read config file [config.txt], load a query to dataframe and , create a csv file from dataframe. Output file : etl/csvfiles/users.csv |
| writetofile.py | Script to write "hello world" to file and then replace the words "hello" and "world" with "Welcome" , "vidya" respectively in file. |
| dbtoxlsx.py | Script to read config file [config2.txt], load a queries to 3 dataframes and , add those dataframes as excel sheet with corresponding charts. Output file : etl/xls/emp_stats_2018_04_27_1.xlsx |
Contents of matpotlib folder
| Script name | Descripton | Plot Diagrams |
|---|---|---|
| basic_plots.py | Script to generate following charts - line chart - bar chart - histogram - scatter plot - stack plot - pie chart |
[Figure_1.png] [Figure_2.png] [Figure_3.png], [Figure_4.png] [Figure_5.png] [Figure_6.png] [Figure_7.png] |
| example.txt | data in csv format | |
| file_plots.py | Script to get data from example.txt and plot chart | [fileplot_1.png] |