人口统计主题数据库.docx

人口统计在hive路径下：1 启动服务binive-servicemetastore&2 :启动hive:bin/hrve# 建库createdatabasedzxktj;# 进摩usedz-rkt;# 建表1createtab1.etb_ana1.ysis_of_f1.oating_popu1.ation(idit.regionstring,f1.oatingpopu1.ationstring)rowformatde1.imitedfie1.dsterminatedby't'# 建表2Createtab1.etb_age_gender(idint.sectionstring,numberofpeop1.estring,numberofboysstng,numberoffema1.estudentsstring)rowformatde1.imitedfie1.dsterminatedbyt"# 建表3createtab1.etb_an1.ys»s(idint.sourcenamestring.numberstring)rowformatde1.imitedfie1.dsterminatedby't"# 建表4createtab1.etb_annua1.1._nationa1.(dint.particu1.arstring.umbe<ofpeop1.estringrowformatde1.imrtedfie1.dsterminatedbyt"# 建表5createtab1.etb_demographic(idint.nameofdtstrictstring.regiona1.popu1.ationstring)rowformatde1.imitedfie1.dsterminatedby't"# 建表6createtab1.etb_rr>ob«1.e_rea1._time_user_statistics(dint.timestring.umbe<ofpeop1.estring)rowformatde1.mrtedfie1.dsterminatedby't,;# 建表7createtab1.etb_statistics_working(idint.regionstring.numbefofresidentsstring.numberOfworkersstring)rowformatde1.imitedfie1.dsterminatedby,f:# 建表8Createtab1.etb_working_USeJstatistics(dint.nameofdtstrictstring.numberofpeop1.estring)rowformatde1.imitedfie1.dsterminatedby,f;# 数据迁移1在SqOOP目录下：bin/sqoopimport-connectjdbcmysqyhadoop2.3306dzxrktj-usernameroot-passwordroot-tab1.etb_ana1.ysis_of_fIoating_popu1.ation-num-mappers1-hre-import-hwe-databasedzx.rkt-hve-tab1.etb_ana1.ysis_of_f1.oating_popu1.ation-fie1.ds-termiated-byAf-de1.ete-target-dir#数据迁移2在sqoop目录下bin/sqoopimport-connectjdbmysqhadoop2-3306dz×-rktj-usernameroot-passwordroot-tab1.etb_age_gender-num-mappers1-hive-import-hive-databasedzx_rktj-hve-tab1.etb_age_gender-fie1.ds-terminated-byf-de1.ete-targetdir#数据迁移3在sqoop目录下：bin/sqoopimport-connectjdbcmysqiy/hadoop2.3306/dzx_rktj-usernameroot-passwordroot-tab1.etb_anfysis-num-mappers1-hrve-import-hrve-databasedzx.rktj-hive-tabteManIySiS-fie1.ds-terminated-byf-detete-target-dir#数据迁移4在sqoop目录下bin/sqoopimport-connectjdbcmysq1.hadoop23306dzx-rktj-usernameroot-passwordroot-tab1.etb_annua1.1._nationa1.-num-mappers1-hive-import-hive-databasedzx_rktj-hive-tab1.etb_annua1.1._nationa1.-fie1.ds-terminated-byV-de1.ete-target-dir#数据迁移5在SqOOP目录下：bin/sqoopimport-connectjdbcmysq1.hadoop2.3306dzxrktj-usernameroot-passwordroot-tab1.etb_demographic-num-mappers1-hre-import-hive-databasedzxkt-hive-tab1.etb_demographic-fie1.ds-terminated-byM-detete-target-dir#数据迁移6在sqoop目录下bnsqoopimport-connectjdbcmysqhadoop2-3306dz×-rktj-use<nameroot-passwordroot-tab1.etb_mobi1.e_fea1._time_user_statistics-num-mappers1-hive-import-hive-databasedzxjktj-hrve-tabtetb_mobi1.e_rea1._time_user_statisticsfie1.ds-termnated-byAf-de1.ete-target-dir#数据迁移7在sqoop目录下：bin/sqoopimport-connectjdbc：mysq1./hadoop2.3306/dzxrktj-usernameroot-passwordroot-tab1.etb_statistics_working-num-mappers1-hrve-import-hwe-databasedzxkt-hive-tab1.etb_stat»stics_working-fie1.ds-terminated-byAf-detete-target-dir#数据迁移8在sqoop目录下bin/sqoopimport-connectjdbcmysq1.hadoop23306dz×-rktj-usernameroot-passwordroot-tab1.etb_v/orking_user_statistics-num-mappers1-hive-import-hive-databasedzx_rktj-hive-tab1.eIbJVorking_USeJStatiStieS-fie1.ds-terminated-byV-de1.ete-target-dir查询1se1.ect*fromtb_ana1.ysis_ofj1.oating_popu1.ation：查询2se1.ect*fromtb_age_gender；查询3se1.ect»fromtb.an1.ysis；查询4se1.ect*fromMannUaI1.naUOnaI;查询5se1.ectfromtb_demographic;查询6se1.ect*fromtb_mobi1.e_rea1.jime_user_siatistics.查询7se1.ect*fromtbstatistics.working；查询8se1.ect*fromtb_Working_USeJStattStics;