CWB Project

Welcome to the CWB Project page!

(February 2006)

3, 2006 progresses

        CWB  nested domain settings.

   
     A,  Shell  and  code

       Observation processing

          1) CWB observation

               Decoder program for CWB data including the conventional data and bogus (TC bogus and Global bogus) data is OBS_FGGE_PROC.tar.gz (20061113).
                      

                   * "gunzip" and un-tarred this file, you will see a "README" file to tell you how to use this program;
                   * The observation errors for global bogus soundings are same as the real soundings specified by OBS preprocessor "3DVAR_OBSPROC".
                      The observation errors for TC bogus are defined in the "module_bogus_ty.F" under  the directory "OBS_FGGE_PRO/src":

                        ! for observation errors
                          REAL, DIMENSION (200) :: uerr, verr
                          REAL                  :: slperr, tc_lat, tc_lon, dis_degree, ratio
                          REAL, PARAMETER       :: max_dis_degree = 6.
                          REAL, PARAMETER       :: vb0 = 0.5, vb1 = 1.5   !wind error m/s at 1000hPa
                          REAL, PARAMETER       :: vt0 = 1.0, vt1 = 2.5   !wind error m/s at 400hPa
                          REAL, PARAMETER       :: ps0 = 50., ps1 = 200.  !slp error Pa

                   * Because the CWB operational TC Bogus data do not include the SLP (Sea Level Pressure) values, the subroutine module_bogus_ty.F is
                      modified to retrive the SLP from the 1000 hPa height based on the hydrostatic assumption. (Y.R. Guo and H.-C. Lin, 20060117)

                   * Hui-Chuan Lin added the mesonet and AWS decoder to the programa, and modified the OBS_FGGE_PROC/STATION.METAR. For details,
                      please read the README file under OBS_FGGE_PROC. Note that something were included specially for CWB surface and sounding data
                      (20060626).

                        The mesonet and aws  surface OBS (FGGE format) processing are added as the SYNOP (FM-12) type.  The details can be
                        found from  the file  "OBS_FGGE_PROC/README" . A run shell script: runcwbobsproc.csh is included for running decoder and 3DVAR_OBSPROC,
                        and after editing this shell script, the usage is: "runcwbobsproc.csh  yyyymmddhh"

                   * a utility advance_cymdh from the program advance_cymdh.f90 (20050902) should be under your ~/bin directory when you run OBS_FGGE_PROC
                       for the time advancing.

             2) GPS RO data

                   The shell script to download the level2/wetPrf data from COSMIC/CDAAC is Download_wetPrf.csh (20050902).

                   The decoder program for wetPrf data (netCDF file to ASCII little_r file) is wetPrf_decoder.tar.gz (20050902) After "gunzip" and untarred this file, you'll see
                    a README file under the directory "wetPrf_decoder" and a shell script "Run_wetPrf_decoder.csh". Read these files, and edit the shell script to get
                    the ASCII little_r file for 3D-Var OBS preprocessor.

                      The extended abstract for 2006 WRF workshop

                            Observation Error Statistics of Spaced-based GPS RO in WRF-Var system and Numerical Experiments for Tyhoon Dujuan.   
                           X.-X. Ma (Shanghai Meteorological Bureau & NCAR), Y.-R.Guo, Y.-H.Kuo, H.-C.Lin (National Center for Atmospheric Research)

                      can be downloaded from

                           http://www.mmm.ucar.edu/events/2006wrfusers/agenda.php

                      by click "P4.4".

                      GPSRO BUFR data processing:

                      As  the Task 2 a), the GPSRO BUFR data processing software was developed for CHAMP and COSMIC mission, including

                         a) shell script for downloading the BUFR format GPSRO files from CDAAC website: Download_bfrPrf.csh. User just need to edit the head part of this shell script
                              to provide the information of the data sources and time.

                         b) BUFR data decoder program: bfrPrf_decoder.tar.gz. After un-tarred this file, there is a directory: gps_bufr_decoder, will be created, under which there is a
                               README.txt. Users can use this decoder programs following the instructions in READ.txt.

                         c) Since COSMIC people said that the QC flag is too conservative for summer COSMIC GPSRO data at memont, the "discard" flag for COSMIC GPSRO
                               BUFR data currently turned off in 3DVAR_OBSPROC. The number of the available COSMIC GPSRO profiles over north hemisphere is significant increased.

                         GPSRO BUFR data decoder is upgraded. The QC flag (pccf) is now under consideration because COSMIC people thought that is OK since September.
                         Now the decoded data from GPSRO bfrPrf data are include the lat, lon, height, refractivity, azimuth angle, impact parameter, and bending angle. These
                         data could be used by local operator, non-local operator, and future, the bending angle assimilation.
                       
                         From now on, we do suggest to use GPSRO BUFR
for WRFVar data assimilation!

             3) Dropsonde data for Typhoon Dujuan, Haitang, and Longwang

                   The dropsonde data have been collected for Typhoon Dujuan (10), Haitang (29), and Longwang (23). The original data files are in WMO format.
                   The shell script and decoder program to convert these WMO format data to LITTLE_R format has been developed. Users can download this file
                  (dropdecode.tar.gz), un-tar it to get the shell script and code. Carefully to read the internal documetation in the shell script dropdecode.csh , edit it,
                   and provide the data files with the correct filenames, and then run the job to get the LITTLE_R file for use of the OBS preprocessor.

            4) Ground-based GPS data processing:

                 i.  The raw ground-based GPS data are obtained from CWB (the month of July 2005). Then COSMIC (John Braun) processed that dataset and provided us the Text files.
            ii. We developed a decoder program: GPSPW_decoder to convert the Text files to LITTLE_R format ASCII files for use of the 3DVAR_OBSPROC in data assimilation system.          

                   The GPSPW data for Typhoon Haitang (14 to 23 July 2005) processded by John Braun, COSMIC can be downloaed here.

            5) 3D-Var OBS preprocessor

                      There are more functions (specification for new GPS Ref errors, global bogus error, etc.) particular for CWB project in 3D-Var OBS preprocessor,
                      which is different from that in the released WRF-Var code. Further modifications were implemented in 3DVAR_OBSPROC because
                            a, Discaded the "bad" flag for FORMOSAT-3/COSMIC GPSRO data;
                            b, For  CWB GPSPW, the data with error > 1 cm are regarded as the missing data.

                      The 3D-Var preprocessor program must be downloaded here: 3DVAR_OBSPROC.tar.gz (20061113).

                      This 3DVAR_OBSPROC is same as that from CVS repository, which include
                            1) the NCEP prebufr format output,
                            2) AIRS data processing;
                            3) updated GPSRO refractivity OBS errors (Chen and Kuo 2005);
                            4) GPSRO Excess phase data processing.

                      You can find what is updated from 3DVAR_OBSPROC/README file after un-tarred the 3DVAR_OBSPROC.tar.gz.

       Data assimilation

             The updated 3D-Var assimilation code  can be downloaded here: wrfvar_2.1.tar.gz (20060823). This is the version 2.1 of the WRF-Var code with the most recent
             bugs fixed. After un-tarred the wrfvar_2.1.tar.gz, you can find the recent changes from the directory: wrfva_2.1/da_3dvar/changes.

             The wrfvar_2.1.tar.gz is updated. Some of the bugs were fixed, and two more functions: QC-OBS and VERIFY were included (20060213):
                  
                         ANALYSIS_TYPE = 'QC-OBS'  ----- a filtered observation file "DAProg_QCed.obs" will be written out for use of the verifications.

                                                                                     The word "filtered" meas that the data passed the "check_Max_iv" and the data below the lowest model level and
                                                                                    above the highest model level for SOUND, SYNOP, METAR, SHIPS, and BUOY were removed.

                         ANALYSIS_TYPE = 'VERIFY' ----- a series of the files "DAProg_WRF-Var.statistics" will be produced and used by a utility program "plot_var_stats.F"
                                                                                    for plotting the scores (RMS and Bias errors) of the verifications.

             The documentation for VERIFY package can be found from VERIFY (ppt file) and Verifications (doc file). The necessary shell script and program can be found from
             BMB web page, under Setction D23.

             Several changes and developments are implemented in wrfvar_2.1 code on 23 August 2006:

                   1, Added the configure for x86_64 (opteron, "palm")
                   2, Bug fix
                   3, For Interpolate_stats CV5 BE

             The details can be found from wrfvar_2.1/da_3dvar/changes/change_20060823.yrg. If you want to use the "interpolate_stats" function
             (interpolate_stats = .TRUE.), you must use the shell script: DA_Run_WRF-Var.csh.new to provide the vertical level information in BE file.

             A ducument for namelist.3dvar for running wrfvar_2.1 can be found from namelist.3dvar (edit needed).

            To prepare running the WRFV2.2 released soon, a wrfvar_2.2.beta version is provided before the wrfvar_2.2 officially releases.
            This beta version of wrfvar can ingest both of the first guesses from WRFV2.1 (SI and forecast) and WRFV2.2 (WPS and forecast), but the output of
            analysis (wrf_3dvar_output) can only be used to initiate the WRFV2.2 model.

             Plotting the INCREMENT fields from wrfvar:

                      There are several ways to plot the increment fields from the wrfvar results:
                      a) Using the "diff" function in RIP4;
                      b) Using NCL;
                      c) Using the utility program provided in wrfvar (see Single_OBS, ppt file) and MM5/GRAPH if you are familiar with MM5 system.

             After you got the new analysis at the initial time by 3D-Var assimilation with WRF-Var, you need to update the boundary condition file "wrfbdy" by
             using utility program downloaded from the above web site by clicking WRF BC update tar file from the web site

                    http://www.mmm.ucar.edu/wrf/users/download/get_source2.html.                    

         WRF model

                The WRF forecast model can also be dowloaded from the web below site by clicking WRF model tar file
 

                    http://www.mmm.ucar.edu/wrf/users/download/get_source2.html

 
        Background error statistics (gen_be)

             Document for Stage0  (doc file)

             A complete description of the Background Error Statistics (BES) in WRF 3D-Var can be found from WRFVAR_BE, and the ppt file can be downloaded
             from WRFVAR_BE_Guo.ppt.

             Before starting Stage0, user must split the WRF model multiple times forecast files into the single time forecast files for input to Stage0. A utility program, wrfout_split,
             has been developed. Users can find the shell script, time_split.csh, after un-tarred the "wrfout_split.tar.gz" file, and edit this script for your application.

          A simplified gen_be_Stage0 code has developed and intensively tested in PC Linux with CWB/WRF forecast data (45-km domain, period of 2003081500Z to 2003091500Z).

          For use of AFWA (US Air Force Weather Agency) and CWB IBM Power5, in addition to the PC Linux, the gen_be_Stage0 code is working on IBM AIX system.

            The results are identical to those from WRFVAR-Stage0 code, but with much short and clean code and compiling much faster. This code can be applied to both MM5 and
            WRF regional models. A README file is included in the tar file (gen_be_Stage0.tar.gz (20060318)).

             Background Error Statistics (BES) files derived in NCAR:

             Summer:

                    Based on the one month forecast files from wrfvar/WRF 6-h  cycling runs (2005070100Z to 2005073118Z), the BES files for domain1 with 45-km
             gridsize (222x128x31) and domain2 with 15-km resolution (178x190x31) were derived. There are total (4x30+3) = 123 samples of (24h-12h) forecast
             differences files used in this BES files derivation. These files are be_45km.cv_5.200507 abd be_15km.cv_5.200507.

    B,  Project progresses

        1) Status of the 2005 CWB project

           The briefly description of the staus of 2005 CWB project can be found from  CWB_progress_200508(doc file) (not completed).

           The presentation for FORMOSA-3 (ppt file) Science workshop, 7 October 2005, Taiwan.

            We reported the 2005 CWB progresses to Mr. Shen, Director of IT Division, CWB on 7 October 2005 in NCAR. The ppt file can be found from
            Report_CWB_Oct2005, including the plan for future work (2006 Tasks).

            The annual report (doc file) from NCAR has been sent to Dr. Terng, CWB on 2 December 2005.

          2) Status of the 2006 CWB project

             Chiang's report for Background error statistic tuning: winter (ppt file) and summer (ppt file).
             Chiang's report for GPSPW assimilation( ppt file).

             Hui-Chuan Lin's report for FGAT and AWS assimilation (pdf file).

             Annual review for 2006 CWB project was completed in 29 November 2006 in CWB, Taiwan. Dr. Bill Kuo gave the presentation
             "Operational Implementation of the WRF-Var System  and  Typhoon Data Assimilation (ppt file)" during the review meeting.
             The "Final Report for 2006 CWB project" can be found here (doc file)".

    C, Typhoon Dujuan experiments

        The Typhoon Dujuan track data can be found from Dujuan Track .
      
 
        The namelist files for experiment at 2003082812Z are

             1) wrfsi.nl for running wrfsi with NCEP AVN data from ftp.ucar.edu anonymous account under directory: /pub/mmm/guo/AVN_Dujuan
             2) namelist.3dvar_obs for running 3D-Var OBS preprocessor 3DVAR_OBSPROC;
             3) namelist.nfs for running converter nfs2wrfvar (20051012) in CWB machine (Linux): msccs1.msc.cwb:/users4/hclin/WRFVAR
             4) namelist.3dvar for running wrf 3D-Var: wrfvar;
             5) namelist.input for running the WRF model;


        The 72-h WRF forecasts from the 6-h cycling mode by assimilating the conventional, global bogus, and TC bogus data with WRFVAR starting from
         1200 UTC 28 to 1200 UTC 31 August 2003 can be obtained from ftp.ucar.edu:anonymous account under the directory:
         /pub/mmm/guo/CYC_CVB or from NCAR MASS Storage System (MSS) under the path: /MAXX/palm/exp3/wrfout 


   D, Typhoon Haitang

        The best track (plot) of Typhoon Haitang (data).

        The distribution of the GPS RO soundings during the period of 2005071500Z to 2005072100Z.

         The OBSERVATION data for Typhoon Haitang can be found from she.cosmic.ucar.edu:/she6/hclin/data/Haitang_OBS.

       The extended abstract for 2006 WRF Workshop 

                Impact of WRFVar (3DVar) Background Error Statistics on Typhoon analysis and Forecast .  
               Y.-R. Guo, H.-C. Lin, X. X. Ma and X.-Y. Huang (NCAR), C.T. Terng (Central Weather Bureau, Taiwan) and Y.-H. Kuo (NCAR)

           can be downloaded from

               http://www.mmm.ucar.edu/events/2006wrfusers/agenda.php

            by click "P4.2"

                The poster  for this study  can be seen from WRF2006_POSTER_guo  (ppt file).

    E, Typhoon Longwang

        The best track (plot) of Typhoon Longwang (data).

        The distribution of the GPS RO soundings during the period of 2005092800Z to 200510400Z.

        The OBSERVATION data for Typhoon Longwang can be found from: she.cosmic.ucar.edu:/she6/hclin/data/Longwang_OBS.

     F, Hurrican Florence

                The poster for the 2nd FORMOSAT-3/COSMIC data user's workshop can be seen from COSMIC_POSTER (ppt file).



        ** The Typhoon Bogus Bogus_data_distribution_2004062912

 

                                                   



For comments, send email to mesouser@ucar.edu

Last Modified: 28 April 2005