removed special charaters from csv files

Variable.csv

@@ -1,43 +1,43 @@
 tableName,variableName,key,variableType,variableDesc
-Sample,sampleID,Primary Key,string,Unique identification for sample. Suggestion:?siteID-date-index.
+Sample,sampleID,Primary Key,string,Unique identification for sample. Suggestion:siteID-date-index.
 Sample,siteID,Foreign key,string,Links with the Site table to describe the location of sampling.
-Sample,dateTime,,datetime,"for grab samples this is the?date, time and timezone?the sample was taken."
-Sample,dateTimeStart,,datetime,"For integrated time averaged samples this is the?date, time and timezone?the sample was started being taken."
-Sample,dateTimeEnd,,datetime,"For integrated time average samples this is the?date, time and timezone?the sample was finished being taken."
+Sample,dateTime,,datetime,"for grab samples this is the date, time and timezone the sample was taken."
+Sample,dateTimeStart,,datetime,"For integrated time averaged samples this is the date, time and timezone the sample was started being taken."
+Sample,dateTimeEnd,,datetime,"For integrated time average samples this is the date, time and timezone the sample was finished being taken."
 Sample,type,,category,Type of sample.
 Sample,typeOther,,string,Description for other type of sample not listed in
 Sample,collection,,category,Method used to collect the data.
-Sample,collectionOther,,string,Description for other type of method not listed in?collection.
-Sample,preTreatment,,boolean,Was the sample chemically treated in anyway with the addition of stabilizers or other?
-Sample,preTreatmentDescription,,string,If?preTreatment?then describe the treatment that was performed.
-Sample,pooled,,boolean,"Is this a pooled sample, and therefore composed of multiple child samples obtained at different sites?"
-Sample,children,,string,If this is a sample with many smaller samples either because of pooling or sub-sampling this indicates?a comma separated list of child sampleID's.
-Sample,parent,,string,If this sample has been pooled into one big sample for analysis this indicates the?sampleID of the larger pooled sample.
+Sample,collectionOther,,string,Description for other type of method not listed in collection.
+Sample,preTreatment,,boolean,Was the sample chemically treated in anyway with the addition of stabilizers or other 
+Sample,preTreatmentDescription,,string,If preTreatment then describe the treatment that was performed.
+Sample,pooled,,boolean,"Is this a pooled sample, and therefore composed of multiple child samples obtained at different sites "
+Sample,children,,string,If this is a sample with many smaller samples either because of pooling or sub-sampling this indicates a comma separated list of child sampleID's.
+Sample,parent,,string,If this sample has been pooled into one big sample for analysis this indicates the sampleID of the larger pooled sample.
 Sample,sizeL,,float,Total volume of water or sludge sampled.
 Sample,fieldSampleTempC,,float,Temperature that the sample is stored at while it is being sampled. This field is mainly relevant for composite samples which are either kept at ambient temperature or refrigerated while being sampled.
-Sample,shippedOnIce,,boolean,Was the sample kept cool while being shipped to the lab?
-Sample,storageTempC,,float,?Temperature that the sample is stored at in Celsius.
-Sample,qualityFlag,,boolean,Does the reporter suspect the sample having some quality issues?
+Sample,shippedOnIce,,boolean,Was the sample kept cool while being shipped to the lab 
+Sample,storageTempC,,float, Temperature that the sample is stored at in Celsius.
+Sample,qualityFlag,,boolean,Does the reporter suspect the sample having some quality issues 
 Sample,notes,,string,Any additional notes.
 WWMeasure,uWwMeasureID,Primary Key,string,Unique identifier a measurement within the measurement table.
-WWMeasure,wwMeasureID,,string,Unique identifier for wide table only. Use when all measures are performed on a single sample at the same time and same laboratory. Suggestion:?siteID_sampleID_LabID_reportDate_ID.
-WWMeasure,sampleID,Foreign key,string,?Links with the identified Sample
+WWMeasure,wwMeasureID,,string,Unique identifier for wide table only. Use when all measures are performed on a single sample at the same time and same laboratory. Suggestion: siteID_sampleID_LabID_reportDate_ID.
+WWMeasure,sampleID,Foreign key,string, Links with the identified Sample
 WWMeasure,labID,Foreign key,string, Links with the identified Lab that performed the analysis.
-WWMeasure,assayID,Foreign key,string,?Links with the?AssayMethod?used to perform the analysis. Use?instrument.ID?for measures that are not viral measures.
-WWMeasure,instrumentID,Foreign key,string,inks with the?Instrument?used to perform the analysis. Use?assay.ID?for viral measures.
+WWMeasure,assayID,Foreign key,string, Links with the AssayMethod used to perform the analysis. Use instrument.ID for measures that are not viral measures.
+WWMeasure,instrumentID,Foreign key,string,inks with the Instrument used to perform the analysis. Use assay.ID for viral measures.
 WWMeasure,reporterID,Foreign key,string,Links with the reporter that is responsible for the data.
 WWMeasure,analysisDate,,date,date the measurement was performed in the lab.
-WWMeasure,reportDate,,date,"date the data was reported. One sampleID may have updated reports based on updates to assay method or reporting standard. In this situation, use the original?sampleID?but updated?MeasureID,?reportDate?and?assayID?(if needed)."
+WWMeasure,reportDate,,date,"date the data was reported. One sampleID may have updated reports based on updates to assay method or reporting standard. In this situation, use the original sampleID but updated MeasureID, reportDate and assayID (if needed)."
 WWMeasure,fractionAnalyzed,,category,Faction of the sample that is analyzed.
 WWMeasure,type,,category,"The variable that is being measured on the sample, e.g. a SARS-CoV-2 gene target region (cov), a biomarker for normalisation (n) or a water quality parameter (wq)."
-WWMeasure,typeOther,,string,Description for an other variable not listed in?category.
+WWMeasure,typeOther,,string,Description for an other variable not listed in category.
 WWMeasure,unit,,category,Unit of the measurement.
-WWMeasure,unitOther,,string,Description for other measurement unit not listed in?unit.
+WWMeasure,unitOther,,string,Description for other measurement unit not listed in unit.
 WWMeasure,aggregation,,category,"Statistical measures used to report the sample units of Ct/Cq, unless otherwise stated. Each aggregation has a corresponding value."
-WWMeasure,aggregationOther,,string,Description for other type of aggregation not listed in?aggregation.
+WWMeasure,aggregationOther,,string,Description for other type of aggregation not listed in aggregation.
 WWMeasure,index,,integer,Index number in case the measurement was taken multiple times.
 WWMeasure,value,,float,The actual measurement value that was obtained through analysis.
-WWMeasure,qualityFlag,,boolean,Does the reporter suspect the measurement having some quality issues?
+WWMeasure,qualityFlag,,boolean,Does the reporter suspect the measurement having some quality issues 
 WWMeasure,accessToPublic,,boolean,"If this is 'no', this data will not be available to the public. If missing, data will be available to the public."
 WWMeasure,accessToAllOrg,,boolean,"If this is 'no', this data will not be available to any partner organization. If missing, data will be available to the all organizations."
 WWMeasure,accessToSelf,,boolean,"If this is 'no', this data will not be shown on the portal when this reporter logs in. If missing, data will be available to this reporter."
@@ -51,34 +51,34 @@ Site,siteID,Primary Key,string,Unique identifier for the location where wastewat
 Site,name,,string,"Given name to the site. Location name could be a treatment plant, campus, institution or sewer location, etc."
 Site,description,,string,"Description of wastewater site (city, building, street, etc.) to better identify the location of the sampling point."
 Site,type,,category,Type of site or institution where sample was taken.
-Site,typeOther,,string,Description of the site when the site is not listed. See?siteType.
-Site,SampleTypeDefault,,category,Used as default when a new sample is created for this site. See?type?in?Sample?table.
-Site,SampleTypeOtherDefault,,string,Used as default when a new sample is created for this site. See?typeOther?in?Sample?table.
-Site,SampleCollectionDefault,,category,Used as default when a new sample is created for this site. See?collection?in?Sample?table.
-Site,SampleCollectOtherDefault,,string,Used as default when a new sample is created for this site. See?collectionOther?in?Sample?table.
-Site,SampleStorageTempCDefault,,float,Used as default when a new sample is created for this site. See?storageTempC?in?Sample?table.
-Site,MeasureFractionAnalyzedDefault,,category,Used as default when a new measurement is created for this site. See?fractionAnalyzed?in?Measurement?table.
-Site,geoLat,,float,"?Site geographical location, latitude in decimal coordinates, ie.: (45.424721)"
-Site,geoLong,,float,"?Site geographical location, longitude in decimal coordinates, ie.: (-75.695000)"
+Site,typeOther,,string,Description of the site when the site is not listed. See siteType.
+Site,SampleTypeDefault,,category,Used as default when a new sample is created for this site. See type in Sample table.
+Site,SampleTypeOtherDefault,,string,Used as default when a new sample is created for this site. See typeOther in Sample table.
+Site,SampleCollectionDefault,,category,Used as default when a new sample is created for this site. See collection in Sample table.
+Site,SampleCollectOtherDefault,,string,Used as default when a new sample is created for this site. See collectionOther in Sample table.
+Site,SampleStorageTempCDefault,,float,Used as default when a new sample is created for this site. See storageTempC in Sample table.
+Site,MeasureFractionAnalyzedDefault,,category,Used as default when a new measurement is created for this site. See fractionAnalyzed in Measurement table.
+Site,geoLat,,float," Site geographical location, latitude in decimal coordinates, ie.: (45.424721)"
+Site,geoLong,,float," Site geographical location, longitude in decimal coordinates, ie.: (-75.695000)"
 Site,notes,,string,Any additional notes.
 Site,polygonID,Foreign key,string,"Links with the Polygon table, this should encompass the area that typically drains into this site."
 Site,sewerNetworkFileLink,,string,Link to a file that has any detailed information about the sewer network associated with the site (any format).
-Site,sewerNetworkFileBLOB,,blob,?A file blob that has any detailed information about the sewer network associated with the site (any format).
+Site,sewerNetworkFileBLOB,,blob, A file blob that has any detailed information about the sewer network associated with the site (any format).
 SiteMeasure,uSiteMeasureID,Primary Key,string,Unique identifier for each measurement for a site.
 SiteMeasure,siteMeasureID,,string,Unique identifier for wide table only. Use when all measures are performed on a single sample.
-SiteMeasure,siteID,Foreign key,string,?Links with the Site table to describe the location of measurement.
-SiteMeasure,instrumentID,Foreign key,string,Links with the?Instrument?table to describe instrument used for the measurement.
+SiteMeasure,siteID,Foreign key,string, Links with the Site table to describe the location of measurement.
+SiteMeasure,instrumentID,Foreign key,string,Links with the Instrument table to describe instrument used for the measurement.
 SiteMeasure,reporterID,Foreign key,string,Links with the reporter that is responsible for the data.
 SiteMeasure,dateTime,,date,The date and time the measurement was performed.
-SiteMeasure,type,,category,"The type of measurement that was performed. The prefix?env?is used for environmental variables, whereas?ww?indicates a measurement on wastewater."
-SiteMeasure,typeOther,,string,Description of the measurement in case it is not listed in?type.
+SiteMeasure,type,,category,"The type of measurement that was performed. The prefix env is used for environmental variables, whereas ww indicates a measurement on wastewater."
+SiteMeasure,typeOther,,string,Description of the measurement in case it is not listed in type.
 SiteMeasure,typeDescription,,string,Additional information on the performed measurement.
 SiteMeasure,aggregation,,category,"When reporting an aggregate measurement, this field describes the method used."
-SiteMeasure,aggregationOther,,string,Description for other type of aggregation not listed in?aggregation.
+SiteMeasure,aggregationOther,,string,Description for other type of aggregation not listed in aggregation.
 SiteMeasure,aggregationDesc,,string,Information on OR reference to which measurements that were included to calculate the aggregated measurement that is being reported.
-SiteMeasure,value,,float,?The actual value that is being reported for this measurement.
-SiteMeasure,unit,,string,?The engineering unit of the measurement.
-SiteMeasure,qualityFlag,,boolean,Does the reporter suspect quality issues with the value of this measurement?
+SiteMeasure,value,,float, The actual value that is being reported for this measurement.
+SiteMeasure,unit,,string, The engineering unit of the measurement.
+SiteMeasure,qualityFlag,,boolean,Does the reporter suspect quality issues with the value of this measurement 
 SiteMeasure,accessToPublic,,boolean,"If this is 'no', this data will not be available to the public. If missing, data will be available to the public."
 SiteMeasure,accessToAllOrgs,,boolean,"If this is 'no', this data will not be available to any partner organization. If missing, data will be available to the all organizations."
 SiteMeasure,accessToSelf,,boolean,"If this is 'no', this data will not be shown on the portal when this reporter logs in. If missing, data will be available to this reporter."
@@ -89,42 +89,42 @@ SiteMeasure,accessToOtherProv,,boolean,"If this is 'no', this data will not be a
 SiteMeasure,accessToDetails,,boolean,More details on the existing confidentiality requirements of this measurement.
 SiteMeasure,notes,,string,Any additional notes.
 Reporter,reporterID,Primary Key,string,Unique identifier for the person or organization that is reporting the data.
-siteIDDefault,,Foreign key,string,Used as default when a new sample is created by this reporter. See?ID?in?Site?table.
-labIDDefault,,Foreign key,string,Used as default when a new sample is created by this reporter. See?ID?in?Lab?table.
+siteIDDefault,,Foreign key,string,Used as default when a new sample is created by this reporter. See ID in Site table.
+labIDDefault,,Foreign key,string,Used as default when a new sample is created by this reporter. See ID in Lab table.
 contactName,,,string,"Full Name of the reporter, either an organization or individual."
-contactEmail,,,string,?Contact e-mail address.
+contactEmail,,,string, Contact e-mail address.
 contactPhone,,,string,Contact phone number.
 notes,,,string,Any additional notes.
 Lab,labID,Primary Key,string,Unique identifier for the laboratory.
-Lab,assayMethodIDDefault,Foreign key,string,Used as default when a new measurement is created for this lab. See?ID?in?AssayMethod?table.
+Lab,assayMethodIDDefault,Foreign key,string,Used as default when a new measurement is created for this lab. See ID in AssayMethod table.
 Lab,name,,string,Name corresponding to lab.
 Lab,contactName,,string,"Contact person or group, for the lab."
 Lab,contactEmail,,string,"Contact e-mail address, for the lab."
 Lab,contactPhone,,string,"Contact phone number, for the lab."
 Lab,updateDate,,date,date information was provided or updated.
 AssayMethod,assayMethodID,Primary Key,string,Unique identifier for the assay method.
-AssayMethod,instrumentID,Foreign key,string,Links with the?Instrument?table to describe instruments used for the measurement.
+AssayMethod,instrumentID,Foreign key,string,Links with the Instrument table to describe instruments used for the measurement.
 AssayMethod,name,,string,Name of the assay method.
 AssayMethod,version,,string,Version of the assay. Semantic versioning is recommended.
 AssayMethod,summary,,string,Short description of the assay and how it is different from the other assay methods.
 AssayMethod,referenceLink,,string,Link to standard operating procedure.
 AssayMethod,date,,date,date on which the assayMethod was created or updated (for version update).
-AssayMethod,aliasID,,string,ID of an assay that is the same or similar.?a comma separated list.
+AssayMethod,aliasID,,string,ID of an assay that is the same or similar. a comma separated list.
 AssayMethod,sampleSizeL,,float,Size of the sample that is analyzed in liters.
 AssayMethod,loq,,float,Limit of quantification (LOQ) for this method if one exists.
 AssayMethod,lod,,float,Limit of detection (LOD) for this method if one exists.
 AssayMethod,unit,,category,"Unit used by this method, and applicable to the LOD and LOQ."
 AssayMethod,unitOther,,string,"Unit used by this method, that are applicable to the LOD and LOQ."
 AssayMethod,methodConc,,string,Description of the method used to concentrate the sample
-AssayMethod,methodExtract,,string,?Description of the method used to extract the sample
+AssayMethod,methodExtract,,string, Description of the method used to extract the sample
 AssayMethod,methodPcr,,string,Description of the PCR method used
 AssayMethod,qualityAssQC,,string,Description of the quality control steps taken
 AssayMethod,inhibition,,string,Description of the inhibition parameters.
 AssayMethod,surrogateRecovery,,string,Description of the surrogate recovery for this method.
 Instrument,instrumentID,Primary Key,string,Unique identifier for the assay method.
 Instrument,name,,string,Name of the instrument used to perform the measurement.
 Instrument,model,,string,Model number or version of the instrument.
-Instrument,description?,,string,Description of the instrument.
+Instrument,description ,,string,Description of the instrument.
 Instrument,alias,,string,ID of an assay that is the same or similar. A comma separated list.
 Instrument,referenceLink,,string,Link to reference for the instrument.
 Instrument,type,,category,Type of instrument used to perform the measurement.
@@ -138,10 +138,10 @@ Polygon,file,,blob,"File containing the geometry of the polygon, blob format."
 Polygon,link,,string,Link to an external reference that describes the geometry of the polygon.
 CovidPublicHealthData,cphdID,Primary Key,string,Unique identifier for the table.
 CovidPublicHealthData,reporterID,Foreign key,string,ID of the reporter who gave this data.
-CovidPublicHealthData,polygonID,Foreign key,string,Links with the?Polygon?table.
+CovidPublicHealthData,polygonID,Foreign key,string,Links with the Polygon table.
 CovidPublicHealthData,date,,string,date of reporting for covid-19 measure.
 CovidPublicHealthData,type,,category,Type of covid-19 patient data.
-CovidPublicHealthData,dateType,,category,Type of date used for?conf?cases. Typically?report?or?episode?are reported.?onset?and?test?date is not usually reported within aggregate data.
+CovidPublicHealthData,dateType,,category,Type of date used for conf cases. Typically report or episode are reported. onset and test date is not usually reported within aggregate data.
 CovidPublicHealthData,value,,float,The numeric value that is being reported.
 CovidPublicHealthData,notes,,string,Any additional notes.
 Lookup,tableName,,string,Name of the Table