Thursday, December 11, 2014

Exercise 8:Raster Modeling

Goals and Objectives
In this exercise we are adding up all the skills we have worked with over the 2014 Fall Semester GIS II class. The Goal of this lab was to use multiple geoprocessing tools to bring together multiple raster files in order to figure out a suitable area to have a frac-sand mine be built in the Lower Trempealeau County. In this lab we will be building a suitability model, using layers for bedrock layers, land type usages, proximity to railroads, the slope of the land, as well as, the water table level. Using those five layers we will create a suitability model which will overlay with the risk assessment model that includes closeness to streams, prime farmland, residential areas, wildlife areas, and visibility from some of the highest peaks in Trempealeau County.

Methods
To start the lab we first had to know what type of sand formations to look for in the bedrock. Research done throughout the semester shows that the Jordan and Wonewoc formations are the best formations to use for mining purposes.

The image on the right is of the bedrock formation for Western Wisconsin. On the map there is a black outline of Lower Trempealeau County. For timing purposes we used just a segment of Trempealeau County to run our data for.

The next step was to use this information to create a ranked raster file to show which places would have the best bedrock to mine and which would not be the primary choices.






Above in the bright green color is the ideal mining locations which include the Wonewoc and the Jordan formations. The areas in gray are what would not be considered the most ideal locations to mine. Converting this file into a more pleasing image would result in changing the gray to a red or black and keep the green part green, but that will all be taken care of at the end of the first seven objectives when they all get added together.

The second step was to import the National Land Cover Data set which we downloaded and used back in Exercise 5. In this section we wanted to select areas of land which would be suitable to drill on. Suitable areas to mine on include planted and cultivated lands, or forest areas. Those areas received the best ranking, while areas of developed land and water areas/marshlands received the worst rankings.


The green areas on this image show those which rank the best in areas of suitability, while black is the worst areas to conduct a sand mine operation, and blue are areas in between the best and worst. 

The third step was to find the proximity to the rail depots. We are using the rail depots because we want to see where they can get on the rail line, not just some random point.

Just like the first two images, this one also is ranked.The closer you are to the rail depot the better ranking you would receive. Using a three category Euclidean Distance we were able to split the county up into three separate areas. 

The next step of this project was to find a relatively flat slop area, mines do not want to be found in places of high slope, so a good slope would be one closer to a flat surface. 


The image above shows what the area, using a Digital Elevation Model, the green areas are the much more flatter areas, than blue are the medium slope, and finally the red are the steeper slop areas. For this part it was important to remember that we have to have all the units the same. In the above image all units were changed to show meters.

Objective 5 required using ground water data. We used a generalized water table elevation map to make our jobs easier. After downloading, we had to import the .e00 file. Since we were unable to use the actual contour lines in the project, we converted it into a raster and added it to the list of ranked rasters which we will use in the next steps.

The image above is a screen shot from the website, Wisconsin Geological Survey, the green lines represent the individual contour lines of the ground water table. 

Objective six involves using the map algebra tool to add up all the above mentioned areas to find the most suitable areas to construct a new frac sand mine. 
After adding all the categories together we came up with a map like the one above. On the map black is the worst ranked area, followed by blue, then green, then red, then white is the best ranked areas. 

In order to make the map look more appealing, I used the block statistics tool to get rid of the salt and pepper look. On the map below, green is the most ideal spot, and the closer to red the worse it gets.


We had to also find areas where we deemed at the beginning where we would not want to build regardless of how good the land is. 

This map uses the same legend as the map above it, but the black areas are the areas where we will not be wanting to consider doing work due to what was mentioned toward the start of this blog post.

After completing the suitability model, we then moved on to creating a risk model.

Objective 8 we began to use more of the raster tools which we did not use very much in the first part. This step involved importing the river and stream flows for the lower section of the county. Since we had to pick certain streams, I chose all the streams which had a stream grade greater than or equal to 5. This way I would not have the entire county selected as being in too close proximity to a stream. 

This map shows in red the close proximity to the streams, not wanting to build there this received the worst ranking, and then the yellow was the next worst, and green was the best ranking. 

Step nine was to select areas where we were not building on prime farmland, this included prime farmland that is sometimes flooded. 
The image above shows the proximity to the prime farmland, the red is either the farmland itself, or the closest area. Then like the previous maps, yellow is the third ranked, and green is the second best. White areas rank higher than green, making them the best areas.

For objective 10, we had to run the same tools to find the residential and populated areas. Since we do not want to build a mine there they will get the worst rankings. Much like the previous maps, we will create this one by selecting the areas of interest, and then running the euclidean distance tool. And lastly reclassify the data into three categories. The three categories make it set so it will be best, medium, and worst ranked. 

Just like the previous maps, red is the worst, closest proximity to residential, or populated areas. Then yellow is the second closest, and lastly green is the best, furthest area.

The next task will find the impact to the schools. This was included in objective 10, as populated areas, but for the sake of this lab, I found the school data and had to separate the operational schools from the historical schools. 



The last step I had was to do something of my choice. I chose to figure out how close into proximity the wild life areas were. 

Again just like the other maps, the red is the worst area, the yellow is second best and the green is the best when it comes to proximity to the wild life areas. 

After calculating the risk assessment for each of the five categories, just like in the previous half of this lab we will use the map algebra tool in order to find the areas of most risk.

After running the tool we get the near finished product pictured below. 

The green areas are the best, down to the dark red being the worst. There are several areas on the map where a frac sand mine would be acceptable with little risk. Those involve the northeast corner of the county, as well as in the middle of the county there are several locations which would be fitting. 

It is important to take not that this data may not be used to calculate an exact location for a frac mine because it only takes into account of this counties data. The northeastern section may not be as risk free as the map shows because it may have other implications from the surrounding counties. 

Taking the risk assessment and combining it with the suitability map we created we can find the least issued based area.

Again, the areas of red are the worst, up to green being the best.

The last step of this project was to use the visibility tool from prime recreational areas. I chose to use the highest eight peaks in the county to use as my visual sites. Again using the Digital Elevation Model and the visibility tool we were able to see what areas were visible, and overlapped it onto the above map. 

The most suitable and risk free areas, with the least amount of visibility are located in the middle as well as the northeastern corner of the county. 



The last part of this lab was to create a flow chart data flow model of all the steps we did. All the steps mentioned above are included in the model, as well as many other steps which were not mentioned in the methods portion.



Lastly, mentioned in the reading regarding the rankings, the table shows the rankings again.


Python Portion
The second part of the lab was to create a Python Script to show which areas of the previously mentioned five risk assessment areas would have a heavier impact. The area I chose to have the highest impact was streams.

And then using this Pyscript we were able to come up with a slightly different map then from above, note this map was not combined with the sustainability map, it is solely a stream weighted risk assessment map.



Conclusion
Overall the data we used to make the map can show where the best areas are with the most suitability to the environment, and the least amount of risk. As stated in the blog this data should not be used alone to figure out where to build a mine. There are far more areas to consider such as road usages, proximity to other mines, cost, and you will have to use other county's data to get a more full looking and accurate map.

Sources
http://wgnhs.uwex.edu/maps-data/gis-data/








Friday, November 21, 2014

GIS II-Exercise 7: Network Analysis

Goals of Exercise 7
In Exercise Seven we split the lab up into two different parts. The first part of the lab, the goal was to be able write a Python Script (see blog post below to view python script). After running the script we were left with 41 mines to use for part two.

In part two of the lab, we were to use Network Analysis tools to figure out the distance from the mines to the closest rail terminal, using roadways. Finally, after accumulating the routes, we were to find how much it cost each individual county to have these trucks running on the roads (equation further down on blog).

Data sets we will be using include, Wisconsin County Map, ESRI street map of the United States, and the points we found in the previous part.

Lastly, in order to calculate the cost we used the equation of 50 trucks per year drive down the roads at 2.2 cents per mile. The trucks will also have to make the trip back from the train rail to the sand mine. In order to calculate this I used an equation of 100 trucks times the 2.2 cents per mile.

Methods

The model above shows the step by step process to figure out the routes needed for the mines to get to the closest rail terminal. 
This involved using the streets layer, and the network analysis to find the closest facility. Next we had to add the mines we found in the previous part of the lab and again find the closest facility. Lastly we added the rail terminals and found the closest facility, and solved. Next we selected our data, this would be the routes we made, and copied the features, and thus we could have them saved as the final results.


The above image is the final result of the above blog post, after a select by attribute was applied in order to see how many counties were effected by routes.

From there we would move on to the next part of the exercise, trying to figure out how much money it cost each county.



This model shows the steps taken in order to calculate the total cost per county. It involved creating many new fields, such as miles and kilometers fields (kilometers field was created to make the conversion easier since the data was saved in meters). The last field we calculated was created using the equation mentioned above in order to calculate the final cost. Using the cost data we were able to create the graphs seen below.


After calculating the cost per county and summarizing the data we were able to create a chart of how much it was costing each county to have trucks run on their roads. 



The two images above, top side, shows the table used to calculate the cost and how much it is going to cost to each county, the image on the bottom was a graph made on excel to show the cost in a lowest to highest price. 

CONCLUSION

Overall we were able to see which counties were receiving the most traffic and cost on them. The two highest I found in my data were Chippewa and Wood Counties. While Trempealeau County having the most mines on the map, they were all relatively close to the rail stations.








Tuesday, November 11, 2014

Exercise 7-Pyscript 2

For this exercise we are using Pyscripter to create a script which will be used to select a certain number of mine locations which meet the following standards;

-Currently Active Mines
-Are not connected to a rail loading station, or is a rail loading station
      *no trucks are needed to get the sands to the trains
-Mines must be more than 1.5 kilometers away from the nearest rail


The above script was created, debugged, and ran to produce a total of 41 mines that mean the above standards.

Below is a map of the selected maps (in yellow) which meet the above standards.

Wednesday, November 5, 2014

Exercise 6-Data Normalization, Geocoding, and Error Assessment

Goals

The goal of this lab is to use data provided by the DNR to find the exact locations of several different fracking facilities. With the given spreadsheet we are to normalize the data and then plot it on a map and compare it to fellow classmates and see how closely they match up.

Objectives

The objectives for this exercise are to obtain the database of the mines in Western Wisconsin. Next we are to geocode the mines using street addresses. After doing the second objective we will find the data given to us has errors in it and we are then to normalize the table and find the addresses for our selected mines. The next objective is to geocode the mines. After the class has finished geocoding their selected mines we are to compare them with our own to see how closely they match up. Lastly, we are to make a map showing our mines relative to our colleagues' mines.

Methods

In this lab we are given many different locations of several sand mines in Western Wisconsin. After selecting our specific mines, we instantly tried to geocode them in ArcMap, only to find out the points would not be processed. After opening up the spreadsheet again we changed the addresses to be normalized. In order to normalize the data, we would have to change the excel file layout.

In the image above you can see the not normalized excel spread sheet. In order to normalize the data we would have to go through the addresses given and separate them out into the entire address, which would then break down into the following categories;

  • Street Number
  • Street Prefix
  • Street Name
  • Street Suffix
  • State
  • City
  • Zip Code
  • Town/City/Village
  • County
Other categories included in the excel spread sheets to help with the normalizing include Mine UNIQUE ID, which will be the most important category later on in the lab, facility name, operator, landowner, status, and size of the property.

Not all of the entries had all the data needed to normalize the table which resulted in having to use two different methods of normalizing. The first was taking the data straight from the spread sheet and breaking it up into the categories listed above. But others did not have all the data needed and would have to use the method of picking it out on a map. In this case I used Google Maps, World View, to figure out the locations as well as Public Land Survey System data to find exact locations.

After finalizing the normalization we got a table that would be usable in ArcMap.

The figure above shows the normalized data in the excel spread sheet to be used in the plotting of the mine locations.

After completion of the spread sheet, we imported them into ArcMap and found any errors with the data. When I added my data to ArcMap I did not come across any errors, but some errors which may occur could be not typing the data right, or having fields missing.

The next step after making sure all your data is right, is to use a base layer data map to make sure your points are in their proper locations. If they were not then you should move them over to a more exact location. After completing this step we will import everyone else's data points. After they were all imported together we will merge the data points together to make one shapefile. A few of the shapefiles had errors when trying to merge with the larger shapefile. In this case I made two separate merge shapefiles to use. After all the mines have been imported onto your map we will extract the ones that share the same unique mine ID as the ones I had to map. This part was a little tricky since there were a few which kept the unique mine ID under a different category. In this case I would have to individually go through the attribute tables to find what the ID was kept under. The unique mine ID was kept under four different categories including; unique mine ID, mine ID, F1, and mine.

After extracting all the mines I compared my distances (using point distance tool) to other people's distances to the mines. (Results below)

Results/Errors





The image on the left is the final map showing my mine points with the mines of the same locations. The points I plotted are the white circles with the mine axes inside them, while the yellow circles are the mines plotted by my class colleagues who had the same mines.

Looking at the map you can see there are some points that look out of place, and some that look like they are overlapping or slightly away from the actual location of the other mine spots.









Some errors which may have occurred would be
  • Incorrect addresses entered
  • Mistyping the data
  • Entering the wrong data for the mine
  • Map Projections
  • Labeling one point with the wrong ID
  • Using the office buildings instead of mine area
  • User neglect
  • Which could include not actually finding the right location

In this image we can see two separate points which are supposed to be the same one. This is one type of error which sprang up from the data we were given from the DNR. On the spread sheet we had two different addresses to choose from. One was a residential looking area, while the other was a forested looking area. Due to the lack of up to date imagery on Google World View neither site looked like a mine. Although the yellow dot chosen on the image represents the office/house most likely owned by the operator while the other represents the actual soon to be mine location.



Conclusion


In conclusion most of the points were fairly close to one another, while others were quite a far distance away. This lab showed how important it is to make sure all your data is normalized, and if you are going to be sharing the data with someone else, make sure everyone knows what coordinate system to use and what coordinate system you are using to plot your data, as well as the proper projections to use.

The image on the right shows how far each point was from the other points, the distance is in meters.

Lastly, the data in the image is arranged from the first mine location to each of the other mine locations, hence four zero distances.


Sources
Bing Maps-Provided world/terrain base map
Drake Bortolameolli-Map Creator
ESRI ArcMap-Software Provider
Google Maps World View-Searching Software to find Locations
Wisconsin DNR-Provider of the mining facilities

Monday, October 20, 2014

Exercise 5-Understanding Data Downloading

Goals and Objectives

In Exercise five we are to gain knowledge with downloading data from multiple websites, importing the data into ESRI ArcMap, and join it with tables. We are also to become more familar with using Python script to project, clip, and load all of our downloaded data into a geodatabase of our choosing. See previous post for the Python script used in this lab. 

Methods

In this lab we have to visit multiple websites to download different data sets to be used in our labs. The first data set we downloaded was from the United States Department of Transportation (DOT). This was to gain access to the railways of the United States. We would later clip these railways down to just the ones in Trempealeau County. The second set of data was downloaded from the USGS National Map Viewer. We downloaded both the National Land Cover Database and National Elevation Dataset. Both downloads of Trempealeau County. The next data set was downloaded from USDA Geospatial Data Gateway. The data gathered from this site was the Cropland data. Next set was downloaded from the Trempealeau County land records. We downloaded an entire geodatabase from this website. Lastly, we downloaded the Soil Survey from the USDA NRCS Web Soil Survey. 

Part two of this lab was to write a Python script to project, clip, and load our data into a geodatabase. See Exercise 5-Python Script for more information or the script used. 





CONCLUSION

When working with this data one thing to watch out for is to make sure you extract everything you need to extract. I forgot to do the double extraction and found myself wondering around trying to find something I never downloaded.


Websites for gathering data
Railway Network Data
http://www.rita.dot.gov/bts/sites/rita.dot.gov.bts/-files/publications/national_trasportation_atlas_database/index.html
Landcover Data
http://nationalmap.gov/viewer.html
Landuse Data
http://datagateway.nrcs.usda.gov/
Geodatabase Data
http://www.tremplocounty.com/landrecords/
Soil Data
http://websoilsurvey.sc.egov.usda.gov/App/HomePage.htm

Exercise 5-Python Script


Python is a program that is used to write codes for various tasks. In our Geographic Information Systems II class we are using Python to help us process tasks in ESRI ArcMap 10.2.2 quicker. We use Python for many different functions in ArcMap. We use the tool PyScripter for Python 3.2. It is a free software created for Windows running computers and is made by Object Pascal (python website). 


Monday, September 29, 2014

Geographical Information Systems II-Introduction to Sand Mining

What is Sand Frac Mining?

Sand Frac Mining has been a mining of the round sand particles in Wisconsin for over 100 years, but now today they have found a different use for these sand particles. Up until a few years ago sand was mined to be used in glass manufacturing, foundry molds, and even used in golf course bunkers. Today, they now use the sand for hydrofracking, or frac for short. Hydrofracking is when sand is pumped into the rocks to extract the natural gas and petroleum from the rock.

   http://wcwrpc.org/frac-sand-factsheet.pdf
Where can you find this sand in Wisconsin?

The sand which has had the highest demand due to its good particle size and uniform roundness is located in the sandstone features of Western and Central Wisconsin. Although not as uniform in roundness and size, you can find similar sands in Southern and Eastern Wisconsin, but it is not nearly in as high of a demand as the sands in Western Wisconsin.

The image on the left shows where the sandstone formations can be found, in the brownish color, while the red squares are some of the mine locations and processing plants (as of December 2011).




What are Some Issues Associated with Sand Frac Mining in Western Wisconsin?

 A newspaper article was just released from the Lacrosse Tribune on September 27, 2014. In the article it talks about several environmental issues which the population living around the mines have to face. Since 2010, Wisconsin has seen sand mines rise from seven, to one hundred forty-five, in just four years. Several farmers live within half a mile of all these mines, 58,000 people over 33 different counties (including Minnesota). When the range is brought back to one mile, the number nearly doubles to 162,000 people. Some farmers have reported developing Asthma from the harmful silica dust that is now present. Silica is a known carcinogen, and constantly being breathed in could cause harmful effects on your body. Although there have been no reports of Polyacrylamide leaching into the groundwater, it is still a great threat. Polyacrylamide is a neurotoxin, also found in cigarettes. On average a sand mine uses between half-a-million gallons of water to two million gallons of water every day. Aside from the chemical usages and threats, citizens of the local towns have had numerous complaints as well, such as the mining lights being on 24/7, the trains and trucks constantly running throughout the night, and even building foundations beginning to become compromised from the repeated blast waves.

How Will GIS Be Used To Further Explore Some of These Issues as Part of Our Class Project
Since the large boom of Frac Sand Mining, it has been difficult to have a correct map showing where all the mines are located. Using GIS in our Geographical Information Systems II class, we will look to update the mine maps in Trempealeau County. We will also use GIS to monitor the mines for potential threats such as; run off of harmful chemicals into local streams or other bodies of water. One more item which we can explore is the possibility to reroute transportation units to minimize public delay and disturbances.

Sources
http://wcwrpc.org/frac-sand-factsheet.pdf
http://dnr.wi.gov/topic/mines/silica.html
http://lacrossetribune.com/news/local/report-frac-sand-industry-affects-lives-of-thousands-who-live/article_5c6716dc-dc4a-5c4e-93a8-4523712785e0.html