SFTW: Scraping data with Google Refine

For the first Something For The Weekend of 2012 I want to tackle a common problem when you’re trying to scrape a collection of webpage: they have some sort of structure in their URL like this, where part of the URL refers to the name or code of an entity:     http://www.ltscotland.org.uk/scottishschoolsonline/schools/freemealentitlement.asp?iSchoolID=5237521

  tp://www.ltscotland.org.uk/scottishschoolsonline/schools/freemealentitlement.asp?iSchoolID=5237629

    ttp://www.ltscotland.org.uk/scottishschoolsonline/schools/freemealentitlement.asp?iSchoolID=5237823

In this instance, you can see that the URL is identical apart from a 7 digit code at the end: the ID of the school the data refers to.

There are a number of ways you could scrape this data. You could use Google Docs and the =importXML formula, but Google Docs will only let you use this 50 times on any one spreadsheet (you could copy the results and select Edit > Paste Special > Values Only and then use the formula a further 50 times if it’s not too many – here’s one I prepared earlier).

And you could use Scraperwiki to write a powerful scraper – but you need to understand enough coding to do so quickly (here’s a demo I prepared earlier).

A middle option is to use Google Refine, and here’s how you do it.

Assembling the ingredients

With the basic URL structure identified, we already have half of our ingredients. What we need  next is a list of the ID codes that we’re going to use to complete each URL.

An advanced search for “list seed number scottish schools filetype:xls” brings up a link to this spreadsheet (XLS) which gives us just that.

The spreadsheet will need editing: remove any rows you don’t need. This will reduce the time that the scraper will take in going through them. For example, if you’re only interested in one local authority, or one type of school, sort your spreadsheet so that you can delete those above or below them.

Now to combine  the ID codes with the base URL.

Bringing your data into Google Refine

Open Google Refine and create a new project with the edited spreadsheet containing the school IDs.

At the top of the school ID column click on the drop-down menu and select Edit column > Add column based on this column…

In the New column name box at the top call this ‘URL’.

In the Expression box type the following piece of GREL (Google Refine Expression Language):

“http://www.ltscotland.org.uk/scottishschoolsonline/schools/freemealentitlement.asp?iSchoolID=”+value

(Type in the quotation marks yourself – if you’re copying them from a webpage you may have problems)

The ‘value’ bit means the value of each cell in the column you just selected. The plus sign adds it to the end of the URL in quotes.

In the Preview window you should see the results – you can even copy one of the resulting URLs and paste it into a browser to check it works. (On one occasion Google Refine added .0 to the end of the ID number, ruining the URL. You can solve this by changing ‘value’ to value.substring(0,7) – this extracts the first 7 characters of the ID number, omitting the ‘.0') UPDATE: in the comment Thad suggests “perhaps, upon import of your spreadsheet of IDs, you forgot to uncheck the importer option to Parse as numbers?”

Click OK if you’re happy, and you should have a new column with a URL for each school ID.

Grabbing the HTML for each page

Now click on the top of this new URL column and select Edit column > Add column by fetching URLs…

In the New column name box at the top call this ‘HTML’.

All you need in the Expression window is ‘value’, so leave that as it is.

Click OK.

Google Refine will now go to each of those URLs and fetch the HTML contents. As we have a couple thousand rows here, this will take a long time – hours, depending on the speed of your computer and internet connection (it may not work at all if either isn’t very fast). So leave it running and come back to it later.

Extracting data from the raw HTML with parseHTML

When it’s finished you’ll have another column where each cell is a bunch of HTML. You’ll need to create a new column to extract what you need from that, and you’ll also need some GREL expressions explained here.

First you need to identify what data you want, and where it is in the HTML. To find it, right-click on one of the webpages containing the data, and search for a key phrase or figure that you want to extract. Around that data you want to find a HTML tag like <table class=”destinations”> or <div id=”statistics”>. Keep that open in another window while you tweak the expression we come onto below…

Back in Google Refine, at the top of the HTML column click on the drop-down menu and select Edit column > Add column based on this column…

In the New column name box at the top give it a name describing the data you’re going to pull out.

In the Expression box type the following piece of GREL (Google Refine Expression Language):

value.parseHtml().select(“table.destinations”)[0].select(“tr”).toString()

(Again, type the quotation marks yourself rather than copying them from here or you may have problems)

I’ll break down what this is doing:

value.parseHtml()

parse the HTML in each cell (value)

.select(“table.destinations”)

find a table with a class (.) of “destinations” (in the source HTML this reads <table class=”destinations”>. If it was <div id=”statistics”> then you would write .select(“div#statistics”) – the hash sign representing an ‘id’ and the full stop representing a ‘class’.

[0]

This zero in square brackets tells Refine to only grab the first table – a number 1 would indicate the second, and so on. This is because numbering (“indexing”) generally begins with zero in programming.

.select(“tr”)

Now, within that table, find anything within the tag <tr>

.toString()

And convert the results into a string of text.

The results of that expression in the Preview window should look something like this:

<tr> <th></th> <th>Abbotswell School</th> <th>Aberdeen City</th> <th>Scotland</th> </tr> <tr> <th>Percentage of pupils</th> <td>25.5%</td> <td>16.3%</td> <td>22.6%</td> </tr>

This is still HTML, but a much smaller and manageable chunk. You could, if you chose, now export it as a spreadsheet file and use various techniques to get rid of the tags (Find and Replace, for example) and split the data into separate columns (the =SPLIT formula, for example).

Or you could further tweak your GREL code in Refine to drill further into your data, like so:

value.parseHtml().select(“table.destinations”)[0].select(“td”)[0].toString()

Which would give you this:

<td>25.5%</td>

Or you can add the .substring function to strip out the HTML like so (assuming that the data you want is always 5 characters long):

value.parseHtml().select(“table.destinations”)[0].select(“td”)[0].toString().substring(5,10)

When you’re happy, click OK and you should have a new column for that data. You can repeat this for every piece of data you want to extract into a new column.

Then click Export in the upper right corner and save as a CSV or Excel file.

Source: http://onlinejournalismblog.com/2012/01/13/sftw-scraping-data-with-google-refine/

East Siberian Heat Wave

The image below illustrates the intensity of the heatwave over western Europe, with temperatures forecast to keep hitting the top end of the scale for days to come.

Global warming is strengthening heatwaves. The Arctic is warming faster than the rest of the world, so the temperature difference between the North Pole and the Equator is getting smaller. It is this temperature difference that powers the jet stream. The result is that the speed at which the jet stream circumnavigates the globe is falling. Furthermore, the path of the jet stream is changing, sometimes extending far to the north, then deeper to the south, just like a river will meander more where the land is flatter.

Above image illustrates that these changes to the jet stream make that warm air from the south can more easily move up north, to higher latitudes, while cold air from the Arctic can more easily move down to lower latitudes, in both cases further decreasing the temperature difference between the North Pole and the Equator, which makes these changes to the jet stream a self-reinforcing feedback loop that is rapidly making the situation worse.

While such developments have been documented for years, e.g. see this feedbacks page, the media rarely inform people about them. And while the media do cover the suffering caused by the heatwaves that have been hitting populous countries such as India, Pakistan, the U.S., Spain and France recently, less attention is given to heatwaves hitting the Arctic.

High temperatures close to the Arctic Ocean are very worrying, for a number of reasons, including:

• They are examples of heatwaves that can increasingly extend far to the north, all the way into the Arctic Ocean, speeding up warming of the Arctic Ocean seabed and threatening to unleash huge methane eruptions. 
• They set the scene for wildfires that emit not only greenhouse gases such as carbon dioxide and methane, but also pollutants such as carbon monoxide (that depletes hydroxyl that could otherwise break down methane) and black carbon (that when settling on ice causes it to absorb more sunlight). 
• They cause warming of the water of rivers that end up in the Arctic Ocean, thus resulting in additional sea ice decline and warming of the Arctic Ocean seabed.

June 24, 2015 - Smoke from wildfires in Alaska - from: wunderground.com

The video below was created by Stuart Thrupp from a NASA animation showing carbon monoxide from Alaska wildfires spreading over the Arctic from June 17th to 29th, 2015.

Short movie of carbon-monoxide levels over Alaska. June 17th- June 29th. Thanks for NASA Eyes on earth for there animation.
Posted by Stuart Thrupp on Wednesday, July 1, 2015

The heatwaves that hit Alaska and Russia recently are now followed up by a heatwave in East Siberia.

The image below shows a location well inside the Arctic Circle where temperatures as high as 37.1°C (98.78°F) were recorded on July 2, 2015. The top panel shows temperatures, while the bottom panel also shows the depth of the Arctic Ocean and the location of the Gakkel Ridge, in between the northern tip of Greenland and the Laptev Sea.

As the image below shows, the jet stream is forecast to move up high into the Arctic north of Siberia over the next few days. The image shows the jet stream as at July 8, 2015.

The image below shows a forecast of temperature anomalies for July 7, 2015.

The four images below illustrate how the heatwave is forecast to develop over the next few days (hat tip to Mark Richardson).

Rain close to the North Pole (forecast July 7, 2015)

The image on the right, also created with a Climate Reanalyzer image, shows rain over the Arctic, over the EastSiberian Sea and over an area close to the North Pole.

Rain over sea ice will create melt ponds with associated loss in albedo (reflectivity), making that light that was previously reflected back into space by the sea ice will instead be absorbed by the water, further speeding up the demise of the sea ice.

The picture below was taken July 2, 2015, by WebCam#1, mounted on a satellite-reporting buoy. The camera provides a wide-angle 120° horizontal field of view and was installed in April 2015, about 1.5 m above the ice surface, at a location some 25 miles from the North Pole. The buoy has meanwhile drifted some distance away from the North Pole, see map at this page.

WebCam#1 showing water on July 2, 2015

The presence of water can indicate that the sea ice has completely disappeared in the respective area, which could in turn be caused by sea ice melting and/or bubbling up of methane, so it's important to keep monitoring this. More likely though, the water is probably surface water on top of the ice, caused by melting and/or rain. Anyway, water reflects less sunlight back into space than sea ice, so the result will be that more sunlight is instead absorbed by the water and/or the sea ice.

With temperatures as high as the 37.1°C (98.78°F) recorded on July 2, 2016 (image further above), huge melting can be expected where there still is sea ice in the waters off the coast of Siberia, while the waters where the sea ice has already gone will warm up rapidly.

Note that the waters off the coast of Siberia are less than 50 m (164 ft) deep, so warming can quickly extend all the way down to the seabed, that can contain enormous amounts of methane in the form of free gas and hydrates.

The situation is dire and calls for comprehensive and effective action, as discussed at the Climate Plan.

While the media gives wide coverage to the heatwaves that have been hitting populous countries such as India, Pakistan,...
Posted by Sam Carana on Thursday, July 2, 2015

Dramatic Sea Ice Decline In Beaufort Sea in June 2015

The image below illustrates the dramatic fall in sea ice thickness (in m) in the Beaufort Sea over the past month. The left panel shows sea ice thickness on May 29, 2015, and the panel on the right shows sea ice thickness on June 29, 2015.

The 30-day animation below further illustrates this dramatic fall in sea ice thickness (from June 8-29, with forecast up to July 7, 2015).

Another perspective is sea ice concentration. The image below shows the high concentration back on May 1, 2015.

The 30-day animation below shows the dramatic fall in sea ice concentration (from June 8-29, with forecast up to July 7, 2015).

Below an interview by Judy Sole with Professor Peter Wadhams, held May 15, 2015, and entitled 'Our time is running out - The Arctic sea ice is going!'

Meanwhile, very high temperatures keep showing up within the Arctic Circle. On July 1, 2015, a temperature of 36°C (96.8°F) was reached near the Kolyma River that ends in the East Siberian Sea, as illustrated by the images below (green circle).

The image below also shows the location where this high temperature was reached (red marker), as well as the depth of the seabed and the Gakkel Ridge that runs in between the northern tip of Greenland and the Laptev Sea.

Related

- High Methane Levels over Laptev Sea
http://arctic-news.blogspot.com/2013/10/high-methane-levels-over-laptev-sea.html

- Accelerated Warming in the Arctic
http://arctic-news.blogspot.com/2015/06/accelerated-warming-in-the-arctic.html

- Gulf Stream brings ever warmer water into Arctic Ocean
http://arctic-news.blogspot.com/2015/06/gulf-stream-brings-ever-warmer-water-into-arctic-ocean.html

- High Temperatures in the Arctic
http://arctic-news.blogspot.com/2015/06/high-temperatures-in-the-arctic.html

- Heat Wave Forecast For Russia Early June 2015 

http://arctic-news.blogspot.com/2015/06/heat-wave-forecast-for-russia-early-june-2015.html

Dramatic Sea Ice Decline In Beaufort Sea in June 2015 http://arctic-news.blogspot.com/2015/06/dramatic-sea-ice-decline-in-beaufort-sea-in-june-2015.html
Posted by Sam Carana on Tuesday, June 30, 2015

Accelerated Warming in the Arctic

Warming in the Arctic is accelerating. On June 25, 2015, high temperatures hit North America. Temperatures as high as 30.3°C (86.54°F) were recorded where the Mackenzie River is flowing into the Arctic Ocean.

June 25, 2015 - High temperatures over North America, close to the Arctic Ocean

On July 1, 2015, temperatures are forecast to be as high as 111.4°F (or 44.1°C) near Chico, north of San Francisco. Temperatures are forecast to be high over most of North America and Eastern Siberia, threatening to further warm up waters of the Arctic Ocean.

Forecast for July 1, 2015 - High temperatures over North America, close to the Arctic Ocean

The image below shows that on June 27, 2015, temperatures of well over 40°C (104°F) were recorded in Europe and in Pakistan, where temperatures earlier this month had reached 49°C (120.2°F) in some places. The heat wave reportedly killed 1233 people in Karachi alone. This in addition to the 2500 people killed earlier in India by high temperatures.

June 27, 2015 - High temperatures over Russia, close to the Arctic Ocean

High temperatures at such locations are very worrying, for a number of reasons, including:

• They are examples of heatwaves that can increasingly extend far to the north, all the way into the Arctic Ocean, speeding up warming of the Arctic Ocean seabed and threatening to unleash huge methane eruptions. 
• They set the scene for wildfires that emit not only greenhouse gases such as carbon dioxide and methane, but also pollutants such as carbon monoxide (that depletes hydroxyl that could otherwise break down methane) and black carbon (that when settling on ice causes it to absorb more sunlight).
• They cause warming of the water of rivers that end up in the Arctic Ocean, thus resulting in additional sea ice decline and warming of the Arctic Ocean seabed. 

June 24, 2015 - Smoke from wildfires in Alaska - from: wunderground.com

The image below shows increased sea surface temperature anomalies in the Arctic. Note the warming in the area of the Beaufort Sea where the Mackenzie River is flowing into the Arctic Ocean.

Very warm water is also flowing from the Pacific Ocean through the Bering Strait into the Arctic Ocean.  As the image below shows, the water that is flowing into the Arctic Ocean from the Pacific is much warmer than it used to be, as much as 6.1°C (10.98°F) warmer.

View the flow of the water on the animated version of above image at earth.nullschool.net

As said above, warm water flowing from rivers into the Arctic Ocean is a major contributor to these sea surface temperature anomalies. As also illustrated by the NOAA image below, rivers carrying warm water into the Bering Strait include the Kobuk River, the Naotak River and the Yukon River that flows all the way from British Columbia, Canada, through Alaska and ends in the Bering Strait. Sea surface temperatures near the coast of Alaska were as high as 19°C (66.2°F) from June 21-24, 2015.

Sea surface temperatures near the coast of Alaska as high as 19°C (66.2°F) from June 21-24, 2015

The Naval Research Laboratory animation below shows changes to Arctic sea ice thickness. Sea ice thickness (in m) down to zero where the Mackenzie River flows into the Arctic Ocean and in the Bering Strait where warm water from the Pacific is entering the Arctic Ocean.

The situation is dire and calls for comprehensive and effective action, as discussed at the Climate Plan.


Related

- Gulf Stream brings ever warmer water into Arctic Ocean
http://arctic-news.blogspot.com/2015/06/gulf-stream-brings-ever-warmer-water-into-arctic-ocean.html

- High Temperatures in the Arctic

http://arctic-news.blogspot.com/2015/06/high-temperatures-in-the-arctic.html

- Heat Wave Forecast For Russia Early June 2015http://arctic-news.blogspot.com/2015/06/heat-wave-forecast-for-russia-early-june-2015.html

Sea surface temperature anomalies in the Arctic. Note the warming in the area of the Beaufort Sea where the Mackenzie...
Posted by Sam Carana on Thursday, June 25, 2015

Data Scraping - Hand Scraped Hardwood Flooring Gives Your Home That Exclusive Look

Today hand scraped hardwood flooring is becoming extremely popular in the more opulent homes as well as in some commercial properties. Although this type of flooring has only recently become fashionable it has been around for many centuries.

Certainly before the invention of modern sanding techniques all floors where hand scraped at the location where they were to be installed to ensure that the floor would be flat and even. However today this method is used instead to provide texture, richness as well as a unique look and feel to the flooring.

Although manufacturers have produced machines which can provide a scraped look to their flooring it looks cheap compared to the real thing. Unfortunately the main problem with using a machine to scrape the flooring is that it provides a uniform look to the pattern of the wood. Because of this it lacks the natural feel that you would see with a floor which has been scraped by hand.

When done by hand, scraping creates a truly unique look to the floor. However the actual look and feel of each floor will vary as it depends on the skills of the person actually carrying out the work. If there is no control in place whilst the work is being carried out this can result in disastrous look to the finished product.

Many manufacturers who actually provide hand scraped hardwood flooring will either just dent, scoop or rough the floor up. But others will use sanding techniques in order to create a worn and uneven look to the flooring. The more professional teams will scrape the entire surface of the wood in order to create the unique hand made look for their customers.

Many companies will allow their customers to choose what type of scraping takes place on their wood. They can choose between light, medium and heavy. The companies who are really good at hand scraping will be able give the hardwood floor a reclaimed look by including wormholes, splits and other naturally-occurring features within the wood.

If you do decide to choose hand scraped hardwood flooring you will need to factor the costs that are associated with it into your budget. Unfortunately this type of flooring does not come cheap and you can find yourself paying upwards of $15 per sq ft. But once it is installed it will give a room a unique and warm rich feel to it and is certainly going to wow your friends and family when they see it for the first time.

Source: http://ezinearticles.com/?Hand-Scraped-Hardwood-Flooring-Gives-Your-Home-That-Exclusive-Look&id=572577

Making data on the web useful: scraping

Introduction

Many times data is not easily accessible – although it does exist. As much as we wish everything was available in CSV or the format of our choice – most data is published in different forms on the web. What if you want to use the data to combine it with other datasets and explore it independently?

Scraping to the rescue!

Scraping describes the method to extract data hidden in documents – such as Web Pages and PDFs and make it useable for further processing. It is among the most useful skills if you set out to investigate data – and most of the time it’s not especially challenging. For the most simple ways of scraping you don’t even need to know how to write code.

This example relies heavily on Google Chrome for the first part. Some things work well with other browsers, however we will be using one specific browser extension only available on Chrome. If you can’t install Chrome, don’t worry the principles remain similar.

Code-free Scraping in 5 minutes using Google Spreadsheets & Google Chrome

Knowing the structure of a website is the first step towards extracting and using the data. Let’s get our data into a spreadsheet – so we can use it further. An easy way to do this is provided by a special formula in Google Spreadsheets.

Save yourselves hours of time in copy-paste agony with the ImportHTML command in Google Spreadsheets. It really is magic!

Recipes

In order to complete the next challenge, take a look in the Handbook at one of the following recipes:

    Extracting data from HTML tables.

    Scraping using the Scraper Extension for Chrome

Both methods are useful for:

    Extracting individual lists or tables from single webpages

The latter can do slightly more complex tasks, such as extracting nested information. Take a look at the recipe for more details.

Neither will work for:

    Extracting data spread across multiple webpages

Challenge

Task: Find a website with a table and scrape the information from it. Share your result on datahub.io (make sure to tag your dataset with schoolofdata.org)

Tip

Once you’ve got your table into the spreadsheet, you may want to move it around, or put it in another sheet. Right click the top left cell and select “paste special” – “paste values only”.

Scraping more than one webpage: Scraperwiki

Note: Before proceeding into full scraping mode, it’s helpful to understand the flesh and bones of what makes up a webpage. Read the Introduction to HTML recipe in the handbook.

Until now we’ve only scraped data from a single webpage. What if there are more? Or you want to scrape complex databases? You’ll need to learn how to program – at least a bit.

It’s beyond the scope of this course to teach how to scrape, our aim here is to help you understand whether it is worth investing your time to learn, and to point you at some useful resources to help you on your way!

Structure of a scraper

Scrapers are comprised of three core parts:

1.    A queue of pages to scrape
2.    An area for structured data to be stored, such as a database
3.    A downloader and parser that adds URLs to the queue and/or structured information to the database.

Fortunately for you there is a good website for programming scrapers: ScraperWiki.com

ScraperWiki has two main functions: You can write scrapers – which are optionally run regularly and the data is available to everyone visiting – or you can request them to write scrapers for you. The latter costs some money – however it helps to contact the Scraperwiki community (Google Group) someone might get excited about your project and help you!.

If you are interested in writing scrapers with Scraperwiki, check out this sample scraper – scraping some data about Parliament. Click View source to see the details. Also check out the Scraperwiki documentation: https://scraperwiki.com/docs/python/

When should I make the investment to learn how to scrape?

A few reasons (non-exhaustive list!):

1.    If you regularly have to extract data where there are numerous tables in one page.

2.    If your information is spread across numerous pages.

3.    If you want to run the scraper regularly (e.g. if information is released every week or month).

4.    If you want things like email alerts if information on a particular webpage changes.

…And you don’t want to pay someone else to do it for you!

Summary:

In this course we’ve covered Web scraping and how to extract data from websites. The main function of scraping is to convert data that is semi-structured into structured data and make it easily useable for further processing. While this is a relatively simple task with a bit of programming – for single webpages it is also feasible without any programming at all. We’ve introduced =importHTML and the Scraper extension for your scraping needs.

Further Reading

1.    Scraping for Journalism: A Guide for Collecting Data: ProPublica Guides

2.    Scraping for Journalists (ebook): Paul Bradshaw

3.    Scrape the Web: Strategies for programming websites that don’t expect it : Talk from PyCon

4.    An Introduction to Compassionate Screen Scraping: Will Larson

Any questions? Got stuck? Ask School of Data!

ScraperWiki has two main functions: You can write scrapers – which are optionally run regularly and the data is available to everyone visiting – or you can request them to write scrapers for you. The latter costs some money – however it helps to contact the Scraperwiki community (Google Group) someone might get excited about your project and help you!.

If you are interested in writing scrapers with Scraperwiki, check out this sample scraper – scraping some data about Parliament. Click View source to see the details. Also check out the Scraperwiki documentation: https://scraperwiki.com/docs/python/

When should I make the investment to learn how to scrape?

A few reasons (non-exhaustive list!):

1.    If you regularly have to extract data where there are numerous tables in one page.

2.    If your information is spread across numerous pages.

3.    If you want to run the scraper regularly (e.g. if information is released every week or month).

4.    If you want things like email alerts if information on a particular webpage changes.

…And you don’t want to pay someone else to do it for you!

Summary:

In this course we’ve covered Web scraping and how to extract data from websites. The main function of scraping is to convert data that is semi-structured into structured data and make it easily useable for further processing. While this is a relatively simple task with a bit of programming – for single webpages it is also feasible without any programming at all. We’ve introduced =importHTML and the Scraper extension for your scraping needs.

Source: http://schoolofdata.org/handbook/courses/scraping/

Gulf Stream brings ever warmer water into Arctic Ocean

The image below shows sea surface temperature anomalies in the Arctic as at June 9, 2015.

The image below shows the Arctic from a 180° rotated angle, while also showing the high sea surface temperature anomalies that are so prominent in the North Pacific (note also that the scale of sea surface temperature anomalies differs).



One may wonder why sea surface temperature anomalies below zero are visible in the North Atlantic, given that ocean heat is rising rapidly. As the IPCC said in AR5, more than 60% of the net energy increase in the climate system is stored in the upper ocean (0–700 m) during the relatively well-sampled 40-year period from 1971 to 2010, and about 30% is stored in the ocean below 700 m.

Global heat content at 0-2000 m is rising even faster than at 0-700 m 

The image below further pictures the situation as at June 9, 2015, with large blue and purple areas showing in the North Atlantic where meltwater from the Arctic has spread over time.



Indeed, the accumulation of meltwater over time has created a huge area with relatively cold water that tends to float at the surface, rather than sink, as the meltwater's salt content is very low.

In other words, the ocean underneath the meltwater at the sea surface is much warmer than the temperatures shown on above images. This can be illustrated by the situation near Svalbard. The image below shows the depth of Barents Sea, which is relatively shallow around Svalbard,

As the image shows, cold meltwater with low salt content floats around Svalbard where the water is most shallow. A 'polar front' separates cold and warm water, following the borders of the area where the seafloor is high. Warm, salty water is carried by the Gulf Stream from the (much deeper) Atlantic Ocean into the Arctic Ocean. This warm water collides with cold water east of Svalbard where the seafloor rises steeply, making this warm water come to the surface. 

Warm water from the Atlantic also comes to the surface west of Svalbard, where warm and cold water are similarly separated by the height of the seafloor. 

The image below shows that on June 8, 2015, sea surface temperatures as high as 11.4°C (52.52°F) were recorded to the south-east of Svalbard (a 9.8°C or 17.64°F anomaly), while sea surface temperatures as high as 7.4°C (45.32°F) were recorded to the west of Svalbard (a 3.5°C or 6.3°F anomaly). 

Sea surface temperatures (top) and sea surface temperature anomalies (bottom) on June 8, 2015.

The image below shows the situation on June 21, 2015, when sea surface temperatures as high as 12.5°C (54.5°F) were recorded to the south-east of Svalbard (a 10.2°C or 18.4°F anomaly), while sea surface temperatures as high as 8.5°C (47.3°F) were recorded to the west of Svalbard (a 3.7°C or 6.7°F anomaly) and as high as 7.3°C (45.1°F) further west of Svalbard (a 3.7°C or 6.7°F anomaly).

Sea surface temperatures (top) and sea surface temperature anomalies (bottom) on June 21, 2015.

These spots where warm water comes to the surface give an indication of how high temperatures of the water are below the surface. As more than 90% of the extra heat caused by people's emissions continues to go into oceans, ever warmer water will be carried by the Gulf Stream into the Arctic Ocean, with the danger that this will warm up sediments under the Arctic Ocean seafloor, triggering huge methane eruptions with gigantic warming potential.

The above images picture the situation as at June 8 and June 21, 2015, when summer on the Northern Hemisphere had just started. In other words, temperatures will rise over the next few months. To get an idea of what can be expected, the image below shows the situation as at September 1, 2014, when sea surface temperatures near Svalbard were as high as 17.5°C (or 63.5°F), an anomaly of 11.9°C (or 21.42°F)

Sea surface temperatures (top) and sea surface temperature anomalies (bottom) on September 1, 2014.

On the combination image below, the image on the left shows large areas (red circles) where warmer water is visible through the sea ice, indicating the presence of even warmer water at greater depth in the Arctic Ocean. The image on the right (from an earlier post) roughly shows how ocean heat can be carried by the Gulf Stream from the Atlantic Ocean off the coast of North America into the Arctic Ocean, diving under the sea ice somewhere between Greenland and Svalbard.

Then, there is also the impact of the heat wave in Russia warming up the Arctic Ocean, as indicated by the red circle on the image below.

The image below shows May Northern Hemisphere ocean temperature anomalies with respect to the period 1901-2000, based on NOAA data and with a polynomial trendline added.

ACCELERATED WARMING IN ARCTIC CAUSING MORE CIRRUS CLOUDS As oceans warm, the atmosphere can be expected to carry more water vapor. This conclusion is supported by studies such as this one. With more water vapor in the atmosphere, storms can be expected to strike with greater intensity. This conclusion is supported by studies such as this one. This situation gets worse as weather gets more extreme. What makes things even worse is that, as the Gulf Stream keeps bringing ever warmer water into the Arctic Ocean, loss of sea ice in the Arctic Ocean and more open water will be the result. More open water means more opportunity for storms to develop and for water to evaporate into the atmosphere. The combination of more open water, more extreme weather, and more water vapor in the atmosphere leads to ever more severe storms that can come with destructive winds and that can suddenly unleash massive amounts of precipitation. Studies such as this one warn that plumes above the anvils of severe storms can bring water vapor up into the stratosphere, contributing to the formation of cirrus clouds that block a lot of heat that would otherwise be radiated away, from Earth into space. More cirrus clouds thus is another self-reinforcing feedback loop of accelerated warming in the Arctic. As the Gulf Stream keeps bringing ever warmer water into the Arctic Ocean, such feedbacks will further speed up warming, as discussed at the feedbacks page. Are there geoengineering methods to reduce cirrus clouds? Seeding of high altitude clouds with ice may be able to do this, resulting in more longwave radiation escaping into space, as discussed in this study. The text in this box was also posted at the Geoengineering group at facebook

The situation is dire and calls for comprehensive and effective action, as discussed at the Climate Plan. 

on June 8, 2015, sea surface temperatures as high as 11.4°C (52.52°F) were recorded to the south-east of Svalbard (a 9.8...
Posted by Sam Carana on Thursday, June 11, 2015