Your code works for me with Excel-2010 VBA and IE8 on any website so far. Of course I need some individual adjustments by case.

I have further tried to develop a shorter code, since the user defined Function getXPathElement runs a lot of loops that accummulate when I have an array of e.g. 5 XPathes to scrap 5 elements in batch progressing (ran 5×10000 items at 2sec/set of 5) from 1 web-page earch engine as following:

strPath(1) = “/html/body/div[2]/div/div/div[2]/div/div/div[4]/div/p/strong”
strPath(2) = “/html/body/div[2]/div/div/div[2]/div/div[2]/div[4]/div/p/strong”
strPath(3) = “/html/body/div[2]/div/div/div[2]/div/div[3]/div[4]/div/p/strong”
strPath(4) = “/html/body/div[2]/div/div/div[2]/div/div/div[2]/h2/a”
strPath(5) = “/html/body/div[2]/div/div/div[2]/div/div[3]/div[2]/p[2]”

For n = 1 To 5
‘ get last node:
strPathArray = Split(strPath(n), “/”)
lastNode = strPathArray(UBound(strPathArray))

‘ get element by TagName fpr strpath(n) -> item 1,2,3,4,5:
Set elem = ie.document.getElementsByTagName(lastNode).item(n)
ws.Cells(iRow, oCol).Value = elem.innerHTML

Next n

The only problem is that indexed tags with [ ] – like last node from strPath(5) p[2] – do not provide the innerHTML, while all others strPath(1) thru (4) work fine.

If that’s proper coding – well who knows?

Since you are most deeply involved in this matter, maybe we can discuss another solution?

In my previous post I described a way of doing web scraping using XPath and VB. I showed how to get stock quotes from the web into Excel using this method. Recently I used the same method to get a list of birthdays of mathematicians. The data was scrap…