The Shadowserver Foundation

Open Hadoop Service Scanning Project

If you are looking at this page, then more than likely, you noticed a scan coming from this server across your network and/or poking at the Hadoop Namenode or Datanode web service.

The Shadowserver Foundation is currently undertaking a project to search for publicly accessible devices that have one or both of these hadoop services service running. The goal of this project is to identify openly accessible systems that have these services running and report them back to the network owners for remediation.

These services have the possibility of disclosing sensitive information or may possibly allow a miscreant to manipulate the hadoop instance. If at all possible, we would like to see these services made un-available to miscreants that would misuse these resources.

Servers that are configured this way have been incorporated into our reports and are being reported on a daily basis.

Methodology

We are querying all computers with routable IPv4 addresses that are not firewalled from the internet on ports 50070/tcp and 50075/tcp with a GET request and capturing the response. We intend no harm, but if we are causing problems, please contact us at: dnsscan [at] shadowserver [dot] org.

If you would like to test your own device to see if it has the Hadoop Namenode or Datanode web service enabled, use your web browser and try to bring up the service page. The URL for the Namenode service is "http://[IP]:50070/" and the URL for the Datanode service is "http://[IP]:50075". If a web page does not appear, then the service is likely not accessible.

Whitelisting

To be removed from this set of scanning you will need to send an email to dnsscan [at] shadowserver [dot] org with the specific CIDR's that you would like to have removed. You will have to be the verifiable owner of these CIDR's and be able to prove that fact. Any address space that is whitelisted will be publicly available here: https://hadoopscan.shadowserver.org/exclude.html

Useful Links

Scan Status

Statistics on current run

Other Statistics

If you would like other statistics and information on historical trends, please take a look at: https://hadoopscan.shadowserver.org/stats/. Otherwise, stats from the most current scan are listed below.


All devices with Hadoop Accessible

All Hadoop

(Click image to enlarge)

If you would like to see more regions click here

All devices with Hadoop Accessible

All Hadoop

(Click image to enlarge)



If you would like us to not scan your network, please let us know and we will remove your networks from the scan.

Likewise, if you have anymore questions please feel free to send us an email at: gro [tod] revfooreswodahs [ta] nacbarssnd

The Shadowserver Foundation