目录导航
shodan api使用指南
虽然目前人们都认为谷歌是最强劲的搜索引擎，但Shodan才是互联网上最可怕的搜索引擎 shodan是一个针对网络设备的搜索引擎，通过Shodan API进行搜索，不仅数据更加丰富，而且能够配合自己的程序实现自动化分析。
本文将要介绍Shodan API在使用过程需要注意的问题，分享使用心得和脚本开发技巧。
0x01 本文将要介绍以下内容
暗网网址 250个 TorLinks | onion Link List
- Shodan API的简单使用
- 利用python调用Shodan API获得搜索结果
- 对搜索结果作进一步处理
- 三种积分(credits)的区别
- 通过Shodan官网导出搜索结果和进一步处理
0x02 Shodan API的简单使用
1、注册账号，获得API Key
测试API Key为：SkVS0RAbiTQpzzEsahqnq2Hv6SwjUfs3
2、安装python包
pip install shodan
3、通过Shodan CLI获得搜索结果
注：
未付费只能获得100个搜索结果
CLI全称为command-line interface，即shodan的命令行模式
Windows系统下使用pip install在同级目录产生文件Shodan.exe
如下图
(1) 初始化
shodan init <api key>
实际命令为：
shodan init SkVS0RAbiTQpzzEsahqnq2Hv6SwjUfs3
如下图
(2) 搜索指定内容（apache）的数量
shodan count apache
如下图
获得结果23803090
(3) 搜索指定内容（apache）的信息
shodan search --fields ip_str,port,org,hostnames apache
搜索关键词：apache
输出：ip_str,port,org,hostnames
(4) 下载指定内容（apache）的搜索结果
shodan download result apache
搜索关键词：apache
保存文件名：result.json.gz
如下图
(5) 解析文件，获得搜索结果
shodan parse --fields ip_str,port,org --separator , result.json.gz
如下图
(6) 搜索指定IP的信息
shodan host 189.201.128.250
如下图
0x03 三种积分(credits)的区别
Shodan共有三种积分(credits)：
- Export credits
- Query credits
- Scan credits
官方文档：
简单理解：
Export Credits
通过Shodan官网下载数据时使用
1 export credit = 10,000 results
注：
导出一次结果消耗一个credit，无论获取到的结果有多少，最多为10000个结果
月初不会更新
Query Credits
调用Shodan API时使用
1 query credit = 100 results
月初更新，也就是说如果只买了一个月的会员，那么下一个月清零
Scan Credits
调用Shodan API时使用
1 scan credit = 1 IP
月初更新
0x04 通过python调用Shodan API获得搜索结果
注：
未付费不仅无法使用搜索过滤条件，而且只能获得100个搜索结果
(1) 搜索指定内容（apache）的信息
python代码如下：
import shodan
SHODAN_API_KEY = "SkVS0RAbiTQpzzEsahqnq2Hv6SwjUfs3"
api = shodan.Shodan(SHODAN_API_KEY)
try:
results = api.search('Apache')
print 'Results found: %s' % results['total']
for result in results['matches']:
print ("%s:%s|%s|%s"%(result['ip_str'],result['port'],result['location']['country_name'],result['hostnames']))
except shodan.APIError, e:
print 'Error: %s' % e
如下图
如果未付费，无法使用搜索过滤条件，例如Apache country:"US"
(2) 搜索指定内容，将获得的IP写入文件
python代码如下：
import shodan
SHODAN_API_KEY = "SkVS0RAbiTQpzzEsahqnq2Hv6SwjUfs3"
api = shodan.Shodan(SHODAN_API_KEY)
file_object = open('ip.txt', 'w')
try:
results = api.search('Apache')
print 'Results found: %s' % results['total']
for result in results['matches']:
# print result['ip_str']
file_object.writelines(result['ip_str']+'\n')
except shodan.APIError, e:
print 'Error: %s' % e
file_object.close()
(3) 通过命令行参数指定搜索条件，将搜索到的IP写入文件
python代码如下：
import shodan
import sys
SHODAN_API_KEY = "SkVS0RAbiTQpzzEsahqnq2Hv6SwjUfs3"
api = shodan.Shodan(SHODAN_API_KEY)
if len(sys.argv)<2:
print '[!]Wrong parameter'
sys.exit(0)
print '[*]Search string: %s' % sys.argv[1]
file_object = open('ip.txt', 'w')
try:
results = api.search(sys.argv[1])
print '[+]Results found: %s' % results['total']
for result in results['matches']:
# print result['ip_str']
file_object.writelines(result['ip_str']+'\n')
except shodan.APIError, e:
print 'Error: %s' % e
file_object.close()
命令行参数:
search.py apache
注：
如果搜索多个关键词，需要用引号将搜索条件包含，例如：
search.py "apache country:US"
(4) 读取文件中的IP列表，反查IP信息
python代码如下：
import sys
reload(sys)
sys.setdefaultencoding('utf8')
SHODAN_API_KEY = "SkVS0RAbiTQpzzEsahqnq2Hv6SwjUfs3"
api = shodan.Shodan(SHODAN_API_KEY)
def searchip( str ):
try:
host = api.host(str)
except shodan.exception.APIError:
print "[!]No information available"
print "---------------------------------------------"
return
else:
# Print general info
try:
print "IP: %s\r\nOrganization: %s\r\nOperating System: %s" % (host['ip_str'], host.get('org', 'n/a'), host.get('os', 'n/a'))
except UnicodeEncodeError:
print "[!]UnicodeEncode Error\r\n"
else:
# Print all banners
for item in host['data']:
print "Port: %s\r\nBanner: %s" % (item['port'], item['data'])
print "---------------------------------------------"
return
file_object = open('ip.txt', 'r')
for line in file_object:
searchip(line)
0x05 通过Shodan官网下载搜索结果
通过Shodan官网下载数据时使用Export credits，如下图
查询一次消耗一个export credit，无论结果有多少个，最多为10000个
导出格式选择为json
(1) 从下载的json结果文件中提取IP
python代码如下:
import json
file_object = open("shodan_data.json", 'r')
for line in file_object:
data = json.loads(line)
print data["ip_str"]
file_object.close()
(2) 从下载的json结果文件中提取指定国家的IP和端口
国家代号在二级元素中，对应结构：data["location"]["country_code"]
python代码如下:
import json
import sys
import re
def search(country):
file_object = open("shodan_data.json", 'r')
file_object2 = open(country+".txt", 'w')
for line in file_object:
data = json.loads(line)
if re.search(data["location"]["country_code"], country, re.IGNORECASE):
str1 = "%s:%s" % (data["ip_str"],data["port"])
print str1
file_object2.writelines(str1+'\n')
file_object.close()
file_object2.close()
if __name__ == "__main__":
if len(sys.argv)<2:
print ('[!]Wrong parameter')
sys.exit(0)
else:
print ('[*]Search country code: %s' % sys.argv[1])
search(sys.argv[1])
print ("[+]Done")
命令行参数:
search.py US
生成文件US.txt，保存IP和对应的端口
0x06 小结
本文介绍了Shodan API的用法，分享使用心得和python脚本开发技巧。选择付费购买时，记得区分好三种积分(credits) from
官方版本(英文)
Installation
The shodan command-line interface (CLI) is packaged with the official Python library for Shodan, which means if you’re running the latest version of the library you already have access to the CLI. To install the new tool simply execute:easy_install shodan
Or if you’re running an older version of the Shodan Python library and want to upgrade:easy_install -U shodan
Once the tool is installed you have to initialize the environment with your API key using shodan initshodan init YOUR_API_KEY
You can get your API key from your Shodan account page located at:Get your API Key
Command Overview
The shodan CLI has a lot of commands, the most popular/ common ones are documented below. For the full list of commands just run the tool without any arguments:
$ shodan
count
Returns the number of results for a search query.
Example
$ shodan count microsoft iis 6.0 5310594
download
Search Shodan and download the results into a file where each line is a JSON banner. For more information on what the banner contains check out:Banner Specification
By default it will only download 1,000 results, if you want to download more look at the –limit flag.
The download command is what you should be using most often when getting results from Shodan since it lets you save the results and process them afterwards using the parsecommand. Because paging through results uses query credits, it makes sense to always store searches that you’re doing so you won’t need to use query credits for a search you already did in the past.
Example
host
See information about the host such as where it’s located, what ports are open and which organization owns the IP.
Example
$ shodan host 189.201.128.250
myip
Returns your Internet-facing IP address.
Example
$ shodan myip 199.30.49.210
parse
Use parse to analyze a file that was generated using the download command. It lets you filter out the fields that you’re interested in, convert the JSON to a CSV and is friendly for pipe-ing to other scripts.
Example
The following command outputs the IP address, port and organization in CSV format for the previously downloaded Microsoft-IIS data:
$ shodan parse --fields ip_str,port,org --separator , microsoft-data.json.gz
search
This command lets you search Shodan and view the results in a terminal-friendly way. By default it will display the IP, port, hostnames and data. You can use the –fields parameter to print whichever banner fields you’re interested in.
Example
To search Microsoft IIS 6.0 and print out their IP, port, organization and hostnames use the following command:
$ shodan search --fields ip_str,port,org,hostnames microsoft iis 6.0
以上就是 shodan api使用指南 的详细信息,api这东西在哪里都一样:免费—限制 付费–加量.用法大同小异.. https://developer.shodan.io/api