SMART error (CurrentPendingSector) detected on host ZFS編
をテンプレートにして作成
[
トップ
] [
新規
|
一覧
|
検索
|
最終更新
|
ヘルプ
|
ログイン
]
開始行:
CONTENTS
#contents
----
Lastmodified &lastmod;
----
*SMART error (CurrentPendingSector) detected on host ZFS...
[[SMART error (CurrentPendingSector) detected on host]]
# zpool status
pool: tank
state: ONLINE
scan: scrub canceled on Fri Aug 14 08:50:50 2015
config:
NAME STATE READ WRITE CKSUM
tank ONLINE 0 0 0
raidz1-0 ONLINE 0 0 0
ada1 ONLINE 0 0 0
ada2 ONLINE 0 0 0
ada3 ONLINE 0 0 0
errors: No known data errors
pool: zfspool
state: ONLINE
scan: none requested
config:
NAME STATE READ WRITE CKSUM
zfspool ONLINE 0 0 0
ada0p3 ONLINE 0 0 0
errors: No known data errors
こんな構成のFreeBSD 9.x なサーバから、こんなメールが・・・
** SMART error (CurrentPendingSector) detected on host: b...
This email was generated by the smartd daemon running on:
host name: blackcube.smb.net
DNS domain: smb.net
NIS domain:
The following warning/error was logged by the smartd dae...
Device: /dev/ada1, 2 Currently unreadable (pending) sect...
For details see host's SYSLOG.
You can also use the smartctl utility for further invest...
No additional email messages about this problem will be ...
ログはこんな具合。
root@blackcube:/home/kuji # grep -i "smartd" /var/log/me...
Aug 14 06:27:15 blackcube smartd[1066]: Device: /dev/ada...
Aug 14 06:27:15 blackcube smartd[1066]: Device: /dev/ada...
Aug 14 06:57:15 blackcube smartd[1066]: Device: /dev/ada...
Aug 14 06:57:15 blackcube smartd[1066]: Device: /dev/ada...
Aug 14 07:27:16 blackcube smartd[1066]: Device: /dev/ada...
Aug 14 07:27:16 blackcube smartd[1066]: Device: /dev/ada...
Aug 14 07:57:15 blackcube smartd[1066]: Device: /dev/ada...
Aug 14 07:57:15 blackcube smartd[1066]: Device: /dev/ada...
Aug 14 08:27:15 blackcube smartd[1066]: Device: /dev/ada...
Aug 14 08:27:15 blackcube smartd[1066]: Device: /dev/ada...
/dev/ada1 は、こんな・・・
# smartctl /dev/ada1 --log=selftest
smartctl 5.43 2012-06-30 r3573 [FreeBSD 9.1-RELEASE-p22 ...
Copyright (C) 2002-12 by Bruce Allen, http://smartmontoo...
=== START OF READ SMART DATA SECTION ===
SMART Self-test log structure revision number 1
Num Test_Description Status Remaini...
# 1 Short offline Completed without error 0...
# 2 Short offline Interrupted (host reset) 0...
# 3 Short offline Completed without error 0...
# 4 Short offline Interrupted (host reset) 0...
# 5 Short offline Interrupted (host reset) 0...
# 6 Short offline Completed without error 0...
# 7 Extended offline Completed: read failure 9...
# 8 Short offline Interrupted (host reset) 0...
# 9 Short offline Interrupted (host reset) 0...
#10 Short offline Interrupted (host reset) 0...
#11 Short offline Completed without error 0...
#12 Short offline Completed without error 0...
#13 Short offline Completed without error 0...
#14 Short offline Completed without error 0...
#15 Extended offline Completed: read failure 9...
#16 Extended offline Completed: read failure 9...
#17 Short offline Interrupted (host reset) 0...
#18 Short offline Completed without error 0...
#19 Short offline Completed without error 0...
#20 Short offline Completed without error 0...
#21 Short offline Completed without error 0...
と言うことで、
b = (int)((L-S)*512/B)
where:
b = File System block number
B = File system block size in bytes
L = LBA of bad sector
S = Starting sector of partition as shown by fdisk...
and (int) denotes the integer part.
S = 0、B = 4096、L = 51978742を公式に代入。
b = (int)(51978742 * 512 / 4096) = (int) 6497342.75 (小...
で、
# dd if=/dev/zero of=/dev/ada1 bs=4096 count=1 seek=6497...
とか、してみたが、状況変わらず。
そこで、ブロックサイズが16ｋのほうの式
b = (int)((L-S)*512/B)
where:
b = File System block number
B = File system block size in bytes (dumpfs 16384)
L = LBA of bad sector
S = Starting sector of partition as shown by fdisk
and (int) denotes the integer part.
S = 0、B = 16384、L = 51978742を公式に代入。
b = (int)(51978742 * 512 / 16384) = (int) 1624335.6875 (...
ということで、
# sysctl kern.geom.debugflags=0x10
kern.geom.debugflags: 0 -> 16
# dd if=/dev/zero of=/dev/ada1 bs=16384 count=1 seek=162...
1+0 records in
1+0 records out
16384 bytes transferred in 0.000646 secs (25367101 bytes...
# sysctl kern.geom.debugflags=0
kern.geom.debugflags: 16 -> 0
とすると、このように変化。
root@blackcube:/home/kuji # grep -i "smartd" /var/log/me...
Aug 14 06:57:15 blackcube smartd[1066]: Device: /dev/ada...
Aug 14 06:57:15 blackcube smartd[1066]: Device: /dev/ada...
Aug 14 07:27:16 blackcube smartd[1066]: Device: /dev/ada...
Aug 14 07:27:16 blackcube smartd[1066]: Device: /dev/ada...
Aug 14 07:57:15 blackcube smartd[1066]: Device: /dev/ada...
Aug 14 07:57:15 blackcube smartd[1066]: Device: /dev/ada...
Aug 14 08:27:15 blackcube smartd[1066]: Device: /dev/ada...
Aug 14 08:27:15 blackcube smartd[1066]: Device: /dev/ada...
Aug 14 08:57:15 blackcube smartd[1066]: Device: /dev/ada...
Aug 14 08:57:15 blackcube smartd[1066]: Device: /dev/ada...
エラーは、2個から1個に減っている。もう一度テスト
# smartctl --test=long /dev/ada1
smartctl 5.43 2012-06-30 r3573 [FreeBSD 9.1-RELEASE-p22 ...
Copyright (C) 2002-12 by Bruce Allen, http://smartmontoo...
=== START OF OFFLINE IMMEDIATE AND SELF-TEST SECTION ===
Sending command: "Execute SMART Extended self-test routi...
Drive command "Execute SMART Extended self-test routine ...
Testing has begun.
Please wait 116 minutes for test to complete.
Test will complete after Fri Aug 14 11:46:40 2015
Use smartctl -X to abort test.
もう1カ所がここ・・・？
# smartctl /dev/ada1 --log=selftest
smartctl 5.43 2012-06-30 r3573 [FreeBSD 9.1-RELEASE-p22 ...
Copyright (C) 2002-12 by Bruce Allen, http://smartmontoo...
=== START OF READ SMART DATA SECTION ===
SMART Self-test log structure revision number 1
Num Test_Description Status Remaini...
# 1 Extended offline Completed: read failure 9...
# 2 Short offline Completed without error 0...
# 3 Short offline Interrupted (host reset) 0...
# 4 Short offline Completed without error 0...
# 5 Short offline Interrupted (host reset) 0...
# 6 Short offline Interrupted (host reset) 0...
# 7 Short offline Completed without error 0...
# 8 Extended offline Completed: read failure 9...
# 9 Short offline Interrupted (host reset) 0...
#10 Short offline Interrupted (host reset) 0...
#11 Short offline Interrupted (host reset) 0...
#12 Short offline Completed without error 0...
#13 Short offline Completed without error 0...
#14 Short offline Completed without error 0...
#15 Short offline Completed without error 0...
#16 Extended offline Completed: read failure 9...
#17 Extended offline Completed: read failure 9...
#18 Short offline Interrupted (host reset) 0...
#19 Short offline Completed without error 0...
#20 Short offline Completed without error 0...
#21 Short offline Completed without error 0...
# grep -i "smartd" /var/log/messages | tail
Aug 14 10:13:12 blackcube smartd[1066]: Device: /dev/ada...
Aug 14 10:13:12 blackcube smartd[1066]: Device: /dev/ada...
Aug 14 10:13:12 blackcube smartd[1066]: Device: /dev/ada...
Aug 14 10:13:12 blackcube smartd[1066]: Device: /dev/ada...
Aug 14 10:43:12 blackcube smartd[1066]: Device: /dev/ada...
Aug 14 10:43:12 blackcube smartd[1066]: Device: /dev/ada...
Aug 14 11:13:13 blackcube smartd[1066]: Device: /dev/ada...
Aug 14 11:13:13 blackcube smartd[1066]: Device: /dev/ada...
Aug 14 11:43:12 blackcube smartd[1066]: Device: /dev/ada...
Aug 14 11:43:12 blackcube smartd[1066]: Device: /dev/ada...
計算
b = (int)(101630056 * 512 / 16384) = (int) 3175939.25 (...
1017 11:57 sysctl kern.geom.debugflags=0x10
1018 11:57 dd if=/dev/zero of=/dev/ada1 bs=16384 cou...
1019 11:58 sysctl kern.geom.debugflags=0
* FreeBSD 11-CURRENT BS 4096 [#be0f60da]
install 時にZrootの設定で、HDDのブロックサイズを４ｋ（デ...
root@blackhole:~ # smartctl --test=short /dev/ada0
smartctl 6.4 2015-06-04 r4109 [FreeBSD 11.0-CURRENT amd6...
Copyright (C) 2002-15, Bruce Allen, Christian Franke, ww...
=== START OF OFFLINE IMMEDIATE AND SELF-TEST SECTION ===
Sending command: "Execute SMART Short self-test routine ...
Drive command "Execute SMART Short self-test routine imm...
Testing has begun.
Please wait 2 minutes for test to complete.
Test will complete after Tue Sep 22 11:15:30 2015
Use smartctl -X to abort test.
root@blackhole:~ # smartctl /dev/ada0 --log=selftest
smartctl 6.4 2015-06-04 r4109 [FreeBSD 11.0-CURRENT amd6...
Copyright (C) 2002-15, Bruce Allen, Christian Franke, ww...
=== START OF READ SMART DATA SECTION ===
SMART Self-test log structure revision number 1
Num Test_Description Status Remaini...
# 1 Short offline Completed without error 0...
# 2 Short offline Completed without error 0...
# 3 Extended offline Interrupted (host reset) 7...
# 4 Short offline Completed without error 0...
# 5 Short offline Completed without error 0...
# 6 Short offline Completed without error 0...
# 7 Short offline Completed: read failure 9...
# 8 Short offline Completed without error 0...
# 9 Short offline Completed without error 0...
#10 Short offline Completed without error 0...
#11 Short offline Completed without error 0...
#12 Short offline Completed without error 0...
#13 Short offline Completed: read failure 9...
#14 Short offline Completed without error 0...
#15 Short captive Completed: read failure 9...
#16 Short captive Completed: read failure 9...
#17 Short captive Completed: read failure 9...
#18 Short captive Completed: read failure 9...
#19 Short captive Completed: read failure 9...
#20 Short captive Completed: read failure 9...
#21 Short offline Completed: read failure 9...
b = (int)((L-S)*512/B)
where:
b = File System block number
B = File system block size in bytes
L = LBA of bad sector
S = Starting sector of partition as shown by fdisk...
and (int) denotes the integer part.
S = 0、B = 4096、L = 3480882840を公式に代入。
b = (int)(1043624 * 512 / 4096) = (int) 424912454.833984...
root@blackhole:~ # sysctl kern.geom.debugflags=0x10
kern.geom.debugflags: 0 -> 16
root@blackhole:~ # dd if=/dev/zero of=/dev/ada0 bs=4096 ...
1+0 records in
1+0 records out
4096 bytes transferred in 0.000181 secs (22647226 bytes/...
root@blackhole:~ # sysctl kern.geom.debugflags=0
kern.geom.debugflags: 16 -> 0
root@blackhole:~ #
380 11:17 smartctl /dev/ada0 --log=selftest
381 11:32 kern.geom.debugflags: 0 - > 16
382 11:32 sysctl kern.geom.debugflags=0x10
383 11:35 dd if=/dev/zero of=/dev/ada0 bs=4096 coun...
384 11:36 sysctl kern.geom.debugflags=0
http://d.hatena.ne.jp/flying-foozy/20131122/1385105842
http://blogs.yahoo.co.jp/alpha3166/10334103.html
----
Total access &counter(total);：本日 &counter(today);：昨...
#counter([total|today|yesterday]);
終了行:
CONTENTS
#contents
----
Lastmodified &lastmod;
----
*SMART error (CurrentPendingSector) detected on host ZFS...
[[SMART error (CurrentPendingSector) detected on host]]
# zpool status
pool: tank
state: ONLINE
scan: scrub canceled on Fri Aug 14 08:50:50 2015
config:
NAME STATE READ WRITE CKSUM
tank ONLINE 0 0 0
raidz1-0 ONLINE 0 0 0
ada1 ONLINE 0 0 0
ada2 ONLINE 0 0 0
ada3 ONLINE 0 0 0
errors: No known data errors
pool: zfspool
state: ONLINE
scan: none requested
config:
NAME STATE READ WRITE CKSUM
zfspool ONLINE 0 0 0
ada0p3 ONLINE 0 0 0
errors: No known data errors
こんな構成のFreeBSD 9.x なサーバから、こんなメールが・・・
** SMART error (CurrentPendingSector) detected on host: b...
This email was generated by the smartd daemon running on:
host name: blackcube.smb.net
DNS domain: smb.net
NIS domain:
The following warning/error was logged by the smartd dae...
Device: /dev/ada1, 2 Currently unreadable (pending) sect...
For details see host's SYSLOG.
You can also use the smartctl utility for further invest...
No additional email messages about this problem will be ...
ログはこんな具合。
root@blackcube:/home/kuji # grep -i "smartd" /var/log/me...
Aug 14 06:27:15 blackcube smartd[1066]: Device: /dev/ada...
Aug 14 06:27:15 blackcube smartd[1066]: Device: /dev/ada...
Aug 14 06:57:15 blackcube smartd[1066]: Device: /dev/ada...
Aug 14 06:57:15 blackcube smartd[1066]: Device: /dev/ada...
Aug 14 07:27:16 blackcube smartd[1066]: Device: /dev/ada...
Aug 14 07:27:16 blackcube smartd[1066]: Device: /dev/ada...
Aug 14 07:57:15 blackcube smartd[1066]: Device: /dev/ada...
Aug 14 07:57:15 blackcube smartd[1066]: Device: /dev/ada...
Aug 14 08:27:15 blackcube smartd[1066]: Device: /dev/ada...
Aug 14 08:27:15 blackcube smartd[1066]: Device: /dev/ada...
/dev/ada1 は、こんな・・・
# smartctl /dev/ada1 --log=selftest
smartctl 5.43 2012-06-30 r3573 [FreeBSD 9.1-RELEASE-p22 ...
Copyright (C) 2002-12 by Bruce Allen, http://smartmontoo...
=== START OF READ SMART DATA SECTION ===
SMART Self-test log structure revision number 1
Num Test_Description Status Remaini...
# 1 Short offline Completed without error 0...
# 2 Short offline Interrupted (host reset) 0...
# 3 Short offline Completed without error 0...
# 4 Short offline Interrupted (host reset) 0...
# 5 Short offline Interrupted (host reset) 0...
# 6 Short offline Completed without error 0...
# 7 Extended offline Completed: read failure 9...
# 8 Short offline Interrupted (host reset) 0...
# 9 Short offline Interrupted (host reset) 0...
#10 Short offline Interrupted (host reset) 0...
#11 Short offline Completed without error 0...
#12 Short offline Completed without error 0...
#13 Short offline Completed without error 0...
#14 Short offline Completed without error 0...
#15 Extended offline Completed: read failure 9...
#16 Extended offline Completed: read failure 9...
#17 Short offline Interrupted (host reset) 0...
#18 Short offline Completed without error 0...
#19 Short offline Completed without error 0...
#20 Short offline Completed without error 0...
#21 Short offline Completed without error 0...
と言うことで、
b = (int)((L-S)*512/B)
where:
b = File System block number
B = File system block size in bytes
L = LBA of bad sector
S = Starting sector of partition as shown by fdisk...
and (int) denotes the integer part.
S = 0、B = 4096、L = 51978742を公式に代入。
b = (int)(51978742 * 512 / 4096) = (int) 6497342.75 (小...
で、
# dd if=/dev/zero of=/dev/ada1 bs=4096 count=1 seek=6497...
とか、してみたが、状況変わらず。
そこで、ブロックサイズが16ｋのほうの式
b = (int)((L-S)*512/B)
where:
b = File System block number
B = File system block size in bytes (dumpfs 16384)
L = LBA of bad sector
S = Starting sector of partition as shown by fdisk
and (int) denotes the integer part.
S = 0、B = 16384、L = 51978742を公式に代入。
b = (int)(51978742 * 512 / 16384) = (int) 1624335.6875 (...
ということで、
# sysctl kern.geom.debugflags=0x10
kern.geom.debugflags: 0 -> 16
# dd if=/dev/zero of=/dev/ada1 bs=16384 count=1 seek=162...
1+0 records in
1+0 records out
16384 bytes transferred in 0.000646 secs (25367101 bytes...
# sysctl kern.geom.debugflags=0
kern.geom.debugflags: 16 -> 0
とすると、このように変化。
root@blackcube:/home/kuji # grep -i "smartd" /var/log/me...
Aug 14 06:57:15 blackcube smartd[1066]: Device: /dev/ada...
Aug 14 06:57:15 blackcube smartd[1066]: Device: /dev/ada...
Aug 14 07:27:16 blackcube smartd[1066]: Device: /dev/ada...
Aug 14 07:27:16 blackcube smartd[1066]: Device: /dev/ada...
Aug 14 07:57:15 blackcube smartd[1066]: Device: /dev/ada...
Aug 14 07:57:15 blackcube smartd[1066]: Device: /dev/ada...
Aug 14 08:27:15 blackcube smartd[1066]: Device: /dev/ada...
Aug 14 08:27:15 blackcube smartd[1066]: Device: /dev/ada...
Aug 14 08:57:15 blackcube smartd[1066]: Device: /dev/ada...
Aug 14 08:57:15 blackcube smartd[1066]: Device: /dev/ada...
エラーは、2個から1個に減っている。もう一度テスト
# smartctl --test=long /dev/ada1
smartctl 5.43 2012-06-30 r3573 [FreeBSD 9.1-RELEASE-p22 ...
Copyright (C) 2002-12 by Bruce Allen, http://smartmontoo...
=== START OF OFFLINE IMMEDIATE AND SELF-TEST SECTION ===
Sending command: "Execute SMART Extended self-test routi...
Drive command "Execute SMART Extended self-test routine ...
Testing has begun.
Please wait 116 minutes for test to complete.
Test will complete after Fri Aug 14 11:46:40 2015
Use smartctl -X to abort test.
もう1カ所がここ・・・？
# smartctl /dev/ada1 --log=selftest
smartctl 5.43 2012-06-30 r3573 [FreeBSD 9.1-RELEASE-p22 ...
Copyright (C) 2002-12 by Bruce Allen, http://smartmontoo...
=== START OF READ SMART DATA SECTION ===
SMART Self-test log structure revision number 1
Num Test_Description Status Remaini...
# 1 Extended offline Completed: read failure 9...
# 2 Short offline Completed without error 0...
# 3 Short offline Interrupted (host reset) 0...
# 4 Short offline Completed without error 0...
# 5 Short offline Interrupted (host reset) 0...
# 6 Short offline Interrupted (host reset) 0...
# 7 Short offline Completed without error 0...
# 8 Extended offline Completed: read failure 9...
# 9 Short offline Interrupted (host reset) 0...
#10 Short offline Interrupted (host reset) 0...
#11 Short offline Interrupted (host reset) 0...
#12 Short offline Completed without error 0...
#13 Short offline Completed without error 0...
#14 Short offline Completed without error 0...
#15 Short offline Completed without error 0...
#16 Extended offline Completed: read failure 9...
#17 Extended offline Completed: read failure 9...
#18 Short offline Interrupted (host reset) 0...
#19 Short offline Completed without error 0...
#20 Short offline Completed without error 0...
#21 Short offline Completed without error 0...
# grep -i "smartd" /var/log/messages | tail
Aug 14 10:13:12 blackcube smartd[1066]: Device: /dev/ada...
Aug 14 10:13:12 blackcube smartd[1066]: Device: /dev/ada...
Aug 14 10:13:12 blackcube smartd[1066]: Device: /dev/ada...
Aug 14 10:13:12 blackcube smartd[1066]: Device: /dev/ada...
Aug 14 10:43:12 blackcube smartd[1066]: Device: /dev/ada...
Aug 14 10:43:12 blackcube smartd[1066]: Device: /dev/ada...
Aug 14 11:13:13 blackcube smartd[1066]: Device: /dev/ada...
Aug 14 11:13:13 blackcube smartd[1066]: Device: /dev/ada...
Aug 14 11:43:12 blackcube smartd[1066]: Device: /dev/ada...
Aug 14 11:43:12 blackcube smartd[1066]: Device: /dev/ada...
計算
b = (int)(101630056 * 512 / 16384) = (int) 3175939.25 (...
1017 11:57 sysctl kern.geom.debugflags=0x10
1018 11:57 dd if=/dev/zero of=/dev/ada1 bs=16384 cou...
1019 11:58 sysctl kern.geom.debugflags=0
* FreeBSD 11-CURRENT BS 4096 [#be0f60da]
install 時にZrootの設定で、HDDのブロックサイズを４ｋ（デ...
root@blackhole:~ # smartctl --test=short /dev/ada0
smartctl 6.4 2015-06-04 r4109 [FreeBSD 11.0-CURRENT amd6...
Copyright (C) 2002-15, Bruce Allen, Christian Franke, ww...
=== START OF OFFLINE IMMEDIATE AND SELF-TEST SECTION ===
Sending command: "Execute SMART Short self-test routine ...
Drive command "Execute SMART Short self-test routine imm...
Testing has begun.
Please wait 2 minutes for test to complete.
Test will complete after Tue Sep 22 11:15:30 2015
Use smartctl -X to abort test.
root@blackhole:~ # smartctl /dev/ada0 --log=selftest
smartctl 6.4 2015-06-04 r4109 [FreeBSD 11.0-CURRENT amd6...
Copyright (C) 2002-15, Bruce Allen, Christian Franke, ww...
=== START OF READ SMART DATA SECTION ===
SMART Self-test log structure revision number 1
Num Test_Description Status Remaini...
# 1 Short offline Completed without error 0...
# 2 Short offline Completed without error 0...
# 3 Extended offline Interrupted (host reset) 7...
# 4 Short offline Completed without error 0...
# 5 Short offline Completed without error 0...
# 6 Short offline Completed without error 0...
# 7 Short offline Completed: read failure 9...
# 8 Short offline Completed without error 0...
# 9 Short offline Completed without error 0...
#10 Short offline Completed without error 0...
#11 Short offline Completed without error 0...
#12 Short offline Completed without error 0...
#13 Short offline Completed: read failure 9...
#14 Short offline Completed without error 0...
#15 Short captive Completed: read failure 9...
#16 Short captive Completed: read failure 9...
#17 Short captive Completed: read failure 9...
#18 Short captive Completed: read failure 9...
#19 Short captive Completed: read failure 9...
#20 Short captive Completed: read failure 9...
#21 Short offline Completed: read failure 9...
b = (int)((L-S)*512/B)
where:
b = File System block number
B = File system block size in bytes
L = LBA of bad sector
S = Starting sector of partition as shown by fdisk...
and (int) denotes the integer part.
S = 0、B = 4096、L = 3480882840を公式に代入。
b = (int)(1043624 * 512 / 4096) = (int) 424912454.833984...
root@blackhole:~ # sysctl kern.geom.debugflags=0x10
kern.geom.debugflags: 0 -> 16
root@blackhole:~ # dd if=/dev/zero of=/dev/ada0 bs=4096 ...
1+0 records in
1+0 records out
4096 bytes transferred in 0.000181 secs (22647226 bytes/...
root@blackhole:~ # sysctl kern.geom.debugflags=0
kern.geom.debugflags: 16 -> 0
root@blackhole:~ #
380 11:17 smartctl /dev/ada0 --log=selftest
381 11:32 kern.geom.debugflags: 0 - > 16
382 11:32 sysctl kern.geom.debugflags=0x10
383 11:35 dd if=/dev/zero of=/dev/ada0 bs=4096 coun...
384 11:36 sysctl kern.geom.debugflags=0
http://d.hatena.ne.jp/flying-foozy/20131122/1385105842
http://blogs.yahoo.co.jp/alpha3166/10334103.html
----
Total access &counter(total);：本日 &counter(today);：昨...
#counter([total|today|yesterday]);
ページ名:
![[PukiWiki]](image/pukiwiki.png "[PukiWiki]")
