Crawl

Public API
Search topology components
HTTP
File shares
SharePoint
User profiles
Lotus Notes
Documentum
Exchange folders
Custom - BCS
SharePoint
SP Apps
Devices
Non-SP UX
Vital (and large) part of
your farm!





New-SPEnterpriseSearchTopology
New-SPEnterpriseSearchCrawlComponent
New-SPEnterpriseSearchIndexComponent
…
Set-SPEnterpriseSearchTopology
SharePoint 2010 Search Service Application
Query Component
Query
Engine
Property
Store
(SQL)
Crawl Component
FAST
Content
SSA
FAST back-end components
(managed separately)
Extensibility:
• Sandbox
• Entity
Extraction
FAST
Query
SSA
Entire index on
local disk
SharePoint 2013 Search Service Application
Property
Store
(SQL)
Separate crawl
and indexing
Link/query analysis
& recommendations
More details: SPC336 - Search Architecture and Sizing in SharePoint 2013
Still there, but only
Crawl Component
SharePoint App Server


Search Runtime Environment
hostcontrollerservice.exe
Host Controller
noderunner.exe
Admin
Component
noderunner.exe
Query
Processing
Component
noderunner.exe
Content
Processing
Component
noderunner.exe
Index
Component
msseearch.exe
mssdmn.exe
noderunner.exe
Analytics
Processing
Component
Crawl
Component
Component
HA mode of operation
Crawl Component
Load-sharing, stateless in DB
Index Component
Per partition Primary/Sec/Ter (dynamic selection)
Query load-sharing
Content/Query Processing components
Load-sharing, stateless
Analytics Processing Component
Distributed map/reduce, stateless in DB
Admin Component
Primary/Secondary (dynamic selection)
Hot standby
Host Controller
(for search dictionary repository)
Primary/Secondary (cmdlet controlled)
Lost primary – no new dictionaries deployed
Prepare servers
• HW/SW reqs!
• Install SharePoint
• Add servers to farm
• Start Search Service
Instance
• Create SSA
Create a new topology
object for the SSA
Add search
components to the
topology
Assign components to
servers
Activate the new
topology
This will replace the
single-server topology
with a scaled-out
topology

Application Server


Query Processing
Processing
Query
Replica
Replica
VM
02
Crawl
Application Server
QueryProcessing
Processing
Query
Index partition 0
VM
01
Application Server


Host server B
Host server A
Replica
Replica
Application Server
Crawl
Admin
Admin
Analytics
Analytics
Content processing
Content processing
Host server C
VM
04
VM
03
Host server D
All SharePoint databases
Search admin db
Link db
Crawl db
Analytics db
More details: SPC336 - Search Architecture and Sizing in SharePoint 2013
All SharePoint databases
Redundant copies of
all databases
Index
Index
Index
Index
Index
Index
Content
Processing
Central Search Farm
365 farm
Regional
3
Regional farm
farmOffice
3
Search service
Crawler
Crawler
Crawler
Crawler
Crawler
Crawler
Index
Regional farm
farm 1
Regional
1
Crawler
Index
Regional
Regional farm
farm 2
2
Index
Crawler
Index
Green
Yellow
Red
TechNet Wiki
Index:
partition
Content
Processing:
Gatherer
Content
Processing
connector
Analytics
analysis:
failed
toCrawler
start
warning
– search analytics
Query
SearchMissing
Service:
Gatherer:
Service
Disk
Full
availability
query
processing
TechNet SCOM knowledge article - http://technet.microsoft.com/enus/library/ee513082(v=office.15).aspx
Daily – Admins
Daily – Business user
Check search topology UI, any
component not green there is a problem
Monitor performance reports, crawler
health and query health
Review usage reports for trends
No Result Queries aka 0 hits
Top Queries by Day
Abandoned Queries
Weekly – Admins
Weekly – Business user
Verify # of documents per partition and
disk space on index, crawler and
analytics components
DR backup
Security updates + Cumulative updates
For a better search experience create
Query Rules
Best bets
Authoritative Pages
Application Server
Application Server
Query Processing
Replica
Query Processing
Index partition 0
Application Server
Replica
Application Server
Crawl
Crawl
Admin
Admin
Analytics
Analytics
Content processing
Content processing
All SharePoint databases
All SharePoint databases
Search admin db
Link db
Crawl db
Analytics db
Limit
Limit
Type
Old Value Value
New Value
Content
processing components
Crawl
components
Supported
Supported
/ server
2 / SSA; 1 /1 server
Unlimited*
Content sources
Crawl databases
Supported
Boundary
5 per SSA
Index replicas
Crawl log entries
Supported
Supported
3 / index partition
100 million
Unlimited
Index components
Supported
60 / SSA; 1 / server
60 / SSA; 4 / server
Index partitions
Supported
20 / SSA
25 / SSA
Indexed items
Supported
100 M / SSA
10 M / indexer
10 M / indexer (250 M / SSA implied)
Search components
Supported
Not Documented
64 / SSA
50 / SSA
15 per SSA
Cold – Hours to Days
Pros: Cheap…. Maintenance and
operational
Warm – Minutes to Hours
Pros: Fairly inexpensive to recover
Hot – Minutes to Seconds
Pros: Fastest recovery for critical apps
Cons: Slow to recover but this may be
ok for your business
Cons: expensive and time-consuming
to maintain
Cons: Very expensive and timeconsuming to maintain
Windows Azure
On Premises
AD1
SP DR1
SP DR2
SP DR3
SQL DR1
SQL DR2
SP DR4
SP DR5
(X-Small)
(A6)
VPN Tunel
(Large)
(A6)
(Large)
(Large)
(Large)
(Large)
Queries, Crawler/Content
Cloud Service
Virtual Network
Add replacement
server to topology
Wait until added
components are green
Remove old server
from topology
Verify Host Controller
repository status
Clone active topology
Add components
Activate topology
For index replica:
Seeding must be
completed
Clone, remove, activate
Needs action if primary
host controller was on
the failed server
Before you remove
server from the farm!
Min: 8 minutes to backup 10K index: 3 nodes, 2GB of data, 6 minutes restore
Max: 8 hours to backup 80M index: 12 nodes, 2TB of data, 6 hours restore
YMMV - test
http://social.technet.microsoft.com/wiki/contents/articles/14382.survival-guide-sharepoint-2013-and-enterprise-search-sp2013es.aspx
http://technet.microsoft.com/en-us/library/cc303422(v=office.15).aspx

 Administer search in SharePoint Server 2013





Scale search for performance and availability in SharePoint Server 2013
Technical diagrams for SharePoint 2013
Manage the search topology in SharePoint Server 2013
Get-SPEnterpriseSearchStatus

 Back up Search service applications in SharePoint 2013
 Overview of SharePoint Foundation and the Volume Shadow Copy Service
Sponsored by