using solr to find the right person for the right job - by kang laura

Click to edit Master title style

• Click to edit Master text styles– Second level

•Third level– Fourth level

»Fifth level

Using Solr to find the right person for the right job

M AY 2 0 11

L A U R A K A N G

T H E L A D D E R S . C O M




»Fifth level

Agenda

• Search at the Ladders• Current Projects

– Standardization of search products– Recommendation service

• Suggested Candidates– Testing Sessions– Challenges and Future Work




»Fifth level

TheLadders.com

• $100K+ job search and career management• Right person for the right job, right job for the right

person• > 4 million members

• Recruit Ladder• Community of recruiters and job seekers• Job search advisors and talent specialists




»Fifth level

Search at the Ladders

• January 2010: search team formed. – First member: computational linguist, Dr. Leslie Barrett

• February 2011: platform team formed. – 9 members– Search, CMS, shared services– Led by Ed Cudahy




»Fifth level

Solr/Lucene at the Ladders

Subscriber search

Candidate search

Recruiter search Job search Hiring

alerts search

Editorial content search

Search

Job to Candidate

Candidate to Job

Recruiter to Candidate

Suggestions

Recruiterslike this

Candidateslike this

Jobslike this




»Fifth level

Standardization of Search Products

• Before– Legacy implementations

•Local Lucene index •Different versions of Solr

– Hard to make improvements• Move to Solr 3.1.0




»Fifth level

Solr Setup

• Extended dismax

• Preprocessing non-alphanumeric characters

• Analyzers/Tokenizers– Stop word removal– Index-side synonym expansion– Custom stemmers

• Custom length normalization for job description and resumes

• Replication

• Multi-core

• Template: maven archetype

• Autosuggest




»Fifth level

Challenges

• Power users– Large Boolean queries– Target result set of 50

• Synonyms with different lengths– HR manager vs. Human Resource manager– Phrase slop

• Company variants• Communicating to users




»Fifth level

Typical Query • Title: "sales consultant" "sales engineer" "solutions architect"

"solution architect" engineer architect "pre-sales consultant" "presales consultant" "solutions engineer" -president -vp -cmo -ceo -cfo -chief -director -software -"s/w" –database

• Location: Redwood City, CA, 100 miles• Company: apple "ingram micro" "tech data" intermec "insight

enterprises" "super micro computer" "digi international inc" radisys "silicon graphics international corp" cray angilysys voltaire "concurrent computer" gtsi "socket mobile" hp hewlett hitachi ibm "i. b. m." "i.b.m." "international business machines" "business machines" intevac xyratex quantum "western digital" wd w.d. ramtron "micron technology" e.m.c. "e. m. c." sandisk brocade seagate 3par stec "dot hill" ocz o.c.z. "o. c. z." "hutchinson technology" "hutchinson tech" lasercard edci dataram "overland storage" emc netapp

• Keyword: (presales "pre sales" pre-sales sales) AND (engineer engineering) AND (storage hardware "sun microsystems" "sun servers")




»Fifth level

Recommendation Service

• RESTful web service• Solr backend• Tracking/feedback• A/B framework

Job to Candidate

Candidate to Job

Recruiter to Candidate

Recommendation Service

Recruiterslike this

Candidateslike this

Jobslike this

Client Application




»Fifth level

Other Projects

• Resume parsing– Parse flagging

• Company list– Company variants– Similar companies

• Synonym list generation• Search help for users




»Fifth level

Suggested Candidates

• Coming soon on Recruit Ladder http://recruit.theladders.com• Suggest candidates that might be a good match when a

recruiter posts a job• Goal:

– Help recruiters quickly identify candidates that are right for the job– Increase interaction between recruiters and job seekers




»Fifth level




»Fifth level

Suggested Candidates

• Hybrid– Categories

1. Position level2. Job specialties/disciplines3. Industry• Job title => position level (VP, director) + job function (marketing)• Relevance matrices for partial matches

– Text• Job function keywords• Candidate’s job experience vs. job description using MoreLikeThis

• Boosting• Filters: salary range, years of experience, location




»Fifth level

Challenges

• Certifications and skills– Taxonomy

• “Good” resume– Resume scoring

• Job description– Short job descriptions– “Series 7 & 63 and 10+ years of experience in related field required”

– Company description/Equal Employment Opportunity clauses

• Different priorities for each job type




»Fifth level

Evaluation

• Other products:– Mean-average precision: search– A/B testing: suggested jobs

• Testing sessions with talent specialists and external recruiters

• Randomly selected set of jobs• Given 5 candidates and their resumes

0 = not a good match1 = keep in pipeline2 = contact




»Fifth level

Future Work

• Job description parser– Skills and certifications

• UI improvements– Personalized weights and filters– Company description

• Geospatial features• Recommendation Service: user ratings• Search/Recommendation quality testing framework

– Customer satisfaction metrics– Pre-release metrics




»Fifth level

We’re hiring

• Email [email protected]




»Fifth level

Questions?

using solr to find the right person for the right job - by kang laura

Technology