GPAL.GoogleDorking wraps the Google Custom Search API behind a fluent query builder. This tutorial sets up credentials, builds a simple search, then layers on advanced operators like site restriction, file type, exact phrase, and date restriction, all returning results as a familiar IGPALGrid.
Here's the whole workflow, start to finish. Each piece is broken down and explained below.
using GenerallyPositive;
using static GenerallyPositive.Enums;
GPAL.WithPublishToConsole();
string apiKey = "YOUR_API_KEY";
string engineId = "YOUR_SEARCH_ENGINE_ID";
IGoogleDorking dorkClient = GPAL.GoogleDorkingFor(apiKey, engineId);
IGPALGrid<string> results;
// Simple search
dorkClient
.SearchFor("dead mike")
.GetResults(out results);
PrintResults(results);
// Full query with site, file type, and date restrictions
dorkClient
.WithSite("example.com")
.WithFileType(FileType.Pdf)
.WithInTitle("report")
.WithExcludeTerm("draft")
.WithResultsPerPageUpTo10(10)
.WithDateRestriction(DateRestriction.PastYear)
.WithSortBy(SortOption.Date)
.SearchForExactPhrase("financial report")
.GetResults(out results);
PrintResults(results);
void PrintResults(IGPALGrid<string> grid)
{
if (0 < grid.Count())
{
foreach (var row in grid)
Console.WriteLine($"Result: Title={row[0]}, Link={row[1]}, Snippet={row[2]}");
}
else
{
Console.WriteLine("No results returned.");
}
}
GPAL.GoogleDorkingFor takes a Google API key and a Programmable Search Engine ID and hands you back an IGoogleDorking client. Once created, the client is reusable across as many searches as you need - each call to SearchFor and GetResults runs independently against the same configuration.
string apiKey = "YOUR_API_KEY";
string engineId = "YOUR_SEARCH_ENGINE_ID";
IGoogleDorking dorkClient = GPAL.GoogleDorkingFor(apiKey, engineId);
The API key comes from the Google Cloud Console under Credentials, and the search engine ID (cx=) comes from the Programmable Search Engine control panel. Both are required before any search will return results.
The minimum workflow is SearchFor followed by GetResults. GetResults fills an IGPALGrid<string> where each row has three columns: title, link, and snippet - the same shape you'd get back from any GPAL grid-producing call.
IGPALGrid<string> results;
dorkClient
.SearchFor("dead mike")
.GetResults(out results);
Every Google dorking operator has a corresponding With* method: WithSite restricts to a domain, WithFileType filters by file extension, WithInTitle and WithInUrl search specific parts of a page, WithExcludeTerm removes unwanted terms, and SearchForExactPhrase wraps the term in quotes. Chain as many as you need before calling GetResults.
dorkClient
.WithSite("example.com")
.WithFileType(FileType.Pdf)
.WithInTitle("report")
.WithExcludeTerm("draft")
.WithResultsPerPageUpTo10(10)
.WithDateRestriction(DateRestriction.PastYear)
.WithSortBy(SortOption.Date)
.SearchForExactPhrase("financial report")
.GetResults(out results);
WithResultsPerPageUpTo10 only accepts 1-10. Passing an out-of-range value (or an empty search term) doesn't throw - GetResults simply returns an empty grid, so check Count() before assuming a search worked.
WithDateRestriction takes a DateRestriction enum value - PastDay, PastWeek, PastMonth, PastYear - or DateRestriction.Custom with a number of months for anything else. This narrows results to content indexed within that window.
dorkClient
.WithDateRestriction(DateRestriction.Custom, 6)
.SearchFor("test")
.GetResults(out results);
// or one of the presets
dorkClient
.WithDateRestriction(DateRestriction.PastWeek)
.SearchFor("test")
.GetResults(out results);
Showing off some plain text in these paragraphs eligendi laboriosam illo nostrum corporis at libero vel voluptas? Expedita, facere dolores voluptatem ad ab rem assumenda soluta!
Lorem ipsum dolor sit amet consectetur adipisicing elit. Obcaecati, iste distinctio veritatis eligendi laboriosam illo nostrum corporis at libero vel voluptas? Expedita, facere dolores voluptatem ad ab rem assumenda soluta!
Lorem ipsum dolor sit amet consectetur adipisicing elit. Obcaecati, iste distinctio veritatis eligendi laboriosam illo nostrum corporis at libero vel voluptas? Expedita, facere dolores voluptatem ad ab rem assumenda soluta!
Lorem ipsum dolor sit amet consectetur adipisicing elit. Quo veniam mollitia excepturi animi eum illum non libero sapiente provident assumenda, delectus voluptatum nobis sed dolorem adipisci laudantium incidunt. Error, ratione?
Lorem ipsum dolor sit amet consectetur adipisicing elit. Quo veniam mollitia excepturi animi eum illum non libero sapiente provident assumenda, delectus voluptatum nobis sed dolorem adipisci laudantium incidunt. Error, ratione?
Lorem ipsum dolor sit amet consectetur adipisicing elit. Quo veniam mollitia excepturi animi eum illum non libero sapiente provident assumenda, delectus voluptatum nobis sed dolorem adipisci laudantium incidunt. Error, ratione?
Lorem ipsum dolor sit amet consectetur adipisicing elit. Quo veniam mollitia excepturi animi eum illum non libero sapiente provident assumenda, delectus voluptatum nobis sed dolorem adipisci laudantium incidunt. Error, ratione?
Here you can find different accents and emphasis sit amet consectetur adipisicing elit. Obcaecati, iste distinctio veritatis eligendi laboriosam illo nostrum corporis at libero vel voluptas? Expedita, facere dolores voluptatem ad ab rem assumenda soluta!
This is a link and how it could look like bestlinkinthebeautifulworld. Obcaecati, iste distinctio veritatis eligendi laboriosam illo nostrum corporis at libero vel voluptas? Expedita, facere dolores voluptatem ad ab rem assumenda soluta!
Here's just some classic bold text adipisicing elit. Obcaecati, iste distinctio veritatis eligendi laboriosam notBoldSecondbestlinkinthebeautifulworld illo nostrum corporis at libero vel voluptas? Expedita, facere dolores voluptatem ad ab rem assumenda soluta!
Obcaecati, iste distinctio veritatis eligendi laboriosam adipisicing elit illo nostrum corporis at adipisicing elit libero vel voluptas? Expedita, adipisicing facere dolores voluptatem ad ab rem assumenda soluta!
Other cuple of colors in case we want to emphasize several ways adipisicing elit. Obcaecati, iste distinctio veritatis eligendi laboriosam adipisicing elit illo nostrum corporis at voluptatem libero vel voluptas? Expedita, facere dolores voluptatem ad ab rem assumenda soluta!
Lorem ipsum dolor sit amet consectetur adipisicing elit. Obcaecati, iste distinctio veritatis eligendi laboriosam illo nostrum corporis at libero vel voluptas? Expedita, facere dolores voluptatem ad ab rem assumenda soluta! Lorem ipsum dolor, sit amet consectetur adipisicing elit. Quod veniam, quam ad expedita laborum sed at voluptates culpa ipsam ut vel. Ullam temporibus a mollitia quod aliquam ratione exercitationem nesciunt.
Lorem ipsum dolor sit amet consectetur adipisicing elit. Obcaecati, iste distinctio veritatis eligendi laboriosam illo nostrum corporis at libero vel voluptas? Expedita, facere dolores voluptatem ad ab rem assumenda soluta! Lorem ipsum dolor, sit amet consectetur adipisicing elit. Quod veniam, quam ad expedita laborum sed at voluptates culpa ipsam ut vel. Ullam temporibus a mollitia quod aliquam ratione exercitationem nesciunt.
Lorem ipsum dolor sit amet consectetur adipisicing elit. Obcaecati, iste distinctio veritatis eligendi laboriosam illo nostrum corporis at libero vel voluptas? Expedita, facere dolores voluptatem ad ab rem assumenda soluta!
Lorem ipsum dolor sit amet consectetur adipisicing elit. Repudiandae quas consequuntur illo numquam assumenda autem exercitationem distinctio perspiciatis in natus. Eius dicta similique ipsam ipsa minima, nemo quae enim tempore.
GPAL
.CallIfNotFound(GenericCallIfNotFound)
.WithPublishToConsole();
//System.Drawing.Rectangle windowSize = new System.Drawing.Rectangle(10, 10, 1500, 1024);
// NOTE: we have to set browser = before we execute any steps
// this is due to the 'GenericCallIfNotFound' which might throw an exception, and BankScraper will not have the browser set when it calls scraper.Close()
// until the complete fluent line gets executed (meaning every step, meaning browser is not set until everything else succeeds)
browser = GPAL.Browser
.WithBrowserType(Enums.BrowserType.Chrome)
.WithProfileDataDirectory(ChromeProfileLocation)
.WithUseAutomationEngine(AutomationEngine.Selenium)
.WithWindowSize(new System.Drawing.Rectangle(0,0,1920,1080))
.ToGPALObject();