[Feat] Issue to retrieve similar link URLs given a URL.

[Madhuvod]

Problem Description
I find it hard to retrieve similar company links that are competitors to a company, given a particular company URL. I have been using the search endpoint for this but it just gives me responses which includes LinkedIn urls, YouTube urls, blogposts etc, but I just need company website url.

Proposed Feature
search is using keyword search. maybe neural search would help

Alternatives Considered
I need help from you guys giving me alternative solutions to find similar company URL's using any endpoint of firecrawl.

my current code:

 import requests

url = "https://api.firecrawl.dev/v1/search"

headers = {
    "Authorization": "Bearer <token>",
    "Content-Type": "application/json"
}

company_name = "Rollout AI"
keywords = "AI website builder"

query = f"Find companies similar to {company_name} that compete in the same market space as {keywords}"

payload = {
    "query": query,
    "limit": 10,
    "lang": "en", 
    "timeout": 60000,
    "scrapeOptions": {}
}

response = requests.post(url, json=payload, headers=headers)

if response.status_code == 200:
    data = response.json()
    if data.get("success"):
        results = data.get("data", [])
        similar_company_urls = [result["url"] for result in results]
        print("Similar Company URLs:")
        for url in similar_company_urls:
            print(url)
    else:
        print("Search request was not successful.")
        print(data.get("warning", "No warning provided."))
else:
    print(f"Failed to retrieve data. Status code: {response.status_code}")

also, I dont want to input dynamic keywords in the query. is there a way I can just give the website url of the main company, so that I automatically get the competitors urls