OA9 OppAlerts from Ben Wills
How AI Search Works: From Prompt to Response A guide for SEOs, AI search marketers, and marketing teams
Work with me
Work in progress Work in progress. Released about a week early, on purpose.

ChatGPT disclosed things in this session that I did not expect it to disclose, and there is no guarantee it stays available. I would rather people had time to use it than had a tidier version of it later.

So: every word of every ChatGPT response here is verbatim, and that part is checked automatically on every build. What is not finished is the presentation. The color coding on the code blocks is incomplete and some of it is imprecise, and there are notes to myself still sitting in the page.

Parts 1 and 2 are close to empty and are getting a lot of detail over the next week or so, along with a cleanup pass on everything else. Worth checking back.

Read the announcement →

Recommendation walkthrough

How ChatGPT Recommends a Local HVAC Company

The hardest case in the set, because there is no dedicated local result card to lean on.

Context

A local service business. The one most small companies will recognize.

Local is the hardest case in this whole set, because there is no dedicated local result card in the tool interface being used here. Everything has to be established from ordinary web pages, and locality has to be checked separately. A city in the query does not guarantee a result from that city.

Our prompt could be something like

Now pick a fourth industry. You choose the industry and the use case.

So far we have done hotels, which is travel and a short prompt. Then blenders, a B2C product anyone could imagine buying. Then B2B SaaS, a CRM, which is a specific business market.

Come up with something relatable, not so niche that nobody will understand it. It can be B2B or B2C. You decide what it is and what the prompt is.

Then walk me through all the same detail. And again, mark what is concrete, what is verified, and what is a representation. You have been doing that. I want to stress how important it is.

ChatGPT's response

Fourth example: Residential HVAC replacement

I chose replacing a central heat pump in Phoenix because it combines:

  • A physical product
  • A local service provider
  • Contractor licensing and permits
  • Site-specific engineering
  • Utility rebates
  • Financing
  • Long-term warranty and service
  • Subjective reputation evidence
  • High switching and failure costs

It is materially different from the previous examples because the “best” equipment cannot be selected independently of the contractor and the house.

Representation key

Throughout this example:

  • Actual request: JSON arguments sent to the web tool in this conversation.
  • Close transcription: Tool-visible response text, shortened and with reference IDs replaced.
  • Normalized JSON: A structure I created from the returned information. It was not returned by the tool.
  • Conceptual step: Model interpretation or synthesis. No separate exposed tool performs it.
  • Verified fact: Supported by a source I opened or retrieved.
  • Unresolved fact: Something that would still require a quote, inspection, authenticated portal, or direct confirmation.

Example user prompt

unclassified, needs review
I own a 2,000-square-foot, single-story home in Phoenix and receive electricity
from SRP. The house was built in the 1990s.

My current system is a 15-year-old, four-ton, single-stage heat pump. It still
runs, but the west-side bedrooms stay warmer than the rest of the house, it
runs almost continuously on very hot afternoons, and my summer electric bills
have increased.

I want to replace it before March 2027. My maximum budget is $15,000 after
rebates, including permits and ordinary installation work.

My priorities are:

- Reliable cooling during Phoenix summers
- More even temperatures throughout the house
- Lower operating noise
- Reasonable electricity use
- Equipment that can be serviced locally
- At least a 10-year parts warranty
- A meaningful contractor labor warranty
- No high-pressure financing or unnecessary add-ons

I want a contractor who will perform a Manual J load calculation, inspect the
ductwork and airflow, pull the required permits, provide exact indoor and
outdoor model numbers, and give me an itemized written proposal.

Recommend which contractors I should request bids from, what class of equipment
I should consider, and how I should compare the proposals.

End-to-end flow

conceptual, drawn by ChatGPT
USER HVAC REQUEST
	│
	▼
MODEL INTERPRETATION
	│
	├── Home characteristics
	├── Existing equipment
	├── Comfort complaints
	├── Utility territory
	├── Budget
	├── Completion deadline
	├── Equipment preferences
	├── Contractor requirements
	└── Unknown site conditions
	│
	▼
DECISION DECOMPOSITION
	│
	├── Repair versus replace
	├── Correct system capacity
	├── Compressor/equipment class
	├── Contractor shortlist
	├── Licensing and insurance
	├── Duct and airflow condition
	├── Current rebates
	├── Tax-credit eligibility
	├── Warranty structure
	└── Total installed cost
	│
	▼
INITIAL WEB FAN-OUT
	│
	├── Local contractor discovery
	├── Arizona licensing source
	├── SRP rebates
	└── Technical installation standards
	│
	▼
CANDIDATE NORMALIZATION
	│
	├── Legal business identity
	├── Trade name
	├── Service territory
	├── License number
	├── Certifications
	├── Equipment brands
	└── Review-source identity
	│
	▼
OFFICIAL VERIFICATION
	│
	├── SRP eligibility
	├── Manual J requirements
	├── Equipment efficiency
	├── AHRI matching
	├── Contractor licensing
	├── Permits
	└── Incentive deadlines
	│
	▼
CONTRACTOR RESEARCH
	│
	├── Installation process
	├── Certifications
	├── Warranty claims
	├── Review patterns
	├── Complaint patterns
	└── Sales-pressure risk
	│
	▼
ADAPTIVE SEARCH
	│
	├── Resolve license identities
	├── Check contradictory incentives
	├── Verify warranties
	├── Find complaint evidence
	└── Identify missing quote requirements
	│
	▼
QUOTE COLLECTION
	│
	├── Onsite inspection
	├── Manual J/S
	├── Duct/static-pressure testing
	├── Exact model numbers
	├── AHRI certificate
	├── Scope of work
	├── Warranties
	├── Rebates
	└── Financing
	│
	▼
QUOTE NORMALIZATION
	│
	├── Equalize equipment capacity
	├── Equalize efficiency metrics
	├── Separate equipment and installation
	├── Remove optional add-ons
	├── Normalize rebates
	├── Normalize warranties
	└── Calculate total ownership cost
	│
	▼
CONTRACTOR AND SYSTEM RANKING
	│
	├── Installation quality
	├── Engineering quality
	├── Equipment fit
	├── Warranty
	├── Reputation
	├── Price
	└── Evidence confidence
	│
	▼
RECOMMENDATION
	├── Contractor shortlist
	├── Preferred equipment class
	├── Quote-comparison framework
	├── Disqualifying red flags
	└── Remaining uncertainties

Step 1: Interpret the request

No exposed tool receives the prompt and returns a structured HVAC specification.

I interpret it directly.

Conceptually:

conceptual
Task:
	Select a contractor and replacement heat-pump system

Location:
	Phoenix, Arizona

Utility:
	SRP

Home:
	2,000 square feet
	Single story
	Built in the 1990s

Existing equipment:
	15-year-old heat pump
	Nominally four tons
	Single-stage compressor

Symptoms:
	Uneven room temperatures
	Long runtimes
	Higher electricity bills

Budget:
	$15,000 after rebates
	Includes ordinary installation and permits

Deadline:
	March 2027

Hard contractor requirements:
	Arizona license
	Insurance
	Manual J
	Duct and airflow evaluation
	Permits
	Exact model numbers
	Itemized proposal

Equipment preferences:
	High reliability
	Lower noise
	Locally serviceable
	At least 10-year parts coverage

Unknowns:
	Actual cooling load
	Duct leakage
	Static pressure
	Insulation condition
	Electrical capacity
	Existing line-set suitability
	Current equipment model numbers
	Exact roof/attic installation configuration

This representation is mine. No internal parser returned it.


Step 2: Identify the real decision structure

The request appears to ask:

Which heat pump should I buy?

The actual decision is:

unclassified, needs review
House assessment
	+
System design
	+
Equipment pairing
	+
Installation quality
	+
Contractor accountability
	+
Price and incentive structure

A premium heat pump installed poorly can perform worse than a moderately priced system installed correctly. ENERGY STAR states that improper installation can reduce HVAC efficiency by as much as 30%, and recommends onsite inspection, duct evaluation, licensing, insurance, and recognized installation certifications. (ENERGY STAR)

Therefore, the research does not begin with brand rankings. It begins with:

  1. What installation process is required?
  2. Which contractors appear capable of following it?
  3. Which equipment class fits the house and priorities?
  4. Which exact paired systems qualify for rebates?

Step 3: Determine that current research is required

Model knowledge alone is insufficient because these facts change:

unclassified, needs review
Contractor operating status
License status
Utility rebate amounts
Rebate deadlines
Tax-credit law
Equipment efficiency requirements
Available refrigerants
Current warranties
Current reviews and complaints
Current installation prices
Participating-contractor lists

The local and regulated nature of the request requires web research.


Step 4: Generate the initial fan-out

I created the search strings directly when calling the web tool.

Actual request

sent exactly as shown
{
	"system1_search_query": [
		{
			"q": "best HVAC contractors Phoenix Arizona heat pump replacement 2026 reviews licensed"
		},
		{
			"q": "site:roc.az.gov HVAC contractor license lookup Phoenix Arizona"
		},
		{
			"q": "Phoenix Arizona heat pump rebates 2026 APS SRP official"
		},
		{
			"q": "ENERGY STAR heat pump sizing contractor selection official"
		}
	],
	"response_length": "long"
}

Query purposes

unclassified, needs review
Query 1:
	Discover local contractor candidates

Query 2:
	Locate the authoritative Arizona licensing system

Query 3:
	Identify current utility incentives

Query 4:
	Establish authoritative installation and sizing criteria

The complete user prompt was not visibly passed as a separate field.


Step 5: Receive and triage initial results

The search returned a pooled textual result set rather than a JSON array mapped to each query.

The results included:

  • Phoenix contractor comparison pages
  • ENERGY STAR heat-pump guidance
  • Arizona utility pages
  • News articles
  • Academic papers
  • Irrelevant results involving commercial buildings or unrelated uses of “Phoenix”

A local contractor-discovery result said that it evaluated hundreds of Phoenix-area providers and selected 18 heat-pump contractors using more than 25 variables. That is useful for candidate discovery, but not sufficient to establish which contractor is best for this homeowner. (Expertise)

The authoritative technical source said that proper sizing requires a Manual J calculation and that larger equipment is not automatically better. (ENERGY STAR)

Initial triage

ResultDecisionReason
ENERGY STAR sizing guidanceRetain/openAuthoritative installation criteria
SRP rebate pageRetain/openCurrent utility-specific rules
Arizona ROCRetain/openAuthoritative licensing source
Local contractor directoryCandidate discoveryCommercial selection methodology
Contractor official pagesRetain/openServices, process and certifications
Generic “best HVAC” listiclesLimited usePotential commercial bias
News articlesContext onlyNot contractor-specific verification
Unrelated academic resultsRejectLexical matches, wrong use case

Step 6: Verify SRP’s current program

Search request

sent exactly as shown
{
	"system2_search_query": [
		{
			"q": "APS Arizona heat pump rebate residential HVAC"
		},
		{
			"q": "SRP Arizona heat pump rebate residential HVAC"
		},
		{
			"q": "Arizona utility heat pump rebate Phoenix 2026"
		},
		{
			"q": "Phoenix heat pump rebate utility official"
		}
	],
	"response_length": "long"
}

The authoritative SRP result was then opened.

Actual open request

sent exactly as shown
{
	"open": [
		{
			"ref_id": "<SRP_REBATE_RESULT>"
		}
	],
	"response_length": "long"
}

Close transcription of response

returned exactly as shown
Air conditioner (AC) rebates | SRP
(<URL>)

<REF_ID> [wordlim: 200]
Content type: text/html;
Source: open({
	"ref_id": "<SRP_REBATE_RESULT>",
	"lineno": null
});
Total lines: 214

L25: # SRP air conditioning rebate
L27: ... get up to $1,125 back...
...
L42: Central AC, heat pump and mini split packages and systems
L46: Single-stage ... $75 per ton
L47: Multi-stage ... $150 per ton
L48: Variable-capacity ... $225 per ton
...

The response was line-addressable extracted text, not raw HTML or JSON.

Verified SRP structure

SRP currently lists rebates based on compressor type for qualifying systems with at least 15.2 SEER2:

Compressor typeRebate
Single-stage$75 per ton
Multi-stage$150 per ton
Variable-capacity$225 per ton
Inverter mini-split$225 per ton

Qualifying equipment must appear in the AHRI directory. The system must be installed by an Arizona-licensed residential air-conditioning contractor before April 30, 2027. Both indoor and outdoor components must be replaced for a split system. (SRP)

For a nominal four-ton variable-capacity system, the maximum arithmetic result would be:

unclassified, needs review
4 tons × $225 per ton = $900

That calculation is illustrative because the existing four-ton size must not be assumed to be correct.


Step 7: Examine Manual J requirements carefully

Actual find request

sent exactly as shown
{
	"find": [
		{
			"ref_id": "<OPENED_SRP_PAGE>",
			"pattern": "Manual J"
		},
		{
			"ref_id": "<OPENED_SRP_PAGE>",
			"pattern": "$225"
		}
	],
	"response_length": "long"
}

Close transcription

returned exactly as shown
L86:
	Upload ... a copy of the Manual J, if applicable...

L94:
	Have the system installed by a contractor licensed in Arizona...

L96:
	Submit Manual J load calculations on single-stage systems.
	Load calculations are not required for multi-stage or
	variable-capacity systems.

SRP does not require the Manual J submission for multi-stage or variable-capacity rebate applications. That does not mean a load calculation is unnecessary for system design. ENERGY STAR separately recommends Manual J for proper sizing. (SRP)

This is an important interpretation step:

unclassified, needs review
Program paperwork requirement:
	Manual J mandatory for SRP single-stage rebate submission

Engineering recommendation:
	Manual J should still be performed for every replacement

A rebate program’s documentation threshold is not the same as installation best practice.


Step 8: Discover contractor candidates

Actual request

sent exactly as shown
{
	"system1_search_query": [
		{
			"q": "Phoenix heat pump installation contractor Manual J NATE licensed AZ Perfect Comfort Day and Night Air Desert Diamond Mechanical"
		},
		{
			"q": "site:azperfectcomfort.com heat pump installation Phoenix Manual J warranty"
		},
		{
			"q": "site:dayandnightair.com heat pump installation Phoenix warranty financing"
		},
		{
			"q": "site:desertdiamondhvac.com heat pump installation Phoenix warranty"
		}
	],
	"response_length": "long"
}

This returned official pages for three plausible bid candidates:

sent exactly as shown
AZ Perfect Comfort
Desert Diamond Air
Day & Night Air

These were selected because they represented different contractor profiles:

CandidateApparent profile
AZ Perfect ComfortSmaller/local contractor emphasizing Manual J and ACCA/NATE
Desert DiamondLarger local specialist with BPI/NATE and Trane affiliation
Day & NightLarge multi-trade regional operation with extensive review volume

This is candidate construction by the model. The search tool did not return a ranked “top three.”


Step 9: Open contractor pages

Actual open request

sent exactly as shown
{
	"open": [
		{
			"ref_id": "<AZ_PERFECT_INSTALLATION_RESULT>"
		},
		{
			"ref_id": "<DESERT_DIAMOND_RESULT>"
		}
	],
	"response_length": "long"
}

AZ Perfect Comfort response

returned exactly as shown
AC Installation & Replacement – AZ Perfect Comfort AC Experts
(<URL>)

<REF_ID> [wordlim: 200]
Content type: text/html;
Source: open({
	"ref_id": "<AZ_PERFECT_RESULT>",
	"lineno": null
});
Total lines: 355

The opened page exposed:

  • Manual J claims
  • ACCA and NATE certification claims
  • Ductwork review
  • System startup and calibration
  • Warranty marketing
  • Review snippets
  • Promotions
  • Contact and service information

Desert Diamond response

returned exactly as shown
Heat Pump Installation In Phoenix, AZ | Desert Diamond Air
(<URL>)

<REF_ID> [wordlim: 200]
Content type: text/html;
Source: open({
	"ref_id": "<DESERT_DIAMOND_RESULT>",
	"lineno": null
});
Total lines: 193

The page exposed:

  • BPI certification
  • NATE certification
  • Trane Comfort Specialist status
  • Ducted heat-pump installation
  • Electrical-panel considerations
  • Duct-sealing and insulation services
  • Installation-process descriptions

These are contractor claims. They are not independent verification of actual field performance.


Step 10: Find specific contractor claims

Actual request

sent exactly as shown
{
	"find": [
		{
			"ref_id": "<OPENED_AZ_PERFECT_PAGE>",
			"pattern": "Manual J"
		},
		{
			"ref_id": "<OPENED_AZ_PERFECT_PAGE>",
			"pattern": "Lifetime Repair Guarantee"
		},
		{
			"ref_id": "<OPENED_DESERT_DIAMOND_PAGE>",
			"pattern": "NATE"
		}
	],
	"response_length": "long"
}

Verified AZ Perfect claims

The extracted page states that the company performs a Manual J calculation using characteristics such as home size, insulation and ductwork. It also claims ACCA/NATE-certified technicians and a lifetime repair guarantee. (AZ Perfect Comfort)

However, “lifetime repair guarantee” is ambiguous.

It could mean:

unclassified, needs review
A. Labor warranty on an installed replacement system
B. Guarantee covering repairs performed by the company
C. Parts-and-labor coverage conditioned on membership
D. Limited guarantee with maintenance requirements

The page headline does not resolve the exact contractual scope.

Therefore:

unclassified, needs review
Observed:
	Contractor markets a Lifetime Repair Guarantee

Unresolved:
	Whether it applies to replacement installation labor
	Duration and transferability
	Exclusions
	Maintenance requirements
	Remedy if the company ceases operating

The written warranty document must be requested.

Verified Desert Diamond claims

Desert Diamond states that its installers hold BPI and NATE certifications and that it is a Trane Comfort Specialist. It also says it installs ducted air-source heat pumps and offers multiple brands. (Desert Diamond Air)

Again, these are first-party claims.


Step 11: Verify licensing

The Arizona Registrar of Contractors is the authoritative source. It explicitly advises consumers to check contractor licenses and regulates more than 60,000 Arizona contractors. (Arizona Department of Real Estate)

Actual open attempt

sent exactly as shown
{
	"open": [
		{
			"ref_id": "<ARIZONA_ROC_RESULT>"
		}
	],
	"response_length": "long"
}

Actual model-visible result

returned exactly as shown
Internal Error

<REF_ID>
Source: open({
	"ref_id": "<ARIZONA_ROC_RESULT>",
	"lineno": null
});
Total lines: 1

L0: Failed to fetch https://roc.az.gov/: (403) Forbidden

The official portal could not be inspected through this retrieval route.

This creates a strict distinction:

returned exactly as shown
Authoritative license-checking system identified:
	Yes

Contractor license status verified through that system:
	No

Reason:
	Official page blocked automated opening

Day & Night’s official site displays Arizona license numbers ROC335883 and ROC335884, but the active status, classification and complaint history should still be checked in the ROC portal directly. (Day & Night HVAC)

A contractor’s own display of a license number is not equivalent to independent verification.


Step 12: Search independent reputation evidence

Actual request

sent exactly as shown
{
	"system1_search_query": [
		{
			"q": "AZ Perfect Comfort Arizona ROC license number"
		},
		{
			"q": "Desert Diamond Mechanical Arizona ROC license number"
		},
		{
			"q": "Day and Night Air Arizona ROC license number"
		},
		{
			"q": "Phoenix HVAC contractor complaints AZ Perfect Comfort Desert Diamond Day and Night Air reviews"
		}
	],
	"response_length": "long"
}

The result set contained:

  • BBB profiles
  • BBB review pages
  • Angi and HomeAdvisor
  • Birdeye aggregations of Google reviews
  • Contractor-owned review pages
  • Company contact pages
  • Irrelevant academic results involving “diamond” or “Phoenix”

Reputation signals found

AZ Perfect Comfort had:

  • BBB A+ accreditation and 4.81/5 from 21 customer reviews
  • Angi 4.9/5 from 22 reviews
  • Contractor-site aggregate claims of approximately 4.9 from hundreds of reviews (Better Business Bureau)

Day & Night had an aggregation showing approximately 4.9 from more than 14,000 Google reviews. (Birdeye Profile)

Desert Diamond had an aggregation showing approximately 4.9 from more than 2,500 Google reviews, while its BBB page also exposed at least one strongly negative review alleging scare tactics and inflated pricing. (Birdeye Profile)

What these figures do not establish

They do not directly establish:

not exposed or proposed
Percentage of installations without callbacks
Average final installed cost
Manual J completion rate
Permit compliance rate
Warranty-claim success rate
Technician quality for a specific crew
Whether reviews are installation-specific
Whether reviews include plumbing and maintenance work

Day & Night’s large review count spans HVAC, plumbing and other services. It cannot be interpreted as 14,000 heat-pump-installation reviews.


Step 13: Detect review-quality problems

One review-aggregation page for AZ Perfect Comfort contained several recent reviews with highly generic wording and similar sentence structure. That does not prove manipulation, but it reduces the value of those individual reviews as evidence. (Birdeye Profile)

The model should therefore distinguish:

proposed
Review volume:
	Useful for establishing that the company operates at scale

Detailed installation review:
	Useful for identifying process and failure modes

Generic short praise:
	Low information value

Complaint with dates, invoice details and company response:
	Higher diagnostic value

Aggregate star rating:
	Weak predictor of engineering quality

The most valuable reviews for this task would specifically mention:

  • Full-system replacement
  • Manual J or sizing
  • Duct correction
  • Permit inspection
  • Equipment model
  • Post-installation comfort
  • Electric-bill change
  • Warranty callback
  • One or more summers of ownership

Step 14: Establish the equipment classes

The user’s current system is single-stage.

The primary classes to compare are:

unclassified, needs review
Single-stage:
	Always runs at full compressor output

Two-stage or multi-stage:
	Can operate at lower and higher capacity

Variable-capacity/inverter:
	Modulates output across a wider range

SRP explains that single-stage equipment turns fully on and off, multi-stage equipment can operate at more than one capacity, and variable-capacity equipment continuously adjusts output. SRP associates variable-capacity equipment with improved comfort and efficiency, while also providing the highest rebate tier. (SRP)

For the example homeowner:

unclassified, needs review
Uneven temperatures
Long runtimes
Noise preference
Phoenix cooling load
Budget ceiling

make a two-stage or variable-capacity system plausible.

But the research cannot select the exact capacity before:

unclassified, needs review
Manual J load calculation
Duct static-pressure test
Room-by-room airflow review
Attic and insulation inspection
Return-air evaluation

The existing four-ton size is historical evidence, not a design specification.


Step 15: Distinguish equipment efficiency from installation quality

A quote might offer:

unclassified, needs review
Contractor A:
	20 SEER2 variable-capacity system
	No documented load calculation
	No duct measurements

Contractor B:
	17 SEER2 two-stage system
	Manual J
	Static-pressure testing
	Duct corrections
	Commissioning report

Contractor B may produce the better real-world result.

ENERGY STAR states that poor duct sealing can cause substantial efficiency loss and that improper installation can reduce efficiency by as much as 30%. (ENERGY STAR)

Therefore, the scoring model should not rank quotes primarily by SEER2.


Step 16: Research rebates and tax incentives

This step produced a particularly important contradiction.

Older or stale claims

An ENERGY STAR page stated that qualifying air-source heat pumps could receive a federal credit of up to $2,000 for equipment installed through 2032. (ENERGY STAR)

Desert Diamond’s page similarly stated that a federal 30% heat-pump credit continued through 2032. (Desert Diamond Air)

Current IRS authority

Current IRS instructions state that energy-efficient home-improvement credits cannot be claimed for property placed in service after December 31, 2025. (IRS)

Because this hypothetical installation occurs in 2026 or 2027:

conceptual
Federal 25C heat-pump credit:
	Do not include in the financial model

Reason:
	Current IRS instructions state that it ended after 2025

This illustrates the source-resolution hierarchy:

unclassified, needs review
Current IRS tax instructions
	>
Older agency marketing page
	>
Contractor marketing content

A contractor quote promising a 2026 federal credit would be a red flag unless supported by newly enacted law and current IRS guidance.

Other possible incentives

SRP’s Cool Cash rebate is current and applicable through April 30, 2027 if its conditions are met. (SRP)

Arizona also operates income-qualified efficiency programs, but eligibility and current program status would need to be evaluated using household income and current program rules. (Resilient Arizona)


Step 17: Generate adaptive fan-out queries

The first round revealed several unresolved issues:

unclassified, needs review
Which contractor licenses are active?
Which contractor performs documented Manual J?
What exactly do the labor warranties cover?
Does the quote qualify for SRP?
Are contractors using current tax information?
What equipment pairs are AHRI certified?
What complaints involve replacement installations?

Conceptual next queries:

unclassified, needs review
"[contractor legal name]" Arizona ROC license
"[contractor name]" labor warranty HVAC installation PDF
"[contractor name]" Manual J Phoenix
"[contractor name]" permit complaint Phoenix
"[contractor name]" heat pump installation review
"[equipment outdoor model]" "[indoor model]" AHRI
"[model number]" SRP rebate
"[contractor name]" financing APR terms

No separate adaptive-query tool creates these. The model generates them based on unresolved evidence.


Step 18: Collect onsite bids

At this point, web research cannot determine the winner.

The three contractors should be asked to inspect the same house and respond to the same written specification.

Bid request

unclassified, needs review
Please provide:

1. Arizona ROC license number and classification
2. Certificate of liability and workers’ compensation insurance
3. Manual J load calculation
4. Manual S equipment selection
5. Existing duct static-pressure measurements
6. Room-by-room airflow assessment
7. Duct leakage or condition findings
8. Exact outdoor-unit model number
9. Exact air-handler or coil model number
10. AHRI certificate/reference number
11. Rated capacity at Phoenix design conditions
12. SEER2, EER2 and HSPF2
13. Compressor type
14. Sound rating
15. Refrigerant type
16. Thermostat model
17. Required electrical work
18. Line-set replacement or reuse
19. Condensate-drain work
20. Permit and inspection responsibility
21. Equipment-removal and disposal
22. Manufacturer parts warranty
23. Compressor warranty
24. Contractor labor warranty
25. Warranty exclusions and maintenance requirements
26. Total cash price
27. Financing APR, term and total payments
28. SRP rebate amount and filing responsibility
29. Installation date
30. Post-installation commissioning procedure

This is not a tool result. It is the normalized request I would recommend creating from the research.


Step 19: Normalize the quotes

Contractor proposals are often deliberately or unintentionally difficult to compare.

Example raw quotes

unclassified, needs review
Quote A:
	“Premium 4-ton variable-speed system”
	$14,700
	10-year warranty
	$900 rebate

Quote B:
	“18 SEER two-stage comfort package”
	$12,900
	Includes duct improvements
	Lifetime warranty

Quote C:
	“High efficiency heat pump”
	$10,800
	Financing only
	No model numbers

These are not comparable until normalized.

Conceptual normalized quote record

unclassified, needs review
{
	"contractor": {
		"legal_name": "Example HVAC LLC",
		"trade_name": "Example Air",
		"roc_license_number": "ROC000000",
		"license_status_verified": false,
		"insurance_verified": false
	},
	"design": {
		"manual_j_completed": true,
		"calculated_load_btu": 42100,
		"selected_nominal_tons": 4,
		"manual_s_completed": true,
		"static_pressure_measured": true,
		"duct_repairs_included": true
	},
	"equipment": {
		"outdoor_model": "EXAMPLE-48HP",
		"indoor_model": "EXAMPLE-AH48",
		"ahri_reference": "000000000",
		"compressor_type": "variable-capacity",
		"seer2": 19.0,
		"eer2": 12.0,
		"hspf2": 8.5,
		"refrigerant": "R-454B",
		"sound_db": 57
	},
	"scope": {
		"permit_included": true,
		"electrical_work_included": true,
		"line_set": "replace",
		"thermostat": "included",
		"crane": "included",
		"haul_away": "included",
		"commissioning_report": true
	},
	"warranty": {
		"parts_years": 10,
		"compressor_years": 12,
		"labor_years": 2,
		"maintenance_required": true,
		"transferable": false
	},
	"pricing": {
		"gross_price": 14700,
		"srp_rebate": 900,
		"other_rebates": 0,
		"net_cash_price": 13800,
		"financing_apr": null
	}
}

This JSON would be created by the research/comparison process. It is not an internal search response.


Step 20: Identify bid disqualifiers

A quote should be rejected or heavily downgraded when it contains:

unclassified, needs review
No exact model numbers
No AHRI reference
Capacity copied from the existing unit without calculation
No onsite inspection
No duct or airflow discussion
No permit
“Permit optional”
Federal tax credit claimed for a 2026 installation
Financing price without APR and total payments
Large discount requiring immediate signature
Warranty described only as “lifetime”
Rebate deducted without proving eligibility
Indoor and outdoor components that are not a certified match
Unclear refrigerant or electrical requirements

A low price does not compensate for an unverifiable equipment match or incomplete installation scope.


Step 21: Create contractor candidate records

No tool returns these objects. They are conceptual normalized records.

AZ Perfect Comfort

unclassified, needs review
{
	"contractor": "AZ Perfect Comfort",
	"verified_from_official_site": {
		"manual_j_claim": true,
		"acca_nate_claim": true,
		"duct_review_claim": true,
		"lifetime_repair_guarantee_claim": true
	},
	"independent_signals": {
		"bbb_rating": "A+",
		"bbb_customer_rating": 4.81,
		"bbb_review_count": 21,
		"angi_rating": 4.9,
		"angi_review_count": 22
	},
	"unresolved": [
		"Active ROC status",
		"Exact labor-warranty language",
		"SRP participating-contractor status",
		"Actual quote and equipment pairing"
	],
	"research_status": "strong bid candidate"
}

Desert Diamond

unclassified, needs review
{
	"contractor": "Desert Diamond Air",
	"verified_from_official_site": {
		"bpi_claim": true,
		"nate_claim": true,
		"trane_comfort_specialist_claim": true,
		"duct_and_insulation_services": true
	},
	"independent_signals": {
		"large_google_review_volume": true,
		"bbb_profile_found": true,
		"negative_complaint_or_review_signal": true
	},
	"unresolved": [
		"Active ROC status",
		"Manual J documentation",
		"Exact warranty terms",
		"Sales and pricing practices",
		"SRP contractor status"
	],
	"research_status": "reasonable bid candidate with pricing-process scrutiny"
}

Day & Night

ChatGPT JSON built from real values
{
	"contractor": "Day & Night Air",
	"verified_from_official_site": {
		"heat_pump_installation": true,
		"financing": true,
		"warranty_claim": true,
		"license_numbers_displayed": [
			"ROC335883",
			"ROC335884"
		]
	},
	"independent_signals": {
		"very_large_review_volume": true,
		"broad_multi_trade_operation": true
	},
	"unresolved": [
		"Active ROC classifications",
		"Manual J procedure",
		"Specific installation crew quality",
		"Exact labor warranty",
		"Pricing relative to smaller firms"
	],
	"research_status": "strong large-company comparison bid"
}

All three JSON blocks are my normalization.


Step 22: Apply hard constraints

Contractor requirements

RequirementAZ PerfectDesert DiamondDay & Night
Phoenix serviceVerifiedVerifiedVerified
Heat-pump installationVerifiedVerifiedVerified
Manual J claimVerifiedNot yet verifiedNot yet verified
NATE/industry certification claimVerifiedVerifiedRequires confirmation
ROC license statusUnresolvedUnresolvedNumbers found; status unresolved
Written labor warrantyUnresolvedUnresolvedUnresolved
SRP eligibilityUnresolvedUnresolvedUnresolved

No contractor can yet be definitively selected.

Equipment constraints

unclassified, needs review
Under $15,000 net:
	Requires actual quotes

Ten-year parts warranty:
	Requires exact manufacturer registration and terms

Quiet:
	Requires exact outdoor model sound rating

Even cooling:
	Requires load, duct and airflow work

Reliable in extreme heat:
	Requires equipment selection at design conditions
	and installation/commissioning quality

Step 23: Define ranking weights

There is no exposed universal HVAC recommendation formula.

For this prompt:

CriterionWeight
Engineering and sizing process25%
Installation scope and commissioning20%
Contractor licensing, insurance and accountability15%
Equipment suitability and serviceability15%
Warranty quality10%
Reputation and complaint handling5%
Net installed price10%

Price receives only 10% because HVAC failure in Phoenix carries substantial comfort and safety consequences, and installation defects can create years of poor performance.

Example score structure

unclassified, needs review
{
	"contractor": "Example HVAC",
	"scores": {
		"engineering": 9.0,
		"installation_scope": 8.5,
		"licensing_accountability": 10.0,
		"equipment_fit": 8.0,
		"warranty": 7.0,
		"reputation": 7.5,
		"price": 6.5
	},
	"evidence_confidence": {
		"engineering": "high",
		"installation_scope": "high",
		"licensing_accountability": "high",
		"equipment_fit": "moderate",
		"warranty": "high",
		"reputation": "moderate",
		"price": "high"
	}
}

This is a proposed comparison structure, not a tool response.


Step 24: Provisional recommendation

Bid shortlist

Based on the research, I would request bids from:

  1. AZ Perfect Comfort
  2. Desert Diamond Air
  3. Day & Night Air

AZ Perfect Comfort would enter the bid process with the strongest documented alignment to the example’s engineering requirement because its site explicitly states that it performs Manual J calculations and considers insulation and ductwork. (AZ Perfect Comfort)

Desert Diamond would be included because of its stated BPI/NATE credentials, heat-pump specialization and building-performance services. (Desert Diamond Air)

Day & Night would provide a useful large-operator comparison and publicly displays Arizona license numbers, but the license classifications and active status still require direct ROC verification. (Day & Night HVAC)

Equipment class

The initial preference would be:

unclassified, needs review
First:
	Properly sized two-stage or variable-capacity heat pump

Not:
	Automatically replace the existing four-ton unit with another four-ton unit

Required:
	Manual J
	Manual S
	Duct/static-pressure evaluation
	AHRI-matched indoor and outdoor components

A variable-capacity system offers the strongest potential for even temperature control and lower perceived noise, but only if the quote remains under budget and the contractor can commission it correctly.

A well-installed two-stage system may be the better value when:

unclassified, needs review
Variable-capacity quote premium is excessive
Local parts availability is weaker
Proprietary controls increase repair risk
The duct system does not support the proposed airflow

Step 25: Final proof before signing

The selected proposal should be checked against this acceptance test:

unclassified, needs review
License:
	Verified directly through Arizona ROC

Insurance:
	Certificate received

Design:
	Manual J and Manual S attached

Ducts:
	Static pressure and deficiencies documented

Equipment:
	Exact model numbers supplied

Certification:
	AHRI reference verified

Rebate:
	SRP eligibility verified before installation

Permits:
	Included in contract

Warranty:
	Written parts and labor terms attached

Price:
	Cash price and financed total both stated

Financing:
	APR, term, payment and total finance charge stated

Installation:
	Startup and commissioning procedure documented

Payment:
	Reasonable schedule tied to project milestones

Tax claims:
	No obsolete 2026 federal credit included

Complete function-call-stack representation

conceptual, drawn by ChatGPT
recommend_hvac_replacement(user_prompt)
│
├── interpret_request()
│	├── identify_location("Phoenix")
│	├── identify_utility("SRP")
│	├── identify_home([
│	│	"2,000 sq ft",
│	│	"single story",
│	│	"1990s construction"
│	│])
│	├── identify_existing_system([
│	│	"15 years old",
│	│	"4 tons",
│	│	"single-stage heat pump"
│	│])
│	├── identify_symptoms([
│	│	"uneven rooms",
│	│	"long runtimes",
│	│	"higher bills"
│	│])
│	├── identify_budget(15000)
│	├── identify_deadline("March 2027")
│	├── identify_contractor_requirements([
│	│	"license",
│	│	"insurance",
│	│	"Manual J",
│	│	"duct inspection",
│	│	"permits",
│	│	"itemized quote"
│	│])
│	└── identify_unknown_site_conditions()
│
├── should_use_tools()
│	└── true
│
├── generate_initial_fanout()
│	└── performed by model
│
├── web_search({
│		queries: [
│			"Phoenix HVAC contractors...",
│			"Arizona ROC...",
│			"SRP rebates...",
│			"ENERGY STAR sizing..."
│		]
│	})
│
├── receive_pooled_result_cards()
│
├── triage_results()
│	├── retain official utility source
│	├── retain licensing source
│	├── retain installation standards
│	├── retain candidate pages
│	└── reject irrelevant matches
│
├── search_current_rebates()
│
├── open([
│		srp_rebate_page,
│		arizona_roc,
│		energy_star_guidance
│	])
│
├── receive_results()
│	├── successful line-addressable SRP page
│	├── successful ENERGY STAR page
│	└── Arizona ROC 403 failure
│
├── find([
│		"Manual J",
│		"$225",
│		"improper installation"
│	])
│
├── generate_contractor_fanout()
│
├── web_search({
│		queries: [
│			"AZ Perfect Comfort...",
│			"Desert Diamond...",
│			"Day & Night..."
│		]
│	})
│
├── open([
│		contractor_installation_pages
│	])
│
├── find([
│		"Manual J",
│		"Lifetime Repair Guarantee",
│		"NATE"
│	])
│
├── generate_reputation_fanout()
│
├── web_search({
│		queries: [
│			"license number",
│			"reviews",
│			"complaints"
│		]
│	})
│
├── normalize_contractor_entities()
│	├── legal/trade names
│	├── locations
│	├── license numbers
│	├── certifications
│	└── review sources
│
├── detect_evidence_conflicts()
│	├── ENERGY STAR says tax credit through 2032
│	├── contractor says credit through 2032
│	└── current IRS says credit ended after 2025
│
├── resolve_source_conflicts()
│	└── prioritize current IRS instructions
│
├── define_bid_specification()
│	├── Manual J/S
│	├── duct/static pressure
│	├── model numbers
│	├── AHRI reference
│	├── scope
│	├── warranties
│	└── pricing
│
├── collect_quotes()
│	└── requires user/offline contractor visits
│
├── normalize_quotes()
│	├── equipment capacity
│	├── efficiency
│	├── scope
│	├── rebates
│	├── warranties
│	└── total cost
│
├── apply_hard_constraints()
│	├── active license
│	├── permits
│	├── engineering
│	├── budget
│	└── warranty
│
├── score_remaining_bids()
│	├── engineering
│	├── installation
│	├── accountability
│	├── equipment fit
│	├── warranty
│	├── reputation
│	└── price
│
├── select_provisional_shortlist()
│	├── AZ Perfect Comfort
│	├── Desert Diamond
│	└── Day & Night
│
└── generate_recommendation()

Main differences from the prior examples

Hotel

unclassified, needs review
Availability by date
Location and travel time
Room-level variability
Guest experience
Cancellation terms

Blender

unclassified, needs review
SKU and variant identity
Merchant offers
Laboratory performance
Warranty
Replacement parts

B2B CRM

unclassified, needs review
Plan tier
Seats
Data model
API
Security
Migration
Long-term switching cost

HVAC replacement

unclassified, needs review
Licensed local contractor
Site-specific engineering
Physical equipment pairing
Building condition
Permits
Utility incentives
Installation workmanship
Financing
Warranty enforcement

The defining difference is:

The recommendation cannot be completed from publicly available product or contractor information alone.

Public research can produce the shortlist and the evaluation framework. The final decision requires new, house-specific evidence generated through onsite inspections and standardized bids.