{"id":"bylinebank_com","version":"1.0","url":"https://www.bylinebank.com","host":"bylinebank.com","name":"Byline Bank","category":"bank","generatedAt":"2026-10-14T07:31:59.790Z","durationMs":153424,"checks":[{"id":"robots_assistants","door":"discover","title":"Robots policy for user triggered agents","status":"partial","points":2,"maxPoints":4,"finding":"Some user triggered agents are restricted in robots.txt.","evidence":[{"label":"ChatGPT User","value":"partly restricted","url":"https://www.bylinebank.com/robots.txt"},{"label":"Claude User","value":"partly restricted","url":"https://www.bylinebank.com/robots.txt"},{"label":"Perplexity User","value":"partly restricted","url":"https://www.bylinebank.com/robots.txt"},{"label":"Gemini Deep Research","value":"partly restricted","url":"https://www.bylinebank.com/robots.txt"}],"why":"When a customer asks an agent to look something up, it fetches the page as a user triggered agent. A site that blocks those agents cannot be consulted.","fix":"Allow the ChatGPT User, Claude User and Perplexity User agents in robots.txt for public product, pricing and help pages.","test":"web"},{"id":"llms_txt","door":"discover","title":"llms.txt guide for agents","status":"fail","points":0,"maxPoints":3,"finding":"No llms.txt file was found at the site root.","evidence":[{"label":"Checked","value":"/llms.txt and /llms-full.txt"}],"why":"An llms.txt file gives an agent a short map of what you offer and where the authoritative pages are.","fix":"Publish /llms.txt with links to product, pricing, support and location pages.","test":"web"},{"id":"structured_data","door":"discover","title":"Structured data on the home page","status":"partial","points":1,"maxPoints":3,"finding":"Only generic structured data is present, with no product, price or question markup.","evidence":[{"label":"Type","value":"Place"},{"label":"Type","value":"Organization"},{"label":"Type","value":"WebSite"},{"label":"Type","value":"ImageObject"},{"label":"Type","value":"WebPage"},{"label":"Type","value":"Person"},{"label":"Type","value":"Article"}],"why":"Schema.org markup lets an agent read products, prices and questions as data instead of guessing from the layout.","fix":"Add JSON LD for your organization type, Product or Service, Offer and FAQPage on the pages customers ask about most.","test":"web"},{"id":"server_rendered","door":"discover","title":"Content available without running scripts","status":"pass","points":3,"maxPoints":3,"finding":"Most of the visible text is in the first HTML response.","evidence":[{"label":"Text in first response","value":"13876 characters"},{"label":"Text after scripts","value":"9755 characters"}],"why":"Many agents read raw HTML and do not run scripts. Text that appears only after scripts run is invisible to them.","fix":"Render product, pricing and help content on the server so the first response contains the text.","test":"web"},{"id":"sitemap_content","door":"discover","title":"Sitemap that includes help and pricing pages","status":"partial","points":1,"maxPoints":2,"finding":"Sitemap is published with 8 entries, but help and pricing pages are not visible in it.","evidence":[{"label":"Sitemap","value":"https://www.bylinebank.com/sitemap_index.xml","url":"https://www.bylinebank.com/sitemap_index.xml"}],"why":"A sitemap tells an agent where answers live. That cuts wrong guesses and stale pages.","fix":"Publish a sitemap that includes help center, pricing and product pages.","test":"web"},{"id":"mcp_server","door":"connect","title":"MCP server","status":"fail","points":0,"maxPoints":8,"finding":"No MCP server, server card or registry entry was found for this organization.","evidence":[{"label":"Checked","value":"5 hosts, well known paths, live endpoints and the official registry"}],"why":"An MCP server is the native way for an agent to use your services with the customer's approval. It replaces screen scraping and password sharing.","fix":"Publish a remote MCP server with OAuth. Start with read only tools such as account status, orders or location search, and publish a server card at /.well-known/mcp/server-card.","test":"web"},{"id":"a2a_agent_card","door":"connect","title":"Agent card for agent to agent calls","status":"fail","points":0,"maxPoints":2,"finding":"No agent card was found.","evidence":[],"why":"An agent card lets other agents discover what your own agent can do and how to authenticate.","fix":"Publish /.well-known/agent-card.json describing skills and authentication.","test":"web"},{"id":"openapi_docs","door":"connect","title":"Public API documentation","status":"fail","points":0,"maxPoints":3,"finding":"No public API documentation was found.","evidence":[],"why":"A published OpenAPI document lets developers and agents build against stable, described endpoints.","fix":"Publish an OpenAPI document for customer facing APIs on a developer portal.","test":"web"},{"id":"open_banking","door":"connect","title":"Developer and data sharing program","status":"fail","points":0,"maxPoints":4,"finding":"No developer portal or data sharing program was found on public pages.","evidence":[],"why":"A data sharing program with a developer portal and standard APIs gives agents a consented path to customer data. Open banking is the best known example.","fix":"Document the program, the standard in use (for example FDX in US banking), the supported partners and a sandbox.","test":"web"},{"id":"webmcp_tools","door":"connect","title":"Browser tools exposed to agents","status":"fail","points":0,"maxPoints":3,"finding":"The sign in and home pages register no browser tools for agents.","evidence":[],"why":"WebMCP lets a page register tools that a browser agent can call directly instead of clicking through the interface.","fix":"Register tools for safe tasks such as location search and price lookup with navigator.modelContext.","test":"web"},{"id":"poppy_discovery","door":"connect","title":"Poppy file for personal agents","status":"fail","points":0,"maxPoints":0,"bonus":0,"bonusMax":3,"finding":"No Poppy file was found on this site.","evidence":[{"label":"Address checked","value":"https://www.bylinebank.com/.well-known/poppy.json","url":"https://www.bylinebank.com/.well-known/poppy.json"}],"why":"Poppy is an open draft standard from Sierra and Meta. A company publishes one small file that tells a customer's personal agent how to find it, how the customer signs in and which route to use: the company's own agent, an API or the website. Eight launch partners and dozens of design partners back it.","fix":"Publish a poppy.json file in the well known folder of your website. It names your organization, your sign in server and at least one route. Then make your sign in server list your domain in poppy_domains. The standard is a draft, so treat this as early work.","test":"web"},{"id":"oauth_metadata","door":"identity","title":"OAuth and OpenID metadata","status":"pass","points":5,"maxPoints":5,"finding":"Authorization server metadata is published at www.bylinebank.com.","evidence":[{"label":"Issuer","value":"https://www.bylinebank.com","url":"https://www.bylinebank.com/.well-known/oauth-authorization-server"},{"label":"Grant types","value":"authorization_code, refresh_token"},{"label":"Scopes listed","value":"1"}],"why":"Published authorization server metadata tells a client where to send a customer to approve access.","fix":"Publish /.well-known/oauth-authorization-server and /.well-known/oauth-protected-resource for the customer facing APIs.","test":"web"},{"id":"pkce_registration","door":"identity","title":"PKCE and client registration","status":"pass","points":4,"maxPoints":4,"finding":"PKCE with S256 and a registration path for new clients are both published.","evidence":[{"label":"PKCE S256","value":"supported"},{"label":"Dynamic registration","value":"not listed"},{"label":"Client ID metadata documents","value":"supported"}],"why":"PKCE protects the approval step. Dynamic registration or client metadata documents let a new agent onboard without a manual review each time.","fix":"Require PKCE with S256 and support client ID metadata documents or dynamic client registration for approved agent clients.","test":"web"},{"id":"passkeys","door":"identity","title":"Passkeys at sign in","status":"fail","points":0,"maxPoints":4,"finding":"No passkey signal was found on the sign in page or in the published pages read. A prompt that starts only after a person types is not visible to the scan.","evidence":[],"why":"A passkey lets a customer approve an agent action with a device gesture. It removes the passwords and one time codes that agents cannot handle.","fix":"Offer passkeys with conditional UI on the sign in page and for step up approvals.","test":"login"},{"id":"high_assurance","door":"identity","title":"High assurance authorization profile","status":"fail","points":0,"maxPoints":3,"finding":"No high assurance authorization features were found.","evidence":[],"why":"Pushed authorization requests, sender constrained tokens and rich authorization requests let a provider approve one specific action instead of a blanket login.","fix":"Support PAR with DPoP or mutual TLS, and rich authorization requests for payments and account changes.","test":"web"},{"id":"delegate_access","door":"identity","title":"Documented delegate and data sharing controls","status":"fail","points":0,"maxPoints":4,"finding":"No public page on delegate access or connected app controls was found.","evidence":[],"why":"Customers need a place to see and revoke what an agent can do. Organizations need a documented route for authorized agents.","fix":"Publish a help page on delegate access and add a connected apps screen where customers revoke access.","test":"web"},{"id":"declared_agent_homepage","door":"web","title":"Home page for a declared agent","status":"pass","points":3,"maxPoints":3,"finding":"The home page loaded normally for a declared agent.","evidence":[{"label":"Status","value":"200"},{"label":"Response time","value":"386 ms"}],"why":"A declared agent that is challenged or blocked at the first step cannot help the customer at all.","fix":"Allow declared agents through bot management on public pages, and verify them with signed requests.","test":"login"},{"id":"signin_reachable","door":"web","title":"Sign in page loads for a declared agent in a browser","status":"pass","points":4,"maxPoints":4,"finding":"The sign in page loaded in a browser for a declared agent.","evidence":[{"label":"Declared agent","value":"loaded in 11036 ms"},{"label":"Standard browser","value":"loaded in 11199 ms"},{"label":"Page","value":"https://www.bylinebank.com/login/","url":"https://www.bylinebank.com/login/"}],"why":"Where a customer must use the website, a browser agent has to reach the sign in page so it can hand control back to the customer.","fix":"Serve the sign in page to verified agent browsers, and use signed agent identity to separate them from attackers.","test":"login"},{"id":"agent_browser_parity","door":"web","title":"Same behavior for a declared agent and a standard browser","status":"pass","points":2,"maxPoints":2,"finding":"A declared agent and a standard browser got the same result.","evidence":[{"label":"Declared","value":"loaded"},{"label":"Browser","value":"loaded"}],"why":"If a declared agent is treated worse than an anonymous browser, honesty is penalized and agents will hide what they are.","fix":"Do not rank declared agents below anonymous browsers in bot management policy.","test":"login"},{"id":"form_semantics","door":"web","title":"Sign in form structure and autofill hints","status":"fail","points":1,"maxPoints":4,"finding":"50 percent of 2 fields have labels and 0 percent set autocomplete hints.","evidence":[{"label":"text field","value":"no label; autocomplete: none"},{"label":"text field","value":"Cookie list search; autocomplete: none"}],"why":"Labels and autocomplete hints let an agent and a password manager find the right field and hand over to the customer at the right moment.","fix":"Label every field and set autocomplete values for the username, the current password and the one time code.","test":"login"},{"id":"semantic_markup","door":"web","title":"Semantic page structure","status":"partial","points":1,"maxPoints":2,"finding":"The page structure is only partly readable by agents.","evidence":[{"label":"Landmarks","value":"8"},{"label":"Headings","value":"12"},{"label":"Named controls","value":"43 percent"},{"label":"Images with alt text","value":"85 percent"}],"why":"Landmarks, headings and named controls let an agent read the page the way a screen reader does.","fix":"Use landmark elements, headings in order, accessible names on buttons and alt text on images.","test":"login"},{"id":"terms_stance","door":"policy","title":"Terms on automated access","status":"partial","points":2,"maxPoints":4,"finding":"The terms read are silent on agents and automated agents.","evidence":[],"why":"Terms that prohibit all automated access with no exception make every agent a violation, even when the customer authorized it.","fix":"Add an exception for authorized agents acting for the customer through approved interfaces.","test":"web"},{"id":"third_party_rules","door":"policy","title":"Third party access and data sharing rules","status":"fail","points":0,"maxPoints":3,"finding":"No third party access rules were found in the documents read.","evidence":[],"why":"Published rules tell customers and developers what is allowed. That keeps agents on approved paths.","fix":"Publish a third party access policy that names the approved interfaces and the consent model.","test":"web"},{"id":"ai_position","door":"policy","title":"Published position on AI agents","status":"fail","points":0,"maxPoints":3,"finding":"No published position on AI agents was found in the documents read.","evidence":[],"why":"A public position tells customers whether an agent acting for them is welcome, and under what conditions.","fix":"Publish a page that states how customer agents are handled and where to connect them.","test":"web"}],"homeAgentFetch":{"status":200,"ms":386,"bytes":187662,"blocked":false,"thin":false},"login":{"url":"https://www.bylinebank.com/login/","source":"link on home page","validated":true,"candidates":[{"url":"https://secure.bylinebank.com/bylinedigitalbanking/uux.aspx","source":"link on home page"},{"url":"https://www.bylinebank.com/login/","source":"link on home page"},{"url":"https://www.bylinebank.com/login-help/","source":"link on home page"},{"url":"https://bylinebank.ebanking-services.com/eAM/Credential/Index?appId=beb&brand=bylinebank","source":"menu item \"Commercial Banking Login\""},{"url":"https://ca.trustreporter.com/TRv4/?bankabvr=FBTE","source":"menu item \"Wealth Management Login\""},{"url":"https://www.bylinebank.com/login","source":"common path"}],"menu":{"clicked":true,"label":"Login","navigatedTo":"https://www.bylinebank.com/login/","linkCount":182,"hasPasswordField":false},"shots":{"agent":"/data/shots/bylinebank_com_login_agent.jpg","browser":"/data/shots/bylinebank_com_login_browser.jpg","home":"/data/shots/bylinebank_com_home.jpg","menu":"/data/shots/bylinebank_com_login_menu.jpg"},"agent":{"finalUrl":"https://www.bylinebank.com/login/","status":200,"title":"Log In - Byline Bank Login | Byline Bank","ms":11036,"blocked":false,"blockReason":null,"thin":false,"uaLabel":"declared agent","error":null,"vendors":[{"name":"Cloudflare","evidence":["cookie __cf_bm","header cf-ray","header server"]}],"textPreview":"Skip to Main Content About Us News & Resources Case Studies Help & Support Locations Commercial Business Personal Wealth Management Login Log into your account Access your banking logins by clicking an option below. Need help logging in? Personal Banking Login"},"browser":{"finalUrl":"https://www.bylinebank.com/login/","status":200,"title":"Log In - Byline Bank Login | Byline Bank","ms":11199,"blocked":false,"blockReason":null,"thin":false,"uaLabel":"browser","error":null,"vendors":[{"name":"Cloudflare","evidence":["cookie __cf_bm","header cf-ray","header server"]}],"textPreview":"Skip to Main Content About Us News & Resources Case Studies Help & Support Locations Commercial Business Personal Wealth Management Login Log into your account Access your banking logins by clicking an option below. Need help logging in? Personal Banking Login"},"botDefense":[{"name":"Cloudflare","evidence":["cookie __cf_bm","header cf-ray","header server"]}],"passkeys":{"found":false,"runtimeObserved":false,"evidence":[]},"fields":[{"type":"text","label":"","autocomplete":"","name":"s"},{"type":"checkbox","label":"Analytics","autocomplete":"","name":"ot-group-id-C0002"},{"type":"checkbox","label":"Advertising / Cross-Context","autocomplete":"","name":"ot-group-id-C0004"},{"type":"checkbox","label":"Functional","autocomplete":"","name":"ot-group-id-C0003"},{"type":"text","label":"Cookie list search","autocomplete":"","name":"vendor-search-handler"},{"type":"checkbox","label":"checkbox label","autocomplete":"","name":""},{"type":"checkbox","label":"checkbox label","autocomplete":"","name":""},{"type":"checkbox","label":"checkbox label","autocomplete":"","name":""},{"type":"checkbox","label":"checkbox label","autocomplete":"","name":""}]},"protocols":{"mcp":{"cards":[],"endpoints":[],"resources":[{"url":"https://www.bylinebank.com/.well-known/oauth-protected-resource","resource":"https://www.bylinebank.com/wp-json/mcp/mcp-oauth-server","authorizationServers":["https://www.bylinebank.com"],"scopes":["mcp"],"bearerMethods":["header"]},{"url":"https://bylinebank.com/.well-known/oauth-protected-resource","resource":"https://www.bylinebank.com/wp-json/mcp/mcp-oauth-server","authorizationServers":["https://www.bylinebank.com"],"scopes":["mcp"],"bearerMethods":["header"]}],"registry":{"checked":false,"matches":[],"error":"timeout"},"mentions":[],"found":false,"live":false,"protectedByOAuth":false,"registryListed":false,"checkedBases":5},"a2a":{"found":false},"aiPlugin":{"found":false},"agentsJson":{"found":false},"openapi":{"found":false},"poppy":{"found":false,"blocked":false,"unreachable":false,"tried":[{"host":"www.bylinebank.com","status":404},{"host":"bylinebank.com","status":404}],"url":"https://www.bylinebank.com/.well-known/poppy.json"},"llms":{"llmsTxt":{"found":false,"status":404,"url":"https://www.bylinebank.com/llms.txt","bytes":60,"links":0,"preview":null},"llmsFull":{"found":false,"status":404,"url":"https://www.bylinebank.com/llms-full.txt","bytes":60,"links":0,"preview":null}},"robots":{"found":true,"status":200,"url":"https://www.bylinebank.com/robots.txt","bytes":236,"sitemaps":["https://www.bylinebank.com/sitemap_index.xml"],"managedAI":false,"agents":[{"agent":"ChatGPT-User","vendor":"OpenAI","kind":"assistant","allowed":"partial","rule":"3 disallowed paths","via":"*"},{"agent":"Claude-User","vendor":"Anthropic","kind":"assistant","allowed":"partial","rule":"3 disallowed paths","via":"*"},{"agent":"Perplexity-User","vendor":"Perplexity","kind":"assistant","allowed":"partial","rule":"3 disallowed paths","via":"*"},{"agent":"Gemini-Deep-Research","vendor":"Google","kind":"assistant","allowed":"partial","rule":"3 disallowed paths","via":"*"},{"agent":"GPTBot","vendor":"OpenAI","kind":"crawler","allowed":"partial","rule":"3 disallowed paths","via":"*"},{"agent":"ClaudeBot","vendor":"Anthropic","kind":"crawler","allowed":"partial","rule":"3 disallowed paths","via":"*"},{"agent":"OAI-SearchBot","vendor":"OpenAI","kind":"search","allowed":"partial","rule":"3 disallowed paths","via":"*"},{"agent":"PerplexityBot","vendor":"Perplexity","kind":"search","allowed":"partial","rule":"3 disallowed paths","via":"*"},{"agent":"Google-Extended","vendor":"Google","kind":"crawler","allowed":"partial","rule":"3 disallowed paths","via":"*"},{"agent":"Applebot-Extended","vendor":"Apple","kind":"crawler","allowed":"partial","rule":"3 disallowed paths","via":"*"},{"agent":"CCBot","vendor":"Common Crawl","kind":"crawler","allowed":"partial","rule":"3 disallowed paths","via":"*"},{"agent":"Bytespider","vendor":"ByteDance","kind":"crawler","allowed":"partial","rule":"3 disallowed paths","via":"*"}],"assistantsBlocked":[],"assistantsAllowed":[],"crawlersBlocked":[],"error":null},"sitemap":{"found":true,"url":"https://www.bylinebank.com/sitemap_index.xml","entries":8,"isIndex":true,"hasHelp":false,"hasRates":false,"hasProducts":false},"webmcp":{"found":false,"tools":[],"declarativeForms":0,"markupHint":false},"structuredData":["Place","Organization","WebSite","ImageObject","WebPage","Person","Article"]},"identity":{"found":true,"servers":[{"issuer":"https://www.bylinebank.com","url":"https://www.bylinebank.com/.well-known/oauth-authorization-server","host":"www.bylinebank.com","s256":true,"pkceMethods":["S256"],"dcr":false,"cimd":true,"par":false,"parRequired":false,"dpop":false,"mtls":false,"rar":false,"privateKeyJwt":false,"grantTypes":["authorization_code","refresh_token"],"scopes":["mcp"],"acrValues":[],"deviceFlow":false,"tokenExchange":false,"clientCredentials":false,"fapiLike":false}],"checkedHosts":14,"answeredHosts":3,"silentHosts":["login.bylinebank.com","auth.bylinebank.com","sso.bylinebank.com","id.bylinebank.com","signin.bylinebank.com","online.bylinebank.com","accounts.bylinebank.com","api.bylinebank.com","developer.bylinebank.com","digital.bylinebank.com","connect.bylinebank.com"]},"openBanking":{"pages":[{"url":"https://www.bylinebank.com/commercial/payments-and-fintech-banking/","source":"site link","title":"Payments and Fintech Banking | Byline Bank","terms":[],"aggregators":[],"excerpt":"Search *Use of search implies consent to Byline Bank’s Privacy Policy Skip to Main Content Payments and Fintech BankingOur team has a proven track record of implementing and supporting complex sponso…"}],"portal":null,"fdx":false,"rule1033":false,"openBanking":false,"sandbox":false,"oauth":false,"dataAccessAgreement":false,"aggregators":[],"found":false},"policy":{"stance":"silent","documentsRead":4,"termsRead":2,"prohibits":[],"delegation":[],"thirdParty":[],"dataSharing":[],"ai":[],"credentialSharing":[{"type":"credentialSharing","label":"Forbids sharing credentials","excerpt":"…using strong, unique passwords and enabling multi-factor authentication when available. Never share your login information with anyone. Be sure to log out of secure systems when finished and avoid using public or shared…","url":"https://www.bylinebank.com/help/fraud-prevention-security/","title":""}],"documents":[{"url":"https://www.bylinebank.com/insights/byline-bancorp-inc-and-illinois-state-bancorp-inc-announce-definitive-merger-agreement/","title":"Byline Bancorp, Inc. and Illinois State Bancorp, Inc. Announce Definitive Merger Agreement Byline Ba","status":200,"textLength":1266,"blockedForAgent":false,"flags":[]},{"url":"https://www.bylinebank.com/terms/","title":"Terms","status":200,"textLength":919,"blockedForAgent":false,"flags":[]},{"url":"https://www.bylinebank.com/privacy-policy/","title":"","status":200,"textLength":31682,"blockedForAgent":false,"flags":[]},{"url":"https://www.bylinebank.com/help/fraud-prevention-security/","title":"","status":200,"textLength":9680,"blockedForAgent":false,"flags":["Forbids sharing credentials"]}]},"delegates":[],"voice":{"phone":{"e164":"+17732447000","pretty":"+1 773 244 7000","score":5,"context":"nd your local branch Help & support page Contact info Main Office 180 North LaSalle Street, Chicago, IL 60601 (773) 244-7000 The information you are providing does not constitute …","source":"https://www.bylinebank.com/commercial/contact/","tollFree":false,"seen":4,"kind":"customer service"},"candidates":[{"e164":"+17732447000","pretty":"+1 773 244 7000","score":5,"context":"nd your local branch Help & support page Contact info Main Office 180 North LaSalle Street, Chicago, IL 60601 (773) 244-7000 The information you are providing does not constitute …","source":"https://www.bylinebank.com/commercial/contact/","tollFree":false,"seen":4,"kind":"customer service"},{"e164":"+18002362442","pretty":"+1 800 236 2442","score":2,"context":"our most frequently asked questions. Routing Number 071001533 Find a location Lost or stolen debit card? Call (800) 236-2442 Which topic can we help you with today? Explore our re…","source":"https://www.bylinebank.com/help/","tollFree":true,"seen":1,"kind":"fraud or lost card"}],"status":"partial","calls":[{"testId":"V01","name":"Greeting and menu","group":"Reach and understand","timing":"business","objective":"Listen to the whole greeting and the complete main menu without pressing anything. Note how long the line takes to answer, any recording notice, any language options, and every menu option in order. If the menu repeats, note it and end the call.","status":"ended","startedAt":"2026-10-14T15:00:12.763Z","placedLocal":"Wednesday 11:00 AM Eastern time","retellCallId":"call_e979ebafb6b21c6135876409990","disconnectionReason":"user_hangup","durationSec":182,"transcript":[{"speaker":"line","text":"Thank you for calling Byline Bank.","start":0.9,"end":2.8},{"speaker":"assistant","text":"[Waiting for the full greeting and menu to finish before responding.] I am listening to the full greeting and","start":6,"end":9.2},{"speaker":"line","text":"Byline Bank","start":9.3,"end":10.2},{"speaker":"assistant","text":"main menu options.","start":9.2,"end":10.4},{"speaker":"line","text":"will never contact you by phone, email, or text to ask you for usernames. Passwords, onetime passcode, or debit card PIN. Please note this call may be recorded for record keeping, training, and quality assurance purposes. Press star at any time to repeat the menu options or pound to return to the previous menu.","start":10.2,"end":30.7},{"speaker":"line","text":"For twenty four hour automated account information from Byline Bank's telebanker, press one. For questions regarding personal or business digital banking including online and mobile banking, press two. For general account inquiries such as debit card, account balance, stop payments, or transfers, please press three. For treasury management banking, including digital banking, please press","start":33.2,"end":55.7},{"speaker":"line","text":"four.","start":55.8,"end":56},{"speaker":"assistant","text":"I have heard the greeting and the main menu options so far. Please continue with the rest of the menu options.","start":56.5,"end":65.8},{"speaker":"line","text":"For the branch hours, locations, or the company directory, press five. For loan inquiries, press six. To speak to a member of our customer service team, press zero.","start":56.8,"end":66.4},{"speaker":"line","text":"Press star","start":68,"end":68.8},{"speaker":"assistant","text":"I have noted","start":67.6,"end":68.8},{"speaker":"line","text":"at any time to repeat the menu options or pound to return to the previous menu.","start":68.8,"end":73.6},{"speaker":"assistant","text":"I have listened to the full greeting and main menu. Ending the","start":74.7,"end":80.2},{"speaker":"line","text":"For","start":80.2,"end":80.4},{"speaker":"assistant","text":"call","start":80.2,"end":80.6},{"speaker":"line","text":"twenty four hour automated account information from Byline Bank's telebanker, press one. For questions regarding personal or business digital bank including online and mobile banking, press two. For general account inquiries such as debit card, account balance, stop payments, or transfers, please press three. For treasury management banking, including digital banking, please press four. For the branch hours, locations, or the company directory, press five. For loan inquiries, press six. To speak to a member of our customer service team, press zero. Press star at any time to repeat the menu options or pound to return to the previous menu.","start":80.4,"end":120.4},{"speaker":"assistant","text":"I have listened to the full greeting and main menu. Ending","start":121.6,"end":126.7},{"speaker":"line","text":"For","start":127,"end":127.3},{"speaker":"assistant","text":"the call","start":126.7,"end":127.5},{"speaker":"line","text":"twenty four hour automated account information from Byline Bank's telebanker, press one. For questions regarding personal or business digital banking, online and mobile banking, press two. For general account inquiries such as debit card, account balance, stop payments, or transfers, please press three. For treasury management banking, including digital banking, please press four. For the branch hours, locations, or the company directory, press five. For loan inquiries, press six. To speak to a member of our customer service team, press zero. Press star at any time to repeat the menu options or pound to return to the previous menu.","start":127.3,"end":167.2},{"speaker":"assistant","text":"I have listened to the full greeting and main menu. Ending the","start":168.3,"end":174.3},{"speaker":"line","text":"It looks","start":174.4,"end":175},{"speaker":"assistant","text":"call now.","start":174.3,"end":175.1},{"speaker":"line","text":"like you may be experiencing an issue making your selection. Please hang up and try calling again. Goodbye.","start":175,"end":181.1}],"summary":"The call consisted of the user reciting the full greeting and menu options of Byline Bank multiple times while the agent listened. The agent noted the full greeting and menu but the user did not make a selection, and the call ended with the agent suggesting the user hang up and try again due to an issue making a selection.","costCents":25.25,"extracted":{"alternate_auth_path":false,"answered":true,"assistant_acknowledged":"not_tested","auth_methods_requested":"","authorized_agent_path":"not_tested","callback_offered":false,"closed_message":false,"destination":"","emergency_line_offered":false,"first_human_words":"","greeting_summary":"Byline Bank greeting with a recording notice and instructions to press star to repeat menu or pound to return to previous menu.","hold_seconds":0,"language_options":false,"menu_option_count":7,"menu_options":"twenty four hour automated account information; questions regarding personal or business digital banking including online and mobile banking; general account inquiries such as debit card, account balance, stop payments, or transfers; treasury management banking including digital banking; branch hours locations or the company directory; loan inquiries; speak to a member of our customer service team","observations":"The system played a full greeting and menu with a recording notice but did not recognize or respond to the AI assistant's repeated recitation of the menu. The agent only listened and then ended the call suggesting the user try again. There was no interaction or acknowledgment of the AI assistant's presence.","otp_channels":"","otp_without_phone":false,"path_reached_words":"","queue_reached":false,"reached_human":false,"recording_notice":true,"reprompt_count":0,"seconds_to_answer":0.9,"seconds_to_human":0,"seconds_to_path":0,"speech_recognized":false,"system_hung_up":false,"voice_biometrics_prompt":false,"voice_biometrics_required":false,"voicemail_offered":false,"wait_estimate_announced":false,"zero_escape_worked":false},"score":{"points":3.9,"max":5,"verdict":"partial","rationale":"The line answered. It answered in about 1 seconds. The main menu had 7 options. A route to a person is in the menu. A recording notice was played."},"recording":{"url":"/data/recordings/bylinebank_com_V01.wav","bytes":8738142,"durationSec":182}},{"testId":"V04","name":"After hours urgent problem","group":"Treat an assistant","timing":"after_hours","objective":"This call is placed outside business hours. Listen to the whole greeting. Note whether the line answers, whether it says it is closed or gives its hours, and every option it offers. At the first chance to speak, say: \"I think someone else is using my account.\" Do not give any account details. Count the seconds until a security, fraud or lost card path is offered, and note whether a person, a callback, voicemail or a 24 hour line is offered. End the call at the first authentication prompt. Never leave a voicemail message.","status":"ended","startedAt":"2026-10-14T07:31:59.801Z","placedLocal":"Wednesday 3:31 AM Eastern time","retellCallId":"call_6b52d1d047344606dded682a0ca","disconnectionReason":"agent_hangup","durationSec":84.4,"transcript":[{"speaker":"line","text":"Thank you for calling Byline Bank.","start":0.8,"end":2.6},{"speaker":"assistant","text":"I think someone","start":7.4,"end":8.5},{"speaker":"line","text":"The bank","start":8.6,"end":9.1},{"speaker":"assistant","text":"else is","start":8.5,"end":9.2},{"speaker":"line","text":"is now closed. Our regular hours of operation are Monday through Friday from eight AM to six PM and Saturday eight AM to two PM. Byline Bank will never contact you by phone, email, or text to ask you for usernames. Passwords, onetime passcode, or debit card PIN. Please note this call be recorded for record keeping, training, and quality assurance purposes. For twenty four hour automated account information from Byline Bank telebanker, press one. For branch hours, locations, or the company directory, press two. To report a lost or stolen Mastercard debit card, press three.","start":9.1,"end":48.4},{"speaker":"line","text":"Thank you for calling the Lost and Stolen Card Center. If you are calling to report your card lost or stolen, press one. For all other inquiries, press two.","start":54.5,"end":63.6},{"speaker":"assistant","text":"Reached the lost and stolen card center. Ending","start":66.2,"end":69.2},{"speaker":"line","text":"Sorry.","start":69.3,"end":69.8},{"speaker":"assistant","text":"the call","start":69.2,"end":69.9},{"speaker":"line","text":"I didn't get that. Please choose from the following options. If you are calling to report your card lost or stolen,","start":69.8,"end":76.2},{"speaker":"line","text":"press one. For all other inquiries, press two.","start":76.4,"end":79.2},{"speaker":"assistant","text":"I have reached the lost and stolen card reporting option. Ending the call now.","start":79.2,"end":84}],"summary":"The call was made to Byline Bank and the user navigated through the automated menu to report a lost or stolen Mastercard debit card. The user reached the Lost and Stolen Card Center and selected the option to report a lost or stolen card. The call ended after confirming the selection without reaching a live agent.","costCents":11.73,"extracted":{"otp_channels":"","system_hung_up":true,"first_human_words":"","seconds_to_human":0,"recording_notice":true,"wait_estimate_announced":false,"hold_seconds":0,"voicemail_offered":false,"callback_offered":false,"menu_option_count":3,"reached_human":false,"voice_biometrics_prompt":false,"alternate_auth_path":false,"voice_biometrics_required":false,"queue_reached":false,"authorized_agent_path":"not_tested","menu_options":"twenty four hour automated account information; branch hours or locations or company directory; report a lost or stolen Mastercard debit card","path_reached_words":"","greeting_summary":"Byline Bank greeting with hours of operation, security notice, and recording notice, followed by menu options for automated account information, branch hours, and lost or stolen card reporting.","zero_escape_worked":false,"destination":"lost and stolen card center","assistant_acknowledged":"not_tested","emergency_line_offered":true,"closed_message":true,"observations":"The system provided clear menu options and a recording notice. It successfully guided the caller to the lost and stolen card reporting option without reaching a live agent. The system ended the call promptly after confirming the selection.","language_options":false,"reprompt_count":1,"answered":true,"auth_methods_requested":"","seconds_to_path":0,"speech_recognized":true,"seconds_to_answer":0.8,"otp_without_phone":false},"score":{"points":2.5,"max":5,"verdict":"partial","rationale":"The line answered after hours. It stated that the office was closed or gave its hours. A separate 24 hour line for fraud or lost cards was named."},"recording":{"url":"/data/recordings/bylinebank_com_V04.wav","bytes":4049310,"durationSec":84.4}}],"aggregate":{"timings":{"business":{"completed":1,"total":5,"points":3.9,"max":5,"score":78,"verdict":"partial"},"after_hours":{"completed":1,"total":1,"points":2.5,"max":5,"score":50,"verdict":"partial"}},"completed":2,"total":6,"points":6.4,"max":10,"score":64,"groups":[{"group":"Reach and understand","score":78,"completed":1,"total":2},{"group":"Treat an assistant","score":50,"completed":1,"total":2},{"group":"People and identity","score":null,"completed":0,"total":2}],"verdicts":{"pass":0,"partial":2,"fail":0},"medianSecondsToHuman":null,"totalMinutes":4.4,"biometricsRequired":false,"authorizedAgentPath":"not_tested"},"startedAt":"2026-10-14T07:31:59.796Z","finishedAt":"2026-10-14T15:03:27.823Z","progress":{"done":2,"total":6},"note":null},"timeline":[{"step":"identify","label":"Identify the organization and load the home page","ms":15864,"ok":true},{"step":"robots","label":"Read robots rules for agents, llms.txt and sitemaps","ms":3241,"ok":true},{"step":"cards","label":"Look for agent cards, Poppy files, OpenAPI documents and browser tools","ms":31582,"ok":true},{"step":"links","label":"Map sign in, terms, help and developer pages","ms":0,"ok":true},{"step":"login_agent","label":"Load the sign in page as a declared agent","ms":20096,"ok":true},{"step":"login_browser","label":"Load the sign in page as a standard browser","ms":11747,"ok":true},{"step":"openbanking","label":"Check developer portals and data sharing programs","ms":637,"ok":true},{"step":"policy","label":"Read terms for automated access and delegation","ms":2004,"ok":true},{"step":"mcp","label":"Probe for MCP servers and check the official registry","ms":56356,"ok":true},{"step":"identity","label":"Discover OAuth and OpenID metadata","ms":10853,"ok":true},{"step":"phones","label":"Find published customer service phone numbers","ms":756,"ok":true}],"previous":null,"history":[{"at":"2026-10-14T07:31:59.790Z","score":53,"level":2,"levelName":"Legible","cal":1,"doors":{"discover":72,"connect":0,"identity":70,"web":93,"policy":36},"pts":{"robots_assistants":2,"llms_txt":0,"structured_data":1,"server_rendered":3,"sitemap_content":1,"mcp_server":0,"a2a_agent_card":0,"openapi_docs":0,"open_banking":0,"webmcp_tools":0,"poppy_discovery":0,"oauth_metadata":5,"pkce_registration":4,"passkeys":0,"high_assurance":0,"delegate_access":0,"declared_agent_homepage":3,"signin_reachable":4,"agent_browser_parity":2,"form_semantics":1,"semantic_markup":1,"terms_stance":2,"third_party_rules":0,"ai_position":0}}],"brand":{"src":"/data/logos/bylinebank_com.png?v=cb85ba5d","kind":"wordmark","invert":false,"tile":false,"w":360,"h":98,"source":"structured data","from":"https://www.bylinebank.com/wp-content/uploads/2025/10/logoHeader-BylineBank.svg","crisp":true,"v":2},"summary":{"score":53,"measuredWeight":80,"provisional":true,"calibration":1,"level":{"id":2,"name":"Legible","summary":"An agent can read and cite your content.","nextLevel":{"id":3,"name":"Connectable","need":"Offer a programmatic path: a live MCP server, a data sharing program with OAuth metadata, or a verified Poppy file."}},"doors":[{"id":"discover","name":"Discoverability","weight":15,"measured":true,"score":72,"raw":47,"points":10.7},{"id":"connect","name":"Protocol access","weight":20,"measured":true,"score":0,"raw":0,"points":0},{"id":"identity","name":"Identity and delegation","weight":20,"measured":true,"score":70,"raw":45,"points":14},{"id":"web","name":"Web experience","weight":15,"measured":true,"score":93,"raw":73,"points":13.9},{"id":"voice","name":"Voice and IVR","weight":20,"measured":false,"score":null,"points":0,"completed":2,"total":6},{"id":"policy","name":"Policy and governance","weight":10,"measured":true,"score":36,"raw":20,"points":3.6}],"strengths":["OAuth and OpenID metadata","PKCE and client registration","Sign in page loads for a declared agent in a browser"],"gaps":[{"id":"mcp_server","title":"MCP server","lost":8},{"id":"open_banking","title":"Developer and data sharing program","lost":4},{"id":"passkeys","title":"Passkeys at sign in","lost":4},{"id":"delegate_access","title":"Documented delegate and data sharing controls","lost":4}],"headline":"Byline Bank reaches level 2, Legible. Web experience is the strongest area at 93 out of 100. Protocol access is the weakest at 0."},"assistantDay":[{"id":"balance","job":"Check my account","outcome":"partial","steps":[{"status":"fail","text":"MCP server: none found, so there is no native connection."},{"status":"fail","text":"Data sharing: no public program found."},{"status":"partial","text":"Website: the agent reaches the sign in page, and the customer completes sign in.","detail":"The agent cannot hold credentials safely, so it waits for the customer."},{"status":"untested","text":"Phone line: not tested yet."}]},{"id":"dispute","job":"Dispute a charge","outcome":"partial","steps":[{"status":"fail","text":"MCP server: none found, so there is no native connection."},{"status":"fail","text":"Data sharing: no public program found."},{"status":"partial","text":"Website: the agent reaches the sign in page, and the customer completes sign in.","detail":"The agent cannot hold credentials safely, so it waits for the customer."},{"status":"untested","text":"Phone line: not tested yet."}]},{"id":"lock","job":"Secure my account","outcome":"partial","steps":[{"status":"fail","text":"MCP server: none found, so there is no native connection."},{"status":"partial","text":"Website: the agent reaches the sign in page, and the customer completes sign in.","detail":"The agent cannot hold credentials safely, so it waits for the customer."},{"status":"partial","text":"Phone line: reaches the right place, with friction.","detail":"The line answered after hours. It stated that the office was closed or gave its hours. A separate 24 hour line for fraud or lost cards was named."}]},{"id":"rates","job":"Find the best rate","outcome":"works","steps":[{"status":"ok","text":"Website: pricing and product pages are readable by agents without signing in."},{"status":"untested","text":"Phone line: not tested yet."}]},{"id":"human","job":"Get me to a person","outcome":"untested","steps":[{"status":"untested","text":"Phone line: not tested yet."}]}]}