Collty technology
Collty Intelligence Core
Collty's proprietary team intelligence and learning system connects the private work graph, domain algorithms, evaluation and governed decisions. It is designed to improve with real work while keeping users, evidence and human control at the center.
- 01ObserveFeedback & outcomes
- 02EvaluatePrivate evals
- 03Hold outBaseline comparison
- 04CanaryLive evidence
- 05ApproveHuman control
Proprietary team assembly engine
How Collty evaluates professionals for a specific request and assembles a team.
Every relevant profile is assessed comprehensively in the context of the request. Collty then evaluates how people work together as a team: role coverage, complementary strengths, availability, workload, delivery evidence and collaboration fit.
Understand the request
The project need is normalized into a task-specific semantic intent: outcome, scope, market, constraints and required capabilities.
Search the vector space
Semantic retrieval finds the closest professional evidence by meaning, not by literal keyword overlap or a fixed profession dictionary.
Resolve verified evidence
Vector matches are resolved back to active, permitted Collty profiles and their source-backed competencies, experience, cases and work signals.
Interpret professional fit
AI examines a minimized evidence packet to understand role fit, proof of experience, industry context and project-specific strengths.
Score the team as a system
Collty evaluates capability coverage, availability, workload, reliability, collaboration and role complementarity across the whole team.
Return grounded options
Ranked team variants contain only real professionals and evidence-linked roles. Unsupported matches are rejected rather than invented.
Evaluation focuses on professional evidence and derived work signals, not sensitive personal data. Only dimensions relevant to the request are included in the minimized AI context. Team-level analysis then measures how the selected people cover the work and complement one another.
Architecture
A proprietary intelligence system for teams and project delivery.
Collty Intelligence Core combines our private work graph, domain algorithms, evaluation, learning, permissions, provenance and decision controls in one architecture. It turns connected evidence about people, teams, projects and outcomes into grounded team assembly, planning and delivery decisions.
A connected, permission-aware work graph
Profiles, competencies, teams, project structures, task activity, collaboration signals, commercial context and outcomes remain connected to their source objects and access boundaries.
Domain algorithms structure every decision
Retrieval, ranking, capability coverage, availability, compatibility, workload, delivery and risk signals turn connected work evidence into grounded intelligence for the task.
Only task-relevant context enters AI reasoning
Context is minimized, structured and filtered. Sensitive fields, secrets and unrelated workspace data are excluded or redacted before a provider request is made.
Reasoning operates inside Collty's evidence architecture
Collty selects and combines the appropriate reasoning capability for each workflow while the Intelligence Core controls context, evidence, evaluation, ranking logic and decisions.
Outputs stay traceable to evidence and versions
High-value runs preserve provenance: the task, evidence boundary, algorithm and grader versions, provider, result status and the human decision that followed.
Outcomes improve the system through a gated loop
Feedback and project outcomes become evaluation signals. Candidate calibration is tested on holdout data, observed in shadow mode and activated only after human approval.
Learning and improvement
Every improvement has to earn its way into production.
A rating, accepted recommendation or completed project does not directly rewrite the ranking engine. Signals are aggregated into a controlled calibration process, tested away from production and reviewed before activation.
- 01Observe
Capture useful human choices, accepted actions and delivery outcomes as scoped learning signals.
- 02Evaluate
Run versioned private datasets through task-specific graders for assembly, planning and recommendations.
- 03Calibrate
Fit a candidate ranking version under bounded constraints instead of rewriting production behavior directly.
- 04Hold out
Compare the candidate with the current baseline on evidence it did not use for calibration.
- 05Shadow
Measure quality, drift, latency and cost without changing what users receive.
- 06Approve
A person reviews the evidence before a new ranking version can become active.
Data and privacy
Useful context in. Unnecessary data out.
Collty uses data to provide the requested workspace feature, ground a decision and improve internal quality through controlled signals. The external model is not the system of record and does not receive unrestricted access to the Collty work graph.
What can be used
- Authorized profile and capability evidence relevant to the task.
- Team, project, task and delivery signals inside the permitted workspace scope.
- Human feedback and project outcomes selected for controlled evaluation.
- Operational telemetry needed to measure quality, latency, errors and cost.
What stays protected
- Credentials, encryption material, payment details and secrets are excluded.
- Unrelated people, projects, chats and workspace records are outside the context boundary.
- Sensitive values are filtered or redacted before a provider request.
- Customer workspace content is not sent to model providers to train shared foundation models.
- Private eval cases, prompts, weights, thresholds and feature schemas are not public.
How decisions stay accountable
- Runs are associated with task, evidence and algorithm versions.
- Operational provenance favors identifiers and control metadata over raw content.
- Protected traces are encrypted when deeper investigation is necessary.
- Consequential changes preserve the human choice that approved or rejected them.
This page explains the AI-specific design boundary. Collty's broader handling of personal information is described in the Privacy Policy.
Production controls
Measured as a live system.
Quality cannot be separated from reliability and cost. Collty tracks the behavior of the complete decision path, not only the text returned by a model.
Quality and drift
Domain scores, critical failures and version comparisons reveal regressions before they become the new baseline.
Reliability and latency
Runs are monitored for duration, provider errors, retries and operational status across product workflows.
Durable execution
A durable outbox protects provenance and learning events, while distributed deduplication prevents equivalent AI work from being charged or executed twice.
Human control
New ranking weights and consequential project actions remain approval-controlled rather than silently changing production behavior.
EU AI Act Compliance
Compliance controls are built into the complete AI lifecycle.
Collty does not apply one generic AI label to every feature. Each system has its own intended purpose, classification, data boundary, oversight rules and post-market evidence. Controls are designed around the real effect of the workflow. Team Assembly recommends alternative project-team compositions from permitted professional evidence; the user inspects profiles, edits the composition and makes the final choice.
Every AI workflow has its own classification
Intended purpose, owner, Collty's provider role, the customer's deployer role, risk class, human-oversight boundary and review date are versioned per product system. Team Assembly, Signals applicant ranking, Team Intelligence and task allocation are conservatively governed as Annex III high-risk systems.
Annex III assessment is connected to operating controls
The risk register covers discrimination, ranking and selection bias, false exclusion, unsupported inclusion and misuse. Versioned data contracts define allowed evidence, protected-attribute exclusions, proxy tests, missing-evidence behavior and activation gates.
Useful reasons without turning Collty into an employment arbiter
A displayed recommendation can explain the professional evidence that supported it. A specialist can correct their profile or report an AI-ranking error; the customer still makes and owns the commercial team decision. Hidden search candidates are not disclosed.
Monitoring continues after release
Quality, false inclusion and exclusion, overrides, review requests, drift, reliability and misuse signals feed a protected incident and corrective-action process. Role-specific AI literacy records support trained human oversight.
These are separate controls. Ratings enter the gated learning loop; a system-error or evidence-correction request protects the accuracy of Collty's output. Collty does not adjudicate the customer's team choice, and ordinary hidden search candidates are never exposed merely to manufacture an explanation.
Collty can also suggest how a professional can make their own profile evidence clearer and more complete. Guidance never guarantees placement in a result: every team is assembled for a specific request, and the customer or project owner makes the final selection.
Read the AI termsStandards and guidance
Designed in alignment with current responsible AI practice.
These frameworks inform Collty's engineering and governance approach. Alignment describes design intent and operating controls; it is not a claim that Collty is certified by NIST, ISO or a model provider.
Collty applies lifecycle governance, contextual risk mapping, repeatable measurement and production controls as design principles for trustworthy AI operations.
NIST GenAI ProfileGenerative AI risks need specific controlsEvidence grounding, evaluation, monitoring, privacy controls and human review address risks that are specific to generative systems.
ISO/IEC 42001:2023AI management and continual improvementThe Core is designed around traceability, defined controls, monitoring and managed improvement of AI-enabled product behavior.
ISO/IEC 23894:2023AI-specific risk managementRisk controls are integrated into the design, deployment and operation of AI-assisted features instead of being treated as a one-time release check.
EU AI Act transparencyClear AI interaction and human oversightThe public architecture, identified AI features and explicit decision boundaries support a risk-based transparency approach while product-specific obligations remain subject to legal assessment.
OpenAI evaluation guidanceEval-driven developmentTask-specific datasets, automated graders, production-like cases and human judgment create a continuous quality process for non-deterministic systems.
FAQ
Technical questions, answered directly.
The answers describe Collty's production governance contract without exposing proprietary features, weights, thresholds, private cases or internal schemas.
What the Core is and what it can use
What is Collty Intelligence Core?
It is Collty's proprietary team and project intelligence architecture. It connects the permission-aware work graph, semantic retrieval, domain algorithms, evaluation, model routing, provenance and controlled learning. External reasoning models are replaceable components inside this system, not the owner of its evidence or decision policy.
Is Collty Intelligence Core a foundation model?
No. It is a domain intelligence system built around Collty's own evidence model and algorithms. Specialized models contribute interpretation and synthesis where they add value; retrieval, ranking, permissions, validation, evaluation and activation controls remain inside Collty.
What data can be used to assemble and assess a team?
Only authorized, task-relevant professional evidence is considered: competencies, roles, experience, cases, industries, languages, availability, capacity, delivery history, verified outcomes and collaboration signals. Team-level analysis also examines coverage, complementarity, workload, resilience and commercial context when the project requires it.
Does team assessment use sensitive personal data?
The assessment is designed around professional evidence and derived work signals, not sensitive personal attributes. Credentials, payment details, encryption material and unrelated workspace content are excluded. Context is minimized and filtered before any provider request.
Is customer workspace content used to train shared external models?
Collty does not send customer workspace content to model providers for training shared foundation models. Provider processing is used to deliver the requested feature under the applicable service terms, while Collty keeps its work graph, evaluation data and learning controls within its own platform boundary.
How is data minimized before AI reasoning?
The Core builds a task-specific evidence packet instead of exposing the work graph directly. Allowlisted structures, field filtering, redaction and evidence identifiers reduce the context to what the current task requires. Deeper protected traces are retained only when needed for evaluation, security or investigation.
How does Collty prevent invented people, roles or evidence?
Generated conclusions must resolve to permitted source objects and grounded evidence identifiers. Domain graders detect unsupported members, invented evidence and missing mandatory capabilities, preventing fluent model output from being accepted without source-backed support.
How quality is measured and improved
What qualifies as a private evaluation case?
A production output can be captured as evidence, but it never becomes the expected answer automatically. Only a separately authored, expert-reviewed and versioned golden reference can be approved for comparison. Live case and run counts are operational governance metrics rather than static marketing claims.
How many approved real cases are in the private eval dataset?
Collty does not hard-code a changing production count into this public page. The exact approved-case count, domain coverage and evaluation-run history are live governance metrics available to authorized reviewers. Captured production outputs are never counted as approved cases until an expert authors and confirms the golden reference.
How is Team Assembly quality measured?
Domain graders examine request relevance, mandatory capability coverage, unsupported-member and invented-evidence failures, role allocation, availability, capacity, collaboration compatibility, resilience and human usefulness. The system evaluates both each professional and the team as a working whole.
How is Project Architect quality measured?
Architect uses a separate evaluation contract for outcome phases, task completeness, dependencies, realistic duration, sprint cadence, ownership, confirmed specialists, evidence grounding and commercial consistency. A fluent-looking plan cannot pass solely because its text is well formed.
Is every candidate compared with a stable baseline?
Yes. A candidate calibration is versioned against the active baseline and evaluated on a deterministic holdout set excluded from fitting. The active baseline remains unchanged until the candidate passes every promotion gate.
Can Collty show that an improvement is not random?
Promotion requires both minimum absolute and relative improvement plus a positive paired 95% confidence interval on weighted holdout evidence. Offline success does not authorize promotion by itself: the candidate must also survive controlled production observation before a person can activate it.
How does Collty handle selection bias?
Displayed recommendations are stored as privacy-safe exposures. Feedback is linked to the exact option and rank; empirical observation propensity is smoothed and converted into bounded inverse-propensity weight so frequently exposed positions do not dominate calibration. This mitigates observed ranking bias, but it is not presented as complete causal identification of every unobserved outcome.
Are different learning signals normalized consistently?
Yes. Under the current versioned contract, a 1-5 rating is mapped with (rating - 1) / 4, a 0-100 delivery score is divided by 100, and binary completion or recommendation outcomes remain 0 or 1. Raw values, normalized values and the contract version remain distinguishable for audit and controlled migration.
Do older outcomes keep the same influence forever?
No. Time-sensitive signals use an explicit half-life contract. Recent evidence receives more weight while older evidence decays gradually instead of disappearing abruptly. The decay policy is versioned with the signal definition.
How is an individual's contribution separated from team context?
Collty combines direct delivery evidence with conservative shrinkage-based adjustment for project and team conditions. Regularization prevents unstable extreme scores and separates individual signals from shared project context. This improves attribution discipline, but Collty does not describe it as a causal estimate of a person's isolated effect.
Does a rating or completed project immediately change ranking?
No. Feedback first becomes a scoped, normalized learning signal. Signals are aggregated into a candidate calibration, tested on holdout evidence, observed safely and reviewed by a person. No single rating, project or customer can directly rewrite production weights.
How changes stay safe, traceable and efficient
What are shadow testing and model shadow mode?
Shadow evaluation compares candidate behavior without replacing the user-visible result. Model shadow mode can run a replaceable provider behind the same minimized context and evaluation contract, allowing Collty to compare quality, latency and cost without silently changing the primary workflow.
How does a ranking version reach production?
It must pass versioned private evaluation, deterministic holdout comparison and statistical promotion criteria. It can then enter a small sticky canary allocation, where live exposures and outcomes are measured. Final promotion requires explicit human approval.
Can a production ranking change be rolled back?
Yes. Promotion preserves the previous active version. An atomic rollback restores that version without retraining, rewriting source evidence or waiting for a new deployment.
How are decisions and versions traced?
High-value runs retain provenance for the task, evidence boundary, context and grader versions, algorithm version, provider, result status and subsequent human decision. Operational records favor fingerprints and identifiers; protected payloads are encrypted when deeper review is necessary.
How are AI usage and cost accounted for?
Provider calls are attributed to the responsible account and feature, including measured input, output, cached and reasoning usage when the provider supplies it. Retries and shadow runs are recorded as separate execution events, while deduplication prevents the same logical request from being charged or executed twice.
Does this learning system slow down product workflows?
The user-facing result does not wait for calibration. Exposure and learning events are written through a durable asynchronous outbox, active policy is cached, and calibration runs in the background with cooldown and single-flight protection. Governance adds small bounded metadata writes rather than another AI pass to every request.
What is monitored in production?
Collty monitors domain quality, critical grader failures, latency, provider errors, retries, token usage, cost, outbox health and drift across versions. These signals are evaluated together because a higher-scoring system is not an improvement if it becomes unreliable, materially slower or disproportionately expensive.
Who can activate consequential changes?
Activation is permission-controlled and human-approved. Candidate ranking weights cannot promote themselves, and consequential project actions remain subject to the product's role and approval boundaries. Database policies and service-only governance operations enforce the same boundary below the interface.
How does Collty classify AI used for team selection and task allocation?
Collty assesses each AI-enabled workflow separately by intended purpose. Team Assembly, Signals applicant ranking, Team Intelligence and task allocation are conservatively governed as high-risk systems under the employment and work-management area of EU AI Act Annex III. Human approval remains an essential control, but it does not by itself remove that classification. Planning, canvas and conversational assistance have separate limited-risk assessments and may not silently inherit personnel-decision authority.
Why was a professional included in a team option?
For a displayed match, Collty can summarize the task-relevant evidence that supported inclusion, such as capabilities, role coverage, relevant cases, industry experience, availability, capacity and verified collaboration or delivery signals. Collty presents alternative team options rather than making the final choice. The user can inspect each available profile, compare professional experience and competencies, remove or replace people and choose the composition. The explanation does not disclose another person's private information, internal weights, security controls or proprietary ranking formula.
Can Collty help a professional improve their profile?
Yes. Collty can identify missing or weak categories of professional evidence and suggest how to make a profile clearer, for example by adding specific capabilities, cases, role evidence, industry experience, availability or current capacity. This is profile-quality guidance, not a promise of inclusion or selection. Team recommendations remain specific to each project request, and the customer or project owner makes the final choice.
Can every professional ask why they did not appear in an ordinary search?
No. An ordinary search does not publish its hidden candidate pool to people who were not shown, and Collty does not notify every profile considered by semantic retrieval. In Signals, an applicant can correct their own profile evidence or report an AI-ranking error, while the client can manually approve, restore or remove candidates. This preserves meaningful system correction without exposing another user's search, candidate pool or private evidence.
Is rating a result the same as requesting human review?
No. Rating a result is a learning signal used in versioned evaluation and calibration. A system-error or profile-evidence correction request opens a separate authenticated case tied to the user's own account and the relevant output. The two records have different purposes and one never silently substitutes for the other.
Can a professional appeal a client's team choice to Collty?
No. Collty is not an employer, recruiter or tribunal and does not overturn a client's independent commercial choice. A professional can correct their own profile evidence or report that an AI ranking used inaccurate or unsupported evidence. Collty can investigate and correct the system or source record, while the client remains responsible for selecting the team.
How does Collty address EU AI Act transparency and operational governance?
AI-assisted interfaces identify their AI role at the point of interaction, and people-affecting recommendations remain under the customer's human control. A versioned inventory, Annex III assessments, risk and data-governance contracts, quality-management controls, technical-file evidence, post-market monitoring, incident records and role-specific AI literacy records support the operational governance expected by the EU AI Act. This describes Collty's implemented compliance architecture, not a claim of regulator approval or formal certification.
Is Collty Intelligence Core designed in alignment with NIST and ISO AI standards?
Yes. The architecture is designed in alignment with the NIST AI RMF and NIST Generative AI Profile principles for lifecycle governance, risk mapping, measurement, documentation, human oversight and continuous production monitoring. It also follows ISO/IEC 42001 and ISO/IEC 23894 principles for traceability, AI management, risk controls and continual improvement. This describes architectural and operational alignment with those requirements; it does not constitute formal ISO certification or NIST endorsement.
Public architecture boundary
Transparent about controls. Private about the mechanism.
Collty publishes the principles, safeguards and accountability model needed to understand how AI is used. It does not publish proprietary ranking formulas, feature definitions, weights, thresholds, system prompts, private evaluation datasets, provider routing rules, encryption details or internal data schemas.
Back to About