World V2.0 is now Generally Available: A Point-in-Time Database of Global Events
We envision a world where AI agents connected to the NOSIBLE intelligence stack can see everything happening in the world in real time, as well as everything that has happened throughout history.
Currently the stack consists of four levels:
- Firehose is a near-real-time data feed of what we crawl.
- Search is a search engine for dated web documents.
- World is a point-in-time database of worldwide events.
- Atlas is a point-in-time knowledge graph built from World.
Today we're happy to announce that World V2.0 has exited preview and is generally available. Practically speaking this means that the methodology is frozen (to prevent data drift) and V2.0 trial data is available via S3, API, and MCP. In this post, we'll explain what changed from V1.2 to V2.0 and answer common questions.
Why We Version the Data
This might sound counterintuitive, but quants prefer consistency over precision. A field that is consistently wrong can still produce a useful signal if its errors are stable. Fix that field halfway through the dataset, however, and a model might interpret the change in the data as a change in the world. That's data drift.
That's why we version the entire World dataset and freeze the methodology for each release. Historical and new events are processed consistently, so you can backtest models without changes to our methodology creating artificial shifts in the data.
How Long Will V1.2 Be Maintained?
We will maintain World V1.2 for as long as we maintain V2.0. V2.0 is a fork of V1.2: every V2.0 event starts as a V1.2 event before receiving additional processing to extract relationships. This lets us continue producing V1.2 as part of the same pipeline. You can keep using V1.2 in production and trial V2.0 when you're ready.
What's New in World V2.0?
Select a feature to see how it works.
Named entitiesWe fine-tuned GLiNER V2.5 to extract and normalize named entities, with types, mention counts, and confidence scores for each entity found in the event text.
V1.2 used spaCy to identify named entities, but its results were often imprecise. We needed cleaner names and types for researchers who filter events by entity, and for the models that extract relationships, find locations and map events to tickers.
In V2.0, we fine-tuned GLiNER V2.5 to identify people, organizations, products, locations and geopolitical entities, then normalize their names. Each entry in the entities field includes a type, mention count and confidence score for the extracted entity.
Ticker mappingWe combine company names, ticker symbols, and Atlas relationships with personalized PageRank and reranking to score and explain company matches.
An article can be relevant to a company without mentioning its name. News about Zepbound, for example, can matter to Eli Lilly. V1.2 missed some of these connections, leaving researchers without events they could use in company-level signals and backtests.
V2.0 matches company names and ticker symbols, then uses Atlas relationships, personalized PageRank and a reranker to find and score additional companies. Each match includes identifiers, a score and an explanation. Read our ticker mapping analysis.
Event classificationsWe combine EmbeddingGemma with trained classification heads to assign ranked event categories and probabilities across all 15 taxonomies in World.
V1.2 classified events using embedding similarity, which produced noisy ontology labels. Researchers need more precise classifications to select events by topic or industry, set confidence thresholds and assemble datasets for investment research.
V2.0 uses EmbeddingGemma and trained heads across 15 taxonomies. It returns categories and probabilities in JSON. In V2.0 we keep only classifications above a 50% confidence to reduce JSON payload size.
Entity sentimentsWe use point-in-time ChronoGPT vintages to score whether an event is good or bad for each entity, with entity-specific baseline corrections and historical normalization.
One event can affect the entities involved differently. In a lawsuit, for example, a ruling may be good for one company and bad for another. An event-level sentiment score alone cannot express both assessments for researchers studying the parties involved.
We use a ChronoGPT vintage trained on information available before each event to score whether it is good or bad for each named entity. We correct for an entity-specific baseline and normalize using historical data available before the event. This makes the scores point-in-time safe. The sentiments field gives each entity a label and standardized score for the event.
Entity relationshipsWe fine-tuned GLiNER to extract entity relationships, then rerank each triple; Atlas aggregates those relationships into a point-in-time knowledge graph.
Names alone don't tell you how entities are connected. Researchers and AI agents also need to know, for example, which company owns a product or has agreed to acquire another company. Those relationships also build the Atlas knowledge graph.
We fine-tuned GLiNER to extract relationships and built an internal reranker to assess them. World stores each result as a subject–predicate–object triple with scores from both models. Atlas aggregates relationships across events into a point-in-time knowledge graph.
English translationsWe use TranslateGemma to translate event titles, descriptions, and key points into English while retaining the original text alongside them to check translations.
World contains events reported in many languages. Researchers working in English need a way to analyze those events together, search their contents and compare findings across markets while retaining access to the original text for inspection.
We use Google's TranslateGemma to translate non-English event titles, descriptions and key points into English. The original text remains in event, while the translation is stored in english. For events originally in English, the field is unchanged from the source text.
Multiple locationsWe identify an event’s primary location and resolve named places and geopolitical entities to coordinates, recording how each was found in the original event text.
Events can involve more than one place. A single location can miss the geographic scope of a cross-border development and leave researchers unable to find an event when searching for another country or geographic region mentioned in the event.
We identify an event's primary geographic context from its title and description, then resolve named locations and geopolitical entities to coordinates. The locations field records each place, how it was found and which is the primary location for the event.
Event key pointsWe extract key points from event sources, capturing named entities and relationships alongside each event's title and description, including the companies and products involved.
An event's title and description don't always capture every detail a researcher or AI agent needs. Key points add facts about the people, companies and products involved, including how they are connected.
We added event.points, a list of factual points drawn from an event's sources. The points sit alongside the title and description in the original event field, and their English translations are available in english for analysis across languages and markets.
AvailabilityWe record hourly source-document counts in a top-level field and remove raw timestamps that slowed processing of large events with extensive source coverage.
Large events can be reported by thousands of sources. In V1.2, retaining raw timestamps could make event records large and slow to process, while researchers still needed to know when the coverage appeared and how it developed over the lifetime of the event.
V2.0 removes the raw timestamps field and adds availability as a top-level field. It records source-document counts by hour, giving researchers a time series of coverage that they can use without carrying and processing every individual timestamp.
Moving From World V1.2 to V2.0
We made V2.0 a fork of V1.2 to make migration as straightforward as possible.
V2.0 retains many event fields, but entity extraction, ontology classifications and ticker mappings have changed. The comparison summarizes the changes between V1.2 and V2.0. Before updating your pipeline, compare the fields and companies you use, and check the production data dictionary and a sample of your delivery.
| Field | V1.2 | V2.0 | What changed |
|---|---|---|---|
english | — | Added | English translations of titles, descriptions and points. |
availability | — | Added | Hourly source counts promoted from timestamps. |
locations | — | Added | Multiple geographic locations for each event. |
sentiments | — | Added | Sentiment for each named entity in the event. |
triples | — | Added | Relationships between named entities in the event. |
timestamps | Present | Removed | Hourly counts retained in availability. |
coordinate | Present | Removed | Coordinates now stored in locations. |
extra | Present | Removed | Signal probabilities moved to signals. |
entities | Present | Updated | GLiNER replaces spaCy; JSON representation changes. |
ontology / ontologies | Present | Updated | Renamed; classification and JSON change. |
event | Present | Adds points containing key event facts. | |
coverage | Present | Adds first, last and most-seen timestamps. | |
signals | Present | Adds sentiment and forward-looking probabilities. | |
tickers | Present | Adds match scores and explanations for each company. | |
event_id | Present | Unchanged | No changes were made from V1.2 to V2.0. |
version | Present | Unchanged | No changes were made from V1.2 to V2.0. |
has_tickers | Present | Unchanged | No changes were made from V1.2 to V2.0. |
provenance | Present | Unchanged | No changes were made from V1.2 to V2.0. |
oai_vector | Present | Unchanged | No changes were made from V1.2 to V2.0. |
How does this affect Atlas?
World describes events as they happen. Atlas connects the entities and relationships found in those events into a point-in-time knowledge graph. Each World V2.0 event has a triples field containing relationships extracted from the event text. A triple has three parts: a subject, a predicate and an object. For example, Sprite → brand_of → Coca-Cola says that Sprite is a brand of Coca-Cola.
Each triple includes entity types, extraction scores and reranker scores. Every day, we aggregate triples across World events, resolve names to normalized entities and use independent sources to corroborate relationships. Those relationships become edges in Atlas. The graph records when relationships became known and retains their evidence, so you can reconstruct what was known on any date.
When Will V3.0 Be Released?
We plan to release World V3.0 in Q1 or Q2 of 2027. The goal is to make the dataset bigger by bringing in more sources and more of the web.
Start a World V2.0 Trial
If you're using World, start with events and companies you know. Compare V1.2 and V2.0 ticker mappings, entity extraction and ontology classifications. Test entity-level sentiment for companies across your investment universe.
I'm excited about the research these additions make possible, especially using entity-level sentiment to study how the same events affect different companies. Start a World V2.0 trial or talk to us about testing it with your investment universe.