thatDot Novelty
Easy Real-Time Anomaly Detection
AI-driven contextual awareness for near zero false positives
Product Overview
Streaming anomaly detection without hassle
Use Novelty to find novel events or patterns when you don’t know what to look for—unknown unknowns. The unique built-in graph pattern learning AI in Novelty will learn what is normal in your data as it streams in and rank every event according to how anomalous it is.
Cybersecurity
Monitor network, device, user, and application data for unusual configuration changes or access patterns.
Network optimization
Identify network route inefficiencies, and eliminate redundant alerts through topology awareness.
Fraud detection
Analyze usage for excess concurrent usage, and generate events to enforce entitlement compliance.
Log data reduction
Intelligently filter log data to eliminate the huge bulk of uninformative data, and highlight what’s important.
General anomaly detection
Black swan events and unknown unknowns can be extremely hard to detect since you don’t know what to look for. Novelty finds them and increases your knowledge about your data.
Edge system abnormalities
Filter away the bulk of irrelevant readings to spotlight potential problems for predictive maintenance, smart metering, asset monitoring, process automation, and improving customer experiences.
Key Features
Find anomalous data fast
When you don’t know what pattern to look for in a data stream, you just want to find the exceptions, the occurrences that don’t fit the norm, Novelty is simple, fast and accurate. No extra data wrangling or data labeling is required. It’s completely unsupervised. It builds a detailed behavioral fingerprint of your data environment for powerful contextual awareness. Feed it data, and it will score every event according to how unusual it is in your data set, and will also explain WHY an event is novel.
Reduce false positives
New is not always novel. Novelty uses its context awareness to accurately tell the difference. For example, in the diagram to the right, yellow dots are unique, but sometimes one-of-a-kind events are normal. Only the ones with highest novelty scores at the top are genuine anomalies.
Analyze categorical data
The most important data is frequently not numeric—entity and user behavior analytics (EUBA), network address and traffic analytics, physical simulation of a real thing (digital twins) etc. Novelty’s built-in AI analyzes categorical data as is, even if it has high cardinality. There’s no need to delay analysis to transform categorical data into sparse, bloated numeric data. Novelty analyzes the existing data and returns detailed scores for novelty, uniqueness, information content, and probability within seconds.
Get answers 1000 times faster
We benchmarked Novelty against a standard Isolation Forest algorithm—the next most commonly used anomaly detection system—on the same data on the same 8-CPU, 16 GB virtual machines. Isolation Forest managed as many as 500 events per second. With Novelty, you can score over 15,000 events per second on a single moderately-sized instance.
Transform data right in the stream
Several data transformation functions are included in Novelty so you won’t need a separate transformation layer before you can use it. Stream raw data in directly.
Leverage your expert knowledge
You can limit or remove the influence of highly novel observations you know are not important. You can also boost particular factors that you know have a high impact on how novel something might be.
You can:
1. Remove individual or groups of observations.
2. Define a rolling window of observations.
3. Delete entire contexts from the system.
Recent posts
-
Stream Processing World Meets Streaming Graph at Current 2024
The thatDot team had a great time last week at Confluent’s big conference, Current 2024. We talked to a lot of folks about the power of Streaming Graph,…
-
Streaming Graph for Real-Time Risk Analysis at Data Connect in Columbus 2024
After more than 25 years in the data management and analysis industry, I had a brand new experience. I attended a technical conference. No, that wasn’t the new…
-
Cypher all the things!
Uses for individual data engineering technologies are often broadened to more than just interacting with databases. The same goes for graph database techniques and, specifically, the leading language…
Want to read more news and other posts? Visit the resource center for all things thatDot.
Help Center
Streaming Graph Help
Novelty Help