Tackling the Anomaly Detection Process
Odysight.ai mainly deals with identifying, classifying and predicting behavioral and structural anomalies in complex mechanical systems. Their goal is to identify what these anomalies are and estimate their impact on the monitored system.
With Odysight.ai they’re focusing on two main aspects: verifying detection results and evaluating their proprietary models themselves. They are identifying what is missed, what is found, and what the thoughts of the model are on each anomaly detected.
For example, rust detection can appear as a very stable part of a metal rod which is stationary in relation to the rod itself. However, rust can also appear as corrosion-dust, where the rust particles are spread along the rod regardless of their origin’s location. In this case, although the model’s confidence in the presence of rust is similar, a different classification between rust and corrosion-dust is required.
Odysight.ai has multiple models per use case. This is where Dataloop came in as a provider initially, in order to verify their model performance and provide measured KPI scores for their clients. Working closely with Dataloop, Odysight.ai is able to detect critical issues saving millions of dollars in repairs and systems’ downtime. They are planning on introducing Dataloop as their integral data quality and model management engine, allowing them to improve life saving automations across critical industries such as aerospace, defense, railway and manufacturing.
Avoiding a Tedious Manual Process with Dataloop’s Accelerated Data Pipelines
Odysight.ai large data volumes, which originate from multiple live sensors, require a high-throughput labeling pipelines, which may span anywhere from 10s to 1000s of images per hour per sensor.
They tested multiple tools and services from different annotation platforms and providers, but what made them choose Dataloop was the data pipelines and the flexibility of their pipelines feature.
Odysight.ai creates their own custom work environment on the Dataloop platform. Having a very well defined platform in Dataloop helped Odysight.ai accelerate the configuration and deployment process itself, which was a real game changer for them.
How does Dataloop’s data pipelines work?
Dataloop's data pipelines are designed to streamline and accelerate the process of labeling and annotating large amounts of data. The pipelines are customizable and can be tailored to meet the specific needs of each client's data and use cases.
Step 1 | Data Ingestion: Ingest data from a variety of sources Including image and video data, audio, & text files. Done via direct upload, cloud storage integration, or API integration.
Step 2 | Data Preparation: Once data is ingested, it’s prepared for annotation. This may involve resizing images, converting file formats, or filtering out irrelevant data.
Step 3 | Auto-Annotation: Auto-annotations are considered at this point using the client model, this step will save time and money if done before sending it to a human annotator.
Step 4 | Data Annotation: The prepared data is then passed through Dataloop’s annotation tools, which allow human annotators to label and annotate the data according to the client’s specific requirements. The quality control phase can be improved using different methods such as smart sampling, real-time annotation validation, or post-processing validation. All methods save time and money using this automation integration into the workflow.
Step 5 | Data Export: Once annotated, it is exported in the desired format for use in machine learning models or other downstream applications. Dataloop’s pipelines can export data in a variety of formats, including JSON, CSV, and COCO.
It’s All About Saving Time and Money
“Working with Dataloop has proven to save Odysight.AI significantly in regards to money and time, by automating once tedious data-engineering and models’ evaluation procedures”
Yeshaia Zabaray, Senior Data Scientist at Odysight.AI
This claim considers the time they saved with their data scientists including the data engineering aspect. Meaning, most of the manual work was taken care of and they didn’t need to use their DevOps team to push data in. Integration was also very quick which also saved us time and money.
“When it comes to our high throughput use cases (a few thousand images per day) Dataloop saved our data scientists 80-90% of their models evaluation time”, says Yishaia Zabary, Data Scientist, Odysight.ai.
They coordinated and ordered tasks via FAAS. For every new image, a FAAS calculated pre-annotation and a QA task was automatically created for that image and pre-annotation.
They plan on using pipelines in the future for image-augmentations in order to assist annotators. FAAS generates additional knowledge on the image (for example, for each pixel it adds a layer of texture score) to enrich the information given to annotators and ease and improve their annotations.
Easily Compare Your Model Performance
How did Odysight.ai use Dataloop’s pipelines and model management tools?
Trained a baseline model → for each new image the model generates appropriate annotations → passed to QA annotation task for evaluation and corrections → back to the model for retraining (based on the QA task results) → repeat.
Dataloop revolutionized Odysight.ai's approach to anomaly detection and verification with their cutting-edge data infrastructure and operating system for AI companies. Dataloop's flexible data pipelines have proven to be a gamechanger for Odysight.ai in their anomaly detection process. By providing an end-to-end platform that covers the entire lifecycle, Dataloop has enabled Odysight.ai to accelerate their AI projects to production, reduce costs, and save extensive engineering efforts on complex tools. With Dataloop’s help, Odysight.ai has been able to fix critical issues in complex machinery, saving millions of dollars in repairs. Additionally, Dataloop has saved Odysight.ai drastically in regards to time and money every month. By automating their once-semi-manual process, Odysight.ai's data scientists have saved 80-90% of their model training and evaluation monthly time, and with the integration of pipelines, they plan to improve life-saving automations across critical industries. With Dataloop as their integral data quality and model management engine, Odysight.ai plans to improve life-saving automations across critical industries such as aerospace, defense, railway, and manufacturing. Dataloop's advanced data infrastructure and operating system for AI companies have proven to be the missing piece of the puzzle for Odysight.ai, enabling them to achieve breakthrough results and bring unparalleled value to their clients.
"Empowering businesses with a data-centric AI strategy lies at the core of our mission at Dataloop.
However, our impact goes beyond enabling AI production workflows; we're also dedicated to championing innovation and collaboration. This partnership with Yishaia and the Odysight.ai team exemplifies the remarkable progress we can achieve when forward-thinking technology and a great team of innovative individuals unite.
As Dataloop's CSM, my focus is on creating customizable work environments in collaboration with our customers to drive their AI operations. With Odysight.ai, we've already achieved significant milestones, and our journey is just beginning.
I'm very proud to be part of Odysight.ai's efforts to address critical issues within complex machinery and the impact on how industries manage and maintain their machinery."