Machine Learning Media Archive

How often have you searched in Google Photos or other cloud media storage and found nothing or not enough? At some point, I got fed up and decided to create my own Media Archive implementation, where I can search by any metadata, apply filters and sorting, and detect objects in images and videos using machine learning.

The program is available here, here or here on this page below.

This is 2.0.14 version of the program and it uses modern models from Hugging Face. For example, Florence 2 model can create one paragraph (around 100 words) image description almost as good as ChatGPT.

Please report any suggestions/bugs/comments on GitHub.

More technical details can be found in the GitHub README.md and RELEASE.md.

Indexing App

Folder to Index:

Machine Learning Models:

Min. Probability:

Add preview to index

Index Video

Video Indexing Interval (1-30000 ms):

OCR

Min. OCR Probability:

OCR Languages:

Extract EXIF information

Save Settings

 

Total Files to Index: 0

Files Indexed: 0

Files Indexed Successfully: 0

Files Indexed with Error: 0

Last 10 Files Status:

Indexing Progress: 0%

Processing Time:

Remaining Time:

Current File:

Current Operation:

Processing ML Backend:

Screen Wake Lock: No

Current Image:

Ready Archive Merging/Updating App

Remove preview from merged archive

Motion Detection and Object detection with Machine Learning from webcamera

Program initialization/Machine Learning model loading. Please wait...
Usually it takes 5-10 seconds, but if loading takes more than 30-60 seconds, refresh the page.

 

WebCam:

WebCam Resolution:

Default Maximum supported Custom

Custom Resolution (WxH)

Mode:

Motion Detection Interval Photos

Interval (ms):

Sensitivity (0-255):

Detect Objects

Min probability:

Use Flash

Use Zip

Save Settings

I could not find a good program, which can do motion detection and I made it myself. This program has several functions:

• Motion detection and take a photo when motion is detected and when motion level is more than specified sensitivity
• Detect and mark objects on the photo if the probability of object detection is more than specified.
• Interval photo for timelapse making.
• Turn on flash if the program is running on the Android phone.
• Add photos to zip file.
• Works fine on PC, Mac, Android Phone. Limited functionality works on iPad with Safari browser and it does not really work on iPhone.

Note 1: In Google Chrome it works only if the automatic download is enabled. If Chrome is configured to ask every time file path where to download the files, it will not work.

Note 2: Program will ask permission to access the camera immediately after starting. This is required to build a list of all available cameras.

If the program does not work well in this blog please try it here.

If Google Drive is mapped as an independent drive and the Browser is setup to automatically download photos to the Google Drive folder, then it can be used as home video surveillance.