ScreenRecord.in: https://screenrecord.in
I have worked remotely for most of my career and have found screen recording a useful tool to share ideas or ask questions. I liked the UX of Loom but always wondered if one could do it without installing any app. Turns out you can! Given today's browsers especially on desktops one can do a lot of things. ScreenRecord.in can record screen, webcam, mic and system audio if the browser supports them. Chrome has the best compatibility. All recording are stored in local storage I am figuring out what features to add.
don't get the $5 ones, they are probably just presence detector or at best distance detector and probably work on 24Ghz. Get the 60Ghz for breathing, heart rate, posture etc.
Unfortunately no. But fortunately, it isn't something new I have built. I use a Seed Studio sensor MR60BHA2 which has an ESP32 which sends the data to Home Assistant through ESPHome. Once it is in Home Assistant you can do automations and notifications. I mostly use it for elderly care. I have another DFRobot C1001 sensor but waiting for ESPHome to add support for it. It has fall detection also which is why I am planning to replace it. They are fairly accurate; ~90%; has been my experience. They work better when mounted on ceiling and have a cone like coverage.
I do it using MMWave sensor, 60Ghz one. Want to have more of them but installation is a pain as these need to be mounted on ceiling so WiFi based sensor would be awesome!
I find the web(HTML/CSS) the most open format for sharing. PDFs are hard to be consumed on smaller devices and much harder to be read by machines. I am working on a feature at Jaunt.com to convert PDFs to HTML. It shows up as reader mode icon. Please try it out and see if it is good enough. I personally think we need to do much better job.
https://jaunt.com
+1! Most LLMs can already output Mathpix markdown. I prompt it to do so and it gives the code and this use a rendering library to show the scalable and selectable equations. No wonder facebook nougat also uses it. Good stuff!
both openai and claude vision models are able do that for me. It is more expensive than tesseract which can run on cpu but I assume it will become similarly cheap in the near future with open models and as AI becomes ubiquitous.
Segmenting at lower resolution and then using them at higher resolution using resolution multipliers don't work as other items bleed in. FastSAM paper has some interesting ideas on doing this with CNNs which I guess SAM2 have superseded. However, the complication in the pipeline is not worth the result as I find vision LLMs are able to do almost the same task within the same OCR prompt.
nougat, donut are OSS. There are no OSS vision models but we will soon have them. MathPix API are also not OSS and I found them expensive compared to vision models.
Mathpix Markdown however is awesome and I ask LLMs to use that to denote formulas as latex is tricky to render in HTML because of things not matching. I don't know latex well so haven't gone deeper on it.
Maybe you could try extracting the text also using some pdf text extraction and use that also to compare. Might help fix numbers which tesseract gets wrong sometimes.
In my experience, this works well but doesn't scale to all kinds of documents.
For scientific papers; it can't render formulas. meta's nougat is the best model to do that.
For invoices and records; donut works better.
Both these models will fail in some cases so you end up running LLM to fix the issues.
Even with that LLM won't be able to do tables and charts justice, as the details were lost during OCR process (bold/italic/other nuances). I feel these might also be "classical" methods.
I have found vision models to be much better as they have the original document/image. Having prompts which are clear helps but still you won't get 100% results as they tend to venture off on their paths.
I believe that can be fixed using fine tuning but no good vision model provides fine tuning for images.
Google Gemini seems to have the feature but I haven't tried it.
Few shots prompting helps keep the LLM from hallucinating, prompt injection and helps adhering to the format requested.
Jaunt Labs is in the process of disrupting the professional content sharing landscape, focusing on documents, presentations, and more. Currently in our alpha launch phase, our momentum is building rapidly. Plus, our founders come with a track record, having successfully built and sold a startup in a similar domain. We aspire to become the platform which democratises knowledge and discussions around it.
We're actively seeking full-stack engineers to join our distributed team. With Django at our core, we're building scalable apps that can handle the demands of our network. On the frontend, it's all about ES6, no frameworks required.
Here's the structure: while autonomy is key, we touch base a few times weekly, typically around 9AM PST. You'll need at least an hour or two of overlap during these meetings.
Why consider us? Beyond the exciting work we're doing, you'll be part of a cohesive team, tackling challenges collaboratively and driving real change.
Interested in being part of our journey? Drop us a line about why you would like to join us at troy [at] jauntlabs.com or reach out directly to our founder at jon [at] jauntlabs.com. Let's build something remarkable together.
Bluetooth repeaters - BLE to WiFI so I can use them in Home Assistant
Button Bot - SwitchBot alternative
Wifi Calling Bell - Relay control calling bell with auto shut-off
Cameras - Uses ESPEye and ESP32 Cam, low res, low latency and does NOT hang Standing Desk - Turns on and off linear actuators
Water controllers - Relays attached to solenoids to automate my plants drip-watering and turn on sprinklers
PIR Sensors - A bit noisy, still not satisfied with performance
RF Transmitter - To replay RF signals
RF Receiver - To receive RF signals
The BLE Repeater has been really useful as it has helped me make many BLE devices available in Home Assistant making automations easy. The nRF connect app has been really helpful to make this happen.
Why use Slack? Slack has rate limits and one will not get the notifications when something real goes down as there will be 100s of messages overloading Slack API.
Thanks for RailsCasts Ryan! A few days back I read a thread on how ruby/rails is losing junior devs because of the complexity/can of worms docs of Rails 7. I believe it is because we are missing high quality content like RailsCasts today.