https://github.com/cartazio/oh-punkin-pi/blob/main/scripts/build-binary.sh <—— my open source testbed harness i mention
Personal contact first name dot lastname at gmail you know the suffix
Biz email that gets auto filtered so I reply slightly sooner
to them
First name atsign wellposed dot sign {random gibber gabber to be ignored} com
I prefer following up email with phone because its a more efficient use of my time, :)
I'm currently building numerical computation tools for businesses using haskell.
I also like helping match awesome people with cool opportunities (when I get along with them :-) )
Submissions
[untitled]
1 points·by carterschonwald··0 comments
Language based security. 2011-2021
langsec.org
4 points·by carterschonwald··0 comments
3 Million Websites use Bootstrap today, here's a list!
meanpath.com
8 points·by carterschonwald··0 comments
Show HN: Try Purescript website, compiled with GHCJS so it runs client side
hdiff.luite.com
2 points·by carterschonwald··0 comments
Cryptol DSL, a tool for writing correct crypto algorithms, is now open-source
cryptol.net
181 points·by carterschonwald··24 comments
Haskell in the Newsroom [video]
infoq.com
97 points·by carterschonwald··27 comments
API design should be an alternating optimization
blog.cstheory.net
1 points·by carterschonwald··0 comments
Mapping high level constructs to LLVM IR
llvm.lyngvig.org
5 points·by carterschonwald··0 comments
OpenBlas project raising money for Haswell+Piledriver hardware
bountysource.com
23 points·by carterschonwald··8 comments
Feed Reader Written with Haskell and Ur/Web
reddit.com
1 points·by carterschonwald··0 comments
Ny haskell talk: who you gonna call? Ghc and its primops
vimeo.com
2 points·by carterschonwald··1 comments
Rename comic sans to comic cerns to commemorate higgs detection
change.org
1 points·by carterschonwald··0 comments
"Don’t waste your time in crappy startup jobs."
michaelochurch.wordpress.com
19 points·by carterschonwald··3 comments
Ask PG: did you just change the password hashes?
1 points·by carterschonwald··2 comments
Okcupid has huge security privilege escalation for all users
at the very least i have tools that let me easily hit better perf for fancy dense memory layouts, and the same tooling lets me experiment with frankly wildly wacky sparse and structured memory formats. the performance claims at least on the dense side are solid so far!
the sparsity angle is because i want magic in the world. like anyone with a really chunky computer like any of those mac mini pros or serious workstation / server tier compute should be able to train from scratch their one 31b equivalent model in a week or so tops is the goal post i have in mind
i definitely will be doing some drop of some faster attention kernels in the next few weeks.
like i can do all sorts of memory layout of tensors/matrices etc tricks that if you dont have the abstractions for it would just never happen. so i can optimize the kernel flops
amusingly ive been working on ultra sparse llm inference/ training/ model design because nature loaths a dense graph/matrix and cause i think it shoukd be possible. i actually stood up a 20-25 percent faster than sota causal fast attention kernel yesterday, will be standing up cuda/metal/armv8 kernels too and thats gonna be fun.
i genuinely think these models should be like 0.1 percent sparse for same capabilities we associate with them today, but theres no sane way to do that with extent tools. i built the right core tech for that in 2014 when there wasnt a market, but now there is and the experimentation velocity is wild.
amusingly llms really have a hard time using my simple apis because its not in distribution array programs. but i literally stood up cpu custom memory format and micro kernel for dense causal attention in less than 24-36 hours and outperforms the equivalent fused ggml/llama cpp fast oath by like 20-25 percent
5.6 sol is pretty good, its definitely very very well tuned, i'm not quite sure which of the others i should use near term, but theyre doing great work
this so true. its really hard to make sure a model isnt going off the rails if i dont see full cot. the fact that oai and anthropic models hide it now has made them less reliable. which is a shame
not sure about that, but im actively working on designing ultra sparse models that i want to have perform competitively with stuff 100-10_000 times larger. ehich does yield similar throughput. time will tell id it works out
one of the most hilarious examples of how the current wh admins false protectionism, in my mind, is the crucible steel bankruptcy in jan/feb 2025.
its a technological tragedy because it was the only facility im aware of globally that could actually manufacture steel based carbide alternatives at commercial volumes. idk if the relevant equipment is being operated by anyone post bankruptcy. powder steel equipment is a bit less destroyed when turned off, but i think the key blocker is that heat cycling a 3k centigrade furnace will age the material and cause cracking thatmakes it hard to resume the powederization flows
this is pretty cool. i think part of the root cause is current rlhf post training design around confidence and optics rather than cooperative transparent honesty. though its kinda an expensive hypothesis to dig into as a private individual
i literally had a co2 sensor for my engineering team last fall cause the space was so poorly ventilated. just measuring it continuously radically changed how everyone approached using the space packing wise and ventilation. smelled better too :p
.... i thought this was more widely known, granted i did write up a pretty wacky doc explaining way more fun experiments than these, and i have a fix that even prevents role collapse in my harness on github
Personal contact first name dot lastname at gmail you know the suffix Biz email that gets auto filtered so I reply slightly sooner to them First name atsign wellposed dot sign {random gibber gabber to be ignored} com
I prefer following up email with phone because its a more efficient use of my time, :)
I'm currently building numerical computation tools for businesses using haskell.
I also like helping match awesome people with cool opportunities (when I get along with them :-) )