Skip to content
View azrabano23's full-sized avatar

Block or report azrabano23

Block user

Prevent this user from interacting with your repositories and sending you notifications. Learn more about blocking users.

You must be logged in to block users.

Maximum 250 characters. Please don’t include any personal information such as legal names or email addresses. Markdown is supported. This note will only be visible to you.
Report abuse

Contact GitHub support about this user’s behavior. Learn more about reporting abuse.

Report abuse
azrabano23/README.md

circadian alertness curve — the two-process model

ML researcher & engineer. ECE + math at Rutgers ('27) — not your average CS major (I'm Engineering). Previously: Google (Ads AI/ML), NASA, Goldman Sachs, Columbia AI. First author of arXiv:2601.18710. Founder of the Grey Matter Society at Yale School of Medicine.

The thread through everything I build: measurements that survive scrutiny — leave-one-subject-out splits, false-discovery-rate control, confidence intervals on everything, and reporting the null results most people bury.

now

  • interpretability & evalsinterp asks why a model made a prediction (logit lens, activation patching, SAE features) from inside your coding agent · evalkit is evals done right — bootstrap CIs, unbiased pass@k, judge-bias controls · steering-audit found that only 31–50% of "successful" activation steers stay coherent — the classifier can't tell degenerate text from a steered one · cross-sae matches sparse-autoencoder features between vision models and human visual cortex, with the false-discovery rate actually controlled
  • ML for medicinethaakat: endometriosis detection from pelvic MRI, AUC 0.961 on a patient-level split (the honest kind) · vigil: pilot cognitive state from EEG/ECG, where fixing the leaky eval cost 0.19 AUROC — I kept the honest number · aurelis: an LLM judge for clinical notes, validated against human graders · neuroloop: closed-loop neuromodulation graphs that prove their safety envelope before they run
  • biological time — the niche I keep coming back to: circa · rhythmrx · fitra — the right intervention at the right circadian phase
  • carbonium — with @RyanRana, exploring whether an abductive engine over fleet-maintenance data can name a failure and its evidence chain — and be evaluated with confounder traps so it can't bluff

upstream

I'd rather fix the ruler than argue about the measurement. PRs to the tools researchers actually run —

  • merged · TransformerLens — direct logit attribution · inspect_evals (UK AI Security Institute) — MedCalc-Bench · nnsight — multi-invoker .backward() fix · MOABB — Nadeau–Bengio corrected t-test, so EEG benchmarks stop reporting optimistic p-values · braindecode — spec-compliant zarr JSON in Hub stores
  • in review · HELM — a regex that scored correct answers 0, ×2: opt-in dedup for MedHELM's ~33%-duplicate dialog test set · Medplum — GraphQL error semantics · MONAI — invertible NormalizeIntensity · SAELens — covariance whitening · garak — NonEngagement detector · pyvene — ELECTRA support · lifelines — RMST was returning the wrong variance (~34× inflated); now Greenwood, validated against survRM2 · PyHealth — evaluation loss was batch-size-dependent, quietly steering checkpoint selection; now example-weighted and pooled · TorchIO — Motion's "rigid" transform moved content along the wrong axis by the wrong amount; now convention-aligned with Affine · dynamo ×2 · SkyPilot · FlashInfer
  • in discussion · lm-evaluation-harness #3080 — design for per-instance repeats aggregation with unbiased pass@k

elsewhere

azra-bano.com · linkedin · arxiv · email

Pinned Loading

  1. BlackStart BlackStart Public

    microgrid disaster simulation software

    Jac

  2. evalkit evalkit Public

    Evaluate LLMs the right way — confidence intervals, unbiased pass@k, significance testing, bias-controlled LLM-as-judge, contamination checks. A drop-in agent skill with a numpy stats core validate…

    Python

  3. interp interp Public

    Ask your coding agent WHY a language model made a prediction — mechanistic interpretability (logit lens, activation patching, SAE features, steering) as a drop-in agent skill. Validated against pub…

    Python

  4. nomos nomos Public

    Forked from RyanRana/nomos

    rl traffic coordination for autonomous vechicles

    Python

  5. TransformerLens TransformerLens Public

    Forked from TransformerLensOrg/TransformerLens

    Fork for PR #1369 (merged): Direct Logit Attribution tool

    Python