_____ _ _
/ ____| | | |
| (___ | |_ _ __ __ _ _ __ __ _ ___| | ___ ___ _ __
\___ \| __| '__/ _` | '_ \ / _` |/ _ \ |/ _ \ / _ \| '_ \
____) | |_| | | (_| | | | | (_| | __/ | (_) | (_) | |_) |
|_____/ \__|_| \__,_|_| |_|\__, |\___|_|\___/ \___/| .__/
__/ | | |
|___/ |_|
Data Scientist | AI Engineer
Data scientist by trade, also trying to make GPUs go brrr!
I built InferenceX, an open-source tool for benchmarking LLM inference across different GPU configurations. It measures throughput, latency, TTFT, and real power efficiency using nvidia-smi. Works with any HuggingFace model that vLLM supports.
read more →I'd love to hear from you. Feel free to reach out!
$ echo "Looking forward to connecting with you!"
Looking forward to connecting with you!