Automatic Summarization of Job Description with LLMs

A workflow using Llama 3-70B to fetch and summarize job descriptions. Optimized inference on a Kubernetes Cluster using continuous batching.

Tech Stack: Python, LLM Inference, Ollama

Github repo here.

Workflow Breakup