AI glossary first submission#525
AI glossary first submission#525kelbrown20 wants to merge 1 commit intoredhat-documentation:mainfrom
Conversation
bergerhoffer
left a comment
There was a problem hiding this comment.
Here's a first pass at a few bits of feedback!
supplementary_style_guide/glossary_terms_conventions/general_conventions/i.adoc
Outdated
Show resolved
Hide resolved
supplementary_style_guide/glossary_terms_conventions/general_conventions/i.adoc
Outdated
Show resolved
Hide resolved
supplementary_style_guide/glossary_terms_conventions/general_conventions/i.adoc
Outdated
Show resolved
Hide resolved
supplementary_style_guide/glossary_terms_conventions/general_conventions/i.adoc
Outdated
Show resolved
Hide resolved
supplementary_style_guide/glossary_terms_conventions/general_conventions/i.adoc
Outdated
Show resolved
Hide resolved
supplementary_style_guide/glossary_terms_conventions/general_conventions/i.adoc
Outdated
Show resolved
Hide resolved
supplementary_style_guide/glossary_terms_conventions/general_conventions/i.adoc
Outdated
Show resolved
Hide resolved
supplementary_style_guide/glossary_terms_conventions/general_conventions/i.adoc
Outdated
Show resolved
Hide resolved
supplementary_style_guide/glossary_terms_conventions/general_conventions/i.adoc
Outdated
Show resolved
Hide resolved
supplementary_style_guide/glossary_terms_conventions/general_conventions/i.adoc
Outdated
Show resolved
Hide resolved
57f011f to
428a59e
Compare
|
@kelbrown20 Is this ready for a re-review? |
428a59e to
cd48339
Compare
|
My apologies for the delay @bergerhoffer! |
sbmetz
left a comment
There was a problem hiding this comment.
Some minor wording tweaks
supplementary_style_guide/glossary_terms_conventions/general_conventions/i.adoc
Outdated
Show resolved
Hide resolved
supplementary_style_guide/glossary_terms_conventions/general_conventions/i.adoc
Outdated
Show resolved
Hide resolved
supplementary_style_guide/glossary_terms_conventions/general_conventions/i.adoc
Show resolved
Hide resolved
cd48339 to
0aa5764
Compare
|
|
||
| *See also*: | ||
|
|
||
| [[inferencing]] |
There was a problem hiding this comment.
| [[inferencing]] | |
| [[inference serving]] |
There was a problem hiding this comment.
"Inference serving" seems to be the proper form.
There was a problem hiding this comment.
They seem to both be correct terms, but they have different meanings.
There was a problem hiding this comment.
OK. So maybe we need "inferencing" and "inference serving"?
Inferencing - the process of running a model
Inference Serving - deploying the inferencing capability on a server
Something like this?
There was a problem hiding this comment.
Yes, that looks about right.
|
|
||
| [[inference]] | ||
| ==== image:images/yes.png[yes] inference (noun) | ||
| *Description*: The act a model generating outputs from input data. For example, "Inference speeds increased on the new models" |
There was a problem hiding this comment.
| *Description*: The act a model generating outputs from input data. For example, "Inference speeds increased on the new models" | |
| *Description*: The process in which a trained model is loaded into memory and generates output based on input data. | |
| For example, "The Llama-3.2-90B-Vision-Instruct-FP8-dynamic model performs inference to identify objects in an image." |
There was a problem hiding this comment.
@aireilly This is an improvement in the definition. Thanks. I'd like to rewrite this a bit. In general, we write definitions as complete sentences. How's this?
| *Description*: The act a model generating outputs from input data. For example, "Inference speeds increased on the new models" | |
| *Description*: AI inference is the process in which a trained model is loaded into memory and then the makes predictions or performs tasks on new data. For example, "The Llama-3.2-90B-Vision-Instruct-FP8-dynamic model performs inference to identify objects in an image." |
There was a problem hiding this comment.
| *Description*: The act a model generating outputs from input data. For example, "Inference speeds increased on the new models" | |
| *Description*: AI inference is the process in which a trained model is loaded into memory and then makes predictions based on input data. For example, "The Llama-3.2-90B-Vision-Instruct-FP8-dynamic model performs inference to identify objects in an image." |
What about this?
|
|
||
| [[inferencing]] | ||
| ==== image:images/yes.png[yes] inferencing (noun) | ||
| *Description*: A process by which a model processes input data, deduce information, and generates an output. For example, "The inferencing workload is distributed across multiple accelerators." |
There was a problem hiding this comment.
| *Description*: A process by which a model processes input data, deduce information, and generates an output. For example, "The inferencing workload is distributed across multiple accelerators." | |
| *Description*: The act of deploying and running a trained model so that it can process input data and generate output. | |
| For example, "Use vLLM to inference serve a trained model." |
There was a problem hiding this comment.
@aireilly Both definitions are correct. We just have to decide if we want to put both "inferencing" and "inference serving" in the SSG or choose one over the other.
IngridT1
left a comment
There was a problem hiding this comment.
I won't be able to merge these without some discussion and changes.
|
|
||
| [[inference]] | ||
| ==== image:images/yes.png[yes] inference (noun) | ||
| *Description*: The act a model generating outputs from input data. For example, "Inference speeds increased on the new models" |
There was a problem hiding this comment.
@aireilly This is an improvement in the definition. Thanks. I'd like to rewrite this a bit. In general, we write definitions as complete sentences. How's this?
| *Description*: The act a model generating outputs from input data. For example, "Inference speeds increased on the new models" | |
| *Description*: AI inference is the process in which a trained model is loaded into memory and then the makes predictions or performs tasks on new data. For example, "The Llama-3.2-90B-Vision-Instruct-FP8-dynamic model performs inference to identify objects in an image." |
|
|
||
| *See also*: | ||
|
|
||
| [[inferencing]] |
There was a problem hiding this comment.
They seem to both be correct terms, but they have different meanings.
|
|
||
| [[inferencing]] | ||
| ==== image:images/yes.png[yes] inferencing (noun) | ||
| *Description*: A process by which a model processes input data, deduce information, and generates an output. For example, "The inferencing workload is distributed across multiple accelerators." |
There was a problem hiding this comment.
@aireilly Both definitions are correct. We just have to decide if we want to put both "inferencing" and "inference serving" in the SSG or choose one over the other.
|
Would be great to make some progress on this. Any idea when we might get this work completed @IngridT1? |
This PR adds new AI terms to the style guide glossary